answer multiple-choice questions: Topics by Science.gov

Sample records for answer multiple-choice questions

The Answering Process for Multiple-Choice Questions in Collaborative Learning: A Mathematical Learning Model Analysis

ERIC Educational Resources Information Center

Nakamura, Yasuyuki; Nishi, Shinnosuke; Muramatsu, Yuta; Yasutake, Koichi; Yamakawa, Osamu; Tagawa, Takahiro

2014-01-01

In this paper, we introduce a mathematical model for collaborative learning and the answering process for multiple-choice questions. The collaborative learning model is inspired by the Ising spin model and the model for answering multiple-choice questions is based on their difficulty level. An intensive simulation study predicts the possibility of…
Retrieval practice with short-answer, multiple-choice, and hybrid tests.

PubMed

Smith, Megan A; Karpicke, Jeffrey D

2014-01-01

Retrieval practice improves meaningful learning, and the most frequent way of implementing retrieval practice in classrooms is to have students answer questions. In four experiments (N=372) we investigated the effects of different question formats on learning. Students read educational texts and practised retrieval by answering short-answer, multiple-choice, or hybrid questions. In hybrid conditions students first attempted to recall answers in short-answer format, then identified answers in multiple-choice format. We measured learning 1 week later using a final assessment with two types of questions: those that could be answered by recalling information verbatim from the texts and those that required inferences. Practising retrieval in all format conditions enhanced retention, relative to a study-only control condition, on both verbatim and inference questions. However, there were little or no advantages of answering short-answer or hybrid format questions over multiple-choice questions in three experiments. In Experiment 4, when retrieval success was improved under initial short-answer conditions, there was an advantage of answering short-answer or hybrid questions over multiple-choice questions. The results challenge the simple conclusion that short-answer questions always produce the best learning, due to increased retrieval effort or difficulty, and demonstrate the importance of retrieval success for retrieval-based learning activities.
Further Support for Changing Multiple-Choice Answers.

ERIC Educational Resources Information Center

Fabrey, Lawrence J.; Case, Susan M.

1985-01-01

The effect on test scores of changing answers to multiple-choice questions was studied and compared to earlier research. The current setting was a nationally administered, in-training, specialty examination for medical residents in obstetrics and gynecology. Both low and high scorers improved their scores when they changed answers. (SW)
Comparing comprehension measured by multiple-choice and open-ended questions.

PubMed

Ozuru, Yasuhiro; Briner, Stephen; Kurby, Christopher A; McNamara, Danielle S

2013-09-01

This study compared the nature of text comprehension as measured by multiple-choice format and open-ended format questions. Participants read a short text while explaining preselected sentences. After reading the text, participants answered open-ended and multiple-choice versions of the same questions based on their memory of the text content. The results indicated that performance on open-ended questions was correlated with the quality of self-explanations, but performance on multiple-choice questions was correlated with the level of prior knowledge related to the text. These results suggest that open-ended and multiple-choice format questions measure different aspects of comprehension processes. The results are discussed in terms of dual process theories of text comprehension. PsycINFO Database Record (c) 2013 APA, all rights reserved
Analyzing Student Confidence in Classroom Voting with Multiple Choice Questions

ERIC Educational Resources Information Center

Stewart, Ann; Storm, Christopher; VonEpps, Lahna

2013-01-01

The purpose of this paper is to present results of a recent study in which students voted on multiple choice questions in mathematics courses of varying levels. Students used clickers to select the best answer among the choices given; in addition, they were also asked whether they were confident in their answer. In this paper we analyze data…
Written Justifications to Multiple-Choice Concept Questions during Active Learning in Class

ERIC Educational Resources Information Center

Koretsky, Milo D.; Brooks, Bill J.; Higgins, Adam Z.

2016-01-01

Increasingly, instructors of large, introductory STEM courses are having students actively engage during class by answering multiple-choice concept questions individually and in groups. This study investigates the use of a technology-based tool that allows students to answer such questions during class. The tool also allows the instructor to…
Student certainty answering misconception question: study of Three-Tier Multiple-Choice Diagnostic Test in Acid-Base and Solubility Equilibrium

NASA Astrophysics Data System (ADS)

Ardiansah; Masykuri, M.; Rahardjo, S. B.

2018-04-01

Students’ concept comprehension in three-tier multiple-choice diagnostic test related to student confidence level. The confidence level related to certainty and student’s self-efficacy. The purpose of this research was to find out students’ certainty in misconception test. This research was quantitative-qualitative research method counting students’ confidence level. The research participants were 484 students that were studying acid-base and equilibrium solubility subject. Data was collected using three-tier multiple-choice (3TMC) with thirty questions and students’ questionnaire. The findings showed that #6 item gives the highest misconception percentage and high student confidence about the counting of ultra-dilute solution’s pH. Other findings were that 1) the student tendency chosen the misconception answer is to increase over item number, 2) student certainty decreased in terms of answering the 3TMC, and 3) student self-efficacy and achievement were related each other in the research. The findings suggest some implications and limitations for further research.
High time for a change: psychometric analysis of multiple-choice questions in nursing.

PubMed

Redmond, Sandra P; Hartigan-Rogers, Jackie A; Cobbett, Shelley

2012-11-26

Nurse educators teach students to develop an informed nursing practice but can educators claim the same grounding in the available evidence when formulating multiple-choice assessment tools to evaluate student learning? Multiple-choice questions are a popular assessment format within nursing education. While widely accepted as a credible format to assess student knowledge across disciplines, debate exists among educators regarding the number of options necessary to adequately test cognitive reasoning and optimal discrimination between student abilities. The purpose of this quasi-experimental between groups study was to examine the psychometric properties of three option multiple-choice questions when compared to the more traditional four option questions. Data analysis revealed that there were no statistically significant differences in the item discrimination, difficulty or the mean examination scores when multiple-choice test questions were administered with three versus four option answer choices. This study provides additional guidance for nurse educators to assist in improving multiple-choice question writing and test design.
A Two-Tier Multiple Choice Questions to Diagnose Thermodynamic Misconception of Thai and Laos Students

NASA Astrophysics Data System (ADS)

Kamcharean, Chanwit; Wattanakasiwich, Pornrat

The objective of this study was to diagnose misconceptions of Thai and Lao students in thermodynamics by using a two-tier multiple-choice test. Two-tier multiple choice questions consist of the first tier, a content-based question and the second tier, a reasoning-based question. Data of student understanding was collected by using 10 two-tier multiple-choice questions. Thai participants were the first-year students (N = 57) taking a fundamental physics course at Chiang Mai University in 2012. Lao participants were high school students in Grade 11 (N = 57) and Grade 12 (N = 83) at Muengnern high school in Xayaboury province, Lao PDR. As results, most students answered content-tier questions correctly but chose incorrect answers for reason-tier questions. When further investigating their incorrect reasons, we found similar misconceptions as reported in previous studies such as incorrectly relating pressure with temperature when presenting with multiple variables.
Two layers LSTM with attention for multi-choice question answering in exams

NASA Astrophysics Data System (ADS)

Li, Yongbin

2018-03-01

Question Answering in Exams is typical question answering task that aims to test how accurately the model could answer the questions in exams. In this paper, we use general deep learning model to solve the multi-choice question answering task. Our approach is to build distributed word embedding of question and answers instead of manually extracting features or linguistic tools, meanwhile, for improving the accuracy, the external corpus is introduced. The framework uses a two layers LSTM with attention which get a significant result. By contrast, we introduce the simple long short-term memory (QA-LSTM) model and QA-LSTM-CNN model and QA-LSTM with attention model as the reference. Experiment demonstrate superior performance of two layers LSTM with attention compared to other models in question answering task.
Augmenting Fellow Education Through Spaced Multiple-Choice Questions.

PubMed

Barsoumian, Alice E; Yun, Heather C

2018-01-01

The San Antonio Uniformed Services Health Education Consortium Infectious Disease Fellowship program historically included a monthly short-answer and multiple-choice quiz. The intent was to ensure medical knowledge in relevant content areas that may not be addressed through clinical rotations, such as operationally relevant infectious disease. After completion, it was discussed in a small group with faculty. Over time, faculty noted increasing dissatisfaction with the activity. Spaced interval education is useful in retention of medical knowledge and skills by medical students and residents. Its use in infectious disease fellow education has not been described. To improve the quiz experience, we assessed the introduction of spaced education curriculum in our program. A pre-intervention survey was distributed to assess the monthly quiz with Likert scale and open-ended questions. A multiple-choice question spaced education curriculum was created using the Qstream(R) platform in 2011. Faculty development on question writing was conducted. Two questions were delivered every 2 d. Incorrectly and correctly answered questions were repeated after 7 and 13 d, respectively. Questions needed to be answered correctly twice to be retired. Fellow satisfaction was assessed at semi-annual fellowship reviews over 5 yr and by a one-time repeat survey. Pre-intervention survey of six fellows indicated dissatisfaction with the time commitment of the monthly quiz (median Likert score of 2, mean 6.5 h to complete), neutral in perceived utility, but satisfaction with knowledge retention (Likert score 4). Eighteen fellows over 5 yr participated in the spaced education curriculum. Three quizzes with 20, 39, and 48 questions were designed. Seventeen percentage of questions addressed operationally relevant topics. Fifty-nine percentage of questions were answered correctly on first attempt, improving to 93% correct answer rate at the end of the analysis. Questions were attempted 2,999 times
How did you guess? Or, what do multiple-choice questions measure?

PubMed

Cox, K R

1976-06-05

Multiple-choice questions classified as requiring problem-solving skills have been interpreted as measuring problem-solving skills within students, with the implicit hypothesis that questions needing an increasingly complex intellectual process should present increasing difficulty to the student. This hypothesis was tested in a 150-question paper taken by 721 students in seven Australian medical schools. No correlation was observed between difficulty and assigned process. Consequently, the question-answering process was explored with a group of final-year students. Anecdotal recall by students gave heavy weight to knowledge rather than problem solving in answering these questions. Assignment of the 150 questions to the classification by three teachers and six students showed their congruence to be a little above random probability.
Delayed, but not immediate, feedback after multiple-choice questions increases performance on a subsequent short-answer, but not multiple-choice, exam: evidence for the dual-process theory of memory.

PubMed

Sinha, Neha; Glass, Arnold Lewis

2015-01-01

Three experiments, two performed in the laboratory and one embedded in a college psychology lecture course, investigated the effects of immediate versus delayed feedback following a multiple-choice exam on subsequent short answer and multiple-choice exams. Performance on the subsequent multiple-choice exam was not affected by the timing of the feedback on the prior exam; however, performance on the subsequent short answer exam was better following delayed than following immediate feedback. This was true regardless of the order in which immediate versus delayed feedback was given. Furthermore, delayed feedback only had a greater effect than immediate feedback on subsequent short answer performance following correct, confident responses on the prior exam. These results indicate that delayed feedback cues a student's prior response and increases subsequent recollection of that response. The practical implication is that delayed feedback is better than immediate feedback during academic testing.
Multiple-Choice and Short-Answer Exam Performance in a College Classroom

ERIC Educational Resources Information Center

Funk, Steven C.; Dickson, K. Laurie

2011-01-01

The authors experimentally investigated the effects of multiple-choice and short-answer format exam items on exam performance in a college classroom. They randomly assigned 50 students to take a 10-item short-answer pretest or posttest on two 50-item multiple-choice exams in an introduction to personality course. Students performed significantly…
The Effects of Question Generation, Question Answering and Reading on Prose Learning.

ERIC Educational Resources Information Center

Owens, Anthony Mathew

Eighty-seven students took part in a study (using three experimental conditions) of the effect of question generation, question answering, and rereading on an immediate posttest and on a delayed test of knowledge of a text passage. In condition G, subjects generated multiple-choice questions that would test knowledge of each of the six content…
Wrong Answers on Multiple-Choice Achievement Tests: Blind Guesses or Systematic Choices?.

ERIC Educational Resources Information Center

Powell, J. C.

A multi-faceted model for the selection of answers for multiple-choice tests was developed from the findings of a series of exploratory studies. This model implies that answer selection should be curvilinear. A series of models were tested for fit using the chi square procedure. Data were collected from 359 elementary school students ages 9-12.…
Measuring University students' understanding of the greenhouse effect - a comparison of multiple-choice, short answer and concept sketch assessment tools with respect to students' mental models

NASA Astrophysics Data System (ADS)

Gold, A. U.; Harris, S. E.

2013-12-01

The greenhouse effect comes up in most discussions about climate and is a key concept related to climate change. Existing studies have shown that students and adults alike lack a detailed understanding of this important concept or might hold misconceptions. We studied the effectiveness of different interventions on University-level students' understanding of the greenhouse effect. Introductory level science students were tested for their pre-knowledge of the greenhouse effect using validated multiple-choice questions, short answers and concept sketches. All students participated in a common lesson about the greenhouse effect and were then randomly assigned to one of two lab groups. One group explored an existing simulation about the greenhouse effect (PhET-lesson) and the other group worked with absorption spectra of different greenhouse gases (Data-lesson) to deepen the understanding of the greenhouse effect. All students completed the same assessment including multiple choice, short answers and concept sketches after participation in their lab lesson. 164 students completed all the assessments, 76 completed the PhET lesson and 77 completed the data lesson. 11 students missed the contrasting lesson. In this presentation we show the comparison between the multiple-choice questions, short answer questions and the concept sketches of students. We explore how well each of these assessment types represents student's knowledge. We also identify items that are indicators of the level of understanding of the greenhouse effect as measured in correspondence of student answers to an expert mental model and expert responses. Preliminary data analysis shows that student who produce concept sketch drawings that come close to expert drawings also choose correct multiple-choice answers. However, correct multiple-choice answers are not necessarily an indicator that a student produces an expert-like correlating concept sketch items. Multiple-choice questions that require detailed
Memorial Consequences of Answering SAT II Questions

ERIC Educational Resources Information Center

Marsh, Elizabeth J.; Agarwal, Pooja K.; Roediger, Henry L., III

2009-01-01

Many thousands of students take standardized tests every year. In the current research, we asked whether answering standardized test questions affects students' later test performance. Prior research has shown both positive and negative effects of multiple-choice testing on later tests, with negative effects arising from students selecting…
A Participatory Learning Approach to Biochemistry Using Student Authored and Evaluated Multiple-Choice Questions

ERIC Educational Resources Information Center

Bottomley, Steven; Denny, Paul

2011-01-01

A participatory learning approach, combined with both a traditional and a competitive assessment, was used to motivate students and promote a deep approach to learning biochemistry. Students were challenged to research, author, and explain their own multiple-choice questions (MCQs). They were also required to answer, evaluate, and discuss MCQs…
Optimizing multiple-choice tests as tools for learning.

PubMed

Little, Jeri L; Bjork, Elizabeth Ligon

2015-01-01

Answering multiple-choice questions with competitive alternatives can enhance performance on a later test, not only on questions about the information previously tested, but also on questions about related information not previously tested-in particular, on questions about information pertaining to the previously incorrect alternatives. In the present research, we assessed a possible explanation for this pattern: When multiple-choice questions contain competitive incorrect alternatives, test-takers are led to retrieve previously studied information pertaining to all of the alternatives in order to discriminate among them and select an answer, with such processing strengthening later access to information associated with both the correct and incorrect alternatives. Supporting this hypothesis, we found enhanced performance on a later cued-recall test for previously nontested questions when their answers had previously appeared as competitive incorrect alternatives in the initial multiple-choice test, but not when they had previously appeared as noncompetitive alternatives. Importantly, however, competitive alternatives were not more likely than noncompetitive alternatives to be intruded as incorrect responses, indicating that a general increased accessibility for previously presented incorrect alternatives could not be the explanation for these results. The present findings, replicated across two experiments (one in which corrective feedback was provided during the initial multiple-choice testing, and one in which it was not), thus strongly suggest that competitive multiple-choice questions can trigger beneficial retrieval processes for both tested and related information, and the results have implications for the effective use of multiple-choice tests as tools for learning.

The Incidence of Clueing in Multiple Choice Testbank Questions in Accounting: Some Evidence from Australia

ERIC Educational Resources Information Center

Ibbett, Nicole L.; Wheldon, Brett J.

2016-01-01

In 2014 Central Queensland University (CQU) in Australia banned the use of multiple choice questions (MCQs) as an assessment tool. One of the reasons given for this decision was that MCQs provide an opportunity for students to "pass" by merely guessing their answers. The mathematical likelihood of a student passing by guessing alone can…
Relationship of awards in multiple choice questions and structured answer questions in the undergraduate years and their effectiveness in evaluation.

PubMed

Khan, Junaid Sarfraz; Mukhtar, Osama; Tabasum, Saima; Shaheen, Naveed; Farooq, M; Irfan, M Abdul; Sattar, Ajmal; Nabeel, M; Imran, M; Rafique, Sadia; Iqbal, Maryam; Afzal, M Sheraz; Hameed, M Shahbaz; Habib, Maryam; Jabeen, Uzma; Mubbashar, Malik Hussain

2010-01-01

A number of evaluation tools for assessing the cognitive and affective domains in accordance with Bloom's taxonomy are available for summative assessment. At the University of Health Sciences, Lahore, Multiple Choice Questions (MCQs) and Structured Answer Questions (SAQs) are used for the evaluation of the cognitive domain at all six hierarch levels of taxonomy using the tables of specifications to ensure content validity. The rationale of having two evaluation tools seemingly similar in their evaluative competency yet differing in feasibility of construction, administration and marking is being challenged in this study. The MCQ and SAQ awards of the ten percent sample population amounting to 985 students in fifteen Medical and Dental Colleges across Punjab were entered into SPSS-15 and correlated according to the cognitive and affective level of assessment in relation to the Bloom's taxonomy and their grouping in the Tables of Specifications, using parametric tests. 3494 anonymously administered questionnaires were analyzed using ethnograph. No statistically significant difference was found in the mean marks obtained by the students when MCQs and SAQs were compared according to their groupings in the Tables of Specifications at all levels of cognitive hierarchical testing. End-of-yearcognitive level testing targets set were not met and more questions were set at the lower cognitive testing levels. Expenses incurred in setting MCQs and SAQs were comparable but conduct and assessment costs for MCQs and SAQs were 6% and 94% of the total respectively. In both MCQs and SAQs students performed better at higher cognitive testing levels whereas the SAQs and MCQs were able to marginally test the lower levels of affective domain only. Student's feedback showed that attempting MCQs required critical thinking, experience and practice. MCQs are more cost effective means at levels of cognitive domain assessment.
Validity and Realibility of Chemistry Systemic Multiple Choices Questions (CSMCQs)

ERIC Educational Resources Information Center

Priyambodo, Erfan; Marfuatun

2016-01-01

Nowadays, Rasch model analysis is used widely in social research, moreover in educational research. In this research, Rasch model is used to determine the validation and the reliability of systemic multiple choices question in chemistry teaching and learning. There were 30 multiple choices question with systemic approach for high school student…
Does Correct Answer Distribution Influence Student Choices When Writing Multiple Choice Examinations?

ERIC Educational Resources Information Center

Carnegie, Jacqueline A.

2017-01-01

Summative evaluation for large classes of first- and second-year undergraduate courses often involves the use of multiple choice question (MCQ) exams in order to provide timely feedback. Several versions of those exams are often prepared via computer-based question scrambling in an effort to deter cheating. An important parameter to consider when…
Using Multiple-Choice Questions to Evaluate In-Depth Learning of Economics

ERIC Educational Resources Information Center

Buckles, Stephen; Siegfried, John J.

2006-01-01

Multiple-choice questions are the basis of a significant portion of assessment in introductory economics courses. However, these questions, as found in course assessments, test banks, and textbooks, often fail to evaluate students' abilities to use and apply economic analysis. The authors conclude that multiple-choice questions can be used to…
[Continuing medical education: how to write multiple choice questions].

PubMed

Soler Fernández, R; Méndez Díaz, C; Rodríguez García, E

2013-06-01

Evaluating professional competence in medicine is a difficult but indispensable task because it makes it possible to evaluate, at different times and from different perspectives, the extent to which the knowledge, skills, and values required for exercising the profession have been acquired. Tests based on multiple choice questions have been and continue to be among the most useful tools for objectively evaluating learning in medicine. When these tests are well designed and correctly used, they can stimulate learning and even measure higher cognitive skills. Designing a multiple choice test is a difficult task that requires knowledge of the material to be tested and of the methodology of test preparation as well as time to prepare the test. The aim of this article is to review what can be evaluated through multiple choice tests, the rules and guidelines that should be taken into account when writing multiple choice questions, the different formats that can be used, the most common errors in elaborating multiple choice tests, and how to analyze the results of the test to verify its quality. Copyright © 2012 SERAM. Published by Elsevier Espana. All rights reserved.
The frequency of item writing flaws in multiple-choice questions used in high stakes nursing assessments.

PubMed

Tarrant, Marie; Knierim, Aimee; Hayes, Sasha K; Ware, James

2006-12-01

Multiple-choice questions are a common assessment method in nursing examinations. Few nurse educators, however, have formal preparation in constructing multiple-choice questions. Consequently, questions used in baccalaureate nursing assessments often contain item-writing flaws, or violations to accepted item-writing guidelines. In one nursing department, 2770 MCQs were collected from tests and examinations administered over a five-year period from 2001 to 2005. Questions were evaluated for 19 frequently occurring item-writing flaws, for cognitive level, for question source, and for the distribution of correct answers. Results show that almost half (46.2%) of the questions contained violations of item-writing guidelines and over 90% were written at low cognitive levels. Only a small proportion of questions were teacher generated (14.1%), while 36.2% were taken from testbanks and almost half (49.4%) had no source identified. MCQs written at a lower cognitive level were significantly more likely to contain item-writing flaws. While there was no relationship between the source of the question and item-writing flaws, teacher-generated questions were more likely to be written at higher cognitive levels (p<0.001). Correct answers were evenly distributed across all four options and no bias was noted in the placement of correct options. Further training in item-writing is recommended for all faculty members who are responsible for developing tests. Pre-test review and quality assessment is also recommended to reduce the occurrence of item-writing flaws and to improve the quality of test questions.
Comedy workshop: an enjoyable way to develop multiple-choice questions.

PubMed

Droegemueller, William; Gant, Norman; Brekken, Alvin; Webb, Lynn

2005-01-01

To describe an innovative method of developing multiple-choice items for a board certification examination. The development of appropriate multiple-choice items is definitely more of an art, rather than a science. The comedy workshop format for developing questions for a certification examination is similar to the process used by comedy writers composing scripts for television shows. This group format dramatically diminishes the frustrations faced by an individual question writer attempting to create items. The vast majority of our comedy workshop participants enjoy and prefer the comedy workshop format. It provides an ideal environment in which to teach and blend the talents of inexperienced and experienced question writers. This is a descriptive article, in which we suggest an innovative process in the art of creating multiple-choice items for a high-stakes examination.
To Show or Not to Show: The Effects of Item Stems and Answer Options on Performance on a Multiple-Choice Listening Comprehension Test

ERIC Educational Resources Information Center

Yanagawa, Kozo; Green, Anthony

2008-01-01

The purpose of this study is to examine whether the choice between three multiple-choice listening comprehension test formats results in any difference in listening comprehension test performance. The three formats entail (a) allowing test takers to preview both the question stem and answer options prior to listening; (b) allowing test takers to…
Testing Collective Memory: Representing the Soviet Union on Multiple-Choice Questions

ERIC Educational Resources Information Center

Reich, Gabriel A.

2011-01-01

This article tests the assumption that state-mandated multiple-choice history exams are a cultural tool for disseminating an "official" collective memory. Findings from a qualitative study of a collection of multiple-choice questions that relate to the history of the Soviet Union are presented. The 263 questions all come from New York…
The impact of two multiple-choice question formats on the problem-solving strategies used by novices and experts.

PubMed

Coderre, Sylvain P; Harasym, Peter; Mandin, Henry; Fick, Gordon

2004-11-05

Pencil-and-paper examination formats, and specifically the standard, five-option multiple-choice question, have often been questioned as a means for assessing higher-order clinical reasoning or problem solving. This study firstly investigated whether two paper formats with differing number of alternatives (standard five-option and extended-matching questions) can test problem-solving abilities. Secondly, the impact of the alternatives number on psychometrics and problem-solving strategies was examined. Think-aloud protocols were collected to determine the problem-solving strategy used by experts and non-experts in answering Gastroenterology questions, across the two pencil-and-paper formats. The two formats demonstrated equal ability in testing problem-solving abilities, while the number of alternatives did not significantly impact psychometrics or problem-solving strategies utilized. These results support the notion that well-constructed multiple-choice questions can in fact test higher order clinical reasoning. Furthermore, it can be concluded that in testing clinical reasoning, the question stem, or content, remains more important than the number of alternatives.
Learning from peer feedback on student-generated multiple choice questions: Views of introductory physics students

NASA Astrophysics Data System (ADS)

Kay, Alison E.; Hardy, Judy; Galloway, Ross K.

2018-06-01

PeerWise is an online application where students are encouraged to generate a bank of multiple choice questions for their classmates to answer. After answering a question, students can provide feedback to the question author about the quality of the question and the question author can respond to this. Student use of, and attitudes to, this online community within PeerWise was investigated in two large first year undergraduate physics courses, across three academic years, to explore how students interact with the system and the extent to which they believe PeerWise to be useful to their learning. Most students recognized that there is value in engaging with PeerWise, and many students engaged deeply with the system, thinking critically about the quality of their submissions and reflecting on feedback provided to them. Students also valued the breadth of topics and level of difficulty offered by the questions, recognized the revision benefits afforded by the resource, and were often willing to contribute to the community by providing additional explanations and engaging in discussion.
Teaching Critical Thinking without (Much) Writing: Multiple-Choice and Metacognition

ERIC Educational Resources Information Center

Bassett, Molly H.

2016-01-01

In this essay, I explore an exam format that pairs multiple-choice questions with required rationales. In a space adjacent to each multiple-choice question, students explain why or how they arrived at the answer they selected. This exercise builds the critical thinking skill known as metacognition, thinking about thinking, into an exam that also…
Graded Multiple Choice Questions: Rewarding Understanding and Preventing Plagiarism

NASA Astrophysics Data System (ADS)

Denyer, G. S.; Hancock, D.

2002-08-01

This paper describes an easily implemented method that allows the generation and analysis of graded multiple-choice examinations. The technique, which uses standard functions in user-end software (Microsoft Excel 5+), can also produce several different versions of an examination that can be employed to prevent the reward of plagarism. The manuscript also discusses the advantages of having a graded marking system for the elimination of ambiguities, use in multi-step calculation questions, and questions that require extrapolation or reasoning. The advantages of the scrambling strategy, which maintains the same question order, is discussed with reference to student equity. The system provides a non-confrontational mechanism for dealing with cheating in large-class multiple-choice examinations, as well as providing a reward for problem solving over surface learning.
Set of Criteria for Efficiency of the Process Forming the Answers to Multiple-Choice Test Items

ERIC Educational Resources Information Center

Rybanov, Alexander Aleksandrovich

2013-01-01

Is offered the set of criteria for assessing efficiency of the process forming the answers to multiple-choice test items. To increase accuracy of computer-assisted testing results, it is suggested to assess dynamics of the process of forming the final answer using the following factors: loss of time factor and correct choice factor. The model…
Sure, or unsure? Measuring students' confidence and the potential impact on patient safety in multiple-choice questions.

PubMed

Rangel, Rafael Henrique; Möller, Leona; Sitter, Helmut; Stibane, Tina; Strzelczyk, Adam

2017-11-01

Multiple-choice questions (MCQs) provide useful information about correct and incorrect answers, but they do not offer information about students' confidence. Ninety and another 81 medical students participated each in a curricular neurology multiple-choice exam and indicated their confidence for every single MCQ. Each MCQ had a defined level of potential clinical impact on patient safety (uncritical, risky, harmful). Our first objective was to detect informed (IF), guessed (GU), misinformed (MI), and uninformed (UI) answers. Further, we evaluated whether there were significant differences for confidence at correct and incorrect answers. Then, we explored if clinical impact had a significant influence on students' confidence. There were 1818 IF, 635 GU, 71 MI, and 176 UI answers in exam I and 1453 IF, 613 GU, 92 MI, and 191 UI answers in exam II. Students' confidence was significantly higher for correct than for incorrect answers at both exams (p < 0.001). For exam I, students' confidence was significantly higher for incorrect harmful than for incorrect risky classified MCQs (p = 0.01). At exam II, students' confidence was significantly higher for incorrect harmful than for incorrect benign (p < 0.01) and significantly higher for correct benign than for correct harmful categorized MCQs (p = 0.01). We were pleased to see that there were more informed than guessed, more uninformed than misinformed answers and higher students' confidence for correct than for incorrect answers. Our expectation that students state higher confidence in correct and harmful and lower confidence in incorrect and harmful MCQs could not be confirmed.
The Display of Multiple Choice Question Bank on Microfilm

ERIC Educational Resources Information Center

Stevens, J. M.; Harris, F. T. C.

1977-01-01

An automated question bank maintained by the Department of Research and Services in Education at the Middlesex Hospital Medical School provides a printed copy of each of 25,000 multiple choice questions (95 percent relating to the whole spectrum of the medical curriculum). Problems with this procedure led to experimental work storing the data on…
Assessment of item-writing flaws in multiple-choice questions.

PubMed

Nedeau-Cayo, Rosemarie; Laughlin, Deborah; Rus, Linda; Hall, John

2013-01-01

This study evaluated the quality of multiple-choice questions used in a hospital's e-learning system. Constructing well-written questions is fraught with difficulty, and item-writing flaws are common. Study results revealed that most items contained flaws and were written at the knowledge/comprehension level. Few items had linked objectives, and no association was found between the presence of objectives and flaws. Recommendations include education for writing test questions.
What about the Bottle? Answers to Common Questions.

ERIC Educational Resources Information Center

Laird, Valerie

2001-01-01

Acknowledges the large amount of confusing information about bottle feeding in areas including nutrition, sanitation, dental health, psychology, and child development. Answers specific questions pertaining to choice of formula and formula preparation, supporting breastfeeding, bottle choice, solid food introduction, feeding position, spitting up,…
Negatively-Worded Multiple Choice Questions: An Avoidable Threat to Validity

ERIC Educational Resources Information Center

Chiavaroli, Neville

2017-01-01

Despite the majority of MCQ writing guides discouraging the use of negatively-worded multiple choice questions (NWQs), they continue to be regularly used both in locally produced examinations and commercially available questions. There are several reasons why the use of NWQs may prove resistant to sound pedagogical advice. Nevertheless, systematic…

Pushing Critical Thinking Skills With Multiple-Choice Questions: Does Bloom's Taxonomy Work?

PubMed

Zaidi, Nikki L Bibler; Grob, Karri L; Monrad, Seetha M; Kurtz, Joshua B; Tai, Andrew; Ahmed, Asra Z; Gruppen, Larry D; Santen, Sally A

2018-06-01

Medical school assessments should foster the development of higher-order thinking skills to support clinical reasoning and a solid foundation of knowledge. Multiple-choice questions (MCQs) are commonly used to assess student learning, and well-written MCQs can support learner engagement in higher levels of cognitive reasoning such as application or synthesis of knowledge. Bloom's taxonomy has been used to identify MCQs that assess students' critical thinking skills, with evidence suggesting that higher-order MCQs support a deeper conceptual understanding of scientific process skills. Similarly, clinical practice also requires learners to develop higher-order thinking skills that include all of Bloom's levels. Faculty question writers and examinees may approach the same material differently based on varying levels of knowledge and expertise, and these differences can influence the cognitive levels being measured by MCQs. Consequently, faculty question writers may perceive that certain MCQs require higher-order thinking skills to process the question, whereas examinees may only need to employ lower-order thinking skills to render a correct response. Likewise, seemingly lower-order questions may actually require higher-order thinking skills to respond correctly. In this Perspective, the authors describe some of the cognitive processes examinees use to respond to MCQs. The authors propose that various factors affect both the question writer and examinee's interaction with test material and subsequent cognitive processes necessary to answer a question.
A Diagnostic Study of Pre-Service Teachers' Competency in Multiple-Choice Item Development

ERIC Educational Resources Information Center

Asim, Alice E.; Ekuri, Emmanuel E.; Eni, Eni I.

2013-01-01

Large class size is an issue in testing at all levels of Education. As a panacea to this, multiple choice test formats has become very popular. This case study was designed to diagnose pre-service teachers' competency in constructing questions (IQT); direct questions (DQT); and best answer (BAT) varieties of multiple choice items. Subjects were 88…
Descriptive Question Answering with Answer Type Independent Features

NASA Astrophysics Data System (ADS)

Yoon, Yeo-Chan; Lee, Chang-Ki; Kim, Hyun-Ki; Jang, Myung-Gil; Ryu, Pum Mo; Park, So-Young

In this paper, we present a supervised learning method to seek out answers to the most frequently asked descriptive questions: reason, method, and definition questions. Most of the previous systems for question answering focus on factoids, lists or definitional questions. However, descriptive questions such as reason questions and method questions are also frequently asked by users. We propose a system for these types of questions. The system conducts an answer search as follows. First, we analyze the user's question and extract search keywords and the expected answer type. Second, information retrieval results are obtained from an existing search engine such as Yahoo or Google. Finally, we rank the results to find snippets containing answers to the questions based on a ranking SVM algorithm. We also propose features to identify snippets containing answers for descriptive questions. The features are adaptable and thus are not dependent on answer type. Experimental results show that the proposed method and features are clearly effective for the task.
Investigating the potential influence of established multiple-choice test-taking cues on item response in a pharmacotherapy board certification examination preparatory manual: a pilot study.

PubMed

Gettig, Jacob P

2006-04-01

To determine the prevalence of established multiple-choice test-taking correct and incorrect answer cues in the American College of Clinical Pharmacy's Updates in Therapeutics: The Pharmacotherapy Preparatory Course, 2005 Edition, as an equal or lesser surrogate indication of the prevalence of such cues in the Pharmacotherapy board certification examination. All self-assessment and patient case question-and-answer sets were assessed individually to determine if they were subject to selected correct and incorrect answer cues commonly seen in multiple-choice question writing. If the question was considered evaluable, correct answer cues-longest answer, mid-range number, one of two similar choices, and one of two opposite choices-were tallied. In addition, incorrect answer cues- inclusionary language and grammatical mismatch-were also tallied. Each cue was counted if it did what was expected or did the opposite of what was expected. Multiple cues could be identified in each question. A total of 237 (47.7%) of 497 questions in the manual were deemed evaluable. A total of 325 correct answer cues and 35 incorrect answer cues were identified in the 237 evaluable questions. Most evaluable questions contained one to two correct and/or incorrect answer cue(s). Longest answer was the most frequently identified correct answer cue; however, it was the least likely to identify the correct answer. Inclusionary language was the most frequently identified incorrect answer cue. Incorrect answer cues were considerably more likely to identify incorrect answer choices than correct answer cues were able to identify correct answer choices. The use of established multiple-choice test-taking cues is unlikely to be of significant help when taking the Pharmacotherapy board certification examination, primarily because of the lack of questions subject to such cues and the inability of correct answer cues to accurately identify correct answers. Incorrect answer cues, especially the use of
Assessing Multiple Choice Question (MCQ) Tests--A Mathematical Perspective

ERIC Educational Resources Information Center

Scharf, Eric M.; Baldwin, Lynne P.

2007-01-01

The reasoning behind popular methods for analysing the raw data generated by multiple choice question (MCQ) tests is not always appreciated, occasionally with disastrous results. This article discusses and analyses three options for processing the raw data produced by MCQ tests. The article shows that one extreme option is not to penalize a…
Use of Feedback-Oriented Online Exercises to Help Physiology Students Construct Well-Organized Answers to Short-Answer Questions

PubMed Central

Carnegie, Jacqueline

2015-01-01

Postsecondary education often requires students to use higher-order cognitive skills (HOCS) such as analysis, evaluation, and creation as they assess situations and apply what they have learned during lecture to the formulation of solutions. Summative assessment of these abilities is often accomplished using short-answer questions (SAQs). Quandary was used to create feedback-oriented interactive online exercises to help students strengthen certain HOCS as they actively constructed answers to questions concerning the regulation of 1) metabolic rate, 2) blood sugar, 3) erythropoiesis, and 4) stroke volume. Each exercise began with a SAQ presenting an endocrine dysfunction or a physiological challenge; students were prompted to answer between six and eight multiple-choice questions while building their answer to the SAQ. Student outcomes on the SAQ sections of summative exams were compared before and after the introduction of the online tool and also between subgroups of students within the posttool-introduction population who demonstrated different levels of participation in the online exercises. While overall SAQ outcomes were not different before and after the introduction of the online exercises, once the SAQ tool had become available, those students who chose to use it had improved SAQ outcomes compared with those who did not. PMID:26113627
Fast Assessments with Digital Tools Using Multiple-Choice Questions

ERIC Educational Resources Information Center

Howell, Dusti D.; Tseng, Daphne ChingYu; Colorado-Resa, Jozenia T.

2017-01-01

Multiple Choice Questions (MCQs) have come a long way since they were used in "The Kansas Silent Reading Test" in 1915. After over 100 years of MCQs, new innovative digital tools using this form of assessment can help foster interactivity in today's classrooms. This article describes three free online MCQ tools that are relatively quick…
Multiple choice questions can be designed or revised to challenge learners' critical thinking.

PubMed

Tractenberg, Rochelle E; Gushta, Matthew M; Mulroney, Susan E; Weissinger, Peggy A

2013-12-01

Multiple choice (MC) questions from a graduate physiology course were evaluated by cognitive-psychology (but not physiology) experts, and analyzed statistically, in order to test the independence of content expertise and cognitive complexity ratings of MC items. Integration of higher order thinking into MC exams is important, but widely known to be challenging-perhaps especially when content experts must think like novices. Expertise in the domain (content) may actually impede the creation of higher-complexity items. Three cognitive psychology experts independently rated cognitive complexity for 252 multiple-choice physiology items using a six-level cognitive complexity matrix that was synthesized from the literature. Rasch modeling estimated item difficulties. The complexity ratings and difficulty estimates were then analyzed together to determine the relative contributions (and independence) of complexity and difficulty to the likelihood of correct answers on each item. Cognitive complexity was found to be statistically independent of difficulty estimates for 88 % of items. Using the complexity matrix, modifications were identified to increase some item complexities by one level, without affecting the item's difficulty. Cognitive complexity can effectively be rated by non-content experts. The six-level complexity matrix, if applied by faculty peer groups trained in cognitive complexity and without domain-specific expertise, could lead to improvements in the complexity targeted with item writing and revision. Targeting higher order thinking with MC questions can be achieved without changing item difficulties or other test characteristics, but this may be less likely if the content expert is left to assess items within their domain of expertise.
Dual processing theory and experts' reasoning: exploring thinking on national multiple-choice questions.

PubMed

Durning, Steven J; Dong, Ting; Artino, Anthony R; van der Vleuten, Cees; Holmboe, Eric; Schuwirth, Lambert

2015-08-01

An ongoing debate exists in the medical education literature regarding the potential benefits of pattern recognition (non-analytic reasoning), actively comparing and contrasting diagnostic options (analytic reasoning) or using a combination approach. Studies have not, however, explicitly explored faculty's thought processes while tackling clinical problems through the lens of dual process theory to inform this debate. Further, these thought processes have not been studied in relation to the difficulty of the task or other potential mediating influences such as personal factors and fatigue, which could also be influenced by personal factors such as sleep deprivation. We therefore sought to determine which reasoning process(es) were used with answering clinically oriented multiple-choice questions (MCQs) and if these processes differed based on the dual process theory characteristics: accuracy, reading time and answering time as well as psychometrically determined item difficulty and sleep deprivation. We performed a think-aloud procedure to explore faculty's thought processes while taking these MCQs, coding think-aloud data based on reasoning process (analytic, nonanalytic, guessing or combination of processes) as well as word count, number of stated concepts, reading time, answering time, and accuracy. We also included questions regarding amount of work in the recent past. We then conducted statistical analyses to examine the associations between these measures such as correlations between frequencies of reasoning processes and item accuracy and difficulty. We also observed the total frequencies of different reasoning processes in the situations of getting answers correctly and incorrectly. Regardless of whether the questions were classified as 'hard' or 'easy', non-analytical reasoning led to the correct answer more often than to an incorrect answer. Significant correlations were found between self-reported recent number of hours worked with think-aloud word count
Conscience in Childhood: Old Questions, New Answers

ERIC Educational Resources Information Center

Aksan, Nazan; Kochanska, Grazyna

2005-01-01

Although conscience has been the focus of reflection for centuries, fundamental questions regarding its organization have not been fully answered. To address those questions, the authors applied structural equation modeling techniques to longitudinal data comprising multiple behavioral measures of children's conscience, obtained in parallel…
"I Don't Know" and Multiple Choice Analysis of Pre- and Post-Tests

ERIC Educational Resources Information Center

Spears, Karen; Wilson, Mary

2010-01-01

Evaluation is an essential component of any Extension education program. One tool, the pre- and post-test, provides measurable evaluation data. Yet often the answer "I don't know" or all possible answers to a multiple choice question are not included in the repeated measure analysis. Because more than two answers are offered, the test of marginal…
A participatory learning approach to biochemistry using student authored and evaluated multiple-choice questions.

PubMed

Bottomley, Steven; Denny, Paul

2011-01-01

A participatory learning approach, combined with both a traditional and a competitive assessment, was used to motivate students and promote a deep approach to learning biochemistry. Students were challenged to research, author, and explain their own multiple-choice questions (MCQs). They were also required to answer, evaluate, and discuss MCQs written by their peers. The technology used to support this activity was PeerWise--a freely available, innovative web-based system that supports students in the creation of an annotated question repository. In this case study, we describe students' contributions to, and perceptions of, the PeerWise system for a cohort of 107 second-year biomedical science students from three degree streams studying a core biochemistry subject. Our study suggests that the students are eager participants and produce a large repository of relevant, good quality MCQs. In addition, they rate the PeerWise system highly and use higher order thinking skills while taking an active role in their learning. We also discuss potential issues and future work using PeerWise for biomedical students. Copyright © 2011 Wiley Periodicals, Inc.
Using a Classroom Response System to Improve Multiple-Choice Performance in APÂ® Physics

NASA Astrophysics Data System (ADS)

Bertrand, Peggy

2009-04-01

Participation in rigorous high school courses such as Advanced Placement (AP®) Physics increases the likelihood of college success, especially for students who are traditionally underserved. Tackling difficult multiple-choice exams should be part of any AP program because well-constructed multiple-choice questions, such as those on AP exams and on the Force Concept Inventory,2 are particularly good at rooting out common and persisting student misconceptions. Additionally, there are barriers to multiple-choice performance that have little to do with content mastery. For example, a student might fail to read the question thoroughly, forget to apply a reasonableness test to the answer, or simply work too slowly.
Regulation of memory accuracy with multiple answers: the plurality option.

PubMed

Luna, Karlos; Higham, Philip A; Martín-Luengo, Beatriz

2011-06-01

We report two experiments that investigated the regulation of memory accuracy with a new regulatory mechanism: the plurality option. This mechanism is closely related to the grain-size option but involves control over the number of alternatives contained in an answer rather than the quantitative boundaries of a single answer. Participants were presented with a slideshow depicting a robbery (Experiment 1) or a murder (Experiment 2), and their memory was tested with five-alternative multiple-choice questions. For each question, participants were asked to generate two answers: a single answer consisting of one alternative and a plural answer consisting of the single answer and two other alternatives. Each answer was rated for confidence (Experiment 1) or for the likelihood of being correct (Experiment 2), and one of the answers was selected for reporting. Results showed that participants used the plurality option to regulate accuracy, selecting single answers when their accuracy and confidence were high, but opting for plural answers when they were low. Although accuracy was higher for selected plural than for selected single answers, the opposite pattern was evident for confidence or likelihood ratings. This dissociation between confidence and accuracy for selected answers was the result of marked overconfidence in single answers coupled with underconfidence in plural answers. We hypothesize that these results can be attributed to overly dichotomous metacognitive beliefs about personal knowledge states that cause subjective confidence to be extreme.
The Use of Management and Marketing Textbook Multiple-Choice Questions: A Case Study.

ERIC Educational Resources Information Center

Hampton, David R.; And Others

1993-01-01

Four management and four marketing professors classified multiple-choice questions in four widely adopted introductory textbooks according to the two levels of Bloom's taxonomy of educational objectives: knowledge and intellectual ability and skill. Inaccuracies may cause instructors to select questions that require less thinking than they intend.…
Comparison of paragraph comprehension test scores with reading versus listening-reading and multiple-choice versus nominal recall administration techniques: justification for the bypass approach.

PubMed

Weinberg, W A; McLean, A; Snider, R L; Rintelmann, J W; Brumback, R A

1989-12-01

Eight groups of learning disabled children (N = 100), categorized by the clinical Lexical Paradigm as good readers or poor readers, were individually administered the Gilmore Oral Reading Test, Form D, by one of four input/retrieval methods: (1) the standardized method of administration in which the child reads each paragraph aloud and then answers five questions relating to the paragraph [read/recall method]; (2) the child reads each paragraph aloud and then for each question selects the correct answer from among three choices read by the examiner [read/choice method]; (3) the examiner reads each paragraph aloud and reads each of the five questions to the child to answer [listen/recall method]; and (4) the examiner reads each paragraph aloud and then for each question reads three multiple-choice answers from which the child selects the correct answer [listen/choice method]. The major difference in scores was between the groups tested by the recall versus the orally read multiple-choice methods. This study indicated that poor readers who listened to the material and were tested by orally read multiple-choice format could perform as well as good readers. The performance of good readers was not affected by listening or by the method of testing. The multiple-choice testing improved the performance of poor readers independent of the input method. This supports the arguments made previously that a "bypass approach" to education of poor readers in which testing is accomplished using an orally read multiple-choice format can enhance the child's school performance on reading-related tasks. Using a listening while reading input method may further enhance performance.
Use of Feedback-Oriented Online Exercises to Help Physiology Students Construct Well-Organized Answers to Short-Answer Questions.

PubMed

Carnegie, Jacqueline

2015-01-01

Postsecondary education often requires students to use higher-order cognitive skills (HOCS) such as analysis, evaluation, and creation as they assess situations and apply what they have learned during lecture to the formulation of solutions. Summative assessment of these abilities is often accomplished using short-answer questions (SAQs). Quandary was used to create feedback-oriented interactive online exercises to help students strengthen certain HOCS as they actively constructed answers to questions concerning the regulation of 1) metabolic rate, 2) blood sugar, 3) erythropoiesis, and 4) stroke volume. Each exercise began with a SAQ presenting an endocrine dysfunction or a physiological challenge; students were prompted to answer between six and eight multiple-choice questions while building their answer to the SAQ. Student outcomes on the SAQ sections of summative exams were compared before and after the introduction of the online tool and also between subgroups of students within the posttool-introduction population who demonstrated different levels of participation in the online exercises. While overall SAQ outcomes were not different before and after the introduction of the online exercises, once the SAQ tool had become available, those students who chose to use it had improved SAQ outcomes compared with those who did not. © 2015 J. Carnegie. CBE—Life Sciences Education © 2015 The American Society for Cell Biology. This article is distributed by The American Society for Cell Biology under license from the author(s). It is available to the public under an Attribution–Noncommercial–Share Alike 3.0 Unported Creative Commons License (http://creativecommons.org/licenses/by-nc-sa/3.0).
The Relationship of Deep and Surface Study Approaches on Factual and Applied Test-Bank Multiple-Choice Question Performance

ERIC Educational Resources Information Center

Yonker, Julie E.

2011-01-01

With the advent of online test banks and large introductory classes, instructors have often turned to textbook publisher-generated multiple-choice question (MCQ) exams in their courses. Multiple-choice questions are often divided into categories of factual or applied, thereby implicating levels of cognitive processing. This investigation examined…
Psychometrics of Multiple Choice Questions with Non-Functioning Distracters: Implications to Medical Education.

PubMed

Deepak, Kishore K; Al-Umran, Khalid Umran; AI-Sheikh, Mona H; Dkoli, B V; Al-Rubaish, Abdullah

2015-01-01

The functionality of distracters in a multiple choice question plays a very important role. We examined the frequency and impact of functioning and non-functioning distracters on psychometric properties of 5-option items in clinical disciplines. We analyzed item statistics of 1115 multiple choice questions from 15 summative assessments of undergraduate medical students and classified the items into five groups by their number of non-functioning distracters. We analyzed the effect of varying degree of non-functionality ranging from 0 to 4, on test reliability, difficulty index, discrimination index and point biserial correlation. The non-functionality of distracters inversely affected the test reliability and quality of items in a predictable manner. The non-functioning distracters made the items easier and lowered the discrimination index significantly. Three non-functional distracters in a 5-option MCQ significantly affected all psychometric properties (p < 0.5). The corrected point biserial correlation revealed that the items with 3 functional options were psychometrically as effective as 5-option items. Our study reveals that a multiple choice question with 3 functional options provides lower most limit of item format that has adequate psychometric property. The test containing items with less number of functioning options have significantly lower reliability. The distracter function analysis and revision of nonfunctioning distracters can serve as important methods to improve the psychometrics and reliability of assessment.
Multiple-Choice Answers: To Change or Not to Change? Perhaps Not Such a Simple Question

ERIC Educational Resources Information Center

Wainscott, Heidi

2016-01-01

When grading students' quizzes and exams, I find that students are seemingly always changing their answers from the right answer to the wrong answer. In fact, I have cautioned students against changing their answer. Colleagues have made similar observations and some books on test-taking strategies advise against answer-changing. In an effort to…

Generic Drugs: Questions and Answers

MedlinePlus

... Vaccines, Blood & Biologics Animal & Veterinary Cosmetics Tobacco Products Drugs Home Drugs Resources for You Information for Consumers (Drugs) Questions & Answers Generic Drugs: Questions & Answers Share Tweet Linkedin Pin it More ...
QU at TREC-2015: Building Real-Time Systems for Tweet Filtering and Question Answering

DTIC Science & Technology

2015-11-20

from Yahoo ! An- swers. We adopted a very simple approach that searched an archived Yahoo ! Answers QA dataset for similar questions to the asked ones and...users to post and answer questions. Yahoo ! An- swers1 is by far one of the largest sQA platforms. Questions and answers on such platforms share some...multiple domains [5]. However, the existence of large social question answering websites, such as Yahoo ! Answers specifically, makes the development of
Question Popularity Analysis and Prediction in Community Question Answering Services

PubMed Central

Liu, Ting; Zhang, Wei-Nan; Cao, Liujuan; Zhang, Yu

2014-01-01

With the blooming of online social media applications, Community Question Answering (CQA) services have become one of the most important online resources for information and knowledge seekers. A large number of high quality question and answer pairs have been accumulated, which allow users to not only share their knowledge with others, but also interact with each other. Accordingly, volumes of efforts have been taken to explore the questions and answers retrieval in CQA services so as to help users to finding the similar questions or the right answers. However, to our knowledge, less attention has been paid so far to question popularity in CQA. Question popularity can reflect the attention and interest of users. Hence, predicting question popularity can better capture the users’ interest so as to improve the users’ experience. Meanwhile, it can also promote the development of the community. In this paper, we investigate the problem of predicting question popularity in CQA. We first explore the factors that have impact on question popularity by employing statistical analysis. We then propose a supervised machine learning approach to model these factors for question popularity prediction. The experimental results show that our proposed approach can effectively distinguish the popular questions from unpopular ones in the Yahoo! Answers question and answer repository. PMID:24837851
Question popularity analysis and prediction in community question answering services.

PubMed

Liu, Ting; Zhang, Wei-Nan; Cao, Liujuan; Zhang, Yu

2014-01-01

With the blooming of online social media applications, Community Question Answering (CQA) services have become one of the most important online resources for information and knowledge seekers. A large number of high quality question and answer pairs have been accumulated, which allow users to not only share their knowledge with others, but also interact with each other. Accordingly, volumes of efforts have been taken to explore the questions and answers retrieval in CQA services so as to help users to finding the similar questions or the right answers. However, to our knowledge, less attention has been paid so far to question popularity in CQA. Question popularity can reflect the attention and interest of users. Hence, predicting question popularity can better capture the users' interest so as to improve the users' experience. Meanwhile, it can also promote the development of the community. In this paper, we investigate the problem of predicting question popularity in CQA. We first explore the factors that have impact on question popularity by employing statistical analysis. We then propose a supervised machine learning approach to model these factors for question popularity prediction. The experimental results show that our proposed approach can effectively distinguish the popular questions from unpopular ones in the Yahoo! Answers question and answer repository.
Writing Multiple Choice Outcome Questions to Assess Knowledge and Competence.

PubMed

Brady, Erik D

2015-11-01

Few articles contemplate the need for good guidance in question item-writing in the continuing education (CE) space. Although many of the core principles of sound item design translate to the CE health education team, the need exists for specific examples for nurse educators that clearly describe how to measure changes in competence and knowledge using multiple choice items. In this article, some keys points and specific examples for nursing CE providers are shared. Copyright 2015, SLACK Incorporated.
Score Increase and Partial-Credit Validity When Administering Multiple-Choice Tests Using an Answer-Until-Correct Format

ERIC Educational Resources Information Center

Slepkov, Aaron D.; Vreugdenhil, Andrew J.; Shiell, Ralph C.

2016-01-01

There are numerous benefits to answer-until-correct (AUC) approaches to multiple-choice testing, not the least of which is the straightforward allotment of partial credit. However, the benefits of granting partial credit can be tempered by the inevitable increase in test scores and by fears that such increases are further contaminated by a large…
Does Anyone Know the Answer to that Question? Individual Differences in Judging Answerability

PubMed Central

Karlsson, Bodil S. A.; Allwood, Carl Martin; Buratti, Sandra

2016-01-01

Occasionally people may attempt to judge whether a question can be answered today, or if not, if it can be answered in the future. For example, a person may consider whether enough is known about the dangers of living close to a nuclear plant, or to a major electricity cable, for them to be willing to do so, and state-authorities may consider whether questions about the dangers of new technologies have been answered, or in a reasonable future can be, for them to be willing to invest money in research aiming develop such technologies. A total of 476 participants, for each of 22 knowledge questions, either judged whether it was answerable today (current answerability), or judged when it could be answered (future answerability). The knowledge questions varied with respect to the expected consensus concerning their answerability: consensus questions (high expected consensus), non-consensus questions (lower expected consensus), and illusion questions (formulated to appear answerable, but with crucial information absent). The questions’ judged answerability level on the two scales was highly correlated. For both scales, consensus questions were rated more answerable than the non-consensus questions, with illusion questions falling in-between. The result for the illusion questions indicates that a feeling of answerability can be created even when it is unlikely that somebody can come up with an answer. The results also showed that individual difference variables influenced the answerability judgments. Higher levels of belief in certainty of knowledge, mankind’s knowledge, and mankind’s efficacy were related to judging the non-consensus questions as more answerable. Participants rating the illusion questions as answerable rated the other answerability questions as more, or equally, answerable compared to the other participants and showed tendencies to prefer a combination of more epistemic default processing and less intellectual processing. PMID:26793164
Potential Values of Incorporating a Multiple-Choice Question Construction in Physics Experimentation Instruction

NASA Astrophysics Data System (ADS)

Yu, Fu-Yun; Liu, Yu-Hsin

2005-09-01

The potential value of a multiple-choice question-construction instructional strategy for the support of students’ learning of physics experiments was examined in the study. Forty-two university freshmen participated in the study for a whole semester. A constant comparison method adopted to categorize students’ qualitative data indicated that the influences of multiple-choice question construction were evident in several significant ways (promoting constructive and productive studying habits; reflecting and previewing course-related materials; increasing in-group communication and interaction; breaking passive learning style and habits, etc.), which, worked together, not only enhanced students’ comprehension and retention of the obtained knowledge, but also helped distil a sense of empowerment and learning community within the participants. Analysis with one-group t-tests, using 3 as the expected mean, on quantitative data further found that students’ satisfaction toward past learning experience, and perceptions toward this strategy’s potentials for promoting learning were statistically significant at the 0.0005 level, while learning anxiety was not statistically significant. Suggestions for incorporating question-generation activities within classroom and topics for future studies were rendered.
Components of Answers to Multiple-Choice Questions on a Published Reading Comprehension Test: An Application of the Hanna-Oaster Approach.

ERIC Educational Resources Information Center

Entin, Eileen B.; Klare, George B.

1980-01-01

An approach to assessing context dependence was applied to data from the Nelson-Denny Reading Test. The results suggest that scores on the difficult passages are inflated because the examinees can answer the questions without having to comprehend the passage. (MKM)
Developing an Array Binary Code Assessment Rubric for Multiple- Choice Questions Using Item Arrays and Binary-Coded Responses

ERIC Educational Resources Information Center

Haro, Elizabeth K.; Haro, Luis S.

2014-01-01

The multiple-choice question (MCQ) is the foundation of knowledge assessment in K-12, higher education, and standardized entrance exams (including the GRE, MCAT, and DAT). However, standard MCQ exams are limited with respect to the types of questions that can be asked when there are only five choices. MCQs offering additional choices more…
Assessing the Validity of Multiple-Choice Questions in Measuring Fourth Graders' Ability to Interpret Graphs about Motion and Temperature

ERIC Educational Resources Information Center

Dulger, Mehmet; Deniz, Hasan

2017-01-01

The purpose of this paper is to assess the validity of multiple-choice questions in measuring fourth grade students' ability to interpret graphs related to physical science topics such as motion and temperature. We administered a test including 6 multiple-choice questions to 28 fourth grade students. Students were asked to explain their thinking…
Beyond Information Retrieval—Medical Question Answering

PubMed Central

Lee, Minsuk; Cimino, James; Zhu, Hai Ran; Sable, Carl; Shanker, Vijay; Ely, John; Yu, Hong

2006-01-01

Physicians have many questions when caring for patients, and frequently need to seek answers for their questions. Information retrieval systems (e.g., PubMed) typically return a list of documents in response to a user’s query. Frequently the number of returned documents is large and makes physicians’ information seeking “practical only ‘after hours’ and not in the clinical settings”. Question answering techniques are based on automatically analyzing thousands of electronic documents to generate short-text answers in response to clinical questions that are posed by physicians. The authors address physicians’ information needs and described the design, implementation, and evaluation of the medical question answering system (MedQA). Although our long term goal is to enable MedQA to answer all types of medical questions, currently, we currently implement MedQA to integrate information retrieval, extraction, and summarization techniques to automatically generate paragraph-level text for definitional questions (i.e., “What is X?”). MedQA can be accessed at http://www.dbmi.columbia.edu/~yuh9001/research/MedQA.html. PMID:17238385
Nursing students collaborating to develop multiple-choice exam revision questions: A student engagement study.

PubMed

Craft, Judy A; Christensen, Martin; Shaw, Natasha; Bakon, Shannon

2017-12-01

Nursing students find bioscience subjects challenging. Bioscience exams pose particular concerns for these students, which may lead to students adopting a surface-approach to learning. To promote student collective understanding of bioscience, improve their confidence for the final exam, and improve deeper understanding of bioscience. In order to address exam anxiety, and improve student understanding of content, this student engagement project involved nursing students collaborating in small groups to develop multiple-choice questions and answers, which became available to the entire student cohort. This study was conducted at two campuses of an Australian university, within a first year bioscience subject as part of the undergraduate nursing programme. All students enrolled in the subject were encouraged to attend face-to-face workshops, and collaborate in revision question writing. Online anonymous questionnaires were used to invite student feedback on this initiative; 79 respondents completed this feedback. Students collaborated in groups to write revision questions as part of in-class activities. These questions were made available on the student online learning site for revision. An online feedback survey was deployed at the conclusion of all workshops for this subject, with questions rated using a Likert scale. Participants indicated that they enjoyed the opportunity to collaborate in this activity, and almost all of these respondents used these questions in their exam preparation. There was strong agreement that this activity improved their confidence for the final exam. Importantly, almost two-thirds of respondents agreed that writing questions improved their understanding of content, and assisted in their active reflection of content. Overall, this initiative revealed various potential benefits for the students, including promoting bioscience understanding and confidence. This may improve their long-term understanding of bioscience for nursing practice
Can Multiple-Choice Testing Induce Desirable Difficulties? Evidence from the Laboratory and the Classroom.

PubMed

Bjork, Elizabeth Ligon; Soderstrom, Nicholas C; Little, Jeri L

2015-01-01

The term desirable difficulties (Bjork, 1994) refers to conditions of learning that, though often appearing to cause difficulties for the learner and to slow down the process of acquisition, actually improve long-term retention and transfer. One known desirable difficulty is testing (as compared with restudy), although typically it is tests that clearly involve retrieval--such as free and cued recall tests--that are thought to induce these learning benefits and not multiple-choice tests. Nonetheless, multiple-choice testing is ubiquitous in educational settings and many other high-stakes situations. In this article, we discuss research, in both the laboratory and the classroom, exploring whether multiple-choice testing can also be fashioned to promote the type of retrieval processes known to improve learning, and we speculate about the necessary properties that multiple-choice questions must possess, as well as the metacognitive strategy students need to use in answering such questions, to achieve this goal.
Quality Multiple-Choice Test Questions: Item-Writing Guidelines and an Analysis of Auditing Testbanks.

ERIC Educational Resources Information Center

Hansen, James D.; Dexter, Lee

1997-01-01

Analysis of test item banks in 10 auditing textbooks found that 75% of questions violated one or more guidelines for multiple-choice items. In comparison, 70% of a certified public accounting exam bank had no violations. (SK)
The Effect of Images on Item Statistics in Multiple Choice Anatomy Examinations

ERIC Educational Resources Information Center

Notebaert, Andrew J.

2017-01-01

Although multiple choice examinations are often used to test anatomical knowledge, these often forgo the use of images in favor of text-based questions and answers. Because anatomy is reliant on visual resources, examinations using images should be used when appropriate. This study was a retrospective analysis of examination items that were text…
Comparing narrative and multiple-choice formats in online communication skill assessment.

PubMed

Kim, Sara; Spielberg, Freya; Mauksch, Larry; Farber, Stu; Duong, Cuong; Fitch, Wes; Greer, Tom

2009-06-01

We compared multiple-choice and open-ended responses collected from a web-based tool designated 'Case for Change', which had been developed for assessing and teaching medical students in the skills involved in integrating sexual risk assessment and behaviour change discussions into patient-centred primary care visits. A total of 111 Year 3 students completed the web-based tool. A series of videos from one patient encounter illustrated how a clinician uses patient-centred communication and health behaviour change skills while caring for a patient presenting with a urinary tract infection. Each video clip was followed by a request for students to respond in two ways to the question: 'What would you do next?' Firstly, students typed their statements of what they would say to the patient. Secondly, students selected from a multiple-choice list the statements that most closely resembled their free text entries. These two modes of students' answers were analysed and compared. When articulating what they would say to the patient in a narrative format, students frequently used doctor-centred approaches that focused on premature diagnostic questioning or neglected to elicit patient perspectives. Despite the instruction to select a matching statement from the multiple-choice list, students tended to choose the most exemplary patient-centred statement, which was contrary to the doctor-centred approaches reflected in their narrative responses. Open-ended questions facilitate in-depth understanding of students' educational needs, although the scoring of narrative responses is time-consuming. Multiple-choice questions allow efficient scoring and individualised feedback associated with question items but do not fully elicit students' thought processes.
Comparison in the quality of distractors in three and four options type of multiple choice questions.

PubMed

Rahma, Nourelhouda A A; Shamad, Mahdi M A; Idris, Muawia E A; Elfaki, Omer Abdelgadir; Elfakey, Walyedldin E M; Salih, Karimeldin M A

2017-01-01

The number of distractors needed for high quality multiple choice questions (MCQs) will be determined by many factors. These include firstly whether English language is their mother tongue or a foreign language; secondly whether the instructors who construct the questions are experts or not; thirdly the time spent on constructing the options is also an important factor. It has been observed by Tarrant et al that more time is often spent on constructing questions than on tailoring sound, reliable, and valid distractors. Firstly, to investigate the effects of reducing the number of options on psychometric properties of the item. Secondly, to determine the frequency of functioning distractors among three or four options in the MCQs examination of the dermatology course in University of Bahri, College of Medicine. This is an experimental study which was performed by means of a dermatology exam, MCQs type. Forty MCQs, with one correct answer for each question were constructed. Two sets of this exam paper were prepared: in the first one, four options were given, including one key answer and three distractors. In the second set, one of the three distractors was deleted randomly, and the sequence of the questions was kept in the same order. Any distracter chosen by less than 5% of the students was regarded as non-functioning. Kuder-Richardson Formula 20 (Kr-20) measures the internal consistency and reliability of an examination with an acceptable range 0.8-1.0. Chi square test was used to compare the distractors in the two exams. A significant difference was observed in discrimination and difficulty indexes for both sets of MCQs. More distractors were non-functional for set one (of four options), but slightly more reliable. The reliability (Kr-20) was slightly higher for set one (of four options). The average marks in option three and four were 34.163 and 33.140, respectively. Compared to set 1 (four options), set 2 (of three options) was more discriminating and associated
Investigations of Human Question Answering

DTIC Science & Technology

1990-02-01

information sources and search through the structures systematically. The formal,,ms and insights from these fields obviously must be tested in psychological ...experiments before we can incorporate them into psychological models of human question answering. One objective of this ONR contract was to test some... psychological model of human question answering. Tests of the QUEST Model QUEST was tested in four different informational contexts. These contexts
Comparing Item Performance on Three- Versus Four-Option Multiple Choice Questions in a Veterinary Toxicology Course.

PubMed

Royal, Kenneth; Dorman, David

2018-06-09

The number of answer options is an important element of multiple-choice questions (MCQs). Many MCQs contain four or more options despite the limited literature suggesting that there is little to no benefit beyond three options. The purpose of this study was to evaluate item performance on 3-option versus 4-option MCQs used in a core curriculum course in veterinary toxicology at a large veterinary medical school in the United States. A quasi-experimental, crossover design was used in which students in each class were randomly assigned to take one of two versions (A or B) of two major exams. Both the 3-option and 4-option MCQs resulted in similar psychometric properties. The findings of our study support earlier research in other medical disciplines and settings that likewise concluded there was no significant change in the psychometric properties of three option MCQs when compared to the traditional MCQs with four or more options.

Effects of Mayfield's Four Questions (M4Q) on Nursing Students' Self-Efficacy and Multiple-Choice Test Scores

ERIC Educational Resources Information Center

Mayfield, Linda Riggs

2010-01-01

This study examined the effects of being taught the Mayfield's Four Questions multiple-choice test-taking strategy on the perceived self-efficacy and multiple-choice test scores of nursing students in a two-year associate degree program. Experimental and control groups were chosen by stratified random sampling. Subjects completed the 10-statement…
Making the Most of Multiple Choice

ERIC Educational Resources Information Center

Brookhart, Susan M.

2015-01-01

Multiple-choice questions draw criticism because many people perceive they test only recall or atomistic, surface-level objectives and do not require students to think. Although this can be the case, it does not have to be that way. Susan M. Brookhart suggests that multiple-choice questions are a useful part of any teacher's questioning repertoire…
Estimating the Effect on Grades of Using Multiple-Choice versus Constructive-Response Questions: Data from the Classroom

ERIC Educational Resources Information Center

Hickson, Stephen; Reed, W. Robert; Sander, Nicholas

2012-01-01

This study investigates the degree to which grades based solely on constructed-response (CR) questions differ from grades based solely on multiple-choice (MC) questions. If CR questions are to justify their higher costs, they should produce different grade outcomes than MC questions. We use a data set composed of thousands of observations on…
Instance-Based Question Answering

DTIC Science & Technology

2006-12-01

answer clustering, composition, and scoring. Moreover, with the effort dedicated to improving monolingual system performance, system parameters are...text collections: document type, manual or automatic annotations (if any), and stylistic and notational differences in technical terms. Monolingual ...forum in which cross language retrieval systems and question answering systems are tested for various Eu- ropean languages. The CLEF QA monolingual task
The "None of the Above" Option in Multiple-Choice Testing: An Experimental Study

ERIC Educational Resources Information Center

DiBattista, David; Sinnige-Egger, Jo-Anne; Fortuna, Glenda

2014-01-01

The authors assessed the effects of using "none of the above" as an option in a 40-item, general-knowledge multiple-choice test administered to undergraduate students. Examinees who selected "none of the above" were given an incentive to write the correct answer to the question posed. Using "none of the above" as the…
Deep Question Answering for protein annotation

PubMed Central

Gobeill, Julien; Gaudinat, Arnaud; Pasche, Emilie; Vishnyakova, Dina; Gaudet, Pascale; Bairoch, Amos; Ruch, Patrick

2015-01-01

Biomedical professionals have access to a huge amount of literature, but when they use a search engine, they often have to deal with too many documents to efficiently find the appropriate information in a reasonable time. In this perspective, question-answering (QA) engines are designed to display answers, which were automatically extracted from the retrieved documents. Standard QA engines in literature process a user question, then retrieve relevant documents and finally extract some possible answers out of these documents using various named-entity recognition processes. In our study, we try to answer complex genomics questions, which can be adequately answered only using Gene Ontology (GO) concepts. Such complex answers cannot be found using state-of-the-art dictionary- and redundancy-based QA engines. We compare the effectiveness of two dictionary-based classifiers for extracting correct GO answers from a large set of 100 retrieved abstracts per question. In the same way, we also investigate the power of GOCat, a GO supervised classifier. GOCat exploits the GOA database to propose GO concepts that were annotated by curators for similar abstracts. This approach is called deep QA, as it adds an original classification step, and exploits curated biological data to infer answers, which are not explicitly mentioned in the retrieved documents. We show that for complex answers such as protein functional descriptions, the redundancy phenomenon has a limited effect. Similarly usual dictionary-based approaches are relatively ineffective. In contrast, we demonstrate how existing curated data, beyond information extraction, can be exploited by a supervised classifier, such as GOCat, to massively improve both the quantity and the quality of the answers with a +100% improvement for both recall and precision. Database URL: http://eagl.unige.ch/DeepQA4PA/ PMID:26384372
Deep Question Answering for protein annotation.

PubMed

Gobeill, Julien; Gaudinat, Arnaud; Pasche, Emilie; Vishnyakova, Dina; Gaudet, Pascale; Bairoch, Amos; Ruch, Patrick

2015-01-01

Biomedical professionals have access to a huge amount of literature, but when they use a search engine, they often have to deal with too many documents to efficiently find the appropriate information in a reasonable time. In this perspective, question-answering (QA) engines are designed to display answers, which were automatically extracted from the retrieved documents. Standard QA engines in literature process a user question, then retrieve relevant documents and finally extract some possible answers out of these documents using various named-entity recognition processes. In our study, we try to answer complex genomics questions, which can be adequately answered only using Gene Ontology (GO) concepts. Such complex answers cannot be found using state-of-the-art dictionary- and redundancy-based QA engines. We compare the effectiveness of two dictionary-based classifiers for extracting correct GO answers from a large set of 100 retrieved abstracts per question. In the same way, we also investigate the power of GOCat, a GO supervised classifier. GOCat exploits the GOA database to propose GO concepts that were annotated by curators for similar abstracts. This approach is called deep QA, as it adds an original classification step, and exploits curated biological data to infer answers, which are not explicitly mentioned in the retrieved documents. We show that for complex answers such as protein functional descriptions, the redundancy phenomenon has a limited effect. Similarly usual dictionary-based approaches are relatively ineffective. In contrast, we demonstrate how existing curated data, beyond information extraction, can be exploited by a supervised classifier, such as GOCat, to massively improve both the quantity and the quality of the answers with a +100% improvement for both recall and precision. Database URL: http://eagl.unige.ch/DeepQA4PA/. © The Author(s) 2015. Published by Oxford University Press.
Domain and Intelligence Based Multimedia Question Answering System

ERIC Educational Resources Information Center

Kumar, K. Magesh; Valarmathie, P.

2016-01-01

Multimedia question answering systems have become very popular over the past few years. It allows users to share their thoughts by answering a given question or obtain information from a set of answered questions. However, existing QA systems support only textual answer which is not so instructive for many users. The user's discussion can be…
Multiple Choice Questions Can Be Designed or Revised to Challenge Learners' Critical Thinking

ERIC Educational Resources Information Center

Tractenberg, Rochelle E.; Gushta, Matthew M.; Mulroney, Susan E.; Weissinger, Peggy A.

2013-01-01

Multiple choice (MC) questions from a graduate physiology course were evaluated by cognitive-psychology (but not physiology) experts, and analyzed statistically, in order to test the independence of content expertise and cognitive complexity ratings of MC items. Integration of higher order thinking into MC exams is important, but widely known to…
Validity and Reliability of Scores Obtained on Multiple-Choice Questions: Why Functioning Distractors Matter

ERIC Educational Resources Information Center

Ali, Syed Haris; Carr, Patrick A.; Ruit, Kenneth G.

2016-01-01

Plausible distractors are important for accurate measurement of knowledge via multiple-choice questions (MCQs). This study demonstrates the impact of higher distractor functioning on validity and reliability of scores obtained on MCQs. Freeresponse (FR) and MCQ versions of a neurohistology practice exam were given to four cohorts of Year 1 medical…
Do Streaks Matter in Multiple-Choice Tests?

ERIC Educational Resources Information Center

Kiss, Hubert János; Selei, Adrienn

2018-01-01

Success in life is determined to a large extent by school performance, which in turn depends heavily on grades obtained in exams. In this study, we investigate a particular type of exam: multiple-choice tests. More concretely, we study if patterns of correct answers in multiple-choice tests affect performance. We design an experiment to study if…
A topic clustering approach to finding similar questions from large question and answer archives.

PubMed

Zhang, Wei-Nan; Liu, Ting; Yang, Yang; Cao, Liujuan; Zhang, Yu; Ji, Rongrong

2014-01-01

With the blooming of Web 2.0, Community Question Answering (CQA) services such as Yahoo! Answers (http://answers.yahoo.com), WikiAnswer (http://wiki.answers.com), and Baidu Zhidao (http://zhidao.baidu.com), etc., have emerged as alternatives for knowledge and information acquisition. Over time, a large number of question and answer (Q&A) pairs with high quality devoted by human intelligence have been accumulated as a comprehensive knowledge base. Unlike the search engines, which return long lists of results, searching in the CQA services can obtain the correct answers to the question queries by automatically finding similar questions that have already been answered by other users. Hence, it greatly improves the efficiency of the online information retrieval. However, given a question query, finding the similar and well-answered questions is a non-trivial task. The main challenge is the word mismatch between question query (query) and candidate question for retrieval (question). To investigate this problem, in this study, we capture the word semantic similarity between query and question by introducing the topic modeling approach. We then propose an unsupervised machine-learning approach to finding similar questions on CQA Q&A archives. The experimental results show that our proposed approach significantly outperforms the state-of-the-art methods.
Dual process theory and intermediate effect: are faculty and residents' performance on multiple-choice, licensing exam questions different?

PubMed

Dong, Ting; Durning, Steven J; Artino, Anthony R; van der Vleuten, Cees; Holmboe, Eric; Lipner, Rebecca; Schuwirth, Lambert

2015-04-01

Clinical reasoning is essential for the practice of medicine. Dual process theory conceptualizes reasoning as falling into two general categories: nonanalytic reasoning (pattern recognition) and analytic reasoning (active comparing and contrasting of alternatives). The debate continues regarding how expert performance develops and how individuals make the best use of analytic and nonanalytic processes. Several investigators have identified the unexpected finding that intermediates tend to perform better on licensing examination items than experts, which has been termed the "intermediate effect." We explored differences between faculty and residents on multiple-choice questions (MCQs) using dual process measures (both reading and answering times) to inform this ongoing debate. Faculty (board-certified internists; experts) and residents (internal medicine interns; intermediates) answered live licensing examination MCQs (U.S. Medical Licensing Examination Step 2 Clinical Knowledge and American Board of Internal Medicine Certifying Examination) while being timed. We conducted repeated analysis of variance to compare the 2 groups on average reading time, answering time, and accuracy on various types of items. Faculty and residents did not differ significantly in reading time [F (1,35) = 0.01, p = 0.93], answering time [F (1,35) = 0.60, p = 0.44], or accuracy [F (1,35) = 0.24, p = 0.63] regardless of easy or hard items. Dual process theory was not evidenced in this study. However, this lack of difference between faculty and residents may have been affected by the small sample size of participants and MCQs may not reflect how physicians made decisions in actual practice setting. Reprint & Copyright © 2015 Association of Military Surgeons of the U.S.
Comparison in the quality of distractors in three and four options type of multiple choice questions

PubMed Central

Rahma, Nourelhouda A A; Shamad, Mahdi M A; Idris, Muawia E A; Elfaki, Omer Abdelgadir; Elfakey, Walyedldin E M; Salih, Karimeldin M A

2017-01-01

Introduction The number of distractors needed for high quality multiple choice questions (MCQs) will be determined by many factors. These include firstly whether English language is their mother tongue or a foreign language; secondly whether the instructors who construct the questions are experts or not; thirdly the time spent on constructing the options is also an important factor. It has been observed by Tarrant et al that more time is often spent on constructing questions than on tailoring sound, reliable, and valid distractors. Objectives Firstly, to investigate the effects of reducing the number of options on psychometric properties of the item. Secondly, to determine the frequency of functioning distractors among three or four options in the MCQs examination of the dermatology course in University of Bahri, College of Medicine. Materials and methods This is an experimental study which was performed by means of a dermatology exam, MCQs type. Forty MCQs, with one correct answer for each question were constructed. Two sets of this exam paper were prepared: in the first one, four options were given, including one key answer and three distractors. In the second set, one of the three distractors was deleted randomly, and the sequence of the questions was kept in the same order. Any distracter chosen by less than 5% of the students was regarded as non-functioning. Kuder-Richardson Formula 20 (Kr-20) measures the internal consistency and reliability of an examination with an acceptable range 0.8–1.0. Chi square test was used to compare the distractors in the two exams. Results A significant difference was observed in discrimination and difficulty indexes for both sets of MCQs. More distractors were non-functional for set one (of four options), but slightly more reliable. The reliability (Kr-20) was slightly higher for set one (of four options). The average marks in option three and four were 34.163 and 33.140, respectively. Conclusion Compared to set 1 (four
Questions and Answers about Sex (For Parents)

MedlinePlus

... Educators Search English Español Questions and Answers About Sex KidsHealth / For Parents / Questions and Answers About Sex ... extent can parents depend on schools to teach sex education? Parents should begin the sex education process ...
Questions and Answers About Nuclear Power Plants.

ERIC Educational Resources Information Center

Environmental Protection Agency, Washington, DC.

This pamphlet is designed to answer many of the questions that have arisen about nuclear power plants and the environment. It is organized into a question and answer format, with the questions taken from those most often asked by the public. Topics include regulation of nuclear power sources, potential dangers to people's health, whether nuclear…
The memorial consequences of multiple-choice testing.

PubMed

Marsh, Elizabeth J; Roediger, Henry L; Bjork, Robert A; Bjork, Elizabeth L

2007-04-01

The present article addresses whether multiple-choice tests may change knowledge even as they attempt to measure it. Overall, taking a multiple-choice test boosts performance on later tests, as compared with non-tested control conditions. This benefit is not limited to simple definitional questions, but holds true for SAT II questions and for items designed to tap concepts at a higher level in Bloom's (1956) taxonomy of educational objectives. Students, however, can also learn false facts from multiple-choice tests; testing leads to persistence of some multiple-choice lures on later general knowledge tests. Such persistence appears due to faulty reasoning rather than to an increase in the familiarity of lures. Even though students may learn false facts from multiple-choice tests, the positive effects of testing outweigh this cost.
Asymmetry in Student Achievement on Multiple-Choice and Constructed-Response Items in Reversible Mathematics Processes

ERIC Educational Resources Information Center

Sangwin, Christopher J.; Jones, Ian

2017-01-01

In this paper we report the results of an experiment designed to test the hypothesis that when faced with a question involving the inverse direction of a reversible mathematical process, students solve a multiple-choice version by verifying the answers presented to them by the direct method, not by undertaking the actual inverse calculation.…
Accommodations for Multiple Choice Tests

ERIC Educational Resources Information Center

Trammell, Jack

2011-01-01

Students with learning or learning-related disabilities frequently struggle with multiple choice assessments due to difficulty discriminating between items, filtering out distracters, and framing a mental best answer. This Practice Brief suggests accommodations and strategies that disability service providers can utilize in conjunction with…
The positive and negative consequences of multiple-choice testing.

PubMed

Roediger, Henry L; Marsh, Elizabeth J

2005-09-01

Multiple-choice tests are commonly used in educational settings but with unknown effects on students' knowledge. The authors examined the consequences of taking a multiple-choice test on a later general knowledge test in which students were warned not to guess. A large positive testing effect was obtained: Prior testing of facts aided final cued-recall performance. However, prior testing also had negative consequences. Prior reading of a greater number of multiple-choice lures decreased the positive testing effect and increased production of multiple-choice lures as incorrect answers on the final test. Multiple-choice testing may inadvertently lead to the creation of false knowledge.

Trustworthiness and relevance in web-based clinical question answering.

PubMed

Cruchet, Sarah; Boyer, Célia; van der Plas, Lonneke

2012-01-01

Question answering systems try to give precise answers to a user's question posed in natural language. It is of utmost importance that the answers returned are relevant to the user's question. For clinical QA, the trustworthiness of answers is another important issue. Limiting the document collection to certified websites helps to improve the trustworthiness of answers. On the other hand, limited document collections are known to harm the relevancy of answers. We show, however, in a comparative evaluation, that promoting trustworthiness has no negative effect on the relevance of the retrieved answers in our clinical QA system. On the contrary, the answers found are in general more relevant.
The Yes-No Question Answering System and Statement Verification.

ERIC Educational Resources Information Center

Akiyama, M. Michael; And Others

1979-01-01

Two experiments investigated the relationship of verification to the answering of yes-no questions. Subjects verified simple statements or answered simple questions. Various proposals concerning the relative difficulty of answering questions and verifying statements were considered, and a model was proposed. (SW)
Answering Your Questions about AIDS.

ERIC Educational Resources Information Center

Kalichman, Seth C.

This book focuses on AIDS education and answers 350 commonly asked questions about Human Immunodeficiency Virus (HIV) and Acquired Immune Deficiency Syndrome (AIDS) taken from questions addressed to two major urban AIDS hotlines (Milwaukee, Wisconsin, and Houston, Texas). Chapter 1, "HIV - The Virus That Causes AIDS," discusses: the HIV…
Multiple-Choice Test Bias Due to Answering Strategy Variation.

ERIC Educational Resources Information Center

Frary, Robert B.; Giles, Mary B.

This paper describes the development and investigation of a new approach to determining the existence of bias in multiple-choice test scores. Previous work in this area has concentrated almost exclusively on bias attributable to specific test items or to differences in test score distributions across racial or ethnic groups. In contrast, the…
Effects of Test Expectation on Multiple-Choice Performance and Subjective Ratings

ERIC Educational Resources Information Center

Balch, William R.

2007-01-01

Undergraduates studied the definitions of 16 psychology terms, expecting either a multiple-choice (n = 132) or short-answer (n = 122) test. All students then received the same multiple-choice test, requiring them to recognize the definitions as well as novel examples of the terms. Compared to students expecting a multiple-choice test, those…
Postsecondary Education Issues: Visible Questions. Invisible Answers.

ERIC Educational Resources Information Center

Western Interstate Commission for Higher Education, Boulder, CO. National Center for Higher Education Management Systems.

With some justification, the inability to answer most of the important questions in higher education is due to the lack of necessary information. But careful examination of our many faceted questions suggests that more information may not be the only answer. The National Center for Higher Education Management Systems (NCHEMS) has found other…
A Noisy-Channel Approach to Question Answering

DTIC Science & Technology

2003-01-01

question “When did Elvis Presley die?” To do this, we build a noisy channel model that makes explicit how answer sentence parse trees are mapped into...in Figure 1, the algorithm above generates the following training example: Q: When did Elvis Presley die ? SA: Presley died PP PP in A_DATE, and...engine as a potential candidate for finding the answer to the question “When did Elvis Presley die?” In this case, we don’t know what the answer is
Revealing Learner Interests through Topic Mining from Question-Answering Data

ERIC Educational Resources Information Center

Dun, Yijie; Wang, Na; Wang, Min; Hao, Tianyong

2017-01-01

In a question-answering system, learner generated content including asked and answered questions is a meaningful resource to capture learning interests. This paper proposes an approach based on question topic mining for revealing learners' concerned topics in real community question-answering systems. The authors' approach firstly preprocesses all…
Answering Questions and Questioning Answers. Part II. University of Central Florida Conference Papers.

ERIC Educational Resources Information Center

Miller, C. C.; And Others

1982-01-01

Brief analyses are provided of presentations made at a conference, held at the University of Central Florida in Orlando, which addressed questions and answers relating to research and education. Conference sessions explored the role of research in relation to educational practices with special focus on theory, research, issues and application.…
Does Educator Training or Experience Affect the Quality of Multiple-Choice Questions?

PubMed

Webb, Emily M; Phuong, Jonathan S; Naeger, David M

2015-10-01

Physicians receive little training on proper multiple-choice question (MCQ) writing methods. Well-constructed MCQs follow rules, which ensure that a question tests what it is intended to test. Questions that break these are described as "flawed." We examined whether the prevalence of flawed questions differed significantly between those with or without prior training in question writing and between those with different levels of educator experience. We assessed 200 unedited MCQs from a question bank for our senior medical student radiology elective: an equal number of questions (50) were written by faculty with previous training in MCQ writing, other faculty, residents, and medical students. Questions were scored independently by two readers for the presence of 11 distinct flaws described in the literature. Questions written by faculty with MCQ writing training had significantly fewer errors: mean 0.4 errors per question compared to a mean of 1.5-1.7 errors per question for the other groups (P < .001). There were no significant differences in the total number of errors between the untrained faculty, residents, and students (P values .35-.91). Among trained faculty 17/50 questions (34%) were flawed, whereas other faculty wrote 38/50 (76%) flawed questions, residents 37/50 (74%), and students 44/50 (88%). Trained question writers' higher performance was mainly manifest in the reduced frequency of five specific errors. Faculty with training in effective MCQ writing made fewer errors in MCQ construction. Educator experience alone had no effect on the frequency of flaws; faculty without dedicated training, residents, and students performed similarly. Copyright © 2015 AUR. Published by Elsevier Inc. All rights reserved.
A Flexible Question-and-Answer Task for Measuring Speech Understanding

PubMed Central

Streeter, Timothy; Roverud, Elin; Mason, Christine R.; Kidd, Gerald

2016-01-01

This report introduces a new speech task based on simple questions and answers. The task differs from a traditional sentence recall task in that it involves an element of comprehension and can be implemented in an ongoing fashion. It also contains two target items (the question and the answer) that may be associated with different voices and locations to create dynamic listening scenarios. A set of 227 questions was created, covering six broad categories (days of the week, months of the year, numbers, colors, opposites, and sizes). All questions and their one-word answers were spoken by 11 female and 11 male talkers. In this study, listeners were presented with question-answer pairs and asked to indicate whether the answer was true or false. Responses were given as simple button or key presses, which are quick to make and easy to score. Two preliminary experiments are presented that illustrate different ways of implementing the basic task. In the first experiment, question-answer pairs were presented in speech-shaped noise, and performance was compared across subjects, question categories, and time, to examine the different sources of variability. In the second experiment, sequences of question-answer pairs were presented amidst competing conversations in an ongoing, spatially dynamic listening scenario. Overall, the question-and-answer task appears to be feasible and could be implemented flexibly in a number of different ways. PMID:27888257
The artful dodger: answering the wrong question the right way.

PubMed

Rogers, Todd; Norton, Michael I

2011-06-01

What happens when speakers try to "dodge" a question they would rather not answer by answering a different question? In 4 studies, we show that listeners can fail to detect dodges when speakers answer similar-but objectively incorrect-questions (the "artful dodge"), a detection failure that goes hand-in-hand with a failure to rate dodgers more negatively. We propose that dodges go undetected because listeners' attention is not usually directed toward a goal of dodge detection (i.e., Is this person answering the question?) but rather toward a goal of social evaluation (i.e., Do I like this person?). Listeners were not blind to all dodge attempts, however. Dodge detection increased when listeners' attention was diverted from social goals toward determining the relevance of the speaker's answers (Study 1), when speakers answered a question egregiously dissimilar to the one asked (Study 2), and when listeners' attention was directed to the question asked by keeping it visible during speakers' answers (Study 4). We also examined the interpersonal consequences of dodge attempts: When listeners were guided to detect dodges, they rated speakers more negatively (Study 2), and listeners rated speakers who answered a similar question in a fluent manner more positively than speakers who answered the actual question but disfluently (Study 3). These results add to the literatures on both Gricean conversational norms and goal-directed attention. We discuss the practical implications of our findings in the contexts of interpersonal communication and public debates.
99 Facts about the FBI: Questions and Answers.

ERIC Educational Resources Information Center

Federal Bureau of Investigation, Quantico, VA.

This booklet on the Federal Bureau of Investigation (FBI) attempts to provide an overview of the FBI's functions. Presented in a question and answer format, the 99 questions and answers discuss the federal government agency's history, administrative matters, jurisdiction, criminal investigations, security matters, foreign counter-intelligence, and…
Comparison of individual answer and group answer with and without structured peer assessment

NASA Astrophysics Data System (ADS)

Kablan, Zeynel

2014-09-01

Background:Cooperative learning activities provide active participation of students leading to better learning. The literature suggests that cooperative learning activities need to be structured for a more effective and productive interaction. Purpose: This study aimed to test the differences among three instructional conditions in terms of science achievement. Sample:A total of 79 fifth-grade students, 42 males (53%) and 37 females (47%), participated in the study. Design and Methods:In the first condition, students answered the teacher's questions individually by raising hands. In the second condition, students discussed the answer in groups and came up with a single group answer. In this condition, the teacher provided only verbal directions to the groups without using any strategy or material. In the third condition, students used a 'peer assessment form' before giving the group answer. A pre-/post-test experimental design was used. Multiple-choice and open-ended tests were used for data collection. One-way analysis of variance (ANOVA) was conducted to test the differences in the test scores between the three groups (individual answer, unstructured group answer and structured group answer). Results:Results showed that there were no significant differences among the three learning conditions in terms of their multiple-choice test scores. In terms of the open-ended test scores, students in the structured group answer condition scored significantly higher than the students in the individual answer condition. Conclusions:Structuring the group work through peer assessment helped to monitor the group discussion, provided a better learning compared to the individual answer condition, and helped students to participate in the activity equally.
A Flexible Question-and-Answer Task for Measuring Speech Understanding.

PubMed

Best, Virginia; Streeter, Timothy; Roverud, Elin; Mason, Christine R; Kidd, Gerald

2016-11-24

This report introduces a new speech task based on simple questions and answers. The task differs from a traditional sentence recall task in that it involves an element of comprehension and can be implemented in an ongoing fashion. It also contains two target items (the question and the answer) that may be associated with different voices and locations to create dynamic listening scenarios. A set of 227 questions was created, covering six broad categories (days of the week, months of the year, numbers, colors, opposites, and sizes). All questions and their one-word answers were spoken by 11 female and 11 male talkers. In this study, listeners were presented with question-answer pairs and asked to indicate whether the answer was true or false. Responses were given as simple button or key presses, which are quick to make and easy to score. Two preliminary experiments are presented that illustrate different ways of implementing the basic task. In the first experiment, question-answer pairs were presented in speech-shaped noise, and performance was compared across subjects, question categories, and time, to examine the different sources of variability. In the second experiment, sequences of question-answer pairs were presented amidst competing conversations in an ongoing, spatially dynamic listening scenario. Overall, the question-and-answer task appears to be feasible and could be implemented flexibly in a number of different ways. © The Author(s) 2016.
So, What Is the Answer? Questions

ERIC Educational Resources Information Center

Hall, Don

2005-01-01

Leaders are barraged daily by teachers, administrators, and students seeking answers to questions ranging from the simplistic to the metaphysical in their complexity. The author is sure leaders wonder at times, "How in the world can I free up enough time to answer them all?" Well, the author states that he hates to break the news, but it is…
Toward automated consumer question answering: automatically separating consumer questions from professional questions in the healthcare domain.

PubMed

Liu, Feifan; Antieau, Lamont D; Yu, Hong

2011-12-01

Both healthcare professionals and healthcare consumers have information needs that can be met through the use of computers, specifically via medical question answering systems. However, the information needs of both groups are different in terms of literacy levels and technical expertise, and an effective question answering system must be able to account for these differences if it is to formulate the most relevant responses for users from each group. In this paper, we propose that a first step toward answering the queries of different users is automatically classifying questions according to whether they were asked by healthcare professionals or consumers. We obtained two sets of consumer questions (~10,000 questions in total) from Yahoo answers. The professional questions consist of two question collections: 4654 point-of-care questions (denoted as PointCare) obtained from interviews of a group of family doctors following patient visits and 5378 questions from physician practices through professional online services (denoted as OnlinePractice). With more than 20,000 questions combined, we developed supervised machine-learning models for automatic classification between consumer questions and professional questions. To evaluate the robustness of our models, we tested the model that was trained on the Consumer-PointCare dataset on the Consumer-OnlinePractice dataset. We evaluated both linguistic features and statistical features and examined how the characteristics in two different types of professional questions (PointCare vs. OnlinePractice) may affect the classification performance. We explored information gain for feature reduction and the back-off linguistic category features. The 10-fold cross-validation results showed the best F1-measure of 0.936 and 0.946 on Consumer-PointCare and Consumer-OnlinePractice respectively, and the best F1-measure of 0.891 when testing the Consumer-PointCare model on the Consumer-OnlinePractice dataset. Healthcare consumer
Some Effects of Changes in Question Structure and Sequence on Performance in a Multiple Choice Chemistry Test.

ERIC Educational Resources Information Center

Hodson, D.

1984-01-01

Investigated the effect on student performance of changes in question structure and sequence on a GCE 0-level multiple-choice chemistry test. One finding noted is that there was virtually no change in test reliability on reducing the number of options (from five to per test item). (JN)
A Novel Multiple Choice Question Generation Strategy: Alternative Uses for Controlled Vocabulary Thesauri in Biomedical-Sciences Education.

PubMed

Lopetegui, Marcelo A; Lara, Barbara A; Yen, Po-Yin; Çatalyürek, Ümit V; Payne, Philip R O

2015-01-01

Multiple choice questions play an important role in training and evaluating biomedical science students. However, the resource intensive nature of question generation limits their open availability, reducing their contribution to evaluation purposes mainly. Although applied-knowledge questions require a complex formulation process, the creation of concrete-knowledge questions (i.e., definitions, associations) could be assisted by the use of informatics methods. We envisioned a novel and simple algorithm that exploits validated knowledge repositories and generates concrete-knowledge questions by leveraging concepts' relationships. In this manuscript we present the development and validation of a prototype which successfully produced meaningful concrete-knowledge questions, opening new applications for existing knowledge repositories, potentially benefiting students of all biomedical sciences disciplines.
Environmental Problems, Causes, and Solutions: An Open Question

ERIC Educational Resources Information Center

Negev, Maya; Garb, Yaakov; Biller, Roni; Sagy, Gonen; Tal, Alon

2010-01-01

In a national evaluation of environmental literacy in Israel, (Negev, Sagy, Garb, Salzberg, & Tal, 2008), the authors included both multiple choice questions and open questions. In this article the authors describe the qualitative analysis of the answers to an open question regarding a local environmental problem. Most participants specified…

Questions and Answers for Architectural Coatings Rule

EPA Pesticide Factsheets

The EPA compiled this question and answer document from inquiries received after the publication of the 1999 final architectural coatings rule and from questions raised at meetings with industry associations.
The Artful Dodger: Answering the Wrong Question the Right Way

ERIC Educational Resources Information Center

Rogers, Todd; Norton, Michael I.

2011-01-01

What happens when speakers try to "dodge" a question they would rather not answer by answering a different question? In 4 studies, we show that listeners can fail to detect dodges when speakers answer similar--but objectively incorrect--questions (the "artful dodge"), a detection failure that goes hand-in-hand with a failure to rate dodgers more…
Use of Credibility Heuristics in a Social Question-Answering Service

ERIC Educational Resources Information Center

Matthews, Paul

2015-01-01

Introduction: This study looked at the effect of community peripheral cues (specifically voting score and answerer's reputation) on the user's credibility rating of answers. Method: Students in technology and philosophy were asked to assess the credibility of answers to questions posted on a social question-answering platform. Through the use of a…
The Effect of English Language on Multiple Choice Question Scores of Thai Medical Students.

PubMed

Phisalprapa, Pochamana; Muangkaew, Wayuda; Assanasen, Jintana; Kunavisarut, Tada; Thongngarm, Torpong; Ruchutrakool, Theera; Kobwanthanakun, Surapon; Dejsomritrutai, Wanchai

2016-04-01

Universities in Thailand are preparing for Thailand's integration into the ASEAN Economic Community (AEC) by increasing the number of tests in English language. English language is not the native language of Thailand Differences in English language proficiency may affect scores among test-takers, even when subject knowledge among test-takers is comparable and may falsely represent the knowledge level of the test-taker. To study the impact of English language multiple choice test questions on test scores of medical students. The final examination of fourth-year medical students completing internal medicine rotation contains 120 multiple choice questions (MCQ). The languages used on the test are Thai and English at a ratio of 3:1. Individual scores of tests taken in both languages were collected and the effect of English language on MCQ was analyzed Individual MCQ scores were then compared with individual student English language proficiency and student grade point average (GPA). Two hundred ninety five fourth-year medical students were enrolled. The mean percentage of MCQ scores in Thai and English were significantly different (65.0 ± 8.4 and 56.5 ± 12.4, respectively, p < 0.001). The correlation between MCQ scores in Thai and English was fair (Spearman's correlation coefficient = 0.41, p < 0.001). Of 295 students, only 73 (24.7%) students scored higher when being tested in English than in Thai language. Students were classified into six grade categories (A, B+, B, C+, C, and D+), which cumulatively measured total internal medicine rotation performance score plus final examination score. MCQ scores from Thai language examination were more closely correlated with total course grades than were the scores from English language examination (Spearman's correlation coefficient = 0.73 (p < 0.001) and 0.53 (p < 0.001), respectively). The gap difference between MCQ scores in both languages was higher in borderline students than in the excellent student group (11.2 ± 11
A Comparison of Study Strategies for Passages: Rereading, Answering Questions, and Generating Questions

ERIC Educational Resources Information Center

Weinstein, Yana; McDermott, Kathleen B.; Roediger, Henry L., III

2010-01-01

Students are often encouraged to generate and answer their own questions on to-be-remembered material, because this interactive process is thought to enhance memory. But does this strategy actually work? In three experiments, all participants read the same passage, answered questions, and took a test to get accustomed to the materials in a…
Exploring examinee behaviours as validity evidence for multiple-choice question examinations.

PubMed

Surry, Luke T; Torre, Dario; Durning, Steven J

2017-10-01

Clinical-vignette multiple choice question (MCQ) examinations are used widely in medical education. Standardised MCQ examinations are used by licensure and certification bodies to award credentials that are meant to assure stakeholders as to the quality of physicians. Such uses are based on the interpretation of MCQ examination performance as giving meaningful information about the quality of clinical reasoning. There are several assumptions foundational to these interpretations and uses of standardised MCQ examinations. This study explores the implicit assumption that cognitive processes elicited by clinical-vignette MCQ items are like the processes thought to occur with 'real-world' clinical reasoning as theorised by dual-process theory. Fourteen participants (three medical students, five residents and six staff physicians) completed three sets of five timed MCQ items (total 15) from the Medical Knowledge Self-Assessment Program (MKSAP). Upon answering a set of MCQs, each participant completed a retrospective think aloud (TA) protocol. Using constant comparative analysis (CCA) methods sensitised by dual-process theory, we performed a qualitative thematic analysis. Examinee behaviours fell into three categories: clinical reasoning behaviours, test-taking behaviours and reactions to the MCQ. Consistent with dual-process theory, statements about clinical reasoning behaviours were divided into two sub-categories: analytical reasoning and non-analytical reasoning. Each of these categories included several themes. Our study provides some validity evidence that test-takers' descriptions of their cognitive processes during completion of high-quality clinical-vignette MCQs align with processes expected in real-world clinical reasoning. This supports one of the assumptions important for interpretations of MCQ examination scores as meaningful measures of clinical reasoning. Our observations also suggest that MCQs elicit other cognitive processes, including certain test
Multiple Choice Items: How to Gain the Most out of Them.

ERIC Educational Resources Information Center

Talmir, Pinchas

1991-01-01

Describes how multiple-choice items can be designed and used as an effective diagnostic tool by avoiding their pitfalls and by taking advantage of their potential benefits. The following issues are discussed: correct' versus best answers; construction of diagnostic multiple-choice items; the problem of guessing; the use of justifications of…
The Basic Epistemological Questions--Are There Also Valid Answers?

ERIC Educational Resources Information Center

Oderman, Dale B.

Epistemology is the branch of philosophy that seeks answers to two main questions: How do we know? and How do we know we know? This paper is concerned with how four major schools of thought have addressed these questions and the implications that their answers to these questions have for education. The paper begins by discussing how four major…
Questions & Answers about Aeronautics and Space.

ERIC Educational Resources Information Center

National Aeronautics and Space Administration, Washington, DC.

Answers to 27 questions about aeronautics, space, and the National Aeronautics and Space Administration (NASA) are provided in this pamphlet. Among the topics dealt with in these questions are: costs of the space program; NASA's role in aeronautics; benefits received from the space program; why the United States hasn't developed means of rescuing…
Improving Students' Capacity to Show Their Knowledge, Understanding and Skills in Exams by Using Combined Question and Answer Papers

ERIC Educational Resources Information Center

Crisp, Victoria

2008-01-01

This research set out to compare the quality, length and nature of (1) exam responses in combined question and answer booklets, with (2) responses in separate answer booklets in order to inform choices about response format. Combined booklets are thought to support candidates by giving more information on what is expected of them. Anecdotal…
Cross-domain question classification in community question answering via kernel mapping

NASA Astrophysics Data System (ADS)

Su, Lei; Hu, Zuoliang; Yang, Bin; Li, Yiyang; Chen, Jun

2015-10-01

An increasingly popular method for retrieving information is via the community question answering (CQA) systems such as Yahoo! Answers and Baidu Knows. In CQA, question classification plays an important role to find the answers. However, the labeled training examples for statistical question classifier are fairly expensive to obtain, as they require the experienced human efforts. Meanwhile, unlabeled data are readily available. This paper employs the method of domain adaptation via kernel mapping to solve this problem. In detail, the kernel approach is utilized to map the target-domain data and the source-domain data into a common space, where the question classifiers are trained under the closer conditional probabilities. The kernel mapping function is constructed by domain knowledge. Therefore, domain knowledge could be transferred from the labeled examples in the source domain to the unlabeled ones in the targeted domain. The statistical training model can be improved by using a large number of unlabeled data. Meanwhile, the Hadoop Platform is used to construct the mapping mechanism to reduce the time complexity. Map/Reduce enable kernel mapping for domain adaptation in parallel in the Hadoop Platform. Experimental results show that the accuracy of question classification could be improved by the method of kernel mapping. Furthermore, the parallel method in the Hadoop Platform could effective schedule the computing resources to reduce the running time.
Is that your final answer? Relationship of changed answers to overall performance on a computer-based medical school course examination.

PubMed

Ferguson, Kristi J; Kreiter, Clarence D; Peterson, Michael W; Rowat, Jane A; Elliott, Scott T

2002-01-01

Whether examinees benefit from the opportunity to change answers to examination questions has been discussed widely. This study was undertaken to document the impact of answer changing on exam performance on a computer-based course examination in a second-year medical school course. This study analyzed data from a 2 hour, 80-item computer delivered multiple-choice exam administered to 190 students (166 second-year medical students and 24 physician's assistant students). There was a small but significant net improvement in overall score when answers were changed: one student's score increased by 7 points, 93 increased by 1 to 4 points, and 38 decreased by 1 to 3 points. On average, lower-performing students benefited slightly less than higher-performing students. Students spent more time on questions for which they changed the answers and were more likely to change items that were more difficult. Students should not be discouraged from changing answers, especially to difficult questions that require careful consideration, although the net effect is quite small.
Making School Choice Work

ERIC Educational Resources Information Center

DeArmond, Michael; Jochim, Ashley; Lake, Robin

2014-01-01

School choice is increasingly the new normal in urban education. But in cities with multiple public school options, how can civic leaders create a choice system that works for all families, whether they choose a charter or district public school? To answer this question, the Center on Reinventing Public Education (CRPE) researchers surveyed 4,000…
Impression formation of tests: retrospective judgments of performance are higher when easier questions come first.

PubMed

Jackson, Abigail; Greene, Robert L

2014-11-01

Four experiments are reported on the importance of retrospective judgments of performance (postdictions) on tests. Participants answered general knowledge questions and estimated how many questions they answered correctly. They gave higher postdictions when easy questions preceded difficult questions. This was true when time to answer each question was equalized and constrained, when participants were instructed not to write answers, and when questions were presented in a multiple-choice format. Results are consistent with the notion that first impressions predominate in overall perception of test difficulty.
Common Timberland Tax Questions and Answers

Treesearch

William C. Siegel

1999-01-01

I recieve numerous letters and telephone calls from non-industrial forest landowners throughout the country who have timber tax questions. Many of the questions I've been asked during the last year should also be of interest to the readers of National Woodlands. I've therefore selected some of them and my answers, for this issue's "Timber and...
Should essays and other "open-ended"-type questions retain a place in written summative assessment in clinical medicine?

PubMed

Hift, Richard J

2014-11-28

Written assessments fall into two classes: constructed-response or open-ended questions, such as the essay and a number of variants of the short-answer question, and selected-response or closed-ended questions; typically in the form of multiple-choice. It is widely believed that constructed response written questions test higher order cognitive processes in a manner that multiple-choice questions cannot, and consequently have higher validity. An extensive review of the literature suggests that in summative assessment neither premise is evidence-based. Well-structured open-ended and multiple-choice questions appear equivalent in their ability to assess higher cognitive functions, and performance in multiple-choice assessments may correlate more highly than the open-ended format with competence demonstrated in clinical practice following graduation. Studies of construct validity suggest that both formats measure essentially the same dimension, at least in mathematics, the physical sciences, biology and medicine. The persistence of the open-ended format in summative assessment may be due to the intuitive appeal of the belief that synthesising an answer to an open-ended question must be both more cognitively taxing and similar to actual experience than is selecting a correct response. I suggest that cognitive-constructivist learning theory would predict that a well-constructed context-rich multiple-choice item represents a complex problem-solving exercise which activates a sequence of cognitive processes which closely parallel those required in clinical practice, hence explaining the high validity of the multiple-choice format. The evidence does not support the proposition that the open-ended assessment format is superior to the multiple-choice format, at least in exit-level summative assessment, in terms of either its ability to test higher-order cognitive functioning or its validity. This is explicable using a theory of mental models, which might predict that the
Assessment of higher order cognitive skills in undergraduate education: modified essay or multiple choice questions? Research paper

PubMed Central

Palmer, Edward J; Devitt, Peter G

2007-01-01

Background Reliable and valid written tests of higher cognitive function are difficult to produce, particularly for the assessment of clinical problem solving. Modified Essay Questions (MEQs) are often used to assess these higher order abilities in preference to other forms of assessment, including multiple-choice questions (MCQs). MEQs often form a vital component of end-of-course assessments in higher education. It is not clear how effectively these questions assess higher order cognitive skills. This study was designed to assess the effectiveness of the MEQ to measure higher-order cognitive skills in an undergraduate institution. Methods An analysis of multiple-choice questions and modified essay questions (MEQs) used for summative assessment in a clinical undergraduate curriculum was undertaken. A total of 50 MCQs and 139 stages of MEQs were examined, which came from three exams run over two years. The effectiveness of the questions was determined by two assessors and was defined by the questions ability to measure higher cognitive skills, as determined by a modification of Bloom's taxonomy, and its quality as determined by the presence of item writing flaws. Results Over 50% of all of the MEQs tested factual recall. This was similar to the percentage of MCQs testing factual recall. The modified essay question failed in its role of consistently assessing higher cognitive skills whereas the MCQ frequently tested more than mere recall of knowledge. Conclusion Construction of MEQs, which will assess higher order cognitive skills cannot be assumed to be a simple task. Well-constructed MCQs should be considered a satisfactory replacement for MEQs if the MEQs cannot be designed to adequately test higher order skills. Such MCQs are capable of withstanding the intellectual and statistical scrutiny imposed by a high stakes exit examination. PMID:18045500
Answering Wh- Questions About Sentences and Text.

ERIC Educational Resources Information Center

Singer, Murray

1986-01-01

Describes a study designed to identify the mental operations that contribute to people's ability to answer wh- questions, that is, questions which request information that plays a particular role in relation to some action or event. Wh- questions are signaled by interrogative pronouns and adverbs like who, what, when, and where. (SED)
Questions & Answers about...Marfan Syndrome.

ERIC Educational Resources Information Center

National Inst. of Arthritis and Musculoskeletal and Skin Diseases (NIH), Bethesda, MD.

This fact sheet answers general questions about Marfan syndrome, a heritable condition that affects the connective tissue. It describes the characteristics of the disorder, the diagnostic process, and ways to manage symptoms. Characteristics include: (1) people with Marfan syndrome are typically very tall, slender, and loose jointed; (2) more than…
Answers to Health Questions in Physical Education.

ERIC Educational Resources Information Center

Kaplan, Robert, Ed.

Culled from the answers of physical education teachers and coaches, this booklet attempts to indicate the scope of health problems and suggests some directions which the solutions may take. It is divided into three parts. Part 1, Health and Safety in Activity Programs, answers questions on first aid, excused absences, and desirability of…

Biomedical question answering using semantic relations.

PubMed

Hristovski, Dimitar; Dinevski, Dejan; Kastrin, Andrej; Rindflesch, Thomas C

2015-01-16

The proliferation of the scientific literature in the field of biomedicine makes it difficult to keep abreast of current knowledge, even for domain experts. While general Web search engines and specialized information retrieval (IR) systems have made important strides in recent decades, the problem of accurate knowledge extraction from the biomedical literature is far from solved. Classical IR systems usually return a list of documents that have to be read by the user to extract relevant information. This tedious and time-consuming work can be lessened with automatic Question Answering (QA) systems, which aim to provide users with direct and precise answers to their questions. In this work we propose a novel methodology for QA based on semantic relations extracted from the biomedical literature. We extracted semantic relations with the SemRep natural language processing system from 122,421,765 sentences, which came from 21,014,382 MEDLINE citations (i.e., the complete MEDLINE distribution up to the end of 2012). A total of 58,879,300 semantic relation instances were extracted and organized in a relational database. The QA process is implemented as a search in this database, which is accessed through a Web-based application, called SemBT (available at http://sembt.mf.uni-lj.si ). We conducted an extensive evaluation of the proposed methodology in order to estimate the accuracy of extracting a particular semantic relation from a particular sentence. Evaluation was performed by 80 domain experts. In total 7,510 semantic relation instances belonging to 2,675 distinct relations were evaluated 12,083 times. The instances were evaluated as correct 8,228 times (68%). In this work we propose an innovative methodology for biomedical QA. The system is implemented as a Web-based application that is able to provide precise answers to a wide range of questions. A typical question is answered within a few seconds. The tool has some extensions that make it especially useful for
"If you have the flu symptoms, your asymptomatic spouse may better answer the willingness-to-pay question". Evidence from a double-bounded dichotomous choice model with heterogeneous anchoring.

PubMed

Schwarzinger, Michaël; Carrat, Fabrice; Luchini, Stéphane

2009-07-01

The small sample size of contingent valuation (CV) surveys conducted in patients may have limited the use of the single-bounded (SB) dichotomous choice format which is recommended in environmental economics. In this paper, we explore two ways to increase the statistical efficiency of the SB format: (1) by the inclusion of proxies in addition to patients; (2) by the addition of a follow-up dichotomous question, i.e. the double-bounded (DB) dichotomous choice format. We found that patients (n=223) and spouses (n=64) answering on behalf of the patient had on average a similar willingness-to-pay for earlier alleviation of flu symptoms. However, a patient was significantly more likely to anchor his/her answer on the first bid as compared to a spouse. Finally, our original DB model with shift effect and heterogeneous anchoring reconciled the discrepancies found in willingness-to-pay statistics between SB and DB models in keeping with increased statistical efficiency.
Computational Natural Language Inference: Robust and Interpretable Question Answering

ERIC Educational Resources Information Center

Sharp, Rebecca Reynolds

2017-01-01

We address the challenging task of "computational natural language inference," by which we mean bridging two or more natural language texts while also providing an explanation of how they are connected. In the context of question answering (i.e., finding short answers to natural language questions), this inference connects the question…
Berkeley Lab Answers Your Home Energy Efficiency Questions

DOE Office of Scientific and Technical Information (OSTI.GOV)

Walker, Iain

2013-02-14

In this follow-up "Ask Berkeley Lab" video, energy efficiency expert Iain Walker answers some of your questions about home energy efficiency. How do you monitor which appliances use the most energy? Should you replace your old windows? Are photovoltaic systems worth the cost? What to do about a leaky house? And what's the single biggest energy user in your home? Watch the video to get the answers to these and more questions.
Berkeley Lab Answers Your Home Energy Efficiency Questions

ScienceCinema

Walker, Iain

2018-01-16

In this follow-up "Ask Berkeley Lab" video, energy efficiency expert Iain Walker answers some of your questions about home energy efficiency. How do you monitor which appliances use the most energy? Should you replace your old windows? Are photovoltaic systems worth the cost? What to do about a leaky house? And what's the single biggest energy user in your home? Watch the video to get the answers to these and more questions.
Pesticide Labeling Questions & Answers

EPA Pesticide Factsheets

Pesticide manufacturers, applicators, state regulatory agencies, and other stakeholders raise questions or issues about pesticide labels. The questions on this page are those that apply to multiple products or address inconsistencies among product labels.
Effectiveness of Guided Multiple Choice Objective Questions Test on Students' Academic Achievement in Senior School Mathematics by School Location

ERIC Educational Resources Information Center

Igbojinwaekwu, Patrick Chukwuemeka

2015-01-01

This study investigated, using pretest-posttest quasi-experimental research design, the effectiveness of guided multiple choice objective questions test on students' academic achievement in Senior School Mathematics, by school location, in Delta State Capital Territory, Nigeria. The sample comprised 640 Students from four coeducation secondary…
Keys to Success: School Facilities Primer, Questions & Answers 101.

ERIC Educational Resources Information Center

Brady, Jim

This publication provides answers to basic questions to help school board members more fully address the complexities of the planning, design, and construction process in order to maximize the goal of student success. The 101 questions and answers are in the areas of: facility planning; learning environment; information technology; safe schools;…
The Effect of the States of Prior Knowledge on Question Answering.

ERIC Educational Resources Information Center

Holmes, Betty C.

A study was conducted to gain insight into the question answering abilities of good and poor readers by comparing how well they answered questions when their prior knowledge was at two different levels (high, low) and in four different states. These states of prior knowledge consisted of the ways in which answers to the questions were stored in…
Reducing the number of options on multiple-choice questions: response time, psychometrics and standard setting.

PubMed

Schneid, Stephen D; Armour, Chris; Park, Yoon Soo; Yudkowsky, Rachel; Bordage, Georges

2014-10-01

Despite significant evidence supporting the use of three-option multiple-choice questions (MCQs), these are rarely used in written examinations for health professions students. The purpose of this study was to examine the effects of reducing four- and five-option MCQs to three-option MCQs on response times, psychometric characteristics, and absolute standard setting judgements in a pharmacology examination administered to health professions students. We administered two versions of a computerised examination containing 98 MCQs to 38 Year 2 medical students and 39 Year 3 pharmacy students. Four- and five-option MCQs were converted into three-option MCQs to create two versions of the examination. Differences in response time, item difficulty and discrimination, and reliability were evaluated. Medical and pharmacy faculty judges provided three-level Angoff (TLA) ratings for all MCQs for both versions of the examination to allow the assessment of differences in cut scores. Students answered three-option MCQs an average of 5 seconds faster than they answered four- and five-option MCQs (36 seconds versus 41 seconds; p = 0.008). There were no significant differences in item difficulty and discrimination, or test reliability. Overall, the cut scores generated for three-option MCQs using the TLA ratings were 8 percentage points higher (p = 0.04). The use of three-option MCQs in a health professions examination resulted in a time saving equivalent to the completion of 16% more MCQs per 1-hour testing period, which may increase content validity and test score reliability, and minimise construct under-representation. The higher cut scores may result in higher failure rates if an absolute standard setting method, such as the TLA method, is used. The results from this study provide a cautious indication to health professions educators that using three-option MCQs does not threaten validity and may strengthen it by allowing additional MCQs to be tested in a fixed amount
Answers to Health Questions: Internet Search Results Versus Online Health Community Responses

PubMed Central

Vermeesch, Amber; Given, Barbara; Huh, Jina

2016-01-01

Background About 6 million people search for health information on the Internet each day in the United States. Both patients and caregivers search for information about prescribed courses of treatments, unanswered questions after a visit to their providers, or diet and exercise regimens. Past literature has indicated potential challenges around quality in health information available on the Internet. However, diverse information exists on the Internet—ranging from government-initiated webpages to personal blog pages. Yet we do not fully understand the strengths and weaknesses of different types of information available on the Internet. Objective The objective of this research was to investigate the strengths and challenges of various types of health information available online and to suggest what information sources best fit various question types. Methods We collected questions posted to and the responses they received from an online diabetes community and classified them according to Rothwell’s classification of question types (fact, policy, or value questions). We selected 60 questions (20 each of fact, policy, and value) and the replies the questions received from the community. We then searched for responses to the same questions using a search engine and recorded the Results Community responses answered more questions than did search results overall. Search results were most effective in answering value questions and least effective in answering policy questions. Community responses answered questions across question types at an equivalent rate, but most answered policy questions and the least answered fact questions. Value questions were most answered by community responses, but some of these answers provided by the community were incorrect. Fact question search results were the most clinically valid. Conclusions The Internet is a prevalent source of health information for people. The information quality people encounter online can have a large impact
Answers to Health Questions: Internet Search Results Versus Online Health Community Responses.

PubMed

Kanthawala, Shaheen; Vermeesch, Amber; Given, Barbara; Huh, Jina

2016-04-28

About 6 million people search for health information on the Internet each day in the United States. Both patients and caregivers search for information about prescribed courses of treatments, unanswered questions after a visit to their providers, or diet and exercise regimens. Past literature has indicated potential challenges around quality in health information available on the Internet. However, diverse information exists on the Internet-ranging from government-initiated webpages to personal blog pages. Yet we do not fully understand the strengths and weaknesses of different types of information available on the Internet. The objective of this research was to investigate the strengths and challenges of various types of health information available online and to suggest what information sources best fit various question types. We collected questions posted to and the responses they received from an online diabetes community and classified them according to Rothwell's classification of question types (fact, policy, or value questions). We selected 60 questions (20 each of fact, policy, and value) and the replies the questions received from the community. We then searched for responses to the same questions using a search engine and recorded the Community responses answered more questions than did search results overall. Search results were most effective in answering value questions and least effective in answering policy questions. Community responses answered questions across question types at an equivalent rate, but most answered policy questions and the least answered fact questions. Value questions were most answered by community responses, but some of these answers provided by the community were incorrect. Fact question search results were the most clinically valid. The Internet is a prevalent source of health information for people. The information quality people encounter online can have a large impact on them. We present what kinds of questions people ask
From Asking to Answering: Making Questions Explicit

ERIC Educational Resources Information Center

Washington, Gene

2006-01-01

"From Asking To Answering: Making Questions Explicit" describes a pedagogical procedure the author has used in writing classes (expository, technical and creative) to help students better understand the purpose, and effect, of text-questions. It accomplishes this by means of thirteen discrete categories (e.g., CLAIMS, COMMITMENT, ANAPHORA, or…
Interactions and user-perceived helpfulness in diet information social questions & answers.

PubMed

Zhang, Yin; Wang, Peilin

2016-12-01

Online health information seeking using social questions and answers (Social Q&A) sites has been increasingly popular in recent years. It calls for better understanding of health information seeking behaviour and interactions between information seekers and information providers. The study investigates how diet information seekers interact with information providers on WebMD Answers, which is a Social Q&A site devoted to health-related topics, and examines the factors that constitute a 'helpful' answer from an information seeker's perspective. Bales' interaction process analysis was applied as the framework to analyse 568 diet-related Q&As from WebMD Answers to identify interaction patterns. Most diet information seekers post questions anonymously and without any detailed description. Individual experts or health organisations provide most answers. Overall, answers are positively received and had a high satisfaction rating. It was also found that information seeker-perceived helpfulness does not depend on who answered the question but to how an information seeker posted the question. This study indicates that answers at WebMD Answers are helpful for diet information seekers. It sheds new light on the interactions during the Q&A process, preferred site functions and important factors that contribute to perceived helpful answers. © 2016 Health Libraries Group.
The American Indians: Answers to 101 Questions.

ERIC Educational Resources Information Center

Bureau of Indian Affairs (Dept. of Interior), Washington, DC.

Presented in a simple and straightforward manner, this publication answers questions basic to an understanding of the American Indian and his socioeconomic position in the United States. The following identify major areas covered and representative questions: (1) The Indian People (Who is an Indian?); (2) The Legal Status of Indians (Are Indians…
The MiPACQ clinical question answering system.

PubMed

Cairns, Brian L; Nielsen, Rodney D; Masanz, James J; Martin, James H; Palmer, Martha S; Ward, Wayne H; Savova, Guergana K

2011-01-01

The Multi-source Integrated Platform for Answering Clinical Questions (MiPACQ) is a QA pipeline that integrates a variety of information retrieval and natural language processing systems into an extensible question answering system. We present the system's architecture and an evaluation of MiPACQ on a human-annotated evaluation dataset based on the Medpedia health and medical encyclopedia. Compared with our baseline information retrieval system, the MiPACQ rule-based system demonstrates 84% improvement in Precision at One and the MiPACQ machine-learning-based system demonstrates 134% improvement. Other performance metrics including mean reciprocal rank and area under the precision/recall curves also showed significant improvement, validating the effectiveness of the MiPACQ design and implementation.
Pattern recognition as a concept for multiple-choice questions in a national licensing exam.

PubMed

Freiwald, Tilo; Salimi, Madjid; Khaljani, Ehsan; Harendza, Sigrid

2014-11-14

Multiple-choice questions (MCQ) are still widely used in high stakes medical exams. We wanted to examine whether and to what extent a national licensing exam uses the concept of pattern recognition to test applied clinical knowledge. We categorized all 4,134 German National medical licensing exam questions between October 2006 and October 2012 by discipline, year, and type. We analyzed questions from the four largest disciplines: internal medicine (n = 931), neurology (n = 305), pediatrics (n = 281), and surgery (n = 233), with respect to the following question types: knowledge questions (KQ), pattern recognition questions (PRQ), inverse PRQ (IPRQ), and pseudo PRQ (PPRQ). A total 51.1% of all questions were of a higher taxonomical order (PRQ and IPRQ) with a significant decrease in the percentage of these questions (p <0.001) from 2006 (61.5%) to 2012 (41.6%). The proportion of PRQs and IPRQs was significantly lower (p <0.001) in internal medicine and surgery, compared to neurology and pediatrics. PRQs were mostly used in questions about diagnoses (71.7%). A significantly higher (p <0.05) percentage of PR/therapy questions was found for internal medicine compared with neurology and pediatrics. The concept of pattern recognition is used with different priorities and to various extents by the different disciplines in a high stakes exam to test applied clinical knowledge. Being aware of this concept may aid in the design and balance of MCQs in an exam with respect to testing clinical reasoning as a desired skill at the threshold of postgraduate medical education.
Instructor perspectives of multiple-choice questions in summative assessment for novice programmers

NASA Astrophysics Data System (ADS)

Shuhidan, Shuhaida; Hamilton, Margaret; D'Souza, Daryl

2010-09-01

Learning to program is known to be difficult for novices. High attrition and high failure rates in foundation-level programming courses undertaken at tertiary level in Computer Science programs, are commonly reported. A common approach to evaluating novice programming ability is through a combination of formative and summative assessments, with the latter typically represented by a final examination. Preparation of such assessment is driven by instructor perceptions of student learning of programming concepts. This in turn may yield instructor perspectives of summative assessment that do not necessarily correlate with student expectations or abilities. In this article, we present results of our study around instructor perspectives of summative assessment for novice programmers. Both quantitative and qualitative data have been obtained via survey responses from programming instructors with varying teaching experience, and from novice student responses to targeted examination questions. Our findings highlight that most of the instructors believed that summative assessment is, and is meant to be, a valid measure of a student's ability to program. Most instructors further believed that Multiple-choice Questions (MCQs) provide a means of testing a low level of understanding, and a few added qualitative comments to suggest that MCQs are easy questions, and others refused to use them at all. There was no agreement around the proposition that if a question was designed to test a low level of skill, or a low level in a hierarchy of a body of knowledge, that such a question should or would be found to be easy by the student. To aid our analysis of assessment questions, we introduced four measures: Syntax Knowledge; Semantic Knowledge; Problem Solving Skill and the Level of Difficulty of the Problem. We applied these measures to selected examination questions, and have identified gaps between the instructor perspectives of what is considered to be an easy question and also in
The MiPACQ Clinical Question Answering System

PubMed Central

Cairns, Brian L.; Nielsen, Rodney D.; Masanz, James J.; Martin, James H.; Palmer, Martha S.; Ward, Wayne H.; Savova, Guergana K.

2011-01-01

The Multi-source Integrated Platform for Answering Clinical Questions (MiPACQ) is a QA pipeline that integrates a variety of information retrieval and natural language processing systems into an extensible question answering system. We present the system’s architecture and an evaluation of MiPACQ on a human-annotated evaluation dataset based on the Medpedia health and medical encyclopedia. Compared with our baseline information retrieval system, the MiPACQ rule-based system demonstrates 84% improvement in Precision at One and the MiPACQ machine-learning-based system demonstrates 134% improvement. Other performance metrics including mean reciprocal rank and area under the precision/recall curves also showed significant improvement, validating the effectiveness of the MiPACQ design and implementation. PMID:22195068
Can workers answer their questions about occupational safety and health: challenges and solutions.

PubMed

Rhebergen, Martijn; Van Dijk, Frank; Hulshof, Carel

2012-01-01

Many workers have questions about occupational safety and health (OSH). Answers to these questions empower them to further improve their knowledge about OSH, make good decisions about OSH matters and improve OSH practice when necessary. Nevertheless, many workers fail to find the answers to their questions. This paper explores the challenges workers may face when seeking answers to their OSH questions. Findings suggest that many workers may lack the skills, experience or motivation to formulate an answerable question, seek and find information, appraise information, compose correct answers and apply information in OSH practice. Simultaneously, OSH knowledge infrastructures often insufficiently support workers in answering their OSH questions. This paper discusses several potentially attractive strategies for developing and improving OSH knowledge infrastructures: 1) providing courses that teach workers to ask answerable questions and to train them to find, appraise and apply information, 2) developing information and communication technology tools or facilities that support workers as they complete one or more stages in the process from question to answer and 3) tailoring information and implementation strategies to the workers' needs and context to ensure that the information can be applied to OSH practice more easily.

Reply & Supply: Efficient crowdsourcing when workers do more than answer questions

PubMed Central

McAndrew, Thomas C.; Guseva, Elizaveta A.

2017-01-01

Crowdsourcing works by distributing many small tasks to large numbers of workers, yet the true potential of crowdsourcing lies in workers doing more than performing simple tasks—they can apply their experience and creativity to provide new and unexpected information to the crowdsourcer. One such case is when workers not only answer a crowdsourcer’s questions but also contribute new questions for subsequent crowd analysis, leading to a growing set of questions. This growth creates an inherent bias for early questions since a question introduced earlier by a worker can be answered by more subsequent workers than a question introduced later. Here we study how to perform efficient crowdsourcing with such growing question sets. By modeling question sets as networks of interrelated questions, we introduce algorithms to help curtail the growth bias by efficiently distributing workers between exploring new questions and addressing current questions. Experiments and simulations demonstrate that these algorithms can efficiently explore an unbounded set of questions without losing confidence in crowd answers. PMID:28806413
Answering Questions about Complex Events

DTIC Science & Technology

2008-12-19

in their environment. To reason about events requires a means of describing, simulating, and analyzing their underlying dynamic processes . For our...that are relevant to our goal of connecting inference and reasoning about processes to answering questions about events. 11 We start with a...different event and process descriptions, ontologies, and models. 2.1.1 Logical AI In AI, formal approaches to model the ability to reason about
Instructor-Aided Asynchronous Question Answering System for Online Education and Distance Learning

ERIC Educational Resources Information Center

Wen, Dunwei; Cuzzola, John; Brown, Lorna; Kinshuk

2012-01-01

Question answering systems have frequently been explored for educational use. However, their value was somewhat limited due to the quality of the answers returned to the student. Recent question answering (QA) research has started to incorporate deep natural language processing (NLP) in order to improve these answers. However, current NLP…
The Act of Answering Questions Elicited Differentiated Responses in a Concealed Information Test.

PubMed

Otsuka, Takuro; Mizutani, Mitsuyoshi; Yagi, Akihiro; Katayama, Jun'ichi

2018-04-17

The concealed information test (CIT), a psychophysiological detection of deception test, compares physiological responses between crime-related and crime-unrelated items. In previous studies, whether the act of answering questions affected physiological responses was unclear. This study examined effects of both question-related and answer-related processes on physiological responses. Twenty participants received a modified CIT, in which the interval between presentation of questions and answering them was 27 s. Differentiated respiratory movements and cardiovascular responses between items were observed for both questions (items) and answers, while differentiated skin conductance response was observed only for questions. These results suggest that physiological responses to questions reflected orientation to a crime-related item, while physiological responses during answering reflected inhibition of psychological arousal caused by orienting. Regarding the CIT's accuracy, participants' perception of the questions themselves more strongly influenced physiological responses than answering them. © 2018 American Academy of Forensic Sciences.
Multiple-choice tests stabilize access to marginal knowledge.

PubMed

Cantor, Allison D; Eslick, Andrea N; Marsh, Elizabeth J; Bjork, Robert A; Bjork, Elizabeth Ligon

2015-02-01

Marginal knowledge refers to knowledge that is stored in memory, but is not accessible at a given moment. For example, one might struggle to remember who wrote The Call of the Wild, even if that knowledge is stored in memory. Knowing how best to stabilize access to marginal knowledge is important, given that new learning often requires accessing and building on prior knowledge. While even a single opportunity to restudy marginal knowledge boosts its later accessibility (Berger, Hall, & Bahrick, 1999), in many situations explicit relearning opportunities are not available. Our question is whether multiple-choice tests (which by definition expose the learner to the correct answers) can also serve this function and, if so, how testing compares to restudying given that tests can be particularly powerful learning devices (Roediger & Karpicke, 2006). In four experiments, we found that multiple-choice testing had the power to stabilize access to marginal knowledge, and to do so for at least up to a week. Importantly, such tests did not need to be paired with feedback, although testing was no more powerful than studying. Overall, the results support the idea that one's knowledge base is unstable, with individual pieces of information coming in and out of reach. The present findings have implications for a key educational challenge: ensuring that students have continuing access to information they have learned.
Global Perspectives: Some Questions and Answers.

ERIC Educational Resources Information Center

Center for Global Perspectives, New York, NY.

To enlighten the reader on the status, objectives, and needs of global education, this paper poses and answers questions related to global perspectives. A global perspective is interpreted to include heightened awareness and understanding of the global system as well as increased consciousness of the intimate relationship of self, humankind, and…
WordBytes: Exploring an Intermediate Constraint Format for Rapid Classification of Student Answers on Constructed Response Assessments

ERIC Educational Resources Information Center

Kim, Kerry J.; Meir, Eli; Pope, Denise S.; Wendel, Daniel

2017-01-01

Computerized classification of student answers offers the possibility of instant feedback and improved learning. Open response (OR) questions provide greater insight into student thinking and understanding than more constrained multiple choice (MC) questions, but development of automated classifiers is more difficult, often requiring training a…
Visual question answering using hierarchical dynamic memory networks

NASA Astrophysics Data System (ADS)

Shang, Jiayu; Li, Shiren; Duan, Zhikui; Huang, Junwei

2018-04-01

Visual Question Answering (VQA) is one of the most popular research fields in machine learning which aims to let the computer learn to answer natural language questions with images. In this paper, we propose a new method called hierarchical dynamic memory networks (HDMN), which takes both question attention and visual attention into consideration impressed by Co-Attention method, which is the best (or among the best) algorithm for now. Additionally, we use bi-directional LSTMs, which have a better capability to remain more information from the question and image, to replace the old unit so that we can capture information from both past and future sentences to be used. Then we rebuild the hierarchical architecture for not only question attention but also visual attention. What's more, we accelerate the algorithm via a new technic called Batch Normalization which helps the network converge more quickly than other algorithms. The experimental result shows that our model improves the state of the art on the large COCO-QA dataset, compared with other methods.
Pick-N Multiple Choice-Exams: A Comparison of Scoring Algorithms

ERIC Educational Resources Information Center

Bauer, Daniel; Holzer, Matthias; Kopp, Veronika; Fischer, Martin R.

2011-01-01

To compare different scoring algorithms for Pick-N multiple correct answer multiple-choice (MC) exams regarding test reliability, student performance, total item discrimination and item difficulty. Data from six 3rd year medical students' end of term exams in internal medicine from 2005 to 2008 at Munich University were analysed (1,255 students,…
Olympics: Questions & Answers on the Major Events.

ERIC Educational Resources Information Center

Gibbon, Alan

This book presents background information on the major Olympic events with a question-answer format. Events considered include track and field, swimming, diving, boxing, weightlifting, the equestrian events, and gymnastics. Line drawings illustrate the text. (MM)
On the Optimality of Answer-Copying Indices: Theory and Practice

ERIC Educational Resources Information Center

Romero, Mauricio; Riascos, Álvaro; Jara, Diego

2015-01-01

Multiple-choice exams are frequently used as an efficient and objective method to assess learning, but they are more vulnerable to answer copying than tests based on open questions. Several statistical tests (known as indices in the literature) have been proposed to detect cheating; however, to the best of our knowledge, they all lack mathematical…
Promoting an active form of learning out-of-class via answering online "study questions" leads to higher than expected exam scores in General Biology.

PubMed

Gibson, Susan I

2015-01-01

A rising need for workers in science, technology, engineering and mathematics (STEM) fields has fueled interest in improving teaching within STEM disciplines. Numerous studies have demonstrated the benefits of active learning approaches on student learning outcomes. However, many of these studies have been conducted in experimental, rather than real-life class, settings. In addition, most of these studies have focused on in-class active learning exercises. This study tested the effects of answering questions outside of class on exam performance for General Biology students at the University of Minnesota. An online database of 1,020 multiple-choice questions covering material from the first half of the course was generated. Students in seven course sections (with an average of ∼265 students per section) were given unlimited access to the online study questions. These students made extensive use of the online questions, with students answering an average of 1,323 questions covering material from the half of the semester for which the questions were available. After students answered a set of questions, they were shown the correct answers for those questions. More specific feedback describing how to arrive at the correct answer was provided for the 73% of the questions for which the correct answers were not deemed to be self-explanatory. The extent to which access to the online study questions improved student learning outcomes was assessed by comparing the performance on exam questions of students in the seven course sections with access to the online study questions with the performance of students in course sections without access to the online study questions. Student performance was analyzed for a total of 89 different exams questions that were not included in the study questions, but that covered the same material covered by the study questions. Each of these 89 questions was used on one to five exams given to students in course sections that had access to the
Explorative search of distributed bio-data to answer complex biomedical questions

PubMed Central

2014-01-01

Background The huge amount of biomedical-molecular data increasingly produced is providing scientists with potentially valuable information. Yet, such data quantity makes difficult to find and extract those data that are most reliable and most related to the biomedical questions to be answered, which are increasingly complex and often involve many different biomedical-molecular aspects. Such questions can be addressed only by comprehensively searching and exploring different types of data, which frequently are ordered and provided by different data sources. Search Computing has been proposed for the management and integration of ranked results from heterogeneous search services. Here, we present its novel application to the explorative search of distributed biomedical-molecular data and the integration of the search results to answer complex biomedical questions. Results A set of available bioinformatics search services has been modelled and registered in the Search Computing framework, and a Bioinformatics Search Computing application (Bio-SeCo) using such services has been created and made publicly available at http://www.bioinformatics.deib.polimi.it/bio-seco/seco/. It offers an integrated environment which eases search, exploration and ranking-aware combination of heterogeneous data provided by the available registered services, and supplies global results that can support answering complex multi-topic biomedical questions. Conclusions By using Bio-SeCo, scientists can explore the very large and very heterogeneous biomedical-molecular data available. They can easily make different explorative search attempts, inspect obtained results, select the most appropriate, expand or refine them and move forward and backward in the construction of a global complex biomedical query on multiple distributed sources that could eventually find the most relevant results. Thus, it provides an extremely useful automated support for exploratory integrated bio search, which is
Reducing Our Ignorance: Finding Answers to Certain Epistemic Questions for Software Systems

NASA Technical Reports Server (NTRS)

Holloway, C. Michael; Johnson, Christopher W.

2011-01-01

In previous papers, we asserted that software system safety is primarily concerned with epistemic questions, that is, questions concerning knowledge and the degree of confidence that can be placed in that knowledge. We also enumerated a set of 21 foundational epistemic questions, discussed some of the difficulties that exist in answering these questions adequately today, and speculated briefly on possible research that may provide improved confidence in the sufficiency of answers in the future. This paper focuses on three of the foundational questions. For each of these questions, current answers are discussed and potential research is proposed to help increase the justifiable level of confidence.
Question and Answer Guide to OCLC.

ERIC Educational Resources Information Center

Yen, Sidney S. C.

The purpose of this guide is to provide basic factual information about the Ohio College Library Center (OCLC), its data base, its operation, and its functions. It is intended for libraries which have not yet participated in OCLC, but would be useful as a reference guide in all libraries. Presented in question and answer form, the guide consists…
A question-answer pair (QAP) database integrated with websites to answer complex questions submitted to the Regional Medicines Information and Pharmacovigilance Centres in Norway (RELIS): a descriptive study.

PubMed

Schjøtt, Jan; Reppe, Linda A; Roland, Pål-Didrik H; Westergren, Tone

2012-01-01

To assess a question-answer pair (QAP) database integrated with websites developed for drug information centres to answer complex questions effectively. Descriptive study with comparison of two subsequent 6-year periods (1995-2000 and 2001-2006). The Regional Medicines Information and Pharmacovigilance Centres in Norway (RELIS). A randomised sample of QAPs from the RELIS database. Answer time in days compared with Mann-Whitney U test. Number of drugs involved (one, two, three or more), complexity (judgemental and/or patient-related or not) and literature search (none, simple or advanced) compared with χ(2) tests. 842 QAPs (312 from 1995 to 2000 and 530 from 2001 to 2006) were compared. The fraction of judgemental and patient-related questions increased (66%-75% and 54%-72%, respectively, p<0.01). Number of drugs and literature search (>50% advanced) was similar in the two periods, but the fraction of answers referring to the RELIS database increased (13%-31%, p<0.01). Median answer time was reduced from 2 days to 1 (p<0.01), although the fraction of complex questions increased from the first to the second period. Furthermore, the mean number of questions per employee per year increased from 66 to 89 from the first to the second period. The authors conclude that RELIS has a potential to efficiently answer complex questions. The model is of relevance for organisation of drug information centres.
What Are the "Right" Questions and the "Right" Answers in Teaching Practice Supervision?

ERIC Educational Resources Information Center

Jyrhama, Riitta

This paper links the problem of questioning and answering in student teacher supervision with teachers' pedagogical thinking. The first section discusses whether asking the right questions or giving the right answers is more important and what is actually involved when the questions and answers are correct. The second section discusses the…
Incorporating Multiple-Choice Questions into an AACSB Assurance of Learning Process: A Course-Embedded Assessment Application to an Introductory Finance Course

ERIC Educational Resources Information Center

Santos, Michael R.; Hu, Aidong; Jordan, Douglas

2014-01-01

The authors offer a classification technique to make a quantitative skills rubric more operational, with the groupings of multiple-choice questions to match the student learning levels in knowledge, calculation, quantitative reasoning, and analysis. The authors applied this classification technique to the mid-term exams of an introductory finance…
Selective Benefits of Question Self-Generation and Answering for Remembering Expository Text

ERIC Educational Resources Information Center

Bugg, Julie M.; McDaniel, Mark A.

2012-01-01

The present study examined possible memory and metacomprehension benefits of using a combined question self-generation and answering technique, relative to rereading, as a study strategy for expository passages. In the 2 question self-generation and answering conditions (detail or conceptual questions), participants were prompted on how to…
Experiential curriculum improves medical students' ability to answer clinical questions using the internet.

PubMed

Alper, Brian S; Vinson, Daniel C

2005-09-01

Teaching about evidence-based medicine (EBM) is widespread, yet physicians still use rapid references preferentially over EBM techniques such as literature searching and appraisal of original research. The Internet now provides rapid access to preappraised evidence. We provided clinically integrated teaching of using the Internet to answer clinical questions for third-year medical students and assessed the change in their search skills. The curriculum included two 90-minute computer lab sessions with teaching of search skills related to clinical questions. Immediately before the first and after the second session, students recorded sites searched, time needed for searching, and answers found for three standardized questions. Pretest and posttest questions were matched and reversed with each block. Eighty-six students completed pretests and posttests. For two questions about conventional medical care, posttest answer quality was significantly higher, and posttest search times were significantly shorter, by 1.6 minutes for question 1 (mean pretest search time 6.3 minutes, mean posttest search time 4.7 minutes) and 1.9 minutes for question 2 (mean pretest search time 8 minutes, mean posttest search time 6.1 minutes). For a question about herbal medicine, results were similar, but there were smaller differences that did not reach statistical significance. Students used or found significantly fewer sites on the posttest than on the pretest to find answers for all three question types (absolute difference=0.3 sites for each question). CONCLUSIONS Introducing students to useful Web sites, practicing answering clinical questions, and integrating this process with clinical rotation experiences can reduce the effort that students need to find answers and improve the quality of answers they find.

Formative student-authored question bank: perceptions, question quality and association with summative performance

PubMed Central

Walsh, Jason L; Harris, Benjamin H L; Denny, Paul; Smith, Phil

2018-01-01

Purpose of the study There are few studies on the value of authoring questions as a study method, the quality of the questions produced by students and student perceptions of student-authored question banks. Here we evaluate PeerWise, a widely used and free online resource that allows students to author, answer and discuss multiple-choice questions. Study design We introduced two undergraduate medical student cohorts to PeerWise (n=603). We looked at their patterns of PeerWise usage; identified associations between student engagement and summative exam performance; and used focus groups to assess student perceptions of the value of PeerWise for learning. We undertook item analysis to assess question difficulty and quality. Results Over two academic years, the two cohorts wrote 4671 questions, answered questions 606 658 times and posted 7735 comments. Question writing frequency correlated most strongly with summative performance (Spearman’s rank: 0.24, p=<0.001). Student focus groups found that: (1) students valued curriculum specificity; and (2) students were concerned about student-authored question quality. Only two questions of the 300 ’most-answered' questions analysed had an unacceptable discriminatory value (point-biserial correlation <0.2). Conclusions Item analysis suggested acceptable question quality despite student concerns. Quantitative and qualitative methods indicated that PeerWise is a valuable study tool. PMID:28866607
Can online networks provide quality answers to questions about occupational safety and health?

PubMed

Rhebergen, Martijn D F; Lenderink, Annet F; van Dijk, Frank J H; Hulshof, Carel T J

2012-05-01

To assess whether experts can provide high-quality answers to occupational safety and health (OSH) questions in online Question & Answer (Q&A) networks. The authors evaluated the quality of answers provided by qualified experts in two Dutch online networks: ArboAntwoord and the Helpdesk of the Netherlands Center for Occupational Diseases. A random sample of 594 answers was independently evaluated by two raters using nine answer quality criteria. An additional criterion, the agreement of answers with the best available evidence, was explored by peer review of a sample of 42 answers. Reviewers performed an evidence search in Medline. The median answer quality score of ArboAntwoord (N=295) and the Netherlands Center for Occupational Diseases Helpdesk (N=299) was 8 of 9 (IQR 2). The inter-rater reliability of the first nine quality criteria was high (κ 0.82-0.90, p<0.05). A question answered by two or more experts had a greater probability of a high-quality score than questions answered by one expert (OR 4.9, 95% CI 2.7 to 9.0). Answers most often scored insufficient on the use of evidence to underpin the answer (36% and 38% for the networks, respectively) and on conciseness (35% and 31%, respectively). Peer review demonstrated that 43%-72% of the answers in both online networks were in complete agreement with the best available evidence. OSH experts are able to provide quality answers in online OSH Q&A networks. Our answer quality appraisal instrument was feasible and provided information on how to improve answer quality.
Protein Electrochemistry: Questions and Answers.

PubMed

Fourmond, V; Léger, C

This chapter presents the fundamentals of electrochemistry in the context of protein electrochemistry. We discuss redox proteins and enzymes that are not photoactive. Of course, the principles described herein also apply to photobioelectrochemistry, as discussed in later chapters of this book. Depending on which experiment is considered, electron transfer between proteins and electrodes can be either direct or mediated, and achieved in a variety of configurations: with the protein and/or the mediator free to diffuse in solution, immobilized in a thick, hydrated film, or adsorbed as a sub-monolayer on the electrode. The experiments can be performed with the goal to study the protein or to use it. Here emphasis is on mechanistic studies, which are easier in the configuration where the protein is adsorbed and electron transfer is direct, but we also explain the interpretation of signals obtained when diffusion processes affect the response.This chapter is organized as a series of responses to questions. Questions 1-5 are related to the basics of electrochemistry: what does "potential" or "current" mean, what does an electrochemical set-up look like? Questions 6-9 are related to the distinction between adsorbed and diffusive redox species. The answers to questions 10-13 explain the interpretation of slow and fast scan voltammetry with redox proteins. Questions 14-19 deal with catalytic electrochemistry, when the protein studied is actually an enzyme. Questions 20, 21 and 22 are general.
Answerers' Motivations and Strategies for Providing Information and Social Support in Social Q&A an Investigation of Health Question Answering

ERIC Educational Resources Information Center

Oh, Sanghee

2010-01-01

Social Q&A allows people to ask and answer questions for each other and to solve problems in everyday life collaboratively. The purpose of the current study is to understand the motivations and strategies of answerers in social Q&A. Thus, three research questions were investigated: (1) Why do answerers participate and contribute in social Q&A? (2)…
A medical consultation service on Facebook: descriptive analysis of questions answered.

PubMed

Helve, Otto

2014-09-04

Social media is used increasingly by the general public to access health information. However, a lack of models for health information distribution limits the presence of publicly funded services on social media sites. The goal of the study was to present a model for delivering child health information to parents through a social media site. A Facebook site was launched for 11 months based on a question-and-answer service produced by a pediatrician and open to Facebook users over 18 years old. If the answer did not include a further referral to a health care service provider, the question was considered comprehensively answered. The site was funded by a pharmaceutical company, and it included an advertisement of a pharmaceutical product for children's fever and pain. During the study, 768 questions were submitted: an average of 69.8 (SD 31.7) per month. There were 245,533 independent Facebook users on the site, with an average of 727.0 (SD 2280.6) per day. Infections were the most common theme in questions (355/768, 46.2%). Questions were more likely to be comprehensively answered if they were related to infections (279/355, 78.6%) than questions related to non-infectious symptoms (265/423, 64.2%, P=.003). On this site aimed at parents of small children, personalized answers were an effective way of delivering information. The service is likely to have reduced the need for further contacts with a health care service provider in more than half of the cases. The site could serve as a model for publicly funded health information distribution.
A Machine Learning-based Method for Question Type Classification in Biomedical Question Answering.

PubMed

Sarrouti, Mourad; Ouatik El Alaoui, Said

2017-05-18

Biomedical question type classification is one of the important components of an automatic biomedical question answering system. The performance of the latter depends directly on the performance of its biomedical question type classification system, which consists of assigning a category to each question in order to determine the appropriate answer extraction algorithm. This study aims to automatically classify biomedical questions into one of the four categories: (1) yes/no, (2) factoid, (3) list, and (4) summary. In this paper, we propose a biomedical question type classification method based on machine learning approaches to automatically assign a category to a biomedical question. First, we extract features from biomedical questions using the proposed handcrafted lexico-syntactic patterns. Then, we feed these features for machine-learning algorithms. Finally, the class label is predicted using the trained classifiers. Experimental evaluations performed on large standard annotated datasets of biomedical questions, provided by the BioASQ challenge, demonstrated that our method exhibits significant improved performance when compared to four baseline systems. The proposed method achieves a roughly 10-point increase over the best baseline in terms of accuracy. Moreover, the obtained results show that using handcrafted lexico-syntactic patterns as features' provider of support vector machine (SVM) lead to the highest accuracy of 89.40 %. The proposed method can automatically classify BioASQ questions into one of the four categories: yes/no, factoid, list, and summary. Furthermore, the results demonstrated that our method produced the best classification performance compared to four baseline systems.
Survey Questions Answered Only by Psychosocial Experts.

ERIC Educational Resources Information Center

American Journal on Mental Retardation, 2000

2000-01-01

Twelve tables provide a breakdown of answers to a survey responded to by 48 experts in the psychosocial treatment of psychiatric and behavioral problems in people with mental retardation. Questions address treatment of self-injurious or aggressive behavior, specific psychiatric disorders, specific target symptoms, use of applied behavior analysis…
Analyzing Electronic Question/Answer Services: Framework and Evaluations of Selected Services.

ERIC Educational Resources Information Center

White, Marilyn Domas, Ed.

This report develops an analytical framework based on systems analysis for evaluating electronic question/answer or AskA services operated by a wide range of types of organizations, including libraries. Version 1.0 of this framework was applied in June 1999 to a selective sample of 11 electronic question/answer services, which cover a range of…
Examen en Vue du Diplome Douzieme Annee. Langue et Litterature 30. Partie B: Lecture (Choix Multiples). Livret de Questions (Examination for the Twelfth Grade Diploma, Language and Literature 30. Part B: Reading--Multiple Choice. Questions Booklet).

ERIC Educational Resources Information Center

Alberta Dept. of Education, Edmonton.

As part of an examination required by the Alberta (Canada) Department of Education in order for 12th grade students to receive a diploma in French, this booklet contains the 80 multiple choice questions portion of Part B, the language and literature component of the January 1987 tests. Representing the genres of poetry, short story, the novel, and…
Examen en Vue du Diplome Douzieme Annee. Langue et Litterature 30. Partie B: Lecture (Choix Multiples). Livret de Questions (Examination for the Twelfth Grade Diploma, Language and Literature 30. Part B: Reading--Multiple Choice. Questions Booklet.)

ERIC Educational Resources Information Center

Alberta Dept. of Education, Edmonton.

As part of an examination required by the Alberta (Canada) Department of Education in order for 12th grade students to receive a diploma in French, this booklet contains the 80 multiple choice questions portion of Part B, the language and literature component of the January 1988 tests. Representing the genres of poetry, short story, novel, and…
Survey Questions Answered Only by Medication Experts.

ERIC Educational Resources Information Center

American Journal on Mental Retardation, 2000

2000-01-01

Fifty-eight tables provide a breakdown of answers to a survey responded to by 45 experts in the medication treatment of psychiatric and behavioral problems in people with mental retardation. Questions address treatment of specific disorders, ratings of various medications for specific disorders or symptoms, and preferences in mood stabilizers,…
ADAPT.DCU at TREC LiveQA: A Sentence Retrieval based Approach to Live Question Answering

DTIC Science & Technology

2015-11-20

list of conceptually similar questions from an index of previously asked on “ Yahoo ! An- swers”. We then extract the best matching sentences from the...answer Japanese why questions. The work in Surdeanu et al. (2011) address the problem of ranking answers to non-factoid how questions from Yahoo ...answering real questions from Yahoo ! Answers in real time. each participant needed to submit a web service application that on receiving a question responds
Mergers and acquisitions. Frequently asked questions and answers.

PubMed

Lin, S M; Smeltzer, C H; Thomas, C

2000-03-01

This article is structured in a question/answer format based on interviews with Dr. Carolyn Hope Smeltzer and Salima Manji Lin of PricewaterhouseCoopers, Chicago, and Chuck Thomas of Hinshaw & Culbertson, Rockford. The questions come from CEO's, healthcare executives, and nurse executives at hospitals that are contemplating mergers or that have both succeeded and failed to merge their institutions. The experts share their knowledge.
Information Presentation in Decision and Risk Analysis: Answered, Partly Answered, and Unanswered Questions.

PubMed

Keller, L Robin; Wang, Yitong

2017-06-01

For the last 30 years, researchers in risk analysis, decision analysis, and economics have consistently proven that decisionmakers employ different processes for evaluating and combining anticipated and actual losses, gains, delays, and surprises. Although rational models generally prescribe a consistent response, people's heuristic processes will sometimes lead them to be inconsistent in the way they respond to information presented in theoretically equivalent ways. We point out several promising future research directions by listing and detailing a series of answered, partly answered, and unanswered questions. © 2016 Society for Risk Analysis.
A Medical Consultation Service on Facebook: Descriptive Analysis of Questions Answered

PubMed Central

2014-01-01

Background Social media is used increasingly by the general public to access health information. However, a lack of models for health information distribution limits the presence of publicly funded services on social media sites. Objective The goal of the study was to present a model for delivering child health information to parents through a social media site. Methods A Facebook site was launched for 11 months based on a question-and-answer service produced by a pediatrician and open to Facebook users over 18 years old. If the answer did not include a further referral to a health care service provider, the question was considered comprehensively answered. The site was funded by a pharmaceutical company, and it included an advertisement of a pharmaceutical product for children’s fever and pain. Results During the study, 768 questions were submitted: an average of 69.8 (SD 31.7) per month. There were 245,533 independent Facebook users on the site, with an average of 727.0 (SD 2280.6) per day. Infections were the most common theme in questions (355/768, 46.2%). Questions were more likely to be comprehensively answered if they were related to infections (279/355, 78.6%) than questions related to non-infectious symptoms (265/423, 64.2%, P=.003). Conclusions On this site aimed at parents of small children, personalized answers were an effective way of delivering information. The service is likely to have reduced the need for further contacts with a health care service provider in more than half of the cases. The site could serve as a model for publicly funded health information distribution. PMID:25189182
Logical Aspects of Question-Answering by Computer.

ERIC Educational Resources Information Center

Kuhns, J. L.

The problem of computerized question-answering is discussed in this paper from the point of view of certain technical, although elementary, notions of logic. Although the work reported herein has general application to the design of information systems, it is specifically motivated by the RAND Relational Data File. This system, for which a…
Ian Hinchliffe Answers Your Higgs Boson Questions

ScienceCinema

Hinchliffe, Ian

2017-12-09

contingent with the ATLAS experiment at CERN, answers many of your questions about the Higgs boson. Ian invited viewers to send in questions about the Higgs via email, Twitter, Facebook, or YouTube in an "Ask a Scientist" video posted July 3: http://youtu.be/xhuA3wCg06s CERN's July 4 announcement that the ATLAS and CMS experiments at the Large Hadron Collider have discovered a particle "consistent with the Higgs boson" has raised questions about what scientists have found and what still remains to be found -- and what it all means. If you have suggestions for future "Ask a Scientist" videos, post them below or send ideas to askascientist@lbl.gov
Responding to Children's Answers: Questions Embedded in the Social Context of Early Childhood Education

ERIC Educational Resources Information Center

Bateman, Amanda

2013-01-01

This article presents analysis of question-answer sequences during problem inquiry between a teacher and two children in an early childhood crèche in New Zealand. Conversation analysis is used to reveal which questions the teacher asks, how children answer the questions, and the teacher's responses to the child's answers. Although adults'…
Analysis of the Difficulty and Discrimination Indices of Multiple-Choice Questions According to Cognitive Levels in an Open and Distance Learning Context

ERIC Educational Resources Information Center

Koçdar, Serpil; Karadag, Nejdet; Sahin, Murat Dogan

2016-01-01

This is a descriptive study which intends to determine whether the difficulty and discrimination indices of the multiple-choice questions show differences according to cognitive levels of the Bloom's Taxonomy, which are used in the exams of the courses in a business administration bachelor's degree program offered through open and distance…
Drug Facts Chat Day: NIH Experts Answer Students' Drug Questions

MedlinePlus

... Home Current Issue Past Issues Drug Facts Chat Day: NIH Experts Answer Students' Drug Questions Past Issues / ... Drug Abuse during their first Drug Facts Chat Day. Photo courtesy of NIDA The questions poured in… ...

Metacognitive effects of initial question difficulty on subsequent memory performance.

PubMed

Pansky, Ainat; Goldsmith, Morris

2014-10-01

In two experiments, we examined whether relative retrieval fluency (the relative ease or difficulty of answering questions from memory) would be translated, via metacognitive monitoring and control processes, into an overt effect on the controlled behavior-that is, the decision whether to answer a question or abstain. Before answering a target set of multiple-choice general-knowledge questions (intermediate-difficulty questions in Exp. 1, deceptive questions in Exp. 2), the participants first answered either a set of difficult questions or a set of easy questions. For each question, they provided a forced-report answer, followed by a subjective assessment of the likelihood that their answer was correct (confidence) and by a free-report control decision-whether or not to report the answer for a potential monetary bonus (or penalty). The participants' ability to answer the target questions (forced-report proportion correct) was unaffected by the initial question difficulty. However, a predicted metacognitive contrast effect was observed: When the target questions were preceded by a set of difficult rather than easy questions, the participants were more confident in their answers to the target questions, and hence were more likely to report them, thus increasing the quantity of freely reported correct information. The option of free report was more beneficial after initial question difficulty than after initial question ease, in terms of both the gain in accuracy (Exp. 2) and a smaller cost in quantity (Exps. 1 and 2). These results demonstrate that changes in subjective experience can influence metacognitive monitoring and control, thereby affecting free-report memory performance independently of forced-report performance.
Formative student-authored question bank: perceptions, question quality and association with summative performance.

PubMed

Walsh, Jason L; Harris, Benjamin H L; Denny, Paul; Smith, Phil

2018-02-01

There are few studies on the value of authoring questions as a study method, the quality of the questions produced by students and student perceptions of student-authored question banks. Here we evaluate PeerWise, a widely used and free online resource that allows students to author, answer and discuss multiple-choice questions. We introduced two undergraduate medical student cohorts to PeerWise (n=603). We looked at their patterns of PeerWise usage; identified associations between student engagement and summative exam performance; and used focus groups to assess student perceptions of the value of PeerWise for learning. We undertook item analysis to assess question difficulty and quality. Over two academic years, the two cohorts wrote 4671 questions, answered questions 606 658 times and posted 7735 comments. Question writing frequency correlated most strongly with summative performance (Spearman's rank: 0.24, p=<0.001). Student focus groups found that: (1) students valued curriculum specificity; and (2) students were concerned about student-authored question quality. Only two questions of the 300 'most-answered' questions analysed had an unacceptable discriminatory value (point-biserial correlation <0.2). Item analysis suggested acceptable question quality despite student concerns. Quantitative and qualitative methods indicated that PeerWise is a valuable study tool. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2018. All rights reserved. No commercial use is permitted unless otherwise expressly granted.
Technical flaws in multiple-choice questions in the access exam to medical specialties ("examen MIR") in Spain (2009-2013).

PubMed

Rodríguez-Díez, María Cristina; Alegre, Manuel; Díez, Nieves; Arbea, Leire; Ferrer, Marta

2016-02-03

The main factor that determines the selection of a medical specialty in Spain after obtaining a medical degree is the MIR ("médico interno residente", internal medical resident) exam. This exam consists of 235 multiple-choice questions with five options, some of which include images provided in a separate booklet. The aim of this study was to analyze the technical quality of the multiple-choice questions included in the MIR exam over the last five years. All the questions included in the exams from 2009 to 2013 were analyzed. We studied the proportion of questions including clinical vignettes, the number of items related to an image and the presence of technical flaws in the questions. For the analysis of technical flaws, we adapted the National Board of Medical Examiners (NBME) guidelines. We looked for 18 different issues included in the manual, grouped into two categories: issues related to testwiseness and issues related to irrelevant difficulties. The final number of questions analyzed was 1,143. The percentage of items based on clinical vignettes increased from 50% in 2009 to 56-58% in the following years (2010-2013). The percentage of items based on an image increased progressively from 10% in 2009 to 15% in 2012 and 2013. The percentage of items with at least one technical flaw varied between 68 and 72%. We observed a decrease in the percentage of items with flaws related to testwiseness, from 30% in 2009 to 20% in 2012 and 2013. While most of these issues decreased dramatically or even disappeared (such as the imbalance in the correct option numbers), the presence of non-plausible options remained frequent. With regard to technical flaws related to irrelevant difficulties, no improvement was observed; this is especially true with respect to negative stem questions and "hinged" questions. The formal quality of the MIR exam items has improved over the last five years with regard to testwiseness. A more detailed revision of the items submitted, checking
A Comparison of the Performance on Three Multiple Choice Question Papers in Obstetrics and Gynecology Over a Period of Three Years Administered at Five London Medical Schools

ERIC Educational Resources Information Center

Stevens, J. M.; And Others

1977-01-01

Five of the medical schools in the University of London collaborated in administering one multiple choice question paper in obstetrics and gynecology, and results showed differences in performance between the five schools on questions and alternatives within questions. The rank order of the schools may result from differences in teaching methods.…
Using mixed methods to identify and answer clinically relevant research questions.

PubMed

Shneerson, Catherine L; Gale, Nicola K

2015-06-01

The need for mixed methods research in answering health care questions is becoming increasingly recognized because of the complexity of factors that affect health outcomes. In this article, we argue for the value of using a qualitatively driven mixed method approach for identifying and answering clinically relevant research questions. This argument is illustrated by findings from a study on the self-management practices of cancer survivors and the exploration of one particular clinically relevant finding about higher uptake of self-management in cancer survivors who had received chemotherapy treatment compared with those who have not. A cross-sectional study generated findings that formed the basis for the qualitative study, by informing the purposive sampling strategy and generating new qualitative research questions. Using a quantitative research component to supplement a qualitative study can enhance the generalizability and clinical relevance of the findings and produce detailed, contextualized, and rich answers to research questions that would be unachievable through quantitative or qualitative methods alone. © The Author(s) 2015.
Do Online Information Retrieval Systems Help Experienced Clinicians Answer Clinical Questions?

PubMed Central

Westbrook, Johanna I.; Coiera, Enrico W.; Gosling, A. Sophie

2005-01-01

Objective: To assess the impact of clinicians' use of an online information retrieval system on their performance in answering clinical questions. Design: Pre-/post-intervention experimental design. Measurements: In a computer laboratory, 75 clinicians (26 hospital-based doctors, 18 family practitioners, and 31 clinical nurse consultants) provided 600 answers to eight clinical scenarios before and after the use of an online information retrieval system. We examined the proportion of correct answers pre- and post-intervention, direction of change in answers, and differences between professional groups. Results: System use resulted in a 21% improvement in clinicians' answers, from 29% (95% confidence interval [CI] 25.4–32.6) correct pre- to 50% (95% CI 46.0–54.0) post-system use. In 33% (95% CI 29.1–36.9) answers were changed from incorrect to correct. In 21% (95% CI 17.1–23.9) correct pre-test answers were supported by evidence found using the system, and in 7% (95% CI 4.9–9.1) correct pre-test answers were changed incorrectly. For 40% (35.4–43.6) of scenarios, incorrect pre-test answers were not rectified following system use. Despite significant differences in professional groups' pre-test scores [family practitioners: 41% (95% CI 33.0–49.0), hospital doctors: 35% (95% CI 28.5–41.2), and clinical nurse consultants: 17% (95% CI 12.3–21.7; χ2 = 29.0, df = 2, p < 0.01)], there was no difference in post-test scores. (χ2 = 2.6, df = 2, p = 0.73). Conclusions: The use of an online information retrieval system was associated with a significant improvement in the quality of answers provided by clinicians to typical clinical problems. In a small proportion of cases, use of the system produced errors. While there was variation in the performance of clinical groups when answering questions unaided, performance did not differ significantly following system use. Online information retrieval systems can be an effective tool in improving the accuracy of
Objective questions in orthopaedic nursing objective questions in orthopaedic nursing Cole P Churchill Lovingstone 212pp £8.50 0-443-02473-1.

PubMed

1988-01-09

The presentation of Elizabeth Evans's book is good; typography and her style make it very readable; and it is well illustrated throughout. The first of two sections deals with multiple choice (MCQs) and the true/ false type questions. The second contains nursing care studies with relevant MCQs for the reader to answer.
Ian Hinchliffe Answers Your Higgs Boson Questions

DOE Office of Scientific and Technical Information (OSTI.GOV)

Hinchliffe, Ian

contingent with the ATLAS experiment at CERN, answers many of your questions about the Higgs boson. Ian invited viewers to send in questions about the Higgs via email, Twitter, Facebook, or YouTube in an "Ask a Scientist" video posted July 3: http://youtu.be/xhuA3wCg06s CERN's July 4 announcement that the ATLAS and CMS experiments at the Large Hadron Collider have discovered a particle "consistent with the Higgs boson" has raised questions about what scientists have found and what still remains to be found -- and what it all means. If you have suggestions for future "Ask a Scientist" videos, post them belowmore » or send ideas to askascientist@lbl.gov« less
Net improvement of correct answers to therapy questions after pubmed searches: pre/post comparison.

PubMed

McKibbon, Kathleen Ann; Lokker, Cynthia; Keepanasseril, Arun; Wilczynski, Nancy L; Haynes, R Brian

2013-11-08

Clinicians search PubMed for answers to clinical questions although it is time consuming and not always successful. To determine if PubMed used with its Clinical Queries feature to filter results based on study quality would improve search success (more correct answers to clinical questions related to therapy). We invited 528 primary care physicians to participate, 143 (27.1%) consented, and 111 (21.0% of the total and 77.6% of those who consented) completed the study. Participants answered 14 yes/no therapy questions and were given 4 of these (2 originally answered correctly and 2 originally answered incorrectly) to search using either the PubMed main screen or PubMed Clinical Queries narrow therapy filter via a purpose-built system with identical search screens. Participants also picked 3 of the first 20 retrieved citations that best addressed each question. They were then asked to re-answer the original 14 questions. We found no statistically significant differences in the rates of correct or incorrect answers using the PubMed main screen or PubMed Clinical Queries. The rate of correct answers increased from 50.0% to 61.4% (95% CI 55.0%-67.8%) for the PubMed main screen searches and from 50.0% to 59.1% (95% CI 52.6%-65.6%) for Clinical Queries searches. These net absolute increases of 11.4% and 9.1%, respectively, included previously correct answers changing to incorrect at a rate of 9.5% (95% CI 5.6%-13.4%) for PubMed main screen searches and 9.1% (95% CI 5.3%-12.9%) for Clinical Queries searches, combined with increases in the rate of being correct of 20.5% (95% CI 15.2%-25.8%) for PubMed main screen searches and 17.7% (95% CI 12.7%-22.7%) for Clinical Queries searches. PubMed can assist clinicians answering clinical questions with an approximately 10% absolute rate of improvement in correct answers. This small increase includes more correct answers partially offset by a decrease in previously correct answers.
Violations of Information Structure: An Electrophysiological Study of Answers to Wh-Questions

ERIC Educational Resources Information Center

Cowles, H. W.; Kluender, Robert; Kutas, Marta; Polinsky, Maria

2007-01-01

This study investigates brain responses to violations of information structure in wh-question-answer pairs, with particular emphasis on violations of focus assignment in it-clefts (It was the queen that silenced the banker). Two types of ERP responses in answers to wh-questions were found. First, all words in the focus-marking (cleft) position…
Biology Question Generation from a Semantic Network

NASA Astrophysics Data System (ADS)

Zhang, Lishan

Science instructors need questions for use in exams, homework assignments, class discussions, reviews, and other instructional activities. Textbooks never have enough questions, so instructors must find them from other sources or generate their own questions. In order to supply instructors with biology questions, a semantic network approach was developed for generating open response biology questions. The generated questions were compared to professional authorized questions. To boost students' learning experience, adaptive selection was built on the generated questions. Bayesian Knowledge Tracing was used as embedded assessment of the student's current competence so that a suitable question could be selected based on the student's previous performance. A between-subjects experiment with 42 participants was performed, where half of the participants studied with adaptive selected questions and the rest studied with mal-adaptive order of questions. Both groups significantly improved their test scores, and the participants in adaptive group registered larger learning gains than participants in the control group. To explore the possibility of generating rich instructional feedback for machine-generated questions, a question-paragraph mapping task was identified. Given a set of questions and a list of paragraphs for a textbook, the goal of the task was to map the related paragraphs to each question. An algorithm was developed whose performance was comparable to human annotators. A multiple-choice question with high quality distractors (incorrect answers) can be pedagogically valuable as well as being much easier to grade than open-response questions. Thus, an algorithm was developed to generate good distractors for multiple-choice questions. The machine-generated multiple-choice questions were compared to human-generated questions in terms of three measures: question difficulty, question discrimination and distractor usefulness. By recruiting 200 participants from
How Do You Answer the Life on Mars Question? Use Multiple Small Landers Like Beagle 2

NASA Technical Reports Server (NTRS)

Gibson, Everett K.; Pillinger, C. T.; Wright, I. P.; Hurst, S. J.; Richter, L.; Sims, M. R.

2012-01-01

To address one of the most important questions in planetary science Is there life on Mars? The scientific community must turn to less costly means of exploring the surface of the Red Planet. The United Kingdom's Beagle 2 Mars lander concept was a small meter-size lander with a scientific payload constituting a large proportion of the flown mass designed to supply answers to the question about life on Mars. A possible reason why Beagle 2 did not send any data was that it was a one-off attempt to land. As Steve Squyres said at the time: "It's difficult to land on Mars - if you want to succeed you have to send two of everything".
Incremental generation of answers during the comprehension of questions with quantifiers.

PubMed

Bott, Oliver; Augurzky, Petra; Sternefeld, Wolfgang; Ulrich, Rolf

2017-09-01

The paper presents a study on the online interpretation of quantified questions involving complex domain restriction, for instance, are all triangles blue that are in the circle. Two probe reaction time (RT) task experiments were conducted to study the incremental nature of answer generation while manipulating visual contexts and response hand overlap between tasks. We manipulated the contexts in such a way that the incremental answer to the question changed from 'yes' to 'no' or remained the same before and after encountering the extraposed relative clause. The findings of both experiments provide evidence for incremental answer preparation but only if the context did not involve the risk of answer revision. Our results show that preliminary output from incremental semantic interpretation results in response priming that facilitates congruent responses in the probe RT task. Copyright © 2017 Elsevier B.V. All rights reserved.
Reserve Component Personnel Issues: Questions and Answers

DTIC Science & Technology

2013-07-12

CRS Report for Congress Prepared for Members and Committees of Congress Reserve Component Personnel Issues: Questions and Answers...Service 7-5700 www.crs.gov RL30802 Report Documentation Page Form ApprovedOMB No. 0704-0188 Public reporting burden for the collection of information...Operations and Reports , 1215 Jefferson Davis Highway, Suite 1204, Arlington VA 22202-4302. Respondents should be aware that notwithstanding any other provision
Recommendations for the pharmacological treatment of COPD: questions and answers.

PubMed

Fernandes, Frederico Leon Arrabal; Cukier, Alberto; Camelier, Aquiles Assunção; Fritscher, Carlos Cezar; Costa, Cláudia Henrique da; Pereira, Eanes Delgado Barros; Godoy, Irma; Cançado, José Eduardo Delfini; Romaldini, José Gustavo; Chatkin, Jose Miguel; Jardim, José Roberto; Rabahi, Marcelo Fouad; Nucci, Maria Cecília Nieves Maiorano de; Sales, Maria da Penha Uchoa; Castellano, Maria Vera Cruz de Oliveira; Aidé, Miguel Abidon; Teixeira, Paulo José Zimermann; Maciel, Renato; Corrêa, Ricardo de Amorim; Stirbulov, Roberto; Athanazio, Rodrigo Abensur; Russo, Rodrigo; Minamoto, Suzana Tanni; Lundgren, Fernando Luiz Cavalcanti

2017-01-01

The treatment of COPD has become increasingly effective. Measures that range from behavioral changes, reduction in exposure to risk factors, education about the disease and its course, rehabilitation, oxygen therapy, management of comorbidities, and surgical and pharmacological treatments to end-of-life care allow health professionals to provide a personalized and effective therapy. The pharmacological treatment of COPD is one of the cornerstones of COPD management, and there have been many advances in this area in recent years. Given the greater availability of drugs and therapeutic combinations, it has become increasingly challenging to know the indications for, limitations of, and potential risks and benefits of each treatment modality. In order to critically evaluate recent evidence and systematize the major questions regarding the pharmacological treatment of COPD, 24 specialists from all over Brazil gathered to develop the present recommendations. A visual guide was developed for the classification and treatment of COPD, both of which were adapted to fit the situation in Brazil. Ten questions were selected on the basis of their relevance in clinical practice. They address the classification, definitions, treatment, and evidence available for each drug or drug combination. Each question was answered by two specialists, and then the answers were consolidated in two phases: review and consensus by all participants. The questions answered are practical questions and help select from among the many options the best treatment for each patient and his/her peculiarities.
Questions and Answers About SNAP Alternatives in Each Sector

EPA Pesticide Factsheets

The following list of questions and answers provides an overview of the regulations governing the use of substitutes that are reviewed under the Significant New Alternatives Policy (SNAP) program in various industrial sectors.
Concept Learning versus Problem Solving: Evaluating a Threat to the Validity of a Particulate Gas Law Question

ERIC Educational Resources Information Center

Sanger, Michael J.; Vaughn, C. Kevin; Binkley, David A.

2013-01-01

Three different samples of students were asked to answer five multiple-choice questions concerning the properties of a sample of helium gas (particle speed, state of matter, sample volume, sample pressure, and particle distribution), including a particulate question first used by Nurrenbern and Pickering (particle distribution). In the first…
Two Preferences in Question-Answer Sequences in Language Classroom Context

ERIC Educational Resources Information Center

Hosoda, Yuri; Aline, David

2013-01-01

Discussing two preferences associated with question-answer sequences, this study examines student responses to teacher questions in primary school English-as-a-foreign-language classes. The paper starts out with a reconsideration of institutional context, with a focus on classroom context from a conversation analysis perspective. We then introduce…
Design of a Low-Cost Adaptive Question Answering System for Closed Domain Factoid Queries

ERIC Educational Resources Information Center

Toh, Huey Ling

2010-01-01

Closed domain question answering (QA) systems achieve precision and recall at the cost of complex language processing techniques to parse the answer corpus. We propose a "query-based" model for indexing answers in a closed domain factoid QA system. Further, we use a phrase term inference method for improving the ranking order of related questions.…
75 FR 54347 - Draft Guidance for Industry: Bar Code Label Requirements-Questions and Answers (Question 12...

Federal Register 2010, 2011, 2012, 2013, 2014

2010-09-07

...] Draft Guidance for Industry: Bar Code Label Requirements-- Questions and Answers (Question 12 Update... Administration (FDA) is announcing the availability of a draft document entitled ``Guidance for Industry: Bar... guidance provides you, manufacturers of a licensed vaccine, with advice concerning compliance with the bar...

To Change or Not to Change: Investigating the Value of MCQ Answer Changing for Gulf Arab Students

ERIC Educational Resources Information Center

Al-Hamly, Mashael; Coombe, Christine

2005-01-01

This study investigates whether the practice of answer changing on multiple-choice questions (MCQs) is beneficial to Gulf Arab students' overall test performance. The proficiency exam used in this study is the Michigan English Language Institute College English Test - Grammar, Cloze, Vocabulary, Reading (MELICET-GCVR), which was developed using…
The detection of cheating in multiple choice examinations

NASA Astrophysics Data System (ADS)

Richmond, Peter; Roehner, Bertrand M.

2015-10-01

Cheating in examinations is acknowledged by an increasing number of organizations to be widespread. We examine two different approaches to assess their effectiveness at detecting anomalous results, suggestive of collusion, using data taken from a number of multiple-choice examinations organized by the UK Radio Communication Foundation. Analysis of student pair overlaps of correct answers is shown to give results consistent with more orthodox statistical correlations for which confidence limits as opposed to the less familiar "Bonferroni method" can be used. A simulation approach is also developed which confirms the interpretation of the empirical approach. Then the variables Xi =(1 -Ui) Yi +Ui Z are a system of symmetric dependent binary variables (0 , 1 ; p) whose correlation matrix is ρij = r. The proof is easy and given in the paper. Let us add two remarks. • We used the expression "symmetric variables" to reflect the fact that all Xi play the same role. The expression "exchangeable variables" is often used with the same meaning. • The correlation matrix has only positive elements. This is of course imposed by the symmetry condition. ρ12 < 0 and ρ23 < 0 would imply ρ13 > 0, thus violating the symmetry requirement. In the following subsections we will be concerned with the question of uniqueness of the set of Xi generated above. Needless to say, it is useful to know whether the proposition gives the answer or only one among many. More precisely, the problem can be stated as follows.
Nuclear Power and the Environment--Questions and Answers.

ERIC Educational Resources Information Center

Campana, Robert J.; Langer, Sidney

This booklet has been developed to help the layman understand and evaluate the various efforts being undertaken to utilize nuclear power for the benefit of mankind. The question and answer format is utilized. Among the topics discussed are: Our Needs for Electricity; Sources of Radiation; Radiation from Nuclear Power Plants; Biological Effects of…
The influence of question design on the response to self-assessment in www.elearnSCI.org: a submodule pilot study.

PubMed

Liu, N; Li, X-W; Zhou, M-W; Biering-Sørensen, F

2015-08-01

This is an interventional training session. The objective of this study was to investigate the difference in response to self-assessment questions in the original and an adjusted version for a submodule of www.elearnSCI.org for student nurses. The study was conducted in a teaching hospital affiliated to Peking University, China. In all, 28 student nurses divided into two groups (groups A and B; 14 in each) received a print-out of a Chinese translation of the slides from the 'Maintaining skin integrity following spinal cord injury' submodule in www.elearnSCI.org for self-study. Both groups were then tested using the 10 self-assessment multiple-choice questions (MCQs) related to the same submodule. Group A used the original questions, whereas group B received an adjusted questionnaire. The responses to four conventional single-answer MCQs were nearly all correct in both groups. However, in three questions, group A, with the option 'All of the above', had a higher number of correct answers than group B, with multiple-answer MCQs. In addition, in another three questions, group A, using the original multiple-answer MCQs, had fewer correct answers than group B, where it was only necessary to tick a single incorrect answer. Variations in design influence the response to questions. The use of conventional single-answer MCQs should be reconsidered, as they only examine the recall of isolated knowledge facts. The 'All of the above' option should be avoided because it would increase the number of correct answers arrived at by guessing. When using multiple-answer MCQs, it is recommended that the questions asked should be in accordance with the content within the www.elearnSCI.org.
Prevalence of answers to orthopaedic in-training examination questions in 3 commonly used orthopedic review sources.

PubMed

Krueger, Chad A; Shakir, Irshad; Fuller, Brian C

2012-09-01

One of the greatest predictors for resident success on the Orthopaedic In-Training Examination (OITE) is reviewing previous OITE questions. However, no studies have examined which review sources contain the most answers to previously asked OITE questions. The goal of this study was to determine which review source contains the most answers to previously asked OITE questions. Each question from the 2006 to 2010 OITEs was examined. The questions were placed into 1 of 13 categories based on their topic. The publication date of the recommended readings associated with each question was recorded. The answer to each question was then searched for in 3 commonly used review sources: Miller's Review of Orthopaedics, 5th edition (MRO), American Academy of Orthopaedic Surgeons Comprehensive Orthopaedic Review (COR), and www.orthobullets.com (OB). Searchable electronic versions of each textbook were used, and each question had a 12-minute time limit. Of 1358 questions, 665 (49%) were found in all 3 sources. Significantly more answers were found on OB (99.4%) compared with MRO (60%) and COR (62%) (P<.0001). Significantly more answers to questions in each question category were found on OB compared with MRO or COR (P<.0001). More than 50% of all recommended readings for OITE questions were published within 5 years of the OITE. Residents using OB to review for the OITE will be exposed to significantly more answers of previously asked OITE questions than residents using MRO or COR (P<.0001). Copyright 2012, SLACK Incorporated.
Working with Second Language Learners: Answers to Teachers' Top Ten Questions.

ERIC Educational Resources Information Center

Cary, Stephen

This book aims to provide practical, research-informed answers to the questions most frequently asked by teachers of second language learners. Every question targets one of the key instructional issues teachers must address to ensure success for their second language students. Included among the questions are: How do I assess a student's English?…
Epistemic Questions and Answers for Software System Safety

NASA Technical Reports Server (NTRS)

Holloway, C. M.; Johnson, Chris W.

2010-01-01

System safety is primarily concerned with epistemic questions, that is, questions concerning knowledge and the degree of confidence that can be placed in that knowledge. For systems with which human experience is long, such as roads, bridges, and mechanical devices, knowledge about what is required to make the systems safe is deep and detailed. High confidence can be placed in the validity of that knowledge. For other systems, however, with which human experience is comparatively short, such as those that rely in part or in whole on software, knowledge about what is required to ensure safety tends to be shallow and general. The confidence that can be placed in the validity of that knowledge is consequently low. In a previous paper, we enumerated a collection of foundational epistemic questions concerning software system safety. In this paper, we review and refine the questions, discuss some difficulties that attend to answering the questions today, and speculate on possible research to improve the situation.
Adding question answering to an e-tutor for programming languages

NASA Astrophysics Data System (ADS)

Taylor, Kate; Moore, Simon

Control over a closed domain of textual material removes many question answering issues, as does an ontology that is closely intertwined with its sources. This pragmatic, shallow approach to many challenging areas of research in adaptive hypermedia, question answering, intelligent tutoring and humancomputer interaction has been put into practice at Cambridge in the Computer Science undergraduate course to teach the hardware description language Veri/og. This language itself poses many challenges as it crosses the interdisciplinary boundary between hardware and software engineers, giving rise to severalhuman ontologies as well as theprogramming language itself We present further results from ourformal and informal surveys. We look at further work to increase the dialogue between studentand tutor and export our knowledge to the Semantic Web.
Net Improvement of Correct Answers to Therapy Questions After PubMed Searches: Pre/Post Comparison

PubMed Central

Keepanasseril, Arun

2013-01-01

Background Clinicians search PubMed for answers to clinical questions although it is time consuming and not always successful. Objective To determine if PubMed used with its Clinical Queries feature to filter results based on study quality would improve search success (more correct answers to clinical questions related to therapy). Methods We invited 528 primary care physicians to participate, 143 (27.1%) consented, and 111 (21.0% of the total and 77.6% of those who consented) completed the study. Participants answered 14 yes/no therapy questions and were given 4 of these (2 originally answered correctly and 2 originally answered incorrectly) to search using either the PubMed main screen or PubMed Clinical Queries narrow therapy filter via a purpose-built system with identical search screens. Participants also picked 3 of the first 20 retrieved citations that best addressed each question. They were then asked to re-answer the original 14 questions. Results We found no statistically significant differences in the rates of correct or incorrect answers using the PubMed main screen or PubMed Clinical Queries. The rate of correct answers increased from 50.0% to 61.4% (95% CI 55.0%-67.8%) for the PubMed main screen searches and from 50.0% to 59.1% (95% CI 52.6%-65.6%) for Clinical Queries searches. These net absolute increases of 11.4% and 9.1%, respectively, included previously correct answers changing to incorrect at a rate of 9.5% (95% CI 5.6%-13.4%) for PubMed main screen searches and 9.1% (95% CI 5.3%-12.9%) for Clinical Queries searches, combined with increases in the rate of being correct of 20.5% (95% CI 15.2%-25.8%) for PubMed main screen searches and 17.7% (95% CI 12.7%-22.7%) for Clinical Queries searches. Conclusions PubMed can assist clinicians answering clinical questions with an approximately 10% absolute rate of improvement in correct answers. This small increase includes more correct answers partially offset by a decrease in previously correct answers
American Iron and Steel Requirement - Guidance and Questions and Answers

EPA Pesticide Factsheets

Explanation of the P.L. 113-76, Consolidated Appropriations Act, 2014 its implementation for the American Iron and Steel (AIS) requirement and other questions and answers in regards to AIS requirements
Questions and Answers: The Education of Exceptional Children. Report Number 73.

ERIC Educational Resources Information Center

Hensley, Gene; And Others

Written in question and answer form, the booklet provides brief responses to often asked questions by legislators and educators concerning the education of exceptional children. Among the topics covered are state and federal legislation; planning and accountability; finance; administration, classification, and placement; personnel utilization;…
Supporting Mediated Peer-Evaluation to Grade Answers to Open-Ended Questions

ERIC Educational Resources Information Center

De Marsico, Maria; Sciarrone, Filippo; Sterbini, Andrea; Temperini, Marco

2017-01-01

We show an approach to semi-automatic grading of answers given by students to open ended questions (open answers). We use both peer-evaluation and teacher evaluation. A learner is modeled by her Knowledge and her assessments quality (Judgment). The data generated by the peer- and teacher-evaluations, and by the learner models is represented by a…
Effect of response format on cognitive reflection: Validating a two- and four-option multiple choice question version of the Cognitive Reflection Test.

PubMed

Sirota, Miroslav; Juanchich, Marie

2018-03-27

The Cognitive Reflection Test, measuring intuition inhibition and cognitive reflection, has become extremely popular because it reliably predicts reasoning performance, decision-making, and beliefs. Across studies, the response format of CRT items sometimes differs, based on the assumed construct equivalence of tests with open-ended versus multiple-choice items (the equivalence hypothesis). Evidence and theoretical reasons, however, suggest that the cognitive processes measured by these response formats and their associated performances might differ (the nonequivalence hypothesis). We tested the two hypotheses experimentally by assessing the performance in tests with different response formats and by comparing their predictive and construct validity. In a between-subjects experiment (n = 452), participants answered stem-equivalent CRT items in an open-ended, a two-option, or a four-option response format and then completed tasks on belief bias, denominator neglect, and paranormal beliefs (benchmark indicators of predictive validity), as well as on actively open-minded thinking and numeracy (benchmark indicators of construct validity). We found no significant differences between the three response formats in the numbers of correct responses, the numbers of intuitive responses (with the exception of the two-option version, which had a higher number than the other tests), and the correlational patterns of the indicators of predictive and construct validity. All three test versions were similarly reliable, but the multiple-choice formats were completed more quickly. We speculate that the specific nature of the CRT items helps build construct equivalence among the different response formats. We recommend using the validated multiple-choice version of the CRT presented here, particularly the four-option CRT, for practical and methodological reasons. Supplementary materials and data are available at https://osf.io/mzhyc/ .
Did Darwin really answer Paley's question?

PubMed

Brunnander, Björn

2013-09-01

It is commonly thought that natural selection explains the rise of adaptive complexity. Razeto-Barry and Frick (2011) have recently argued in favour of this view, dubbing it the Creative View. I argue that the Creative View is mistaken if it claims that natural selection serves to answer Paley's question. This is shown by a case that brings out the contrastive structure inherent in this demand for explanation. There is, however, a rather trivial sense in which specific environmental conditions are crucial for the rise of specific adaptations, but this is hardly what opponents of the Creative View are denying. Copyright © 2013 Elsevier Ltd. All rights reserved.
Internet delivered question and answer column for patients with schizophrenia.

PubMed

Maijala, Riikka; Anttila, Minna; Koivunen, Marita; Pitkänen, Anneli; Kuosmanen, Lauri; Välimäki, Maritta

2015-01-01

The purpose of this study was to describe the use of an Internet delivered question and answer column among patients with schizophrenia. The column was developed for research purposes. The study sample consisted of patients (N = 100) admitted to acute inpatient psychiatric care in two hospital districts. Descriptive data were collected from the column to which a nurse replied within 3 days and analysed using qualitative content analysis. The column had four to five questions weekly. The most common age of users was 18-24 years, and the gender distribution was almost equal. Column use was heaviest among students (44%) and least among unemployed people (19%). Out of 85 questions or comments sent to the column, 25 (29%) were related to program training and the remaining 60 (71%) were related to medication (31%), illness and tests (25%), other questions or comments (9%), daily life and coping with it (4%), and places to receive treatment (2%). An Internet delivered question and answer column can be included in the care of patients with schizophrenia. However, it requires a new type of basic and additional education in the field of mental health care in order for nurses to be able to provide nursing via the Internet forum.
Teacher Deployment of "Oh" in Known-Answer Question Sequences

ERIC Educational Resources Information Center

Hosoda, Yuri

2016-01-01

This conversation analytic study describes some specific interactional contexts in which native English-speaking teachers produce "oh" in known-answer question sequences in English language classes. The data for this study come from 10 video-recorded Japanese primary school English language class sessions. The analysis identified three…
Are psychiatrists affecting the legal process by answering legal questions?

PubMed

Hardie, Timothy; Elcock, Susan; Mackay, R D

2008-01-01

Psychiatrists are often asked to answer legal questions. The extent to which they answer strictly legal rather than medical matters is not known. To investigate how strongly psychiatrists in England and Wales express opinions on one legal question - that of diminished responsibility in respect of a murder charge, and how this is related to outcome in court. METHOD Our data were extracted from psychiatric reports and case files supplied by the then Department of Constitutional Affairs (now the Ministry of Justice) on cases heard in the Crown Courts between 1 January 1997 and 31 December 2001 in which the defence of diminished responsibility had been raised. The cases had been selected by the Law Commission in their earlier review of partial defences to murder. We devised a reliable system of rating the presence/absence and strength of expression of a legal opinion in the medical reports. We tested the data for relationship between nature and strength of opinion and progression to trial and verdict. RESULTS Psychiatric reports were available on 143 of 156 cases in which diminished responsibility was considered. They yielded 338 opinions on at least one aspect of diminished responsibility. In 110 (93%) of the 118 cases in which there was a diminished verdict, this was made without trial and, therefore, without reference to a jury. In only eight (27%) out of the 30 cases that went to trial, was a diminished responsibility verdict made. Half of the reports (169) gave a clear opinion on diminished responsibility, a third (121) invited the court to draw a particular conclusion and only 11% (36) provided relevant evidence without answering the legal questions. When there was an opinion or an invitation to make a finding on the legal question, a trial was less likely. A trial was also less likely if reports agreed on what the verdict should be. CONCLUSIONS Psychiatrists frequently answer the legal question of diminished responsibility. The judiciary and medical experts
An overview of the BIOASQ large-scale biomedical semantic indexing and question answering competition.

PubMed

Tsatsaronis, George; Balikas, Georgios; Malakasiotis, Prodromos; Partalas, Ioannis; Zschunke, Matthias; Alvers, Michael R; Weissenborn, Dirk; Krithara, Anastasia; Petridis, Sergios; Polychronopoulos, Dimitris; Almirantis, Yannis; Pavlopoulos, John; Baskiotis, Nicolas; Gallinari, Patrick; Artiéres, Thierry; Ngomo, Axel-Cyrille Ngonga; Heino, Norman; Gaussier, Eric; Barrio-Alvers, Liliana; Schroeder, Michael; Androutsopoulos, Ion; Paliouras, Georgios

2015-04-30

This article provides an overview of the first BIOASQ challenge, a competition on large-scale biomedical semantic indexing and question answering (QA), which took place between March and September 2013. BIOASQ assesses the ability of systems to semantically index very large numbers of biomedical scientific articles, and to return concise and user-understandable answers to given natural language questions by combining information from biomedical articles and ontologies. The 2013 BIOASQ competition comprised two tasks, Task 1a and Task 1b. In Task 1a participants were asked to automatically annotate new PUBMED documents with MESH headings. Twelve teams participated in Task 1a, with a total of 46 system runs submitted, and one of the teams performing consistently better than the MTI indexer used by NLM to suggest MESH headings to curators. Task 1b used benchmark datasets containing 29 development and 282 test English questions, along with gold standard (reference) answers, prepared by a team of biomedical experts from around Europe and participants had to automatically produce answers. Three teams participated in Task 1b, with 11 system runs. The BIOASQ infrastructure, including benchmark datasets, evaluation mechanisms, and the results of the participants and baseline methods, is publicly available. A publicly available evaluation infrastructure for biomedical semantic indexing and QA has been developed, which includes benchmark datasets, and can be used to evaluate systems that: assign MESH headings to published articles or to English questions; retrieve relevant RDF triples from ontologies, relevant articles and snippets from PUBMED Central; produce "exact" and paragraph-sized "ideal" answers (summaries). The results of the systems that participated in the 2013 BIOASQ competition are promising. In Task 1a one of the systems performed consistently better from the NLM's MTI indexer. In Task 1b the systems received high scores in the manual evaluation of the "ideal
Randomized trial for answers to clinical questions: evaluating a pre-appraised versus a MEDLINE search protocol.

PubMed

Patel, Manesh R; Schardt, Connie M; Sanders, Linda L; Keitz, Sheri A

2006-10-01

The paper compares the speed, validity, and applicability of two different protocols for searching the primary medical literature. A randomized trial involving medicine residents was performed. An inpatient general medicine rotation was used. Thirty-two internal medicine residents were block randomized into four groups of eight. Success rate of each search protocol was measured by perceived search time, number of questions answered, and proportion of articles that were applicable and valid. Residents randomized to the MEDLINE-first (protocol A) group searched 120 questions, and residents randomized to the MEDLINE-last (protocol B) searched 133 questions. In protocol A, 104 answers (86.7%) and, in protocol B, 117 answers (88%) were found to clinical questions. In protocol A, residents reported that 26 (25.2%) of the answers were obtained quickly or rated as "fast" (<5 minutes) as opposed to 55 (51.9%) in protocol B, (P = 0.0004). A subset of questions and articles (n = 79) were reviewed by faculty who found that both protocols identified similar numbers of answer articles that addressed the questions and were felt to be valid using critical appraisal criteria. For resident-generated clinical questions, both protocols produced a similarly high percentage of applicable and valid articles. The MEDLINE-last search protocol was perceived to be faster. However, in the MEDLINE-last protocol, a significant portion of questions (23%) still required searching MEDLINE to find an answer.
Home Schooling: Answers to Questions Parents Most Often Ask.

ERIC Educational Resources Information Center

McIntire, Deborah; Windham, Robert

This resource for parents draws upon research findings and the experience of home schooling parents to answer common questions about home schooling in the United States and Canada. Included is information on home schooling instructional approaches and curricula, record keeping, organizational tools, and practical tips. Chapter 1, "Initial…

Assessing the quality of pharmacist answers to telephone drug information questions.

PubMed

Woodward, C T; Stevenson, J G; Poremba, A

1990-04-01

A quality assurance (QA) program is described in which frontline pharmacists were asked test drug information questions via anonymous telephone calls. The program was instituted at a university hospital that began providing decentralized pharmaceutical services in 1985. Questions were developed on the basis of a pilot study conducted to determine the types and complexity of drug information questions received by frontline pharmacists at the hospital. Data on departmental clinical productivity were used to determine the number of questions that would be posed during each shift in the various service areas. The questions were posed during a 10-day period; the pharmacists were aware of the program, but the callers did not identify their affiliation with it. In response to 105 questions asked, 86 were judged to have been answered correctly, 13 answers were deemed incomplete, and 6 were judged incorrect. Pharmacists were more likely to respond incorrectly to complex questions and questions posed during the night shift. As a result of the audit, staff members with advanced clinical knowledge were asked to help less experienced pharmacists, the position of assistant director for drug information and staff development was created, and educational programs were instituted. The QA audit has been repeated twice. Posing test drug information questions via anonymous telephone calls is effective in assessing the quality of drug information provided by pharmacists in patient-care areas.
Understanding the Factors Influencing User Experience of Social Question and Answer Services

ERIC Educational Resources Information Center

Deng, Shengli; Fang, Yuling; Liu, Yong; Li, Hongxiu

2015-01-01

Introduction: The popularity of social question and answer sites has made it an important and convenient source for obtaining knowledge. This study quantifies how three different system characteristics (interface design, interaction and answer quality) affect users' perceptions (perceived usefulness, perceived ease of use and perceived enjoyment),…
41 CFR 300-2.20 - What is the purpose of the question & answer format?

Code of Federal Regulations, 2010 CFR

2010-07-01

... 41 Public Contracts and Property Management 4 2010-07-01 2010-07-01 false What is the purpose of the question & answer format? 300-2.20 Section 300-2.20 Public Contracts and Property Management Federal Travel Regulation System GENERAL INTRODUCTION 2-HOW TO USE THE FTR Question & Answer Format § 300...
Records--The Achilles' Heel of School Nursing: Answers to Bothersome Questions

ERIC Educational Resources Information Center

Schwab, Nadine C.; Pohlman, Katherine J.

2004-01-01

This article addresses practice issues related to school health records and school nursing documentation. Because the issues have been posed by practicing school nurses, the article is in Question and Answer (Q&A) format. Specifically, the questions addressed concern the following: ownership and storage location of student health records when…
Using a Classroom Response System to Improve Multiple-Choice Performance in AP[R] Physics

ERIC Educational Resources Information Center

Bertrand, Peggy

2009-01-01

Participation in rigorous high school courses such as Advanced Placement (AP[R]) Physics increases the likelihood of college success, especially for students who are traditionally underserved. Tackling difficult multiple-choice exams should be part of any AP program because well-constructed multiple-choice questions, such as those on AP exams and…
A Semi-Supervised Learning Approach to Enhance Health Care Community–Based Question Answering: A Case Study in Alcoholism

PubMed Central

Klabjan, Diego; Jonnalagadda, Siddhartha Reddy

2016-01-01

Background Community-based question answering (CQA) sites play an important role in addressing health information needs. However, a significant number of posted questions remain unanswered. Automatically answering the posted questions can provide a useful source of information for Web-based health communities. Objective In this study, we developed an algorithm to automatically answer health-related questions based on past questions and answers (QA). We also aimed to understand information embedded within Web-based health content that are good features in identifying valid answers. Methods Our proposed algorithm uses information retrieval techniques to identify candidate answers from resolved QA. To rank these candidates, we implemented a semi-supervised leaning algorithm that extracts the best answer to a question. We assessed this approach on a curated corpus from Yahoo! Answers and compared against a rule-based string similarity baseline. Results On our dataset, the semi-supervised learning algorithm has an accuracy of 86.2%. Unified medical language system–based (health related) features used in the model enhance the algorithm’s performance by proximately 8%. A reasonably high rate of accuracy is obtained given that the data are considerably noisy. Important features distinguishing a valid answer from an invalid answer include text length, number of stop words contained in a test question, a distance between the test question and other questions in the corpus, and a number of overlapping health-related terms between questions. Conclusions Overall, our automated QA system based on historical QA pairs is shown to be effective according to the dataset in this case study. It is developed for general use in the health care domain, which can also be applied to other CQA sites. PMID:27485666
Approaches to answering critical CER questions.

PubMed

Kinnier, Christine V; Chung, Jeanette W; Bilimoria, Karl Y

2015-01-01

While randomized controlled trials (RCTs) are the gold standard for research, many research questions cannot be ethically and practically answered using an RCT. Comparative effectiveness research (CER) techniques are often better suited than RCTs to address the effects of an intervention under routine care conditions, an outcome otherwise known as effectiveness. CER research techniques covered in this section include: effectiveness-oriented experimental studies such as pragmatic trials and cluster randomized trials, treatment response heterogeneity, observational and database studies including adjustment techniques such as sensitivity analysis and propensity score analysis, systematic reviews and meta-analysis, decision analysis, and cost effectiveness analysis. Each section describes the technique and covers the strengths and weaknesses of the approach.
Effects of Differential Feedback on the Answering of Two Types of Questions by Fifth- and Sixth-Graders.

ERIC Educational Resources Information Center

Peeck, J.

1979-01-01

Fifth- and sixth-graders were tested with multiple-choice fact and inference questions about a reading passage, then given feedback either with or without the text present. Retesting occurred four days later. Results corroborated recent findings on age-related improvement in inferential processing comprehension and memory. (Author/SJL)
Fillers as Signals: Evidence from a Question-Answering Paradigm

ERIC Educational Resources Information Center

Walker, Esther J.; Risko, Evan F.; Kingstone, Alan

2014-01-01

The present study examined the influence of a human or computer "partner" on the production of fillers ("um" and "uh") during a question and answer task. Experiment 1 investigated whether or not responding to a human partner as opposed to a computer partner results in a higher rate of filler production. Participants…
Long-Term Follow-Up of Echolalia and Question Answering.

ERIC Educational Resources Information Center

Foxx, R. M.; Faw, Gerald D.

1990-01-01

A long-term followup (from 26 to 57 months) of echolalia and correct question-answering was conducted with six mentally retarded adult subjects identified from three previously published studies. Echolalia was lower than in baseline in 80.6 percent of the followups. Issues related to the study of maintenance are discussed. (Author/DB)
Using the regulation of accuracy to study performance when the correct answer is not known.

PubMed

Luna, Karlos; Martín-Luengo, Beatriz

2017-08-01

We examined memory performance in multiple-choice questions when correct answers were not always present. How do participants answer when they are aware that the correct alternative may not be present? To answer this question we allowed participants to decide on the number of alternatives in their final answer (the plurality option), and whether they wanted to report or withhold their answer (report option). We also studied the memory benefits when both the plurality and the report options were available. In two experiments participants watched a crime and then answered questions with five alternatives. Half of the questions were presented with the correct alternative and half were not. Participants selected one alternative and rated confidence, then selected three alternatives and again rated confidence, and finally indicated whether they preferred the answer with one or with three alternatives (plurality option). Lastly, they decided whether to report or withhold the answer (report option). Results showed that participants' confidence in their selections was higher, that they chose more single answers, and that they preferred to report more often when the correct alternative was presented. We also attempted to classify a posteriori questions as either presented with or without the correct alternative from participants' selection. Classification was better than chance, and encouraging, but the forensic application of the classification technique is still limited since there was a large percentage of responses that were incorrectly classified. Our results also showed that the memory benefits of both plurality and report options overlap. © 2017 Scandinavian Psychological Associations and John Wiley & Sons Ltd.
77 FR 74671 - Guidance for Industry: Questions and Answers Regarding Food Facility Registration (Fifth Edition)

Federal Register 2010, 2011, 2012, 2013, 2014

2012-12-17

... DEPARTMENT OF HEALTH AND HUMAN SERVICES Food and Drug Administration [Docket No. FDA-2012-D-1002] Guidance for Industry: Questions and Answers Regarding Food Facility Registration (Fifth Edition) AGENCY... announcing the availability of a guidance for industry entitled ``Questions and Answers Regarding Food...
Delay and probability discounting of multiple commodities in smokers and never-smokers using multiple-choice tasks.

PubMed

Poltavski, Dmitri V; Weatherly, Jeffrey N

2013-12-01

The purpose of the present study was to investigate temporal and probabilistic discounting in smokers and never-smokers, across a number of commodities, using a multiple-choice method. One hundred and eighty-two undergraduate university students, of whom 90 had never smoked, 73 were self-reported light smokers (<10 cigarettes/day), and 17 were heavy smokers (10+cigarettes/day), completed computerized batteries of delay and probability discounting questions pertaining to a total of eight commodities and administered in a multiple-choice format. In addition to cigarettes, monetary rewards, and health outcomes, the tasks included novel commodities such as ideal dating partner and retirement income. The results showed that heavy smokers probability discounted commodities at a significantly shallower rate than never-smokers, suggesting greater risk-taking. No effect of smoking status was observed for delay discounting questions. The only commodity that was probability discounted significantly less than others was 'finding an ideal dating partner'. The results suggest that probability discounting tasks using the multiple-choice format can discriminate between non-abstaining smokers and never-smokers and could be further explored in the context of behavioral and drug addictions.
Comparing the use of an online expert health network against common information sources to answer health questions.

PubMed

Rhebergen, Martijn D F; Lenderink, Annet F; van Dijk, Frank J H; Hulshof, Carel T J

2012-02-02

Many workers have questions about occupational safety and health (OSH). It is unknown whether workers are able to find correct, evidence-based answers to OSH questions when they use common information sources, such as websites, or whether they would benefit from using an easily accessible, free-of-charge online network of OSH experts providing advice. To assess the rate of correct, evidence-based answers to OSH questions in a group of workers who used an online network of OSH experts (intervention group) compared with a group of workers who used common information sources (control group). In a quasi-experimental study, workers in the intervention and control groups were randomly offered 2 questions from a pool of 16 standardized OSH questions. Both questions were sent by mail to all participants, who had 3 weeks to answer them. The intervention group was instructed to use only the online network ArboAntwoord, a network of about 80 OSH experts, to solve the questions. The control group was instructed that they could use all information sources available to them. To assess answer correctness as the main study outcome, 16 standardized correct model answers were constructed with the help of reviewers who performed literature searches. Subsequently, the answers provided by all participants in the intervention (n = 94 answers) and control groups (n = 124 answers) were blinded and compared with the correct model answers on the degree of correctness. Of the 94 answers given by participants in the intervention group, 58 were correct (62%), compared with 24 of the 124 answers (19%) in the control group, who mainly used informational websites found via Google. The difference between the 2 groups was significant (rate difference = 43%, 95% confidence interval [CI] 30%-54%). Additional analysis showed that the rate of correct main conclusions of the answers was 85 of 94 answers (90%) in the intervention group and 75 of 124 answers (61%) in the control group (rate difference
Comparing the Use of an Online Expert Health Network against Common Information Sources to Answer Health Questions

PubMed Central

Lenderink, Annet F; van Dijk, Frank JH; Hulshof, Carel TJ

2012-01-01

Background Many workers have questions about occupational safety and health (OSH). It is unknown whether workers are able to find correct, evidence-based answers to OSH questions when they use common information sources, such as websites, or whether they would benefit from using an easily accessible, free-of-charge online network of OSH experts providing advice. Objective To assess the rate of correct, evidence-based answers to OSH questions in a group of workers who used an online network of OSH experts (intervention group) compared with a group of workers who used common information sources (control group). Methods In a quasi-experimental study, workers in the intervention and control groups were randomly offered 2 questions from a pool of 16 standardized OSH questions. Both questions were sent by mail to all participants, who had 3 weeks to answer them. The intervention group was instructed to use only the online network ArboAntwoord, a network of about 80 OSH experts, to solve the questions. The control group was instructed that they could use all information sources available to them. To assess answer correctness as the main study outcome, 16 standardized correct model answers were constructed with the help of reviewers who performed literature searches. Subsequently, the answers provided by all participants in the intervention (n = 94 answers) and control groups (n = 124 answers) were blinded and compared with the correct model answers on the degree of correctness. Results Of the 94 answers given by participants in the intervention group, 58 were correct (62%), compared with 24 of the 124 answers (19%) in the control group, who mainly used informational websites found via Google. The difference between the 2 groups was significant (rate difference = 43%, 95% confidence interval [CI] 30%–54%). Additional analysis showed that the rate of correct main conclusions of the answers was 85 of 94 answers (90%) in the intervention group and 75 of 124 answers (61%) in
Decision making under internal uncertainty: the case of multiple-choice tests with different scoring rules.

PubMed

Bereby-Meyer, Yoella; Meyer, Joachim; Budescu, David V

2003-02-01

This paper assesses framing effects on decision making with internal uncertainty, i.e., partial knowledge, by focusing on examinees' behavior in multiple-choice (MC) tests with different scoring rules. In two experiments participants answered a general-knowledge MC test that consisted of 34 solvable and 6 unsolvable items. Experiment 1 studied two scoring rules involving Positive (only gains) and Negative (only losses) scores. Although answering all items was the dominating strategy for both rules, the results revealed a greater tendency to answer under the Negative scoring rule. These results are in line with the predictions derived from Prospect Theory (PT) [Econometrica 47 (1979) 263]. The second experiment studied two scoring rules, which allowed respondents to exhibit partial knowledge. Under the Inclusion-scoring rule the respondents mark all answers that could be correct, and under the Exclusion-scoring rule they exclude all answers that might be incorrect. As predicted by PT, respondents took more risks under the Inclusion rule than under the Exclusion rule. The results illustrate that the basic process that underlies choice behavior under internal uncertainty and especially the effect of framing is similar to the process of choice under external uncertainty and can be described quite accurately by PT. Copyright 2002 Elsevier Science B.V.
Selecting Information to Answer Questions: Strategic Individual Differences when Searching Texts

ERIC Educational Resources Information Center

Cerdan, Raquel; Gilabert, Ramiro; Vidal-Abarca, Eduardo

2011-01-01

The purpose of the study was to explore students' selection of information strategies in a task-oriented reading situation. 72 secondary school students read two texts and answered six questions per text, three of which were manipulated to induce a misleading matching between the wording of the question and distracting pieces of information in the…
Questions and Answers about RTI: A Guide to Success

ERIC Educational Resources Information Center

Moran, Heather; Petruzzelli, Anthony

2011-01-01

As Response-to-Intervention (RTI) models continue to attract a great deal of attention, school and district leaders need to understand the structures needed, the personnel required, the challenges faced, and rewards realized from RTI. "Questions and Answers About RTI: A Guide to Success" is designed to guide a school or district through the…
Assessment of H1N1 questions and answers posted on the Web.

PubMed

Kim, Sujin; Pinkerton, Thomas; Ganesh, Nithya

2012-04-01

A novel strain of human influenza A (H1N1) posed a serious pandemic threat worldwide during 2009. The public's fear of pandemic flu often raises awareness and discussion of such events. The goal of this study was to characterize major topical matters of H1N1 questions and answers raised by the online question and answer community Yahoo! Answers during H1N1 outbreak. The study used Text Mining for SPSS Clementine (v.12; SPSS Inc., Chicago, IL) to extract the major concepts of the collected Yahoo! questions and answers. The original collections were retrieved using "H1N1" in search, keyword and then filtered for only "resolved questions" in the "health" category submitted within the past 2 years. The most frequently formed categories were as follows: general health (health, disease, medicine, investigation, evidence, problem), flu-specific terms (H1N1, swine, shot, fever, cold, infective, throat), and nonmedical issues (feel, North American, people, child, nations, government, states, help, doubt, emotion). The study found that URL data are fairly predictable: those providing answers are divided between ones dedicated to giving trustworthy information-from news organizations and the government, for instance-and those looking to espouse a more biased point of view. Critical evaluation of online sources should be taught to select the quality of information and improve health literacy. The challenges of pandemic prevention and control, therefore, demand both e-surveillance and better informed "Netizens." Copyright © 2012 Association for Professionals in Infection Control and Epidemiology, Inc. Published by Mosby, Inc. All rights reserved.
10 Questions to Answer for Technology to Succeed in Your School

ERIC Educational Resources Information Center

Gosmire, Doreen; Grady, Marilyn L.

2007-01-01

Few principals claim to be technology experts. Most aspire to design a map that leads their schools to success with educational technology. However, the key to success on the journey is not knowing everything or becoming a technology expert. It is about asking the right questions, exploring the answers to those questions, and creating a road map…

A cognitive evaluation of four online search engines for answering definitional questions posed by physicians.

PubMed

Yu, Hong; Kaufman, David

2007-01-01

The Internet is having a profound impact on physicians' medical decision making. One recent survey of 277 physicians showed that 72% of physicians regularly used the Internet to research medical information and 51% admitted that information from web sites influenced their clinical decisions. This paper describes the first cognitive evaluation of four state-of-the-art Internet search engines: Google (i.e., Google and Scholar.Google), MedQA, Onelook, and PubMed for answering definitional questions (i.e., questions with the format of "What is X?") posed by physicians. Onelook is a portal for online definitions, and MedQA is a question answering system that automatically generates short texts to answer specific biomedical questions. Our evaluation criteria include quality of answer, ease of use, time spent, and number of actions taken. Our results show that MedQA outperforms Onelook and PubMed in most of the criteria, and that MedQA surpasses Google in time spent and number of actions, two important efficiency criteria. Our results show that Google is the best system for quality of answer and ease of use. We conclude that Google is an effective search engine for medical definitions, and that MedQA exceeds the other search engines in that it provides users direct answers to their questions; while the users of the other search engines have to visit several sites before finding all of the pertinent information.
Survey design research: a tool for answering nursing research questions.

PubMed

Siedlecki, Sandra L; Butler, Robert S; Burchill, Christian N

2015-01-01

The clinical nurse specialist is in a unique position to identify and study clinical problems in need of answers, but lack of time and resources may discourage nurses from conducting research. However, some research methods can be used by the clinical nurse specialist that are not time-intensive or cost prohibitive. The purpose of this article is to explain the utility of survey methodology for answering a number of nursing research questions. The article covers survey content, reliability and validity issues, sample size considerations, and methods of survey delivery.
Educational Choice: Practical Policy Questions. Occasional Paper Series No. 7.

ERIC Educational Resources Information Center

First, Patricia F.

The consideration of school choice plans raises policy questions for school administrators. This paper addresses pragmatic concerns about definitions and policy questions related to educational finance. Interdistrict choice, emphasizing families' right to choose among existing public schools, raises questions regarding transportation and…
What Is the Correct Answer about The Dress' Colors? Investigating the Relation between Optimism, Previous Experience, and Answerability.

PubMed

Karlsson, Bodil S A; Allwood, Carl Martin

2016-01-01

The Dress photograph, first displayed on the internet in 2015, revealed stunning individual differences in color perception. The aim of this study was to investigate if lay-persons believed that the question about The Dress colors was answerable. Past research has found that optimism is related to judgments of how answerable knowledge questions with controversial answers are (Karlsson et al., 2016). Furthermore, familiarity with a question can create a feeling of knowing the answer (Reder and Ritter, 1992). Building on these findings, 186 participants saw the photo of The Dress and were asked about the correct answer to the question about The Dress' colors (" blue and black," "white and gold," "other, namely…," or "there is no correct answer" ). Choice of the alternative "there is no correct answer" was interpreted as believing the question was not answerable. This answer was chosen more often by optimists and by people who reported they had not seen The Dress before. We also found that among participants who had seen The Dress photo before, 19%, perceived The Dress as "white and gold" but believed that the correct answer was "blue and black ." This, in analogy to previous findings about non-believed memories (Scoboria and Pascal, 2016), shows that people sometimes do not believe the colors they have perceived are correct. Our results suggest that individual differences related to optimism and previous experience may contribute to if the judgment of the individual perception of a photograph is enough to serve as a decision basis for valid conclusions about colors. Further research about color judgments under ambiguous circumstances could benefit from separating individual perceptual experience from beliefs about the correct answer to the color question. Including the option "there is no correct answer " may also be beneficial.
Benford's Law: textbook exercises and multiple-choice testbanks.

PubMed

Slepkov, Aaron D; Ironside, Kevin B; DiBattista, David

2015-01-01

Benford's Law describes the finding that the distribution of leading (or leftmost) digits of innumerable datasets follows a well-defined logarithmic trend, rather than an intuitive uniformity. In practice this means that the most common leading digit is 1, with an expected frequency of 30.1%, and the least common is 9, with an expected frequency of 4.6%. Currently, the most common application of Benford's Law is in detecting number invention and tampering such as found in accounting-, tax-, and voter-fraud. We demonstrate that answers to end-of-chapter exercises in physics and chemistry textbooks conform to Benford's Law. Subsequently, we investigate whether this fact can be used to gain advantage over random guessing in multiple-choice tests, and find that while testbank answers in introductory physics closely conform to Benford's Law, the testbank is nonetheless secure against such a Benford's attack for banal reasons.
Analyzing Multiple-Choice Questions by Model Analysis and Item Response Curves

NASA Astrophysics Data System (ADS)

Wattanakasiwich, P.; Ananta, S.

2010-07-01

In physics education research, the main goal is to improve physics teaching so that most students understand physics conceptually and be able to apply concepts in solving problems. Therefore many multiple-choice instruments were developed to probe students' conceptual understanding in various topics. Two techniques including model analysis and item response curves were used to analyze students' responses from Force and Motion Conceptual Evaluation (FMCE). For this study FMCE data from more than 1000 students at Chiang Mai University were collected over the past three years. With model analysis, we can obtain students' alternative knowledge and the probabilities for students to use such knowledge in a range of equivalent contexts. The model analysis consists of two algorithms—concentration factor and model estimation. This paper only presents results from using the model estimation algorithm to obtain a model plot. The plot helps to identify a class model state whether it is in the misconception region or not. Item response curve (IRC) derived from item response theory is a plot between percentages of students selecting a particular choice versus their total score. Pros and cons of both techniques are compared and discussed.
Multiple-Choice Exams: An Obstacle for Higher-Level Thinking in Introductory Science Classes

PubMed Central

Stanger-Hall, Kathrin F.

2012-01-01

Learning science requires higher-level (critical) thinking skills that need to be practiced in science classes. This study tested the effect of exam format on critical-thinking skills. Multiple-choice (MC) testing is common in introductory science courses, and students in these classes tend to associate memorization with MC questions and may not see the need to modify their study strategies for critical thinking, because the MC exam format has not changed. To test the effect of exam format, I used two sections of an introductory biology class. One section was assessed with exams in the traditional MC format, the other section was assessed with both MC and constructed-response (CR) questions. The mixed exam format was correlated with significantly more cognitively active study behaviors and a significantly better performance on the cumulative final exam (after accounting for grade point average and gender). There was also less gender-bias in the CR answers. This suggests that the MC-only exam format indeed hinders critical thinking in introductory science classes. Introducing CR questions encouraged students to learn more and to be better critical thinkers and reduced gender bias. However, student resistance increased as students adjusted their perceptions of their own critical-thinking abilities. PMID:22949426
Questions and Answers about AFTERSCHOOL CARE: A Sloan Work and Family Research Network Fact Sheet

ERIC Educational Resources Information Center

Sloan Work and Family Research Network, 2008

2008-01-01

The Sloan Work and Family Research Network has prepared Fact Sheets that provide statistical answers to some important questions about work-family and work-life issues. This Fact Sheet includes statistics about Afterschool Care, and answers the following questions about afterschool programs: (1) How does afterschool care help children?; (2) How…
Answers to the 50 Most Important Questions about Private Mental Health Practice.

ERIC Educational Resources Information Center

Forman, Bruce D.; Silverman, Wade H.

Designed for anyone contemplating or presently established in private mental health practice, this book provides the answers to 50 pertinent questions concerning private practice. Questions were culled from a survey of graduate students in psychology, as well as experienced psychotherapists, psychiatrists, social workers, mental health counselors,…
The development and validation of a two-tiered multiple-choice instrument to identify alternative conceptions in earth science

NASA Astrophysics Data System (ADS)

Mangione, Katherine Anna

This study was to determine reliability and validity for a two-tiered, multiple- choice instrument designed to identify alternative conceptions in earth science. Additionally, this study sought to identify alternative conceptions in earth science held by preservice teachers, to investigate relationships between self-reported confidence scores and understanding of earth science concepts, and to describe relationships between content knowledge and alternative conceptions and planning instruction in the science classroom. Eighty-seven preservice teachers enrolled in the MAT program participated in this study. Sixty-eight participants were female, twelve were male, and seven chose not to answer. Forty-seven participants were in the elementary certification program, five were in the middle school certification program, and twenty-nine were pursuing secondary certification. Results indicate that the two-tiered, multiple-choice format can be a reliable and valid method for identifying alternative conceptions. Preservice teachers in all certification areas who participated in this study may possess common alternative conceptions previously identified in the literature. Alternative conceptions included: all rivers flow north to south, the shadow of the Earth covers the Moon causing lunar phases, the Sun is always directly overhead at noon, weather can be predicted by animal coverings, and seasons are caused by the Earth's proximity to the Sun. Statistical analyses indicated differences, however not all of them significant, among all subgroups according to gender and certification area. Generally males outperformed females and preservice teachers pursuing middle school certification had higher scores on the questionnaire followed by those obtaining secondary certification. Elementary preservice teachers scored the lowest. Additionally, self-reported scores of confidence in one's answers and understanding of the earth science concept in question were analyzed. There was a
Questions and Answers on Disciplining Students with Disabilities. OSEP Memorandum.

ERIC Educational Resources Information Center

Heumann, Judith E.; Hehir, Thomas

This document, presented in question and answer format, provides guidance about legal requirements of the Individuals with Disabilities Education Act (IDEA) concerning the misconduct of students with disabilities and corrects the misunderstanding that students with disabilities are exempt from discipline under current law. It discusses recent…
Kant's answer to the question 'what is man?' and its implications for anthropology.

PubMed

Cohen, Alix A

2008-12-01

This paper examines Kant's anthropological project and its relationship to his conception of 'man' in order to show that Kant's answer to the question 'what is man?' entails a decisive re-evaluation of traditional conceptions of human nature. I argue that Kant redirects the question 'what is man?' away from defining man in terms of what he is, and towards defining him in terms of what he does, in particular through the distinction between three levels of what I will call 'man's praxis': the levels of technicality, prudence, and morality. As soon as man is understood in terms of what he makes of himself rather than in terms of what he is, two crucial issues arise: what is the purpose of his making? And how can he reach this destination? My claim is that whilst the first question is answered by ethics and a doctrine of prudence, the second question is answered by anthropology. In this sense, anthropology plays the crucial role of identifying the worldly helps and hindrances to the realisation of man's purposes--and this is the reason why it should be understood as a 'pragmatic' discipline.
Evaluation of Modified Essay Questions (MEQ) and Multiple Choice Questions (MCQ) as a tool for Assessing the Cognitive Skills of Undergraduate Medical Students

PubMed Central

Khan, Moeen-uz-Zafar; Aljarallah, Badr Muhammad

2011-01-01

Objectives: Developing and testing the cognitive skills and abstract thinking of undergraduate medical students are the main objectives of problem based learning. Modified Essay Questions (MEQ) and Multiple Choice Questions (MCQ) may both be designed to test these skills. The objectives of this study were to assess the effectiveness of both forms of questions in testing the different levels of the cognitive skills of undergraduate medical students and to detect any item writing flaws in the questions. Methods: A total of 50 MEQs and 50 MCQs were evaluated. These questions were chosen randomly from various examinations given to different batches of undergraduate medical students taking course MED 411–412 at the Department of Medicine, Qassim University from the years 2005 to 2009. The effectiveness of the questions was determined by two assessors and was defined by the question’s ability to measure higher cognitive skills, as determined by modified Bloom’s taxonomy, and its quality as determined by the presence of item writing flaws. ‘SPSS15’ and ‘Medcalc’ programs were used to tabulate and analyze the data. Results: The percentage of questions testing the level III (problem solving) cognitive skills of the students was 40% for MEQs and 60% for the MCQs; the remaining questions merely assessed the recall and comprehension. No significant difference was found between MEQ and MCQ in relation to the type of questions (recall; comprehension or problem solving x2 = 5.3, p = 0.07).The agreement between the two assessors was quite high in case of MCQ (kappa=0.609; SE 0.093; 95%CI 0.426 – 0.792) but lower in case of MEQ (kappa=0.195; SE 0.073; 95%CI 0.052 – 0.338). 16% of the MEQs and 12% of the MCQs had item writing flaws. Conclusion: A well constructed MCQ is superior to MEQ in testing the higher cognitive skills of undergraduate medical students in a problem based learning setup. Constructing an MEQ for assessing the cognitive skills of a student is not
A One-Day Dental Faculty Workshop in Writing Multiple-Choice Questions: An Impact Evaluation.

PubMed

AlFaris, Eiad; Naeem, Naghma; Irfan, Farhana; Qureshi, Riaz; Saad, Hussain; Al Sadhan, Ra'ed; Abdulghani, Hamza Mohammad; Van der Vleuten, Cees

2015-11-01

Long training workshops on the writing of exam questions have been shown to be effective; however, the effectiveness of short workshops needs to be demonstrated. The aim of this study was to evaluate the impact of a one-day, seven-hour faculty development workshop at the College of Dentistry, King Saud University, Saudi Arabia, on the quality of multiple-choice questions (MCQs). Kirkpatrick's four-level evaluation model was used. Participants' satisfaction (Kirkpatrick's Level 1) was evaluated with a post-workshop questionnaire. A quasi-experimental, randomized separate sample, pretest-posttest design was used to assess the learning effect (Kirkpatrick's Level 2). To evaluate transfer of learning to practice (Kirkpatrick's Level 3), MCQs created by ten faculty members as a result of the training were assessed. To assess Kirkpatrick's Level 4 regarding institutional change, interviews with three key leaders of the school were conducted, coded, and analyzed. A total of 72 course directors were invited to and attended some part of the workshop; all 52 who attended the entire workshop completed the satisfaction form; and 22 of the 36 participants in the experimental group completed the posttest. The results showed that all 52 participants were highly satisfied with the workshop, and significant positive changes were found in the faculty members' knowledge and the quality of their MCQs with effect sizes of 0.7 and 0.28, respectively. At the institutional level, the interviews demonstrated positive structural changes in the school's assessment system. Overall, this one-day item-writing faculty workshop resulted in positive changes at all four of Kirkpatrick's levels; these effects suggest that even a short training session can improve a dental school's assessment of its students.
Science Matters Podcast: Questions and Answers with EPA's Dr. Peter Grevatt

EPA Pesticide Factsheets

Listen to a podcast with Dr. Peter Grevatt, the director of EPA's Office of Children's Health Protection, as he answers questions about children's health, or read some of the highlights from the conversation here.
Multiple-Choice Question Tests: A Convenient, Flexible and Effective Learning Tool? A Case Study

ERIC Educational Resources Information Center

Douglas, Mercedes; Wilson, Juliette; Ennis, Sean

2012-01-01

The research presented in this paper is part of a project investigating assessment practices, funded by the Scottish Funding Council. Using established principles of good assessment and feedback, the use of online formative and summative multiple choice tests (MCT's) was piloted to support independent and self-directed learning and improve…
Answering Student Questions During Examinations: A Descriptive Study of Faculty Beliefs.

PubMed

Stillwell, Susan B; Krautscheid, Lorretta C

2016-01-01

Examinations are used to evaluate individual student learning. Therefore, fair and consistent administration practices are essential. One issue associated with testing administration practices includes whether or not students should be allowed to ask questions during exams and how faculty should respond. Findings from this descriptive study indicate that faculty believe answering questions disrupts the testing environment, inhibits effective monitoring of the testing environment, and could provide unfair hints to students who ask questions. Yet, faculty permit students to ask questions to clarify unclear wording, to provide definitions, and to appear receptive to student needs. Recommendations for nursing education and research are provided.
29 CFR 2509.75-5 - Questions and answers relating to fiduciary responsibility.

Code of Federal Regulations, 2011 CFR

2011-07-01

.... 2509.75-5 Section 2509.75-5 Labor Regulations Relating to Labor (Continued) EMPLOYEE BENEFITS SECURITY... SECURITY ACT OF 1974 § 2509.75-5 Questions and answers relating to fiduciary responsibility. On June 25, 1975, the Department of Labor issued an interpretive bulletin, ERISA IB 75-5, containing questions and...
Questions and Answers about Child Care: A Sloan Work and Family Research Network Fact Sheet

ERIC Educational Resources Information Center

Sloan Work and Family Research Network, 2008

2008-01-01

The Sloan Work and Family Research Network has prepared Fact Sheets that provide statistical answers to some important questions about work-family and work-life issues. This Fact Sheet includes statistics about Child Care, and answers the following questions about child care: (1) How many children are in child care?; (2) How many hours per week do…
76 FR 4360 - Draft Guidance for Industry: Questions and Answers Regarding Implementation of the Menu Labeling...

Federal Register 2010, 2011, 2012, 2013, 2014

2011-01-25

...] Draft Guidance for Industry: Questions and Answers Regarding Implementation of the Menu Labeling...: Questions and Answers Regarding Implementation of the Menu Labeling Provisions of Section 4205 of the... Implementation of the Menu Labeling Provisions of Section 4205 of the Patient Protection and Affordable Care Act...

Application of Item Analysis to Assess Multiple-Choice Examinations in the Mississippi Master Cattle Producer Program

ERIC Educational Resources Information Center

Parish, Jane A.; Karisch, Brandi B.

2013-01-01

Item analysis can serve as a useful tool in improving multiple-choice questions used in Extension programming. It can identify gaps between instruction and assessment. An item analysis of Mississippi Master Cattle Producer program multiple-choice examination responses was performed to determine the difficulty of individual examinations, assess the…
Questions and Answers on Unfair Labor Practices. A Practitioner's Guide.

ERIC Educational Resources Information Center

Indiana Univ., Bloomington. Midwest Center for Public Sector Labor Relations.

An unfair labor practice is the violation of any right granted employees, unions, or employers by a collective bargaining law. This guide answers common questions about unfair labor practices in public sector labor relations. The booklet is divided into two sections, unfair employer labor practices and unfair union labor practices. The section…
The Use of a Comprehensive Multiple Choice Final Exam in the Macroeconomics Principles Course: An Assessment.

ERIC Educational Resources Information Center

Petrowsky, Michael C.

This paper analyzes the results of a pilot study at Glendale Community College (Arizona) to assess the effectiveness of a comprehensive multiple choice final exam in the macroeconomic principles course. The "pilot project" involved the administration of a 50-question multiple choice exam to 71 students in three macroeconomics sections.…
Toward automated classification of consumers' cancer-related questions with a new taxonomy of expected answer types.

PubMed

McRoy, Susan; Jones, Sean; Kurmally, Adam

2016-09-01

This article examines methods for automated question classification applied to cancer-related questions that people have asked on the web. This work is part of a broader effort to provide automated question answering for health education. We created a new corpus of consumer-health questions related to cancer and a new taxonomy for those questions. We then compared the effectiveness of different statistical methods for developing classifiers, including weighted classification and resampling. Basic methods for building classifiers were limited by the high variability in the natural distribution of questions and typical refinement approaches of feature selection and merging categories achieved only small improvements to classifier accuracy. Best performance was achieved using weighted classification and resampling methods, the latter yielding an accuracy of F1 = 0.963. Thus, it would appear that statistical classifiers can be trained on natural data, but only if natural distributions of classes are smoothed. Such classifiers would be useful for automated question answering, for enriching web-based content, or assisting clinical professionals to answer questions. © The Author(s) 2015.
A Case Study on Multiple-Choice Testing in Anatomical Sciences

ERIC Educational Resources Information Center

Golda, Stephanie DuPont

2011-01-01

Objective testing techniques, such as multiple-choice examinations, are a widely accepted method of assessment in gross anatomy. In order to deter cheating on these types of examinations, instructors often design several versions of an examination to distribute. These versions usually involve the rearrangement of questions and their corresponding…
An assessment of functioning and non-functioning distractors in multiple-choice questions: a descriptive analysis.

PubMed

Tarrant, Marie; Ware, James; Mohammed, Ahmed M

2009-07-07

Four- or five-option multiple choice questions (MCQs) are the standard in health-science disciplines, both on certification-level examinations and on in-house developed tests. Previous research has shown, however, that few MCQs have three or four functioning distractors. The purpose of this study was to investigate non-functioning distractors in teacher-developed tests in one nursing program in an English-language university in Hong Kong. Using item-analysis data, we assessed the proportion of non-functioning distractors on a sample of seven test papers administered to undergraduate nursing students. A total of 514 items were reviewed, including 2056 options (1542 distractors and 514 correct responses). Non-functioning options were defined as ones that were chosen by fewer than 5% of examinees and those with a positive option discrimination statistic. The proportion of items containing 0, 1, 2, and 3 functioning distractors was 12.3%, 34.8%, 39.1%, and 13.8% respectively. Overall, items contained an average of 1.54 (SD = 0.88) functioning distractors. Only 52.2% (n = 805) of all distractors were functioning effectively and 10.2% (n = 158) had a choice frequency of 0. Items with more functioning distractors were more difficult and more discriminating. The low frequency of items with three functioning distractors in the four-option items in this study suggests that teachers have difficulty developing plausible distractors for most MCQs. Test items should consist of as many options as is feasible given the item content and the number of plausible distractors; in most cases this would be three. Item analysis results can be used to identify and remove non-functioning distractors from MCQs that have been used in previous tests.
500 Questions and Answers for New Teachers: A Survival Guide.

ERIC Educational Resources Information Center

Torreano, Joanna Montagna

This book presents tips, in the form of questions and answers, to help beginning teachers feel less isolated. There are six sections. "Getting Your Act Together" includes "What To Do Before School Opens"; "The First Day of School"; "Open House"; "Goal Setting"; and "Last Day of School.""Getting To Know You" includes "Administrators"; "Board of…
Infectious Mononucleosis in Active Patients: Definitive Answers to Common Questions.

ERIC Educational Resources Information Center

Auwaerter, Paul G.

2002-01-01

Describes infectious mononucleosis (IM), examining viral transmission and infection, clinical features, diagnosis, and management. Focuses on answers to several commonly asked questions about IM in sport (e.g., when it is safe to resume sports after IM, how often fatigue or depression are related to earlier bouts of IM, and how often IM is…
41 CFR 300-2.21 - How is the rule expressed in the question and answer format?

Code of Federal Regulations, 2010 CFR

2010-07-01

... 41 Public Contracts and Property Management 4 2010-07-01 2010-07-01 false How is the rule expressed in the question and answer format? 300-2.21 Section 300-2.21 Public Contracts and Property Management Federal Travel Regulation System GENERAL INTRODUCTION 2-HOW TO USE THE FTR Question & Answer...
Can Simply Answering Research Questions Change Behaviour? Systematic Review and Meta Analyses of Brief Alcohol Intervention Trials

PubMed Central

McCambridge, Jim; Kypri, Kypros

2011-01-01

Background Participant reports of their own behaviour are critical for the provision and evaluation of behavioural interventions. Recent developments in brief alcohol intervention trials provide an opportunity to evaluate longstanding concerns that answering questions on behaviour as part of research assessments may inadvertently influence it and produce bias. The study objective was to evaluate the size and nature of effects observed in randomized manipulations of the effects of answering questions on drinking behaviour in brief intervention trials. Methodology/Principal Findings Multiple methods were used to identify primary studies. Between-group differences in total weekly alcohol consumption, quantity per drinking day and AUDIT scores were evaluated in random effects meta-analyses. Ten trials were included in this review, of which two did not provide findings for quantitative study, in which three outcomes were evaluated. Between-group differences were of the magnitude of 13.7 (−0.17 to 27.6) grams of alcohol per week (approximately 1.5 U.K. units or 1 standard U.S. drink) and 1 point (0.1 to 1.9) in AUDIT score. There was no difference in quantity per drinking day. Conclusions/Significance Answering questions on drinking in brief intervention trials appears to alter subsequent self-reported behaviour. This potentially generates bias by exposing non-intervention control groups to an integral component of the intervention. The effects of brief alcohol interventions may thus have been consistently under-estimated. These findings are relevant to evaluations of any interventions to alter behaviours which involve participant self-report. PMID:21998626
Using Written-Answer Questions To Complement Numerical Problems. Case Study: A Separation Processes Course.

ERIC Educational Resources Information Center

Iveson, Simon M.

2002-01-01

Describes the process and outcome of including in assignments and examinations some questions requiring written answers along with traditional questions requiring only numerical calculations. Lists questions used in a chemical engineering course on separation processes along with sample responses from students. Student feedback indicates a…
Children's Ability to Answer Different Types of Questions

ERIC Educational Resources Information Center

Salomo, Dorothe; Lieven, Elena; Tomasello, Michael

2013-01-01

Young children answer many questions every day. The extent to which they do this in an adult-like way -- following Grice's Maxim of Quantity by providing the requested information, no more no less -- has been studied very little. In an experiment, we found that two-, three- and four-year-old children are quite skilled at answering…
Step by Step: Biology Undergraduates’ Problem-Solving Procedures during Multiple-Choice Assessment

PubMed Central

Prevost, Luanna B.; Lemons, Paula P.

2016-01-01

This study uses the theoretical framework of domain-specific problem solving to explore the procedures students use to solve multiple-choice problems about biology concepts. We designed several multiple-choice problems and administered them on four exams. We trained students to produce written descriptions of how they solved the problem, and this allowed us to systematically investigate their problem-solving procedures. We identified a range of procedures and organized them as domain general, domain specific, or hybrid. We also identified domain-general and domain-specific errors made by students during problem solving. We found that students use domain-general and hybrid procedures more frequently when solving lower-order problems than higher-order problems, while they use domain-specific procedures more frequently when solving higher-order problems. Additionally, the more domain-specific procedures students used, the higher the likelihood that they would answer the problem correctly, up to five procedures. However, if students used just one domain-general procedure, they were as likely to answer the problem correctly as if they had used two to five domain-general procedures. Our findings provide a categorization scheme and framework for additional research on biology problem solving and suggest several important implications for researchers and instructors. PMID:27909021
Comparing Assessments of Students' Knowledge by Computerized Open-Ended and Multiple-Choice Tests.

ERIC Educational Resources Information Center

Anbar, Michael

1991-01-01

Interactive computerized tests accepting unrestricted natural-language input were used to assess knowledge of clinical biophysics at the State University of New York at Buffalo. Comparison of responses to open-ended sequential questions and multiple-choice questions on the same material found the two formats test different aspects of competence.…
Examining the Impact of Question Surface Features on Students’ Answers to Constructed-Response Questions on Photosynthesis

PubMed Central

Weston, Michele; Haudek, Kevin C.; Prevost, Luanna; Urban-Lurain, Mark; Merrill, John

2015-01-01

One challenge in science education assessment is that students often focus on surface features of questions rather than the underlying scientific principles. We investigated how student written responses to constructed-response questions about photosynthesis vary based on two surface features of the question: the species of plant and the order of two question prompts. We asked four versions of the question with different combinations of the two plant species and order of prompts in an introductory cell biology course. We found that there was not a significant difference in the content of student responses to versions of the question stem with different species or order of prompts, using both computerized lexical analysis and expert scoring. We conducted 20 face-to-face interviews with students to further probe the effects of question wording on student responses. During the interviews, we found that students thought that the plant species was neither relevant nor confusing when answering the question. Students identified the prompts as both relevant and confusing. However, this confusion was not specific to a single version. PMID:25999312
The new history of psychology II: Some (different) answers to Watrin's four questions.

PubMed

Brock, Adrian C

2017-05-01

This article is mainly a response to the article by João Paulo Watrin, "The Ambiguous 'New History of Psychology': Some New Questions to Brock (2017)" (Watrin, 2017), which was itself a reply to my article, "The New History of Psychology: Some (Different) Answers to Lovett's Five Questions" (Brock, 2017). Watrin (2017) suggested that previous writers have conflated the terms "critical history" and "new history." They are said to differ, in that although the former is merely a name for a loose collection of approaches to the history of psychology, the latter involves rhetoric about the historiographical commitments of critical history. He also disputed the validity of the distinction between "old" and "new" history. I suggest that he is wrong on all these points. Watrin then poses and answers four rhetorical questions on Whig history, textbooks, critical thinking, and ad hominem arguments, and I provide alternative answers to all of them. After suggesting that our different views can be attributed to different agendas, I conclude with some reflections on how professional historians and psychologists can work together. (PsycINFO Database Record (c) 2017 APA, all rights reserved).
The National Stream Quality Accounting Network (NASQAN) - Some questions and answers

USGS Publications Warehouse

Ficke, John F.; Hawkinson, Richard O.

1975-01-01

One of the major new efforts of the U.S. Geological Survey is the National Stream Quality Accounting Network (NASQAN). This circular is intended to answer some of the frequently asked questions concerning concepts used in establishing NASQAN, its purposes, design, value, and future plans.
How do primary care physicians seek answers to clinical questions? A literature review.

PubMed

Coumou, Herma C H; Meijman, Frans J

2006-01-01

The authors investigated the extent to which changes occurred between 1992 and 2005 in the ways that primary care physicians seek answers to clinical problems. What search strategies are used? How much time is spent on them? How do primary care physicians evaluate various search activities and information sources? Can a clinical librarian be useful to a primary care physician? Twenty-one original research papers and three literature reviews were examined. No systematic reviews were identified. Primary care physicians seek answers to only a limited number of questions about which they first consult colleagues and paper sources. This practice has basically not changed over the years despite the enormous increase in and better accessibility to electronic information sources. One of the major obstacles is the time it takes to search for information. Other difficulties primary care physicians experience are related to formulating an appropriate search question, finding an optimal search strategy, and interpreting the evidence found. Some studies have been done on the supporting role of a clinical librarian in general practice. However, the effects on professional behavior of the primary care physician and on patient outcome have not been studied. A small group of primary care physicians prefer this support to developing their own search skills. Primary care physicians have several options for finding quick answers: building a question-and-answer database, consulting filtered information sources, or using an intermediary such as a clinical librarian.
How do primary care physicians seek answers to clinical questions? A literature review

PubMed Central

Coumou, Herma C. H.; Meijman, Frans J.

2006-01-01

Objectives: The authors investigated the extent to which changes occurred between 1992 and 2005 in the ways that primary care physicians seek answers to clinical problems. What search strategies are used? How much time is spent on them? How do primary care physicians evaluate various search activities and information sources? Can a clinical librarian be useful to a primary care physician? Methods: Twenty-one original research papers and three literature reviews were examined. No systematic reviews were identified. Results: Primary care physicians seek answers to only a limited number of questions about which they first consult colleagues and paper sources. This practice has basically not changed over the years despite the enormous increase in and better accessibility to electronic information sources. One of the major obstacles is the time it takes to search for information. Other difficulties primary care physicians experience are related to formulating an appropriate search question, finding an optimal search strategy, and interpreting the evidence found. Some studies have been done on the supporting role of a clinical librarian in general practice. However, the effects on professional behavior of the primary care physician and on patient outcome have not been studied. A small group of primary care physicians prefer this support to developing their own search skills. Discussion: Primary care physicians have several options for finding quick answers: building a question-and-answer database, consulting filtered information sources, or using an intermediary such as a clinical librarian. PMID:16404470
Using a Fine-Grained Multiple-Choice Response Format in Educational Drill-and-Practice Video Games

ERIC Educational Resources Information Center

Beserra, Vagner; Nussbaum, Miguel; Grass, Antonio

2017-01-01

When using educational video games, particularly drill-and-practice video games, there are several ways of providing an answer to a quiz. The majority of paper-based options can be classified as being either multiple-choice or constructed-response. Therefore, in the process of creating an educational drill-and-practice video game, one fundamental…

Use of Feedback-Oriented Online Exercises to Help Physiology Students Construct Well-Organized Answers to Short-Answer Questions

ERIC Educational Resources Information Center

Carnegie, Jacqueline

2015-01-01

Postsecondary education often requires students to use higher-order cognitive skills (HOCS) such as analysis, evaluation, and creation as they assess situations and apply what they have learned during lecture to the formulation of solutions. Summative assessment of these abilities is often accomplished using short-answer questions (SAQs). Quandary…
Benford’s Law: Textbook Exercises and Multiple-Choice Testbanks

PubMed Central

Slepkov, Aaron D.; Ironside, Kevin B.; DiBattista, David

2015-01-01

Benford’s Law describes the finding that the distribution of leading (or leftmost) digits of innumerable datasets follows a well-defined logarithmic trend, rather than an intuitive uniformity. In practice this means that the most common leading digit is 1, with an expected frequency of 30.1%, and the least common is 9, with an expected frequency of 4.6%. Currently, the most common application of Benford’s Law is in detecting number invention and tampering such as found in accounting-, tax-, and voter-fraud. We demonstrate that answers to end-of-chapter exercises in physics and chemistry textbooks conform to Benford’s Law. Subsequently, we investigate whether this fact can be used to gain advantage over random guessing in multiple-choice tests, and find that while testbank answers in introductory physics closely conform to Benford’s Law, the testbank is nonetheless secure against such a Benford’s attack for banal reasons. PMID:25689468
Questions and Answers for Reporting for the 2006 Partial Updating of the TSCA Chemical Inventory Database: Inorganic Chemicals Addendum

EPA Pesticide Factsheets

This document addresses specific questions related to reporting inorganic chemicals under the IUR and is an addendum to the Questions and Answers for Reporting for the 2006 Partial Updating of the TSCA Chemical Inventory Database (Questions and Answers Document).
Frequently Asked Questions about ADHD and the Answers from the Internet.

ERIC Educational Resources Information Center

Loechler, Kathy

1999-01-01

Identifies useful Internet sites about attention-deficit hyperactivity disorder (ADHD) and the results of searching these sites to answer common questions concerning incidence of ADHD, basic information about Ritalin drug therapy, educational placement of students with ADHD, sources of information about special needs, and what parents can do at…
Using and Developing with CD-Interactive: Frequently Asked Questions Are Answered.

ERIC Educational Resources Information Center

Lediaev, Lucy; van Sonderen, Lex

1994-01-01

Discusses Compact Disc-Interactive (CD-I) using a question-and-answer format. Highlights include development of the CD-I technology; where to purchase discs and players; compatibility with other CD-ROM drives; how to make discs; authoring systems versus custom programs; entertainment and educational applications; licensing issues; specifications;…
15 CFR Supplement No. 1 to Part 734 - Questions and Answers-Technology and Software Subject to the EAR

Code of Federal Regulations, 2010 CFR

2010-01-01

... 15 Commerce and Foreign Trade 2 2010-01-01 2010-01-01 false Questions and Answers-Technology and... Supplement No. 1 to Part 734—Questions and Answers—Technology and Software Subject to the EAR This Supplement No. 1 contains explanatory questions and answers relating to technology and software that is subject...
Have the Answers to Common Legal Questions Concerning Nutrition Support Changed Over the Past Decade? 10 Questions for 10 Years.

PubMed

Barrocas, Albert; Cohen, Michael L

2016-06-01

Clinical nutrition specialists (CNSs) are often confronted with technological, ethical, and legal questions, that is, what can be done technologically, what should be done ethically, and what must be done legally, which conflict at times. The conflict represents a "troubling trichotomy" as discussed in the lead article of this issue of Nutrition in Clinical Practice (NCP). During Clinical Nutrition Week in 2006, a symposium covering these 3 topics was presented, and later that year, an article covering the same topic was published in NCP In this article, we revisit several legal questions/issues that were raised 10 years ago and discuss current answers and approaches. Some of the answers remain unchanged. Other answers have been modified by additional legislation, court decisions, or regulations. In addition, new questions/issues have arisen. Some of the most common questions regarding nutrition support involve the following: liability, informed consent, medical decisional incapacity vs legal competence, advance directive specificity, surrogate decision making, physician orders for life-sustaining treatment and electronic medical orders for life-sustaining treatment, legal definition of death, patient vs family decision making, the noncompliant patient, and elder abuse obligations. In the current healthcare environment, these questions and issues are best addressed via a transdisciplinary team that focuses on function rather than form. The CNS can play a pivotal role in dealing with these challenges by applying the acronym ACT: being Accountable and Communicating with all stakeholders while actively participating as an integral part of the transdisciplinary Team. © 2016 American Society for Parenteral and Enteral Nutrition.
Measuring the Consistency in Change in Hepatitis B Knowledge among Three Different Types of Tests: True/False, Multiple Choice, and Fill in the Blanks Tests.

ERIC Educational Resources Information Center

Sahai, Vic; Demeyere, Petra; Poirier, Sheila; Piro, Felice

1998-01-01

The recall of information about Hepatitis B demonstrated by 180 seventh graders was tested with three test types: (1) short-answer; (2) true/false; and (3) multiple-choice. Short answer testing was the most reliable. Suggestions are made for the use of short-answer tests in evaluating student knowledge. (SLD)
Social Question and Answer Services versus Library Virtual Reference: Evaluation and Comparison from the Users' Perspective

ERIC Educational Resources Information Center

Zhang, Yin; Deng, Shengli

2014-01-01

Introduction: In recent years, the introduction of social question and answer services and other Internet tools have expanded the ways in which people have their questions answered. There has been speculation and debate over whether such services and other Internet tools are replacing library virtual reference services. Method: Most previous…
AGU Climate Scientists Offer Question-and-Answer Service for Media

NASA Astrophysics Data System (ADS)

Jackson, Stacy

2010-03-01

In fall 2009, AGU launched a member-driven pilot project to improve the accuracy of climate science coverage in the media and to improve public understanding of climate science. The project's goal was to increase the accessibility of climate science experts to journalists across the full spectrum of media outlets. As a supplement to the traditional one-to-one journalist-expert relationship model, the project tested the novel approach of providing a question-and-answer (Q&A) service with a pool of expert scientists and a Web-based interface with journalists. Questions were explicitly limited to climate science to maintain a nonadvocacy, nonpartisan perspective.
The Answering System to Yes-No Truth-Functional Questions in Korean-English Bilingual Children

ERIC Educational Resources Information Center

Choi, Hansook

2014-01-01

This study presents an experiment that explores the patterns of answers to yes-no truth-functional questions in English and Korean. The answering patterns are examined from 12 Korean-English bilingual children and 10 Korean-monolingual children. Four types of sentences in relation to given situations (Wason in "Br J Psychol" 52:133-142,…
Interpretation of Genomic Data Questions and Answers

PubMed Central

Simon, Richard

2008-01-01

Using a question and answer format we describe important aspects of using genomic technologies in cancer research. The main challenges are not managing the mass of data, but rather the design, analysis and accurate reporting of studies that result in increased biological knowledge and medical utility. Many analysis issues address the use of expression microarrays but are also applicable to other whole genome assays. Microarray based clinical investigations have generated both unrealistic hyperbole and excessive skepticism. Genomic technologies are tremendously powerful and will play instrumental roles in elucidating the mechanisms of oncogenesis and in devlopingan era of predictive medicine in which treatments are tailored to individual tumors. Achieving these goals involves challenges in re-thinking many paradigms for the conduct of basic and clinical cancer research and for the organization of interdisciplinary collaboration. PMID:18582627
Practical question-and-answer guide on VDTS (video display terminals) for BEES (base bioenvironmental engineer). Final report

DOE Office of Scientific and Technical Information (OSTI.GOV)

Olson, B.M.

1985-01-01

The USAF OEHL conducted an extensive literature review of Video Display Terminals (VDTs) and the health problems commonly associated with them. The report is presented in a question-and-answer format in an attempt to paraphrase the most commonly asked questions about VDTs that are forwarded to USAF OEHL/RZN. The questions and answers have been divided into several topic areas: Ionizing Radiation; Nonionizing Radiation; Optical Radiation; Ultrasound; Static Electricity; Health Complaints/Ergonomics; Pregnancy.
An Experimental Remote Question-Answer Scan Television and Student Evaluation System.

ERIC Educational Resources Information Center

Rigas, Anthony L.

Presented is a description of the development and use of a technical system designed to provide students (in this case, engineering students) situated at remote sites a means for better interaction with their instructors. For example, students at such sites cannot get their immediate questions answered because of the physical location of their…
Identification of technical item flaws leads to improvement of the quality of single best Multiple Choice Questions.

PubMed

Fayyaz Khan, Humaira; Farooq Danish, Khalid; Saeed Awan, Azra; Anwar, Masood

2013-05-01

The purpose of the study was to identify technical item flaws in the multiple choice questions submitted for the final exams for the years 2009, 2010 and 2011. This descriptive analytical study was carried out in Islamic International Medical College (IIMC). The Data was collected from the MCQ's submitted by the faculty for the final exams for the year 2009, 2010 and 2011. The data was compiled and evaluated by a three member assessment committee. The data was analyzed for frequency and percentages the categorical data was analyzed by chi-square test. Overall percentage of flawed item was 67% for the year 2009 of which 21% were for testwiseness and 40% were for irrelevant difficulty. In year 2010 the total item flaws were 36% and 11% testwiseness and 22% were for irrelevant difficulty. The year 2011 data showed decreased overall flaws of 21%. The flaws of testwisness were 7%, irrelevant difficulty were 11%. Technical item flaws are frequently encountered during MCQ construction, and the identification of flaws leads to improved quality of the single best MCQ's.
Verbal Paradata and Survey Error: Respondent Speech, Voice, and Question-Answering Behavior Can Predict Income Item Nonresponse

ERIC Educational Resources Information Center

Jans, Matthew E.

2010-01-01

Income nonresponse is a significant problem in survey data, with rates as high as 50%, yet we know little about why it occurs. It is plausible that the way respondents answer survey questions (e.g., their voice and speech characteristics, and their question- answering behavior) can predict whether they will provide income data, and will reflect…
Polytomous versus Dichotomous Scoring on Multiple-Choice Examinations: Development of a Rubric for Rating Partial Credit

ERIC Educational Resources Information Center

Grunert, Megan L.; Raker, Jeffrey R.; Murphy, Kristen L.; Holme, Thomas A.

2013-01-01

The concept of assigning partial credit on multiple-choice test items is considered for items from ACS Exams. Because the items on these exams, particularly the quantitative items, use common student errors to define incorrect answers, it is possible to assign partial credits to some of these incorrect responses. To do so, however, it becomes…
Long-term follow-up of echolalia and question answering.

PubMed

Foxx, R M; Faw, G D

1990-01-01

A long-term follow-up of echolalia and correct question answering was conducted for 6 subjects from three previously published studies. The follow-up periods ranged from 26 to 57 months. In a training site follow-up, subjects were exposed to baseline/posttraining conditions in which the original trainer and/or a novel person(s) presented trained and untrained questions. Four subjects displayed echolalia below baseline levels, and another did so in some assessments. Overall, echolalia was lower than in baseline in 80.6% of the follow-ups. Five subjects displayed correct responding above baseline levels. No clear differences were noted in correct responding or echolalia between the trainer and novel-person presentations or between trained and untrained questions. In a follow-up in a natural environment conducted by a novel person, lower than baseline levels of echolalia were displayed by 3 subjects; 2 subjects displayed lower than baseline levels in some assessments. Two subjects consistently displayed correct responding above baseline, and 3 did so occasionally. Issues related to the study of maintenance are discussed.
Long-term follow-up of echolalia and question answering.

PubMed Central

Foxx, R M; Faw, G D

1990-01-01

A long-term follow-up of echolalia and correct question answering was conducted for 6 subjects from three previously published studies. The follow-up periods ranged from 26 to 57 months. In a training site follow-up, subjects were exposed to baseline/posttraining conditions in which the original trainer and/or a novel person(s) presented trained and untrained questions. Four subjects displayed echolalia below baseline levels, and another did so in some assessments. Overall, echolalia was lower than in baseline in 80.6% of the follow-ups. Five subjects displayed correct responding above baseline levels. No clear differences were noted in correct responding or echolalia between the trainer and novel-person presentations or between trained and untrained questions. In a follow-up in a natural environment conducted by a novel person, lower than baseline levels of echolalia were displayed by 3 subjects; 2 subjects displayed lower than baseline levels in some assessments. Two subjects consistently displayed correct responding above baseline, and 3 did so occasionally. Issues related to the study of maintenance are discussed. PMID:2249974
Feedback-related brain activity predicts learning from feedback in multiple-choice testing.

PubMed

Ernst, Benjamin; Steinhauser, Marco

2012-06-01

Different event-related potentials (ERPs) have been shown to correlate with learning from feedback in decision-making tasks and with learning in explicit memory tasks. In the present study, we investigated which ERPs predict learning from corrective feedback in a multiple-choice test, which combines elements from both paradigms. Participants worked through sets of multiple-choice items of a Swahili-German vocabulary task. Whereas the initial presentation of an item required the participants to guess the answer, corrective feedback could be used to learn the correct response. Initial analyses revealed that corrective feedback elicited components related to reinforcement learning (FRN), as well as to explicit memory processing (P300) and attention (early frontal positivity). However, only the P300 and early frontal positivity were positively correlated with successful learning from corrective feedback, whereas the FRN was even larger when learning failed. These results suggest that learning from corrective feedback crucially relies on explicit memory processing and attentional orienting to corrective feedback, rather than on reinforcement learning.

Multiple choice answers: what to do when you have too many questions.

PubMed

Jupiter, Daniel C

2015-01-01

Carrying out too many statistical tests in a single study throws results into doubt, for reasons statistical and ethical. I discuss why this is the case and briefly mention ways to handle the problem. Copyright © 2015 American College of Foot and Ankle Surgeons. Published by Elsevier Inc. All rights reserved.
Comparison between three option, four option and five option multiple choice question tests for quality parameters: A randomized study.

PubMed

Vegada, Bhavisha; Shukla, Apexa; Khilnani, Ajeetkumar; Charan, Jaykaran; Desai, Chetna

2016-01-01

Most of the academic teachers use four or five options per item of multiple choice question (MCQ) test as formative and summative assessment. Optimal number of options in MCQ item is a matter of considerable debate among academic teachers of various educational fields. There is a scarcity of the published literature regarding the optimum number of option in each item of MCQ in the field of medical education. To compare three options, four options, and five options MCQs test for the quality parameters - reliability, validity, item analysis, distracter analysis, and time analysis. Participants were 3 rd semester M.B.B.S. students. Students were divided randomly into three groups. Each group was given one set of MCQ test out of three options, four options, and five option randomly. Following the marking of the multiple choice tests, the participants' option selections were analyzed and comparisons were conducted of the mean marks, mean time, validity, reliability and facility value, discrimination index, point biserial value, distracter analysis of three different option formats. Students score more ( P = 0.000) and took less time ( P = 0.009) for the completion of three options as compared to four options and five options groups. Facility value was more ( P = 0.004) in three options group as compared to four and five options groups. There was no significant difference between three groups for the validity, reliability, and item discrimination. Nonfunctioning distracters were more in the four and five options group as compared to three option group. Assessment based on three option MCQs is can be preferred over four option and five option MCQs.
Measuring the Benefits of Examinee-Selected Questions

ERIC Educational Resources Information Center

Allen, Nancy L.; Holland, Paul W.; Thayer, Dorothy T.

2005-01-01

Allowing students to choose the question(s) that they will answer from among several possible alternatives is often viewed as a mechanism for increasing fairness in certain types of assessments. The fairness of optional topic choice is not a universally accepted fact, however, and various studies have been done to assess this question. We examine…
The "Individualised Accounting Questions" Technique: Using Excel to Generate Quantitative Exercises for Large Classes with Unique Individual Answers

ERIC Educational Resources Information Center

Nnadi, Matthias; Rosser, Mike

2014-01-01

The "individualised accounting questions" (IAQ) technique set out in this paper encourages independent active learning. It enables tutors to set individualised accounting questions and construct an answer grid that can be used for any number of students, with numerical values for each student's answers based on their student enrolment…
Comparison between Long-Menu and Open-Ended Questions in computerized medical assessments. A randomized controlled trial

PubMed Central

Rotthoff, Thomas; Baehring, Thomas; Dicken, Hans-Dieter; Fahron, Urte; Richter, Bernd; Fischer, Martin R; Scherbaum, Werner A

2006-01-01

Background Long-menu questions (LMQs) are viewed as an alternative method for answering open-ended questions (OEQs) in computerized assessment. So far this question type and its influence on examination scores have not been studied sufficiently. However, the increasing use of computerized assessments will also lead to an increasing use of this question type. Using a summative online key feature (KF) examination we evaluated whether LMQs can be compared with OEQs in regard to the level of difficulty, performance and response times. We also evaluated the content for its suitability for LMQs. Methods We randomized 146 fourth year medical students into two groups. For the purpose of this study we created 7 peer-reviewed KF-cases with a total of 25 questions. All questions had the same content in both groups, but nine questions had a different answer type. Group A answered 9 questions with an LM type, group B with an OE type. In addition to the LM answer, group A could give an OE answer if the appropriate answer was not included in the list. Results The average number of correct answers for LMQs and OEQs showed no significant difference (p = 0.93). Among all 630 LM answers only one correct term (0.32%) was not included in the list of answers. The response time for LMQs did not significantly differ from that of OEQs (p = 0.65). Conclusion LMQs and OEQs do not differ significantly. Compared to standard multiple-choice questions (MCQs), the response time for LMQs and OEQs is longer. This is probably due to the fact that they require active problem solving skills and more practice. LMQs correspond more suitable to Short answer questions (SAQ) then to OEQ and should only be used when the answers can be clearly phrased, using only a few, precise synonyms. LMQs can decrease cueing effects and significantly simplify the scoring in computerized assessment. PMID:17032439
Legal Challenges and Pitfalls for Start-up Companies - 48 Common Questions and Answers.

PubMed

Staehelin, Matthias

2014-12-01

Transforming a business idea into reality requires a legal implementation plan. The following 48 questions and answers address key issues that typically arise in start-up situations. Early planning can help avoid costly mistakes.
Know Hepatitis B Questions and Answers for Asian Americans and Pacific Islanders (AAPIs)

MedlinePlus

... Campaign About our Partner Spread the Word Know Hepatitis B Questions and Answers Recommend on Facebook Tweet ... Overview Transmission Symptoms Testing Treatment Overview What is Hepatitis B? Hepatitis B is a liver disease. It ...
Language acquisition: hesitations in the question/answer dialogic pair.

PubMed

Chacon, Lourenço; Villega, Cristyane de Camargo Sampaio

2015-01-01

(1) To verify the existence (or not) of hesitation marks in the beginning of utterances in children's discourse; and (2) to determine to what extent the presence/absence of these marks could be explained by retrievable facts in the production conditions of their discourses. Interview situations with four children aged 5-6 years attending Kindergarten level II in a public preschool at the time of the data collection were analyzed. The interviews were recorded on audio and video, inside a soundproof booth, with high fidelity equipment. Afterwards, the recordings were transcribed by six transcribers that were specially trained for this task. Transcription rules that prioritized the analyses of hesitations were used. For the analysis of retrievable facts in the production conditions of children's discourse, the dialogic pair question-answer was adopted. A correlation between presence/absence of hesitation in the beginning of utterances in children and type of question (open/closed) made by the collocutor was observed. When the question was closed ended, the utterances were preferably initiated without hesitation marks, and when the question was open ended, the utterances were preferably initiated with hesitation marks. The presence/absence of hesitation marks in the beginning of utterances in children was found to be dependent on the production conditions of their discourses.
An online network tool for quality information to answer questions about occupational safety and health: usability and applicability.

PubMed

Rhebergen, Martijn D F; Hulshof, Carel T J; Lenderink, Annet F; van Dijk, Frank J H

2010-10-22

Common information facilities do not always provide the quality information needed to answer questions on health or health-related issues, such as Occupational Safety and Health (OSH) matters. Barriers may be the accessibility, quantity and readability of information. Online Question & Answer (Q&A) network tools, which link questioners directly to experts can overcome some of these barriers. When designing and testing online tools, assessing the usability and applicability is essential. Therefore, the purpose of this study is to assess the usability and applicability of a new online Q&A network tool for answers on OSH questions. We applied a cross-sectional usability test design. Eight occupational health experts and twelve potential questioners from the working population (workers) were purposively selected to include a variety of computer- and internet-experiences. During the test, participants were first observed while executing eight tasks that entailed important features of the tool. In addition, they were interviewed. Through task observations and interviews we assessed applicability, usability (effectiveness, efficiency and satisfaction) and facilitators and barriers in use. Most features were usable, though several could be improved. Most tasks were executed effectively. Some tasks, for example searching stored questions in categories, were not executed efficiently and participants were less satisfied with the corresponding features. Participants' recommendations led to improvements. The tool was found mostly applicable for additional information, to observe new OSH trends and to improve contact between OSH experts and workers. Hosting and support by a trustworthy professional organization, effective implementation campaigns, timely answering and anonymity were seen as important use requirements. This network tool is a promising new strategy for offering company workers high quality information to answer OSH questions. Q&A network tools can be an addition
Answer Changing in Testing Situations: The Role of Metacognition in Deciding Which Answers to Review

ERIC Educational Resources Information Center

Stylianou-Georgiou, Agni; Papanastasiou, Elena C.

2017-01-01

The purpose of our study was to examine the issue of answer changing in relation to students' abilities to monitor their behaviour accurately while responding to multiple-choice tests. The data for this study were obtained from the final examination administered to students in an educational psychology course. The results of the study indicate…
A deep learning approach for predicting the quality of online health expert question-answering services.

PubMed

Hu, Ze; Zhang, Zhan; Yang, Haiqin; Chen, Qing; Zuo, Decheng

2017-07-01

Recently, online health expert question-answering (HQA) services (systems) have attracted more and more health consumers to ask health-related questions everywhere at any time due to the convenience and effectiveness. However, the quality of answers in existing HQA systems varies in different situations. It is significant to provide effective tools to automatically determine the quality of the answers. Two main characteristics in HQA systems raise the difficulties of classification: (1) physicians' answers in an HQA system are usually written in short text, which yields the data sparsity issue; (2) HQA systems apply the quality control mechanism, which refrains the wisdom of crowd. The important information, such as the best answer and the number of users' votes, is missing. To tackle these issues, we prepare the first HQA research data set labeled by three medical experts in 90days and formulate the problem of predicting the quality of answers in the system as a classification task. We not only incorporate the standard textual feature of answers, but also introduce a set of unique non-textual features, i.e., the popular used surface linguistic features and the novel social features, from other modalities. A multimodal deep belief network (DBN)-based learning framework is then proposed to learn the high-level hidden semantic representations of answers from both textual features and non-textual features while the learned joint representation is fed into popular classifiers to determine the quality of answers. Finally, we conduct extensive experiments to demonstrate the effectiveness of including the non-textual features and the proposed multimodal deep learning framework. Copyright © 2017 Elsevier Inc. All rights reserved.
Do Melt Inclusions Answer Big Questions?

NASA Astrophysics Data System (ADS)

Hofmann, A. W.; Sobolev, A. V.

2009-12-01

In a pioneering paper, Sobolev and Shimizu (1993) demonstrated the existence of ultra-depleted melt inclusions in olivine phenocrysts in MORB. They interpreted these as evidence for the preservation of parental melts formed by progressive near-fractional melting. Subsequently many cases have been described where melt inclusions from single basalt samples display enormous chemical and isotopic heterogeneity. The interpretation of these observations hinges critically on whether such melt inclusions can faithfully preserve primary or parental melt composition. If they do, melt inclusion data can truly answer big questions from small-scale observations. If they do not, they answer rather small questions. Favoring the second possibility, Danyushevsky et al. (2004) have suggested that much of the observed variability of highly incompatible trace elements in melt inclusions “may not represent geologically significant melts, but instead reflect localized, grain-scale reaction processes within the magmatic plumbing system.” We disagree and show that this mechanism cannot, for example, explain isotopic heterogeneity measured in several suites of melt inclusions, nor does it not account for the presence of ultra-depleted melts and "ghost" plagioclase signatures in other inclusions. More recently, Spandler et al. (2007) have suggested on the basis of experimental evidence that diffusion rates for REE in olivine are so rapid that parental melt compositions in melt inclusions are rapidly falsified by diffusional exchange with (evolved) host lava. We show that the very fact that extreme chemical and isotopic heterogeneities are routinely preserved in melt inclusions demonstrates that this conclusion is unwarranted, either because residence times of the olivine phenocrysts are much shorter than assumed by Spandler et al. or because the high experimental diffusion rates are caused by an unknown experimental artifact. Although there is no obvious flaw in design and execution of
STS-114: Discovery Question & Answer with Joint Crew on ISS

NASA Technical Reports Server (NTRS)

2005-01-01

STS-114 Commander Eileen Collins, Pilot James Kelly, Mission Specialists Souichi Noguchi, Stephen Robinson, Charles Camarda, Andrew Thomas, Wendy Lawrence, and Expedition 11 Commander Sergei Krikalev and Flight Engineer John Phillips answers questions from United States, Japanese and Russian News media in the Destiny laboratory of the International Space Station. Risk, safety, extravehicular activities, spacewalks, re-entry, gap fillers, tiles, flight operations, flight crew activities, team work, and life in space are topics covered with the News media.
Formulating and Answering High-Impact Causal Questions in Physiologic Childbirth Science: Concepts and Assumptions.

PubMed

Snowden, Jonathan M; Tilden, Ellen L; Odden, Michelle C

2018-06-08

In this article, we conclude our 3-part series by focusing on several concepts that have proven useful for formulating causal questions and inferring causal effects. The process of causal inference is of key importance for physiologic childbirth science, so each concept is grounded in content related to women at low risk for perinatal complications. A prerequisite to causal inference is determining that the question of interest is causal rather than descriptive or predictive. Another critical step in defining a high-impact causal question is assessing the state of existing research for evidence of causality. We introduce 2 causal frameworks that are useful for this undertaking, Hill's causal considerations and the sufficient-component cause model. We then provide 3 steps to aid perinatal researchers in inferring causal effects in a given study. First, the researcher should formulate a rigorous and clear causal question. We introduce an example of epidural analgesia and labor progression to demonstrate this process, including the central role of temporality. Next, the researcher should assess the suitability of the given data set to answer this causal question. In randomized controlled trials, data are collected with the express purpose of answering the causal question. Investigators using observational data should also ensure that their chosen causal question is answerable with the available data. Finally, investigators should design an analysis plan that targets the causal question of interest. Some data structures (eg, time-dependent confounding by labor progress when estimating the effect of epidural analgesia on postpartum hemorrhage) require specific analytical tools to control for bias and estimate causal effects. The assumptions of consistency, exchangeability, and positivity may be especially useful in carrying out these steps. Drawing on appropriate causal concepts and considering relevant assumptions strengthens our confidence that research has reduced
On-Line Mathematics Assessment: The Impact of Mode on Performance and Question Answering Strategies

ERIC Educational Resources Information Center

Johnson, Martin; Green, Sylvia

2006-01-01

The transition from paper-based to computer-based assessment raises a number of important issues about how mode might affect children's performance and question answering strategies. In this project 104 eleven-year-olds were given two sets of matched mathematics questions, one set on-line and the other on paper. Facility values were analyzed to…
The Communication Skills Used by Deaf Children and Their Hearing Peers in a Question-and-Answer Game Context

ERIC Educational Resources Information Center

Toe, Dianne M.; Paatsch, Louise E.

2010-01-01

Communication is frequently characterized by a sequence of questions and answers. Little is known about how well students who are deaf or hard of hearing (deaf/HH) understand their hearing classmates in the context of an inclusive setting. This study explored the communication skills used by deaf/HH children when asking and answering questions in…
Automatic Classification of Question & Answer Discourse Segments from Teacher's Speech in Classrooms

ERIC Educational Resources Information Center

Blanchard, Nathaniel; D'Mello, Sidney; Olney, Andrew M.; Nystrand, Martin

2015-01-01

Question-answer (Q&A) is fundamental for dialogic instruction, an important pedagogical technique based on the free exchange of ideas and open-ended discussion. Automatically detecting Q&A is key to providing teachers with feedback on appropriate use of dialogic instructional strategies. In line with this, this paper studies the…
Second Language Reading Topic Familiarity and Test Score: Test-Taking Strategies for Multiple-Choice Comprehension Questions

ERIC Educational Resources Information Center

Lee, Jia-Ying

2011-01-01

The main purpose of this study was to compare the strategies used by Chinese-speaking students when confronted with familiar versus unfamiliar topics in a multiple-choice format reading comprehension test. The focus was on describing what students do when they are taking reading comprehension tests by asking students to verbalize their thoughts.…
The Family and Medical Leave Act: Questions and Answers for the Academic Community.

ERIC Educational Resources Information Center

Euben, Donna R.; Thornton, Saranna R.

2002-01-01

Provides excerpts from a guide written by the American Association of University Professors (AAUP) concerning the Family and Medical Leave Act. Offers advice using a question-and-answer format on the application of the legislation to different situations. (EV)
The new history of psychology: Some (different) answers to Lovett's five questions.

PubMed

Brock, Adrian C

2017-05-01

[Correction Notice: An Erratum for this article was reported in Vol 20(2) of History of Psychology (see record 2016-53552-001). In this article there was an error in the 11th paragraph of the Lovett's Five Questions for the New Historians section. The conference paper "The "new" history of science: Implications for philosophy of science" by Rachel Laudan (1992) was wrongly attributed to her husband, Larry Laudan. All versions of this article have been corrected.] The professionalization of the history of psychology from the 1960s led to significant changes in the way that history was written. Several authors tried to summarize these changes in the 1980s, and Laurel Furumoto's (1989) G. Stanley Hall lecture, "The new history of psychology" is the best-known example of this genre. This journal published a critique of the new history by Benjamin R. Lovett (2006) with the title, "The new history of psychology: A review and critique," and it is still being cited as an authoritative source. The article consists of 3 parts. First, the author attempts to show that the new history is not as different from the old as its proponents claim. He then discusses some problems that he considers to be unique to the new history, and he presents them in the form of 5 questions for the new historians, which he then goes on to answer himself. Finally, he discusses the problematic relationship between critical history and psychology. This article is a reply to Lovett's article. The author argues that the new history is different from the old in every way that Lovett claims that it is not. It critically analyzes Lovett's answers to his own 5 questions and offers some alternative answers to these questions. It also suggests that many psychologist-historians are opposed to new history of psychology, especially in its critical versions, and that this explains why Lovett's article has been uncritically received. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

Multiple-Choice Testing Using Immediate Feedback--Assessment Technique (IF AT®) Forms: Second-Chance Guessing vs. Second-Chance Learning?

ERIC Educational Resources Information Center

Merrel, Jeremy D.; Cirillo, Pier F.; Schwartz, Pauline M.; Webb, Jeffrey A.

2015-01-01

Multiple choice testing is a common but often ineffective method for evaluating learning. A newer approach, however, using Immediate Feedback Assessment Technique (IF AT®, Epstein Educational Enterprise, Inc.) forms, offers several advantages. In particular, a student learns immediately if his or her answer is correct and, in the case of an…
Paper and Other Web Coating National Emission Standards for Hazardous Air Pollutants (NESHAP) Questions and Answers

EPA Pesticide Factsheets

This May 2003 document contains questions and answers on the Paper and Web Coating National Emission Standards for Hazardous Air Pollutants (NESHAP) regulation. The questions cover topics such as compliance, applicability, and initial notification.
Using the Weighted Keyword Model to Improve Information Retrieval for Answering Biomedical Questions

PubMed Central

Yu, Hong; Cao, Yong-gang

2009-01-01

Physicians ask many complex questions during the patient encounter. Information retrieval systems that can provide immediate and relevant answers to these questions can be invaluable aids to the practice of evidence-based medicine. In this study, we first automatically identify topic keywords from ad hoc clinical questions with a Condition Random Field model that is trained over thousands of manually annotated clinical questions. We then report on a linear model that assigns query weights based on their automatically identified semantic roles: topic keywords, domain specific terms, and their synonyms. Our evaluation shows that this weighted keyword model improves information retrieval from the Text Retrieval Conference Genomics track data. PMID:21347188
Using the weighted keyword model to improve information retrieval for answering biomedical questions.

PubMed

Yu, Hong; Cao, Yong-Gang

2009-03-01

Physicians ask many complex questions during the patient encounter. Information retrieval systems that can provide immediate and relevant answers to these questions can be invaluable aids to the practice of evidence-based medicine. In this study, we first automatically identify topic keywords from ad hoc clinical questions with a Condition Random Field model that is trained over thousands of manually annotated clinical questions. We then report on a linear model that assigns query weights based on their automatically identified semantic roles: topic keywords, domain specific terms, and their synonyms. Our evaluation shows that this weighted keyword model improves information retrieval from the Text Retrieval Conference Genomics track data.
Searching for answers to clinical questions using google versus evidence-based summary resources: a randomized controlled crossover study.

PubMed

Kim, Sarang; Noveck, Helaine; Galt, James; Hogshire, Lauren; Willett, Laura; O'Rourke, Kerry

2014-06-01

To compare the speed and accuracy of answering clinical questions using Google versus summary resources. In 2011 and 2012, 48 internal medicine interns from two classes at Rutgers University Robert Wood Johnson Medical School, who had been trained to use three evidence-based summary resources, performed four-minute computer searches to answer 10 clinical questions. Half were randomized to initiate searches for answers to questions 1 to 5 using Google; the other half initiated searches using a summary resource. They then crossed over and used the other resource for questions 6 to 10. They documented the time spent searching and the resource where the answer was found. Time to correct response and percentage of correct responses were compared between groups using t test and general estimating equations. Of 480 questions administered, interns found answers for 393 (82%). Interns initiating searches in Google used a wider variety of resources than those starting with summary resources. No significant difference was found in mean time to correct response (138.5 seconds for Google versus 136.1 seconds for summary resource; P = .72). Mean correct response rate was 58.4% for Google versus 61.5% for summary resource (mean difference -3.1%; 95% CI -10.3% to 4.2%; P = .40). The authors found no significant differences in speed or accuracy between searches initiated using Google versus summary resources. Although summary resources are considered to provide the highest quality of evidence, improvements to allow for better speed and accuracy are needed.
Americans with Disabilities Act (ADA). Title 1--Employment. Questions & Answers for Employees.

ERIC Educational Resources Information Center

American Association of Retired Persons, Washington, DC.

This guide provides information on Title I of the Americans with Disabilities Act (ADA) in a question-and-answer format for employees. The guide covers such topics as the following: which employers must comply; what employment practices and activities are covered; who is protected against employment discrimination; definitions of a person with a…
Let's Talk About Food. Answers to your Questions About Foods and Nutrition.

ERIC Educational Resources Information Center

White, Philip L., Ed.; Selvey, Nancy, Ed.

This book on the subject of nutrition is written in the form of often-asked questions and detailed, informative answers. In ten chapters the following range of nutrition topics is covered: (1) meaning of RDA, nutrition labeling, calorie tables, nutrient density; (2) adequate diet, pregnancy, physical fitness, vitamins, diet for athletes, baby…
26 CFR 1.416-1 - Questions and answers on top-heavy plans.

Code of Federal Regulations, 2012 CFR

2012-04-01

..., employers under common control or affiliated service group. A partner of a partnership will not be treated... employees, former key employees, and non-key employees. (b) All employers that are aggregated under section... as key employees, as former key employees, or as non-key employees. See Question and Answer T-12 for...
26 CFR 1.416-1 - Questions and answers on top-heavy plans.

Code of Federal Regulations, 2010 CFR

2010-04-01

..., employers under common control or affiliated service group. A partner of a partnership will not be treated... employees, former key employees, and non-key employees. (b) All employers that are aggregated under section... as key employees, as former key employees, or as non-key employees. See Question and Answer T-12 for...
Answering questions at the point of care: do residents practice EBM or manage information sources?

PubMed

McCord, Gary; Smucker, William D; Selius, Brian A; Hannan, Scott; Davidson, Elliot; Schrop, Susan Labuda; Rao, Vinod; Albrecht, Paula

2007-03-01

To determine the types of information sources that evidence-based medicine (EBM)-trained, family medicine residents use to answer clinical questions at the point of care, to assess whether the sources are evidence-based, and to provide suggestions for more effective information-management strategies in residency training. In 2005, trained medical students directly observed (for two half-days per physician) how 25 third-year family medicine residents retrieved information to answer clinical questions arising at the point of care and documented the type and name of each source, the retrieval location, and the estimated time spent consulting the source. An end-of-study questionnaire asked 37 full-time faculty and the participating residents about the best information sources available, subscriptions owned, why they use a personal digital assistant (PDA) to practice medicine, and their experience in preventing medical errors using a PDA. Forty-four percent of questions were answered by attending physicians, 23% by consulting PDAs, and 20% from books. Seventy-two percent of questions were answered within two minutes. Residents rated UptoDate as the best source for evidence-based information, but they used this source only five times. PDAs were used because of ease of use, time factors, and accessibility. All examples of medical errors discovered or prevented with PDA programs were medication related. None of the participants' residencies required the use of a specific medical information resource. The results support the Agency for Health Care Research and Quality's call for medical system improvements at the point of care. Additionally, it may be necessary to teach residents better information-management skills in addition to EBM skills.
Using research evidence in mental health: user-rating and focus group study of clinicians' preferences for a new clinical question-answering service.

PubMed

Barley, Elizabeth A; Murray, Joanna; Churchill, Rachel

2009-12-01

Clinicians report difficulties using research in their practices. The aim of the study was to describe needs and preferences for a mental health clinical question-answering service designed to assist this process. Multi-disciplinary clinicians participated in a focus group; users of the service supplied feedback. Fifty-four clinicians received answers to 84 questions about mental health treatments. User ratings showed that the answers had multiple uses: informing health care (43), education (22), staff development (28) and research (12), and were considered useful, clear, relevant and helpful. Focus group participants appreciated critically appraised summaries of evidence and stressed the time-saving benefit of the service. Clinicians without a medical training were least confident in applying evidence. Attitudes to research were positive, but concern was expressed about its potential misuse for political purposes. This appeared to arise from an ambiguity around the term 'insufficient evidence', which participants felt is widely misinterpreted as 'evidence of no effect'. A highly valued, responsive service has been developed. A range of clinicians find critically appraised summaries of research useful. Education about the use of research may help clinicians to be more evidence based.
The Different Paths in the Franchising Entrepreneurship Choice

NASA Astrophysics Data System (ADS)

Tomaras, Petros; Konstantopoulos, Nikolaos; Zondiros, Dimitris

2007-12-01

This study aims to testify the scientific veracity of the question: is the franchisees' choice on entrepreneurial start-up univocal or many-valued? Two variables are examined by registering daily activities of the entrepreneurial franchisees, as they appear by the answers given to a closed-ended questionnaire. We proceeded with a multiple variable statistical analysis (principal component analysis) of survey data collected from franchisees of a Greece-based franchise system. The results of the research indicate that among different value standards, the entrepreneurs conclude in choosing the franchising.
26 CFR 1.512(a)-5T - Questions and answers relating to the unrelated business taxable income of organizations...

Code of Federal Regulations, 2010 CFR

2010-04-01

... 26 Internal Revenue 7 2010-04-01 2010-04-01 true Questions and answers relating to the unrelated... TREASURY (CONTINUED) INCOME TAX (CONTINUED) INCOME TAXES (CONTINUED) Taxation of Business Income of Certain Exempt Organizations § 1.512(a)-5T Questions and answers relating to the unrelated business taxable...
Examining the impact of question surface features on students' answers to constructed-response questions on photosynthesis.

PubMed

Weston, Michele; Haudek, Kevin C; Prevost, Luanna; Urban-Lurain, Mark; Merrill, John

2015-01-01

One challenge in science education assessment is that students often focus on surface features of questions rather than the underlying scientific principles. We investigated how student written responses to constructed-response questions about photosynthesis vary based on two surface features of the question: the species of plant and the order of two question prompts. We asked four versions of the question with different combinations of the two plant species and order of prompts in an introductory cell biology course. We found that there was not a significant difference in the content of student responses to versions of the question stem with different species or order of prompts, using both computerized lexical analysis and expert scoring. We conducted 20 face-to-face interviews with students to further probe the effects of question wording on student responses. During the interviews, we found that students thought that the plant species was neither relevant nor confusing when answering the question. Students identified the prompts as both relevant and confusing. However, this confusion was not specific to a single version. © 2015 M. Weston et al. CBE—Life Sciences Education © 2015 The American Society for Cell Biology. This article is distributed by The American Society for Cell Biology under license from the author(s). It is available to the public under an Attribution–Noncommercial–Share Alike 3.0 Unported Creative Commons License (http://creativecommons.org/licenses/by-nc-sa/3.0).
[Mechanism of drug dependency: answers to the questions of KATO].

PubMed

Takigawa, M

2000-01-01

The complicated mechanisms of drug dependency were discussed from the perspective of a reward, especially the perspective of psychic dependency of the brain. In Kato's article, the following questions were raised. (1) Improper usage of terminology in describing the objective pharmacological behavior and describing the subjective psychic experience, e.g. the term "obsessional comfort". (2) The enhanced effects of morphine and d-amphetamine in ICSS (intracranial self-stimulation) were not suitably regarded, as these might be the results of stimulus current running in the brain. The conclusion that "morphine and d-amphetamine are 2 kinds of addictive drugs due to the reinforcement effects on ICSS" appears to be putting the incidental before the fundamental because these are addictive drugs in clinical use. (3) It was unknown why the basic problem of drug dependency was limited to psychic stimulant (antihypnotic, etc.), and why only opiates were represented as an addictive drug. (4) The conclusion that the reinforcement effects of barbital and benzodiazepine were not observed in ICSS contradicted Kato's conclusion, in which the reinforcement effects were detected in an experiment involving self-administration. (5) He reiterated that the usage of terminology was confused in describing the psychic experience and pharmacological behavioral. In response to the comments of the editors, I would answer the questions as follows: It is well-known that the terminologies used in psychiatry are strict and prudent. This should also be the case in the description of pharmacological behaviors in animal models. The author admitted Kato's profound relevant experiences in drug dependency, and did not disapprove of his criticisms about the terminology used in the article to describe objective behaviors and observe subjective experience. That article was excerpted from one of my lectures, which to some extent allowed freedom in phrases and sentences. The following are my answers to Kato
Grading Multiple Choice Exams with Low-Cost and Portable Computer-Vision Techniques

NASA Astrophysics Data System (ADS)

Fisteus, Jesus Arias; Pardo, Abelardo; García, Norberto Fernández

2013-08-01

Although technology for automatic grading of multiple choice exams has existed for several decades, it is not yet as widely available or affordable as it should be. The main reasons preventing this adoption are the cost and the complexity of the setup procedures. In this paper, Eyegrade, a system for automatic grading of multiple choice exams is presented. While most current solutions are based on expensive scanners, Eyegrade offers a truly low-cost solution requiring only a regular off-the-shelf webcam. Additionally, Eyegrade performs both mark recognition as well as optical character recognition of handwritten student identification numbers, which avoids the use of bubbles in the answer sheet. When compared with similar webcam-based systems, the user interface in Eyegrade has been designed to provide a more efficient and error-free data collection procedure. The tool has been validated with a set of experiments that show the ease of use (both setup and operation), the reduction in grading time, and an increase in the reliability of the results when compared with conventional, more expensive systems.
[To what extent do reviewers of multiple-choice questions need to be trained? A comparison between handing out information sheets and brief workshop sessions].

PubMed

Öchsner, Wolfgang; Böckers, Anja

2016-01-01

A competent review process is crucial to ensure the quality of multiple-choice (MC) questions. However, the acquisition of reviewing skills should not cause any unnecessary additional burden for a medical staff that is already facing heavy workloads. 100 MC questions, for which an expert review existed, were presented to 12 novices. In advance, six participants received a specific information sheet covering critical information for high-calibre review; the other six participants attended a 2.5-hour workshop covering the same information. The review results of both groups were analysed with a licensed version of the IBM software SPSS 19.0 (SPSS Inc., Chicago, IL). The results of the workshop group were distinctly closer to the experts' results (gold standard) than those of the information sheet group. For the quantitatively important category of medium quality MC questions, the results of the workshop group did not significantly differ from the experts' results. In the information sheet group the results were significantly poorer than the experts', regardless of the quality of the questions. Distributing specific information sheets to MC question reviewers is not sufficient for ensuring the quality of the review so that - regardless of the increased effort involved - a recommendation to conduct specific workshops must be made. Copyright © 2014. Published by Elsevier GmbH.
Randomized controlled trials in evidence-based mental health care: getting the right answer to the right question.

PubMed

Essock, Susan M; Drake, Robert E; Frank, Richard G; McGuire, Thomas G

2003-01-01

The purpose of clinical research is to answer this question: Would a new treatment, when added to the existing range of treatment options available in practice, help patients? Randomized controlled trials (RCTs)--in particular, double-blind RCTs--have important methodological advantages over observational studies for addressing this question. These advantages, however, come at a price. RCTs compare treatments using a particular allocation rule for assigning patients to treatments (random assignment) that does not mimic real-world practice. "Favorable" results from an RCT indicating that a new treatment is superior to existing treatments are neither necessary nor sufficient for establishing a "yes" answer to the question posed above. Modeled on an experimental design, RCTs are expensive in time and money and must compare simple differences in treatments. Findings have a high internal validity but may not address the needs of the field, particularly where treatment is complex and rapidly evolving. Design of clinical research needs to take account of the way treatments are allocated in actual practice and include flexible designs to answer important questions most effectively.
Addressing challenges to MMPI-2-RF-based testimony: questions and answers.

PubMed

Ben-Porath, Yossef S

2012-11-01

Introduction of a new version of a psychological test brings with it challenges that can be accentuated by the adversarial nature of the legal process. In the case of the Minnesota Multiphasic Personality Inventory-2 Restructured Form (MMPI-2-RF), these challenges can be addressed by becoming familiar with the rationale for and the methods used in revising the inventory, the information contained in the test manuals, and the growing peer-reviewed literature on the test. Potential challenges to MMPI-2-RF-based testimony are identified in this article and discussed in question and answer format. The questions guiding this discussion are based on the Daubert factors, established in 1993 by the US Supreme Court as criteria for gauging the scientific validity of proffered expert testimony. The answers to these questions apply more broadly to testimony in depositions, pre-trial hearings, and at trial. Consideration of the MMPI-2-RF in light of the Daubert factors indicates that the instrument has been subjected to extensive empirical testing and that a substantial peer-reviewed literature is available to guide and support its use. Information about the known and potential rate of error associated with MMPI-2-RF scores is available, and standard procedures for administration, scoring, and interpretation of the inventory are detailed in the test administration manual. Indicators of MMPI-2-RF acceptance can be cited, and criticisms of the MMPI-2-RF can be addressed with information available in the test documents and an extensive, modern, and actively growing peer-reviewed literature.
The Varieties of Student Experience--An Open Research Question and Some Ways to Answer It

ERIC Educational Resources Information Center

Ainley, Patrick

2008-01-01

Based on meetings of the Society for Research into Higher Education's Student Experience Network over the past three years, the genuinely open research question is posed whether there is one or more undergraduate student experience within English higher education. Answering this question depends on whether what is taught or what is learnt is…

75 FR 11641 - Community Reinvestment Act; Interagency Questions and Answers Regarding Community Reinvestment...

Federal Register 2010, 2011, 2012, 2013, 2014

2010-03-11

... lending test applicable to large institutions, its content may also be applicable to, for example, small... the guidance that describes the lending, investment, and service tests. The Questions and Answers are... received total quantitative CRA consideration. Although this is true if the express, bona fide intent of...
26 CFR 35.3405-1T - Questions and answers relating to withholding on pensions, annuities, and certain other deferred...

Code of Federal Regulations, 2010 CFR

2010-04-01

... payment for the year? A. No. Periodic payments can vary during a calendar year because of make-up of past... 26 Internal Revenue 15 2010-04-01 2010-04-01 false Questions and answers relating to withholding... REGULATIONS UNDER THE TAX EQUITY AND FISCAL RESPONSIBILITY ACT OF 1982 § 35.3405-1T Questions and answers...
Questions and Answers about School-Age Children in Self-Care: A Sloan Work and Family Research Network Fact Sheet

ERIC Educational Resources Information Center

Sloan Work and Family Research Network, 2009

2009-01-01

The Sloan Work and Family Research Network has prepared Fact Sheets that provide statistical answers to some important questions about work-family and work-life issues. This Fact Sheet includes statistics about Children in Self-Care, and answers the following questions about school-age children in self-care: (1) How many school-age children are in…
Questions and Answers Explaining the New Tax Rules Applicable to Tax-Sheltered Annuities.

ERIC Educational Resources Information Center

Gordon, David E.; Spuehler, Donald R.

1991-01-01

The Tax Reform Act of 1986 and subsequent legislation have radically altered the rules needed to maintain favorable tax status of tax-sheltered annuity plans for college employees. Application of the new rules is complex. Critical questions facing institutions and organizations are answered, and potential liabilities facing educational employers…
Perspectives from the Avian Phylogenomics Project: Questions that Can Be Answered with Sequencing All Genomes of a Vertebrate Class.

PubMed

Jarvis, Erich D

2016-01-01

The rapid pace of advances in genome technology, with concomitant reductions in cost, makes it feasible that one day in our lifetime we will have available extant genomes of entire classes of species, including vertebrates. I recently helped cocoordinate the large-scale Avian Phylogenomics Project, which collected and sequenced genomes of 48 bird species representing most currently classified orders to address a range of questions in phylogenomics and comparative genomics. The consortium was able to answer questions not previously possible with just a few genomes. This success spurred on the creation of a project to sequence the genomes of at least one individual of all extant ∼10,500 bird species. The initiation of this project has led us to consider what questions now impossible to answer could be answered with all genomes, and could drive new questions now unimaginable. These include the generation of a highly resolved family tree of extant species, genome-wide association studies across species to identify genetic substrates of many complex traits, redefinition of species and the species concept, reconstruction of the genomes of common ancestors, and generation of new computational tools to address these questions. Here I present visions for the future by posing and answering questions regarding what scientists could potentially do with available genomes of an entire vertebrate class.
Answering the right question - integration of InSAR with other datasets

NASA Astrophysics Data System (ADS)

Holley, Rachel; McCormack, Harry; Burren, Richard

2014-05-01

The capabilities of satellite Interferometric Synthetic Aperture Radar (InSAR) are well known, and utilized across a wide range of academic and commercial applications. However there is a tendency, particularly in commercial applications, for users to ask 'What can we study with InSAR?'. When establishing a new technique this approach is important, but InSAR has been possible for 20 years now and, even accounting for new and innovative algorithms, this ground has been thoroughly explored. Too many studies conclude 'We show the ground is moving here, by this much', and mention the wider context as an afterthought. The focus needs to shift towards first asking the right questions - in fields as diverse as hazard awareness, resource optimization, financial considerations and pure scientific enquiry - and then working out how to achieve the best possible answers. Depending on the question, InSAR (and ground deformation more generally) may provide a large or small contribution to the overall solution, and there are usually benefits to integrating a number of techniques to capitalize on the complementary capabilities and provide the most useful measurements. However, there is still a gap between measurements and answers, and unlocking the value of the data relies heavily on appropriate visualization, integrated analysis, communication between technique and application experts, and appropriate use of modelling. We present a number of application examples, and demonstrate how their usefulness can be transformed by moving from a focus on data to answers - integrating complementary geodetic, geophysical and geological datasets and geophysical modeling with appropriate visualization, to enable comprehensive solution-focused interpretation. It will also discuss how forthcoming developments are likely to further advance realisation of the full potential satellite InSAR holds.
Answering Contextually Demanding Questions: Pragmatic Errors Produced by Children with Asperger Syndrome or High-Functioning Autism

ERIC Educational Resources Information Center

Loukusa, Soile; Leinonen, Eeva; Jussila, Katja; Mattila, Marja-Leena; Ryder, Nuala; Ebeling, Hanna; Moilanen, Irma

2007-01-01

This study examined irrelevant/incorrect answers produced by children with Asperger syndrome or high-functioning autism (7-9-year-olds and 10-12-year-olds) and normally developing children (7-9-year-olds). The errors produced were divided into three types: in Type 1, the child answered the original question incorrectly, in Type 2, the child gave a…
The Testing Methods and Gender Differences in Multiple-Choice Assessment

NASA Astrophysics Data System (ADS)

Ng, Annie W. Y.; Chan, Alan H. S.

2009-10-01

This paper provides a comprehensive review of the multiple-choice assessment in the past two decades for facilitating people to conduct effective testing in various subject areas. It was revealed that a variety of multiple-choice test methods viz. conventional multiple-choice, liberal multiple-choice, elimination testing, confidence marking, probability testing, and order-of-preference scheme are available for use in assessing subjects' knowledge and decision ability. However, the best multiple-choice test method for use has not yet been identified. The review also indicated that the existence of gender differences in multiple-choice task performance might be due to the test area, instruction/scoring condition, and item difficulty.
Questions & Answers for the New Chemicals Program under the Toxic Substances Control Act (TSCA)

EPA Pesticide Factsheets

This Questions & Answers document for the New Chemicals Program is intended only to explain the requirements of TSCA section 5 and selected EPA regulations implementing section 5, and to provide useful information to persons subject to these requirements.
Warning Signs of Youth Violence. Just the Facts: Answers to Your Questions about Psychological Health

ERIC Educational Resources Information Center

American Psychological Association (APA), 2002

2002-01-01

Violence. It's the act of purposefully hurting someone. And it's a major issue facing today's young adults. This fact sheet answers questions that those aged 12-24 might ask about violence. This age group faces the highest risk of being the victim of violence. Questions regard the causes of youth violence, warning signs, what to do if someone…
Multiple-Choice Exams: An Obstacle for Higher-Level Thinking in Introductory Science Classes

ERIC Educational Resources Information Center

Stanger-Hall, Kathrin F.

2012-01-01

Learning science requires higher-level (critical) thinking skills that need to be practiced in science classes. This study tested the effect of exam format on critical-thinking skills. Multiple-choice (MC) testing is common in introductory science courses, and students in these classes tend to associate memorization with MC questions and may not…
Americans with Disabilities Act: Responsibilities for Postsecondary Institutions Serving Deaf and Hard of Hearing Students. Questions and Answers. Second Edition.

ERIC Educational Resources Information Center

Kincaid, Jeanne M.; Rawlinson, Sharaine J.

This publication provides answers to questions concerning responsibilities of institutions of postsecondary education toward students who are deaf or hard of hearing under the Americans with Disabilities Act. These questions were originally received but not answered due to time constraints during two satellite conferences held by the Midwest…
COMPUTER TECHNIQUES FOR WEEKLY MULTIPLE-CHOICE TESTING.

ERIC Educational Resources Information Center

BROYLES, DAVID

TO ENCOURAGE POLITICAL SCIENCE STUDENTS TO READ PROPERLY AND CONTINUOUSLY, THE AUTHOR GIVES FREQUENT SHORT QUIZZES BASED ON THE ASSIGNED READINGS. FOR EASE IN ADMINISTRATION AND SCORING, HE USES MARK-SENSE CARDS, ON WHICH THE STUDENT MARKS DESIGNATED AREAS TO INDICATE HIS NUMBER AND HIS CHOICE OF ANSWERS. TO EMPHASIZE THE VALUE OF CONTINUED HIGH…
Questions and Answers Regarding the 1997 State Plan Requirements for Hospital, Medical, and Infectious Waste Incinerators (HMIWI)

EPA Pesticide Factsheets

This November 1997 document contains questions and answers on the state plan requirements for HMIWI regulations. The questions cover topics such as re-opening existing sources, timelines for submission, consequences for failure to submit, and more.
Cost analysis for computer supported multiple-choice paper examinations

PubMed Central

Mandel, Alexander; Hörnlein, Alexander; Ifland, Marianus; Lüneburg, Edeltraud; Deckert, Jürgen; Puppe, Frank

2011-01-01

Introduction: Multiple-choice-examinations are still fundamental for assessment in medical degree programs. In addition to content related research, the optimization of the technical procedure is an important question. Medical examiners face three options: paper-based examinations with or without computer support or completely electronic examinations. Critical aspects are the effort for formatting, the logistic effort during the actual examination, quality, promptness and effort of the correction, the time for making the documents available for inspection by the students, and the statistical analysis of the examination results. Methods: Since three semesters a computer program for input and formatting of MC-questions in medical and other paper-based examinations is used and continuously improved at Wuerzburg University. In the winter semester (WS) 2009/10 eleven, in the summer semester (SS) 2010 twelve and in WS 2010/11 thirteen medical examinations were accomplished with the program and automatically evaluated. For the last two semesters the remaining manual workload was recorded. Results: The cost of the formatting and the subsequent analysis including adjustments of the analysis of an average examination with about 140 participants and about 35 questions was 5-7 hours for exams without complications in the winter semester 2009/2010, about 2 hours in SS 2010 and about 1.5 hours in the winter semester 2010/11. Including exams with complications, the average time was about 3 hours per exam in SS 2010 and 2.67 hours for the WS 10/11. Discussion: For conventional multiple-choice exams the computer-based formatting and evaluation of paper-based exams offers a significant time reduction for lecturers in comparison with the manual correction of paper-based exams and compared to purely electronically conducted exams it needs a much simpler technological infrastructure and fewer staff during the exam. PMID:22205913
Cost analysis for computer supported multiple-choice paper examinations.

PubMed

Mandel, Alexander; Hörnlein, Alexander; Ifland, Marianus; Lüneburg, Edeltraud; Deckert, Jürgen; Puppe, Frank

2011-01-01

Multiple-choice-examinations are still fundamental for assessment in medical degree programs. In addition to content related research, the optimization of the technical procedure is an important question. Medical examiners face three options: paper-based examinations with or without computer support or completely electronic examinations. Critical aspects are the effort for formatting, the logistic effort during the actual examination, quality, promptness and effort of the correction, the time for making the documents available for inspection by the students, and the statistical analysis of the examination results. Since three semesters a computer program for input and formatting of MC-questions in medical and other paper-based examinations is used and continuously improved at Wuerzburg University. In the winter semester (WS) 2009/10 eleven, in the summer semester (SS) 2010 twelve and in WS 2010/11 thirteen medical examinations were accomplished with the program and automatically evaluated. For the last two semesters the remaining manual workload was recorded. The cost of the formatting and the subsequent analysis including adjustments of the analysis of an average examination with about 140 participants and about 35 questions was 5-7 hours for exams without complications in the winter semester 2009/2010, about 2 hours in SS 2010 and about 1.5 hours in the winter semester 2010/11. Including exams with complications, the average time was about 3 hours per exam in SS 2010 and 2.67 hours for the WS 10/11. For conventional multiple-choice exams the computer-based formatting and evaluation of paper-based exams offers a significant time reduction for lecturers in comparison with the manual correction of paper-based exams and compared to purely electronically conducted exams it needs a much simpler technological infrastructure and fewer staff during the exam.
26 CFR 1.505(c)-1T - Questions and answers relating to the notification requirement for recognition of exemption under...

Code of Federal Regulations, 2010 CFR

2010-04-01

... 26 Internal Revenue 7 2010-04-01 2010-04-01 true Questions and answers relating to the... Questions and answers relating to the notification requirement for recognition of exemption under paragraphs... taxation need not submit the notification required by section 505(c). [T.D. 8073, 51 FR 4330, Feb. 4, 1986...
Exam Question Exchange.

ERIC Educational Resources Information Center

Alexander, John J., Ed.

1987-01-01

Contains two articles relating to chemistry examination questions. One provides examples of how to sequence multiple choice questions so that partial credit may be given for some responses. The second includes a question and solution dealing with stereoisomerism as a result of free radical chlorination of a nonstereoisometic substance. (TW)
A comparative study of students' performance in preclinical physiology assessed by multiple choice and short essay questions.

PubMed

Oyebola, D D; Adewoye, O E; Iyaniwura, J O; Alada, A R; Fasanmade, A A; Raji, Y

2000-01-01

This study was designed to compare the performance of medical students in physiology when assessed by multiple choice questions (MCQs) and short essay questions (SEQs). The study also examined the influence of factors such as age, sex, O/level grades and JAMB scores on performance in the MCQs and SEQs. A structured questionnaire was administered to 264 medical students' four months before the Part I MBBS examination. Apart from personal data of each student, the questionnaire sought information on the JAMB scores and GCE O' Level grades of each student in English Language, Biology, Chemistry, Physics and Mathematics. The physiology syllabus was divided into five parts and the students were administered separate examinations (tests) on each part. Each test consisted of MCQs and SEQs. The performance in MCQs and SEQs were compared. Also, the effects of JAMB scores and GCE O/level grades on the performance in both the MCQs and SEQs were assessed. The results showed that the students performed better in all MCQ tests than in the SEQs. JAMB scores and O' level English Language grade had no significant effect on students' performance in MCQs and SEQs. However O' level grades in Biology, Chemistry, Physics and Mathematics had significant effects on performance in MCQs and SEQs. Inadequate knowledge of physiology and inability to present information in a logical sequence are believed to be major factors contributing to the poorer performance in the SEQs compared with MCQs. In view of the finding of significant association between performance in MCQs and SEQs and GCE O/level grades in science subjects and mathematics, it was recommended that both JAMB results and the GCE results in the four O/level subjects above may be considered when selecting candidates for admission into the medical schools.
Young Children's Sensitivity to New and Given Information when Answering Predicate-Focus Questions

ERIC Educational Resources Information Center

Salomo, Dorothe; Lieven, Elena; Tomasello, Michael

2010-01-01

In two studies we investigated 2-year-old children's answers to predicate-focus questions depending on the preceding context. Children were presented with a successive series of short video clips showing transitive actions (e.g., frog washing duck) in which either the action (action-new) or the patient (patient-new) was the changing, and therefore…

Question-Answer Activities in Synchronous Virtual Classrooms in Terms of Interest and Usefulness

ERIC Educational Resources Information Center

Aydemir, Melike; Kursun, Engin; Karaman, Selçuk

2016-01-01

Instructors generally convey their face to face habits to synchronous virtual classrooms, but these face to face strategies do not work in these environments. In this sense, the purpose of this study was to investigate the effects of question type and answer format used in synchronous class implementations on perceived interest and usefulness. To…
Analysis of Student Responses to Peer-Instruction Conceptual Questions Answered Using an Electronic Response System: Trends by Gender and Ethnicity

ERIC Educational Resources Information Center

Steer, David; McConnell, David; Gray, Kyle; Kortz, Karen; Liang, Xin

2009-01-01

This descriptive study investigated students' answers to geoscience conceptual questions answered using electronic personal response systems. Answer patterns were examined to evaluate the peer-instruction pedagogical approach in a large general education classroom setting. (Contains 3 figures and 2 tables.)
Step by Step: Biology Undergraduates' Problem-Solving Procedures during Multiple-Choice Assessment.

PubMed

Prevost, Luanna B; Lemons, Paula P

2016-01-01

This study uses the theoretical framework of domain-specific problem solving to explore the procedures students use to solve multiple-choice problems about biology concepts. We designed several multiple-choice problems and administered them on four exams. We trained students to produce written descriptions of how they solved the problem, and this allowed us to systematically investigate their problem-solving procedures. We identified a range of procedures and organized them as domain general, domain specific, or hybrid. We also identified domain-general and domain-specific errors made by students during problem solving. We found that students use domain-general and hybrid procedures more frequently when solving lower-order problems than higher-order problems, while they use domain-specific procedures more frequently when solving higher-order problems. Additionally, the more domain-specific procedures students used, the higher the likelihood that they would answer the problem correctly, up to five procedures. However, if students used just one domain-general procedure, they were as likely to answer the problem correctly as if they had used two to five domain-general procedures. Our findings provide a categorization scheme and framework for additional research on biology problem solving and suggest several important implications for researchers and instructors. © 2016 L. B. Prevost and P. P. Lemons. CBE—Life Sciences Education © 2016 The American Society for Cell Biology. This article is distributed by The American Society for Cell Biology under license from the author(s). It is available to the public under an Attribution–Noncommercial–Share Alike 3.0 Unported Creative Commons License (http://creativecommons.org/licenses/by-nc-sa/3.0).
Review of multiple-choice-questions and group performance - A comparison of face-to-face and virtual groups with and without facilitation

PubMed Central

Kazubke, Edda; Schüttpelz-Brauns, Katrin

2010-01-01

Background: Multiple choice questions (MCQs) are often used in exams of medical education and need careful quality management for example by the application of review committees. This study investigates whether groups communicating virtually by email are similar to face-to-face groups concerning their review process performance and whether a facilitator has positive effects. Methods: 16 small groups of students were examined, which had to evaluate and correct MCQs under four different conditions. In the second part of the investigation the changed questions were given to a new random sample for the judgement of the item quality. Results: There was no significant influence of the variables “form of review committee” and “facilitation”. However, face-to-face and virtual groups clearly differed in the required treatment times. The test condition “face to face without facilitation” was generally valued most positively concerning taking over responsibility, approach to work, sense of well-being, motivation and concentration on the task. Discussion: Face-to-face and virtual groups are equally effective in the review of MCQs but differ concerning their efficiency. The application of electronic review seems to be possible but is hardly recommendable because of the long process time and technical problems. PMID:21818213
Do Sequentially-Presented Answer Options Prevent the Use of Testwiseness Cues on Continuing Medical Education Tests?

ERIC Educational Resources Information Center

Willing, Sonja; Ostapczuk, Martin; Musch, Jochen

2015-01-01

Testwiseness--that is, the ability to find subtle cues towards the solution by the simultaneous comparison of the available answer options--threatens the validity of multiple-choice (MC) tests. Discrete-option multiple-choice (DOMC) has recently been proposed as a computerized alternative testing format for MC tests, and presumably allows for a…
Exploring the Learning Mechanism of Web-Based Question-Answering Systems and Their Design

ERIC Educational Resources Information Center

Zhang, Yin

2010-01-01

In recent years, a number of models concerning question-answering (QA) systems have been put forward. But many of them stress technology and neglect the research of QA itself. In this paper, we analyse the essence of QA and discuss the relationship between technology and QA. On that basis, we propose that when designing web-based QA systems, more…
Express Authorization Questions and Answers about What is Generally the Content of a Program Revision Application?

EPA Pesticide Factsheets

Frequently asked questions about express authorization with answers organized into five categories: attorney general's statement, statutory checklist, rule checklists, program description, and state initiated regulatory changes.
Item Reliabilities for a Family of Answer-Until-Correct (AUC) Scoring Rules.

ERIC Educational Resources Information Center

Kane, Michael T.; Moloney, James M.

The Answer-Until-Correct (AUC) procedure has been proposed in order to increase the reliability of multiple-choice items. A model for examinees' behavior when they must respond to each item until they answer it correctly is presented. An expression for the reliability of AUC items, as a function of the characteristics of the item and the scoring…
Multiple-choice pretesting potentiates learning of related information.

PubMed

Little, Jeri L; Bjork, Elizabeth Ligon

2016-10-01

Although the testing effect has received a substantial amount of empirical attention, such research has largely focused on the effects of tests given after study. The present research examines the effect of using tests prior to study (i.e., as pretests), focusing particularly on how pretesting influences the subsequent learning of information that is not itself pretested but that is related to the pretested information. In Experiment 1, we found that multiple-choice pretesting was better for the learning of such related information than was cued-recall pretesting or a pre-fact-study control condition. In Experiment 2, we found that the increased learning of non-pretested related information following multiple-choice testing could not be attributed to increased time allocated to that information during subsequent study. Last, in Experiment 3, we showed that the benefits of multiple-choice pretesting over cued-recall pretesting for the learning of related information persist over 48 hours, thus demonstrating the promise of multiple-choice pretesting to potentiate learning in educational contexts. A possible explanation for the observed benefits of multiple-choice pretesting for enhancing the effectiveness with which related nontested information is learned during subsequent study is discussed.
Technical Approaches for Answering the Question: What is the condition of the Nation's Waters?

EPA Science Inventory

The National Aquatic Resource Surveys were designed to answer the question of the status and trends in the condition of each of our aquatic resources: coastal waters, lakes and reservoirs, rivers and streams and wetlands. At the higher levels, the EPA is consistently asked a see...
Relationship between item difficulty and discrimination indices in true/false-type multiple choice questions of a para-clinical multidisciplinary paper.

PubMed

Sim, Si-Mui; Rasiah, Raja Isaiah

2006-02-01

This paper reports the relationship between the difficulty level and the discrimination power of true/false-type multiple-choice questions (MCQs) in a multidisciplinary paper for the para-clinical year of an undergraduate medical programme. MCQ items in papers taken from Year II Parts A, B and C examinations for Sessions 2001/02, and Part B examinations for 2002/03 and 2003/04, were analysed to obtain their difficulty indices and discrimination indices. Each paper consisted of 250 true/false items (50 questions of 5 items each) on topics drawn from different disciplines. The questions were first constructed and vetted by the individual departments before being submitted to a central committee, where the final selection of the MCQs was made, based purely on the academic judgement of the committee. There was a wide distribution of item difficulty indices in all the MCQ papers analysed. Furthermore, the relationship between the difficulty index (P) and discrimination index (D) of the MCQ items in a paper was not linear, but more dome-shaped. Maximal discrimination (D = 51% to 71%) occurred with moderately easy/difficult items (P = 40% to 74%). On average, about 38% of the MCQ items in each paper were "very easy" (P > or =75%), while about 9% were "very difficult" (P <25%). About two-thirds of these very easy/difficult items had "very poor" or even negative discrimination (D < or =20%). MCQ items that demonstrate good discriminating potential tend to be moderately difficult items, and the moderately-to-very difficult items are more likely to show negative discrimination. There is a need to evaluate the effectiveness of our MCQ items.
ASIME 2016 White Paper: Answers to Questions from the Asteroid Miners

NASA Astrophysics Data System (ADS)

Galache, Jl; Graps, A. L.; Asime 2016 Contributors, 30

2017-09-01

The aim of the Asteroid Science Intersections with In-Space Mine Engineering (ASIME) 2016 conference on September 21-22, 2016 in Luxembourg City was to provide an environment for the detailed discussion of the specific properties of asteroids, with the engineering needs of space missions that utilise asteroids. The ASIME 2016 Conference produced a layered record of discussions from the asteroid scientists and the asteroid miners to understand each other's key concerns and to address key scientific questions from the asteroid mining companies: Planetary Resources, Deep Space Industries and TransAstra. These Questions were the focus of the two-day conference, were addressed by scientists inside and outside of the ASIME 2016 Conference and were the focus of this White Paper. The answers in this White Paper point to the Science Knowledge Gaps (SKGs) for advancing the asteroid in-space resource utilisation domain.
Single-Concept Clicker Question Sequences

ERIC Educational Resources Information Center

Lee, Albert; Ding, Lin; Reay, Neville W.; Bao, Lei

2011-01-01

Students typically use electronic polling systems, or clickers, to answer individual questions. Differing from this tradition, we have developed a new clicker methodology in which multiple clicker questions targeting the same underlying concept but with different surface features are grouped into a sequence. Here we present the creation,…
Referential Choice: Predictability and Its Limits

PubMed Central

Kibrik, Andrej A.; Khudyakova, Mariya V.; Dobrov, Grigory B.; Linnik, Anastasia; Zalmanov, Dmitrij A.

2016-01-01

We report a study of referential choice in discourse production, understood as the choice between various types of referential devices, such as pronouns and full noun phrases. Our goal is to predict referential choice, and to explore to what extent such prediction is possible. Our approach to referential choice includes a cognitively informed theoretical component, corpus analysis, machine learning methods and experimentation with human participants. Machine learning algorithms make use of 25 factors, including referent’s properties (such as animacy and protagonism), the distance between a referential expression and its antecedent, the antecedent’s syntactic role, and so on. Having found the predictions of our algorithm to coincide with the original almost 90% of the time, we hypothesized that fully accurate prediction is not possible because, in many situations, more than one referential option is available. This hypothesis was supported by an experimental study, in which participants answered questions about either the original text in the corpus, or about a text modified in accordance with the algorithm’s prediction. Proportions of correct answers to these questions, as well as participants’ rating of the questions’ difficulty, suggested that divergences between the algorithm’s prediction and the original referential device in the corpus occur overwhelmingly in situations where the referential choice is not categorical. PMID:27721800
Student-written single-best answer questions predict performance in finals.

PubMed

Walsh, Jason; Harris, Benjamin; Tayyaba, Saadia; Harris, David; Smith, Phil

2016-10-01

Single-best answer (SBA) questions are widely used for assessment in medical schools; however, often clinical staff have neither the time nor the incentive to develop high-quality material for revision purposes. A student-led approach to producing formative SBA questions offers a potential solution. Cardiff University School of Medicine students created a bank of SBA questions through a previously described staged approach, involving student question-writing, peer-review and targeted senior clinician input. We arranged questions into discrete tests and posted these online. Student volunteer performance on these tests from the 2012/13 cohort of final-year medical students was recorded and compared with the performance of these students in medical school finals (knowledge and objective structured clinical examinations, OSCEs). In addition, we compared the performance of students that participated in question-writing groups with the performance of the rest of the cohort on the summative SBA assessment. Often clinical staff have neither the time nor the incentive to develop high-quality material for revision purposes Performance in the end-of-year summative clinical knowledge SBA paper correlated strongly with performance in the formative student-written SBA test (r = ~0.60, p <0.01). There was no significant correlation between summative OSCE scores and formative student-written SBA test scores. Students who wrote and reviewed questions scored higher than average in the end-of-year summative clinical knowledge SBA paper. Student-written SBAs predict performance in end-of-year SBA examinations, and therefore can provide a potentially valuable revision resource. There is potential for student-written questions to be incorporated into summative examinations. © 2015 John Wiley & Sons Ltd.
Pathology informatics questions and answers from the University of Pittsburgh pathology residency informatics rotation.

PubMed

Harrison, James H

2004-01-01

Effective pathology practice increasingly requires familiarity with concepts in medical informatics that may cover a broad range of topics, for example, traditional clinical information systems, desktop and Internet computer applications, and effective protocols for computer security. To address this need, the University of Pittsburgh (Pittsburgh, Pa) includes a full-time, 3-week rotation in pathology informatics as a required component of pathology residency training. To teach pathology residents general informatics concepts important in pathology practice. We assess the efficacy of the rotation in communicating these concepts using a short-answer examination administered at the end of the rotation. Because the increasing use of computers and the Internet in education and general communications prior to residency training has the potential to communicate key concepts that might not need additional coverage in the rotation, we have also evaluated incoming residents' informatics knowledge using a similar pretest. This article lists 128 questions that cover a range of topics in pathology informatics at a level appropriate for residency training. These questions were used for pretests and posttests in the pathology informatics rotation in the Pathology Residency Program at the University of Pittsburgh for the years 2000 through 2002. With slight modification, the questions are organized here into 15 topic categories within pathology informatics. The answers provided are brief and are meant to orient the reader to the question and suggest the level of detail appropriate in an answer from a pathology resident. A previously published evaluation of the test results revealed that pretest scores did not increase during the 3-year evaluation period, and self-assessed computer skill level correlated with pretest scores, but all pretest scores were low. Posttest scores increased substantially, and posttest scores did not correlate with the self-assessed computer skill level
Using peer discussion facilitated by clicker questions in an informal education setting: enhancing farmer learning of science.

PubMed

Smith, Michelle K; Annis, Seanna L; Kaplan, Jennifer J; Drummond, Frank

2012-01-01

Blueberry growers in Maine attend annual Cooperative Extension presentations given by university faculty members. These presentations cover topics, such as, how to prevent plant disease and monitor for insect pests. In 2012, in order to make the sessions more interactive and promote learning, clicker questions and peer discussion were incorporated into the presentations. Similar to what has been shown at the undergraduate level, after peer discussion, more blueberry growers gave correct answers to multiple-choice questions than when answering independently. Furthermore, because blueberry growers are characterized by diverse levels of education, experience in the field etc., we were able to determine whether demographic factors were associated with changes in performance after peer discussion. Taken together, our results suggest that clicker questions and peer discussion work equally well with adults from a variety of demographic backgrounds without disadvantaging a subset of the population and provide an important learning opportunity to the least formally educated members. Our results also indicate that clicker questions with peer discussion were viewed as a positive addition to university-related informal science education sessions.
Using Peer Discussion Facilitated by Clicker Questions in an Informal Education Setting: Enhancing Farmer Learning of Science

PubMed Central

Smith, Michelle K.; Annis, Seanna L.; Kaplan, Jennifer J.; Drummond, Frank

2012-01-01

Blueberry growers in Maine attend annual Cooperative Extension presentations given by university faculty members. These presentations cover topics, such as, how to prevent plant disease and monitor for insect pests. In 2012, in order to make the sessions more interactive and promote learning, clicker questions and peer discussion were incorporated into the presentations. Similar to what has been shown at the undergraduate level, after peer discussion, more blueberry growers gave correct answers to multiple-choice questions than when answering independently. Furthermore, because blueberry growers are characterized by diverse levels of education, experience in the field etc., we were able to determine whether demographic factors were associated with changes in performance after peer discussion. Taken together, our results suggest that clicker questions and peer discussion work equally well with adults from a variety of demographic backgrounds without disadvantaging a subset of the population and provide an important learning opportunity to the least formally educated members. Our results also indicate that clicker questions with peer discussion were viewed as a positive addition to university-related informal science education sessions. PMID:23077638
"None of the above" as a correct and incorrect alternative on a multiple-choice test: implications for the testing effect.

PubMed

Odegard, Timothy N; Koen, Joshua D

2007-11-01

Both positive and negative testing effects have been demonstrated with a variety of materials and paradigms (Roediger & Karpicke, 2006b). The present series of experiments replicate and extend the research of Roediger and Marsh (2005) with the addition of a "none-of-the-above" response option. Participants (n=32 in both experiments) read a set of passages, took an initial multiple-choice test, completed a filler task, and then completed a final cued-recall test (Experiment 1) or multiple-choice test (Experiment 2). Questions were manipulated on the initial multiple-choice test by adding a "none-of-the-above" response alternative (choice "E") that was incorrect ("E" Incorrect) or correct ("E" Correct). The results from both experiments demonstrated that the positive testing effect was negated when the "none-of-the-above" alternative was the correct response on the initial multiple-choice test, but was still present when the "none-of-the-above" alternative was an incorrect response.
How well does the Internet answer patients’ questions about inflammatory bowel disease?

PubMed Central

Promislow, Steven; Walker, John R; Taheri, Mohammad; Bernstein, Charles N

2010-01-01

BACKGROUND The Internet is an increasingly important source of health information. OBJECTIVE To assess how well common websites answered patients’ questions regarding inflammatory bowel disease (IBD). METHODS Thirty websites were identified and evaluated. Based on a previous survey of patient information needs, a comprehensive question list was developed in the three following areas: medical information (seven items), medical treatment (six items) and self-management (eight items). The websites were evaluated for the amount of information they provided to answer each question using two standard measures of information quality – the DISCERN and the Ensuring Quality Information for Patients scales. RESULTS Four particularly strong websites, scoring highest (on a scale from 1 to 5) in terms of IBD information, were the Crohn’s and Colitis Foundation of America (mean information score 4.3), About.com (4.2), HealthCentral (3.8) and WebMD (3.8). These websites also scored well on the DISCERN and the Ensuring Quality Information for Patients quality scales. Most websites provided at least adequate information on common symptoms, complications, treatments and what is known (or not known) about the causes of IBD. However, many web-sites did not provide adequate information about prognosis, possible side effects of treatment and risks of developing cancer. Information regarding self-management was covered to a very limited extent. CONCLUSION Websites could be strengthened by providing more of the information patients deem to be important, and by more clearly identifying sources of information and the date the information was updated. Most websites would benefit from more attention given to reducing the reading level and improving the organization of material. PMID:21157582

Individual Choice and Unequal Participation in Higher Education

ERIC Educational Resources Information Center

Voigt, Kristin

2007-01-01

Does the unequal participation of non-traditional students in higher education indicate social injustice, even if it can be traced back to individuals' choices? Drawing on luck egalitarian approaches,this article suggests that an answer to this question must take into account the effects of unequal brute luck on educational choices. I use a…
Olympian Parents Answer the Question of How Parents Contribute towards Their Child's Academic Productivity

ERIC Educational Resources Information Center

Campbell, James Reed

2011-01-01

How do parents contribute toward their child's academic productivity? This article analyzes studies conducted over the last 30 years on this topic. During these three decades a number of theories and theoretical frameworks have been developed to answer this fundamental question. There have been nine national studies published and six reviews of…
Six Questions for the Resource Model of Control (and Some Answers)

PubMed Central

Inzlicht, Michael; Berkman, Elliot

2017-01-01

The resource model of self-control casts self-control as a capacity that relies on some limited resource that exhausts with use. The model captured our imagination and brought much-needed attention on an important yet neglected psychological construct. Despite its success, basic issues with the model remain. Here, we ask six questions: (i) Does self-control really wane over time? (ii) Is ego depletion a form of mental fatigue? (iii) What is the resource that is depleted by ego depletion? (iv) How can changes in motivation, perception, and expectations replenish an exhausted resource? (v) Has the revised resource model unwittingly become a model about motivation? (vi) Do self-control exercises increase self-control? By providing some answers to these questions – including conducting a meta-analysis of the self-control training literature – we highlight how the resource model needs to be revised if not supplanted altogether. PMID:28966660
Will Veterans Answer Sexual Orientation and Gender Identity Questions?

PubMed

Ruben, Mollie A; Blosnich, John R; Dichter, Melissa E; Luscri, Lorry; Shipherd, Jillian C

2017-09-01

The Veterans Health Administration does not routinely collect and document sexual orientation and gender identity (SOGI) data, despite existing health disparities among sexual and gender minority Veterans. Because of the legacy of previous Department of Defense (DoD) policies that prohibited disclosure of sexual or gender minority identities among active duty personnel, Veterans may be reluctant to respond to SOGI questions. This population-based study assesses item nonresponse to SOGI questions by Veteran status. This is a secondary analysis of data from a population-based sample of adults in 20 US states that elected to administer a SOGI module in the 2014 Behavioral Risk Factor Surveillance System survey. Prevalence of SOGI refusals and responses of "don't know" were compared for Veterans and non-Veterans. Veterans (n=22,587) and non-Veterans (n=146,475) were surveyed. Nearly all Veteran respondents (≥98%) completed the SOGI questions, with 95.4% identifying as heterosexual, 1.2% as gay or lesbian, 1.2% as bisexual, and 0.59% as transgender. A significantly lower proportion of Veterans than non-Veterans refuse to answer sexual orientation (1.5% vs. 1.9%). There was no difference between Veterans and non-Veterans in responses for gender identity. Veterans are just as likely as non-Veterans to complete SOGI items in survey research. Asking Veterans about SOGI is unlikely to yield significant nonresponse. These data suggest that future research should investigate Veterans' perspectives on being asked about SOGI in research settings and as part of routine clinical care.
A Model Driven Question-Answering System for a CAI Environment. Final Report (July 1970 to May 1972).

ERIC Educational Resources Information Center

Brown, John S.; And Others

A question answering system which permits a computer-assisted instruction (CAI) student greater initiative in the variety of questions he can ask is described. A method is presented to represent the dynamic processes of a subject matter area by augmented finite state automata, which permits efficient inferencing about dynamic processes and…
77 FR 10662 - Guidance for Industry: Questions and Answers Regarding Establishment and Maintenance of Records...

Federal Register 2010, 2011, 2012, 2013, 2014

2012-02-23

... Records by Persons Who Manufacture, Process, Pack, Transport, Distribute, Receive, Hold, or Import Food... ``Questions and Answers Regarding Establishment and Maintenance of Records by Persons Who Manufacture, Process... updated information pertaining to the establishment and maintenance of records by persons who manufacture...
"The new history of psychology: Some (different) answers to Lovett's five questions": Correction to Brock (2017).

PubMed

2017-05-01

Reports an error in "The New History of Psychology: Some (Different) Answers to Lovett's Five Questions" by Adrian C. Brock ( History of Psychology , Advanced Online Publication, Jun 27, 2016, np). In this article there was an error in the 11th paragraph of the Lovett's Five Questions for the New Historians section. The conference paper "The "new" history of science: Implications for philosophy of science" by Rachel Laudan (1992) was wrongly attributed to her husband, Larry Laudan. All versions of this article have been corrected. (The following abstract of the original article appeared in record 2016-31594-001.) The professionalization of the history of psychology from the 1960s led to significant changes in the way that history was written. Several authors tried to summarize these changes in the 1980s, and Laurel Furumoto's (1989) G. Stanley Hall lecture, "The new history of psychology" is the best-known example of this genre. This journal published a critique of the new history by Benjamin R. Lovett (2006) with the title, "The new history of psychology: A review and critique," and it is still being cited as an authoritative source. The article consists of 3 parts. First, the author attempts to show that the new history is not as different from the old as its proponents claim. He then discusses some problems that he considers to be unique to the new history, and he presents them in the form of 5 questions for the new historians, which he then goes on to answer himself. Finally, he discusses the problematic relationship between critical history and psychology. This article is a reply to Lovett's article. The author argues that the new history is different from the old in every way that Lovett claims that it is not. It critically analyzes Lovett's answers to his own 5 questions and offers some alternative answers to these questions. It also suggests that many psychologist-historians are opposed to new history of psychology, especially in its critical versions, and
Violations of information structure: an electrophysiological study of answers to wh-questions.

PubMed

Cowles, H W; Kluender, Robert; Kutas, Marta; Polinsky, Maria

2007-09-01

This study investigates brain responses to violations of information structure in wh-question-answer pairs, with particular emphasis on violations of focus assignment in it-clefts (It was the queen that silenced the banker). Two types of ERP responses in answers to wh-questions were found. First, all words in the focus-marking (cleft) position elicited a large positivity (P3b) characteristic of sentence-final constituents, as did the final words of these sentences, which suggests that focused elements may trigger integration effects like those seen at sentence end. Second, the focusing of an inappropriate referent elicited a smaller, N400-like effect. The results show that comprehenders actively use structural focus cues and discourse-level restrictions during online sentence processing. These results, based on visual stimuli, were different from the brain response to auditory focus violations indicated by pitch-accent [Hruska, C., Steinhauer, K., Alter, K., & Steube, A. (2000). ERP effects of sentence accents and violations of the information structure. In Poster presented at the 13th annual CUNY conference on human sentence processing, San Diego, CA.], but similar to brain responses to newly introduced discourse referents [Bornkessel, I., Schlesewsky, M., & Friederici, A. (2003). Contextual information modulated initial processes of syntactic integration: the role of inter- versus intrasentential predictions. Journal of Experimental Psychology: Learning, Memory and Cognition, 29, 871-882.].
INDUSTRIAL CONTROL SYSTEM CYBER SECURITY: QUESTIONS AND ANSWERS RELEVANT TO NUCLEAR FACILITIES, SAFEGUARDS AND SECURITY

DOE Office of Scientific and Technical Information (OSTI.GOV)

Robert S. Anderson; Mark Schanfein; Trond Bjornard

2011-07-01

Typical questions surrounding industrial control system (ICS) cyber security always lead back to: What could a cyber attack do to my system(s) and; how much should I worry about it? These two leading questions represent only a fraction of questions asked when discussing cyber security as it applies to any program, company, business, or organization. The intent of this paper is to open a dialog of important pertinent questions and answers that managers of nuclear facilities engaged in nuclear facility security and safeguards should examine, i.e., what questions should be asked; and how do the answers affect an organization's abilitymore » to effectively safeguard and secure nuclear material. When a cyber intrusion is reported, what does that mean? Can an intrusion be detected or go un-noticed? Are nuclear security or safeguards systems potentially vulnerable? What about the digital systems employed in process monitoring, and international safeguards? Organizations expend considerable efforts to ensure that their facilities can maintain continuity of operations against physical threats. However, cyber threats particularly on ICSs may not be well known or understood, and often do not receive adequate attention. With the disclosure of the Stuxnet virus that has recently attacked nuclear infrastructure, many organizations have recognized the need for an urgent interest in cyber attacks and defenses against them. Several questions arise including discussions about the insider threat, adequate cyber protections, program readiness, encryption, and many more. These questions, among others, are discussed so as to raise the awareness and shed light on ways to protect nuclear facilities and materials against such attacks.« less
EBM apps that help you search for answers to your clinical questions.

PubMed

Windish, Donna

2014-06-01

In the age of smartphones and tablets, it has become common place to find apps that help you do or find almost anything. The quality and breadth of medical apps has improved greatly in recent years. You can now find medical apps that recreate textbooks, search for current articles, calculate likelihood ratios and find point-of-care answers to clinical questions. This article describes and reviews apps aimed at helping clinicians search for evidence to support the practice of EBM.
Are Faculty Predictions or Item Taxonomies Useful for Estimating the Outcome of Multiple-Choice Examinations?

ERIC Educational Resources Information Center

Kibble, Jonathan D.; Johnson, Teresa

2011-01-01

The purpose of this study was to evaluate whether multiple-choice item difficulty could be predicted either by a subjective judgment by the question author or by applying a learning taxonomy to the items. Eight physiology faculty members teaching an upper-level undergraduate human physiology course consented to participate in the study. The…
Interspecific competition in plants: how well do current methods answer fundamental questions?

PubMed

Connolly, J; Wayne, P; Bazzaz, F A

2001-02-01

Accurately quantifying and interpreting the processes and outcomes of competition among plants is essential for evaluating theories of plant community organization and evolution. We argue that many current experimental approaches to quantifying competitive interactions introduce size bias, which may significantly impact the quantitative and qualitative conclusions drawn from studies. Size bias generally arises when estimates of competitive ability are erroneously influenced by the initial size of competing individuals. We employ a series of quantitative thought experiments to demonstrate the potential for size bias in analysis of four traditional experimental designs (pairwise, replacement series, additive series, and response surfaces) either when only final measurements are available or when both initial and final measurements are collected. We distinguish three questions relevant to describing competitive interactions: Which species dominates? Which species gains? and How do species affect each other? The choice of experimental design and measurements greatly influences the scope of inference permitted. Conditions under which the latter two questions can give biased information are tabulated. We outline a new approach to characterizing competition that avoids size bias and that improves the concordance between research question and experimental design. The implications of the choice of size metrics used to quantify both the initial state and the responses of elements in interspecific mixtures are discussed. The relevance of size bias in competition studies with organisms other than plants is also discussed.
"The Panama Canal Episode: An Encounter with a Question and Answers." Occasional Paper 3.

ERIC Educational Resources Information Center

Seifman, Eli

This is an account of the experience of a college instructor and a group of prospective social studies teachers as they answer a simple question concerned with direction of travel through the Panama Canal and explore the reactions of students. The situation originates in a class discussion focusing on ways of asking and responding to classroom…
Do-It-Yourself Learning Games: Software That Lets You Pick the Questions--and Answers.

ERIC Educational Resources Information Center

Hively, Wells

1984-01-01

Reviews user-adaptable learning games that can be customized for any subject, including Tic Tac Show and the Game Show from Computer Advanced Ideas, which are question-answer learning programs based on game shows, and Master Match from Computer Advanced Ideas and Square Pairs from Scholastic Inc., which are based on the card game Concentration.…
Surface Coating of Wood Building Products National Emission Standards for Hazardous Air Pollutants (NESHAP) Questions and Answers (Q&A's)

EPA Pesticide Factsheets

This September 2004 document contains questions and answers on the Surface Coating of Wood Building Products National Emission Standards for Hazardous Air Pollutants (NESHAP) regulation. The questions cover topics such as compliance, and applicability, etc
Municipal Solid Waste Landfill New Source Performance Standards (NSPS) and Emission Guidelines (EG) -- Questions and Answers

EPA Pesticide Factsheets

This November 1998 document of questions and answers are provided as a guide for those subject to the new source performance standards (NSPS) or emission guidelines (EG), as well as those implementing the NSPS or EG.
How well do websites concerning children's anxiety answer parents' questions about treatment choices?

PubMed

Reynolds, Kristin A; Walker, John R; Walsh, Kate

2015-10-01

The goals of this study were to evaluate the quality of information concerning anxiety disorders in children that is available on the Internet and to evaluate changes in the quality of website information over time. The authors identified websites addressing child anxiety disorders (N = 26) using a Google search and recommendations from an expert in child anxiety. Each website was evaluated on the extent to which it addressed questions that parents consider important, the quality of information, and the reading level. All websites provided adequate information describing treatment options; however, fewer websites had information addressing many questions that are important to parents, including the duration of treatment, what happens when treatment stops, and the benefits and risks of various treatments. Many websites provided inadequate information on pharmacological treatment. Most websites were of moderate quality and had more difficult reading levels than is recommended. Five years after the initial assessment, authors re-analyzed the websites in order to investigate changes in content over time. The content of only six websites had been updated since the original analysis, the majority of which improved on the three aforementioned areas of evaluation. Websites could be strengthened by providing important information that would support parent decision-making. © The Author(s) 2014.
Positive vs. Negative: The Impact of Question Polarity in Voting Advice Applications

PubMed Central

Krouwel, André; van de Pol, Jasper; de Vreese, Claes

2016-01-01

Online Voting Advice Applications (VAAs) are survey-like instruments that help citizens to shape their political preferences and compare them with those of political parties. Especially in multi-party democracies, their increasing popularity indicates that VAAs play an important role in opinion formation for citizens, as well as in the public debate prior to elections. Hence, the objectivity and transparency of VAAs are crucial. In the design of VAAs, many choices have to be made. Extant research in survey methodology shows that the seemingly arbitrary choice to word questions positively (e.g., ‘The city council should allow cars into the city centre’) or negatively (‘The city council should ban cars from the city centre’) systematically affects the answers. This asymmetry in answers is in line with work on negativity bias in other areas of linguistics and psychology. Building on these findings, this study investigated whether question polarity also affects the answers to VAA statements. In a field experiment (N = 31,112) during the Dutch municipal elections we analysed the effects of polarity for 16 out of 30 VAA statements with a large variety of linguistic contrasts. Analyses show a significant effect of question wording for questions containing a wide range of implicit negations (such as ‘forbid’ vs. ‘allow’), as well as for questions with explicit negations (e.g., ‘not’). These effects of question polarity are found especially for VAA users with lower levels of political sophistication. As these citizens are an important target group for Voting Advice Applications, this stresses the need for VAA builders to be sensitive to wording choices when designing VAAs. This study is the first to show such consistent wording effects not only for political attitude questions with implicit negations in VAAs, but also for political questions containing explicit negations. PMID:27723776
Second Life for Electric Vehicle Batteries: Answering Questions on Battery Degradation and Value

DOE Office of Scientific and Technical Information (OSTI.GOV)

Neubauer, J. S.; Wood, E.; Pesaran, A.

2015-05-04

Battery second use – putting used plug-in electric vehicle (PEV) batteries into secondary service following their automotive tenure – has been proposed as a means to decrease the cost of PEVs while providing low cost energy storage to other fields (e.g. electric utility markets). To understand the value of used automotive batteries, however, we must first answer several key questions related to National Renewable Energy Laboratory (NREL) has developed a methodology and the requisite tools to answer these questions, including NREL’s Battery Lifetime Simulation Tool (BLAST). Herein we introduce these methods and tools, and demonstrate their application. We have foundmore » that capacity fade from automotive use has a much larger impact on second use value than resistance growth. Where capacity loss is driven by calendar effects more than cycling effects, average battery temperature during automotive service – which is often driven by climate – is found to be the single factor with the largest effect on remaining value. Installing hardware and software capabilities onboard the vehicle that can both infer remaining battery capacity from in-situ measurements, as well as track average battery temperature over time, will thereby facilitate the second use of automotive batteries.« less
Gender differences in response to questions on the australian national chemistry quiz

NASA Astrophysics Data System (ADS)

Walding, Richard; Fogliani, Charles; Over, Ray; Bain, John D.

In contrast to the attention given to the relative levels of achievement of boys and girls in mathematics, the question of whether there are sex differences in the solution of chemistry questions has not attracted much attention. This study compares the performance of boys and girls in the Australian National Chemistry Quiz (Chem Quiz), a multiple-choice test conducted by the Royal Australian Chemical Institute. The analyses were based on results from 27,000 students in Years 11 and 12 and 16,000 students in Year 10 who completed the Chem Quiz in 1991. Although some questions in the Chem Quiz were solved equally well by boys and girls, on many questions boys outperformed girls. The extreme case was a question answered correctly by 67% of Year 10 boys in contrast to 48% of Year 10 girls. Several reasons why boys and girls might differ in the rates they solve at least some chemistry questions are discussed, and directions for identifying the nature, extent, and basis for sex differences are outlined.

The Effects of Self-Explanation and Reading Questions and Answers on Learning Computer Programming Language

ERIC Educational Resources Information Center

Lee, Nancy

2013-01-01

The current study explored the differential effects of two learning strategies, self-explanation and reading questions and answers, on students' test performance in the computer programming language JavaScript. Students' perceptions toward the two strategies as to their effectiveness in learning JavaScript was also explored by examining students'…
Providing Services for Students Who Are Hard of Hearing in Postsecondary Education: Questions and Answers.

ERIC Educational Resources Information Center

Rawlinson, Sharaine; Trychin, Sam; Davis, Cheryl; Brennan-Dore, Corinne

This booklet, in question-and-answer format, is intended to guide service providers in colleges and universities in supplying required special services to students who are hard of hearing. Introductory material explains the mission and objectives of PEPNet, which is to provide the coordination and collaboration in technical assistance to…
Use of a Social Question Answering Application in a Face-to-Face College Biology Class

ERIC Educational Resources Information Center

Grasso, SandraJean M.

2017-01-01

University students use social media tools not only to connect with friends socially but also to collaborate with classmates. Many universities have embraced academically-focused social media platforms such as social question answering (SQA) applications to make student interactions easier. This study addresses how students in a face-to-face…
Personality Factors and Occupational Specialty Choice.

ERIC Educational Resources Information Center

Borges, Nicole J.; Jones, Bonnie J.

This study is a continuation of an earlier investigation of personality and medical specialty choice. The earlier study determined that personality differences existed among family practitioners, anesthesiologists, and general surgeons. Based on this initial research, an attempt was made to answer the question of how the personality factors of…
29 CFR 2509.75-8 - Questions and answers relating to fiduciary responsibility under the Employee Retirement Income...

Code of Federal Regulations, 2012 CFR

2012-07-01

... answers, relating them to the appropriate sections of the Act, is also provided. Index Key to question... reason to doubt the competence, integrity or responsibility of such persons. FR-12 Q: How many...
29 CFR 2509.75-8 - Questions and answers relating to fiduciary responsibility under the Employee Retirement Income...

Code of Federal Regulations, 2013 CFR

2013-07-01

... answers, relating them to the appropriate sections of the Act, is also provided. Index Key to question... reason to doubt the competence, integrity or responsibility of such persons. FR-12 Q: How many...
29 CFR 2509.75-8 - Questions and answers relating to fiduciary responsibility under the Employee Retirement Income...

Code of Federal Regulations, 2014 CFR

2014-07-01

... answers, relating them to the appropriate sections of the Act, is also provided. Index Key to question... reason to doubt the competence, integrity or responsibility of such persons. FR-12 Q: How many...
National Emissions Standards for Hazardous Air Pollutants (NESHAP) for Area Source Standards for Prepared Feeds Manufacturing: Commonly Asked Questions and Answers

EPA Pesticide Factsheets

This 2011 document answers common questions about the NESHAP for Area Sources for Prepared Feeds Manufacturing. The questions range in topics including applicability, specific requirements, and recordkeeping.
75 FR 29350 - Draft Guidance for Industry: Questions and Answers Regarding the Reportable Food Registry as...

Federal Register 2010, 2011, 2012, 2013, 2014

2010-05-25

...] Draft Guidance for Industry: Questions and Answers Regarding the Reportable Food Registry as Established.... The agency is also seeking comments from industry on the Reportable Food Registry requirements, and... the implementation of the Reportable Food Registry on September 8, 2009, and informs industry about...
Questioning the answer: questioning style, choice and self-determination in interactions with young people with intellectual disabilities*

PubMed Central

Pilnick, Alison; Clegg, Jennifer; Murphy, Elizabeth; Almack, Kathryn

2010-01-01

For young people with intellectual disabilities (ID), the transition from children's to adult services has long been recognised as a challenging move. One of the aims of the White Paper Valuing People (2001) was to address some of the problems associated with this transition. This paper reports on data from a project which examines the impact of these service changes, and the ways in which transition is negotiated by carers, professionals and users. It presents a conversation analysis of eight tape-recorded formal review meetings at which transition to adult services is discussed. It takes as its starting point the existing interactional work on ID and the way in which this demonstrates the effects of the local and contextual specifics of particular kinds of interaction on the eventual outcomes (e.g. Rapley 2004, Antaki 2001, Maynard and Marlaire 1992). We show that an attempt to allow self-determination in the context of transitions can paradoxically result in undermining user choice and control. We also argue that, while a rule-based approach to practice may offer moral clarity for professionals, it can result in interactional and practical difficulties which cannot be easily reconciled. PMID:20415789
Data Mining Student Choices: A New Approach to Business Curriculum Planning

ERIC Educational Resources Information Center

Maldonado, Edgar; Seehusen, Vicky

2018-01-01

The authors used a clustering technique to analyze business course choices made by students who completed an individualized degree in a large, urban, public university. They looked for patterns to answer the research question, "What can we learn from students' choices to inform the curricular redesign process in business programs?" The…
Rubella: Questions and Answers

MedlinePlus

... of special precautions. Does the MMR vaccine cause autism? There is no scientific evidence that measles, MMR, ... other vaccine causes or increases the risk of autism. The question about a possible link between MMR ...
Manipulations of Choice Familiarity in Multiple-Choice Testing Support a Retrieval Practice Account of the Testing Effect

ERIC Educational Resources Information Center

Jang, Yoonhee; Pashler, Hal; Huber, David E.

2014-01-01

We performed 4 experiments assessing the learning that occurs when taking a test. Our experiments used multiple-choice tests because the processes deployed during testing can be manipulated by varying the nature of the choice alternatives. Previous research revealed that a multiple-choice test that includes "none of the above" (NOTA)…
Nested Logit Models for Multiple-Choice Item Response Data

ERIC Educational Resources Information Center

Suh, Youngsuk; Bolt, Daniel M.

2010-01-01

Nested logit item response models for multiple-choice data are presented. Relative to previous models, the new models are suggested to provide a better approximation to multiple-choice items where the application of a solution strategy precedes consideration of response options. In practice, the models also accommodate collapsibility across all…
Preparing for the Flu During the 2009-10 School Year: Questions and Answers for Schools

ERIC Educational Resources Information Center

US Department of Education, 2009

2009-01-01

This brochure provides answers to the following questions: (1) Why do school districts, schools, teachers, parents, and communities need to plan for the continuation of learning for students during flu season this year? (2) How should districts and schools go about planning to continue students' education when they are at home because of H1N1?…
Plasticity and Adult Neurogenesis in Amphibians and Reptiles: More Questions than Answers.

PubMed

Powers, Alice Schade

2016-08-24

Studies of the relationship between behavioral plasticity and new cells in the adult brain in amphibians and reptiles are sparse but demonstrate that environmental and hormonal variables do have an effect on the amount of cell proliferation and/or migration. The variables that are reviewed here are: enriched environment, social stimulation, spatial area use, season, photoperiod and temperature, and testosterone. Fewer data are available for amphibians than for reptiles, but for both groups many issues are still to be resolved. It is to be hoped that the questions raised here will generate more answers in future studies. © 2016 S. Karger AG, Basel.
Classifying Chinese Questions Related to Health Care Posted by Consumers Via the Internet.

PubMed

Guo, Haihong; Na, Xu; Hou, Li; Li, Jiao

2017-06-20

In question answering (QA) system development, question classification is crucial for identifying information needs and improving the accuracy of returned answers. Although the questions are domain-specific, they are asked by non-professionals, making the question classification task more challenging. This study aimed to classify health care-related questions posted by the general public (Chinese speakers) on the Internet. A topic-based classification schema for health-related questions was built by manually annotating randomly selected questions. The Kappa statistic was used to measure the interrater reliability of multiple annotation results. Using the above corpus, we developed a machine-learning method to automatically classify these questions into one of the following six classes: Condition Management, Healthy Lifestyle, Diagnosis, Health Provider Choice, Treatment, and Epidemiology. The consumer health question schema was developed with a four-hierarchical-level of specificity, comprising 48 quaternary categories and 35 annotation rules. The 2000 sample questions were coded with 2000 major codes and 607 minor codes. Using natural language processing techniques, we expressed the Chinese questions as a set of lexical, grammatical, and semantic features. Furthermore, the effective features were selected to improve the question classification performance. From the 6-category classification results, we achieved an average precision of 91.41%, recall of 89.62%, and F 1 score of 90.24%. In this study, we developed an automatic method to classify questions related to Chinese health care posted by the general public. It enables Artificial Intelligence (AI) agents to understand Internet users' information needs on health care. ©Haihong Guo, Xu Na, Li Hou, Jiao Li. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 20.06.2017.
The Positive and Negative Consequences of Multiple-Choice Testing

ERIC Educational Resources Information Center

Roediger, Henry L.; Marsh, Elizabeth J.

2005-01-01

Multiple-choice tests are commonly used in educational settings but with unknown effects on students' knowledge. The authors examined the consequences of taking a multiple-choice test on a later general knowledge test in which students were warned not to guess. A large positive testing effect was obtained: Prior testing of facts aided final…
Test Pool Questions, Area III.

ERIC Educational Resources Information Center

Sloan, Jamee Reid

This manual contains multiple choice questions to be used in testing students on nurse training objectives. Each test includes several questions covering each concept. The concepts in section A, medical surgical nursing, are diseases of the following systems: musculoskeletal; central nervous; cardiovascular; gastrointestinal; urinary and male…
Answers to the Most Frequently Asked Questions about Reinspections under the AHERA Asbestos-In-Schools Rule.

ERIC Educational Resources Information Center

Environmental Protection Agency, Washington, DC. Office of Toxic Substances.

This document was prepared in response to inquiries that have been received by the Environmental Protection Agency concerning the reinspection requirements and related provisions of the Asbestos Hazard Emergency Response Act (AHERA) regulations. The answers developed represent the Agency's responses to the 15 most frequently asked questions to…

Reducing the Need for Guesswork in Multiple-Choice Tests

ERIC Educational Resources Information Center

Bush, Martin

2015-01-01

The humble multiple-choice test is very widely used within education at all levels, but its susceptibility to guesswork makes it a suboptimal assessment tool. The reliability of a multiple-choice test is partly governed by the number of items it contains; however, longer tests are more time consuming to take, and for some subject areas, it can be…
Egg Ambassadors: Answering Consumer Questions

USDA-ARS?s Scientific Manuscript database

Food can be a touchy subject. It seems people either have very strong thoughts and opinions on food or they could care less as long as food is available to feed them and their families. With the current economic environment, many individuals are examining food choices more closely to ensure the gr...
Area Source Boiler National Emission Standards for Hazardous Air Pollutants (NESHAP), 40 CFR Part 63, Subpart JJJJJJ: Questions and Answers

EPA Pesticide Factsheets

This October 2016 question and answer (Q&A) document is in response to a number of questions the EPA has received from delegated state and local agencies and the regulated community regarding the NESHAP for Area source boilers. Document updates 4/2014 PDF.
[Dental care in pregnancy. Ten questions and answers].

PubMed

Patcas, Raphael; Schmidlin, Patrick R; Zimmermann, Roland; Gnoinski, Wanda

2012-01-01

Dental care of pregnant patients is a demanding task. On one hand, clinicians are facing patients with an altered physiology that may cause a greater need for treatment. On the other hand, pregnancy in itself as well as the unborn child involves potential contraindications to dental interventions. It is therefore essential that dentists be knowledgeable of the ramifications pregnancy has on medical findings and therapy. Also, clinicians must be able to conduct their treatment based on well-grounded data to avoid any harm to the pregnant woman and her unborn child. This article focuses on facts specifically relevant to clinicians. Based on most current scientific data, we aim to answer the following ten questions: 1. What are the physiological changes during pregnancy? 2. What is the adequate lying position for a pregnant patient? 3. Is there a pregnancy-related gingivitis? 4. What is the association between periodontitis, pregnancy and preterm birth? 5. Are there oral manifestations of pregnancy-related therapies? 6. Are caries and erosions inevitable during pregnancy? 7. Should the intake of fluoride be advocated? 8. Is it permissible to x-ray pregnant patients? 9. Is orthodontics contraindicated during pregnancy and 10. Which medication should be administered with caution?
Doing Science and Asking Questions II: An Exercise That Generates Questions

NASA Astrophysics Data System (ADS)

Hurt Middlecamp, Catherine; Nickel, Anne-Marie L.

2005-08-01

Given the importance of questions in science, it is critical that students learn to ask questions as well as learning to answer them. This paper describes a classroom exercise to help students better ask their own questions. It has been classroom-tested in multiple formats and has also been used for curriculum development workshops for faculty. This exercise in creating questions can be easily customized to suit different instructional contexts; some variations are outlined. More broadly, this paper also discusses the pedagogical significance of questioning, raising four salient points: (1) learners are more likely to have a personal interest in the questions they raise; (2) questions can serve as entry points for issues relating to ethnicity and gender; (3) questions give control to the person who asks them; and (4) questions can challenge existing structures, categories, and norms.
A rapid evidence-based service by librarians provided information to answer primary care clinical questions.

PubMed

McGowan, Jessie; Hogg, William; Rader, Tamara; Salzwedel, Doug; Worster, Danielle; Cogo, Elise; Rowan, Margo

2010-03-01

A librarian consultation service was offered to 88 primary care clinicians during office hours. This included a streamlined evidence-based process to answer questions in fewer than 20 min. This included a contact centre accessed through a Web-based platform and using hand-held devices and computers with Web access. Librarians were given technical training in evidence-based medicine, including how to summarise evidence. To describe the process and lessons learned from developing and operating a rapid response librarian consultation service for primary care clinicians. Evaluation included librarian interviews and a clinician exit satisfaction survey. Clinicians were positive about its impact on their clinical practice and decision making. The project revealed some important 'lessons learned' in the clinical use of hand-held devices, knowledge translation and training for clinicians and librarians. The Just-in-Time Librarian Consultation Service showed that it was possible to provide evidence-based answers to clinical questions in 15 min or less. The project overcame a number of barriers using innovative solutions. There are many opportunities to build on this experience for future joint projects of librarians and healthcare providers.
Connecting cognition and consumer choice.

PubMed

Bartels, Daniel M; Johnson, Eric J

2015-02-01

We describe what can be gained from connecting cognition and consumer choice by discussing two contexts ripe for interaction between the two fields. The first-context effects on choice-has already been addressed by cognitive science yielding insights about cognitive process but there is promise for more interaction. The second is learning and representation in choice where relevant theories in cognitive science could be informed by consumer choice, and in return, could pose and answer new questions. We conclude by discussing how these two fields of research stand to benefit from more interaction, citing examples of how interfaces of cognitive science with other fields have been illuminating for theories of cognition. Copyright © 2014 Elsevier B.V. All rights reserved.
Helping physics teacher-candidates develop questioning skills through innovative technology use

NASA Astrophysics Data System (ADS)

Milner-Bolotin, Marina

2015-12-01

Peer Instruction has been used successfully in undergraduate classrooms for decades. Its success depends largely on the quality of multiple-choice questions. Yet it is still rare in secondary schools because of teachers' lack of experience in designing, evaluating, and implementing conceptual questions. Research-based multiple-choice conceptual questions are also underutilized in physics teacher education. This study explores the implementation of Peer Instruction enhanced by PeerWise collaborative online system, in a physics methods course in a physics teacher education program.
Predicting social and communicative ability in school-age children with autism spectrum disorder: A pilot study of the Social Attribution Task, Multiple Choice.

PubMed

Burger-Caplan, Rebecca; Saulnier, Celine; Jones, Warren; Klin, Ami

2016-11-01

The Social Attribution Task, Multiple Choice is introduced as a measure of implicit social cognitive ability in children, addressing a key challenge in quantification of social cognitive function in autism spectrum disorder, whereby individuals can often be successful in explicit social scenarios, despite marked social adaptive deficits. The 19-question Social Attribution Task, Multiple Choice, which presents ambiguous stimuli meant to elicit social attribution, was administered to children with autism spectrum disorder (N = 23) and to age-matched and verbal IQ-matched typically developing children (N = 57). The Social Attribution Task, Multiple Choice performance differed between autism spectrum disorder and typically developing groups, with typically developing children performing significantly better than children with autism spectrum disorder. The Social Attribution Task, Multiple Choice scores were positively correlated with age (r = 0.474) while being independent from verbal IQ (r = 0.236). The Social Attribution Task, Multiple Choice was strongly correlated with Vineland Adaptive Behavior Scales Communication (r = 0.464) and Socialization (r = 0.482) scores, but not with Daily Living Skills scores (r = 0.116), suggesting that the implicit social cognitive ability underlying performance on the Social Attribution Task, Multiple Choice is associated with real-life social adaptive function. © The Author(s) 2016.
Computer Analysis in HSC German

ERIC Educational Resources Information Center

Clutterbuck, Michael; Mowchanuk, Timothy

1977-01-01

In October, 1976, a new type of question was introduced into the Victorian HSC German test: A listening comprehension question with multiple-choice answers has replaced the written reproduction question. Results of a computer analysis of the answers given in the exam are reported. (SW)
Multiple-choice examinations: adopting an evidence-based approach to exam technique.

PubMed

Hammond, E J; McIndoe, A K; Sansome, A J; Spargo, P M

1998-11-01

Negatively marked multiple-choice questions (MCQs) are part of the assessment process in both the Primary and Final examinations for the fellowship of the Royal College of Anaesthetists. It is said that candidates who guess will lose marks in the MCQ paper. We studied candidates attending a pre-examination revision course and have shown that an evaluation of examination technique is an important part of an individual's preparation. All candidates benefited substantially from backing their educated guesses while only 3 out of 27 lost marks from backing their wild guesses. Failure to appreciate the relationship between knowledge and technique may significantly affect a candidate's performance in the examination.
Exploring undergraduates' understanding of photosynthesis using diagnostic question clusters.

PubMed

Parker, Joyce M; Anderson, Charles W; Heidemann, Merle; Merrill, John; Merritt, Brett; Richmond, Gail; Urban-Lurain, Mark

2012-01-01

We present a diagnostic question cluster (DQC) that assesses undergraduates' thinking about photosynthesis. This assessment tool is not designed to identify individual misconceptions. Rather, it is focused on students' abilities to apply basic concepts about photosynthesis by reasoning with a coordinated set of practices based on a few scientific principles: conservation of matter, conservation of energy, and the hierarchical nature of biological systems. Data on students' responses to the cluster items and uses of some of the questions in multiple-choice, multiple-true/false, and essay formats are compared. A cross-over study indicates that the multiple-true/false format shows promise as a machine-gradable format that identifies students who have a mixture of accurate and inaccurate ideas. In addition, interviews with students about their choices on three multiple-choice questions reveal the fragility of students' understanding. Collectively, the data show that many undergraduates lack both a basic understanding of the role of photosynthesis in plant metabolism and the ability to reason with scientific principles when learning new content. Implications for instruction are discussed.
Exploring Undergraduates' Understanding of Photosynthesis Using Diagnostic Question Clusters

PubMed Central

Parker, Joyce M.; Anderson, Charles W.; Heidemann, Merle; Merrill, John; Merritt, Brett; Richmond, Gail; Urban-Lurain, Mark

2012-01-01

We present a diagnostic question cluster (DQC) that assesses undergraduates' thinking about photosynthesis. This assessment tool is not designed to identify individual misconceptions. Rather, it is focused on students' abilities to apply basic concepts about photosynthesis by reasoning with a coordinated set of practices based on a few scientific principles: conservation of matter, conservation of energy, and the hierarchical nature of biological systems. Data on students' responses to the cluster items and uses of some of the questions in multiple-choice, multiple-true/false, and essay formats are compared. A cross-over study indicates that the multiple-true/false format shows promise as a machine-gradable format that identifies students who have a mixture of accurate and inaccurate ideas. In addition, interviews with students about their choices on three multiple-choice questions reveal the fragility of students' understanding. Collectively, the data show that many undergraduates lack both a basic understanding of the role of photosynthesis in plant metabolism and the ability to reason with scientific principles when learning new content. Implications for instruction are discussed. PMID:22383617
Questions and Answers: EPA's Guidelines for Carcinogen Risk Assessment and Supplemental Guidance from Assessing Susceptibility from Early-Life Exposure to Carcinogens

EPA Science Inventory

March 29, 2005
EPA's Guidelines for Carcinogen Risk Assessment
And Supplemental Guidance from Assessing Susceptibility from Early-life
Exposure to Carcinogens

Questions and Answers

The following questions ...
Questionnaires for eliciting evaluation data from users of interactive question answering

DOE Office of Scientific and Technical Information (OSTI.GOV)

Kelly, Diane; Kantor, Paul B.; Morse, Emile

Evaluating interactive question answering (QA) systems with real users can be challenging because traditional evaluation measures based on the relevance of items returned are difficult to employ since relevance judgments can be unstable in multi-user evaluations. The work reported in this paper evaluates, in distinguishing among a set of interactive QA systems, the effectiveness of three questionnaires: a Cognitive Workload Questionnaire (NASA TLX), and Task and System Questionnaires customized to a specific interactive QA application. These Questionnaires were evaluated with four systems, seven analysts, and eight scenarios during a 2-week workshop. Overall, results demonstrate that all three Questionnaires are effectivemore » at distinguishing among systems, with the Task Questionnaire being the most sensitive. Results also provide initial support for the validity and reliability of the Questionnaires.« less
"Remember to Hand out Medals": Peer Rating and Expertise in a Question-and-Answer Study Group

ERIC Educational Resources Information Center

Ponti, Marisa

2015-01-01

This article reports on an exploratory study of giving medals as part of a peer rating system in a question-and-answer (Q&A) study group on Python, a programming language. There are no professional teachers tutoring learners. The study aimed to understand whether and how medals, awarded to responses in a peer-based learning environment, can…
On the Equivalence of Constructed-Response and Multiple-Choice Tests.

ERIC Educational Resources Information Center

Traub, Ross E.; Fisher, Charles W.

Two sets of mathematical reasoning and two sets of verbal comprehension items were cast into each of three formats--constructed response, standard multiple-choice, and Coombs multiple-choice--in order to assess whether tests with indentical content but different formats measure the same attribute, except for possible differences in error variance…
78 FR 29140 - Center for Devices and Radiological Health Appeals Processes: Questions and Answers About 517A...

Federal Register 2010, 2011, 2012, 2013, 2014

2013-05-17

... availability of the draft guidance entitled ``Center for Devices and Radiological Health (CDRH) Appeals Processes: Questions and Answers About 517A.'' This draft document provides CDRH's proposed interpretation... decisions and actions taken by CDRH. This draft guidance is not final nor is it in effect at this time...
Getting Ready for the "School of the Future": Key Questions and Tentative Answers

NASA Astrophysics Data System (ADS)

Ott, Michela; Pozzi, Francesca

This paper explores some key aspects of "today's school", as opposed to those that have characterized "yesterday's school", with the final aim of shedding light on "tomorrow's school". In this direction, the paper puts forward tentative answers to some key questions related to the new characteristics and roles of teachers and students (main actors of the learning process) and the new features/ potentialities of contemporary educational tools which, in turn, require the enactment of innovative pedagogical approaches and educational methods. The emerging picture of the present learning landscape helps in figuring out a future situation where learning possibilities are substantially increased.
Extracting Exact Answers to Questions Based on Structural Links

DTIC Science & Technology

2002-01-01

type of asking point and answer point (e.g. NePerson asking point matches NePerson and its sub-types NeMan and NeWoman; ‘how’ matches manner-modifier...NePerson V-S win [John Smith]/ NeMan Some sample results are given in section 4 to illustrate how answer-points are identified based on matching binary

Questioning collectives and agencies: a commentary on curricular choices

NASA Astrophysics Data System (ADS)

Arnold, Jenny

2015-06-01

This commentary explores theoretical alternatives for viewing the problem identified by Volny Fages and Virginie Albe in their article entitled Social issues in nanoscience and nanotechnology Master's degrees: The socio-political stakes of curricular choices. An approach to social research is suggested that would render visible the associations maintaining the states of affairs depicted by Fages and Albe. In their research, Fages and Albe identified conceptions of the relationship between scientific endeavour and social concerns to be at the root of "choices" made by coordinators of Masters programs in nano science and technology in universities selected for their study. Albe and Fages, insiders in the sense that they take responsibility for a particular program within one such course, convey their belief that, "future scientists need to identify, accept and take on board the social responsibilities linked to their own practice of science, and to work collectively for a more democratic division of power regarding socio-technical choices". However, many of the Master's programs reviewed in their research were reported as providing limited opportunities for their students to critically engage with social aspects of scientific work. This commentary questions the notion of "choices" used in their research and proposes Actor-Network Theory as a theoretical framework open to the existence of various human and non-human agencies at work when a "choice" is made. The aim of the commentary is to further Fages and Albe's agenda by calling for understanding and ultimately a reassembling of the state of affairs in a way that would be acceptable to those invested.
Promoting an active form of learning out-of-class via answering online “study questions” leads to higher than expected exam scores in General Biology

PubMed Central

2015-01-01

A rising need for workers in science, technology, engineering and mathematics (STEM) fields has fueled interest in improving teaching within STEM disciplines. Numerous studies have demonstrated the benefits of active learning approaches on student learning outcomes. However, many of these studies have been conducted in experimental, rather than real-life class, settings. In addition, most of these studies have focused on in-class active learning exercises. This study tested the effects of answering questions outside of class on exam performance for General Biology students at the University of Minnesota. An online database of 1,020 multiple-choice questions covering material from the first half of the course was generated. Students in seven course sections (with an average of ∼265 students per section) were given unlimited access to the online study questions. These students made extensive use of the online questions, with students answering an average of 1,323 questions covering material from the half of the semester for which the questions were available. After students answered a set of questions, they were shown the correct answers for those questions. More specific feedback describing how to arrive at the correct answer was provided for the 73% of the questions for which the correct answers were not deemed to be self-explanatory. The extent to which access to the online study questions improved student learning outcomes was assessed by comparing the performance on exam questions of students in the seven course sections with access to the online study questions with the performance of students in course sections without access to the online study questions. Student performance was analyzed for a total of 89 different exams questions that were not included in the study questions, but that covered the same material covered by the study questions. Each of these 89 questions was used on one to five exams given to students in course sections that had access to the
[What Can We Learn from the English Primary Schools? Questions and Answers from My Fulbright Administrative Exchange.

ERIC Educational Resources Information Center

Firlik, Russell J.

This paper discusses the primary education system in England as a whole and the operation of primary schools in Leicestershire in particular. It also contains questions and answers concerning English primary education. The paper describes the organization, funding, and administration of English primary schools, which provide the first 6 years of…
International Conference on Harmonisation; Guidance on E7 Studies in Support of Special Populations; Geriatrics; Questions and Answers; availability. Notice.

PubMed

2012-02-21

The Food and Drug Administration (FDA) is announcing the availability of a guidance entitled ``E7 Studies in Support of Special Populations: Geriatrics; Questions and Answers.'' The guidance was prepared under the auspices of the International Conference on Harmonisation of Technical Requirements for Registration of Pharmaceuticals for Human Use (ICH). The questions and answers (Q&A) guidance addresses special considerations for the design and conduct of clinical trials of drugs likely to have significant use in the elderly. The Q&As are intended to provide guidance on the use of geriatric data to adequately characterize and represent the safety and efficacy of a drug for a marketing application, including data collected postmarketing.
Feedback enhances the positive effects and reduces the negative effects of multiple-choice testing.

PubMed

Butler, Andrew C; Roediger, Henry L

2008-04-01

Multiple-choice tests are used frequently in higher education without much consideration of the impact this form of assessment has on learning. Multiple-choice testing enhances retention of the material tested (the testing effect); however, unlike other tests, multiple-choice can also be detrimental because it exposes students to misinformation in the form of lures. The selection of lures can lead students to acquire false knowledge (Roediger & Marsh, 2005). The present research investigated whether feedback could be used to boost the positive effects and reduce the negative effects of multiple-choice testing. Subjects studied passages and then received a multiple-choice test with immediate feedback, delayed feedback, or no feedback. In comparison with the no-feedback condition, both immediate and delayed feedback increased the proportion of correct responses and reduced the proportion of intrusions (i.e., lure responses from the initial multiple-choice test) on a delayed cued recall test. Educators should provide feedback when using multiple-choice tests.
An Algorithm to Improve Test Answer Copying Detection Using the Omega Statistic

ERIC Educational Resources Information Center

Maeda, Hotaka; Zhang, Bo

2017-01-01

The omega (?) statistic is reputed to be one of the best indices for detecting answer copying on multiple choice tests, but its performance relies on the accurate estimation of copier ability, which is challenging because responses from the copiers may have been contaminated. We propose an algorithm that aims to identify and delete the suspected…
The Interviewer in the Respondent's Shoes: What Can We Learn from the Way Interviewers Answer Survey Questions?

ERIC Educational Resources Information Center

Wuyts, Celine; Loosveldt, Geert

2017-01-01

Previous research shows that interviewers to some extent fail to expend the effort that is needed to collect high-quality survey data. We extend the idea of interviewer satisficing to a related task, in which the interviewers themselves answer survey questions. We hypothesize that interviewers who self-administer the questionnaire in a careless…
College Choice: Understanding Student Enrollment Behavior. ERIC Digest.

ERIC Educational Resources Information Center

Paulsen, Michael B.

This digest summarizes in a question and answer format a full length report of the same title. It addresses trends in college student enrollment patterns with an emphasis on behavior underlying student choice of college. Demographic changes and cuts in important sources of student financial aid brought significant enrollment declines to higher…
Fostering the exchange of real world data across different countries to answer primary care research questions: an UNLOCK study from the IPCRG.

PubMed

Cragg, Liza; Williams, Siân; van der Molen, Thys; Thomas, Mike; Correia de Sousa, Jaime; Chavannes, Niels H

2018-03-08

There is growing awareness amongst healthcare planners, providers and researchers of the need to make better use of routinely collected health data by translating it into actionable information that improves efficiency of healthcare and patient outcomes. There is also increased acceptance of the importance of real world research that recruits patients representative of primary care populations and evaluates interventions realistically delivered by primary care professionals. The UNLOCK Group is an international collaboration of primary care researchers and practitioners from 15 countries. It has coordinated and shared datasets of diagnostic and prognostic variables for COPD and asthma to answer research questions meaningful to professionals working in primary care over a 6-year period. Over this time the UNLOCK Group has undertaken several studies using data from unselected primary care populations from diverse contexts to evaluate the burden of disease, multiple morbidities, treatment and follow-up. However, practical and structural constraints have hampered the UNLOCK Group's ability to translate research ideas into studies. This study explored the constraints, challenges and successes experienced by the UNLOCK Group and its participants' learning as researchers and primary care practitioners collaborating to answer primary care research questions. The study identified lessons for future studies and collaborations that require data sharing across borders. It also explored specific challenges to fostering the exchange of primary care data in comparison to other datasets such as public health, prescribing or hospital data and mechanisms that may be used to overcome these.
Developing Multiple Choice Tests: Tips & Techniques

ERIC Educational Resources Information Center

McCowan, Richard J.

1999-01-01

Item writing is a major responsibility of trainers. Too often, qualified staff who prepare lessons carefully and teach conscientiously use inadequate tests that do not validly reflect the true level of trainee achievement. This monograph describes techniques for constructing multiple-choice items that measure student performance accurately. It…
Economic Choices. Political Decisions That Affect You. Teacher's Guide.

ERIC Educational Resources Information Center

Chibucos, Pamela E.

This teacher's guide to an educational unit on economic choices provides motivators, terms and concepts to know, lesson objectives, student activities, student worksheets, and evaluation criteria. One activity requires students to research their family's economic history and answer questions such as: (1) "Do any family members belong to a…
Management of hyperthyroidism due to Graves' disease: frequently asked questions and answers (if any).

PubMed

Bartalena, L; Chiovato, L; Vitti, P

2016-10-01

Graves' disease is the most common cause of hyperthyroidism in iodine-replete areas. Although progress has been made in our understanding of the pathogenesis of the disease, no treatment targeting pathogenic mechanisms of the disease is presently available. Therapies for Graves' hyperthyroidism are largely imperfect because they are bound to either a high rate of relapsing hyperthyroidism (antithyroid drugs) or lifelong hypothyroidism (radioiodine treatment or thyroidectomy). Aim of the present article is to offer a practical guidance to the reader by providing evidence-based answers to frequently asked questions in clinical practice.
The Development of Multiple-Choice Items Consistent with the AP Chemistry Curriculum Framework to More Accurately Assess Deeper Understanding

ERIC Educational Resources Information Center

Domyancich, John M.

2014-01-01

Multiple-choice questions are an important part of large-scale summative assessments, such as the advanced placement (AP) chemistry exam. However, past AP chemistry exam items often lacked the ability to test conceptual understanding and higher-order cognitive skills. The redesigned AP chemistry exam shows a distinctive shift in item types toward…
A cost-consequences analysis of a primary care librarian question and answering service.

PubMed

McGowan, Jessie; Hogg, William; Zhong, Jianwei; Zhao, Xue

2012-01-01

Cost consequences analysis was completed from randomized controlled trial (RCT) data for the Just-in-time (JIT) librarian consultation service in primary care that ran from October 2005 to April 2006. The service was aimed at providing answers to clinical questions arising during the clinical encounter while the patient waits. Cost saving and cost avoidance were also analyzed. The data comes from eighty-eight primary care providers in the Ottawa area working in Family Health Networks (FHNs) and Family Health Groups (FHGs). We conducted a cost consequences analysis based on data from the JIT project. We also estimated the potential economic benefit of JIT librarian consultation service to the health care system. The results show that the cost per question for the JIT service was $38.20. The cost could be as low as $5.70 per question for a regular service. Nationally, if this service was implemented and if family physicians saw additional patients when the JIT service saved them time, up to 61,100 extra patients could be seen annually. A conservative estimate of the cost savings and cost avoidance per question for JIT was $11.55. The cost per question, if the librarian service was used at full capacity, is quite low. Financial savings to the health care system might exceed the cost of the service. Saving physician's time during their day could potentially lead to better access to family physicians by patients. Implementing a librarian consultation service can happen quickly as the time required to train professional librarians to do this service is short.
Choice numeracy and physicians-in-training performance: the case of Medicare Part D

PubMed Central

Hanoch, Yaniv; Miron-Shatz, Talya; Cole, Helen; Himmelstein, Mary; Federman, Alex D.

2017-01-01

In choosing a prescription plan, Medicare beneficiaries in the US usually face over 50 options. Many have turned to their physicians for help with this complex task. However, exactly how well do physicians navigate information on Part D plans is still an open question. In this study, we explored this unanswered question by examining the effect of choice-set size and numeracy levels on a physician-in-training’s ability to choose appropriate Medicare drug plans. Consistent with our hypotheses, increases in choice sets correlated significantly with fewer correct answers, and higher numeracy levels were associated with more correct answers. Hence, our data further highlight the role of numeracy in financial- and health-related decision making, and also raise concerns about physicians’ ability to help patients choose the optimal Part D plan. PMID:20658834
Neuroscience cannot answer these questions: a response to G. and R. Murrow's essay hypothesizing a link between dehumanization, human rights abuses and public policy

PubMed Central

Hoffman, Morris B.

2015-01-01

The Murrows' paper, ‘A hypothetical link between dehumanization and human rights abuses’, in which they propose that neuroscience may answer some difficult public policy questions, including questions about the First Amendment, is an unfortunate foray into law and public policy unjustified by the current state of neuroscience. Neuroscientific insights may one day have important implications for the law, and for some of the folk psychological assumptions embedded in the law, but they will never change the words of the written Constitution, or answer difficult policy questions in the interstices of those words. Suggesting that neuroscience can today inform these questions does a disservice to science, law and the complexity of the human condition. PMID:27774237
Translating Answers to Open-Ended Survey Questions in Cross-Cultural Research: A Case Study on the Interplay between Translation, Coding, and Analysis

ERIC Educational Resources Information Center

Behr, Dorothée

2015-01-01

Open-ended probing questions in cross-cultural surveys help uncover equivalence problems in cross-cultural survey research. For languages that a project team does not understand, probe answers need to be translated into a common project language. This article presents a case study on translating open-ended, that is, narrative answers. It describes…
[Comments on the seven clinical questions & answers in Japanese gastric treatment guidelines of the 4th edition].

PubMed

Xu, J M

2017-03-23

Japanese gastric cancer treatment guidelines of the 4th Edition proposed solutions to 7 clinically contentious questions. However, the solutions to question 1-3 are not complete and may cause ambiguity. In order to avoid the wrong choice of surgical resection, the solutions to question 1-3 should be clearly defined. For question 1-3, we suggest provisos be added such as patients with resectable M1 disease and without any other non-curable factors, after whose status and tumor biological behavior being fully understood and being fully discussed by a multidisciplinary team, can be recommended to receive comprehensive treatment including surgical resection.
Concealed Questions. In Search of Answers

ERIC Educational Resources Information Center

Frana, Ilaria

2010-01-01

This dissertation examines the semantic interpretation of various types of DPs in so-called concealed-question (CQ) constructions, as "Bill's phone number" in the sentence "John knows Bill's phone number". The peculiar characteristic of DP-CQs is that they are interpreted as having the meaning of an embedded question. So, for instance, the…
Variational neuroethology: Answering further questions. Reply to comments on "Answering Schrödinger's question: A free-energy formulation"

NASA Astrophysics Data System (ADS)

Ramstead, Maxwell J. D.; Badcock, Paul B.; Friston, Karl J.

2018-03-01

First and foremost, we sincerely thank our commentators for their incisive and thought-provoking responses [1-14] to our metatheory of living systems; namely, variational neuroethology (VNE) [15]. We appreciated the critical insights, questions, suggestions, and proposals for future research. We were also pleased to see signs of a fruitful dialectic between different perspectives - unexpectedly, some of our commentators addressed others' questions and concerns; suggesting that VNE might enable productive scientific discourse and inspire new, multidisciplinary research questions. There were also friendly critics, who helpfully questioned the coherence and validity of VNE, and motivated us to revisit key issues.

Which form of assessment provides the best information about student performance in chemistry examinations?

NASA Astrophysics Data System (ADS)

Hudson, Ross D.; Treagust, David F.

2013-04-01

Background . This study developed from observations of apparent achievement differences between male and female chemistry performances in a state university entrance examination. Male students performed more strongly than female students, especially in higher scores. Apart from the gender of the students, two other important factors that might influence student performance were format of questions (short-answer or multiple-choice) and type of questions (recall or application). Purpose The research question addressed in this study was: Is there a relationship between performance in state university entrance examinations in chemistry and school chemistry examinations and student gender, format of questions - multiple-choice or short-answer, and conceptual level - recall or application? Sample The two sources of data were: (1) secondary analyses of five consecutive years' data published by the examining authority of chemistry examinations, and (2) tests conducted with 192 students which provided information about all aspects of the three variables (question format, question type and gender) under consideration. Design and methods Both sources of data were analysed using ANOVA to compare means for the variables under consideration and the statistical significance of any differences. The data from the tests were also analysed using Rasch analysis to determine differences in gender performance. Results When overall mean data are considered, both male and female students performed better on multiple-choice questions and recall questions than on short-answer questions and application questions, respectively. When overall mean data are considered, male students outperformed female students in both the university entrance and school tests, particularly in the higher scores. When data were analysed with Rasch, there was no statistically significant difference in performance between males and females of equal ability. Conclusions Both male and female students generally perform
Adults' Learning about Science in Free-Choice Settings

ERIC Educational Resources Information Center

Rennie, Leonie J.; Williams, Gina F.

2006-01-01

This paper synthesizes findings from three studies to answer a general question: What do casual, adult visitors learn about science from their science-related experiences in free-choice settings? Specifically we asked whether there are changes in how people think about science in their daily lives, the nature and use of scientific knowledge, and…
Measures of Partial Knowledge and Unexpected Responses in Multiple-Choice Tests

ERIC Educational Resources Information Center

Chang, Shao-Hua; Lin, Pei-Chun; Lin, Zih-Chuan

2007-01-01

This study investigates differences in the partial scoring performance of examinees in elimination testing and conventional dichotomous scoring of multiple-choice tests implemented on a computer-based system. Elimination testing that uses the same set of multiple-choice items rewards examinees with partial knowledge over those who are simply…
A passage retrieval method based on probabilistic information retrieval model and UMLS concepts in biomedical question answering.

PubMed

Sarrouti, Mourad; Ouatik El Alaoui, Said

2017-04-01

Passage retrieval, the identification of top-ranked passages that may contain the answer for a given biomedical question, is a crucial component for any biomedical question answering (QA) system. Passage retrieval in open-domain QA is a longstanding challenge widely studied over the last decades. However, it still requires further efforts in biomedical QA. In this paper, we present a new biomedical passage retrieval method based on Stanford CoreNLP sentence/passage length, probabilistic information retrieval (IR) model and UMLS concepts. In the proposed method, we first use our document retrieval system based on PubMed search engine and UMLS similarity to retrieve relevant documents to a given biomedical question. We then take the abstracts from the retrieved documents and use Stanford CoreNLP for sentence splitter to make a set of sentences, i.e., candidate passages. Using stemmed words and UMLS concepts as features for the BM25 model, we finally compute the similarity scores between the biomedical question and each of the candidate passages and keep the N top-ranked ones. Experimental evaluations performed on large standard datasets, provided by the BioASQ challenge, show that the proposed method achieves good performances compared with the current state-of-the-art methods. The proposed method significantly outperforms the current state-of-the-art methods by an average of 6.84% in terms of mean average precision (MAP). We have proposed an efficient passage retrieval method which can be used to retrieve relevant passages in biomedical QA systems with high mean average precision. Copyright © 2017 Elsevier Inc. All rights reserved.
The Struggle for School Choice Policy after Zelman: Regulation vs. the Free Market. Policy Analysis.

ERIC Educational Resources Information Center

Omand, H. Lillian

Private school regulation is a growing concern among school choice proponents. This paper uses a national survey of private schools to analyze the potential effects of various regulations. More than 1,000 schools answered questions about their willingness to participate in school choice programs if they had to comply with particular regulations.…
Multi-scale ecosystem monitoring: an application of scaling data to answer multiple ecological questions

USDA-ARS?s Scientific Manuscript database

Background/Question/Methods Standardized monitoring data collection efforts using a probabilistic sample design, such as in the Bureau of Land Management’s (BLM) Assessment, Inventory, and Monitoring (AIM) Strategy, provide a core suite of ecological indicators, maximize data collection efficiency,...
Answering Consumer Questions: Opportunity for Impact

USDA-ARS?s Scientific Manuscript database

Food can be a touchy subject. It seems people either have very strong thoughts and opinions on food or they could care less as long as food is available to feed them and their families. With the current economic environment, many individuals are examining food choices more closely to ensure the g...
Talking with Children and Teens about Alzheimer's Disease: A Question and Answer Guidebook for Parents, Teachers and Caregivers.

ERIC Educational Resources Information Center

McCrea, James M.

Professionals in the fields of nursing, education, health care, recreation, and social work, who specialize in dealing with Alzheimer's disease, wrote answers to questions collected from discussion sessions held at four Pennsylvania elder facilities and made suggestions for talking to young people about the disease and its impact. This guidebook…
An Examination of High School Graduates Who Identify Teachers as Influential in Their Choice of College

ERIC Educational Resources Information Center

Mozie-Ross, Yvette D.

2011-01-01

This exploratory study contributes to what is known about the college choice process by providing a quantitative comparative analysis to determine how high school graduates who identify teachers as influential in their choice of college differ from graduates who do not. Specifically, this study answers the following research question: How do…
Demand Characteristics of Multiple-Choice Items.

ERIC Educational Resources Information Center

Diamond, James J.; Williams, David V.

Thirteen graduate students were asked to indicate for each of 24 multiple-choice items whether the item tested "recall of specific information," a "higher order skill," or "don't know." The students were also asked to state their general basis for judging the items. The 24 items had been previously classified according to Bloom's cognitive-skills…
Multiple Choice Testing and the Retrieval Hypothesis of the Testing Effect

ERIC Educational Resources Information Center

Sensenig, Amanda E.

2010-01-01

Taking a test often leads to enhanced later memory for the tested information, a phenomenon known as the "testing effect". This memory advantage has been reliably demonstrated with recall tests but not multiple choice tests. One potential explanation for this finding is that multiple choice tests do not rely on retrieval processes to the same…
Compatible solute influence on nucleic acids: Many questions but few answers

PubMed Central

Kurz, Matthias

2008-01-01

Compatible solutes are small organic osmolytes including but not limited to sugars, polyols, amino acids, and their derivatives. They are compatible with cell metabolism even at molar concentrations. A variety of organisms synthesize or take up compatible solutes for adaptation to extreme environments. In addition to their protective action on whole cells, compatible solutes display significant effects on biomolecules in vitro. These include stabilization of native protein and nucleic acid structures. They are used as additives in polymerase chain reactions to increase product yield and specificity, but also in other nucleic acid and protein applications. Interactions of compatible solutes with nucleic acids and protein-nucleic acid complexes are much less understood than the corresponding interactions of compatible solutes with proteins. Although we may begin to understand solute/nucleic acid interactions there are only few answers to the many questions we have. I summarize here the current state of knowledge and discuss possible molecular mechanisms and thermodynamics. PMID:18522725
Comparison of Integrated Testlet and Constructed-Response Question Formats

ERIC Educational Resources Information Center

Slepkov, Aaron D.; Shiell, Ralph C.

2014-01-01

Constructed-response (CR) questions are a mainstay of introductory physics textbooks and exams. However, because of the time, cost, and scoring reliability constraints associated with this format, CR questions are being increasingly replaced by multiple-choice (MC) questions in formal exams. The integrated testlet (IT) is a recently developed…
Profiling Students' Multiple Source Use by Question Type

ERIC Educational Resources Information Center

List, Alexandra; Grossnickle, Emily M.; Alexander, Patricia A.

2016-01-01

The present study examined undergraduate students' multiple source use in response to two different types of academic questions, one discrete and one open-ended. Participants (N = 240) responded to two questions using a library of eight digital sources, varying in source type (e.g., newspaper article) and reliability (e.g., authors' credentials).…
Drift: An Analysis of Outcome Framing in Intertemporal Choice

ERIC Educational Resources Information Center

Read, Daniel; Frederick, Shane; Scholten, Marc

2013-01-01

People prefer to receive good outcomes immediately rather than wait, and they must be compensated for waiting. But what influences their decision about how much compensation is required for a given wait? To give a partial answer to this question, we develop the DRIFT model, a heuristic description of how framing influences intertemporal choice. We…
Talking Physics: Two Case Studies on Short Answers and Self-explanation in Learning Physics

NASA Astrophysics Data System (ADS)

Badeau, Ryan C.

This thesis explores two case studies into the use of short answers and self-explanation to improve student learning in physics. The first set of experiments focuses on the role of short answer questions in the context of computer-based instruction. Through a series of six experiments, we compare and evaluate the performance of computer-assessed short answer questions versus multiple choice for training conceptual topics in physics, controlling for feedback between the two formats. In addition to finding overall similar improvements on subsequent student performance and retention, we identify unique differences in how students interact with the treatments in terms of time spent on feedback and performance on follow-up short answer assessment. In addition, we identify interactions between the level of interactivity of the training, question format, and student attitudinal ratings of each respective training. The second case study focuses on the use of worked examples in the context of multi-concept physics problems - which we call "synthesis problems." For this part of the thesis, four experiments were designed to evaluate the effectiveness of two instructional methods employing worked examples on student performance with synthesis problems; these instructional techniques, analogical comparison and self-explanation, have previously been studied primarily in the context of single-concept problems. As such, the work presented here represents a novel focus on extending these two techniques to this class of more complicated physics problem. Across the four experiments, both self-explanation and certain kinds of analogical comparison of worked examples significantly improved student performance on a target synthesis problem, with distinct improvements in recognition of the relevant concepts. More specifically, analogical comparison significantly improved student performance when the comparisons were invoked between worked synthesis examples. In contrast, similar
Answers in search of a question: 'proofs' of the tri-dimensionality of space

NASA Astrophysics Data System (ADS)

Callender, Craig

From Kant's first published work to recent articles in the physics literature, philosophers and physicists have long sought an answer to the question: Why does space have three dimensions? In this paper, I will flesh out Kant's claim with a brief detour through Gauss' law. I then describe Büchel's version of the common argument that stable orbits are possible only if space is three dimensional. After examining objections by Russell and van Fraassen, I develop three original criticisms of my own. These criticisms are relevant to both historical and contemporary proofs of the dimensionality of space (in particular, a recent one by Burgbacher, Lämmerzahl, and Macias). In general, I argue that modern "proofs" of the dimensionality of space have gone off track.
Barriers and decisions when answering clinical questions at the point of care: a grounded theory study.

PubMed

Cook, David A; Sorensen, Kristi J; Wilkinson, John M; Berger, Richard A

2013-11-25

Answering clinical questions affects patient-care decisions and is important to continuous professional development. The process of point-of-care learning is incompletely understood. To understand what barriers and enabling factors influence physician point-of-care learning and what decisions physicians face during this process. Focus groups with grounded theory analysis. Focus group discussions were transcribed and then analyzed using a constant comparative approach to identify barriers, enabling factors, and key decisions related to physician information-seeking activities. Academic medical center and outlying community sites. Purposive sample of 50 primary care and subspecialist internal medicine and family medicine physicians, interviewed in 11 focus groups. Insufficient time was the main barrier to point-of-care learning. Other barriers included the patient comorbidities and contexts, the volume of available information, not knowing which resource to search, doubt that the search would yield an answer, difficulty remembering questions for later study, and inconvenient access to computers. Key decisions were whether to search (reasons to search included infrequently seen conditions, practice updates, complex questions, and patient education), when to search (before, during, or after the clinical encounter), where to search (with the patient present or in a separate room), what type of resource to use (colleague or computer), what specific resource to use (influenced first by efficiency and second by credibility), and when to stop. Participants noted that key features of efficiency (completeness, brevity, and searchability) are often in conflict. Physicians perceive that insufficient time is the greatest barrier to point-of-care learning, and efficiency is the most important determinant in selecting an information source. Designing knowledge resources and systems to target key decisions may improve learning and patient care.
Questions and Answers Regarding the 2009 New Source Performance Standards (NSPS) Emissions Guidelines, and State Plan Process for Hospital, Medical, and Infectious Waste Incinerators (HMIWI)

EPA Pesticide Factsheets

This July 2011 document contains questions and answers on the Hospital/Medical/Infectious Waste Incinerators (HMIWI) regulations. The questions cover topics such as state plan requirements, compliance, applicability, operator training, and more.
Role of self-concept in answering survey questions on complementary and alternative medicine: challenges to and strategies for improving data quality.

PubMed

Willson, Stephanie; Stussman, Barbara; Maitland, Aaron; Nahin, Richard L

2009-12-01

The aim of this study was to assess the construct validity of survey questions about the use of herbal and other nonvitamin/nonmineral dietary supplements. We conducted one-on-one, in-depth cognitive interviews with 32 respondents to test questions from the complementary and alternative medicine (CAM) supplement for the 2007 National Health Interview Survey. Respondents were sampled purposively according to their use of CAM. Interviewers probed respondents for their understanding of the questions, and analysis was guided by grounded theory, an approach that generates explanations of response error that are closely tied to the empirical data. We found two sources of misinterpretation of CAM questions. First, some respondents did not have any pre-established definition of what constitutes an herbal supplement while others had interpretations that did not match the intended definitions. These problems are common to many survey questions. However, a second finding is that misinterpretation also arose when respondents incorporated notions of self-concept into the act of taking "natural herbs," and answered based on their understanding of this image rather than on actual behavior. There are several sources of misinterpretation of CAM questions. One of the most important sources is whether or not the respondent has created a concept of self-image that includes the use of herbal supplements. Common questionnaire design techniques such as providing definitions to respondents will not help to eliminate misinterpretation due to self-image. We found that careful question wording that does not evoke definitions of self, combined with visual aids that narrow the focus of the questions, can lead to more accurate answers.

Some links on this page may take you to non-federal websites. Their policies may differ from this site.