Assessing the effectiveness of the NICHD investigative interview protocol when interviewing French-speaking alleged victims of child sexual abuse in Quebec.

PubMed

Cyr, Mireille; Lamb, Michael E

2009-05-01

The study was designed to assess the effectiveness of the flexibly structured NICHD Investigative Interview Protocol for child sexual abuse (CSA) investigative interviews by police officers and mental health workers in Quebec. The NICHD Protocol was designed to operationalize "best practice" guidelines and to help forensic interviewers use open-ended prompts to facilitate free recall by alleged victims. A total of 83 interviews with 3- to 13-year-old alleged victims were matched with 83 interviews conducted by the same interviewers before they were trained to use the Protocol. Interviews were matched with respect to the children's ages, children-perpetrator relationships, and the types and frequency of abuse. Coders categorized each of the prompts used to elicit information about the abuse and tabulated the numbers of new forensically relevant details provided in each response. Interviewers used three times as many open-ended prompts in Protocol interviews than in non-Protocol interviews, whereas use of all other types of questions was halved, and the total number of questions asked decreased by 25%. Protocol-guided interviews yielded more details than comparison interviews. The mean number of details per prompt increased from 3 to 5 details when the Protocol was used. Even with young children, interviewers using the Protocol employed more invitations to elicit forensically relevant details. French-speaking investigators using the NICHD Protocol used open-ended prompts rather than focused questions when interviewing alleged victims. In addition, these interviewers needed fewer questions to get relevant information when using the Protocol. A French version of the NICHD Protocol is now available to police officers and social workers who investigate the alleged sexual abuse of young children in French-speaking countries. This French version allowed trained interviewers to increase the use of invitations and reduce the use of more focused and risky questions. When the number of questions was controlled, more central details and more details in total were obtained in Protocol interviews, because the average prompt elicited more detailed answers in Protocol interviews. However, learning to use the NICHD Protocol required extended training and continued feedback sessions to maintain the high quality of interviewing.

Systematic Evaluation of the Patient-Reported Outcome (PRO) Content of Clinical Trial Protocols

PubMed Central

Kyte, Derek; Duffy, Helen; Fletcher, Benjamin; Gheorghe, Adrian; Mercieca-Bebber, Rebecca; King, Madeleine; Draper, Heather; Ives, Jonathan; Brundage, Michael; Blazeby, Jane; Calvert, Melanie

2014-01-01

Background Qualitative evidence suggests patient-reported outcome (PRO) information is frequently absent from clinical trial protocols, potentially leading to inconsistent PRO data collection and risking bias. Direct evidence regarding PRO trial protocol content is lacking. The aim of this study was to systematically evaluate the PRO-specific content of UK National Institute for Health Research (NIHR) Health Technology Assessment (HTA) programme trial protocols. Methods and Findings We conducted an electronic search of the NIHR HTA programme database (inception to August 2013) for protocols describing a randomised controlled trial including a primary/secondary PRO. Two investigators independently reviewed the content of each protocol, using a specially constructed PRO-specific protocol checklist, alongside the ‘Standard Protocol Items: Recommendations for Interventional Trials’ (SPIRIT) checklist. Disagreements were resolved through discussion with a third investigator. 75 trial protocols were included in the analysis. Protocols included a mean of 32/51 (63%) SPIRIT recommendations (range 16–41, SD 5.62) and 11/33 (33%) PRO-specific items (range 4–18, SD 3.56). Over half (61%) of the PRO items were incomplete. Protocols containing a primary PRO included slightly more PRO checklist items (mean 14/33 (43%)). PRO protocol content was not associated with general protocol completeness; thus, protocols judged as relatively ‘complete’ using SPIRIT were still likely to have omitted a large proportion of PRO checklist items. Conclusions The PRO components of HTA clinical trial protocols require improvement. Information on the PRO rationale/hypothesis, data collection methods, training and management was often absent. This low compliance is unsurprising; evidence shows existing PRO guidance for protocol developers remains difficult to access and lacks consistency. Study findings suggest there are a number of PRO protocol checklist items that are not fully addressed by the current SPIRIT statement. We therefore advocate the development of consensus-based supplementary guidelines, aimed at improving the completeness and quality of PRO content in clinical trial protocols. PMID:25333349

Definitions of terms, processes and a minimum dataset for transperineal prostate biopsies: a standardization approach of the Ginsburg Study Group for Enhanced Prostate Diagnostics.

PubMed

Kuru, Timur H; Wadhwa, Karan; Chang, Richard Tsung Meng; Echeverria, Lina Maria Carmona; Roethke, Matthias; Polson, Alexander; Rottenberg, Giles; Koo, Brendan; Lawrence, Edward M; Seidenader, Jonas; Gnanapragasam, Vincent; Axell, Richard; Roth, Wilfried; Warren, Anne; Doble, Andrew; Muir, Gordon; Popert, Rick; Schlemmer, Heinz-Peter; Hadaschik, Boris A; Kastner, Christof

2013-09-01

To define terms and processes and agree on a minimum dataset in relation to transperineal prostate biopsy procedures and enhanced prostate diagnostics. To identify the need for further evaluation and establish a collaborative research practice. A 19-member multidisciplinary panel rated 66 items for their appropriateness and their definition to be incorporated into the international databank using the Research and Development/University of California Los Angeles Appropriateness Method. The item list was developed from interviews conducted with healthcare professionals from urology, radiology, pathology and engineering. The panel agreed on 56 items that were appropriate to be incorporated into a prospective database. In total, 10 items were uncertain and were omitted. These items were within the categories: definitions (n = 2), imaging (n = 1), surgical protocols (n = 2) and histology (n = 5). The components of a minimum dataset for transperineal prostate biopsy have been defined. This provides an opportunity for multicentre collaborative data analysis and technique development. The findings of the present study will facilitate prospective studies into the application and outcome of transperineal prostate biopsies. © 2013 BJU International.

Development and Preliminary Validation of Refugee Trauma History Checklist (RTHC)—A Brief Checklist for Survey Studies

PubMed Central

Gottvall, Maria; Vaez, Marjan

2017-01-01

A high proportion of refugees have been subjected to potentially traumatic experiences (PTEs), including torture. PTEs, and torture in particular, are powerful predictors of mental ill health. This paper reports the development and preliminary validation of a brief refugee trauma checklist applicable for survey studies. Methods: A pool of 232 items was generated based on pre-existing instruments. Conceptualization, item selection and item refinement was conducted based on existing literature and in collaboration with experts. Ten cognitive interviews using a Think Aloud Protocol (TAP) were performed in a clinical setting, and field testing of the proposed checklist was performed in a total sample of n = 137 asylum seekers from Syria. Results: The proposed refugee trauma history checklist (RTHC) consists of 2 × 8 items, concerning PTEs that occurred before and during the respondents’ flight, respectively. Results show low item non-response and adequate psychometric properties Conclusions: RTHC is a usable tool for providing self-report data on refugee trauma history surveys of community samples. The core set of included events can be augmented and slight modifications can be applied to RTHC for use also in other refugee populations and settings. PMID:28976937

Modified Scoring, Traditional Item Analysis, and Sato's Caution Index Used To Investigate the Reading Recall Protocol.

ERIC Educational Resources Information Center

Deville, Craig W.; Chalhoub-Deville, Micheline

A study demonstrated the utility of item analyses to investigate which items function well or poorly in a second language reading recall protocol instrument. Data were drawn from a larger study of 56 learners of German as a second language at various proficiency levels. Pausal units of scored recall protocols were analyzed using both classical…

Feasibility of Using Qualitative Interviews to Explore Patients' Treatment Goals: Experience from Dermatology.

PubMed

Blome, Christine; von Usslar, Kathrin; Augustin, Matthias

2016-06-01

Qualitative interviews are used to assess understandability and content validity of patient-reported outcomes. However, the common approach of asking patients to paraphrase items may not be sufficient to completely reveal item content as understood by patients. We used qualitative interviews to elicit more detailed information about patients' understanding of treatment goal items for the Patient Benefit Index 2.0 (PBI 2.0). This questionnaire measures patient-relevant benefit from treatments for skin diseases by assessing goal importance prior to and goal attainment after treatment. We interviewed 16 patients with psoriasis, atopic dermatitis, leg ulcers, and vitiligo. Patients were asked to elaborate in detail on their understanding of 15 treatment goal items. Subsequently, they were asked to suggest changes in item wording and to name missing treatment goals. Interview transcripts were analyzed according to an adapted approach of content analysis. The task was easy for the patients to understand, and they shared detailed information on what each goal meant to them. Results of the content analysis induced a range of revisions of the PBI 2.0 items, including changes in wording (four items) and item order (two items). Four items were deleted because they were found to be redundant or irrelevant, and one item was added to the list of treatment goals. Asking patients to elaborate on their item understanding in qualitative interviews provided detailed insight into item content and understandability. This method has helped considerably to improve feasibility and content validity of the PBI 2.0.

Therapist self-report of evidence-based practices in usual care for adolescent behavior problems: factor and construct validity.

PubMed

Hogue, Aaron; Dauber, Sarah; Henderson, Craig E

2014-01-01

This study introduces a therapist-report measure of evidence-based practices for adolescent conduct and substance use problems. The Inventory of Therapy Techniques-Adolescent Behavior Problems (ITT-ABP) is a post-session measure of 27 techniques representing four approaches: cognitive-behavioral therapy (CBT), family therapy (FT), motivational interviewing (MI), and drug counseling (DC). A total of 822 protocols were collected from 32 therapists treating 71 adolescents in six usual care sites. Factor analyses identified three clinically coherent scales with strong internal consistency across the full sample: FT (8 items; α = .79), MI/CBT (8 items; α = .87), and DC (9 items, α = .90). The scales discriminated between therapists working in a family-oriented site versus other sites and showed moderate convergent validity with therapist reports of allegiance and skill in each approach. The ITT-ABP holds promise as a cost-efficient quality assurance tool for supporting high-fidelity delivery of evidence-based practices in usual care.

The Effects of Respondents’ Consent to be Recorded on Interview Length and Data Quality in a National Panel Study

PubMed Central

McGonagle, Katherine A.; Brown, Charles; Schoeni, Robert F.

2014-01-01

Recording interviews is a key feature of quality control protocols for most survey organizations. We examine the effects on interview length and data quality of a new protocol adopted by a national panel study. The protocol recorded a randomly chosen one-third of all interviews digitally, although all respondents were asked for permission to record their interview, and interviewers were blind to whether or not interviews were recorded. We find that the recording software slowed the interview slightly. Interviewer knowledge that the interview may be recorded improved data quality, but this knowledge also increased the length of the interview. Interviewers with higher education and performance ratings were less reactive to the new recording protocol. Survey managers may face a trade-off between higher data quality and longer interviews when determining recording protocols. PMID:26550000

Identifying content for the glaucoma-specific item bank to measure quality-of-life parameters.

PubMed

Khadka, Jyoti; McAlinden, Colm; Craig, Jamie E; Fenwick, Eva K; Lamoureux, Ecosse L; Pesudovs, Konrad

2015-01-01

Patient-reported outcomes (PROs) have become essential clinical trial end points. However, a comprehensive, multidimensional, patient-relevant, and precise glaucoma-specific PRO instrument is not available. Therefore, the purpose of this study was to identify content for a new, glaucoma-specific, quality-of-life (QOL) item bank. Content identification was undertaken in 5 phases: (1) identification of extant items in glaucoma-specific instruments and the qualitative literature; (2) focus groups and interviews with glaucoma patients; (3) item classification and selection; (4) expert review and revision of items; and (5) cognitive interviews with patients. A total of 737 unique items (extant items from PRO instruments, 247; qualitative articles, 14 items; focus groups and semistructured interviews, 476 items) were identified. These items were classified into 10 QOL domains. Four criteria (item redundancy, item inconsistent with domain definition, item content too narrow to have wider applicability, and item clarity) were used to remove and refine the items. After the cognitive interviews, the final minimally representative item set had a total of 342 unique items belonging to 10 domains: activity limitation (88), mobility (20), visual symptoms (19), ocular surface symptoms (22), general symptoms (15), convenience (39), health concerns (45), emotional well-being (49), social issues (23), and economic issues (22). The systematic content identification process identified 10 QOL domains, which were important to patients with glaucoma. The majority of the items were identified from the patient-specific focus groups and semistructured interviews suggesting that the existing PRO instruments do not adequately address QOL issues relevant to individuals with glaucoma.

Trends in Sexual Orientation Missing Data Over a Decade of the California Health Interview Survey

PubMed Central

Viana, Joseph; Grant, David; Cochran, Susan D.; Lee, Annie C.; Ponce, Ninez A.

2015-01-01

Objectives. We explored changes in sexual orientation question item completion in a large statewide health survey. Methods. We used 2003 to 2011 California Health Interview Survey data to investigate sexual orientation item nonresponse and sexual minority self-identification trends in a cross-sectional sample representing the noninstitutionalized California household population aged 18 to 70 years (n = 182 812 adults). Results. Asians, Hispanics, limited-English-proficient respondents, and those interviewed in non-English languages showed the greatest declines in sexual orientation item nonresponse. Asian women, regardless of English-proficiency status, had the highest odds of item nonresponse. Spanish interviews produced more nonresponse than English interviews and Asian-language interviews produced less nonresponse when we controlled for demographic factors and survey cycle. Sexual minority self-identification increased in concert with the item nonresponse decline. Conclusions. Sexual orientation nonresponse declines and the increase in sexual minority identification suggest greater acceptability of sexual orientation assessment in surveys. Item nonresponse rate convergence among races/ethnicities, language proficiency groups, and interview languages shows that sexual orientation can be measured in surveys of diverse populations. PMID:25790399

A decision-tree approach to the assessment of posttraumatic stress disorder: Engineering empirically rigorous and ecologically valid assessment measures.

PubMed

Stewart, Regan W; Tuerk, Peter W; Metzger, Isha W; Davidson, Tatiana M; Young, John

2016-02-01

Structured diagnostic interviews are widely considered to be the optimal method of assessing symptoms of posttraumatic stress; however, few clinicians report using structured assessments to guide clinical practice. One commonly cited impediment to these assessment approaches is the amount of time required for test administration and interpretation. Empirically keyed methods to reduce the administration time of structured assessments may be a viable solution to increase the use of standardized and reliable diagnostic tools. Thus, the present research conducted an initial feasibility study using a sample of treatment-seeking military veterans (N = 1,517) to develop a truncated assessment protocol based on the Clinician-Administered Posttraumatic Stress Disorder (PTSD) Scale (CAPS). Decision-tree analysis was utilized to identify a subset of predictor variables among the CAPS items that were most predictive of a diagnosis of PTSD. The algorithm-driven, atheoretical sequence of questions reduced the number of items administered by more than 75% and classified the validation sample at 92% accuracy. These results demonstrated the feasibility of developing a protocol to assess PTSD in a way that imposes little assessment burden while still providing a reliable categorization. (c) 2016 APA, all rights reserved).

Health Information National Trends Survey in American Sign Language (HINTS-ASL): Protocol for the Cultural Adaptation and Linguistic Validation of a National Survey.

PubMed

Kushalnagar, Poorna; Harris, Raychelle; Paludneviciene, Raylene; Hoglind, TraciAnn

2017-09-13

The Health Information National Trends Survey (HINTS) collects nationally representative data about the American's public use of health-related information. This survey is available in English and Spanish, but not in American Sign Language (ASL). Thus, the exclusion of ASL users from these national health information survey studies has led to a significant gap in knowledge of Internet usage for health information access in this underserved and understudied population. The objectives of this study are (1) to culturally adapt and linguistically translate the HINTS items to ASL (HINTS-ASL); and (2) to gather information about deaf people's health information seeking behaviors across technology-mediated platforms. We modified the standard procedures developed at the US National Center for Health Statistics Cognitive Survey Laboratory to culturally adapt and translate HINTS items to ASL. Cognitive interviews were conducted to assess clarity and delivery of these HINTS-ASL items. Final ASL video items were uploaded to a protected online survey website. The HINTS-ASL online survey has been administered to over 1350 deaf adults (ages 18 to 90 and up) who use ASL. Data collection is ongoing and includes deaf adult signers across the United States. Some items from HINTS item bank required cultural adaptation for use with deaf people who use accessible services or technology. A separate item bank for deaf-related experiences was created, reflecting deaf-specific technology such as sharing health-related ASL videos through social network sites and using video remote interpreting services in health settings. After data collection is complete, we will conduct a series of analyses on deaf people's health information seeking behaviors across technology-mediated platforms. HINTS-ASL is an accessible health information national trends survey, which includes a culturally appropriate set of items that are relevant to the experiences of deaf people who use ASL. The final HINTS-ASL product will be available for public use upon completion of this study. ©Poorna Kushalnagar. Originally published in JMIR Research Protocols (http://www.researchprotocols.org), 13.09.2017.

New Interview and Observation Measures of the Broader Autism Phenotype: Description of Strategy and Reliability Findings for the Interview Measures.

PubMed

Parr, Jeremy R; De Jonge, Maretha V; Wallace, Simon; Pickles, Andrew; Rutter, Michael L; Le Couteur, Ann S; van Engeland, Herman; Wittemeyer, Kerstin; McConachie, Helen; Roge, Bernadette; Mantoulan, Carine; Pedersen, Lennart; Isager, Torben; Poustka, Fritz; Bolte, Sven; Bolton, Patrick; Weisblatt, Emma; Green, Jonathan; Papanikolaou, Katerina; Baird, Gillian; Bailey, Anthony J

2015-10-01

Clinical genetic studies confirm the broader autism phenotype (BAP) in some relatives of individuals with autism, but there are few standardized assessment measures. We developed three BAP measures (informant interview, self-report interview, and impression of interviewee observational scale) and describe the development strategy and findings from the interviews. International Molecular Genetic Study of Autism Consortium data were collected from families containing at least two individuals with autism. Comparison of the informant and self-report interviews was restricted to samples in which the interviews were undertaken by different researchers from that site (251 UK informants, 119 from the Netherlands). Researchers produced vignettes that were rated blind by others. Retest reliability was assessed in 45 participants. Agreement between live scoring and vignette ratings was very high. Retest stability for the interviews was high. Factor analysis indicated a first factor comprising social-communication items and rigidity (but not other repetitive domain items), and a second factor comprised mainly of reading and spelling impairments. Whole scale Cronbach's alphas were high for both interviews. The correlation between interviews for factor 1 was moderate (adult items 0.50; childhood items 0.43); Kappa values for between-interview agreement on individual items were mainly low. The correlations between individual items and total score were moderate. The inclusion of several factor 2 items lowered the overall Cronbach's alpha for the total set. Both interview measures showed good reliability and substantial stability over time, but the findings were better for factor 1 than factor 2. We recommend factor 1 scores be used for characterising the BAP. © 2015 The Authors Autism Research published by Wiley Periodicals, Inc. on behalf of International Society for Autism Research.

Development of and Field-Test Results for the CAHPS PCMH Survey

PubMed Central

Scholle, Sarah Hudson; Vuong, Oanh; Ding, Lin; Fry, Stephanie; Gallagher, Patricia; Brown, Julie A.; Hays, Ron D.; Cleary, Paul D.

2017-01-01

Objective To develop and evaluate survey questions that assess processes of care relevant to Patient-Centered Medical Homes (PCMHs). Research Design We convened expert panels, reviewed evidence on effective care practices and existing surveys, elicited broad public input, and conducted cognitive interviews and a field test to develop items relevant to PCMHs that could be added to the CAHPS® Clinician & Group (CG-CAHPS) 1.0 Survey. Surveys were tested using a two-contact mail protocol in 10 adult and 33 pediatric practices (both private and community health centers) in Massachusetts. A total of 4,875 completed surveys were received (overall response rate of 25%). Analyses We calculated the rate of valid responses for each item. We conducted exploratory factor analyses and estimated item-to-total correlations, individual and site level reliability, and correlations among proposed multi-item composites. Results Ten items in four new domains (Comprehensiveness, Information, Self-Management Support, and Shared Decision-Making) and four items in two existing domains (Access and Coordination of Care) were selected to be supplemental items to be used in conjunction with the adult CG-CAHPS 1.0 survey. For the child version, four items in each of two new domains (Information and Self-Management Support) and five items in existing domains (Access, Comprehensiveness-Prevention, Coordination of Care) were selected. Conclusions This study provides support for the reliability and validity of new items to supplement the CG-CAHPS 1.0 survey to assess aspects of primary care that are important attributes of Patient-Centered Medical Homes. PMID:23064272

The Geoscience Concept Test: A New Assessment Tool Based on Student Misconceptions

NASA Astrophysics Data System (ADS)

Libarkin, J.; Anderson, S. W.; Boone, W. J.; Beilfuss, M.; Dahl, J.

2002-12-01

We developed and began pilot testing of an earth science assessment tool called the geoscience concept test (GCT). The GCT uses student misconceptions as distractors in a 30 item multiple-choice instrument. Student misconceptions were first assessed through the analysis of nearly 300 questionnaires administered in introductory geology courses at three institutions. Results from the questionnaires guided the development of an interview protocol that was used by four interviewers at four different institutions. Over 100 in-depth student interviews lasting from 0.5 to 1 hour probed topics related to the Earth's interior, geologic time, and the formation of Earth surface features such as mountains and volcanoes to better define misconceptions. Thematic content analysis of the interviews identified a number of widely held misconceptions, which were then incorporated into the GCT as multiple-choice distractors (wrong answers). For content validity, the initial GCT was reviewed by seven experts (3 geoscientists and 4 science educators) and revised before pilot testing. Approximately 100 introductory and non-science major college students from four institutions were assessed with the GCT pilot in the spring of 2002. Rasch model analysis of this data showed that students found the pilot test difficult, and the level of difficulty was consistent between the four institutions. Analysis of individual items showed that students had fewer misconceptions regarding the locations of earthquakes, and many misconceptions regarding the locations of volcanoes on the Earth's surface, suggesting a disconnect in their understanding of the role of plate tectonics in these phenomena. Analysis of the misfit statistic for each item showed that none of the questions misfit, although we dropped one question and modified the wording of another for clarity in the next round of piloting. A second round of piloting scheduled for the fall of 2002 includes nearly 3000 students from 34 institutions in 19 states.

Diagnostic Efficiency among Psychiatric Outpatients of a Self-Report Version of a Subset of Screen Items of the Structured Clinical Interview for DSM-IV-TR Personality Disorders (SCID-II)

ERIC Educational Resources Information Center

Germans, Sara; Van Heck, Guus L.; Masthoff, Erik D.; Trompenaars, Fons J. W. M.; Hodiamont, Paul P. G.

2010-01-01

This article describes the identification of a 10-item set of the Structured Clinical Interview for DSM-IV Personality Disorders (SCID-II) items, which proved to be effective as a self-report assessment instrument in screening personality disorders. The item selection was based on the retrospective analyses of 495 SCID-II interviews. The…

SPIRIT 2013 Statement: defining standard protocol items for clinical trials.

PubMed

Chan, An-Wen; Tetzlaff, Jennifer M; Altman, Douglas G; Laupacis, Andreas; Gøtzsche, Peter C; Krle A-Jerić, Karmela; Hrobjartsson, Asbjørn; Mann, Howard; Dickersin, Kay; Berlin, Jesse A; Dore, Caroline J; Parulekar, Wendy R; Summerskill, William S M; Groves, Trish; Schulz, Kenneth F; Sox, Harold C; Rockhold, Frank W; Rennie, Drummond; Moher, David

2015-12-01

The protocol of a clinical trial serves as the foundation for study planning, conduct, reporting, and appraisal. However, trial protocols and existing protocol guidelines vary greatly in content and quality. This article describes the systematic development and scope of SPIRIT (Standard Protocol Items: Recommendations for Interventional Trials) 2013, a guideline for the minimum content of a clinical trial protocol. The 33-item SPIRIT checklist applies to protocols for all clinical trials and focuses on content rather than format. The checklist recommends a full description of what is planned; it does not prescribe how to design or conduct a trial. By providing guidance for key content, the SPIRIT recommendations aim to facilitate the drafting of high-quality protocols. Adherence to SPIRIT would also enhance the transparency and completeness of trial protocols for the benefit of investigators, trial participants, patients, sponsors, funders, research ethics committees or institutional review boards, peer reviewers, journals, trial registries, policymakers, regulators, and other key stakeholders.

SPIRIT 2013 Statement: Defining Standard Protocol Items for Clinical Trials

PubMed Central

Chan, An-Wen; Tetzlaff, Jennifer M.; Altman, Douglas G.; Laupacis, Andreas; Gøtzsche, Peter C.; Krleža-Jerić, Karmela; Hróbjartsson, Asbjørn; Mann, Howard; Dickersin, Kay; Berlin, Jesse A.; Doré, Caroline J.; Parulekar, Wendy R.; Summerskill, William S.M.; Groves, Trish; Schulz, Kenneth F.; Sox, Harold C.; Rockhold, Frank W.; Rennie, Drummond; Moher, David

2016-01-01

The protocol of a clinical trial serves as the foundation for study planning, conduct, reporting, and appraisal. However, trial protocols and existing protocol guidelines vary greatly in content and quality. This article describes the systematic development and scope of SPIRIT (Standard Protocol Items: Recommendations for Interventional Trials) 2013, a guideline for the minimum content of a clinical trial protocol. The 33-item SPIRIT checklist applies to protocols for all clinical trials and focuses on content rather than format. The checklist recommends a full description of what is planned; it does not prescribe how to design or conduct a trial. By providing guidance for key content, the SPIRIT recommendations aim to facilitate the drafting of high-quality protocols. Adherence to SPIRIT would also enhance the transparency and completeness of trial protocols for the benefit of investigators, trial participants, patients, sponsors, funders, research ethics committees or institutional review boards, peer reviewers, journals, trial registries, policymakers, regulators, and other key stakeholders. PMID:23295957

SPIRIT 2013 statement: defining standard protocol items for clinical trials.

PubMed

Chan, An-Wen; Tetzlaff, Jennifer M; Altman, Douglas G; Laupacis, Andreas; Gøtzsche, Peter C; Krleža-Jerić, Karmela; Hróbjartsson, Asbjørn; Mann, Howard; Dickersin, Kay; Berlin, Jesse A; Doré, Caroline J; Parulekar, Wendy R; Summerskill, William S M; Groves, Trish; Schulz, Kenneth F; Sox, Harold C; Rockhold, Frank W; Rennie, Drummond; Moher, David

2013-02-05

The protocol of a clinical trial serves as the foundation for study planning, conduct, reporting, and appraisal. However, trial protocols and existing protocol guidelines vary greatly in content and quality. This article describes the systematic development and scope of SPIRIT (Standard Protocol Items: Recommendations for Interventional Trials) 2013, a guideline for the minimum content of a clinical trial protocol.The 33-item SPIRIT checklist applies to protocols for all clinical trials and focuses on content rather than format. The checklist recommends a full description of what is planned; it does not prescribe how to design or conduct a trial. By providing guidance for key content, the SPIRIT recommendations aim to facilitate the drafting of high-quality protocols. Adherence to SPIRIT would also enhance the transparency and completeness of trial protocols for the benefit of investigators, trial participants, patients, sponsors, funders, research ethics committees or institutional review boards, peer reviewers, journals, trial registries, policymakers, regulators, and other key stakeholders.

Low accuracy and low consistency of fourth-graders' school breakfast and school lunch recalls

PubMed Central

THOMPSON, WILLIAM 0.; LITAKER, MARK S.; FRYE, FRANCESCA H.A.; GUINN, CAROLINE H.

2005-01-01

Objective To determine the accuracy and consistency of fourth-graders' school breakfast and school lunch recalls obtained during 24-hour recalls and compared with observed intake. Design Children were interviewed using a multiple-pass protocol at school the morning after being observed eating school breakfast and school lunch. Subjects 104 children stratified by ethnicity (African-American, white) and gender were randomly selected and interviewed up to 3 times each with 4 to 14 weeks between each interview. Statistical analysis Match, omission, and intrusion rates to determine accuracy of reporting items; arithmetic and/or absolute differences to determine accuracy for reporting amounts; total inaccuracy to determine inaccuracy for reporting items and amounts combined; intraclass correlation coefficients (ICC) to determine consistency. Results Means were 51% for omission rate, 39% for intrusion rate, and 7.1 servings for total inaccuracy. Total inaccuracy decreased significantly from the first to the third recall (P=0.006). The ICC was 0.29 for total inaccuracy and 0.15 for omission rate. For all meal components except bread/grain and beverage, there were more omissions than intrusions. Mean arithmetic and absolute differences per serving in amount reported for matches were -0.08 and 0.24, respectively. Mean amounts per serving of omissions and intrusions were 0.86 and 0.80, respectively. Applications/conclusions The low accuracy and low consistency of children's recalls from this study raise concerns regarding the current uses of dietary recalls obtained from children. To improve the accuracy and consistency of children's dietary recalls, validation studies are needed to determine the best way(s) to interview children. PMID:11905461

Collecting Practice-level Data in a Changing Physician Office-based Ambulatory Care Environment: A Pilot Study Examining the Physician induction interview Component of the National Ambulatory Medical Care Survey.

PubMed

Halley, Meghan C; Rendle, Katharine A; Gugerty, Brian; Lau, Denys T; Luft, Harold S; Gillespie, Katherine A

2017-11-01

Objective This report examines ways to improve National Ambulatory Medical Care Survey (NAMCS) data on practice and physician characteristics in multispecialty group practices. Methods From February to April 2013, the National Center for Health Statistics (NCHS) conducted a pilot study to observe the collection of the NAMCS physician interview information component in a large multispecialty group practice. Nine physicians were randomly sampled using standard NAMCS recruitment procedures; eight were eligible and agreed to participate. Using standard protocols, three field representatives conducted NAMCS physician induction interviews (PIIs) while trained ethnographers observed and audio recorded the interviews. Transcripts and field notes were analyzed to identify recurrent issues in the data collection process. Results The majority of the NAMCS items appeared to have been easily answered by the physician respondents. Among the items that appeared to be difficult to answer, three themes emerged: (a) physician respondents demonstrated an inconsistent understanding of "location" in responding to questions; (b) lack of familiarity with administrative matters made certain questions difficult for physicians to answer; and (c) certain primary care‑oriented questions were not relevant to specialty care providers. Conclusions Some PII survey questions were challenging for physicians in a multispecialty practice setting. Improving the design and administration of NAMCS data collection is part of NCHS' continuous quality improvement process. All material appearing in this report is in the public domain and may be reproduced or copied without permission; citation as to source, however, is appreciated.

Writing Interview Protocols and Conducting Interviews: Tips for Students New to the Field of Qualitative Research

ERIC Educational Resources Information Center

Jacob, Stacy A.; Furgerson, S. Paige

2012-01-01

Students new to doing qualitative research in the ethnographic and oral traditions, often have difficulty creating successful interview protocols. This article offers practical suggestions for students new to qualitative research for both writing interview protocol that elicit useful data and for conducting the interview. This piece was originally…

Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement.

PubMed

Moher, David; Shamseer, Larissa; Clarke, Mike; Ghersi, Davina; Liberati, Alessandro; Petticrew, Mark; Shekelle, Paul; Stewart, Lesley A

2015-01-01

Systematic reviews should build on a protocol that describes the rationale, hypothesis, and planned methods of the review; few reviews report whether a protocol exists. Detailed, well-described protocols can facilitate the understanding and appraisal of the review methods, as well as the detection of modifications to methods and selective reporting in completed reviews. We describe the development of a reporting guideline, the Preferred Reporting Items for Systematic reviews and Meta-Analyses for Protocols 2015 (PRISMA-P 2015). PRISMA-P consists of a 17-item checklist intended to facilitate the preparation and reporting of a robust protocol for the systematic review. Funders and those commissioning reviews might consider mandating the use of the checklist to facilitate the submission of relevant protocol information in funding applications. Similarly, peer reviewers and editors can use the guidance to gauge the completeness and transparency of a systematic review protocol submitted for publication in a journal or other medium.

Development of a disease-specific quality of life questionnaire for adult patients with hereditary angioedema due to C1 inhibitor deficiency (HAE-QoL): Spanish multi-centre research project.

PubMed

Prior, Nieves; Remor, Eduardo; Gómez-Traseira, Carmen; López-Serrano, Concepción; Cabañas, Rosario; Contreras, Javier; Campos, Ángel; Cardona, Victoria; Cimbollek, Stefan; González-Quevedo, Teresa; Guilarte, Mar; de Rojas, Dolores Hernández Fernández; Marcos, Carmen; Rubio, María; Tejedor-Alonso, Miguel Ángel; Caballero, Teresa

2012-07-20

There is a need for a disease-specific instrument for assessing health-related quality of life in adults with hereditary angioedema due to C1 inhibitor deficiency, a rare, disabling and life-threatening disease. In this paper we report the protocol for the development and validation of a specific questionnaire, with details on the results of the process of item generation, domain selection, and the expert and patient rating phase. Semi-structured interviews were completed by 45 patients with hereditary angioedema and 8 experts from 8 regions in Spain. A qualitative content analysis of the responses was carried out. Issues raised by respondents were grouped into categories. Content analysis identified 240 different responses, which were grouped into 10 conceptual domains. Sixty- four items were generated. A total of 8 experts and 16 patients assessed the items for clarity, relevance to the disease, and correct dimension assignment. The preliminary version of the specific health-related quality of life questionnaire for hereditary angioedema (HAE-QoL v 1.1) contained 44 items grouped into 9 domains. To the best of our knowledge, this is the first multi-centre research project that aims to develop a specific health-related quality of life questionnaire for adult patients with hereditary angioedema due to C1 inhibitor deficiency. A preliminary version of the specific HAE-QoL questionnaire was obtained. The qualitative analysis of interviews together with the expert and patient rating phase helped to ensure content validity. A pilot study will be performed to assess the psychometric properties of the questionnaire and to decide on the final version.

Validation of an instrument to assess visual ability in children with visual impairment in China.

PubMed

Huang, Jinhai; Khadka, Jyoti; Gao, Rongrong; Zhang, Sifang; Dong, Wenpeng; Bao, Fangjun; Chen, Haisi; Wang, Qinmei; Chen, Hao; Pesudovs, Konrad

2017-04-01

To validate a visual ability instrument for school-aged children with visual impairment in China by translating, culturally adopting and Rasch scaling the Cardiff Visual Ability Questionnaire for Children (CVAQC). The 25-item CVAQC was translated into Mandarin using a standard protocol. The translated version (CVAQC-CN) was subjected to cognitive testing to ensure a proper cultural adaptation of its content. Then, the CVAQC-CN was interviewer-administered to 114 school-aged children and young people with visual impairment. Rasch analysis was carried out to assess its psychometric properties. The correlation between the CVAQC-CN visual ability scores and clinical measure of vision (visual acuity; VA and contrast sensitivity, CS) were assessed using Spearman's r. Based on cultural adaptation exercise, cognitive testing, missing data and Rasch metrics-based iterative item removal, three items were removed from the original 25. The 22-item CVAQC-CN demonstrated excellent measurement precision (person separation index, 3.08), content validity (item separation, 10.09) and item reliability (0.99). Moreover, the CVAQC-CN was unidimensional and had no item bias. The person-item map indicated good targeting of item difficulty to person ability. The CVAQC-CN had moderate correlations between CS (-0.53, p<0.00001) and VA (0.726, p<0.00001), respectively, indicating its validity. The 22-item CVAQC-CN is a psychometrically robust and valid instrument to measure visual ability in children with visual impairment in China. The instrument can be used as a clinical and research outcome measure to assess the change in visual ability after low vision rehabilitation intervention. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/.

SPIRIT 2013 explanation and elaboration: guidance for protocols of clinical trials

PubMed Central

Tetzlaff, Jennifer M; Gøtzsche, Peter C; Altman, Douglas G; Mann, Howard; Berlin, Jesse A; Dickersin, Kay; Hróbjartsson, Asbjørn; Schulz, Kenneth F; Parulekar, Wendy R; Krleža-Jerić, Karmela; Laupacis, Andreas; Moher, David

2013-01-01

High quality protocols facilitate proper conduct, reporting, and external review of clinical trials. However, the completeness of trial protocols is often inadequate. To help improve the content and quality of protocols, an international group of stakeholders developed the SPIRIT 2013 Statement (Standard Protocol Items: Recommendations for Interventional Trials). The SPIRIT Statement provides guidance in the form of a checklist of recommended items to include in a clinical trial protocol. This SPIRIT 2013 Explanation and Elaboration paper provides important information to promote full understanding of the checklist recommendations. For each checklist item, we provide a rationale and detailed description; a model example from an actual protocol; and relevant references supporting its importance. We strongly recommend that this explanatory paper be used in conjunction with the SPIRIT Statement. A website of resources is also available (www.spirit-statement.org). The SPIRIT 2013 Explanation and Elaboration paper, together with the Statement, should help with the drafting of trial protocols. Complete documentation of key trial elements can facilitate transparency and protocol review for the benefit of all stakeholders. PMID:23303884

SPIRIT 2013 explanation and elaboration: guidance for protocols of clinical trials.

PubMed

Chan, An-Wen; Tetzlaff, Jennifer M; Gøtzsche, Peter C; Altman, Douglas G; Mann, Howard; Berlin, Jesse A; Dickersin, Kay; Hróbjartsson, Asbjørn; Schulz, Kenneth F; Parulekar, Wendy R; Krleza-Jeric, Karmela; Laupacis, Andreas; Moher, David

2013-01-08

High quality protocols facilitate proper conduct, reporting, and external review of clinical trials. However, the completeness of trial protocols is often inadequate. To help improve the content and quality of protocols, an international group of stakeholders developed the SPIRIT 2013 Statement (Standard Protocol Items: Recommendations for Interventional Trials). The SPIRIT Statement provides guidance in the form of a checklist of recommended items to include in a clinical trial protocol. This SPIRIT 2013 Explanation and Elaboration paper provides important information to promote full understanding of the checklist recommendations. For each checklist item, we provide a rationale and detailed description; a model example from an actual protocol; and relevant references supporting its importance. We strongly recommend that this explanatory paper be used in conjunction with the SPIRIT Statement. A website of resources is also available (www.spirit-statement.org). The SPIRIT 2013 Explanation and Elaboration paper, together with the Statement, should help with the drafting of trial protocols. Complete documentation of key trial elements can facilitate transparency and protocol review for the benefit of all stakeholders.

Investigating Linguistic Sources of Differential Item Functioning Using Expert Think-Aloud Protocols in Science Achievement Tests

NASA Astrophysics Data System (ADS)

Roth, Wolff-Michael; Oliveri, Maria Elena; Dallie Sandilands, Debra; Lyons-Thomas, Juliette; Ercikan, Kadriye

2013-03-01

Even if national and international assessments are designed to be comparable, subsequent psychometric analyses often reveal differential item functioning (DIF). Central to achieving comparability is to examine the presence of DIF, and if DIF is found, to investigate its sources to ensure differentially functioning items that do not lead to bias. In this study, sources of DIF were examined using think-aloud protocols. The think-aloud protocols of expert reviewers were conducted for comparing the English and French versions of 40 items previously identified as DIF (N = 20) and non-DIF (N = 20). Three highly trained and experienced experts in verifying and accepting/rejecting multi-lingual versions of curriculum and testing materials for government purposes participated in this study. Although there is a considerable amount of agreement in the identification of differentially functioning items, experts do not consistently identify and distinguish DIF and non-DIF items. Our analyses of the think-aloud protocols identified particular linguistic, general pedagogical, content-related, and cognitive factors related to sources of DIF. Implications are provided for the process of arriving at the identification of DIF, prior to the actual administration of tests at national and international levels.

Psychometric properties of the Zarit Caregiver Burden Interview administered to caregivers to patients with Duchenne muscular dystrophy: a Rasch analysis.

PubMed

Landfeldt, Erik; Mayhew, Anna; Straub, Volker; Bushby, Katharine; Lochmüller, Hanns; Lindgren, Peter

2017-12-18

To explore the psychometric properties of the full 22-item English (UK and US) version of the Zarit Caregiver Burden Interview administered to caregivers to patients with Duchenne muscular dystrophy. Caregivers to patients with Duchenne muscular dystrophy from the United Kingdom and the United States, recruited through the TREAT-NMD network, completed the Zarit Caregiver Burden Interview online. The psychometric properties of the Zarit Caregiver Burden Interview were examined using Rasch analysis. A total of 475 caregivers completed the Zarit Caregiver Burden Interview. Model misfit was identified for 9 of 22 items (mean item fit residual 0.061, SD: 2.736) and 13 of 22 items displayed disordered thresholds. The overall item-trait interaction chi-square value was 499 (198 degrees of freedom, p < 0.001). The mean person fit residual was estimated at -0.213 (SD: 1.235). The Person Separation Index and Cronbach's α were estimated at 0.902 and 0.914, respectively. Item dependency was low and we found no significant differential item functioning by country or sex. Our Rasch analysis shows that the Zarit Caregiver Burden Interview fails to fully operationalize a quantitative conceptualization of caregiver burden among caregivers to patients with Duchenne muscular dystrophy from the United Kingdom and the United States. Further research is needed to understand the psychometric properties of the Zarit Caregiver Burden Interview in other populations and settings. Implications for Rehabilitation Duchenne muscular dystrophy is a terminal disease characterized by progressive muscle degeneration resulting in substantial disability and a significant burden on family caregivers. The Zarit Caregiver Burden Interview is one of the most widely applied measures of caregiver burden. Our Rasch analysis suggests that the Zarit Caregiver Burden Interview is not fit for purpose to measure burden in UK and US caregivers to patients with Duchenne muscular dystrophy. Clinicians and decision-makers should interpret Zarit Caregiver Burden Interview data from these populations with caution.

Cross-cultural adaptation of the Posttraumatic Stress Disorder Checklist 5 (PCL-5) and Life Events Checklist 5 (LEC-5) for the Brazilian context.

PubMed

Lima, Eduardo de Paula; Vasconcelos, Alina Gomide; Berger, William; Kristensen, Christian Haag; Nascimento, Elizabeth do; Figueira, Ivan; Mendlowicz, Mauro Vitor

2016-01-01

To describe the process of cross-cultural adaptation of the Posttraumatic Stress Disorder Checklist 5 (PCL-5) and the Life Events Checklist 5 (LEC-5) for the Brazilian sociolinguistic context. The adaptation process sought to establish conceptual, semantic, and operational equivalence between the original items of the questionnaire and their translated versions, following standardized protocols. Initially, two researchers translated the original version of the scale into Brazilian Portuguese. Next, a native English speaker performed the back-translation. Quantitative and qualitative criteria were used to evaluate the intelligibility of items. Five specialists compared the original and translated versions and assessed the degree of equivalence between them in terms of semantic, idiomatic, cultural and conceptual aspects. The degree of agreement between the specialists was measured using the content validity coefficient (CVC). Finally, 28 volunteers from the target population were interviewed in order to assess their level of comprehension of the items. CVCs for items from both scales were satisfactory for all criteria. The mean comprehension scores were above the cutoff point established. Overall, the results showed that the adapted versions' items had adequate rates of equivalence in terms of concepts and semantics. The translation and adaptation processes were successful for both scales, resulting in versions that are not only equivalent to the originals, but are also intelligible for the population at large.

Clinical utility of the MMPI-2-RF SUI items and scale in a forensic inpatient setting: Association with interview self-report and future suicidal behaviors.

PubMed

Glassmire, David M; Tarescavage, Anthony M; Burchett, Danielle; Martinez, Jennifer; Gomez, Anthony

2016-11-01

In this study, we examined whether the 5 Minnesota Multiphasic Personality Inventory-2-Restructured Form (MMPI-2-RF; Ben-Porath & Tellegen, 2008/2011) Suicidal/Death Ideation (SUI) items (93, 120, 164, 251, and 334) would provide incremental suicide-risk assessment information after accounting for information garnered from clinical interview questions. Among 229 forensic inpatients (146 men, 83 women) who were administered the MMPI-2-RF, 34.9% endorsed at least 1 SUI item. We found that patients who endorsed SUI items on the MMPI-2-RF concurrently denied conceptually related suicide-risk information during the clinical interview. For instance, 8% of the sample endorsed Item 93 (indicating recent suicidal ideation), yet denied current suicidal ideation upon interview. Conversely, only 2.2% of the sample endorsed current suicidal ideation during the interview, yet denied recent suicidal ideation on Item 93. The SUI scale, as well as the MMPI-2-RF Demoralization (RCd) and Low Positive Emotions (RC2) scales, correlated significantly and meaningfully with conceptually related suicide-risk information from the interview, including history of suicide attempts, history of suicidal ideation, current suicidal ideation, and months since last suicide attempt. We also found that the SUI scale added incremental variance (after accounting for information garnered from the interview and after accounting for scores on RCd and RC2) to predictions of future suicidal behavior within 1 year of testing. Relative risk ratios indicated that both SUI-item endorsement and the presence of interview-reported risk information significantly and meaningfully increased the risk of suicidal behavior in the year following testing, particularly when endorsement of suicidal ideation occurred for both methods of self-report. (PsycINFO Database Record (c) 2016 APA, all rights reserved).

Evaluation of item candidates for a diabetic retinopathy quality of life item bank.

PubMed

Fenwick, Eva K; Pesudovs, Konrad; Khadka, Jyoti; Rees, Gwyn; Wong, Tien Y; Lamoureux, Ecosse L

2013-09-01

We are developing an item bank assessing the impact of diabetic retinopathy (DR) on quality of life (QoL) using a rigorous multi-staged process combining qualitative and quantitative methods. We describe here the first two qualitative phases: content development and item evaluation. After a comprehensive literature review, items were generated from four sources: (1) 34 previously validated patient-reported outcome measures; (2) five published qualitative articles; (3) eight focus groups and 18 semi-structured interviews with 57 DR patients; and (4) seven semi-structured interviews with diabetes or ophthalmic experts. Items were then evaluated during 3 stages, namely binning (grouping) and winnowing (reduction) based on key criteria and panel consensus; development of item stems and response options; and pre-testing of items via cognitive interviews with patients. The content development phase yielded 1,165 unique items across 7 QoL domains. After 3 sessions of binning and winnowing, items were reduced to a minimally representative set (n = 312) across 9 domains of QoL: visual symptoms; ocular surface symptoms; activity limitation; mobility; emotional; health concerns; social; convenience; and economic. After 8 cognitive interviews, 42 items were amended resulting in a final set of 314 items. We have employed a systematic approach to develop items for a DR-specific QoL item bank. The psychometric properties of the nine QoL subscales will be assessed using Rasch analysis. The resulting validated item bank will allow clinicians and researchers to better understand the QoL impact of DR and DR therapies from the patient's perspective.

Application of Think Aloud Protocols for Examining and Confirming Sources of Differential Item Functioning Identified by Expert Reviews

ERIC Educational Resources Information Center

Ercikan, Kadriye; Arim, Rubab; Law, Danielle; Domene, Jose; Gagnon, France; Lacroix, Serge

2010-01-01

This paper demonstrates and discusses the use of think aloud protocols (TAPs) as an approach for examining and confirming sources of differential item functioning (DIF). The TAPs are used to investigate to what extent surface characteristics of the items that are identified by expert reviews as sources of DIF are supported by empirical evidence…

Comparing Lay Community and Academic Survey Center Interviewers in Conducting Household Interviews in Latino Communities.

PubMed

Chan-Golston, Alec M; Friedlander, Scott; Glik, Deborah C; Prelip, Michael L; Belin, Thomas R; Brookmeyer, Ron; Santos, Robert; Chen, Jie; Ortega, Alexander N

2016-01-01

The employment of professional interviewers from academic survey centers to conduct surveys has been standard practice. Because one goal of community-engaged research is to provide professional skills to community residents, this paper considers whether employing locally trained lay interviewers from within the community may be as effective as employing interviewers from an academic survey center with regard to unit and item nonresponse rates and cost. To study a nutrition-focused intervention, 1035 in-person household interviews were conducted in East Los Angeles and Boyle Heights, 503 of which were completed by lay community interviewers. A chi-square test was used to assess differences in unit nonresponse rates between professional and community interviewers and Welch's t tests were used to assess differences in item nonresponse rates. A cost comparison analysis between the two interviewer groups was also conducted. Interviewers from the academic survey center had lower unit nonresponse rates than the lay community interviewers (16.2% vs. 23.3%; p < 0.01). However, the item nonresponse rates were lower for the community interviewers than the professional interviewers (1.4% vs. 3.3%; p < 0.01). Community interviewers cost approximately $415.38 per survey whereas professional interviewers cost approximately $537.29 per survey. With a lower cost per completed survey and lower item nonresponse rates, lay community interviewers are a viable alternative to professional interviewers for fieldwork in community-based research. Additional research is needed to assess other important aspects of data quality interviewer such as interviewer effects and response error.

The Effects of Respondents' Consent to Be Recorded on Interview Length and Data Quality in a National Panel Study

ERIC Educational Resources Information Center

McGonagle, Katherine A.; Brown, Charles; Schoeni, Robert F.

2015-01-01

Recording interviews is a key feature of quality control protocols for most survey organizations. We examine the effects on interview length and data quality of a new protocol adopted by a national panel study. The protocol recorded a randomly chosen one-third of all interviews digitally, although all respondents were asked for permission to…

Augmented Reality Mentor for Training Maintenance Procedures: Interim Assessment

DTIC Science & Technology

2014-08-01

USABILITY QUESTIONNAIRE ........................................................ C-1 APPENDIX D: AR MENTOR USABILITY INTERVIEW PROTOCOL...APPENDIX F. INSTRUCTOR INTERVIEW PROTOCOL ......................................... F-1 APPENDIX G: MECHANIC INTERVIEW PROTOCOL...thus freeing up the opportunity for instruction around higher-order problem solving. They may also reduce the burden on peer “ helpers ” who read

Validation of the content of the prevention protocol for early sepsis caused by Streptococcus agalactiaein newborns

PubMed Central

da Silva, Fabiana Alves; Vidal, Cláudia Fernanda de Lacerda; de Araújo, Ednaldo Cavalcante

2015-01-01

Abstract Objective: to validate the content of the prevention protocol for early sepsis caused by Streptococcus agalactiaein newborns. Method: a transversal, descriptive and methodological study, with a quantitative approach. The sample was composed of 15 judges, 8 obstetricians and 7 pediatricians. The validation occurred through the assessment of the content of the protocol by the judges that received the instrument for data collection - checklist - which contained 7 items that represent the requisites to be met by the protocol. The validation of the content was achieved by applying the Content Validity Index. Result: in the judging process, all the items that represented requirements considered by the protocol obtained concordance within the established level (Content Validity Index > 0.75). Of 7 items, 6 have obtained full concordance (Content Validity Index 1.0) and the feasibility item obtained a Content Validity Index of 0.93. The global assessment of the instruments obtained a Content Validity Index of 0.99. Conclusion: the validation of content that was done was an efficient tool for the adjustment of the protocol, according to the judgment of experienced professionals, which demonstrates the importance of conducting a previous validation of the instruments. It is expected that this study will serve as an incentive for the adoption of universal tracking by other institutions through validated protocols. PMID:26444165

Adolescent substance use screening in primary care: validity of computer self-administered vs. clinician-administered screening

PubMed Central

Harris, Sion Kim; Knight, John R; Van Hook, Shari; Sherritt, Lon; Brooks, Traci; Kulig, John W; Nordt, Christina; Saitz, Richard

2015-01-01

Background Computer self-administration may help busy pediatricians’ offices increase adolescent substance use screening rates efficiently and effectively, if proven to yield valid responses. The CRAFFT screening protocol for adolescents has demonstrated validity as an interview, but a computer self-entry approach needs validity testing. The aim of this study was to evaluate the criterion validity and time efficiency of a computerized adolescent substance use screening protocol implemented by self-administration or clinician-administration. Methods 12- to 17-year-old patients coming for routine care at three primary care clinics completed the computerized screen by both self-administration and clinician-administration during their visit. To account for order effects, we randomly assigned participants to self-administer the screen either before or after seeing their clinician. Both were conducted using a tablet computer and included identical items (any past-12-month use of tobacco, alcohol, drugs; past-3-months frequency of each; and six CRAFFT items). The criterion measure for substance use was the Timeline Follow-Back, and for alcohol/drug use disorder, the Adolescent Diagnostic Interview, both conducted by confidential research assistant-interview after the visit. Tobacco dependence risk was assessed with the self-administered Hooked on Nicotine Checklist (HONC). Analyses accounted for the multi-site cluster sampling design. Results Among 136 participants, mean age was 15.0±1.5 yrs, 54% were girls, 53% were Black or Hispanic, and 67% had ≥3 prior visits with their clinician. Twenty-seven percent reported any substance use (including tobacco) in the past 12 months, 7% met criteria for an alcohol or cannabis use disorder, and 4% were HONC-positive. Sensitivity/specificity of the screener were high for detecting past-12-month use or disorder and did not differ between computer and clinician. Mean completion time was 49 seconds (95%CI 44-54) for computer and 74 seconds (95%CI 68-87) for clinician (paired comparison p<0.001). Conclusions Substance use screening by computer self-entry is a valid and time-efficient alternative to clinician-administered screening. PMID:25774878

Accuracy of Fourth-Graders' Dietary Recalls of School Breakfast and School Lunch Validated with Observations: In-Person versus Telephone Interviews

PubMed Central

THOMPSON, WILLIAM O.; LITAKER, MARK S.; GUINN, CAROLINE H.; FRYE, FRANCESCA H. A.; BAGLIO, MICHELLE L.; SHAFFER, NICOLE M.

2005-01-01

Objective: To investigate the accuracy of children's dietary recalls of school breakfast and school lunch validated with observations and obtained during in-person versus telephone interviews. Design: Each child was observed eating school breakfast and school lunch and was interviewed that evening about that day's intake. Setting: Ten elementary schools. Participants: A sample of fourth-graders was randomly selected within race (black, white) and gender strata, observed, and interviewed in person (n = 33) or by telephone (n = 36). Main Outcomes Measured: Rates for omissions (items observed but not reported) and intrusions (items reported but not observed) were calculated to determine accuracy for reporting items. A measure of total inaccuracy was calculated to determine inaccuracy for reporting items and amounts combined. Analysis: Analysis of variance; chi-square. Results: Interview type (in person, telephone) did not significantly affect recall accuracy. For omission rate, intrusion rate, and total inaccuracy, means were 34%, 19%, and 4.6 servings for in person recalls and 32%, 16%, and 4.3 servings for telephone recalls of school breakfast and school lunch. Conclusions and Implications: The accuracy of children's recalls of school breakfast and school lunch is not significantly different whether obtained in person or by telephone. Whether interviewed in person or by telephone, children reported only 67% of items observed; furthermore, 17% of items reported were not observed. PMID:12773283

Developing a short version of the Toronto Structured Interview for Alexithymia using item response theory.

PubMed

Sekely, Angela; Taylor, Graeme J; Bagby, R Michael

2018-03-17

The Toronto Structured Interview for Alexithymia (TSIA) was developed to provide a structured interview method for assessing alexithymia. One drawback of this instrument is the amount of time it takes to administer and score. The current study used item response theory (IRT) methods to analyze data from a large heterogeneous multi-language sample (N = 842) to investigate whether a subset of items could be selected to create a short version of the instrument. Samejima's (1969) graded response model was used to fit the item responses. Items providing maximum information were retained in the short model, resulting in the elimination of 12-items from the original 24-items. Despite the 50% reduction in the number of items, 65.22% of the information was retained. Further studies are needed to validate the short version. A short version of the TSIA is potentially of practical value to clinicians and researchers with time constraints. Copyright © 2018. Published by Elsevier B.V.

Inter-rater reliability of Hamilton depression rating scale using video-recorded interviews — Focus on rater-blinding

PubMed Central

Prasad, M. Krishna; Udupa, K.; Kishore, K. R.; Thirthalli, J.; Sathyaprabha, T. N.; Gangadhar, B. N.

2009-01-01

Background: Hamilton depression rating scale (Ham-D) is the most widely used clinician rating scale for depression. There has been no Indian study that has examined the inter-rater reliability (IRR) of video-recorded interviews of the 21-item Ham-D. Aim: To study the IRR of scoring video-recorded interviews for 21-item Ham-D. Materials and Methods: Eighteen subjects with major depressive disorder involved in a larger study were interviewed using the semi-structured clinical interview of the 21-item Ham-D by a primary rater after informed consent. These interviews were video-recorded and portions edited to ensure rater blinding. Subsequently, the video-recorded interviews were rated by a “blind” rater. Both rated the different sub-domains of Ham-D according to Rhoades and Overall (1983). IRR was evaluated using intra-class correlation coefficient. Results: Excellent IRR was observed (0.9891) between the two raters. This was true for each of the primary factors and super-factors. Conclusion: Video recorded 21-item Ham-D has excellentIRR. Video-recorded interviews of Ham-D can be reliably used to blind raters in research. PMID:19881046

Guidelines for Inclusion of Patient-Reported Outcomes in Clinical Trial Protocols: The SPIRIT-PRO Extension.

PubMed

Calvert, Melanie; Kyte, Derek; Mercieca-Bebber, Rebecca; Slade, Anita; Chan, An-Wen; King, Madeleine T; Hunn, Amanda; Bottomley, Andrew; Regnault, Antoine; Chan, An-Wen; Ells, Carolyn; O'Connor, Daniel; Revicki, Dennis; Patrick, Donald; Altman, Doug; Basch, Ethan; Velikova, Galina; Price, Gary; Draper, Heather; Blazeby, Jane; Scott, Jane; Coast, Joanna; Norquist, Josephine; Brown, Julia; Haywood, Kirstie; Johnson, Laura Lee; Campbell, Lisa; Frank, Lori; von Hildebrand, Maria; Brundage, Michael; Palmer, Michael; Kluetz, Paul; Stephens, Richard; Golub, Robert M; Mitchell, Sandra; Groves, Trish

2018-02-06

Patient-reported outcome (PRO) data from clinical trials can provide valuable evidence to inform shared decision making, labeling claims, clinical guidelines, and health policy; however, the PRO content of clinical trial protocols is often suboptimal. The SPIRIT (Standard Protocol Items: Recommendations for Interventional Trials) statement was published in 2013 and aims to improve the completeness of trial protocols by providing evidence-based recommendations for the minimum set of items to be addressed, but it does not provide PRO-specific guidance. To develop international, consensus-based, PRO-specific protocol guidance (the SPIRIT-PRO Extension). The SPIRIT-PRO Extension was developed following the Enhancing Quality and Transparency of Health Research (EQUATOR) Network's methodological framework for guideline development. This included (1) a systematic review of existing PRO-specific protocol guidance to generate a list of potential PRO-specific protocol items (published in 2014); (2) refinements to the list and removal of duplicate items by the International Society for Quality of Life Research (ISOQOL) Protocol Checklist Taskforce; (3) an international stakeholder survey of clinical trial research personnel, PRO methodologists, health economists, psychometricians, patient advocates, funders, industry representatives, journal editors, policy makers, ethicists, and researchers responsible for evidence synthesis (distributed by 38 international partner organizations in October 2016); (4) an international Delphi exercise (n = 137 invited; October 2016 to February 2017); and (5) consensus meeting (n = 30 invited; May 2017). Prior to voting, consensus meeting participants were informed of the results of the Delphi exercise and given data from structured reviews evaluating the PRO protocol content of 3 defined samples of trial protocols. The systematic review identified 162 PRO-specific protocol recommendations from 54 sources. The ISOQOL Taskforce (n = 21) reduced this to 56 items, which were considered by 138 international stakeholder survey participants and 99 Delphi panelists. The final wording of the SPIRIT-PRO Extension was agreed on at a consensus meeting (n = 29 participants) and reviewed by external group of experts during a consultation period. Eleven extensions and 5 elaborations to the SPIRIT 2013 checklist were recommended for inclusion in clinical trial protocols in which PROs are a primary or key secondary outcome. Extension items focused on PRO-specific issues relating to the trial rationale, objectives, eligibility criteria, concepts used to evaluate the intervention, time points for assessment, PRO instrument selection and measurement properties, data collection plan, translation to other languages, proxy completion, strategies to minimize missing data, and whether PRO data will be monitored during the study to inform clinical care. The SPIRIT-PRO guidelines provide recommendations for items that should be addressed and included in clinical trial protocols in which PROs are a primary or key secondary outcome. Improved design of clinical trials including PROs could help ensure high-quality data that may inform patient-centered care.

Refinement of the Long-Term Conditions Questionnaire (LTCQ): patient and expert stakeholder opinion.

PubMed

Kelly, Laura; Potter, Caroline M; Hunter, Cheryl; Gibbons, Elizabeth; Fitzpatrick, Ray; Jenkinson, Crispin; Peters, Michele

2016-01-01

It is a key UK government priority to assess and improve outcomes in people with long-term conditions (LTCs). We are developing a new patient-reported outcome measure, the Long-Term Conditions Questionnaire (LTCQ), for use among people with single or multiple LTCs. This study aimed to refine candidate LTCQ items that had previously been informed through literature reviews, interviews with professional stakeholders, and interviews with people with LTCs. Cognitive interviews (n=32) with people living with LTCs and consultations with professional stakeholders (n=13) and public representatives (n=5) were conducted to assess the suitability of 23 candidate items. Items were tested for content and comprehensibility and underwent a translatability assessment. Four rounds of revisions took place, due to amendments to item structure, improvements to item clarity, item duplication, and recommendations for future translations. Twenty items were confirmed as relevant to living with LTCs and understandable to patients and professionals. This study supports the content validity of the LTCQ items among people with LTCs and professional stakeholders. The final items are suitable to enter the next stage of psychometric refinement.

75 FR 11540 - Agency Information Collection Activities: Proposed Collection; Comment Request

Federal Register 2010, 2011, 2012, 2013, 2014

2010-03-11

... the evaluation: (1) Pre/post-test interview protocol--Consisting of both open- and closed-ended... respondents in interviews that will take one hour each. The pre/post-test interview protocol will be... the year. At the end of the year, post-test interviews will be performed as one-hour group interviews...

Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015: elaboration and explanation.

PubMed

Shamseer, Larissa; Moher, David; Clarke, Mike; Ghersi, Davina; Liberati, Alessandro; Petticrew, Mark; Shekelle, Paul; Stewart, Lesley A

2015-01-02

Protocols of systematic reviews and meta-analyses allow for planning and documentation of review methods, act as a guard against arbitrary decision making during review conduct, enable readers to assess for the presence of selective reporting against completed reviews, and, when made publicly available, reduce duplication of efforts and potentially prompt collaboration. Evidence documenting the existence of selective reporting and excessive duplication of reviews on the same or similar topics is accumulating and many calls have been made in support of the documentation and public availability of review protocols. Several efforts have emerged in recent years to rectify these problems, including development of an international register for prospective reviews (PROSPERO) and launch of the first open access journal dedicated to the exclusive publication of systematic review products, including protocols (BioMed Central's Systematic Reviews). Furthering these efforts and building on the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-analyses) guidelines, an international group of experts has created a guideline to improve the transparency, accuracy, completeness, and frequency of documented systematic review and meta-analysis protocols--PRISMA-P (for protocols) 2015. The PRISMA-P checklist contains 17 items considered to be essential and minimum components of a systematic review or meta-analysis protocol.This PRISMA-P 2015 Explanation and Elaboration paper provides readers with a full understanding of and evidence about the necessity of each item as well as a model example from an existing published protocol. This paper should be read together with the PRISMA-P 2015 statement. Systematic review authors and assessors are strongly encouraged to make use of PRISMA-P when drafting and appraising review protocols. © BMJ Publishing Group Ltd 2014.

Development of the Oxford Participation and Activities Questionnaire: constructing an item pool

PubMed Central

Kelly, Laura; Jenkinson, Crispin; Dummett, Sarah; Dawson, Jill; Fitzpatrick, Ray; Morley, David

2015-01-01

Purpose The Oxford Participation and Activities Questionnaire is a patient-reported outcome measure in development that is grounded on the World Health Organization International Classification of Functioning, Disability, and Health (ICF). The study reported here aimed to inform and generate an item pool for the new measure, which is specifically designed for the assessment of participation and activity in patients experiencing a range of health conditions. Methods Items were informed through in-depth interviews conducted with 37 participants spanning a range of conditions. Interviews aimed to identify how their condition impacted their ability to participate in meaningful activities. Conditions included arthritis, cancer, chronic back pain, diabetes, motor neuron disease, multiple sclerosis, Parkinson’s disease, and spinal cord injury. Transcripts were analyzed using the framework method. Statements relating to ICF themes were recast as questionnaire items and shown for review to an expert panel. Cognitive debrief interviews (n=13) were used to assess items for face and content validity. Results ICF themes relevant to activities and participation in everyday life were explored, and a total of 222 items formed the initial item pool. This item pool was refined by the research team and 28 generic items were mapped onto all nine chapters of the ICF construct, detailing activity and participation. Cognitive interviewing confirmed the questionnaire instructions, items, and response options were acceptable to participants. Conclusion Using a clear conceptual basis to inform item generation, 28 items have been identified as suitable to undergo further psychometric testing. A large-scale postal survey will follow in order to refine the instrument further and to assess its psychometric properties. The final instrument is intended for use in clinical trials and interventions targeted at maintaining or improving activity and participation. PMID:26056503

Development of the Oxford Participation and Activities Questionnaire: constructing an item pool.

PubMed

Kelly, Laura; Jenkinson, Crispin; Dummett, Sarah; Dawson, Jill; Fitzpatrick, Ray; Morley, David

2015-01-01

The Oxford Participation and Activities Questionnaire is a patient-reported outcome measure in development that is grounded on the World Health Organization International Classification of Functioning, Disability, and Health (ICF). The study reported here aimed to inform and generate an item pool for the new measure, which is specifically designed for the assessment of participation and activity in patients experiencing a range of health conditions. Items were informed through in-depth interviews conducted with 37 participants spanning a range of conditions. Interviews aimed to identify how their condition impacted their ability to participate in meaningful activities. Conditions included arthritis, cancer, chronic back pain, diabetes, motor neuron disease, multiple sclerosis, Parkinson's disease, and spinal cord injury. Transcripts were analyzed using the framework method. Statements relating to ICF themes were recast as questionnaire items and shown for review to an expert panel. Cognitive debrief interviews (n=13) were used to assess items for face and content validity. ICF themes relevant to activities and participation in everyday life were explored, and a total of 222 items formed the initial item pool. This item pool was refined by the research team and 28 generic items were mapped onto all nine chapters of the ICF construct, detailing activity and participation. Cognitive interviewing confirmed the questionnaire instructions, items, and response options were acceptable to participants. Using a clear conceptual basis to inform item generation, 28 items have been identified as suitable to undergo further psychometric testing. A large-scale postal survey will follow in order to refine the instrument further and to assess its psychometric properties. The final instrument is intended for use in clinical trials and interventions targeted at maintaining or improving activity and participation.

Qualitative Development of the PROMIS® Pediatric Stress Response Item Banks

PubMed Central

Gardner, William; Pajer, Kathleen; Riley, Anne W.; Forrest, Christopher B.

2013-01-01

Objective To describe the qualitative development of the Patient-Reported Outcome Measurement Information System (PROMIS®) Pediatric Stress Response item banks. Methods Stress response concepts were specified through a literature review and interviews with content experts, children, and parents. A library comprising 2,677 items derived from 71 instruments was developed. Items were classified into conceptual categories; new items were written and redundant items were removed. Items were then revised based on cognitive interviews (n = 39 children), readability analyses, and translatability reviews. Results 2 pediatric Stress Response sub-domains were identified: somatic experiences (43 items) and psychological experiences (64 items). Final item pools cover the full range of children’s stress experiences. Items are comprehensible among children aged ≥8 years and ready for translation. Conclusions Child- and parent-report versions of the item banks assess children’s somatic and psychological states when demands tax their adaptive capabilities. PMID:23124904

Development of a Patient-Reported Outcome Instrument to Evaluate Symptoms of Advanced NSCLC: Qualitative Research and Content Validity of the Non-Small Cell Lung Cancer Symptom Assessment Questionnaire (NSCLC-SAQ)

PubMed Central

Atkinson, Thomas M.; DeBusk, Kendra P.A.; Liepa, Astra M.; Scanlon, Michael; Coons, Stephen Joel

2016-01-01

PURPOSE To describe the process and results of the preliminary qualitative development of a new symptom-based PRO measure intended to assess treatment benefit in advanced non-small cell lung cancer (NSCLC) clinical trials. METHODS Individual qualitative interviews were conducted with adult NSCLC (Stage I–IV) patients in the US. Experienced interviewers conducted concept elicitation (CE) and cognitive interviews using semi-structured interview guides. The CE interview guide was used to elicit spontaneous reports of symptom experiences along with probing to further explore and confirm concepts. Interview transcripts were coded and analyzed by professional qualitative coders using Atlas.ti software, and were summarized by like-content using an iterative coding framework. Data from the CE interviews were considered alongside existing literature and clinical expert opinion during an item-generation process, leading to development of a preliminary version of the NSCLC Symptom Assessment Questionnaire (NSCLC-SAQ). Three waves of cognitive interviews were conducted to evaluate concept relevance, item interpretability, and structure of the draft items to facilitate further instrument refinement. FINDINGS Fifty-one patients (mean age 64.9 [SD=11.2]; 51.0% female) participated in the CE interviews. A total of 1,897 expressions of NSCLC-related symptoms were identified and coded in interview transcripts, representing approximately 42 distinct symptom concepts. A 9-item initial draft instrument was developed for testing in three waves of cognitive interviews with additional NSCLC patients (n=20), during which both paper and electronic versions of the instrument were evaluated and refined. Participant responses and feedback during cognitive interviews led to the removal of 2 items and substantial modifications to others. IMPLICATIONS The NSCLC-SAQ is a 7-item PRO measure intended for use in advanced NSCLC clinical trials to support medical product labelling. The NSCLC-SAQ uses a 7-day recall period and verbal rating scales. It was developed in accordance with the FDA’s PRO Guidance and scientific best practices, and the resulting qualitative interview data provide evidence of content validity. The NSCLC-SAQ has been prepared in both paper and electronic administration formats and a tablet computer-based version is currently undergoing quantitative testing to confirm its measurement properties and support FDA qualification. PMID:27041408

Measuring the effects of online health information for patients: Item generation for an e-health impact questionnaire

PubMed Central

Kelly, Laura; Jenkinson, Crispin; Ziebland, Sue

2013-01-01

Objective The internet is a valuable resource for accessing health information and support. We are developing an instrument to assess the effects of websites with experiential and factual health information. This study aimed to inform an item pool for the proposed questionnaire. Methods Items were informed through a review of relevant literature and secondary qualitative analysis of 99 narrative interviews relating to patient and carer experiences of health. Statements relating to identified themes were re-cast as questionnaire items and shown for review to an expert panel. Cognitive debrief interviews (n = 21) were used to assess items for face and content validity. Results Eighty-two generic items were identified following secondary qualitative analysis and expert review. Cognitive interviewing confirmed the questionnaire instructions, 62 items and the response options were acceptable to patients and carers. Conclusion Using a clear conceptual basis to inform item generation, 62 items have been identified as suitable to undergo further psychometric testing. Practice implications The final questionnaire will initially be used in a randomized controlled trial examining the effects of online patient's experiences. This will inform recommendations on the best way to present patients’ experiences within health information websites. PMID:23598293

Patient perspective on quality of geriatric care and rehabilitation--development and psychometric testing of a questionnaire.

PubMed

Wressle, Ewa; Eriksson, Lennart; Fahlander, Amie; Rasmusson, Ing-Marie; Tedemalm, Ulla; Tängmark, Karin

2006-06-01

The aim was to develop and test a questionnaire for use in telephone interviews concerning patient evaluation of geriatric care and rehabilitation. Instrument development was performed comprising qualitative interviews, construction of items, content validation, pilot study and data collection for evaluation of care and rehabilitation, clinical utility, reliability and construct validity. Qualitative interviews were performed with 12 elderly participants. The qualitative interviews formed the basis for the construction of 45 items. An expert panel performed a content validation of the questionnaire resulting in a revised version. A pilot study comprised 29 participants recently discharged from geriatric wards and the main data collection comprised 221 participants. Inclusion criteria were being able to perform a telephone interview and willingness to participate. Clinical utility was examined through questions to the interviewers, answered in writing. Cronbach's alpha coefficient was 0.79. According to a factor analysis and the evaluation of clinical utility, the underlying dimensions of the final revised questionnaire concern 'Respect and safety', 'Information and participation' and 'Rehabilitation interventions', scored in 18 items. In addition, one global item concerns satisfaction with care, resulting in 19 items in total. The revised questionnaire was named PaPeR, Patient Perspective on care and Rehabilitation. The questionnaire is considered valid, reliable and judged to have good clinical utility. The time consumption for the telephone interview is about 10-20 minutes. The questionnaire is useful in defining areas for potential quality improvement in geriatric wards.

Bifactor and Item Response Theory Analyses of Interviewer Report Scales of Cognitive Impairment in Schizophrenia

ERIC Educational Resources Information Center

Reise, Steven P.; Ventura, Joseph; Keefe, Richard S. E.; Baade, Lyle E.; Gold, James M.; Green, Michael F.; Kern, Robert S.; Mesholam-Gately, Raquelle; Nuechterlein, Keith H.; Seidman, Larry J.; Bilder, Robert

2011-01-01

A psychometric analysis of 2 interview-based measures of cognitive deficits was conducted: the 21-item Clinical Global Impression of Cognition in Schizophrenia (CGI-CogS; Ventura et al., 2008), and the 20-item Schizophrenia Cognition Rating Scale (SCoRS; Keefe et al., 2006), which were administered on 2 occasions to a sample of people with…

Health Worker Compliance with a 'Test And Treat' Malaria Case Management Protocol in Papua New Guinea.

PubMed

Pulford, Justin; Smith, Iso; Mueller, Ivo; Siba, Peter M; Hetzel, Manuel W

2016-01-01

The Papua New Guinea (PNG) Department of Health introduced a 'test and treat' malaria case management protocol in 2011. This study assesses health worker compliance with the test and treat protocol on a wide range of measures, examines self-reported barriers to health worker compliance as well as health worker attitudes towards the test and treat protocol. Data were collected by cross-sectional survey conducted in randomly selected primary health care facilities in 2012 and repeated in 2014. The combined survey data included passive observation of current or recently febrile patients (N = 771) and interviewer administered questionnaires completed with health workers (N = 265). Across the two surveys, 77.6% of patients were tested for malaria infection by rapid diagnostic test (RDT) or microscopy, 65.6% of confirmed malaria cases were prescribed the correct antimalarials and 15.3% of febrile patients who tested negative for malaria infection were incorrectly prescribed an antimalarial. Overall compliance with a strictly defined test and treat protocol was 62.8%. A reluctance to test current/recently febrile patients for malaria infection by RDT or microscopy in the absence of acute malaria symptoms, reserving recommended antimalarials for confirmed malaria cases only and choosing to clinically diagnose a malaria infection, despite a negative RDT result were the most frequently reported barriers to protocol compliance. Attitudinal support for the test and treat protocol, as assessed by a nine-item measure, improved across time. In conclusion, health worker compliance with the full test and treat malaria protocol requires improvement in PNG and additional health worker support will likely be required to achieve this. The broader evidence base would suggest any such support should be delivered over a longer period of time, be multi-dimensional and multi-modal.

Health Worker Compliance with a ‘Test And Treat’ Malaria Case Management Protocol in Papua New Guinea

PubMed Central

Pulford, Justin; Smith, Iso; Mueller, Ivo; Siba, Peter M.; Hetzel, Manuel W.

2016-01-01

The Papua New Guinea (PNG) Department of Health introduced a ‘test and treat’ malaria case management protocol in 2011. This study assesses health worker compliance with the test and treat protocol on a wide range of measures, examines self-reported barriers to health worker compliance as well as health worker attitudes towards the test and treat protocol. Data were collected by cross-sectional survey conducted in randomly selected primary health care facilities in 2012 and repeated in 2014. The combined survey data included passive observation of current or recently febrile patients (N = 771) and interviewer administered questionnaires completed with health workers (N = 265). Across the two surveys, 77.6% of patients were tested for malaria infection by rapid diagnostic test (RDT) or microscopy, 65.6% of confirmed malaria cases were prescribed the correct antimalarials and 15.3% of febrile patients who tested negative for malaria infection were incorrectly prescribed an antimalarial. Overall compliance with a strictly defined test and treat protocol was 62.8%. A reluctance to test current/recently febrile patients for malaria infection by RDT or microscopy in the absence of acute malaria symptoms, reserving recommended antimalarials for confirmed malaria cases only and choosing to clinically diagnose a malaria infection, despite a negative RDT result were the most frequently reported barriers to protocol compliance. Attitudinal support for the test and treat protocol, as assessed by a nine-item measure, improved across time. In conclusion, health worker compliance with the full test and treat malaria protocol requires improvement in PNG and additional health worker support will likely be required to achieve this. The broader evidence base would suggest any such support should be delivered over a longer period of time, be multi-dimensional and multi-modal. PMID:27391594

Cognitive interviews to test and refine questionnaires.

PubMed

García, Alexandra A

2011-01-01

Survey data are compromised when respondents do not interpret questions in the way researchers expect. Cognitive interviews are used to detect problems respondents have in understanding survey instructions and items, and in formulating answers. This paper describes methods for conducting cognitive interviews and describes the processes and lessons learned with an illustrative case study. The case study used cognitive interviews to elicit respondents' understanding and perceptions of the format, instructions, items, and responses that make up the Diabetes Symptom Self-Care Inventory (DSSCI), a questionnaire designed to measure Mexican Americans' symptoms of type 2 diabetes and their symptom management strategies. Responses to cognitive interviews formed the basis for revisions in the format, instructions, items, and translation of the DSSCI. All those who develop and revise surveys are urged to incorporate cognitive interviews into their instrumentation methods so that they may produce more reliable and valid measurements. © 2011 Wiley Periodicals, Inc.

Survey data collection using Audio Computer Assisted Self-Interview.

PubMed

Jones, Rachel

2003-04-01

The Audio Computer Assisted Self-Interview (ACASI) is a computer application that allows a research participant to hear survey interview items over a computer headset and read the corresponding items on a computer monitor. The ACASI automates progression from one item to the next, skipping irrelevant items. The research participant responds by pressing a number keypad, sending the data directly into a database. The ACASI was used to enhance participants' sense of privacy. A convenience sample of 257 young urban women, ages 18 to 29 years, were interviewed in neighborhood settings concerning human immune deficiency virus (HIV) sexual risk behaviors. Notebook computers were used to facilitate mobility. The overwhelming majority rated their experience with ACASI as easy to use. This article will focus on the use of ACASI in HIV behavioral research, its benefits, and approaches to resolve some identified problems with this method of data collection.

Asking the right questions to get the right answers: using cognitive interviews to review the acceptability, comprehension and clinical meaningfulness of patient self-report adverse event items in oncology patients.

PubMed

Holch, Patricia; Warrington, Lorraine; Potrata, Barbara; Ziegler, Lucy; Hector, Ceri; Keding, Ada; Harley, Clare; Absolom, Kate; Morris, Carolyn; Bamforth, Leon; Velikova, Galina

Standardized reporting of treatment-related adverse events (AE) is essential in clinical trials, usually achieved by using the National Cancer Institute (NCI) Common Terminology Criteria for Adverse Events (CTCAE) reported by clinicians. Patient-reported adverse events (PRAE) may add value to clinician assessments, providing patient perspective on subjective toxicity. We developed an online patient symptom report and self-management system for real-time reporting and managing AE during cancer treatment integrated with electronic patient records (eRAPID). As part of this program we developed a patient version of the CTCAE (version 4.0), rephrasing terminology into a self-report format. We explored patient understanding of these items via cognitive interviews. Sixty patients (33 female, 27 male) undergoing treatment were purposively sampled by age, gender and tumor group (median age 61.5, range 35-84, 12 breast, 12 gynecological, 13 colorectal, 12 lung and 11 renal). Twenty-one PRAE items were completed on a touch-screen computer. Subsequent audio-recorded cognitive interviews and thematic analysis explored patients' comprehension of items via verbal probing techniques during three interview rounds (n = 20 patients/round). In total 33 item amendments were made; 29% related to question comprehension, 68% response option and 3% order effects. These amendments to phrasing and language improved patient understanding but maintained CTCAE grading and key medical information. Changes were endorsed by members of a patient advisory group (N = 11). Item adaptations resulted in a bank of consistently interpreted self-report AE items for use in future research program. In-depth analysis of items through cognitive interviews is an important step towards developing an internationally valid system for PRAE, thus improving patient safety and experiences during cancer treatment.

Harmonizing Screening for Gambling Problems in Epidemiological Surveys – Development of the Rapid Screener for Problem Gambling (RSPG)

PubMed Central

Challet-Bouju, Gaëlle; Perrot, Bastien; Romo, Lucia; Valleur, Marc; Magalon, David; Fatséas, Mélina; Chéreau-Boudet, Isabelle; Luquiens, Amandine; Grall-Bronnec, Marie; Hardouin, Jean-Benoit

2016-01-01

Background and aims The aim of this study was to test the screening properties of several combinations of items from gambling scales, in order to harmonize screening of gambling problems in epidemiological surveys. The objective was to propose two brief screening tools (three items or less) for a use in interviews and self-administered questionnaires. Methods We tested the screening properties of combinations of items from several gambling scales, in a sample of 425 gamblers (301 non-problem gamblers and 124 disordered gamblers). Items tested included interview-based items (Pathological Gambling section of the DSM-IV, lifetime history of problem gambling, monthly expenses in gambling, and abstinence of 1 month or more) and self-report items (South Oaks Gambling Screen, Gambling Attitudes, and Beliefs Survey). The gold standard used was the diagnosis of a gambling disorder according to the DSM-5. Results Two versions of the Rapid Screener for Problem Gambling (RSPG) were developed: the RSPG-Interview (RSPG-I), being composed of two interview items (increasing bets and loss of control), and the RSPG-Self-Assessment (RSPG-SA), being composed of three self-report items (chasing, guiltiness, and perceived inability to stop). Discussion and conclusions We recommend using the RSPG-SA/I for screening problem gambling in epidemiological surveys, with the version adapted for each purpose (RSPG-I for interview-based surveys and RSPG-SA for self-administered surveys). This first triage of potential problem gamblers must be supplemented by further assessment, as it may overestimate the proportion of problem gamblers. However, a first triage has the great advantage of saving time and energy in large-scale screening for problem gambling. PMID:27348558

The Structured Interview & Scoring Tool-Massachusetts Alzheimer's Disease Research Center (SIST-M): development, reliability, and cross-sectional validation of a brief structured clinical dementia rating interview.

PubMed

Okereke, Olivia I; Copeland, Maura; Hyman, Bradley T; Wanggaard, Taylor; Albert, Marilyn S; Blacker, Deborah

2011-03-01

The Clinical Dementia Rating (CDR) and CDR Sum-of-Boxes can be used to grade mild but clinically important cognitive symptoms of Alzheimer disease. However, sensitive clinical interview formats are lengthy. To develop a brief instrument for obtaining CDR scores and to assess its reliability and cross-sectional validity. Using legacy data from expanded interviews conducted among 347 community-dwelling older adults in a longitudinal study, we identified 60 questions (from a possible 131) about cognitive functioning in daily life using clinical judgment, inter-item correlations, and principal components analysis. Items were selected in 1 cohort (n=147), and a computer algorithm for generating CDR scores was developed in this same cohort and re-run in a replication cohort (n=200) to evaluate how well the 60 items retained information from the original 131 items. Short interviews based on the 60 items were then administered to 50 consecutively recruited older individuals, with no symptoms or mild cognitive symptoms, at an Alzheimer's Disease Research Center. Clinical Dementia Rating scores based on short interviews were compared with those from independent long interviews. In the replication cohort, agreement between short and long CDR interviews ranged from κ=0.65 to 0.79, with κ=0.76 for Memory, κ=0.77 for global CDR, and intraclass correlation coefficient for CDR Sum-of-Boxes=0.89. In the cross-sectional validation, short interview scores were slightly lower than those from long interviews, but good agreement was observed for global CDR and Memory (κ≥0.70) as well as for CDR Sum-of-Boxes (intraclass correlation coefficient=0.73). The Structured Interview & Scoring Tool-Massachusetts Alzheimer's Disease Research Center is a brief, reliable, and sensitive instrument for obtaining CDR scores in persons with symptoms along the spectrum of mild cognitive change.

Body Mass Index, Sex, Interview Protocol, and Children’s Accuracy for Reporting Kilocalories Observed Eaten at School Meals

PubMed Central

Baxter, Suzanne Domel; Smith, Albert F.; Litaker, Mark S.; Guinn, Caroline H.; Nichols, Michele D.; Miller, Patricia H.; Kipp, Katherine

2008-01-01

This pilot study investigated body mass index (BMI), sex, interview protocol, and children’s accuracy for reporting kilocalories. Forty fourth-grade children (20 low BMI [LBMI; ≥5th and <50th percentiles; 10 boys; 15 black], 20 high BMI [HBMI;≥ 85th percentile; 10 boys; 15 black]) were observed eating school meals (breakfast, lunch) and interviewed either that evening about the prior 24 hours (24E) or the next morning about the previous day (PDM), with 10 LBMI (5 boys) and 10 HBMI (5 boys) per interview protocol. Five kilocalorie variables were analyzed using separate 4-factor (BMI group, sex, race, interview protocol) analyses of variance. No effects were found for reported or matched kilocalories. More kilocalories were observed (p<0.02) and omitted (p<0.05) by HBMI than LBMI children. For intruded kilocalories, means were smaller (better) for HBMI girls than HBMI boys, but larger for LBMI girls than LBMI boys (interaction p<0.04); LBMI girls intruded the most while HBMI girls intruded the least. For interview protocol, omitted and intruded kilocalories were higher (worse), although not significantly so (ps<0.11), for PDM than 24E. These results illuminate relations of BMI, sex, interview protocol, and children’s reporting accuracy, and are consistent with results concerning BMI and sex from studies with adults. PMID:17000199

Sources of Interactional Problems in a Survey of Racial/Ethnic Discrimination

PubMed Central

Johnson, Timothy P.; Shariff-Marco, Salma; Willis, Gordon; Cho, Young Ik; Breen, Nancy; Gee, Gilbert C.; Krieger, Nancy; Grant, David; Alegria, Margarita; Mays, Vickie M.; Williams, David R.; Landrine, Hope; Liu, Benmei; Reeve, Bryce B.; Takeuchi, David; Ponce, Ninez A.

2014-01-01

Cross-cultural variability in respondent processing of survey questions may bias results from multiethnic samples. We analyzed behavior codes, which identify difficulties in the interactions of respondents and interviewers, from a discrimination module contained within a field test of the 2007 California Health Interview Survey. In all, 553 (English) telephone interviews yielded 13,999 interactions involving 22 items. Multilevel logistic regression modeling revealed that respondent age and several item characteristics (response format, customized questions, length, and first item with new response format), but not race/ethnicity, were associated with interactional problems. These findings suggest that item function within a multi-cultural, albeit English language, survey may be largely influenced by question features, as opposed to respondent characteristics such as race/ethnicity. PMID:26166949

Children’s Dietary Recalls from Three Validation Studies: Types of Intrusion Vary with Retention Interval

PubMed Central

Baxter, Suzanne Domel; Hardin, James W.; Smith, Albert F.; Royer, Julie A.; Guinn, Caroline H.

2008-01-01

SUMMARY Using previously collected data of fourth-grade children observed eating school meals and then interviewed, we categorized intrusions (food items reported but not observed eaten) as stretches (on the child’s tray) or confabulations (not on the child’s tray). We investigated intrusions, confabulations, and stretches, and the role of liking, at different retention intervals (morning interviews about the previous day’s intake; evening interviews about that day’s intake) and under different reporting-order prompts (forward; reverse). As retention interval between consumption and report increased, the likelihood 1) increased that reported items were intrusions, that reported items were confabulations, and that intrusions were confabulations; and 2) was constant that reported items were stretches. Results concerning reporting-order prompts were inconclusive. Liking ratings were higher for matches (reports of items observed eaten) than stretches, for confabulations than stretches, and for matches than omissions (unreported items observed eaten), but did not vary by retention interval or reporting-order prompts. PMID:19023454

Development of a measure of asthma-specific quality of life among adults.

PubMed

Eberhart, Nicole K; Sherbourne, Cathy D; Edelen, Maria Orlando; Stucky, Brian D; Sin, Nancy L; Lara, Marielena

2014-04-01

A key goal in asthma treatment is improvement in quality of life (QoL), but existing measures often confound QoL with symptoms and functional impairment. The current study addresses these limitations and the need for valid patient-reported outcome measures by using state-of-the-art methods to develop an item bank assessing QoL in adults with asthma. This article describes the process for developing an initial item pool for field testing. Five focus group interviews were conducted with a total of 50 asthmatic adults. We used "pile sorting/binning" and "winnowing" methods to identify key QoL dimensions and develop a pool of items based on statements made in the focus group interviews. We then conducted a literature review and consulted with an expert panel to ensure that no key concepts were omitted. Finally, we conducted individual cognitive interviews to ensure that items were well understood and inform final item refinement. Six hundred and sixty-one QoL statements were identified from focus group interview transcripts and subsequently used to generate a pool of 112 items in 16 different content areas. Items covering a broad range of content were developed that can serve as a valid gauge of individuals' perceptions of the effects of asthma and its treatment on their lives. These items do not directly measure symptoms or functional impairment, yet they include a broader range of content than most existent measures of asthma-specific QoL.

Development of a Measure of Asthma-Specific Quality of Life among Adults

PubMed Central

Eberhart, Nicole K.; Sherbourne, Cathy D.; Edelen, Maria Orlando; Stucky, Brian D.; Sin, Nancy L.; Lara, Marielena

2014-01-01

Purpose A key goal in asthma treatment is improvement in quality of life (QoL), but existing measures often confound QoL with symptoms and functional impairment. The current study addresses these limitations and the need for valid patient-reported outcome measures by using state-of-the-art methods to develop an item bank assessing QoL in adults with asthma. This article describes the process for developing an initial item pool for field testing. Methods Five focus group interviews were conducted with a total of 50 asthmatic adults. We used “pile sorting/binning” and “winnowing” methods to identify key QoL dimensions and develop a pool of items based on statements made in the focus group interviews. We then conducted a literature review and consulted with an expert panel to ensure that no key concepts were omitted. Finally, we conducted individual cognitive interviews to ensure that items were well understood and inform final item refinement. Results 661 QoL statements were identified from focus group interview transcripts and subsequently used to generate a pool of 112 items in 16 different content areas. Conclusions Items covering a broad range of content were developed that can serve as a valid gauge of individuals’ perceptions of the effects of asthma and its treatment on their lives. These items do not directly measure symptoms or functional impairment, yet they include a broader range of content than most existent measures of asthma-specific QoL. PMID:24062237

Qualitative Evaluation of Pediatric Pain Behavior, Quality, and Intensity Item Candidates and the PROMIS Pain Domain Framework in Children With Chronic Pain.

PubMed

Jacobson, C Jeffrey; Kashikar-Zuck, Susmita; Farrell, Jennifer; Barnett, Kimberly; Goldschneider, Ken; Dampier, Carlton; Cunningham, Natoshia; Crosby, Lori; DeWitt, Esi Morgan

2015-12-01

As initial steps in a broader effort to develop and test pediatric pain behavior and pain quality item banks for the Patient-Reported Outcomes Measurement Information System (PROMIS), we used qualitative interview and item review methods to 1) evaluate the overall conceptual scope and content validity of the PROMIS pain domain framework among children with chronic/recurrent pain conditions, and 2) develop item candidates for further psychometric testing. To elicit the experiential and conceptual scope of pain outcomes across a variety of pediatric recurrent/chronic pain conditions, we conducted 32 semi-structured individual and 2 focus-group interviews with children and adolescents (8-17 years), and 32 individual and 2 focus-group interviews with parents of children with pain. Interviews with pain experts (10) explored the operational limits of pain measurement in children. For item bank development, we identified existing items from measures in the literature, grouped them by concept, removed redundancies, and modified the remaining items to match PROMIS formatting. New items were written as needed and cognitive debriefing was completed with the children and their parents, resulting in 98 pain behavior (47 self, 51 proxy), 54 quality, and 4 intensity items for further testing. Qualitative content analyses suggest that reportable pain outcomes that matter to children with pain are captured within and consistent with the pain domain framework in PROMIS. PROMIS pediatric pain behavior, quality, and intensity items were developed based on a theoretical framework of pain that was evaluated by multiple stakeholders in the measurement of pediatric pain, including researchers, clinicians, and children with pain and their parents, and the appropriateness of the framework was verified. Copyright © 2015 American Pain Society. Published by Elsevier Inc. All rights reserved.

Qualitative modification and development of patient- and caregiver-reported outcome measures for iron chelation therapy.

PubMed

Horodniceanu, Erica G; Bal, Vasudha; Dhatt, Harman; Carter, John A; Huang, Vicky; Lasch, Kathryn

2017-06-23

Compliance, palatability, gastrointestinal (GI) symptom, and treatment satisfaction patient- and observer-reported outcome (PRO, ObsRO) measures were developed/modified for patients with transfusion-dependent anemias or myelodysplastic syndrome (MDS) requiring iron chelation therapy (ICT). This qualitative cross-sectional observational study used grounded theory data collection and analysis methods and followed PRO/ObsRO development industry guidance. Patients and caregivers of patients with transfusion-dependent anemias or MDS were individually interviewed face-to-face to cognitively debrief the Compliance, Palatability, GI Symptom Diary, and Modified Satisfaction with Iron Chelation Therapy (SICT) instruments presented electronically. Interviews were conducted in sets. Interviews began open-endedly to spontaneously elicit ICT experiences. Item modifications were debriefed during the later interviews. Interviews were audio recorded, transcribed, and coded. Data was analyzed using ATLAS.ti qualitative research software. Twenty-one interviews were completed (Set 1: 5 patients, 6 caregivers; Set 2: 6 patients, 4 caregivers) in 6 US cities. Mean age was 43 years for patients and 9 years for children of caregivers. Conditions requiring ICT use across groups included transfusion-dependent anemias (85.7%) and MDS (14.3%). Concepts spontaneously reported were consistent with instruments debriefed. Interview analysis resulted in PRO and ObsRO versions of each instrument: Compliance (2 items), Palatability (4 items), GI Symptom Diary (6 items), and Modified SICT (PRO = 13, ObsRO = 17 items). Qualitative research data from cognitive interviews supports the content validity and relevance of the instruments developed/modified. Quantitative validation of these PRO and ObsRO measures is needed testing for validity, reliability, and responsiveness for future research use with new formulations of oral ICT.

The Oxford Participation and Activities Questionnaire: study protocol.

PubMed

Morley, David; Dummett, Sarah; Kelly, Laura; Dawson, Jill; Fitzpatrick, Ray; Jenkinson, Crispin

2013-01-01

With an ageing population and increasing demands on health and social care services, there is growing importance attached to the management of long-term conditions, including maximizing the cost-effectiveness of treatments. In line with this, there is increasing emphasis on the need to keep people both active and participating in daily life. Consequently, it is essential that well developed and validated instruments that can meaningfully assess levels of participation and activity are widely available. Current measures, however, are largely focused on disability and rehabilitation, and there is no measure of activity or participation for generic use that fully meets the standards set by regulatory bodies such as the US Food and Drug Administration. Here we detail a protocol for the development and validation of a new patient-reported outcome measure (PROM) for assessment of participation and activity in people experiencing a variety of health conditions, ie, the Oxford Participation and Activities Questionnaire (Ox-PAQ). The stages incorporated in its development are entirely in line with current regulations and represent best practice in the development of PROMs. Development of the Ox-PAQ is theoretically grounded in the World Health Organization International Classification of Functioning, Disability, and Health. The project incorporates a new strategy of engaging with stakeholders from the outset in an attempt to identify those characteristics of PROMs considered most important to a range of potential users. Items will be generated through interviews with patients from a range of conditions. Pretesting of the instrument will be via cognitive interviews and focus groups. A postal survey will be conducted, with data subject to factor and Rasch analysis in order to identify appropriate dimensions and redundant items. Reliability will be assessed by Cronbach's alpha and item-total correlations. A second, large-scale postal survey will follow, with the Ox-PAQ being administered in conjunction with generic measures of health status to further test the validity of the measure. The Ox-PAQ will again be administered at 2 weeks to assess test-retest reliability and at 3 months to assess responsiveness. The development of the Ox-PAQ is a timely one. With increasing emphasis being placed on the importance of keeping people active and participating in daily life, the instrument has the potential for significant uptake. Its primary use is intended to be in clinical trials and for evaluation of interventions targeted at maintaining activity and participation.

Development and validation of a novel patient-reported treatment satisfaction measure for hyperfunctional facial lines: facial line satisfaction questionnaire.

PubMed

Pompilus, Farrah; Burgess, Somali; Hudgens, Stacie; Banderas, Benjamin; Daniels, Selena

2015-12-01

Facial lines or wrinkles are among the most visible signs of aging, and minimally invasive cosmetic procedures are becoming increasingly popular. The aim of this study was to develop and validate the Facial Line Satisfaction Questionnaire (FLSQ) for use in adults with upper facial lines (UFL). A literature review, concept elicitation interviews (n = 33), and cognitive debriefing interviews (n = 23) of adults with UFL were conducted to develop the FLSQ. The FLSQ comprises Baseline and Follow-up versions and was field-tested with 150 subjects in a US observational study designed to assess its psychometric performance. Analyses included acceptability (item and scale distribution [i.e. missingness, floor, and ceiling effects]), reliability, and validity (including concurrent validity). In total, 69 concepts were elicited during patient interviews. Following cognitive debriefing interviews, the FLSQ-Baseline version included 11 items and the Follow-up version included 13 items. Response rates for the FLSQ were 100% and 73% at baseline and follow-up, respectively; no items had excessive missing data. Questionnaire scale scores were normally distributed. Most domain scores demonstrated good internal consistency reliability (Cronbach's α ≥ 0.70). Most items within their respective domains exhibited good convergent (item-scale correlations > 0.40) and discriminant (items had higher correlation with their hypothesized scales than other scales) validity. Concurrent validity correlation coefficients of the FLSQ domain scores with the associated concurrent measures were acceptable (range: r = 0.40-0.70). Six FLSQ items demonstrated reliability and validity as stand-alone items outside their domains. The FLSQ is a valid questionnaire for assessing treatment expectations, satisfaction, impact, and preference in adults with UFL. © 2015 The Authors. Journal of Cosmetic Dermatology Published by Wiley Periodicals, Inc.

Comparing the Personality Disorder Interview for DSM-IV (PDI-IV) and SCID-II borderline personality disorder scales: an item-response theory analysis.

PubMed

Huprich, Steven K; Paggeot, Amy V; Samuel, Douglas B

2015-01-01

One-hundred sixty-nine psychiatric outpatients and 171 undergraduate students were assessed with the Personality Disorder Interview-IV (PDI-IV; Widiger, Mangine, Corbitt, Ellis, & Thomas, 1995) and the Structured Clinical Interview for DSM-IV Axis II disorders (SCID-II; First, Gibbon, Spitzer, Williams, & Benjamin, 1997) for borderline personality disorder (BPD). Eighty individuals met PDI-IV BPD criteria, whereas 34 met SCID-II BPD criteria. Dimensional ratings of both measures were highly intercorrelated (rs = .78, .75), and item-level interrater reliability fell in the good to excellent range. An item-response theory analysis was performed to investigate whether properties of the items from each interview could help understand these differences. The limited agreement seemed to be explained by differences in the response options across the two interviews. We found that suicidal behavior was among the most discriminating criteria on both instruments, whereas dissociation and difficulty controlling anger had the 2 lowest alpha parameter values. Finally, those meeting BPD criteria on both interviews had higher levels of anxiety, depression, and more impairments in object relations than those meeting criteria on just the PDI-IV. These findings suggest that the choice of measure has a notable effect on the obtained diagnostic prevalence and the level of BPD severity that is detected.

The effect of sociodemographic (mis)match between interviewers and respondents on unit and item nonresponse in Belgium.

PubMed

Vercruyssen, Anina; Wuyts, Celine; Loosveldt, Geert

2017-09-01

Interviewer characteristics affect nonresponse and measurement errors in face-to-face surveys. Some studies have shown that mismatched sociodemographic characteristics - for example gender - affect people's behavior when interacting with an interviewer at the door and during the survey interview, resulting in more nonresponse. We investigate the effect of sociodemographic (mis)matching on nonresponse in two successive rounds of the European Social Survey in Belgium. As such, we replicate the analyses of the effect of (mis)matching gender and age on unit nonresponse on the one hand, and of gender, age and education level (mis)matching on item nonresponse on the other hand. Recurring effects of sociodemographic (mis)match are found for both unit and item nonresponse. Copyright © 2017 Elsevier Inc. All rights reserved.

Validity testing of the quality of life scale, Swedish version: focus group interviews of women with fibromyalgia.

PubMed

Liedberg, Gunilla M; Eddy, Linda L; Burckhardt, Carol S

2012-12-01

Focus group interviews were used to examine validity of the Quality of Life Scale, Swedish version (QOLS-S) for use with women with fibromyalgia. Five interviews with 18 women with fibromyalgia were completed. The opening question was "What does quality of life mean to you?" Later, participants were asked to respond to questions about the specific domains and items in the QOLS-S. The transcribed interviews were analysed, and categories were identified. Opinions concerning domains and items in the QOLS-S were linked to domains of the QOLS-S. Four categories emerged from the opening question: finances, to be an active person and participate in society, relations with others, and health. Overall, the women's perceptions of quality of life were congruent with the domains of QOLS-S. However, further attention should be given to the translation of certain items and apparent overlaps in some items indicate that they can be combined. Also, the instrument needs to be scrutinized from a cultural perspective because some items in the "social, community and civic activities" domain were not endorsed by the participants. Copyright © 2012 John Wiley & Sons, Ltd.

Applying mixed methods to pretest the Pressure Ulcer Quality of Life (PU-QOL) instrument.

PubMed

Gorecki, C; Lamping, D L; Nixon, J; Brown, J M; Cano, S

2012-04-01

Pretesting is key in the development of patient-reported outcome (PRO) instruments. We describe a mixed-methods approach based on interviews and Rasch measurement methods in the pretesting of the Pressure Ulcer Quality of Life (PU-QOL) instrument. We used cognitive interviews to pretest the PU-QOL in 35 patients with pressure ulcers with the view to identifying problematic items, followed by Rasch analysis to examine response options, appropriateness of the item series and biases due to question ordering (item fit). We then compared findings in an interactive and iterative process to identify potential strengths and weaknesses of PU-QOL items, and guide decision-making about further revisions to items and design/layout. Although cognitive interviews largely supported items, they highlighted problems with layout, response options and comprehension. Findings from the Rasch analysis identified problems with response options through reversed thresholds. The use of a mixed-methods approach in pretesting the PU-QOL instrument proved beneficial for identifying problems with scale layout, response options and framing/wording of items. Rasch measurement methods are a useful addition to standard qualitative pretesting for evaluating strengths and weaknesses of early stage PRO instruments.

Revealing barriers and facilitators to use a new genetic test: comparison of three user involvement methods.

PubMed

Rhebergen, Martijn D F; Visser, Maaike J; Verberk, Maarten M; Lenderink, Annet F; van Dijk, Frank J H; Kezic, Sanja; Hulshof, Carel T J

2012-10-01

We compared three common user involvement methods in revealing barriers and facilitators from intended users that might influence their use of a new genetic test. The study was part of the development of a new genetic test on the susceptibility to hand eczema for nurses. Eighty student nurses participated in five focus groups (n = 33), 15 interviews (n = 15) or questionnaires (n = 32). For each method, data were collected until saturation. We compared the mean number of items and relevant remarks that could influence the use of the genetic test obtained per method, divided by the number of participants in that method. Thematic content analysis was performed using MAXQDA software. The focus groups revealed 30 unique items compared to 29 in the interviews and 21 in the questionnaires. The interviews produced more items and relevant remarks per participant (1.9 and 8.4 pp) than focus groups (0.9 and 4.8 pp) or questionnaires (0.7 and 2.3 pp). All three involvement methods revealed relevant barriers and facilitators to use a new genetic test. Focus groups and interviews revealed substantially more items than questionnaires. Furthermore, this study suggests a preference for the use of interviews because the number of items per participant was higher than for focus groups and questionnaires. This conclusion may be valid for other genetic tests as well.

A Structured Forensic Interview Protocol Improves the Quality and Informativeness of Investigative Interviews with Children: A Review of Research Using the NICHD Investigative Interview Protocol

ERIC Educational Resources Information Center

Lamb, Michael; Orbach, Yael; Hershkowitz, Irit; Esplin, Phillip W.; Horowitz, Dvora

2007-01-01

Objective: To show how the results of research on children's memory, communicative skills, social knowledge, and social tendencies can be translated into guidelines that improve the quality of forensic interviews of children. Method: We review studies designed to evaluate children's capacities as witnesses, explain the development of the…

Initial development of a patient-reported outcome measure of experience with cognitive impairment associated with schizophrenia.

PubMed

Welch, Lisa C; Trudeau, Jeremiah J; Silverstein, Steven M; Sand, Michael; Henderson, David C; Rosen, Raymond C

2017-01-01

Cognitive impairment is a serious, often distressing aspect of schizophrenia that affects patients' day-to-day lives. Although several interview-based instruments exist to assess cognitive functioning, a reliable measure developed based on the experiences of patients facing cognitive difficulties is needed to complement the objective performance-based assessments. The present article describes the initial development of a patient-reported outcome (PRO) measure to assess the subjective experience of cognitive impairment among patients with schizophrenia, the Patient-Reported Experience of Cognitive Impairment in Schizophrenia (PRECIS). The phases of development included the construction of a conceptual model based on the existing knowledge and two sets of qualitative interviews with patients: 1) concept elicitation interviews to ensure face and content validity from the perspective of people with schizophrenia and 2) cognitive debriefing of the initial item pool. Input from experts was elicited throughout the process. The initial conceptual model included seven domains. The results from concept elicitation interviews (n=80) supported these domains but yielded substantive changes to concepts within domains and to terminology. Based on these results, an initial pool of 53 items was developed to reflect the most common descriptions and languages used by the study participants. Cognitive debriefing interviews (n=22) resulted in the removal of 18 items and modification of 22 other items. The remaining 35 items represented 23 concepts within six domains plus two items assessing bother. The draft PRO measure is currently undergoing psychometric testing as a precursor to broad-based clinical and research use.

Development of Self-Report Measures of Social Attitudes that Act as Environmental Barriers and Facilitators for People with Disabilities

PubMed Central

Garcia, Sofia F.; Hahn, Elizabeth A.; Magasi, Susan; Lai, Jin-Shei; Semik, Patrick; Hammel, Joy; Heinemann, Allen W.

2014-01-01

Objective To describe the development of new self-report measures of social attitudes that act as environmental facilitators or barriers to the participation of people with disabilities in society. Design A mixed methods approach included a literature review; item classification, selection and writing; cognitive interviews and field testing with participants with spinal cord injury (SCI), traumatic brain injury (TBI) or stroke; and rating scale analysis to evaluate initial psychometric properties. Setting General community. Participants Nine individuals with SCI, TBI or stroke participated in cognitive interviews; 305 community residents with those same conditions participated in field testing. Interventions None. Main Outcome Measure(s) Self-report item pool of social attitudes that act as facilitators or barriers to people with disabilities participating in society. Results An interdisciplinary team of experts classified 710 existing social environment items into content areas and wrote 32 new items. Additional qualitative item review included item refinement and winnowing of the pool prior to cognitive interviews and field testing 82 items. Field test data indicated that the pool satisfies a one-parameter item response theory measurement model and would be appropriate for development into a calibrated item bank. Conclusions Our qualitative item review process supported a social environment conceptual framework that includes both social support and social attitudes. We developed a new social attitudes self-report item pool. Calibration testing of that pool is underway with a larger sample in order to develop a social attitudes item bank for persons with disabilities. PMID:25045803

Development of self-report measures of social attitudes that act as environmental barriers and facilitators for people with disabilities.

PubMed

Garcia, Sofia F; Hahn, Elizabeth A; Magasi, Susan; Lai, Jin-Shei; Semik, Patrick; Hammel, Joy; Heinemann, Allen W

2015-04-01

To describe the development of new self-report measures of social attitudes that act as environmental facilitators or barriers to the participation of people with disabilities in society. A mixed-methods approach included a literature review; item classification, selection, and writing; cognitive interviews and field testing of participants with spinal cord injury (SCI), traumatic brain injury (TBI), or stroke; and rating scale analysis to evaluate initial psychometric properties. General community. Individuals with SCI, TBI, or stroke participated in cognitive interviews (n=9); community residents with those same conditions participated in field testing (n=305). None. Self-report item pool of social attitudes that act as facilitators or barriers to people with disabilities participating in society. An interdisciplinary team of experts classified 710 existing social environment items into content areas and wrote 32 new items. Additional qualitative item review included item refinement and winnowing of the pool prior to cognitive interviews and field testing of 82 items. Field test data indicated that the pool satisfies a 1-parameter item response theory measurement model and would be appropriate for development into a calibrated item bank. Our qualitative item review process supported a social environment conceptual framework that includes both social support and social attitudes. We developed a new social attitudes self-report item pool. Calibration testing of that pool is underway with a larger sample to develop a social attitudes item bank for persons with disabilities. Copyright © 2015 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.

Qualitative Evaluation of Pediatric Pain-Behavior, -Quality and -Intensity Item Candidates and the PROMIS Pain Domain Framework in Children with Chronic Pain

PubMed Central

Jacobson, C. Jeffrey; Kashikar-Zuck, Susmita; Farrell, Jennifer; Barnett, Kimberly; Goldschneider, Ken; Dampier, Carlton; Cunningham, Natoshia; Crosby, Lori; DeWitt, Esi Morgan

2015-01-01

As initial steps in a broader effort to develop and test pediatric Pain Behavior and Pain Quality item banks for the Patient Reported Outcomes Measurement Information System (PROMIS®), we employed qualitative interview and item review methods to 1) evaluate the overall conceptual scope and content validity of the PROMIS pain domain framework among children with chronic /recurrent pain conditions, and 2) develop item candidates for further psychometric testing. To elicit the experiential and conceptual scope of pain outcomes across a variety of pediatric recurrent/chronic pain conditions, we conducted semi-structured individual (32) and focus-group interviews (2) with children and adolescents (8–17 years), and parents of children with pain (individual (32) and focus group (2)). Interviews with pain experts (10) explored the operational limits of pain measurement in children. For item bank development, we identified existing items from measures in the literature, grouped them by concept, removed redundancies, and modified remaining items to match PROMIS formatting. New items were written as needed and cognitive debriefing was completed with children and their parents, resulting in 98 Pain Behavior (47 self, 51 proxy), 54 Quality and 4 Intensity items for further testing. Qualitative content analyses suggest that reportable pain outcomes that matter to children with pain are captured within and consistent with the pain domain framework in PROMIS. PMID:26335990

Hidden Item Variance in Multiple Mini-Interview Scores

ERIC Educational Resources Information Center

Zaidi, Nikki L.; Swoboda, Christopher M.; Kelcey, Benjamin M.; Manuel, R. Stephen

2017-01-01

The extant literature has largely ignored a potentially significant source of variance in multiple mini-interview (MMI) scores by "hiding" the variance attributable to the sample of attributes used on an evaluation form. This potential source of hidden variance can be defined as rating items, which typically comprise an MMI evaluation…

Semi-Structured Interview Protocol for Constructing Logic Models

ERIC Educational Resources Information Center

Gugiu, P. Cristian; Rodriguez-Campos, Liliana

2007-01-01

This paper details a semi-structured interview protocol that evaluators can use to develop a logic model of a program's services and outcomes. The protocol presents a series of questions, which evaluators can ask of specific program informants, that are designed to: (1) identify key informants basic background and contextual information, (2)…

Bifactor and Item Response Theory Analyses of Interviewer Report Scales of Cognitive Impairment in Schizophrenia

PubMed Central

Reise, Steven P.; Ventura, Joseph; Keefe, Richard S. E.; Baade, Lyle E.; Gold, James M.; Green, Michael F.; Kern, Robert S.; Mesholam-Gately, Raquelle; Nuechterlein, Keith H.; Seidman, Larry J.; Bilder, Robert

2011-01-01

We conducted psychometric analyses of two interview-based measures of cognitive deficits: the 21-item Clinical Global Impression of Cognition in Schizophrenia (CGI-CogS; Ventura et al., 2008), and the 20-item Schizophrenia Cognition Rating Scale (SCoRS; Keefe et al., 2006), which were administered on two occasions to a sample of people with schizophrenia. Traditional psychometrics, bifactor analysis, and item response theory (IRT) methods were used to explore item functioning, dimensionality, and to compare instruments. Despite containing similar item content, responses to the CGI-CogS demonstrated superior psychometric properties (e.g., higher item-intercorrelations, better spread of ratings across response categories), relative to the SCoRS. We argue that these differences arise mainly from the differential use of prompts and how the items are phrased and scored. Bifactor analysis demonstrated that although both measures capture a broad range of cognitive functioning (e.g., working memory, social cognition), the common variance on each is overwhelmingly explained by a single general factor. IRT analyses of the combined pool of 41 items showed that measurement precision is peaked in the mild to moderate range of cognitive impairment. Finally, simulated adaptive testing revealed that only about 10 to 12 items are necessary to achieve latent trait level estimates with reasonably small standard errors for most individuals. This suggests that these interview-based measures of cognitive deficits could be shortened without loss of measurement precision. PMID:21381848

Developing a guideline for clinical trial protocol content: Delphi consensus survey

PubMed Central

2012-01-01

Background Recent evidence has highlighted deficiencies in clinical trial protocols, having implications for many groups. Existing guidelines for randomized clinical trial (RCT) protocol content vary substantially and most do not describe systematic methodology for their development. As one of three prespecified steps for the systematic development of a guideline for trial protocol content, the objective of this study was to conduct a three-round Delphi consensus survey to develop and refine minimum content for RCT protocols. Methods Panellists were identified using a multistep iterative approach, met prespecified minimum criteria and represented key stakeholders who develop or use clinical trial protocols. They were asked to rate concepts for importance in a minimum set of items for RCT protocols. The main outcome measures were degree of importance (scale of 1 to 10; higher scores indicating higher importance) and level of consensus for items. Results were presented as medians, interquartile ranges, counts and percentages. Results Ninety-six expert panellists participated in the Delphi consensus survey including trial investigators, methodologists, research ethics board members, funders, industry, regulators and journal editors. Response rates were between 88 and 93% per round. Overall, panellists rated 63 of 88 concepts of high importance (of which 50 had a 25th percentile rating of 8 or greater), 13 of moderate importance (median 6 or 7) and 12 of low importance (median less than or equal to 5) for minimum trial protocol content. General and item-specific comments and subgroup results provided valuable insight for further discussions. Conclusions This Delphi process achieved consensus from a large panel of experts from diverse stakeholder groups on essential content for RCT protocols. It also highlights areas of divergence. These results, complemented by other empirical research and consensus meetings, are helping guide the development of a guideline for protocol content. PMID:23006145

Development of a tool to assess adherence to a model of the division of responsibility in feeding young children: using response mapping to capacitate validation measures.

PubMed

Lohse, Barbara; Satter, Ellyn; Arnold, Kristen

2014-04-01

Accurate early assessment and targeted intervention with problematic parent/child feeding dynamics is critical for the prevention and treatment of child obesity. The division of responsibility in feeding (sDOR), articulated by the Satter Feeding Dynamics Model (fdSatter), has been demonstrated clinically as an effective approach to reduce child feeding problems, including those leading to obesity. Lack of a tested instrument to examine adherence to fdSatter stimulated initial construction of the Satter Feeding Dynamics Inventory (fdSI). The aim of this project was to refine the item pool to establish translational validity, making the fdSI suitable for advanced psychometric analysis. Cognitive interviews (n = 80) with caregivers of varied socioeconomic strata informed revisions that demonstrated face and content validity. fdSI responses were mapped to interviews using an iterative, multi-phase thematic approach to provide an instrument ready for construct validation. fdSI development required five interview phases over 32 months: Foundational; Refinement; Transitional; Assurance; and Launching. Each phase was associated with item reduction and revision. Thirteen items were removed from the 38-item Foundational phase and seven were revised in the Refinement phase. Revisions, deletions, and additions prompted by Transitional and Assurance phase interviews resulted in the 15-item Launching phase fdSI. Only one Foundational phase item was carried through all development phases, emphasizing the need to test for item comprehension and interpretation before psychometric analyses. Psychometric studies of item pools without encrypted meanings will facilitate progress toward a tool that accurately detects adherence to sDOR. Ability to measure sDOR will facilitate focus on feeding behaviors associated with reduced risk of childhood obesity.

Evaluation of Item Candidates: The PROMIS Qualitative Item Review

PubMed Central

DeWalt, Darren A.; Rothrock, Nan; Yount, Susan; Stone, Arthur A.

2009-01-01

One of the PROMIS (Patient-Reported Outcome Measurement Information System) network's primary goals is the development of a comprehensive item bank for patient-reported outcomes of chronic diseases. For its first set of item banks, PROMIS chose to focus on pain, fatigue, emotional distress, physical function, and social function. An essential step for the development of an item pool is the identification, evaluation, and revision of extant questionnaire items for the core item pool. In this work, we also describe the systematic process wherein items are classified for subsequent statistical processing by the PROMIS investigators. Six phases of item development are documented: identification of extant items, item classification and selection, item review and revision, focus group input on domain coverage, cognitive interviews with individual items, and final revision before field testing. Identification of items refers to the systematic search for existing items in currently available scales. Expert item review and revision was conducted by trained professionals who reviewed the wording of each item and revised as appropriate for conventions adopted by the PROMIS network. Focus groups were used to confirm domain definitions and to identify new areas of item development for future PROMIS item banks. Cognitive interviews were used to examine individual items. Items successfully screened through this process were sent to field testing and will be subjected to innovative scale construction procedures. PMID:17443114

Evaluating the Process of Generating a Clinical Trial Protocol

PubMed Central

Franciosi, Lui G.; Butterfield, Noam N.; MacLeod, Bernard A.

2002-01-01

The research protocol is the principal document in the conduct of a clinical trial. Its generation requires knowledge about the research problem, the potential experimental confounders, and the relevant Good Clinical Practices for conducting the trial. However, such information is not always available to authors during the writing process. A checklist of over 80 items has been developed to better understand the considerations made by authors in generating a protocol. It is based on the most cited requirements for designing and implementing the randomised controlled trial. Items are categorised according to the trial's research question, experimental design, statistics, ethics, and standard operating procedures. This quality assessment tool evaluates the extent that a generated protocol deviates from the best-planned clinical trial.

The Development of the DSM-5 Cultural Formulation Interview-Fidelity Instrument (CFI-FI): A Pilot Study

PubMed Central

Aggarwal, Neil Krishan; Glass, Andrew; Tirado, Amilcar; Boiler, Marit; Nicasio, Andel; Alegría, Margarita; Wall, Melanie; Lewis-Fernández, Roberto

2015-01-01

This paper reports on the development of the Cultural Formulation Interview-Fidelity Instrument (CFI-FI) which assesses clinician fidelity to the DSM-5 Cultural Formulation Interview (CFI). The CFI consists of a manualized set of standard questions that can precede every psychiatric evaluation. It is based on the DSM-IV Outline for Cultural Formulation, the cross-cultural assessment with the most evidence in psychiatric training. Using the New York sample of the DSM-5 CFI field trial, two independent raters created and finalized items for the CFI-FI based on six audio-taped and transcribed interviews. The raters then used the final CFI-FI to rate the remaining 23 interviews. Inter-rater reliability ranged from .73 to 1 for adherence items and .52 to 1 for competence items. The development of the CFI-FI can help researchers and administrators determine whether the CFI has been implemented with fidelity, permitting future intervention research. PMID:25130248

An evaluation of the linguistic and cultural validity of the Spanish language version of the children with special health care needs screener.

PubMed

Read, Debra; Bethell, Christina; Blumberg, Stephen J; Abreu, Milagros; Molina, Clara

2007-11-01

The 2001 National Survey of Children with Special Health Care Needs (CSHCN) used the CSHCN Screener, a 5-item survey based tool, to identify children with special health care needs. The prevalence of special health care needs for Hispanic children was lower than that reported for all other ethnic and racial groups, with the exception of Asian children. To better understand the reasons for the lower prevalence rate, this study examined variations in CSHCN prevalence for Hispanic children according to whether parents responded to the National Survey of CSHCN screening interview in Spanish or English. The Spanish translation of the CSHCN Screener was further evaluated through a series of face-to-face interviews with parents with limited English proficiency (LEP). The 2001 National Survey of CSHCN screened 372,174 children ages 0-17 years for special health care needs. Bivariate and multivariate analyses were conducted to examine the effects of interview language on the CSHCN prevalence rates for Hispanic children (n = 47,371). Using a standardized protocol, cognitive interviews were conducted in Spanish with 19 LEP parents to elicit their comprehension of and reactions to the screening questions. When parents were interviewed in English, 11.7% of Hispanic children were identified as CSHCN. When parents were interviewed in Spanish, 5.1% of Hispanic children were identified as CSHCN. Lower prevalence of the need for or use of prescription medications for chronic conditions made the largest contribution to the observed difference in CSHCN prevalence. Cognitive interviews with parents did not identify any linguistic or cultural deficiencies in the Spanish translation of the CSHCN Screener. Parents did express disinclination toward sharing details of their children's health in the context of a typical telephone survey.

Questionnaire Adapting: Little Changes Mean a Lot.

PubMed

Sousa, Vanessa E C; Matson, Jeffrey; Dunn Lopez, Karen

2017-09-01

Questionnaire development involves rigorous testing to ensure reliability and validity. Due to time and cost constraints of developing new questionnaires, researchers often adapt existing questionnaires to better fit the purpose of their study. However, the effect of such adaptations is unclear. We conducted cognitive interviews as a method to evaluate the understanding of original and adapted questionnaire items to be applied in a future study. The findings revealed that all subjects (a) comprehended the original and adapted items differently, (b) changed their scores after comparing the original to the adapted items, and (c) were unanimous in stating that the adapted items were easier to understand. Cognitive interviewing allowed us to assess the interpretation of adapted items in a useful and efficient manner before use in data collection.

A research coding method for the basic patient-centered interview.

PubMed

Grayson-Sneed, Katelyn A; Smith, Sandi W; Smith, Robert C

2017-03-01

To develop a more reliable coding method of medical interviewing focused on data-gathering and emotion-handling. Two trained (30h) undergraduates rated videotaped interviews from 127 resident-simulated patient (SP) interactions. Trained on 45 videotapes, raters coded 25 of 127 study set tapes for patient-centeredness. Guetzkow's U, Cohen's Kappa, and percent of agreement were used to measure raters' reliability in unitizing and coding residents' skills for eliciting: agenda (3 yes/no items), physical story (2), personal story (6), emotional story (15), using indirect skills (4), and general patient-centeredness (3). 45 items were dichotomized from the earlier, Likert scale-based method and were reduced to 33 during training. Guetzkow's U ranged from 0.00 to 0.087. Kappa ranged from 0.86 to 1.00 for the 6 variables and 33 individual items. The overall kappa was 0.90, and percent of agreement was 97.5%. Percent of agreement by item ranged from 84 to 100%. A simple, highly reliable coding method, weighted (by no. of items) to highlight personal elements of an interview, was developed and is recommended as a criterion standard research coding method. An easily conducted, reliable coding procedure can be the basis for everyday questionnaires like patient satisfaction with patient-centeredness. Copyright © 2016 Elsevier Ireland Ltd. All rights reserved.

A Screening Tool to Identify Spasticity in Need of Treatment

PubMed Central

Zorowitz, Richard D.; Wein, Theodore H.; Dunning, Kari; Deltombe, Thierry; Olver, John H.; Davé, Shashank J.; Dimyan, Michael A.; Kelemen, John; Pagan, Fernando L.; Evans, Christopher J.; Gillard, Patrick J.; Kissela, Brett M.

2017-01-01

Objective To develop a clinically useful patient-reported screening tool for health care providers to identify patients with spasticity in need of treatment regardless of etiology. Design Eleven spasticity experts participated in a modified Delphi panel and reviewed and revised 2 iterations of a screening tool designed to identify spasticity symptoms and impact on daily function and sleep. Spasticity expert panelists evaluated items pooled from existing questionnaires to gain consensus on the screening tool content. The study also included cognitive interviews of 20 patients with varying spasticity etiologies to determine if the draft screening tool was understandable and relevant to patients with spasticity. Results The Delphi panel reached an initial consensus on 21 of 47 items for the screening tool and determined that the tool should have no more than 11 to 15 items and a 1-month recall period for symptom and impact items. After 2 rounds of review, 13 items were selected and modified by the expert panelists. Most patients (n = 16 [80%]) completed the cognitive interview and interpreted the items as intended. Conclusions Through the use of a Delphi panel and patient interviews, a 13-item spasticity screening tool was developed that will be practical and easy to use in routine clinical practice. PMID:27552355

The Long-Term Conditions Questionnaire: conceptual framework and item development.

PubMed

Peters, Michele; Potter, Caroline M; Kelly, Laura; Hunter, Cheryl; Gibbons, Elizabeth; Jenkinson, Crispin; Coulter, Angela; Forder, Julien; Towers, Ann-Marie; A'Court, Christine; Fitzpatrick, Ray

2016-01-01

To identify the main issues of importance when living with long-term conditions to refine a conceptual framework for informing the item development of a patient-reported outcome measure for long-term conditions. Semi-structured qualitative interviews (n=48) were conducted with people living with at least one long-term condition. Participants were recruited through primary care. The interviews were transcribed verbatim and analyzed by thematic analysis. The analysis served to refine the conceptual framework, based on reviews of the literature and stakeholder consultations, for developing candidate items for a new measure for long-term conditions. Three main organizing concepts were identified: impact of long-term conditions, experience of services and support, and self-care. The findings helped to refine a conceptual framework, leading to the development of 23 items that represent issues of importance in long-term conditions. The 23 candidate items formed the first draft of the measure, currently named the Long-Term Conditions Questionnaire. The aim of this study was to refine the conceptual framework and develop items for a patient-reported outcome measure for long-term conditions, including single and multiple morbidities and physical and mental health conditions. Qualitative interviews identified the key themes for assessing outcomes in long-term conditions, and these underpinned the development of the initial draft of the measure. These initial items will undergo cognitive testing to refine the items prior to further validation in a survey.

Lower-fat menu items in restaurants satisfy customers.

PubMed

Fitzpatrick, M P; Chapman, G E; Barr, S I

1997-05-01

To evaluate a restaurant-based nutrition program by measuring customer satisfaction with lower-fat menu items and assessing patrons' reactions to the program. Questionnaires to assess satisfaction with menu items were administered to patrons in eight of the nine restaurants that volunteered to participate in the nutrition program. One patron from each participating restaurant was randomly selected for a semistructured interview about nutrition programming in restaurants. Persons dining in eight participating restaurants over a 1-week period (n = 686). Independent samples t tests were used to compare respondents' satisfaction with lower-fat and regular menu items. Two-way analysis of variance tests were completed using overall satisfaction as the dependent variable and menu-item classification (ie, lower fat or regular) and one of eight other menu item and respondent characteristics as independent variables. Qualitative methods were used to analyze interview transcripts. Of 1,127 menu items rated for satisfaction, 205 were lower fat, 878 were regular, and 44 were of unknown classification. Customers were significantly more satisfied with lower-fat than with regular menu items (P < .001). Overall satisfaction did not vary by any of the other independent variables. Interview results indicate the importance of restaurant during as an indulgent experience. High satisfaction with lower-fat menu items suggests that customers will support restaurant providing such choices. Dietitians can use these findings to encourage restaurateurs to include lower-fat choices on their menus, and to assure clients that their expectations of being indulged are not incompatible with these choices.

Three approaches to investigating the multidimensional nature of a science assessment

NASA Astrophysics Data System (ADS)

Gokiert, Rebecca Jayne

The purpose of this study was to investigate a multi-method approach for collecting validity evidence about the underlying knowledge and skills measured by a large-scale science assessment. The three approaches included analysis of dimensionality, differential item functioning (DIF), and think-aloud interviews. The specific research questions addressed were: (1) Does the 4-factor model previously found by Hamilton et al. (1995) for the grade 8 sample explain the data? (2) Do the performances of male and female students systematically differ? Are these performance differences captured in the dimensions? (3) Can think-aloud reports aid in the generation of hypotheses about the underlying knowledge and skills that are measured by this test? A confirmatory factor analysis of the 4-factor model revealed good model data fit for both the AB and AC tests. Twenty-four of the 83 AB test items and 16 of the 77 AC test items displayed significant DIF, however, items were found, on average, to favour both males and females equally. There were some systematic differences found across the 4-factors; items favouring males tended to be related to earth and space sciences, stereotypical male related activities, and numerical operations. Conversely, females were found to outperform males on items that required careful reading and attention to detail. Concurrent and retrospective verbal reports (Ericsson & Simon, 1993) were collected from 16 grade 8 students (9 male and 7 female) while they solved 12 DIF items. Four general cognitive processing themes were identified from the student protocols that could be used to explain male and female problem solving. The themes included comprehension (verbal and visual), visualization, background knowledge/experience (school or life), and strategy use. There were systematic differences in cognitive processing between the students that answered the items correctly and the students who answered the items incorrectly; however, this did not always correspond with the statistical gender DIF results. Although the multifaceted approach produced interpretable and meaningful validity evidence about the knowledge and skills, these forms of validity evidence only begin to provide a basic understanding of the underlying construct(s) that are being measured.

Development of the 7-Item Binge-Eating Disorder Screener (BEDS-7)

PubMed Central

Deal, Linda S.; DiBenedetti, Dana B.; Nelson, Lauren; Fehnel, Sheri E.; Brown, T. Michelle

2016-01-01

Objective Develop a brief, patient-reported screening tool designed to identify individuals with probable binge-eating disorder (BED) for further evaluation or referral to specialists. Methods Items were developed on the basis of the DSM-5 diagnostic criteria, existing tools, and input from 3 clinical experts (January 2014). Items were then refined in cognitive debriefing interviews with participants self-reporting BED characteristics (March 2014) and piloted in a multisite, cross-sectional, prospective, noninterventional study consisting of a semistructured diagnostic interview (to diagnose BED) and administration of the pilot Binge-Eating Disorder Screener (BEDS), Binge Eating Scale (BES), and RAND 36-Item Short-Form Health Survey (RAND-36) (June 2014–July 2014). The sensitivity and specificity of classification algorithms (formed from the pilot BEDS item-level responses) in predicting BED diagnosis were evaluated. The final algorithm was selected to minimize false negatives and false positives, while utilizing the fewest number of BEDS items. Results Starting with the initial BEDS item pool (20 items), the 13-item pilot BEDS resulted from the cognitive debriefing interviews (n = 13). Of the 97 participants in the noninterventional study, 16 were diagnosed with BED (10/62 female, 16%; 6/35 male, 17%). Seven BEDS items (BEDS-7) yielded 100% sensitivity and 38.7% specificity. Participants correctly identified (true positives) had poorer BES scores and RAND-36 scores than participants identified as true negatives. Conclusions Implementation of the brief, patient-reported BEDS-7 in real-world clinical practice is expected to promote better understanding of BED characteristics and help physicians identify patients who may have BED. PMID:27486542

Development of the 7-Item Binge-Eating Disorder Screener (BEDS-7).

PubMed

Herman, Barry K; Deal, Linda S; DiBenedetti, Dana B; Nelson, Lauren; Fehnel, Sheri E; Brown, T Michelle

2016-01-01

Develop a brief, patient-reported screening tool designed to identify individuals with probable binge-eating disorder (BED) for further evaluation or referral to specialists. Items were developed on the basis of the DSM-5 diagnostic criteria, existing tools, and input from 3 clinical experts (January 2014). Items were then refined in cognitive debriefing interviews with participants self-reporting BED characteristics (March 2014) and piloted in a multisite, cross-sectional, prospective, noninterventional study consisting of a semistructured diagnostic interview (to diagnose BED) and administration of the pilot Binge-Eating Disorder Screener (BEDS), Binge Eating Scale (BES), and RAND 36-Item Short-Form Health Survey (RAND-36) (June 2014-July 2014). The sensitivity and specificity of classification algorithms (formed from the pilot BEDS item-level responses) in predicting BED diagnosis were evaluated. The final algorithm was selected to minimize false negatives and false positives, while utilizing the fewest number of BEDS items. Starting with the initial BEDS item pool (20 items), the 13-item pilot BEDS resulted from the cognitive debriefing interviews (n = 13). Of the 97 participants in the noninterventional study, 16 were diagnosed with BED (10/62 female, 16%; 6/35 male, 17%). Seven BEDS items (BEDS-7) yielded 100% sensitivity and 38.7% specificity. Participants correctly identified (true positives) had poorer BES scores and RAND-36 scores than participants identified as true negatives. Implementation of the brief, patient-reported BEDS-7 in real-world clinical practice is expected to promote better understanding of BED characteristics and help physicians identify patients who may have BED.

Robust Multi-unit Auction Protocol against False-name Bids

NASA Astrophysics Data System (ADS)

Yokoo, Makoto; Sakurai, Yuko; Matsubara, Shigeo

This paper presents a new multi-unit auction protocol (IR protocol) that is robust against false-name bids. Internet auctions have become an integral part of Electronic Commerce and a promising field for applying agent and Artificial Intelligence technologies. Although the Internet provides an excellent infrastructure for executing auctions, the possibility of a new type of cheating called false-name bids has been pointed out. A false-name bid is a bid submitted under a fictitious name. A protocol called LDS has been developed for combinatorial auctions of multiple different items and has proven to be robust against false-name bids. Although we can modify the LDS protocol to handle multi-unit auctions, in which multiple units of an identical item are auctioned, the protocol is complicated and requires the auctioneer to carefully pre-determine the combination of bundles to obtain a high social surplus or revenue. For the auctioneer, our newly developed IR protocol is easier to use than the LDS, since the combination of bundles is automatically determined in a flexible manner according to the declared evaluation values of agents. The evaluation results show that the IR protocol can obtain a better social surplus than that obtained by the LDS protocol.

Ramsay-Curve Differential Item Functioning

ERIC Educational Resources Information Center

Woods, Carol M.

2011-01-01

Differential item functioning (DIF) occurs when an item on a test, questionnaire, or interview has different measurement properties for one group of people versus another, irrespective of true group-mean differences on the constructs being measured. This article is focused on item response theory based likelihood ratio testing for DIF (IRT-LR or…

The Oxford Participation and Activities Questionnaire: study protocol

PubMed Central

Morley, David; Dummett, Sarah; Kelly, Laura; Dawson, Jill; Fitzpatrick, Ray; Jenkinson, Crispin

2014-01-01

Background With an ageing population and increasing demands on health and social care services, there is growing importance attached to the management of long-term conditions, including maximizing the cost-effectiveness of treatments. In line with this, there is increasing emphasis on the need to keep people both active and participating in daily life. Consequently, it is essential that well developed and validated instruments that can meaningfully assess levels of participation and activity are widely available. Current measures, however, are largely focused on disability and rehabilitation, and there is no measure of activity or participation for generic use that fully meets the standards set by regulatory bodies such as the US Food and Drug Administration. Here we detail a protocol for the development and validation of a new patient-reported outcome measure (PROM) for assessment of participation and activity in people experiencing a variety of health conditions, ie, the Oxford Participation and Activities Questionnaire (Ox-PAQ). The stages incorporated in its development are entirely in line with current regulations and represent best practice in the development of PROMs. Methods Development of the Ox-PAQ is theoretically grounded in the World Health Organization International Classification of Functioning, Disability, and Health. The project incorporates a new strategy of engaging with stakeholders from the outset in an attempt to identify those characteristics of PROMs considered most important to a range of potential users. Items will be generated through interviews with patients from a range of conditions. Pretesting of the instrument will be via cognitive interviews and focus groups. A postal survey will be conducted, with data subject to factor and Rasch analysis in order to identify appropriate dimensions and redundant items. Reliability will be assessed by Cronbach’s alpha and item-total correlations. A second, large-scale postal survey will follow, with the Ox-PAQ being administered in conjunction with generic measures of health status to further test the validity of the measure. The Ox-PAQ will again be administered at 2 weeks to assess test-retest reliability and at 3 months to assess responsiveness. Conclusion The development of the Ox-PAQ is a timely one. With increasing emphasis being placed on the importance of keeping people active and participating in daily life, the instrument has the potential for significant uptake. Its primary use is intended to be in clinical trials and for evaluation of interventions targeted at maintaining activity and participation. PMID:24399888

Department of Defense Logistics Roadmap 2008. Volume 1

DTIC Science & Technology

2008-07-01

machine readable identification mark on the Department’s tangible qualifying assets, and establishes the data management protocols needed to...uniquely identify items with a Unique Item Identifier (UII) via machine - readable information (MRI) marking represented by a two-dimensional data...property items with a machine -readable Unique Item Identifier (UII), which is a set of globally unique data elements. The UII is used in functional

Cybersecurity and Resilience | Energy Systems Integration Facility | NREL

Science.gov Websites

, and offer prioritized action items to improve organizational protocols. The team is also helping and provide a prioritized list of action items for gaps in security controls. Security architectures

The Long-Term Conditions Questionnaire: conceptual framework and item development

PubMed Central

Peters, Michele; Potter, Caroline M; Kelly, Laura; Hunter, Cheryl; Gibbons, Elizabeth; Jenkinson, Crispin; Coulter, Angela; Forder, Julien; Towers, Ann-Marie; A’Court, Christine; Fitzpatrick, Ray

2016-01-01

Purpose To identify the main issues of importance when living with long-term conditions to refine a conceptual framework for informing the item development of a patient-reported outcome measure for long-term conditions. Materials and methods Semi-structured qualitative interviews (n=48) were conducted with people living with at least one long-term condition. Participants were recruited through primary care. The interviews were transcribed verbatim and analyzed by thematic analysis. The analysis served to refine the conceptual framework, based on reviews of the literature and stakeholder consultations, for developing candidate items for a new measure for long-term conditions. Results Three main organizing concepts were identified: impact of long-term conditions, experience of services and support, and self-care. The findings helped to refine a conceptual framework, leading to the development of 23 items that represent issues of importance in long-term conditions. The 23 candidate items formed the first draft of the measure, currently named the Long-Term Conditions Questionnaire. Conclusion The aim of this study was to refine the conceptual framework and develop items for a patient-reported outcome measure for long-term conditions, including single and multiple morbidities and physical and mental health conditions. Qualitative interviews identified the key themes for assessing outcomes in long-term conditions, and these underpinned the development of the initial draft of the measure. These initial items will undergo cognitive testing to refine the items prior to further validation in a survey. PMID:27621678

Development of a Self-Report Physical Function Instrument for Disability Assessment: Item Pool Construction and Factor Analysis

PubMed Central

McDonough, Christine M.; Jette, Alan M.; Ni, Pengsheng; Bogusz, Kara; Marfeo, Elizabeth E; Brandt, Diane E; Chan, Leighton; Meterko, Mark; Haley, Stephen M.; Rasch, Elizabeth K.

2014-01-01

Objectives To build a comprehensive item pool representing work-relevant physical functioning and to test the factor structure of the item pool. These developmental steps represent initial outcomes of a broader project to develop instruments for the assessment of function within the context of Social Security Administration (SSA) disability programs. Design Comprehensive literature review; gap analysis; item generation with expert panel input; stakeholder interviews; cognitive interviews; cross-sectional survey administration; and exploratory and confirmatory factor analyses to assess item pool structure. Setting In-person and semi-structured interviews; internet and telephone surveys. Participants A sample of 1,017 SSA claimants, and a normative sample of 999 adults from the US general population. Interventions Not Applicable. Main Outcome Measure Model fit statistics Results The final item pool consisted of 139 items. Within the claimant sample 58.7% were white; 31.8% were black; 46.6% were female; and the mean age was 49.7 years. Initial factor analyses revealed a 4-factor solution which included more items and allowed separate characterization of: 1) Changing and Maintaining Body Position, 2) Whole Body Mobility, 3) Upper Body Function and 4) Upper Extremity Fine Motor. The final 4-factor model included 91 items. Confirmatory factor analyses for the 4-factor models for the claimant and the normative samples demonstrated very good fit. Fit statistics for claimant and normative samples respectively were: Comparative Fit Index = 0.93 and 0.98; Tucker-Lewis Index = 0.92 and 0.98; Root Mean Square Error Approximation = 0.05 and 0.04. Conclusions The factor structure of the Physical Function item pool closely resembled the hypothesized content model. The four scales relevant to work activities offer promise for providing reliable information about claimant physical functioning relevant to work disability. PMID:23542402

Development of a self-report physical function instrument for disability assessment: item pool construction and factor analysis.

PubMed

McDonough, Christine M; Jette, Alan M; Ni, Pengsheng; Bogusz, Kara; Marfeo, Elizabeth E; Brandt, Diane E; Chan, Leighton; Meterko, Mark; Haley, Stephen M; Rasch, Elizabeth K

2013-09-01

To build a comprehensive item pool representing work-relevant physical functioning and to test the factor structure of the item pool. These developmental steps represent initial outcomes of a broader project to develop instruments for the assessment of function within the context of Social Security Administration (SSA) disability programs. Comprehensive literature review; gap analysis; item generation with expert panel input; stakeholder interviews; cognitive interviews; cross-sectional survey administration; and exploratory and confirmatory factor analyses to assess item pool structure. In-person and semistructured interviews and Internet and telephone surveys. Sample of SSA claimants (n=1017) and a normative sample of adults from the U.S. general population (n=999). Not applicable. Model fit statistics. The final item pool consisted of 139 items. Within the claimant sample, 58.7% were white; 31.8% were black; 46.6% were women; and the mean age was 49.7 years. Initial factor analyses revealed a 4-factor solution, which included more items and allowed separate characterization of: (1) changing and maintaining body position, (2) whole body mobility, (3) upper body function, and (4) upper extremity fine motor. The final 4-factor model included 91 items. Confirmatory factor analyses for the 4-factor models for the claimant and the normative samples demonstrated very good fit. Fit statistics for claimant and normative samples, respectively, were: Comparative Fit Index=.93 and .98; Tucker-Lewis Index=.92 and .98; and root mean square error approximation=.05 and .04. The factor structure of the physical function item pool closely resembled the hypothesized content model. The 4 scales relevant to work activities offer promise for providing reliable information about claimant physical functioning relevant to work disability. Copyright © 2013 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.

Enhancing user privacy in SARG04-based private database query protocols

NASA Astrophysics Data System (ADS)

Yu, Fang; Qiu, Daowen; Situ, Haozhen; Wang, Xiaoming; Long, Shun

2015-11-01

The well-known SARG04 protocol can be used in a private query application to generate an oblivious key. By usage of the key, the user can retrieve one out of N items from a database without revealing which one he/she is interested in. However, the existing SARG04-based private query protocols are vulnerable to the attacks of faked data from the database since in its canonical form, the SARG04 protocol lacks means for one party to defend attacks from the other. While such attacks can cause significant loss of user privacy, a variant of the SARG04 protocol is proposed in this paper with new mechanisms designed to help the user protect its privacy in private query applications. In the protocol, it is the user who starts the session with the database, trying to learn from it bits of a raw key in an oblivious way. An honesty test is used to detect a cheating database who had transmitted faked data. The whole private query protocol has O( N) communication complexity for conveying at least N encrypted items. Compared with the existing SARG04-based protocols, it is efficient in communication for per-bit learning.

A new structured interview for children with autism spectrum disorder based on the DSM-IV.

PubMed

Hansakunachai, Tippawan; Roongpraiwan, Rawiwan; Sombuntham, Tasnawat; Limprasert, Pornprot; Ruangdaraganon, Nichara

2014-08-01

Autism spectrum disorder (ASD) is a common neurodevelopmental disorder in children. The clinical spectrum of ASD includes autism, childhood disintegrative disorder Asperger syndrome and pervasive developmental disorder not otherwise specified (PDD-NOS). Although the DSM-IVcriteria are well acceptedforASD diagnosis, there are some known limitations for clinicians. The most important issue is lack'ofspecific age-appropriate items in each domain. Thus, the DSM-IVneeds some modifications in order to be appropriate for clinical use. To develop a structured interview for children based on the DSM-IVdiagnostic criteria ofautism and PDD-NOS. MATERIAL ANDMETHOD: From June 2006 to December 2008, 140 Thai children, 121 boys and 19 girls, already diagnosed with ASD, were recruited through the child development clinics of Ramathibodi and Thammasat University Hospitals in Thailand. A 26-item structured interview was developed with scoring according to the DSM-IVdiagnostic criteria for autism andPDD- NOS. To test the accuracy of the structured interview and its reliability, 32 children with ASD were selected and interviewed by four clinicians using the new instrument. One clinician interviewed the parents or caregivers, while three others independently took notes and observed the play behavior of the children. All items from the structured interview as scored by each clinician were compared using inter-rater agreement statistics (Kappa). All of the original 140 patients were then clinically diagnosed again using the structured interview and the results were compared with the initial diagnoses. Ofthe 140patients originally diagnosed with ASD, 110 and 30patients were finally diagnosed with the new interview as having autism and PDD-NOS, respectively. The initial diagnoses from 15 cases (10.7%) were changed according to the structured interview Inter-rater reliability among the four clinicians showed a good level ofagreement (Kappa = 0.897) with statistical significance (p<0.001). The authors only compared the items in the structured interview between the autism and PDD-NOSgroups from 105 cases aged 2-5 years (79 cases with autism and 26 cases with PDD-NOS) because there were only 4 cases with PDD-NOS in the other age groups. Highly significant differences (p<0.001) in clinical items between patients with autism and patients with PDD-NOS from the final diagnoses were noted in 6 of 8 items in the category of restricted, repetitive and stereotyped patterns ofbehavior, interests and activities, which were more common in the autism group than the PDD-NOS group. In addition, the autism group had higher frequencies of using finger-pointing to indicate interest rather than verbalization, and idiosyncratic language, than the PDD-NOS group. The newly developed structured interview for Thai children with ASD had a high level ofinterrater reliability between four clinicians. However, most children tested using this structured interview were 2-5years ofage, and the study did not include non-autistic groups. The application ofthis structured interview needs further study with a wider variety ofcases, such as ASD cases from different age groups, children with delayed development and normal children.

Development of an instrument for assessing workstyle in checkout cashier work (BAsIK).

PubMed

Kjellberg, Katarina; Palm, Peter; Josephson, Malin

2012-01-01

Checkout cashier work consists of handling a large number of items during a work shift, which implies repetitive movements of the shoulders, arms and hands/wrists, and a high work rate. The work is associated with a high prevalence of disorders in the neck and upper extremity. The concept of workstyle explains how ergonomic and psychosocial factors interact in the development of work-related upper extremity disorders. The aim of the project was to develop an instrument for the occupational health services to be used in the efforts to prevent upper extremity disorders in checkout cashier work. The instrument is based on the workstyle concept and is intended to be used as a tool to identify high-risk workstyle and needs for interventions, such as training and education. The instrument, BAsIK, consists of four parts; a questionnaire about workstyle, an observation protocol for work technique, a checklist about the design of the checkout and a questionnaire about work organization. The instrument was developed by selecting workstyle items developed for office work and adapting them to checkout cashier work, discussions with researchers and ergonomists, focus-group interviews with cashiers, observations of video recordings of cashiers, and studies of existing guidelines and checklists.

Quantum Private Queries

NASA Astrophysics Data System (ADS)

Giovannetti, Vittorio; Lloyd, Seth; Maccone, Lorenzo

2008-06-01

We propose a cheat sensitive quantum protocol to perform a private search on a classical database which is efficient in terms of communication complexity. It allows a user to retrieve an item from the database provider without revealing which item he or she retrieved: if the provider tries to obtain information on the query, the person querying the database can find it out. The protocol ensures also perfect data privacy of the database: the information that the user can retrieve in a single query is bounded and does not depend on the size of the database. With respect to the known (quantum and classical) strategies for private information retrieval, our protocol displays an exponential reduction in communication complexity and in running-time computational complexity.

76 FR 17427 - Notice of Submission of Proposed Information Collection to OMB; Emergency Comment Request...

Federal Register 2010, 2011, 2012, 2013, 2014

2011-03-29

... (HPRP) grantees, as well as the site visit interview guide that will serve as the protocol for 15-18... site visit interview guide that will serve as the protocol for 15-18 site visits to be conducted to...

Using Cognitive Interviews to Pilot an International Survey of Principal Preparation: A Western Australian Perspective

ERIC Educational Resources Information Center

Wildy, Helen; Clarke, Simon

2009-01-01

This paper provides an example of the application of the cognitive interview, a qualitative tool for pre-testing a survey instrument to check its cognitive validity, that is, whether the items mean to respondents what they mean to the item designers. The instrument is the survey used in the final phase of the International Study of Principal…

Development and evaluation of a thermochemistry concept inventory for college-level general chemistry

NASA Astrophysics Data System (ADS)

Wren, David A.

The research presented in this dissertation culminated in a 10-item Thermochemistry Concept Inventory (TCI). The development of the TCI can be divided into two main phases: qualitative studies and quantitative studies. Both phases focused on the primary stakeholders of the TCI, college-level general chemistry instructors and students. Each phase was designed to collect evidence for the validity of the interpretations and uses of TCI testing data. A central use of TCI testing data is to identify student conceptual misunderstandings, which are represented as incorrect options of multiple-choice TCI items. Therefore, quantitative and qualitative studies focused heavily on collecting evidence at the item-level, where important interpretations may be made by TCI users. Qualitative studies included student interviews (N = 28) and online expert surveys (N = 30). Think-aloud student interviews (N = 12) were used to identify conceptual misunderstandings used by students. Novice response process validity interviews (N = 16) helped provide information on how students interpreted and answered TCI items and were the basis of item revisions. Practicing general chemistry instructors (N = 18), or experts, defined boundaries of thermochemistry content included on the TCI. Once TCI items were in the later stages of development, an online version of the TCI was used in expert response process validity survey (N = 12), to provide expert feedback on item content, format and consensus of the correct answer for each item. Quantitative studies included three phases: beta testing of TCI items (N = 280), pilot testing of the a 12-item TCI (N = 485), and a large data collection using a 10-item TCI ( N = 1331). In addition to traditional classical test theory analysis, Rasch model analysis was also used for evaluation of testing data at the test and item level. The TCI was administered in both formative assessment (beta and pilot testing) and summative assessment (large data collection), with items performing well in both. One item, item K, did not have acceptable psychometric properties when the TCI was used as a quiz (summative assessment), but was retained in the final version of the TCI based on the acceptable psychometric properties displayed in pilot testing (formative assessment).

78 FR 3431 - Proposed Information Collection Activity; Comment Request

Federal Register 2010, 2011, 2012, 2013, 2014

2013-01-16

... protocols to collect further qualitative information through interviews and/or focus groups with program... Readiness Goals and Head Start Program Functioning'' research project. The purpose of this study is to... functioning. ACF is proposing to use a semi-structured telephone interview protocol to collect information...

A protocol for eliciting nonmaterial values through a cultural ecosystem services frame.

PubMed

Gould, Rachelle K; Klain, Sarah C; Ardoin, Nicole M; Satterfield, Terre; Woodside, Ulalia; Hannahs, Neil; Daily, Gretchen C; Chan, Kai M

2015-04-01

Stakeholders' nonmaterial desires, needs, and values often critically influence the success of conservation projects. These considerations are challenging to articulate and characterize, resulting in their limited uptake in management and policy. We devised an interview protocol designed to enhance understanding of cultural ecosystem services (CES). The protocol begins with discussion of ecosystem-related activities (e.g., recreation, hunting) and management and then addresses CES, prompting for values encompassing concepts identified in the Millennium Ecosystem Assessment (2005) and explored in other CES research. We piloted the protocol in Hawaii and British Columbia. In each location, we interviewed 30 individuals from diverse backgrounds. We analyzed results from the 2 locations to determine the effectiveness of the interview protocol in elucidating nonmaterial values. The qualitative and spatial components of the protocol helped characterize cultural, social, and ethical values associated with ecosystems in multiple ways. Maps and situational, or vignette-like, questions helped respondents articulate difficult-to-discuss values. Open-ended prompts allowed respondents to express a diversity of ecosystem-related values and proved sufficiently flexible for interviewees to communicate values for which the protocol did not explicitly probe. Finally, the results suggest that certain values, those mentioned frequently throughout the interview, are particularly salient for particular populations. The protocol can provide efficient, contextual, and place-based data on the importance of particular ecosystem attributes for human well-being. Qualitative data are complementary to quantitative and spatial assessments in the comprehensive representation of people's values pertaining to ecosystems, and this protocol may assist in incorporating values frequently overlooked in decision making processes. © 2014 The Authors. Conservation Biology published by Wiley Periodicals, Inc. on behalf of Society for Conservation Biology.

The perceptual learning of time-compressed speech: A comparison of training protocols with different levels of difficulty

PubMed Central

Gabay, Yafit; Karni, Avi; Banai, Karen

2017-01-01

Speech perception can improve substantially with practice (perceptual learning) even in adults. Here we compared the effects of four training protocols that differed in whether and how task difficulty was changed during a training session, in terms of the gains attained and the ability to apply (transfer) these gains to previously un-encountered items (tokens) and to different talkers. Participants trained in judging the semantic plausibility of sentences presented as time-compressed speech and were tested on their ability to reproduce, in writing, the target sentences; trail-by-trial feedback was afforded in all training conditions. In two conditions task difficulty (low or high compression) was kept constant throughout the training session, whereas in the other two conditions task difficulty was changed in an adaptive manner (incrementally from easy to difficult, or using a staircase procedure). Compared to a control group (no training), all four protocols resulted in significant post-training improvement in the ability to reproduce the trained sentences accurately. However, training in the constant-high-compression protocol elicited the smallest gains in deciphering and reproducing trained items and in reproducing novel, untrained, items after training. Overall, these results suggest that training procedures that start off with relatively little signal distortion (“easy” items, not far removed from standard speech) may be advantageous compared to conditions wherein severe distortions are presented to participants from the very beginning of the training session. PMID:28545039

Measuring Reform Practices in Science and Mathematics Classrooms: The Reformed Teaching Observation Protocol.

ERIC Educational Resources Information Center

Sawada, Daiyo; Piburn, Michael D.; Judson, Eugene; Turley, Jeff; Falconer, Kathleen; Benford, Russell; Bloom, Irene

2002-01-01

Describes the Reformed Teaching Observation Protocol (RTOP), a 25-item classroom observation protocol that is standards-based, inquiry-oriented, and student-centered. Provides the definition for reform and the basis for evaluation of the Arizona Collaborative for Excellence in the Preparation of Teachers (ACEPT). Concludes that reform, as defined…

77 FR 9906 - Nationwide Categorical Waivers Under Section 1605 (Buy American) of the American Recovery and...

Federal Register 2010, 2011, 2012, 2013, 2014

2012-02-21

... (4) network manager for conversion of proprietary protocol--Staefa brand system--to a non-proprietary... conversion of proprietary protocol--Staefa brand system--to a non-proprietary open source protocol, are not... their scouting process did not locate any domestic manufacturers for these exact or equivalent items. In...

[Polish version of the ADOS (autism diagnostic observation schedule-generic)].

PubMed

Chojnicka, Izabela; Płoski, Rafał

2012-01-01

The article presents the Polish version of the autism diagnostic observation schedule-generic (ADOS), which together with the autism diagnostic interview-revised (ADI-R) is cited as the "gold standard" for the diagnosis of autism. The ADOS is a standardised, semistructured observation protocol appropriate for children and adults of differing age and language levels. It is linked to ICD-10 and DSM-IV-TR criteria. The ADOS consists of four modules, ranging from module 1 for nonverbal individuals to module 4 for verbally fluent adults. The adequate inter-rater reliability for items has been established. The protocol has high discriminant validity and distinguishes children with pervasive developmental disorders from children, who are outside of the spectrum. Although it does not enable to distinguish individuals with pervasive developmental disorder, unspecified from individuals with childhood autism. The paper presents subsequent steps of the translation process of the original version into Polish, as well as a chosen adaptation strategy of the Polish version. The ADOS is a very useful tool both for clinical diagnosis and for the scientific purpose diagnosis. In this last case it is extremely important to use a standardised method. Until now, there was no standardised diagnostic tool for autism in Poland.

Measuring Access to Information and Technology: Environmental Factors Affecting Persons With Neurologic Disorders.

PubMed

Hahn, Elizabeth A; Garcia, Sofia F; Lai, Jin-Shei; Miskovic, Ana; Jerousek, Sara; Semik, Patrick; Wong, Alex; Heinemann, Allen W

2016-08-01

To develop and validate a patient-reported measure of access to information and technology (AIT) for persons with spinal cord injury, stroke, or traumatic brain injury. A mixed-methods approach was used to develop items, refine them through cognitive interviews, and evaluate their psychometric properties. Item responses were evaluated with the Rasch rating scale model. Correlational and analysis-of-variance methods were used to evaluate construct validity. Community-dwelling individuals participated in telephone interviews or traveled to the academic medical centers where this research took place. Individuals with a diagnosis of spinal cord injury, stroke, or traumatic brain injury (aged ≥18y, English speaking) participated in cognitive interviews (n=12 persons), field testing of the items (n=305 persons), and validation testing of the final set of items (n=604 persons). Not applicable. A set of items to measure AIT for people with disabilities. A user-friendly multimedia touchscreen was used for self-administration of the items. A 23-item AIT measure demonstrated good evidence of internal consistency reliability, and content and construct validity. This new AIT measure will enable researchers and clinicians to determine to what extent environmental factors influence health outcomes and social participation in people with disabilities. The AIT measure could also provide disability advocates with more specific and detailed information about environmental factors to lobby for elimination of barriers. Copyright © 2016 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.

Connecting Levels of Representation: Emergent versus Submergent Perspective

ERIC Educational Resources Information Center

Rappoport, Lana T.; Ashkenazi, Guy

2008-01-01

Chemical phenomena can be described using three representation modes: macro, submicro, and symbolic. The way students use and connect these modes when solving conceptual problems was studied, using a think-aloud interview protocol. The protocol was validated through interviews with six faculty members, and then applied to four graduate and six…

Understanding health care provider barriers to hospital affiliated medical fitness center facility referral: a questionnaire survey and semi structured interviews.

PubMed

Smock, Carissa; Alemagno, Sonia

2017-08-03

The purpose of this study is to understand health care provider barriers to referring patients to Medical Fitness Center Facilities within an affiliated teaching hospital system using referral of diabetic services as an example. The aims of this study include: (1) to assess health care providers' awareness and use of facilities, (2) to determine barriers to referring patients to facilities, (3) identify current and needed resources and/or changes to increase referral to facilities. A 20-item electronic survey and requests for semi-structured interviews were administered to hospital system directors and managers (n = 51). Directors and managers instructed physicians and staff to complete the survey and interviews as applicable. Perceived barriers, knowledge, utilization, and referral of patients to Medical Fitness Center Facilities were collected and examined. Descriptive statistics were generated regarding practice characteristics, provider characteristics, and referral. Of the health care providers surveyed and interviewed (n = 25) 40% indicated verbally suggesting use of facilities, 24% provided a flyer about the facilities. No respondents indicated that they directly referred patients to the facilities. However, 16% referred patients to other locations for physical activity - including their own department's management and prevention services. 20% do not refer to Medical Fitness Center Facilities or any other lifestyle programs/locations. Lack of time (92%) and lack of standard guidelines and operating procedures (88%) are barriers to referral. All respondents indicated a strong ability to refer patients to Medical Fitness Center Facilities if given education about referral programs available as well as standard clinical guidelines and protocol for delivery. The results of this study indicate that, although few healthcare providers are currently referring patients to Medical Fitness Center Facilities, health care providers with an affiliated Medical Fitness Center Facility not only want clinical standard guidelines, protocol, and training to refer patients to Medical Fitness Center Facilities, but believe they have the ability to increase referral if given these tools. The Medical Fitness Association has a unique opportunity to bridge health care providers to Medical Fitness Center Facilities by developing clinical practice guidelines in cooperation with the American Diabetes Association.

Item-Level Psychometrics of the Glasgow Outcome Scale: Extended Structured Interviews.

PubMed

Hong, Ickpyo; Li, Chih-Ying; Velozo, Craig A

2016-04-01

The Glasgow Outcome Scale-Extended (GOSE) structured interview captures critical components of activities and participation, including home, shopping, work, leisure, and family/friend relationships. Eighty-nine community dwelling adults with mild-moderate traumatic brain injury (TBI) were recruited (average = 2.7 year post injury). Nine items of the 19 items were used for the psychometrics analysis purpose. Factor analysis and item-level psychometrics were investigated using the Rasch partial-credit model. Although the principal components analysis of residuals suggests that a single measurement factor dominates the measure, the instrument did not meet the factor analysis criteria. Five items met the rating scale criteria. Eight items fit the Rasch model. The instrument demonstrated low person reliability (0.63), low person strata (2.07), and a slight ceiling effect. The GOSE demonstrated limitations in precisely measuring activities/participation for individuals after TBI. Future studies should examine the impact of the low precision of the GOSE on effect size. © The Author(s) 2016.

Development and reliability of a structured interview guide for the Montgomery Asberg Depression Rating Scale (SIGMA).

PubMed

Williams, Janet B W; Kobak, Kenneth A

2008-01-01

The Montgomery-Asberg Depression Rating Scale (MADRS) is often used in clinical trials to select patients and to assess treatment efficacy. The scale was originally published without suggested questions for clinicians to use in gathering the information necessary to rate the items. Structured and semi-structured interview guides have been found to improve reliability with other scales. To describe the development and test-retest reliability of a structured interview guide for the MADRS (SIGMA). A total of 162 test-retest interviews were conducted by 81 rater pairs. Each patient was interviewed twice, once by each rater conducting an independent interview. The intraclass correlation for total score between raters using the SIGMA was r=0.93, P<0.0001. All ten items had good to excellent interrater reliability. Use of the SIGMA can result in high reliability of MADRS scores in evaluating patients with depression.

Exploring the Relevance of Items in the Communicative Participation Item Bank (CPIB) for Individuals With Hearing Loss

PubMed Central

Baylor, Carolyn R.; Birch, Kristen; Yorkston, Kathryn M.

2017-01-01

Purpose The Communicative Participation Item Bank (CPIB) was developed to evaluate participation restrictions in communication situations for individuals with speech and language disorders. This study evaluated the potential relevance of CPIB items for individuals with hearing loss. Method Cognitive interviews were conducted with 17 adults with a range of treated and untreated hearing loss, who responded to 46 items. Interviews were continued until saturation was reached and prevalent trends emerged. A focus group was also conducted with 3 experienced audiologists to seek their views on the CPIB. Analysis of data included qualitative and quantitative approaches. Results The majority of the items were applicable to individuals with hearing loss; however, 12 items were identified as potentially not relevant. This was largely attributed to the items' focus on speech production rather than hearing. The results from the focus group were in agreement for a majority of items. Conclusions The next step in validating the CPIB for individuals with hearing loss is a psychometric analysis on a large sample. Possible outcomes could be that the CPIB is considered valid in its entirety or the creation of a new questionnaire or a hearing loss–specific short form with a subset of items is necessary. PMID:28114665

The COPD-SIB: a newly developed disease-specific item bank to measure health-related quality of life in patients with chronic obstructive pulmonary disease.

PubMed

Paap, Muirne C S; Lenferink, Lonneke I M; Herzog, Nadine; Kroeze, Karel A; van der Palen, Job

2016-06-27

Health-related quality of life (HRQoL) is widely used as an outcome measure in the evaluation of treatment interventions in patients with chronic obstructive pulmonary disease (COPD). In order to address challenges associated with existing fixed-length measures (e.g., too long to be used routinely, too short to ensure both content validity and reliability), a COPD-specific item bank (COPD-SIB) was developed. Items were selected based on literature review and interviews with Dutch COPD patients, with a strong focus on both content validity and item comprehension. The psychometric quality of the item bank was evaluated using Mokken Scale Analysis and parametric Item Response Theory, using data of 666 COPD patients. The final item bank contains 46 items that form a strong scale, tapping into eight important themes that were identified based on literature review and patient interviews: Coping with disease/symptoms, adaptability; Autonomy; Anxiety about the course/end-state of the disease, hopelessness; Positive psychological functioning; Situations triggering or enhancing breathing problems; Symptoms; Activity; Impact. The 46-item COPD-SIB has good psychometric properties and content validity. Items are available in Dutch and English. The COPD-SIB can be used as a stand-alone instrument, or to inform computerised adaptive testing.

Development of a Symptom-Focused Patient-Reported Outcome Measure for Functional Dyspepsia: The Functional Dyspepsia Symptom Diary (FDSD)

PubMed Central

Taylor, Fiona; Higgins, Sophie; Carson, Robyn T; Eremenco, Sonya; Foley, Catherine; Lacy, Brian E; Parkman, Henry P; Reasner, David S; Shields, Alan L; Tack, Jan; Talley, Nicholas J

2018-01-01

Objectives: The Functional Dyspepsia Symptom Diary (FDSD) was developed to address the lack of symptom-focused, patient-reported outcome (PRO) measures designed for use in functional dyspepsia (FD) patients and meeting Food and Drug Administration recommendations for PRO instrument development. Methods: Concept elicitation interviews were conducted with FD participants to identify symptoms important and relevant to FD patients. A preliminary version of the FDSD was constructed, then completed by FD participants on an electronic device in cognitive interviews to evaluate the readability, comprehensibility, relevance, and comprehensiveness of the FDSD, and to preliminarily evaluate its measurement properties. Results: During concept elicitation interviews, 45 participants spontaneously reported 19 symptom concepts. Of those, seven symptoms were selected for assessment by the eight-item FDSD. Cognitive interviews with 57 participants confirmed that participants were able to comprehend and provide meaningful responses to the FDSD, and that the handheld electronic FDSD format was suitable for use in the target population. Scores of the FDSD were well-distributed among response options, item discrimination indices suggested that the FDSD items differentiate among patients with varying degrees of FD severity, and inter-item correlations suggested that no items of the FDSD were capturing redundant information. Internal consistency estimates (0.87) and construct-related validity estimates using known-groups methods were within acceptable ranges. Conclusions: The FDSD is a content-valid PRO measure, with preliminary psychometric evidence providing support for the FDSD’s items and total score. Further psychometric evaluations are recommended to more fully test the FDSD’s score performance and other measurement properties in the target patient population. PMID:28925989

Developing an interactive mobile phone self-report system for self-management of hypertension. Part 2: content validity and usability.

PubMed

Bengtsson, Ulrika; Kjellgren, Karin; Höfer, Stefan; Taft, Charles; Ring, Lena

2014-10-01

Self-management support tools using technology may improve adherence to hypertension treatment. There is a need for user-friendly tools facilitating patients' understanding of the interconnections between blood pressure, wellbeing and lifestyle. This study aimed to examine comprehension, comprehensiveness and relevance of items, and further to evaluate the usability and reliability of an interactive hypertension-specific mobile phone self-report system. Areas important in supporting self-management and candidate items were derived from five focus group interviews with patients and healthcare professionals (n = 27), supplemented by a literature review. Items and response formats were drafted to meet specifications for mobile phone administration and were integrated into a mobile phone data-capture system. Content validity and usability were assessed iteratively in four rounds of cognitive interviews with patients (n = 21) and healthcare professionals (n = 4). Reliability was examined using a test-retest. Focus group analyses yielded six areas covered by 16 items. The cognitive interviews showed satisfactory item comprehension, relevance and coverage; however, one item was added. The mobile phone self-report system was reliable and perceived easy to use. The mobile phone self-report system appears efficiently to capture information relevant in patients' self-management of hypertension. Future studies need to evaluate the effectiveness of this tool in improving self-management of hypertension in clinical practice.

The Quality of Working Life Questionnaire for Cancer Survivors (QWLQ-CS): a Pre-test Study.

PubMed

de Jong, Merel; Tamminga, Sietske J; de Boer, Angela G E M; Frings-Dresen, Monique H W

2016-06-02

Returning to and continuing work is important to many cancer survivors, but also represents a challenge. We know little about subjective work outcomes and how cancer survivors perceive being returned to work. Therefore, we developed the Quality of Working Life Questionnaire for Cancer Survivors (QWLQ-CS). Our aim was to pre-test the items of the initial QWLQ-CS on acceptability and comprehensiveness. In addition, item retention was performed by pre-assessing the relevance scores and response distributions of the items in the QWLQ-CS. Semi-structured interviews were conducted after cancer survivors, who had returned to work, filled in the 102 items of the QWLQ-CS. To improve acceptability and comprehensiveness, the semi-structured interview inquired about items that were annoying, difficult, confusing, twofold or redundant. If cancer survivors had difficulty explaining their opinion or emotion about an item, the interviewer used verbal probing technique to investigate the cancer survivor's underlying thoughts. The cancer survivors' comments on the items were analysed, and items were revised accordingly. Decisions on item retention regarding the relevance of items and the response distributions were made by means of pre-set decision rules. The 19 cancer survivors (53 % male) had a mean age of 51 ± 11 years old. They were diagnosed between 2009 and 2013 with lymphoma, leukaemia, prostate cancer, breast cancer, or colon cancer. Acceptability of the QWLQ-CS was good - none of the items were annoying - but 73 items were considered difficult, confusing, twofold or redundant. To improve acceptability, for instance, the authors replaced the phrase 'disease' with 'health situation' in several items. Consequently, comprehensiveness was improved by the authors rephrasing and adjusting items by adding clarifying words, such as 'in the work situation'. The pre-assessment of the relevance scores resulted in a sufficient number of cancer survivors indicating the items as relevant to their quality of working life, and no evident indication for uneven response distributions. Therefore, all items were retained. The 104 items of the preliminary QWLQ-CS were found relevant, acceptable and comprehensible by cancer survivors who have returned to work. The QWLQ-CS is now suitable for larger sample sizes of cancer survivors, which is necessary to test the psychometric properties of this questionnaire.

Individuals with knee impairments identify items in need of clarification in the Patient Reported Outcomes Measurement Information System (PROMIS®) pain interference and physical function item banks - a qualitative study.

PubMed

Lynch, Andrew D; Dodds, Nathan E; Yu, Lan; Pilkonis, Paul A; Irrgang, James J

2016-05-11

The content and wording of the Patient Reported Outcome Measurement Information System (PROMIS) Physical Function and Pain Interference item banks have not been qualitatively assessed by individuals with knee joint impairments. The purpose of this investigation was to identify items in the PROMIS Physical Function and Pain Interference Item Banks that are irrelevant, unclear, or otherwise difficult to respond to for individuals with impairment of the knee and to suggest modifications based on cognitive interviews. Twenty-nine individuals with knee joint impairments qualitatively assessed items in the Pain Interference and Physical Function Item Banks in a mixed-methods cognitive interview. Field notes were analyzed to identify themes and frequency counts were calculated to identify items not relevant to individuals with knee joint impairments. Issues with clarity were identified in 23 items in the Physical Function Item Bank, resulting in the creation of 43 new or modified items, typically changing words within the item to be clearer. Interpretation issues included whether or not the knee joint played a significant role in overall health and age/gender differences in items. One quarter of the original items (31 of 124) in the Physical Function Item Bank were identified as irrelevant to the knee joint. All 41 items in the Pain Interference Item Bank were identified as clear, although individuals without significant pain substituted other symptoms which interfered with their life. The Physical Function Item Bank would benefit from additional items that are relevant to individuals with knee joint impairments and, by extension, to other lower extremity impairments. Several issues in clarity were identified that are likely to be present in other patient cohorts as well.

Development of Patient-reported Outcomes Measure of Pharmaceutical Therapy for Quality of Life (PROMPT-QoL): A novel instrument for medication management.

PubMed

Sakthong, Phantipa; Suksanga, Phattrapa; Sakulbumrungsil, Rungpetch; Winit-Watjana, Win

2015-01-01

Medicines can affect a patient's health-related quality of life (HRQoL), but there exists no standardized HRQoL measure for medication management. To develop the new HRQoL instrument "Patient-reported Outcomes Measure of Pharmaceutical Therapy for Quality of Life" (PROMPT-QoL), and to evaluate its content validity and preliminary psychometrics using a Rasch model. The PROMPT-QoL questionnaire was developed through the concept review, item generation, cognitive interviews, and initial psychometric evaluation. Its first draft was initially tested by Round-1 interviews of 120 adult outpatients taking their medicines at least three months continuously. The final draft with 43 items was then constructed and checked by 10 physicians and 5 pharmacists for the questionnaire importance and content validity. Round-2 interviews in six patient groups with 10 patients of each were conducted to elicit patients' understanding of the questionnaire and assess preliminary psychometrics using the Rasch analysis, including fit statistics, person and item reliabilities. The 43-item PROMPT-QoL comprised 10 domains: General Attitude toward Medication Use, Medicine Information, Disease Information, Medicine Effectiveness, Impacts of Medicines and Side-effects, Psychological Impacts of Medication Use, Convenience, Availability and Accessibility, Therapeutic Relationship with Healthcare Providers, and Overall QoL. Based on the patient interviews and expert review, the questionnaire was considered important, useful, and comprehensive. All items and domains yielded content validity indexes above the acceptable values of 0.80 and 0.90, respectively. In Round 2, thirty-nine problems identified in Group 1 were reduced to two issues in Group 6 after amendments. The Rasch analysis revealed eight items were misfit and two domains were reliable for both personal and item aspects (Medicine Information and Psychological Impacts of Medication Use). The newly developed PROMPT-QoL has favorable content validity and appropriate preliminary results. Further studies in large patient groups are required to test its complete psychometric properties. Copyright © 2015 Elsevier Inc. All rights reserved.

Development of short-form and screening cutoff point of the Smartphone Addiction Inventory (SPAI-SF).

PubMed

Lin, Yu-Hsuan; Pan, Yuan-Chien; Lin, Sheng-Hsuan; Chen, Sue-Huei

2017-06-01

Smartphone addiction is considered a form of technological addiction that has attracted increasing attention. The present study developed and validated the short-form Smartphone Addiction Inventory (SPAI-SF) and established cutoff point for screening smartphone addiction based on diagnostic criteria established by psychiatric interview. A total of 268 participants completed an online survey that collected demographic data, smartphone use behaviours, and responses to the 26-item SPAI. Each participant also completed a psychiatric interview. Confirmatory factor analysis (CFA) revealed that the 10-item SPAI-SF replicated the structure of original 26-item SPAI accurately, yielding a four-factor model consisting of compulsive behaviour, functional impairment, withdrawal, and tolerance. For maximal diagnostic accuracy, a cutoff point of 24/25 best discriminated cases of smartphone addiction from diagnostic negatives. The present findings suggest that both the 26-item SPAI and SPAI-SF manifest the four constructs of behavioural addiction and the characteristics of smartphone addiction. The cutoff point determined by psychiatrists' diagnostic interview will be useful for clinical screening and epidemiologic research. Copyright © 2016 John Wiley & Sons, Ltd.

Developing an item bank to measure economic quality of life for individuals with disabilities.

PubMed

Tulsky, David S; Kisala, Pamela A; Lai, Jin-Shei; Carlozzi, Noelle; Hammel, Joy; Heinemann, Allen W

2015-04-01

To develop and evaluate the psychometric properties of an item set measuring economic quality of life (QOL) for use by individuals with disabilities. Survey. Community settings. Individuals with disabilities completed individual interviews (n=64), participated in focus groups (n=172), and completed cognitive interviews (n=15). Inclusion criteria included the following: traumatic brain injury, spinal cord injury, or stroke; age ≥18 years; and ability to read and speak English. We calibrated the items with 305 former rehabilitation inpatients. None. Economic QOL. Confirmatory factor analysis showed acceptable fit indices (comparative fit index=.939, root mean square error of approximation=.089) for the 37 items. However, 3 items demonstrated local item dependence. Dropping 9 items improved fit and obviated local dependence. Rasch analysis of the remaining 28 items yielded a person reliability of .92, suggesting that these items discriminate about 4 economic QOL levels. We developed a 28-item bank that measures economic aspects of QOL. Preliminary confirmatory factor analysis and Rasch analysis results support the psychometric properties of this new measure. It fills a gap in health-related QOL measurement by describing the economic barriers and facilitators of community participation. Future development will make the item bank available as a computer adaptive test. Copyright © 2015 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.

Children's Disclosures of Sexual Abuse: Learning from Direct Inquiry

ERIC Educational Resources Information Center

Schaeffer, Paula; Leventhal, John M.; Asnes, Andrea Gottsegen

2011-01-01

Objectives: Published protocols for forensic interviewing for child sexual abuse do not include specific questions about what prompted children to tell about sexual abuse or what made them wait to tell. We, therefore, aimed to: (1) add direct inquiry about the process of a child's disclosure to a forensic interview protocol; (2) determine if…

Effects of video-feedback on the communication, clinical competence and motivational interviewing skills of practice nurses: a pre-test posttest control group study.

PubMed

Noordman, Janneke; van der Weijden, Trudy; van Dulmen, Sandra

2014-10-01

To examine the effects of individual video-feedback on the generic communication skills, clinical competence (i.e. adherence to practice guidelines) and motivational interviewing skills of experienced practice nurses working in primary care. Continuing professional education may be necessary to refresh and reflect on the communication and motivational interviewing skills of experienced primary care practice nurses. A video-feedback method was designed to improve these skills. Pre-test/posttest control group design. Seventeen Dutch practice nurses and 325 patients participated between June 2010-June 2011. Nurse-patient consultations were videotaped at two moments (T0 and T1), with an interval of 3-6 months. The videotaped consultations were rated using two protocols: the Maastrichtse Anamnese en Advies Scorelijst met globale items (MAAS-global) and the Behaviour Change Counselling Index. Before the recordings, nurses were allocated to a control or video-feedback group. Nurses allocated to the video-feedback group received video-feedback between T0 and T1. Data were analysed using multilevel linear or logistic regression. Nurses who received video-feedback appeared to pay significantly more attention to patients' request for help, their physical examination and gave significantly more understandable information. With respect to motivational interviewing, nurses who received video-feedback appeared to pay more attention to 'agenda setting and permission seeking' during their consultations. Video-feedback is a potentially effective method to improve practice nurses' generic communication skills. Although a single video-feedback session does not seem sufficient to increase all motivational interviewing skills, significant improvement in some specific skills was found. Nurses' clinical competences were not altered after feedback due to already high standards. © 2014 John Wiley & Sons Ltd.

The reliability of sensitive information provided by injecting drug users in a clinical setting: clinician-administered versus audio computer-assisted self-interviewing (ACASI).

PubMed

Islam, M Mofizul; Topp, Libby; Conigrave, Katherine M; van Beek, Ingrid; Maher, Lisa; White, Ann; Rodgers, Craig; Day, Carolyn A

2012-01-01

Research with injecting drug users (IDUs) suggests greater willingness to report sensitive and stigmatised behaviour via audio computer-assisted self-interviewing (ACASI) methods than during face-to-face interviews (FFIs); however, previous studies were limited in verifying this within the same individuals at the same time point. This study examines the relative willingness of IDUs to report sensitive information via ACASI and during a face-to-face clinical assessment administered in health services for IDUs. During recruitment for a randomised controlled trial undertaken at two IDU-targeted health services, assessments were undertaken as per clinical protocols, followed by referral of eligible clients to the trial, in which baseline self-report data were collected via ACASI. Five questions about sensitive injecting and sexual risk behaviours were administered to participants during both clinical interviews and baseline research data collection. "Percentage agreement" determined the magnitude of concordance/discordance in responses across interview methods, while tests appropriate to data format assessed the statistical significance of this variation. Results for all five variables suggest that, relative to ACASI, FFI elicited responses that may be perceived as more socially desirable. Discordance was statistically significant for four of the five variables examined. Participants who reported a history of sex work were more likely to provide discordant responses to at least one socially sensitive item. In health services for IDUs, information collection via ACASI may elicit more reliable and valid responses than FFI. Adoption of a universal precautionary approach to complement individually tailored assessment of and advice regarding health risk behaviours for IDUs may address this issue.

Developing an item bank to measure the coping strategies of people with hereditary retinal diseases.

PubMed

Prem Senthil, Mallika; Khadka, Jyoti; De Roach, John; Lamey, Tina; McLaren, Terri; Campbell, Isabella; Fenwick, Eva K; Lamoureux, Ecosse L; Pesudovs, Konrad

2018-05-05

Our understanding of the coping strategies used by people with visual impairment to manage stress related to visual loss is limited. This study aims to develop a sophisticated coping instrument in the form of an item bank implemented via Computerised adaptive testing (CAT) for hereditary retinal diseases. Items on coping were extracted from qualitative interviews with patients which were supplemented by items from a literature review. A systematic multi-stage process of item refinement was carried out followed by expert panel discussion and cognitive interviews. The final coping item bank had 30 items. Rasch analysis was used to assess the psychometric properties. A CAT simulation was carried out to estimate an average number of items required to gain precise measurement of hereditary retinal disease-related coping. One hundred eighty-nine participants answered the coping item bank (median age = 58 years). The coping scale demonstrated good precision and targeting. The standardised residual loadings for items revealed six items grouped together. Removal of the six items reduced the precision of the main coping scale and worsened the variance explained by the measure. Therefore, the six items were retained within the main scale. Our CAT simulation indicated that, on average, less than 10 items are required to gain a precise measurement of coping. This is the first study to develop a psychometrically robust coping instrument for hereditary retinal diseases. CAT simulation indicated that on an average, only four and nine items were required to gain measurement at moderate and high precision, respectively.

Reporting and methodological quality of meta-analyses in urological literature.

PubMed

Xia, Leilei; Xu, Jing; Guzzo, Thomas J

2017-01-01

To assess the overall quality of published urological meta-analyses and identify predictive factors for high quality. We systematically searched PubMed to identify meta-analyses published from January 1st, 2011 to December 31st, 2015 in 10 predetermined major paper-based urology journals. The characteristics of the included meta-analyses were collected, and their reporting and methodological qualities were assessed by the PRISMA checklist (27 items) and AMSTAR tool (11 items), respectively. Descriptive statistics were used for individual items as a measure of overall compliance, and PRISMA and AMSTAR scores were calculated as the sum of adequately reported domains. Logistic regression was used to identify predictive factors for high qualities. A total of 183 meta-analyses were included. The mean PRISMA and AMSTAR scores were 22.74 ± 2.04 and 7.57 ± 1.41, respectively. PRISMA item 5, protocol and registration, items 15 and 22, risk of bias across studies, items 16 and 23, additional analysis had less than 50% adherence. AMSTAR item 1, " a priori " design, item 5, list of studies and item 10, publication bias had less than 50% adherence. Logistic regression analyses showed that funding support and " a priori " design were associated with superior reporting quality, following PRISMA guideline and " a priori " design were associated with superior methodological quality. Reporting and methodological qualities of recently published meta-analyses in major paper-based urology journals are generally good. Further improvement could potentially be achieved by strictly adhering to PRISMA guideline and having " a priori " protocol.

Pancreatitis Quality of Life Instrument: Development of a new instrument

PubMed Central

Bova, Carol; Barton, Bruce; Hartigan, Celia

2014-01-01

Objectives: The goal of this project was to develop the first disease-specific instrument for the evaluation of quality of life in chronic pancreatitis. Methods: Focus groups and interview sessions were conducted, with chronic pancreatitis patients, to identify items felt to impact quality of life which were subsequently formatted into a paper-and-pencil instrument. This instrument was used to conduct an online survey by an expert panel of pancreatologists to evaluate its content validity. Finally, the modified instrument was presented to patients during precognitive testing interviews to evaluate its clarity and appropriateness. Results: In total, 10 patients were enrolled in the focus groups and interview sessions where they identified 50 items. Once redundant items were removed, the 40 remaining items were made into a paper-and-pencil instrument referred to as the Pancreatitis Quality of Life Instrument. Through the processes of content validation and precognitive testing, the number of items in the instrument was reduced to 24. Conclusions: This marks the development of the first disease-specific instrument to evaluate quality of life in chronic pancreatitis. It includes unique features not found in generic instruments (economic factors, stigma, and spiritual factors). Although this marks a giant step forward, psychometric evaluation is still needed prior to its clinical use. PMID:26770703

Development of an instrument designed to measure employees' perceptions of workplace breastfeeding support.

PubMed

Greene, Sally W; Olson, Beth H

2008-09-01

Breastfeeding rates remain low in the United States, especially among working women. Unfortunately, no quantitative instrument exists to facilitate the examination of why women who return to work discontinue breastfeeding sooner than the general population. The objective of this study was to develop an instrument to measure female employees' perceptions of breastfeeding support in the workplace, which would be suitable for piloting with the target population. Examination of the literature, reviews with experts, and one-on-one interviews with women who had experience combining breastfeeding and work were used to create the instrument subscales and items. Examination of the literature was used to develop four subscales: company policies/work culture, manager support, co-worker support, and workflow. Expert review resulted in the addition of a fifth subscale, the physical environment of the breastfeeding space. One-on-one interviews were used to ensure that the item wording was appropriate for the target population. Eighteen items were added, and 15 were reworded based on comments from the expert review and from the interviews. The resulting survey contained 54 items that required either categorical yes/no or Likert scale responses. Results from this process indicate the survey subscales and items adequately reflect women's perceptions of breastfeeding support in the workplace and the instrument is appropriate for piloting with new mother employees.

PRISMA-Children (C) and PRISMA-Protocol for Children (P-C) Extensions: a study protocol for the development of guidelines for the conduct and reporting of systematic reviews and meta-analyses of newborn and child health research.

PubMed

Kapadia, Mufiza Z; Askie, Lisa; Hartling, Lisa; Contopoulos-Ioannidis, Despina; Bhutta, Zulfiqar A; Soll, Roger; Moher, David; Offringa, Martin

2016-04-18

Paediatric systematic reviews differ from adult systematic reviews in several key aspects such as considerations of child tailored interventions, justifiable comparators, valid outcomes and child sensitive search strategies. Available guidelines, including PRISMA-P (2015) and PRISMA (2009), do not cover all the complexities associated with reporting systematic reviews in the paediatric population. Using a collaborative, multidisciplinary structure, we aim to develop evidence-based and consensus-based PRISMA-P-C (Protocol for Children) and PRISMA-C (Children) Extensions to guide paediatric systematic review protocol and completed review reporting. This project's methodology follows published recommendations for developing reporting guidelines and involves the following six phases; (1) establishment of a steering committee representing key stakeholder groups; (2) a scoping review to identify potential Extension items; (3) three types of consensus activities including meetings of the steering committee to achieve high-level decisions on the content and methodology of the Extensions, a survey of key stakeholders to generate a list of possible items to include in the Extensions and a formal consensus meeting to select the reporting items to add to, or modify for, the Extension; (4) the preliminary checklist items generated in phase III will be evaluated against the existing evidence and reporting practices in paediatric systematic reviews; (5) extension statements and explanation and elaboration documents will provide detailed advice for each item and examples of good reporting; (6) development and implementation of effective knowledge translation of the extension checklist, and an evaluation of the Extensions by key stakeholders. This protocol was considered a quality improvement project by the Hospital for Sick Children's Ethics Committee and did not require ethical review. The resultant checklists, jointly developed with all relevant stakeholders, will be disseminated through peer-reviewed journals as well as national and international conference presentations. Endorsement of the checklist will be sought simultaneously in multiple journals. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/

PRISMA-Children (C) and PRISMA-Protocol for Children (P-C) Extensions: a study protocol for the development of guidelines for the conduct and reporting of systematic reviews and meta-analyses of newborn and child health research

PubMed Central

Kapadia, Mufiza Z; Askie, Lisa; Hartling, Lisa; Contopoulos-Ioannidis, Despina; Bhutta, Zulfiqar A; Soll, Roger; Moher, David; Offringa, Martin

2016-01-01

Introduction Paediatric systematic reviews differ from adult systematic reviews in several key aspects such as considerations of child tailored interventions, justifiable comparators, valid outcomes and child sensitive search strategies. Available guidelines, including PRISMA-P (2015) and PRISMA (2009), do not cover all the complexities associated with reporting systematic reviews in the paediatric population. Using a collaborative, multidisciplinary structure, we aim to develop evidence-based and consensus-based PRISMA-P-C (Protocol for Children) and PRISMA-C (Children) Extensions to guide paediatric systematic review protocol and completed review reporting. Methods and analysis This project's methodology follows published recommendations for developing reporting guidelines and involves the following six phases; (1) establishment of a steering committee representing key stakeholder groups; (2) a scoping review to identify potential Extension items; (3) three types of consensus activities including meetings of the steering committee to achieve high-level decisions on the content and methodology of the Extensions, a survey of key stakeholders to generate a list of possible items to include in the Extensions and a formal consensus meeting to select the reporting items to add to, or modify for, the Extension; (4) the preliminary checklist items generated in phase III will be evaluated against the existing evidence and reporting practices in paediatric systematic reviews; (5) extension statements and explanation and elaboration documents will provide detailed advice for each item and examples of good reporting; (6) development and implementation of effective knowledge translation of the extension checklist, and an evaluation of the Extensions by key stakeholders. Ethics and Dissemination This protocol was considered a quality improvement project by the Hospital for Sick Children's Ethics Committee and did not require ethical review. The resultant checklists, jointly developed with all relevant stakeholders, will be disseminated through peer-reviewed journals as well as national and international conference presentations. Endorsement of the checklist will be sought simultaneously in multiple journals. PMID:27091820

An item response theory analysis of the Executive Interview and development of the EXIT8: A Project FRONTIER Study.

PubMed

Jahn, Danielle R; Dressel, Jeffrey A; Gavett, Brandon E; O'Bryant, Sid E

2015-01-01

The Executive Interview (EXIT25) is an effective measure of executive dysfunction, but may be inefficient due to the time it takes to complete 25 interview-based items. The current study aimed to examine psychometric properties of the EXIT25, with a specific focus on determining whether a briefer version of the measure could comprehensively assess executive dysfunction. The current study applied a graded response model (a type of item response theory model for polytomous categorical data) to identify items that were most closely related to the underlying construct of executive functioning and best discriminated between varying levels of executive functioning. Participants were 660 adults ages 40 to 96 years living in West Texas, who were recruited through an ongoing epidemiological study of rural health and aging, called Project FRONTIER. The EXIT25 was the primary measure examined. Participants also completed the Trail Making Test and Controlled Oral Word Association Test, among other measures, to examine the convergent validity of a brief form of the EXIT25. Eight items were identified that provided the majority of the information about the underlying construct of executive functioning; total scores on these items were associated with total scores on other measures of executive functioning and were able to differentiate between cognitively healthy, mildly cognitively impaired, and demented participants. In addition, cutoff scores were recommended based on sensitivity and specificity of scores. A brief, eight-item version of the EXIT25 may be an effective and efficient screening for executive dysfunction among older adults.

Development, content validity, and cross-cultural adaptation of a patient-reported outcome measure for real-time symptom assessment in irritable bowel syndrome.

PubMed

Vork, L; Keszthelyi, D; Mujagic, Z; Kruimel, J W; Leue, C; Pontén, I; Törnblom, H; Simrén, M; Albu-Soda, A; Aziz, Q; Corsetti, M; Holvoet, L; Tack, J; Rao, S S; van Os, J; Quetglas, E G; Drossman, D A; Masclee, A A M

2018-03-01

End-of-day questionnaires, which are considered the gold standard for assessing abdominal pain and other gastrointestinal (GI) symptoms in irritable bowel syndrome (IBS), are influenced by recall and ecological bias. The experience sampling method (ESM) is characterized by random and repeated assessments in the natural state and environment of a subject, and herewith overcomes these limitations. This report describes the development of a patient-reported outcome measure (PROM) based on the ESM principle, taking into account content validity and cross-cultural adaptation. Focus group interviews with IBS patients and expert meetings with international experts in the fields of neurogastroenterology & motility and pain were performed in order to select the items for the PROM. Forward-and-back translation and cognitive interviews were performed to adapt the instrument for the use in different countries and to assure on patients' understanding with the final items. Focus group interviews revealed 42 items, categorized into five domains: physical status, defecation, mood and psychological factors, context and environment, and nutrition and drug use. Experts reduced the number of items to 32 and cognitive interviewing after translation resulted in a few slight adjustments regarding linguistic issues, but not regarding content of the items. An ESM-based PROM, suitable for momentary assessment of IBS symptom patterns was developed, taking into account content validity and cross-cultural adaptation. This PROM will be implemented in a specifically designed smartphone application and further validation in a multicenter setting will follow. © 2017 John Wiley & Sons Ltd.

Using Localized Survey Items to Augment Standardized Benchmarking Measures: A LibQUAL+[TM] Study

ERIC Educational Resources Information Center

Thompson, Bruce; Cook, Colleen; Kyrillidou, Martha

2006-01-01

The LibQUAL+[TM] protocol solicits open-ended comments from users with regard to library service quality, gathers data on 22 core items, and, at the option of individual libraries, also garners ratings on five items drawn from a pool of more than 100 choices selected by libraries. In this article, the relationship of scores on these locally…

A learning activity to introduce undergraduate students to bioethics in human clinical research: a case study.

PubMed

Segarra, Ignacio; Gomez, Manuel

2014-12-01

We developed a pharmacology practicum assignment to introduce students to the research ethics and steps involved in a clinical trial. The assignment included literature review, critical analysis of bioethical situations, writing a study protocol and presenting it before a simulated ethics committee, a practice interview with a faculty member to obtain informed consent, and a student reflective assessment and self-evaluation. Students were assessed at various steps in the practicum; the learning efficiency of the activity was evaluated using an independent survey as well as students' reflective feedback. Most of the domains of Bloom's and Fink's taxonomies of learning were itemized and covered in the practicum. Students highly valued the translatability of theoretical concepts into practice as well as the approach to mimic professional practice. This activity was within a pharmacy program, but may be easily transferable to other medical or health sciences courses. © The Author(s) 2014.

Do communication training programs improve students' communication skills?--a follow-up study.

PubMed

Simmenroth-Nayda, Anne; Weiss, Cora; Fischer, Thomas; Himmel, Wolfgang

2012-09-05

Although it is taken for granted that history-taking and communication skills are learnable, this learning process should be confirmed by rigorous studies, such as randomized pre- and post-comparisons. The purpose of this paper is to analyse whether a communication course measurably improves the communicative competence of third-year medical students at a German medical school and whether technical or emotional aspects of communication changed differently. A sample of 32 randomly selected students performed an interview with a simulated patient before the communication course (pre-intervention) and a second interview after the course (post-intervention), using the Calgary-Cambridge Observation Guide (CCOG) to assess history taking ability. On average, the students improved in all of the 28 items of the CCOG. The 6 more technically-orientated communication items improved on average from 3.4 for the first interview to 2.6 in the second interview (p < 0.0001), the 6 emotional items from 2.7 to 2.3 (p = 0.023). The overall score for women improved from 3.2 to 2.5 (p = 0.0019); male students improved from 3.0 to 2.7 (n.s.). The mean interview time significantly increased from the first to the second interview, but the increase in the interview duration and the change of the overall score for the students' communication skills were not correlated (Pearson's r = 0.03; n.s.). Our communication course measurably improved communication skills, especially for female students. These improvements did not depend predominantly on an extension of the interview time. Obviously, "technical" aspects of communication can be taught better than "emotional" communication skills.

Use of the Environment and Policy Evaluation and Observation as a Self-Report Instrument (EPAO-SR) to measure nutrition and physical activity environments in child care settings: validity and reliability evidence.

PubMed

Ward, Dianne S; Mazzucca, Stephanie; McWilliams, Christina; Hales, Derek

2015-09-26

Early care and education (ECE) centers are important settings influencing young children's diet and physical activity (PA) behaviors. To better understand their impact on diet and PA behaviors as well as to evaluate public health programs aimed at ECE settings, we developed and tested the Environment and Policy Assessment and Observation - Self-Report (EPAO-SR), a self-administered version of the previously validated, researcher-administered EPAO. Development of the EPAO-SR instrument included modification of items from the EPAO, community advisory group and expert review, and cognitive interviews with center directors and classroom teachers. Reliability and validity data were collected across 4 days in 3-5 year old classrooms in 50 ECE centers in North Carolina. Center teachers and directors completed relevant portions of the EPAO-SR on multiple days according to a standardized protocol, and trained data collectors completed the EPAO for 4 days in the centers. Reliability and validity statistics calculated included percent agreement, kappa, correlation coefficients, coefficients of variation, deviations, mean differences, and intraclass correlation coefficients (ICC), depending on the response option of the item. Data demonstrated a range of reliability and validity evidence for the EPAO-SR instrument. Reporting from directors and classroom teachers was consistent and similar to the observational data. Items that produced strongest reliability and validity estimates included beverages served, outside time, and physical activity equipment, while items such as whole grains served and amount of teacher-led PA had lower reliability (observation and self-report) and validity estimates. To overcome lower reliability and validity estimates, some items need administration on multiple days. This study demonstrated appropriate reliability and validity evidence for use of the EPAO-SR in the field. The self-administered EPAO-SR is an advancement of the measurement of ECE settings and can be used by researchers and practitioners to assess the nutrition and physical activity environments of ECE settings.

New Faculty Interview Protocol.

ERIC Educational Resources Information Center

National Center on Postsecondary Teaching, Learning, and Assessment, University Park, PA.

This document is a protocol for interviewing new faculty to be used in conjunction with a new faculty survey as part of a project to create a profile of new faculty at U.S. colleges and universities. An introduction reports that the survey had been distributed to 5 schools (2 liberal arts colleges, a community college, a comprehensive univesity,…

Assessing Scientific Practices Using Machine-Learning Methods: How Closely Do They Match Clinical Interview Performance?

NASA Astrophysics Data System (ADS)

Beggrow, Elizabeth P.; Ha, Minsu; Nehm, Ross H.; Pearl, Dennis; Boone, William J.

2014-02-01

The landscape of science education is being transformed by the new Framework for Science Education (National Research Council, A framework for K-12 science education: practices, crosscutting concepts, and core ideas. The National Academies Press, Washington, DC, 2012), which emphasizes the centrality of scientific practices—such as explanation, argumentation, and communication—in science teaching, learning, and assessment. A major challenge facing the field of science education is developing assessment tools that are capable of validly and efficiently evaluating these practices. Our study examined the efficacy of a free, open-source machine-learning tool for evaluating the quality of students' written explanations of the causes of evolutionary change relative to three other approaches: (1) human-scored written explanations, (2) a multiple-choice test, and (3) clinical oral interviews. A large sample of undergraduates (n = 104) exposed to varying amounts of evolution content completed all three assessments: a clinical oral interview, a written open-response assessment, and a multiple-choice test. Rasch analysis was used to compute linear person measures and linear item measures on a single logit scale. We found that the multiple-choice test displayed poor person and item fit (mean square outfit >1.3), while both oral interview measures and computer-generated written response measures exhibited acceptable fit (average mean square outfit for interview: person 0.97, item 0.97; computer: person 1.03, item 1.06). Multiple-choice test measures were more weakly associated with interview measures (r = 0.35) than the computer-scored explanation measures (r = 0.63). Overall, Rasch analysis indicated that computer-scored written explanation measures (1) have the strongest correspondence to oral interview measures; (2) are capable of capturing students' normative scientific and naive ideas as accurately as human-scored explanations, and (3) more validly detect understanding than the multiple-choice assessment. These findings demonstrate the great potential of machine-learning tools for assessing key scientific practices highlighted in the new Framework for Science Education.

The Effect of Videotaping Students' Interviews with Patients for Interview Skill Education

PubMed Central

Lee, Woo Sung; Hwang, Ji Young; Lim, Ji Eun; Suh, Sang-Yeon; Park, Ki Heum

2013-01-01

Background The importance of communication between patients and physicians has been proven in many previous studies. The authors analyzed the effect of interview skill education through videotapes which recorded students' interviews with real patients in the outpatient department of family medicine. Methods This study was conducted with all students who chose the elective course of family medicine and one randomly selected student every week from an 'infectious internal medicine' class at Dongguk University Ilsan Hospital during the period from December 2008 to March 2011. All students performed a preliminary examination of a new patient at the outpatient department of family medicine. All consultations were videotaped. Feedback to the student was given on the same day by viewing the videotape together. After feedback, all students performed another preliminary examination of one new patient at the department of family medicine the same week. Three family medicine residents scored all videotapes using 10-item interview skill checklists. Many parts of the checklists were modified using the Arizona Clinical Interview Rating Scales. Results Thirty-three students participated. Of 10 items, nine showed increased scores after feedback. There was a significant change in four items after feedback: 'type of question' (before 2.36 ± 0.60, after 2.73 ± 0.72), 'timeline' (before 2.82 ± 0.68, after 3.18 ± 0.73), 'positive verbal reinforcement' (before 2.24 ± 0.56, after 2.61 ± 0.90), and the total score (before 21.70 ± 2.62, after 23.39 ± 3.13) (P < 0.05). Conclusion Giving feedback to medical school students on medical interview skills using videotapes of students' preliminary consultations with real patients in outpatient settings, was effective in improving the interview areas of 'type of question,' 'timeline,' 'positive verbal reinforcement,' and the total interview scores. PMID:23560207

Cognitive interviews guide design of a new CAM patient expectations questionnaire.

PubMed

Sherman, Karen J; Eaves, Emery R; Ritenbaugh, Cheryl; Hsu, Clarissa; Cherkin, Daniel C; Turner, Judith A

2014-01-25

No consistent relationship exists between pre-treatment expectations and therapeutic benefit from various complementary and alternative medicine (CAM) therapies in clinical trials. However, many different expectancy measures have been used in those studies, with no validated questionnaires clearly focused on CAM and pain. We undertook cognitive interviews as part of a process to develop and validate such a questionnaire. We reviewed questions about expectations of benefits of acupuncture, chiropractic, massage, or yoga for pain. Components of the questions - verbs, nouns, response options, terms and phrases describing back pain - were identified. Using seven different cognitive interview scripts, we conducted 39 interviews to evaluate how individuals with chronic low back pain understood these individual components in the context of expectancy questions for a therapy they had not yet received. Chosen items were those with the greatest agreement and least confusion among participants, and were closest to the meanings intended by the investigators. The questionnaire drafted for psychometric evaluation had 18 items covering various domains of expectancy. "Back pain" was the most consistently interpreted descriptor for this condition. The most understandable response options were 0-10 scales, a structure used throughout the questionnaire, with 0 always indicating no change, and 10 anchored with an absolute descriptor such as "complete relief". The use of words to describe midpoints was found to be confusing. The word "expect" held different and shifting meanings for participants. Thus paired items comparing "hope" and "realistically expect" were chosen to evaluate 5 different aspects of treatment expectations (back pain; back dysfunction and global effects; impact of back pain on specific areas of life; sleep, mood, and energy; coping). "Impact of back pain" on various areas of life was found to be a consistently meaningful concept, and more global than "interference". Cognitive interviews identified wordings with considerable agreement among both participants and investigators. Some items widely used in clinical studies had different meanings to participants than investigators, or were confusing to participants. The final 18-item questionnaire is undergoing psychometric evaluation with goals of streamlining as well as identifying best items for use when questionnaire length is constrained.

Development process of an assessment tool for disruptive behavior problems in cross-cultural settings: the Disruptive Behavior International Scale – Nepal version (DBIS-N)

PubMed Central

Burkey, Matthew D.; Ghimire, Lajina; Adhikari, Ramesh P.; Kohrt, Brandon A.; Jordans, Mark J. D.; Haroz, Emily; Wissow, Lawrence

2017-01-01

Systematic processes are needed to develop valid measurement instruments for disruptive behavior disorders (DBDs) in cross-cultural settings. We employed a four-step process in Nepal to identify and select items for a culturally valid assessment instrument: 1) We extracted items from validated scales and local free-list interviews. 2) Parents, teachers, and peers (n=30) rated the perceived relevance and importance of behavior problems. 3) Highly rated items were piloted with children (n=60) in Nepal. 4) We evaluated internal consistency of the final scale. We identified 49 symptoms from 11 scales, and 39 behavior problems from free-list interviews (n=72). After dropping items for low ratings of relevance and severity and for poor item-test correlation, low frequency, and/or poor acceptability in pilot testing, 16 items remained for the Disruptive Behavior International Scale—Nepali version (DBIS-N). The final scale had good internal consistency (α=0.86). A 4-step systematic approach to scale development including local participation yielded an internally consistent scale that included culturally relevant behavior problems. PMID:28093575

Translating questionnaire items for a multi-lingual worker population: the iterative process of translation and cognitive interviews with English-, Spanish-, and Chinese-speaking workers.

PubMed

Fujishiro, Kaori; Gong, Fang; Baron, Sherry; Jacobson, C Jeffery; DeLaney, Sheli; Flynn, Michael; Eggerth, Donald E

2010-02-01

The increasing ethnic diversity of the US workforce has created a need for research tools that can be used with multi-lingual worker populations. Developing multi-language questionnaire items is a complex process; however, very little has been documented in the literature. Commonly used English items from the Job Content Questionnaire and Quality of Work Life Questionnaire were translated by two interdisciplinary bilingual teams and cognitively tested in interviews with English-, Spanish-, and Chinese-speaking workers. Common problems across languages mainly concerned response format. Language-specific problems required more conceptual than literal translations. Some items were better understood by non-English speakers than by English speakers. De-centering (i.e., modifying the English original to correspond with translation) produced better understanding for one item. Translating questionnaire items and achieving equivalence across languages require various kinds of expertise. Backward translation itself is not sufficient. More research efforts should be concentrated on qualitative approaches to developing useful research tools. Published 2009 Wiley-Liss, Inc.

Survey Development to Assess College Students' Perceptions of the Campus Environment.

PubMed

Sowers, Morgan F; Colby, Sarah; Greene, Geoffrey W; Pickett, Mackenzie; Franzen-Castle, Lisa; Olfert, Melissa D; Shelnutt, Karla; Brown, Onikia; Horacek, Tanya M; Kidd, Tandalayo; Kattelmann, Kendra K; White, Adrienne A; Zhou, Wenjun; Riggsbee, Kristin; Yan, Wangcheng; Byrd-Bredbenner, Carol

2017-11-01

We developed and tested a College Environmental Perceptions Survey (CEPS) to assess college students' perceptions of the healthfulness of their campus. CEPS was developed in 3 stages: questionnaire development, validity testing, and reliability testing. Questionnaire development was based on an extensive literature review and input from an expert panel to establish content validity. Face validity was established with the target population using cognitive interviews with 100 college students. Concurrent-criterion validity was established with in-depth interviews (N = 30) of college students compared to surveys completed by the same 30 students. Surveys completed by college students from 8 universities (N = 1147) were used to test internal structure (factor analysis) and internal consistency (Cronbach's alpha). After development and testing, 15 items remained from the original 48 items. A 5-factor solution emerged: physical activity (4 items, α = .635), water (3 items, α = .773), vending (2 items, α = .680), healthy food (2 items, α = .631), and policy (2 items, α = .573). The mean total score for all universities was 62.71 (±11.16) on a 100-point scale. CEPS appears to be a valid and reliable tool for assessing college students' perceptions of their health-related campus environment.

Initial assessment of public perception and acceptance of Geothermal Energy applications in Çanakkale, NW Turkey.

NASA Astrophysics Data System (ADS)

Sedat Çetiner, Ziya; Çekiç, Osman; Ertekin, Can; Bakırcı, Mesut

2016-04-01

Growing need of energy in global scale has resulted in increasing number of research and development of renewable energy technologies. Turkey, being very rich in the renewable energy resources, has recently paid special attention to accelerate utilization of these resources to reduce the carbon based energy cost. Among these, Geothermal Energy resources in the country, mainly utilized in district heating and balneological applications, has been shifted toward harvesting electric energy in the shed of recent incentives. While these developments are happening at the policy level, the knowledge and the perception of the public is important to shape the future policies and acceptance of such resources in daily life. In light of these developments, the aim of this study is to identify and analyze the public awareness and acceptance mechanisms for the successful deployment of future and ongoing geothermal investments in Çanakkale region of the Biga Peninsula using geological, social and economic constraints in a well-defined questionnaire. The study employed a mixed method to explore the public perception. Mixed method studies involve qualitative and quantitative techniques and intends to explore an issue in-depth. Thus a sequential explanatory design was used to gather the public's perception. Exploratory design involves a qualitative study followed by a design of a quantitative survey and analysis. The researchers, firs, interviewed 24 college students about their knowledge and perceptions of geothermal resources using a semi-structured interview protocol. The protocol comprised of 8 open ended questions. With the help of the literature and the qualitative survey results, an item database with 51 questions were constructed. The initial survey and the items then were sent to 5 experts. Following the expert review, the survey was given its final form and the item numbers were dropped to 34. Then this survey was applied to a group of 100 college students. The survey also include descriptive information, such as level of education, students' residence, gender, etc. İt is important to note that the participants of the study were college students. This group was selected intentionally to explore the subject in depth, with the assumption that the college students might have more information about the energy resources than the general public. The results were analyzed using descriptive statistics. The results provided that the students did not have enough knowledge about geothermal resources and their economic use in Turkey. The next steps will involve a factor analysis and expanding the survey to the general public. Some recommendations also included in the study to inform the public on the use of geothermal resources in energy sector.

Wrong-Site Surgery, Retained Surgical Items, and Surgical Fires : A Systematic Review of Surgical Never Events.

PubMed

Hempel, Susanne; Maggard-Gibbons, Melinda; Nguyen, David K; Dawes, Aaron J; Miake-Lye, Isomi; Beroes, Jessica M; Booth, Marika J; Miles, Jeremy N V; Shanman, Roberta; Shekelle, Paul G

2015-08-01

Serious, preventable surgical events, termed never events, continue to occur despite considerable patient safety efforts. To examine the incidence and root causes of and interventions to prevent wrong-site surgery, retained surgical items, and surgical fires in the era after the implementation of the Universal Protocol in 2004. We searched 9 electronic databases for entries from 2004 through June 30, 2014, screened references, and consulted experts. Two independent reviewers identified relevant publications in June 2014. One reviewer used a standardized form to extract data and a second reviewer checked the data. Strength of evidence was established by the review team. Data extraction was completed in January 2015. Incidence of wrong-site surgery, retained surgical items, and surgical fires. We found 138 empirical studies that met our inclusion criteria. Incidence estimates for wrong-site surgery in US settings varied by data source and procedure (median estimate, 0.09 events per 10,000 surgical procedures). The median estimate for retained surgical items was 1.32 events per 10,000 procedures, but estimates varied by item and procedure. The per-procedure surgical fire incidence is unknown. A frequently reported root cause was inadequate communication. Methodologic challenges associated with investigating changes in rare events limit the conclusions of 78 intervention evaluations. Limited evidence supported the Universal Protocol (5 studies), education (4 studies), and team training (4 studies) interventions to prevent wrong-site surgery. Limited evidence exists to prevent retained surgical items by using data-matrix-coded sponge-counting systems (5 pertinent studies). Evidence for preventing surgical fires was insufficient, and intervention effects were not estimable. Current estimates for wrong-site surgery and retained surgical items are 1 event per 100,000 and 1 event per 10,000 procedures, respectively, but the precision is uncertain, and the per-procedure prevalence of surgical fires is not known. Root-cause analyses suggest the need for improved communication. Despite promising approaches and global Universal Protocol evaluations, empirical evidence for interventions is limited.

Evaluation of email alerts in practice: Part 2. Validation of the information assessment method.

PubMed

Pluye, Pierre; Grad, Roland M; Johnson-Lafleur, Janique; Bambrick, Tara; Burnand, Bernard; Mercer, Jay; Marlow, Bernard; Campbell, Craig

2010-12-01

The information assessment method (IAM) permits health professionals to systematically document the relevance, cognitive impact, use and health outcomes of information objects delivered by or retrieved from electronic knowledge resources. The companion review paper (Part 1) critically examined the literature, and proposed a 'Push-Pull-Acquisition-Cognition-Application' evaluation framework, which is operationalized by IAM. The purpose of the present paper (Part 2) is to examine the content validity of the IAM cognitive checklist when linked to email alerts. A qualitative component of a mixed methods study was conducted with 46 doctors reading and rating research-based synopses sent on email. The unit of analysis was a doctor's explanation of a rating of one item regarding one synopsis. Interviews with participants provided 253 units that were analysed to assess concordance with item definitions. The content relevance of seven items was supported. For three items, revisions were needed. Interviews suggested one new item. This study has yielded a 2008 version of IAM. © 2010 Blackwell Publishing Ltd.

Measuring quality of life in patients with head and neck cancer: Update of the EORTC QLQ-H&N Module, Phase III.

PubMed

Singer, Susanne; Araújo, Cláudia; Arraras, Juan Ignacio; Baumann, Ingo; Boehm, Andreas; Brokstad Herlofson, Bente; Castro Silva, Joaquim; Chie, Wei-Chu; Fisher, Sheila; Guntinas-Lichius, Orlando; Hammerlid, Eva; Irarrázaval, María Elisa; Jensen Hjermstad, Marianne; Jensen, Kenneth; Kiyota, Naomi; Licitra, Lisa; Nicolatou-Galitis, Ourania; Pinto, Monica; Santos, Marcos; Schmalz, Claudia; Sherman, Allen C; Tomaszewska, Iwona M; Verdonck de Leeuw, Irma; Yarom, Noam; Zotti, Paola; Hofmeister, Dirk

2015-09-01

The objective of this study was to pilot test an updated version of the European Organization for Research and Treatment of Cancer Quality of Life Questionnaire Head and Neck Module (EORTC QLQ-H&N60). Patients with head and neck cancer were asked to complete a list of 60 head and neck cancer-specific items comprising the updated EORTC head and neck module and the core questionnaire EORTC QLQ-C30. Debriefing interviews were conducted to identify any irrelevant items and confusing or upsetting wording. Interviews were performed with 330 patients from 17 countries, representing different head and neck cancer sites and treatments. Forty-one of the 60 items were retained according to the predefined EORTC criteria for module development, for another 2 items the wording was refined, and 17 items were removed. The preliminary EORTC QLQ-H&N43 can now be used in academic research. Psychometrics will be tested in a larger field study. © 2014 Wiley Periodicals, Inc.

Cross-national replication of the gender identity interview for children.

PubMed

Wallien, Madeleine S C; Quilty, Lena C; Steensma, Thomas D; Singh, Devita; Lambert, Susan L; Leroux, Annie; Owen-Anderson, Allison; Kibblewhite, Sarah J; Bradley, Susan J; Cohen-Kettenis, Peggy T; Zucker, Kenneth J

2009-11-01

We administered the Gender Identity Interview for Children, a 12-item child-informant measure, to children referred clinically for gender identity problems in Toronto, Ontario, Canada (N = 329) and Amsterdam, The Netherlands (N = 228) and 173 control children. Confirmatory factor analysis identified a Cognitive Gender Confusion factor (4 items) and an Affective Gender Confusion factor (8 items). Patients from both clinics had a significantly higher deviant total score than the controls, and the Dutch patients had a significantly higher deviant score than the Toronto patients. In this cross-national study, we are the first to report on the validity of this measure to discriminate children with gender identity disorder from controls outside of North America.

Development of the Knee Numeric-Entity Evaluation Score (KNEES-ACL): a condition-specific questionnaire.

PubMed

Comins, J D; Krogsgaard, M R; Brodersen, J

2013-10-01

Patient-related outcome measures (PROMs) are commonly used to gauge treatment effects in patients with anterior cruciate ligament (ACL) deficiency. Valid measures of specific conditions depend on relevant item content. While item content can be derived either from clinicians (face validity) or from patients, item relevance and comprehensiveness can only be confirmed by the patient (content validity). Focus group and single interviews were conducted with patients' pre- and post-ACL reconstruction in order to construct a condition-specific PROM for the target patients. One hundred fifty-seven items from a previously conducted literature search were used as a basis for content genesis. Content saturation was achieved after three focus groups and seven single interviews. Thirty-eight items from the literature search were directly endorsed, and five modified items were endorsed. Twelve new item themes with verbatim content emerged. Thus, a 55-item pilot PROM consisting of six conceptual domains was assembled. We have constructed a condition-specific PROM for measurement of surgical and non-surgical treatment effects on ACL deficiency. The instrument possesses face and content validity. A pilot survey to assess the psychometric properties will be performed using Rasch measurement theory. © 2013 John Wiley & Sons A/S. Published by John Wiley & Sons Ltd.

A randomized trial of mailed questionnaires versus telephone interviews: Response patterns in a survey

PubMed Central

Feveile, Helene; Olsen, Ole; Hogh, Annie

2007-01-01

Background Data for health surveys are often collected using either mailed questionnaires, telephone interviews or a combination. Mode of data collection can affect the propensity to refuse to respond and result in different patterns of responses. The objective of this paper is to examine and quantify effects of mode of data collection in health surveys. Methods A stratified sample of 4,000 adults residing in Denmark was randomised to mailed questionnaires or computer-assisted telephone interviews. 45 health-related items were analyzed; four concerning behaviour and 41 concerning self assessment. Odds ratios for more positive answers and more frequent use of extreme response categories (both positive and negative) among telephone respondents compared to questionnaire respondents were estimated. Tests were Bonferroni corrected. Results For the four health behaviour items there were no significant differences in the response patterns. For 32 of the 41 health self assessment items the response pattern was statistically significantly different and extreme response categories were used more frequently among telephone respondents (Median estimated odds ratio: 1.67). For a majority of these mode sensitive items (26/32), a more positive reporting was observed among telephone respondents (Median estimated odds ratio: 1.73). The overall response rate was similar among persons randomly assigned to questionnaires (58.1%) and to telephone interviews (56.2%). A differential nonresponse bias for age and gender was observed. The rate of missing responses was higher for questionnaires (0.73 – 6.00%) than for telephone interviews (0 – 0.51%). The "don't know" option was used more often by mail respondents (10 – 24%) than by telephone respondents (2 – 4%). Conclusion The mode of data collection affects the reporting of self assessed health items substantially. In epidemiological studies, the method effect may be as large as the effects under investigation. Caution is needed when comparing prevalences across surveys or when studying time trends. PMID:17592653

Development of disaster mental health guidelines through the Delphi process in Japan.

PubMed

Suzuki, Yuriko; Fukasawa, Maiko; Nakajima, Satomi; Narisawa, Tomomi; Kim, Yoshiharu

2012-07-02

The mental health community in Japan had started reviewing the country's disaster mental health guidelines before the Great East Japan Earthquake, aiming to revise them based on evidence and experience accumulated in the last decade. Given the wealth of experience and knowledge acquired in the field by many Japanese mental health professionals, we decided to develop the guidelines through systematic consensus building and selected the Delphi method. After a thorough literature review and focus group interviews, 96 items regarding disaster mental health were included in Delphi Round 1. Of 100 mental health professionals experienced in disaster response who were invited to participate, 97 agreed. The appropriateness of each statement was assessed by the participants using a Likert scale (1: extremely inappropriate, 9: very appropriate) and providing free comments in three rounds. Consensus by experts was defined as an average score of ≥7 for which ≥70% of participants assigned this score, and items reaching consensus were included in the final guidelines. Overall, of the 96 items (89 initially asked and 7 added items), 77 items were agreed on (46 items in Round 1, and 19 positive and 12 negative agreed on items in Round 2). In Round 2, three statements with which participants agreed most strongly were: 1) A protocol for emergency work structure and information flow should be prepared in normal times; 2) The mental health team should attend regular meetings on health and medicine to exchange information; and 3) Generally, it is recommended not to ask disaster survivors about psychological problems at the initial response but ask about their present worries and physical condition. Three statements with which the participants disagreed most strongly in this round were: 1) Individuals should be encouraged to provide detailed accounts of their experiences; 2) Individuals should be provided with education if they are interested in receiving it; and 3) Bad news should be withheld from distressed individuals for fear of causing more upset. Most items which achieved agreement in Round 1 were statements described in previous guidelines or publications, or statements regarding the basic attitude of human service providers. The revised guidelines were thus developed based on the collective wisdom drawn from Japanese practitioners' experience while also considering the similarities and differences from the international standards.

Redefining diagnostic symptoms of depression using Rasch analysis: testing an item bank suitable for DSM-V and computer adaptive testing.

PubMed

Mitchell, Alex J; Smith, Adam B; Al-salihy, Zerak; Rahim, Twana A; Mahmud, Mahmud Q; Muhyaldin, Asma S

2011-10-01

We aimed to redefine the optimal self-report symptoms of depression suitable for creation of an item bank that could be used in computer adaptive testing or to develop a simplified screening tool for DSM-V. Four hundred subjects (200 patients with primary depression and 200 non-depressed subjects), living in Iraqi Kurdistan were interviewed. The Mini International Neuropsychiatric Interview (MINI) was used to define the presence of major depression (DSM-IV criteria). We examined symptoms of depression using four well-known scales delivered in Kurdish. The Partial Credit Model was applied to each instrument. Common-item equating was subsequently used to create an item bank and differential item functioning (DIF) explored for known subgroups. A symptom level Rasch analysis reduced the original 45 items to 24 items of the original after the exclusion of 21 misfitting items. A further six items (CESD13 and CESD17, HADS-D4, HADS-D5 and HADS-D7, and CDSS3 and CDSS4) were removed due to misfit as the items were added together to form the item bank, and two items were subsequently removed following the DIF analysis by diagnosis (CESD20 and CDSS9, both of which were harder to endorse for women). Therefore the remaining optimal item bank consisted of 17 items and produced an area under the curve (AUC) of 0.987. Using a bank restricted to the optimal nine items revealed only minor loss of accuracy (AUC = 0.989, sensitivity 96%, specificity 95%). Finally, when restricted to only four items accuracy was still high (AUC was still 0.976; sensitivity 93%, specificity 96%). An item bank of 17 items may be useful in computer adaptive testing and nine or even four items may be used to develop a simplified screening tool for DSM-V major depressive disorder (MDD). Further examination of this item bank should be conducted in different cultural settings.

Reporting and methodological quality of meta-analyses in urological literature

PubMed Central

Xu, Jing

2017-01-01

Purpose To assess the overall quality of published urological meta-analyses and identify predictive factors for high quality. Materials and Methods We systematically searched PubMed to identify meta-analyses published from January 1st, 2011 to December 31st, 2015 in 10 predetermined major paper-based urology journals. The characteristics of the included meta-analyses were collected, and their reporting and methodological qualities were assessed by the PRISMA checklist (27 items) and AMSTAR tool (11 items), respectively. Descriptive statistics were used for individual items as a measure of overall compliance, and PRISMA and AMSTAR scores were calculated as the sum of adequately reported domains. Logistic regression was used to identify predictive factors for high qualities. Results A total of 183 meta-analyses were included. The mean PRISMA and AMSTAR scores were 22.74 ± 2.04 and 7.57 ± 1.41, respectively. PRISMA item 5, protocol and registration, items 15 and 22, risk of bias across studies, items 16 and 23, additional analysis had less than 50% adherence. AMSTAR item 1, “a priori” design, item 5, list of studies and item 10, publication bias had less than 50% adherence. Logistic regression analyses showed that funding support and “a priori” design were associated with superior reporting quality, following PRISMA guideline and “a priori” design were associated with superior methodological quality. Conclusions Reporting and methodological qualities of recently published meta-analyses in major paper-based urology journals are generally good. Further improvement could potentially be achieved by strictly adhering to PRISMA guideline and having “a priori” protocol. PMID:28439452

Development and validation of a new survey: Perceptions of Teaching as a Profession (PTaP)

NASA Astrophysics Data System (ADS)

Adams, Wendy

2017-01-01

To better understand the impact of efforts to train more science teachers such as the PhysTEC Project and to help with early identification of future teachers, we are developing the survey of Perceptions of Teaching as a Profession (PTaP) to measure students' views of teaching as a career, their interest in teaching and the perceived climate of physics departments towards teaching as a profession. The instrument consists of a series of statements which require a response using a 5-point Likert-scale and can be easily administered online. The survey items were drafted by a team of researchers and physics teacher candidates and then reviewed by an advisory committee of 20 physics teacher educators and practicing teachers. We conducted 27 interviews with both teacher candidates and non-teaching STEM majors. The survey was refined through an iterative process of student interviews and item clarification until all items were interpreted consistently and answered for consistent reasons. In this presentation the preliminary results from the student interviews as well as the results of item analysis and a factor analysis on 900 student responses will be shared.

Developing a customized multiple interview for dental school admissions.

PubMed

Gardner, Karen M

2014-04-01

From the early 1980s until recently, the University of British Columbia Faculty of Dentistry had employed the Canadian Dental Association (CDA) Structured Interview in its Phase 2 admissions process (with those applicants invited for interviews). While this structured interview had demonstrated reliability and validity, the Faculty of Dentistry came to believe that a multiple interview process using scenarios would help it better identify applicants who would match its mission. After a literature review that investigated such interview protocols as unstructured, semi-structured, computerized, and telephone formats, a multiple interview format was chosen. This format was seen as an emerging trend, with evidence that it has been deemed fairer by applicants, more reliable by interviewers, more difficult for applicants to provide set answers for the scenarios, and not to require as many interviewers as other formats. This article describes the process undertaken to implement a customized multiple interview format for admissions and reports these outcomes of the process: a smoothly running multiple interview; effective training protocols for staff, interviewers, and applicants; and reports from successful applicants and interviewers that they felt the multiple interview was a more reliable and fairer recruiting tool than other models.

To list or not to list? The value and detriment of freelisting in ethnobotanical studies.

PubMed

Zambrana, Narel Y Paniagua; Bussmann, Rainer W; Hart, Robbie E; Huanca, Araceli L Moya; Soria, Gere Ortiz; Vaca, Milton Ortiz; Álvarez, David Ortiz; Morán, Jorge Soria; Morán, María Soria; Chávez, Saúl; Moreno, Bertha Chávez; Moreno, Gualberto Chávez; Roca, Oscar; Siripi, Erlin

2018-04-01

Although freelisting and semi-structured interviews are widespread methods in ethnobotany, few studies quantitatively examine how these methods may bias results. Using a comprehensive ethnobotanical inventory of palm species, uses and names in the Chácobo tribe of Bolivia, we show that interviews elicit more items than freelists, but the effect is sensitive to sample size, item type and data categorization. This implies that even subtle methodological choices may greatly affect reported results.

Establishing the cultural equivalence of the Young Children’s Participation and Environment Measure (YC-PEM) for use in Singapore

PubMed Central

Lim, Chun Yi; Law, Mary; Khetani, Mary; Pollock, Nancy; Rosenbaum, Peter

2016-01-01

Aims Establishing the cultural equivalence of clinical assessments is critical to ensuring culturally competent care. Developed in North America, the Young Children’s Participation and Environment Measure (YC-PEM) is a caregiver questionnaire of participation in home, preschool, and community activities and perceptions of environmental impact on participation. The purpose of this study is to establish the cultural equivalence of YC-PEM content for use in Singapore. Methods We conducted semi-structured interviews with 10 early childhood and healthcare providers and cognitive interviews with 10 parents in Singapore to examine the relevance of original YC-PEM content (activities, environmental factors, item wording). Interviews were transcribed, summarized and categorized according to item, semantic, conceptual, and operational dimensions of the Applied Cultural Framework that served as a decision-making guide to keep, modify or delete the items. Results Providers and parents agreed on conceptual, item and semantic changes but less on operational changes. Significant changes were made to improve comprehension of the YC-PEM. Conclusions Despite using the same language, the majority of the YC-PEM items needed modification to be relevant to the Singapore culture. Cultural adaptation of the YC-PEM is important because there are cultural differences in children’s participation, their environments as well as the way people understand words. PMID:26642891

Adults Living with Type 2 Diabetes: Kept Personal Health Information Items as Expressions of Need

ERIC Educational Resources Information Center

Whetstone, Melinda

2013-01-01

This study investigated personal information behavior and information needs that 21 adults managing life with Type 2 diabetes identify explicitly and implicitly during discussions of item acquisition and use of health information items that are kept in their homes. Research drew upon a naturalistic lens, in that semi-structured interviews were…

Content validity--establishing and reporting the evidence in newly developed patient-reported outcomes (PRO) instruments for medical product evaluation: ISPOR PRO good research practices task force report: part 1--eliciting concepts for a new PRO instrument.

PubMed

Patrick, Donald L; Burke, Laurie B; Gwaltney, Chad J; Leidy, Nancy Kline; Martin, Mona L; Molsen, Elizabeth; Ring, Lena

2011-12-01

The importance of content validity in developing patient reported outcomes (PRO) instruments is stressed by both the US Food and Drug Administration and the European Medicines Agency. Content validity is the extent to which an instrument measures the important aspects of concepts that developers or users purport it to assess. A PRO instrument measures the concepts most significant and relevant to a patient's condition and its treatment. For PRO instruments, items and domains as reflected in the scores of an instrument should be important to the target population and comprehensive with respect to patient concerns. Documentation of target population input in item generation, as well as evaluation of patient understanding through cognitive interviewing, can provide the evidence for content validity. Developing content for, and assessing respondent understanding of, newly developed PRO instruments for medical product evaluation will be discussed in this two-part ISPOR PRO Good Research Practices Task Force Report. Topics include the methods for generating items, documenting item development, coding of qualitative data from item generation, cognitive interviewing, and tracking item development through the various stages of research and preparing this tracking for submission to regulatory agencies. Part 1 covers elicitation of key concepts using qualitative focus groups and/or interviews to inform content and structure of a new PRO instrument. Part 2 covers the instrument development process, the assessment of patient understanding of the draft instrument using cognitive interviews and steps for instrument revision. The two parts are meant to be read together. They are intended to offer suggestions for good practices in planning, executing, and documenting qualitative studies that are used to support the content validity of PRO instruments to be used in medical product evaluation. Copyright © 2011 International Society for Pharmacoeconomics and Outcomes Research (ISPOR). Published by Elsevier Inc. All rights reserved.

Development of the PedsQL™ Epilepsy Module: Focus group and cognitive interviews.

PubMed

Follansbee-Junger, Katherine W; Mann, Krista A; Guilfoyle, Shanna M; Morita, Diego A; Varni, James W; Modi, Avani C

2016-09-01

Youth with epilepsy have impaired health-related quality of life (HRQOL). Existing epilepsy-specific HRQOL measures are limited by not having parallel self- and parent-proxy versions, having a restricted age range, not being inclusive of children with developmental disabilities, or being too lengthy for use in a clinical setting. Generic HRQOL measures do not adequately capture the idiosyncrasies of epilepsy. The purpose of the present study was to develop items and content validity for the PedsQL™ Epilepsy Module. An iterative qualitative process of conducting focus group interviews with families of children with epilepsy, obtaining expert input, and conducting cognitive interviews and debriefing was utilized to develop empirically derived content for the instrument. Eleven health providers with expertise in pediatric epilepsy from across the country provided feedback on the conceptual model and content, including epileptologists, nurse practitioners, social workers, and psychologists. Ten pediatric patients (age 4-16years) with a diagnosis of epilepsy and 11 parents participated in focus groups. Thirteen pediatric patients (age 5-17years) and 17 parents participated in cognitive interviews. Focus groups, expert input, and cognitive debriefing resulted in 6 final domains including restrictions, seizure management, cognitive/executive functioning, social, sleep/fatigue, and mood/behavior. Patient self-report versions ranged from 30 to 33 items and parent proxy-report versions ranged from 26 to 33 items, with the toddler and young child versions having fewer items. Standardized qualitative methodology was employed to develop the items and content for the novel PedsQL™ Epilepsy Module. The PedsQL™ Epilepsy Module has the potential to enhance clinical decision-making in pediatric epilepsy by capturing and monitoring important patient-identified contributors to HRQOL. Copyright © 2016 Elsevier Inc. All rights reserved.

Preference-based Glaucoma-specific Health-related Quality of Life Instrument: Development of the Health Utility for Glaucoma.

PubMed

Muratov, Sergei; Podbielski, Dominik W; Kennedy, Kevin; Jack, Susan M; Pemberton, Julia; Ahmed, Iqbal Ike K; Baltaziak, Monika; Xie, Feng

2018-05-12

To develop a descriptive system for a glaucoma-specific preference-based health-related quality of life (HRQoL) instrument: the Health Utility for Glaucoma (HUG-5). The descriptive system was developed in two stages: item identification and item selection. A systematic literature review of HRQoL assessment of glaucoma was conducted using a comprehensive search strategy. Purposeful sampling was used to recruit patients with different clinical characteristics. Relevant items were presented to glaucoma patients through face-to-face, semi-structured interviews. Framework methodology was applied to analyze interview content. The recurring themes identified through an iterative content analysis represented topics of most importance and relevance to patients. These themes formed the domains of the HUG-5 descriptive system. Three versions of the descriptive system, differing in explanatory detail, were pilot tested using a focus group. The literature review identified 19 articles which contained 266 items. These items were included for the full text review and were used to develop an interview guide. From twelve patient interviews, 22 themes were identified and grouped into five domains that informed the five questions of the descriptive system. The HUG-5 measures visual discomfort, mobility, daily life activities, emotional well-being, and social activities. Each question has five response levels that range from "no problem" to "severe problem". The focus group comprised of seven additional patients unanimously preferred the version that contained detailed, specific examples to support each question. A 5-domain descriptive system of a glaucoma-specific preference-based instrument, the HUG-5, was developed and remains to be evaluated for validity and reliability in the glaucoma patient population.

Do communication training programs improve students’ communication skills? - a follow-up study

PubMed Central

2012-01-01

Background Although it is taken for granted that history-taking and communication skills are learnable, this learning process should be confirmed by rigorous studies, such as randomized pre- and post-comparisons. The purpose of this paper is to analyse whether a communication course measurably improves the communicative competence of third-year medical students at a German medical school and whether technical or emotional aspects of communication changed differently. Method A sample of 32 randomly selected students performed an interview with a simulated patient before the communication course (pre-intervention) and a second interview after the course (post-intervention), using the Calgary-Cambridge Observation Guide (CCOG) to assess history taking ability. Results On average, the students improved in all of the 28 items of the CCOG. The 6 more technically-orientated communication items improved on average from 3.4 for the first interview to 2.6 in the second interview (p < 0.0001), the 6 emotional items from 2.7 to 2.3 (p = 0.023). The overall score for women improved from 3.2 to 2.5 (p = 0.0019); male students improved from 3.0 to 2.7 (n.s.). The mean interview time significantly increased from the first to the second interview, but the increase in the interview duration and the change of the overall score for the students’ communication skills were not correlated (Pearson’s r = 0.03; n.s.). Conclusions Our communication course measurably improved communication skills, especially for female students. These improvements did not depend predominantly on an extension of the interview time. Obviously, “technical” aspects of communication can be taught better than “emotional” communication skills. PMID:22947372

The effect of computer-mediated administration on self-disclosure of problems on the addiction severity index.

PubMed

Butler, Stephen F; Villapiano, Albert; Malinow, Andrew

2009-12-01

People tend to disclose more personal information when communication is mediated through the use of a computer. This study was conducted to examine the impact of this phenomenon on the way respondents answer questions during computer-mediated, self-administration of the Addiction Severity Index (ASI) called the Addiction Severity Index-Multimedia Version((R)) (ASI-MV((R))). A sample of 142 clients in substance abuse treatment was administered the ASI via an interviewer and the computerized ASI-MV((R)), three to five days apart in a counterbalanced order. Seven composite scores were compared between the two test administrations using paired t-tests. Post hoc analyses examined interviewer effects. Comparisons of composite scores for each of the domains between the face-to-face administered and computer-mediated, self-administered ASI revealed that significantly greater problem severity was reported by clients in five of the seven domains during administration of the computer-mediated, self-administered version compared to the trained interviewer version. Item analyses identified certain items as responsible for significant differences, especially those asking clients to rate need for treatment. All items that were significantly different between the two modes of administration revealed greater problem severity reported on the ASI-MV((R)) as compared to the interview administered assessment. Post hoc analyses yielded significant interviewer effects on four of the five domains where differences were observed. These data support a growing literature documenting a tendency for respondents to be more self-disclosing in a computer-mediated format over a face-to-face interview. Differences in interviewer skill in establishing rapport may account for these observations.

Qualitative Development and Content Validation of the PROMIS Pediatric Sleep Health Items.

PubMed

Bevans, Katherine B; Meltzer, Lisa J; De La Motte, Anna; Kratchman, Amy; Viél, Dominique; Forrest, Christopher B

2018-04-25

To develop the Patient Reported Outcome Measurement Information System (PROMIS) Pediatric Sleep Health item pool and evaluate its content validity. Participants included 8 expert sleep clinician-researchers, 64 children ages 8-17 years, and 54 parents of children ages 5-17 years. We started with item concepts and expressions from the PROMIS Sleep Disturbance and Sleep Related Impairment adult measures. Additional pediatric sleep health concepts were generated by expert (n = 8), child (n = 28), and parent (n = 33) concept elicitation interviews and a systematic review of existing pediatric sleep health questionnaires. Content validity of the item pool was evaluated with item translatability review, readability analysis, and child (n = 36) and parent (n = 21) cognitive interviews. The final pediatric Sleep Health item pool includes 43 items that assess sleep disturbance (children's capacity to fall and stay asleep, sleep quality, dreams, and parasomnias) and sleep-related impairments (daytime sleepiness, low energy, difficulty waking up, and the impact of sleep and sleepiness on cognition, affect, behavior, and daily activities). Items are translatable and relevant and well understood by children ages 8-17 and parents of children ages 5-17. Rigorous qualitative procedures were used to develop and evaluate the content validity of the PROMIS Pediatric Sleep Health item pool. Once the item pool's psychometric properties are established, the scales will be useful for measuring children's subjective experiences of sleep.

Practitioner Perspective: Assessing Child-Care Quality with a Telephone Interview.

ERIC Educational Resources Information Center

Ponder, Karen W.

2001-01-01

Discusses findings that child care quality can be measured effectively and efficiently through telephone interview. Notes that interview items were more highly correlated to the materials composite than to the interaction composite of the Environment Ratings Scales. Describes situations where on-site observation is necessary. Suggests that one…

Structured assessment of current mental state in clinical practice: an international study of the reliability and validity of the Current Psychiatric State interview, CPS-50.

PubMed

Falloon, I R H; Mizuno, M; Murakami, M; Roncone, R; Unoka, Z; Harangozo, J; Pullman, J; Gedye, R; Held, T; Hager, B; Erickson, D; Burnett, K

2005-01-01

To develop a reliable standardized assessment of psychiatric symptoms for use in clinical practice. A 50-item interview, the Current Psychiatric State 50 (CPS-50), was used to assess 237 patients with a range of psychiatric diagnoses. Ratings were made by interviewers after a 2-day training. Comparisons of inter-rater reliability on each item and on eight clinical subscales were made across four international centres and between psychiatrists and non-psychiatrists. A principal components analysis was used to validate these clinical scales. Acceptable inter-rater reliability (intra-class coefficient > 0.80) was found for 46 of the 50 items, and for all eight subscales. There was no difference between centres or between psychiatrists and non-psychiatrists. The principal components analysis factors were similar to the clinical scales. The CPS-50 is a reliable standardized assessment of current mental status that can be used in clinical practice by all mental health professionals after brief training. Blackwell Munksgaard 2004

Does informed consent given by healthy individuals when enrolling in clinical research feel less voluntary than for ill individuals?

PubMed

Roberts, Laura; Kim, Jane Paik

2018-04-30

Clinical research is predicated ethically on the authentic voluntarism of individuals who choose to enroll in human studies. Existing literature has focused on aspects of informed consent for clinical research other than voluntarism. The objective of this study was to compare the perspectives of clinical research participants who are in good health and who are ill regarding voluntarism-related aspects of informed consent and to assess situational influences that enable voluntarism in the process of obtaining clinical research consent. A 23-item written survey, the Informed Consent Questionnaire (ICQ), was administered in a "piggyback" semi-structured interview study of ill and healthy volunteers enrolled in IRB-approved clinical research studies. A total of 150 (60 mentally ill, 43 physically ill, and 47 healthy) clinical research participants participated. Respondents expressed positive views of their experiences with the informed consent processes for their respective clinical research protocols and respondents strongly endorsed items related to voluntarism irrespective of their illness type (range of means = [3.9, 4.8]). Ill participants more highly endorsed items relating to informed consent conditions (mentally ill vs healthy: 0.54 on a 5-point scale, P value = 0.01) (physically ill vs. healthy: 0.47 on a 5-point scale, P value = 0.01). The favorable views of clinical research participants regarding their experience of giving informed consent to enroll in a study were not surprising. Contrary to our a priori hypothesis, healthy individuals did not feel as positively as their ill counterparts. Copyright © 2018 Elsevier Ltd. All rights reserved.

The Development and Preliminary Testing of an Instrument for Assessing Fatigue Self-management Outcomes in Patients With Advanced Cancer.

PubMed

Chan, Raymond Javan; Yates, Patsy; McCarthy, Alexandra L

Fatigue is one of the most distressing and commonly experienced symptoms in patients with advanced cancer. Although the self-management (SM) of cancer-related symptoms has received increasing attention, no research instrument assessing fatigue SM outcomes for patients with advanced cancer is available. The aim of this study was to describe the development and preliminary testing of an interviewer-administered instrument for assessing the frequency and perceived levels of effectiveness and self-efficacy associated with fatigue SM behaviors in patients with advanced cancer. The development and testing of the Self-efficacy in Managing Symptoms Scale-Fatigue Subscale for Patients With Advanced Cancer (SMSFS-A) involved a number of procedures: item generation using a comprehensive literature review and semistructured interviews, content validity evaluation using expert panel reviews, and face validity and test-retest reliability evaluation using pilot testing. Initially, 23 items (22 specific behaviors with 1 global item) were generated from the literature review and semistructured interviews. After 2 rounds of expert panel review, the final scale was reduced to 17 items (16 behaviors with 1 global item). Participants in the pilot test (n = 10) confirmed that the questions in this scale were clear and easy to understand. Bland-Altman analysis showed agreement of results over a 1-week interval. The SMSFS-A items were generated using multiple sources. This tool demonstrated preliminary validity and reliability. The SMSFS-A has the potential to be used for clinical and research purposes. Nurses can use this instrument for collecting data to inform the initiation of appropriate fatigue SM support for this population.

Measurement invariance across educational levels and gender in 12-item Zarit Burden Interview (ZBI) on caregivers of people with dementia.

PubMed

Lin, Chung-Ying; Ku, Li-Jung Elizabeth; Pakpour, Amir H

2017-11-01

The Zarit Burden Interview (ZBI) is a commonly used self-report to assess caregiver burden. A 12-item short form of the ZBI has been developed; however, its measurement invariance has not been examined across some different demographics. It is unclear whether different genders and educational levels of a population interpret the ZBI items similarly. Therefore, this study aimed to examine the measurement invariance of the 12-item ZBI across gender and educational levels in a Taiwanese sample. Caregivers who had a family member with dementia (n = 270) completed the ZBI through telephone interviews. Three confirmatory factor analysis (CFA) models were conducted: Model 1 was the configural model, Model 2 constrained all factor loadings, Model 3 constrained all factor loadings and item intercepts. Multiple group CFAs and the differential item functioning (DIF) contrast under Rasch analyses were used to detect measurement invariance across males (n = 100) and females (n = 170) and across educational levels of junior high schools and below (n = 86) and senior high schools and above (n = 183). The fit index differences between models supported the measurement invariance across gender and across educational levels (∆ comparative fit index (CFI) = -0.010 and 0.003; ∆ root mean square error of approximation (RMSEA) = -0.006 to 0.004). No substantial DIF contrast was found across gender and educational levels (value = -0.36 to 0.29). The ZBI is appropriate for combined use and for comparisons in caregivers across gender and different educational levels in Taiwan.

Development and study of self-efficacy scale in medication adherence among Iranian patients with hypertension

PubMed Central

Najimi, Arash; Mostafavi, Firoozeh; Sharifirad, Gholamreza; Golshiri, Parastoo

2017-01-01

BACKGROUND: This study was aimed at developing and studying the scale of self-efficacy in adherence to treatment in Iranian patients with hypertension. METHODS: A mix-method study was conducted on the two stages: in the first phase, a qualitative study was done using content analysis through deep and semi-structured interviews. After data analysis, the draft of tool was prepared. Items in the draft were selected based on the extracted concepts. In the second phase, validity and reliability of the instrument were implemented using a quantitative study. The prepared instrument in the first phase was studied among 612 participants. To test the construct validity and internal consistency, exploratory factor analysis and Cronbach's alpha were used, respectively. To study the validity of the final scale, the average score of self-efficacy in patients with controlled hypertension were compared with patients with uncontrolled hypertension. RESULTS: In overall, 16 patients were interviewed. Twenty-six items were developed to assess different concepts of self-efficacy. Concept-related items were extracted from interviews to study the face validity of the tool from patient's point of view. Four items were deleted because scored 0.79 in content validity. The mean of questionnaire content validity was 0.85. Items were collected in two factors with an eigenvalue >1. Four items were deleted with load factor <0.4. Reliability was 0.84 for the entire instrument. CONCLUSION: Self-efficacy scale in patients with hypertension is a valid and reliable instrument that can effectively evaluate the self-efficacy in medication adherence in the management of hypertension. PMID:29114551

Development of a family functioning scale for major depressive disorder.

PubMed

DiBenedetti, Dana Britt; Danchenko, Natalya; François, Clement; Lewis, Sandra; Davis, Kimberly H; Fehnel, Sheri E

2012-03-01

To better understand depression's impact on family functioning from the perspectives of patients with major depressive disorder (MDD) and their partners; to develop and test patient and partner versions of a new self-reported measure, the Depression and Family Functioning Scale (DFFS), for use in clinical trials. Concept elicitation interviews were conducted with 32 adults with clinician-diagnosed moderate-to-severe MDD and their respective partners. Twenty-six items were drafted to address relevant aspects of family functioning and were then tested and refined through two iterative sets of cognitive debriefing interviews, each conducted by the same pair of highly experienced researchers, including a licensed clinical psychologist. Depression negatively affects family functioning through poorer communication, increased conflicts, decreased family interaction, and decreased intimacy. No existing instrument measured all domains of interest, or had been rigorously developed and psychometrically validated in the target populations. The draft DFFS items generally tested well and only minor modifications were made to the items after the second set of interviews. Both patients and partners indicated that the final set of 15 DFFS items addresses all concepts of importance. The DFFS evaluates the impact of depression on family functioning and has the potential to provide important information that can facilitate a more comprehensive evaluation of new treatments in clinical trial settings. Although MDD severity was not confirmed with a standardized interview, in clinical practice in the US, MDD is generally not diagnosed with the use of a structured clinical interview or clinician-administered tool. In the current study, depression severity had little (if any) impact on the specific concepts elicited as being important to family functioning. In fact, patients with milder depression had more insight and were able to better articulate changes in family functioning with treatment.

Patient-Centered Research to Support the Development of the Symptoms of Major Depressive Disorder Scale (SMDDS): Initial Qualitative Research.

PubMed

McCarrier, Kelly P; Deal, Linda S; Abraham, Lucy; Blum, Steven I; Bush, Elizabeth Nicole; Martin, Mona L; Thase, Michael E; Coons, Stephen Joel

2016-04-01

Content valid, patient-reported outcome (PRO) measures of major depressive disorder (MDD) symptoms are needed to assess MDD treatment benefit. While a range of questionnaires are currently available to evaluate aspects of depression from the patient's perspective, their comprehensiveness and qualitative development histories are unclear. The objective of this study was to describe the process and results of the preliminary qualitative development of a new symptom-based PRO measure intended to assess treatment benefit in MDD clinical trials. Qualitative interviews were conducted with adult MDD patients in the USA who recently experienced a major depressive episode. Experienced interviewers conducted concept elicitation (CE) and cognitive interviews using semi-structured interview guides. The CE interview guide was used to elicit spontaneous reports of symptom experiences along with probing to further explore and confirm concepts. The cognitive interview guide was developed to evaluate concept relevance, understandability, and structure of the draft items, and to facilitate further instrument refinement. Forty patients participated in the CE interviews. A total of 3022 symptom codes, representing 84 different concepts were derived from the transcripts. Data from the CE interviews were considered alongside existing literature and clinical expert opinion during an item-generation process, leading to development of a preliminary version of the Symptoms of Major Depressive Disorder Scale (SMDDS). Fifteen patients participated in three waves of cognitive interviews, during which the SMDDS was further refined. The SMDDS is a 35-item PRO measure intended for use as an endpoint in MDD clinical trials to support medical product labeling. The SMDDS uses a 7-day recall period and verbal rating scales. It was developed in accordance with the US Food and Drug Administration (FDA)'s PRO Guidance and best practices. Qualitative interviews have provided evidence for content validity. Future quantitative studies will confirm the SMDDS's measurement properties and support FDA qualification.

Fourth-grade children's dietary recall accuracy is influenced by retention interval (target period and interview time).

PubMed

Baxter, Suzanne Domel; Hardin, James W; Guinn, Caroline H; Royer, Julie A; Mackelprang, Alyssa J; Smith, Albert F

2009-05-01

For a 24-hour dietary recall, two possible target periods are the prior 24 hours (24 hours immediately preceding the interview time) and previous day (midnight to midnight of the day before the interview), and three possible interview times are morning, afternoon, and evening. Target period and interview time determine the retention interval (elapsed time between to-be-reported meals and the interview), which, along with intervening meals, can influence reporting accuracy. The effects of target period and interview time on children's accuracy for reporting school meals during 24-hour dietary recalls were investigated. DESIGN AND SUBJECTS/SETTING: During the 2004-2005, 2005-2006, and 2006-2007 school years in Columbia, SC, each of 374 randomly selected fourth-grade children (96% African American) was observed eating two consecutive school meals (breakfast and lunch) and interviewed to obtain a 24-hour dietary recall using one of six conditions defined by crossing two target periods with three interview times. Each condition had 62 or 64 children (half boys). Accuracy for reporting school meals was quantified by calculating rates for omissions (food items observed eaten but unreported) and intrusions (food items reported eaten but unobserved); a measure of total inaccuracy combined errors for reporting food items and amounts. For each accuracy measure, analysis of variance was conducted with target period, interview time, their interaction, sex, interviewer, and school year in the model. There was a target-period effect and a target-period by interview-time interaction on omission rates, intrusion rates, and total inaccuracy (six P values <0.004). For prior-24-hour recalls compared to previous-day recalls, and for prior-24-hour recalls in the afternoon and evening compared to previous-day recalls in the afternoon and evening, omission rates were better by one third, intrusion rates were better by one half, and total inaccuracy was better by one third. To enhance children's dietary recall accuracy, target periods and interview times that minimize the retention interval should be chosen.

Suicide Risk Management Protocol in Post-Cardiac Arrest Survivors: Development, Feasibility, and Outcomes.

PubMed

Bucy, Rachel A; Hanisko, Kaitlyn A; Kamphuis, Lee A; Nallamothu, Brahmajee K; Iwashyna, Theodore J; Pfeiffer, Paul N

2017-03-01

Suicidal ideation is an important part of the spectrum of depression, but studies of outcomes after cardiac events often avoid asking about suicide as part of their assessment due to perceived resource constraints and the complexity of managing this finding. To describe the development, feasibility, and outcomes of a suicide risk management protocol implemented by research assistants administering the Patient Health Questionnaire Depression Scale (PHQ-9). Patients surviving in-hospital cardiac arrest at any Veterans Affairs hospital during 2014 to 2015 received PHQ-9 screening as a part of longitudinal telephone or mail interviews administered at 3, 6, 9, and 12 months after hospital discharge. Those who screened positive for suicidal ideation were administered a telephone risk assessment protocol. Fifty-five of 366 (15%) interviewed Veterans endorsed suicidal ideation according to the PHQ-9 on 82 of their completed interviews. Of those who endorsed suicidal ideation during their interview, 81% of interviews included passive suicidal ideation without intent or plan. Five (9%) patients were recommended to receive expedited follow-up with a mental health provider or suicide prevention coordinator located within their Veterans Affairs healthcare facility. In 50 (63%) interviews, the patient already had reliable resources, such as a mental health provider or the number to the Veterans Crisis Line. Suicidal ideation is common after in-hospital cardiac arrest, although most patients are at low risk. Addressing suicidal ideation in an observational research study is feasible, with a detailed protocol and research staff who can respond to incidents of high-risk suicidal ideation in collaboration with study clinicians.

Developing Teaching Strategies in the EHR Era: A Survey of GME Experts.

PubMed

Atwater, Amber R; Rudd, Mariah; Brown, Audrey; Wiener, John S; Benjamin, Robert; Lee, W Robert; Rosdahl, Jullia A

2016-10-01

There is limited information on the impact of widespread adoption of the electronic health record (EHR) on graduate medical education (GME). To identify areas of consensus by education experts, where the use of EHR impacts GME, with the goal of developing strategies and tools to enhance GME teaching and learning in the EHR environment. Information was solicited from experienced US physician educators who use EPIC EHR following 3 steps: 2 rounds of online surveys using the Delphi technique, followed by telephone interviews. The survey contained 3 stem questions and 52 items with Likert-scale responses. Consensus was defined by predetermined cutoffs. A second survey reassessed items for which consensus was not initially achieved. Common themes to improve GME in settings with an EHR were compiled from the telephone interviews. The panel included 19 physicians in 15 states in Round 1, 12 in Round 2, and 10 for the interviews. Ten items were found important for teaching and learning: balancing focus on EHR documentation with patient engagement achieved 100% consensus. Other items achieving consensus included adequate learning time, balancing EHR data with verbal history and physical examination, communicating clinical thought processes, hands-on EHR practice, minimizing data repetition, and development of shortcuts and templates. Teaching strategies incorporating both online software and face-to-face solutions were identified during the interviews. New strategies are needed for effective teaching and learning of residents and fellows, capitalizing on the potential of the EHR, while minimizing any unintended negative impact on medical education.

Updated Draft Protocol for the Evaluation of Bactericidal Activity of Hard, Non-porous Copper Containing Surface Products

EPA Pesticide Factsheets

This document describes the updated draft testing protocol recommended by the EPA to support the registration of copper-containing surface products (such as door knobs, or other items that are not intended for food contact) that bear sanitizer claims.

34 CFR 462.3 - What definitions apply?

Code of Federal Regulations, 2012 CFR

2012-07-01

... items across pre- and post-testing. Test administrator means an individual who is trained to administer... instructional time a student needs before post-testing. Violation of these protocols often invalidates the test... defined in the Act. Test means a standardized test, assessment, or instrument that has a formal protocol...

34 CFR 462.3 - What definitions apply?

Code of Federal Regulations, 2010 CFR

2010-07-01

... items across pre- and post-testing. Test administrator means an individual who is trained to administer... instructional time a student needs before post-testing. Violation of these protocols often invalidates the test... defined in the Act. Test means a standardized test, assessment, or instrument that has a formal protocol...

34 CFR 462.3 - What definitions apply?

Code of Federal Regulations, 2011 CFR

2011-07-01

... items across pre- and post-testing. Test administrator means an individual who is trained to administer... instructional time a student needs before post-testing. Violation of these protocols often invalidates the test... defined in the Act. Test means a standardized test, assessment, or instrument that has a formal protocol...

34 CFR 462.3 - What definitions apply?

Code of Federal Regulations, 2014 CFR

2014-07-01

... items across pre- and post-testing. Test administrator means an individual who is trained to administer... instructional time a student needs before post-testing. Violation of these protocols often invalidates the test... defined in the Act. Test means a standardized test, assessment, or instrument that has a formal protocol...

34 CFR 462.3 - What definitions apply?

Code of Federal Regulations, 2013 CFR

2013-07-01

... items across pre- and post-testing. Test administrator means an individual who is trained to administer... instructional time a student needs before post-testing. Violation of these protocols often invalidates the test... defined in the Act. Test means a standardized test, assessment, or instrument that has a formal protocol...

How I Learned to Design and Conduct Semi-Structured Interviews: An Ongoing and Continuous Journey

ERIC Educational Resources Information Center

Rabionet, Silvia E.

2011-01-01

Qualitative interviewing is a flexible and powerful tool to capture the voices and the ways people make meaning of their experience Learning to conduct semi-structure interviews requires the following six stages: (a) selecting the type of interview; (b) establishing ethical guidelines, (c) crafting the interview protocol; (d) conducting and…

Interviewing To Hire Competent Community College Faculty.

ERIC Educational Resources Information Center

Murray, John P.

1999-01-01

Focuses on improving the interview process as a critical step in hiring new faculty who will prove to be effective in the community college environment. Necessary considerations for preplanning, establishing an interview protocol, and developing interview questions are defined based upon a review of the literature. Contains 46 references. (TGO)

Pretest and refinement of items for alcohol highway safety surveys

DOT National Transportation Integrated Search

1984-05-30

This study summarizes the procedures employed in pre-testing a set of alcohol-highway safety questionnaire items. The procedures included conducting a set of focus groups and a series of telephone interviews on several forms of the questionnaires. Th...

Methodology for the development and calibration of the SCI-QOL item banks

PubMed Central

Tulsky, David S.; Kisala, Pamela A.; Victorson, David; Choi, Seung W.; Gershon, Richard; Heinemann, Allen W.; Cella, David

2015-01-01

Objective To develop a comprehensive, psychometrically sound, and conceptually grounded patient reported outcomes (PRO) measurement system for individuals with spinal cord injury (SCI). Methods Individual interviews (n = 44) and focus groups (n = 65 individuals with SCI and n = 42 SCI clinicians) were used to select key domains for inclusion and to develop PRO items. Verbatim items from other cutting-edge measurement systems (i.e. PROMIS, Neuro-QOL) were included to facilitate linkage and cross-population comparison. Items were field tested in a large sample of individuals with traumatic SCI (n = 877). Dimensionality was assessed with confirmatory factor analysis. Local item dependence and differential item functioning were assessed, and items were calibrated using the item response theory (IRT) graded response model. Finally, computer adaptive tests (CATs) and short forms were administered in a new sample (n = 245) to assess test-retest reliability and stability. Participants and Procedures A calibration sample of 877 individuals with traumatic SCI across five SCI Model Systems sites and one Department of Veterans Affairs medical center completed SCI-QOL items in interview format. Results We developed 14 unidimensional calibrated item banks and 3 calibrated scales across physical, emotional, and social health domains. When combined with the five Spinal Cord Injury – Functional Index physical function banks, the final SCI-QOL system consists of 22 IRT-calibrated item banks/scales. Item banks may be administered as CATs or short forms. Scales may be administered in a fixed-length format only. Conclusions The SCI-QOL measurement system provides SCI researchers and clinicians with a comprehensive, relevant and psychometrically robust system for measurement of physical-medical, physical-functional, emotional, and social outcomes. All SCI-QOL instruments are freely available on Assessment CenterSM. PMID:26010963

Methodology for the development and calibration of the SCI-QOL item banks.

PubMed

Tulsky, David S; Kisala, Pamela A; Victorson, David; Choi, Seung W; Gershon, Richard; Heinemann, Allen W; Cella, David

2015-05-01

To develop a comprehensive, psychometrically sound, and conceptually grounded patient reported outcomes (PRO) measurement system for individuals with spinal cord injury (SCI). Individual interviews (n=44) and focus groups (n=65 individuals with SCI and n=42 SCI clinicians) were used to select key domains for inclusion and to develop PRO items. Verbatim items from other cutting-edge measurement systems (i.e. PROMIS, Neuro-QOL) were included to facilitate linkage and cross-population comparison. Items were field tested in a large sample of individuals with traumatic SCI (n=877). Dimensionality was assessed with confirmatory factor analysis. Local item dependence and differential item functioning were assessed, and items were calibrated using the item response theory (IRT) graded response model. Finally, computer adaptive tests (CATs) and short forms were administered in a new sample (n=245) to assess test-retest reliability and stability. A calibration sample of 877 individuals with traumatic SCI across five SCI Model Systems sites and one Department of Veterans Affairs medical center completed SCI-QOL items in interview format. We developed 14 unidimensional calibrated item banks and 3 calibrated scales across physical, emotional, and social health domains. When combined with the five Spinal Cord Injury--Functional Index physical function banks, the final SCI-QOL system consists of 22 IRT-calibrated item banks/scales. Item banks may be administered as CATs or short forms. Scales may be administered in a fixed-length format only. The SCI-QOL measurement system provides SCI researchers and clinicians with a comprehensive, relevant and psychometrically robust system for measurement of physical-medical, physical-functional, emotional, and social outcomes. All SCI-QOL instruments are freely available on Assessment CenterSM.

Convergence of Scores on the Interview and Questionnaire Versions of the Eating Disorder Examination: A Meta-Analytic Review

ERIC Educational Resources Information Center

Berg, Kelly C.; Peterson, Carol B.; Frazier, Patricia; Crow, Scott J.

2011-01-01

Significant discrepancies have been found between interview- and questionnaire-based assessments of psychopathology; however, these studies have typically compared instruments with unmatched item content. The Eating Disorder Examination (EDE), a structured interview, and the questionnaire version of the EDE (EDE-Q) are considered the preeminent…

Readability and Comprehension of the Geriatric Depression Scale and PROMIS® Physical Function Items in Older African Americans and Latinos

PubMed Central

Paz, Sylvia H.; Jones, Loretta; Calderón, José L.; Hays, Ron D.

2016-01-01

Background Depression and physical function are especially important health domains for the elderly. The Geriatric Depression Scale (GDS) and the Patient-Reported Outcomes Measurement Information System (PROMIS®) Physical Function Item Bank are two surveys commonly used to measure these domains. It is unclear if these two instruments adequately measure these aspects of health in minority elderly. Objective To estimate the readability of the GDS and PROMIS® Physical Function items and to assess their comprehensibility by a sample of African American and Latino elderly. Methods Readability was estimated using the Flesch-Kincaid (F-K) and Flesch-Reading-Ease (FRE) formulae for English versions, and a Spanish adaptation of the FRE formula for the Spanish versions. Comprehension of the GDS and PROMIS items by minority elderly was evaluated with 30 cognitive interviews. Results Readability estimates of a number of items in English and Spanish of the GDS and PROMIS physical functioning items exceed the recommended 5th grade level, or were rated as fairly difficult, difficult, or very difficult to read. Cognitive interviews revealed that many participants felt that more than the two (yes/no) GDS response options were needed to answer the questions. Wording of several PROMIS items was considered confusing and responses potentially uninterpretable because they were based on physical aids. Conclusions Problems with item wording and response options of the GDS and PROMIS Physical Function items may negatively affect reliability and validity of measurement when used with minority elderly. PMID:27599978

Development of the multiple sclerosis (MS) early mobility impairment questionnaire (EMIQ).

PubMed

Ziemssen, Tjalf; Phillips, Glenn; Shah, Ruchit; Mathias, Adam; Foley, Catherine; Coon, Cheryl; Sen, Rohini; Lee, Andrew; Agarwal, Sonalee

2016-10-01

The Early Mobility Impairment Questionnaire (EMIQ) was developed to facilitate early identification of mobility impairments in multiple sclerosis (MS) patients. We describe the initial development of the EMIQ with a focus on the psychometric evaluation of the questionnaire using classical and item response theory methods. The initial 20-item EMIQ was constructed by clinical specialists and qualitatively tested among people with MS and physicians via cognitive interviews. Data from an observational study was used to make additional updates to the instrument based on exploratory factor analysis (EFA) and item response theory (IRT) analysis, and psychometric analyses were performed to evaluate the reliability and validity of the final instrument's scores and screening properties (i.e., sensitivity and specificity). Based on qualitative interview analyses, a revised 15-item EMIQ was included in the observational study. EFA, IRT and item-to-item correlation analyses revealed redundant items which were removed leading to the final nine-item EMIQ. The nine-item EMIQ performed well with respect to: test-retest reliability (ICC = 0.858); internal consistency (α = 0.893); convergent validity; and known-groups methods for construct validity. A cut-point of 41 on the 0-to-100 scale resulted in sufficient sensitivity and specificity statistics for viably identifying patients with mobility impairment. The EMIQ is a content valid and psychometrically sound instrument for capturing MS patients' experience with mobility impairments in a clinical practice setting. Additional research is suggested to further confirm the EMIQ's screening properties over time.

Development and psychometric evaluation of a women shift workers' reproductive health questionnaire: study protocol for a sequential exploratory mixed-method study.

PubMed

Nikpour, Maryam; Tirgar, Aram; Ebadi, Abbas; Ghaffari, Fatemeh; Firouzbakht, Mojgan; Hajiahmadi, Mahmod

2018-02-06

Although shift works is a certain treat for female reproductive health, but currently, there is no standardized instrument for measuring reproductive health among female shift workers. This study aims to develop and evaluate the psychometric properties of a Women Shift Workers' Reproductive Health Questionnaire (WSW-RHQ). This is a sequential exploratory mixed-method study with a qualitative and a quantitative phase. In the qualitative phase, semi-structured interviews will be held with female shift workers who live in Mazandaran Province, Iran, additionally, the literature review will be performed by searching electronic databases. Sampling will be done in different workplaces and with maximum variation respecting female shift workers' age and job and educational and different economic situation. Interview data will be analyzed using conventional content analysis and then, the primary item pool for the questionnaire will be developed. In the quantitative phase, we will evaluate the psychometric properties of the questionnaire, i.e. its face, content, construct as well as reliability via the internal consistency, stability. Finally, a scoring system will be developed for the questionnaire. The development of WSW-RHQ will facilitate the promotion and implementation of reproductive health interventions and assessment of their effectiveness. Other scholars can cross-culturally adapt and use the questionnaire according to their immediate contexts.

Rapid and Accurate Behavioral Health Diagnostic Screening: Initial Validation Study of a Web-Based, Self-Report Tool (the SAGE-SR)

PubMed Central

Purcell, Susan E; Rhea, Karen; Maier, Philip; First, Michael; Zweede, Lisa; Sinisterra, Manuela; Nunn, M Brad; Austin, Marie-Paule; Brodey, Inger S

2018-01-01

Background The Structured Clinical Interview for DSM (SCID) is considered the gold standard assessment for accurate, reliable psychiatric diagnoses; however, because of its length, complexity, and training required, the SCID is rarely used outside of research. Objective This paper aims to describe the development and initial validation of a Web-based, self-report screening instrument (the Screening Assessment for Guiding Evaluation-Self-Report, SAGE-SR) based on the Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition (DSM-5) and the SCID-5-Clinician Version (CV) intended to make accurate, broad-based behavioral health diagnostic screening more accessible within clinical care. Methods First, study staff drafted approximately 1200 self-report items representing individual granular symptoms in the diagnostic criteria for the 8 primary SCID-CV modules. An expert panel iteratively reviewed, critiqued, and revised items. The resulting items were iteratively administered and revised through 3 rounds of cognitive interviewing with community mental health center participants. In the first 2 rounds, the SCID was also administered to participants to directly compare their Likert self-report and SCID responses. A second expert panel evaluated the final pool of items from cognitive interviewing and criteria in the DSM-5 to construct the SAGE-SR, a computerized adaptive instrument that uses branching logic from a screener section to administer appropriate follow-up questions to refine the differential diagnoses. The SAGE-SR was administered to healthy controls and outpatient mental health clinic clients to assess test duration and test-retest reliability. Cutoff scores for screening into follow-up diagnostic sections and criteria for inclusion of diagnoses in the differential diagnosis were evaluated. Results The expert panel reduced the initial 1200 test items to 664 items that panel members agreed collectively represented the SCID items from the 8 targeted modules and DSM criteria for the covered diagnoses. These 664 items were iteratively submitted to 3 rounds of cognitive interviewing with 50 community mental health center participants; the expert panel reviewed session summaries and agreed on a final set of 661 clear and concise self-report items representing the desired criteria in the DSM-5. The SAGE-SR constructed from this item pool took an average of 14 min to complete in a nonclinical sample versus 24 min in a clinical sample. Responses to individual items can be combined to generate DSM criteria endorsements and differential diagnoses, as well as provide indices of individual symptom severity. Preliminary measures of test-retest reliability in a small, nonclinical sample were promising, with good to excellent reliability for screener items in 11 of 13 diagnostic screening modules (intraclass correlation coefficient [ICC] or kappa coefficients ranging from .60 to .90), with mania achieving fair test-retest reliability (ICC=.50) and other substance use endorsed too infrequently for analysis. Conclusions The SAGE-SR is a computerized adaptive self-report instrument designed to provide rigorous differential diagnostic information to clinicians. PMID:29572204

Conducting a successful residency research project.

PubMed

Barletta, Jeffrey F

2008-08-15

The residency research project can be a challenging endeavor for pharmacy residents since they typically have limited experience in this area. Furthermore, as the number of accredited residency programs has increased, so has the demand for preceptors with research experience. This review is intended to assist the resident and preceptor by providing steps and guidance with conducting a successful residency research project. Items such as idea generation, proposing the right type of project, departmental review, and project management skills are discussed and guidance with writing the research protocol is provided. Items that must be addressed in every research protocol are described and a generalized protocol template is presented. In addition, the institutional review board review process is described and tips and pointers for obtaining approval are included. Finally, useful tools and resources are provided that can be used up front or throughout each phase of the research project.

Reporting quality of randomized controlled trials in patients with HIV on antiretroviral therapy: a systematic review.

PubMed

Nagai, Kaori; Saito, Akiko M; Saito, Toshiki I; Kaneko, Noriyo

2017-12-28

To allow for correct evaluation of clinical trial results, readers require comprehensive, clear, and highly transparent information on the methodology used and the results obtained. This study aimed to evaluate the quality of reporting in articles on randomized controlled trials (RCTs) of antiretroviral therapy (ART) in the field of HIV/AIDS. We searched for original articles on RCTs of ART developed in the field of HIV/AIDS in PubMed database by 5 April 2016. Searched articles were divided into three groups based on the revision year in which the Consolidated Standards of Reporting Trials (CONSORT) guidelines were published: Period 1 (1996-2001); Period 2 (2002-2010); and Period 3 (2011-2016). We evaluated the articles using the reporting rates of the 37 items in the CONSORT 2010 checklist, five items in the protocol deviation, and the three items in the ethics. Fifty-two articles were extracted and included in this study. Many of the reporting rates calculated using the CONSORT 2010 checklist showed a significantly increasing trend over the successive periods (65% in Period 1, 67% in Period 2, 79% in Period 3; p < 0.0001). The items with reporting rates < 50% were "the presence or absence of a protocol change and the reason for such a change," "randomization and blinding," and "where the full trial protocol can be accessed." Reporting rates of deviations were as low as < 30%, while the reporting rates for patient compliance were the highest (>80% in Period 3) among the five items. The reporting rates for obtaining informed consent and approval by the ethics committee or institutional review board were high (>88%), regardless of the time period assessed. In terms of representative RCT articles in the field of HIV/AIDS, the reporting rate of the items defined by CONSORT was approximately 70%, improving over the successive CONSORT statement revision periods.

Initial constructs for patient-centered outcome measures to evaluate brain-computer interfaces.

PubMed

Andresen, Elena M; Fried-Oken, Melanie; Peters, Betts; Patrick, Donald L

2016-10-01

The authors describe preliminary work toward the creation of patient-centered outcome (PCO) measures to evaluate brain-computer interface (BCI) as an assistive technology (AT) for individuals with severe speech and physical impairments (SSPI). In Phase 1, 591 items from 15 existing measures were mapped to the International Classification of Functioning, Disability and Health (ICF). In Phase 2, qualitative interviews were conducted with eight people with SSPI and seven caregivers. Resulting text data were coded in an iterative analysis. Most items (79%) were mapped to the ICF environmental domain; over half (53%) were mapped to more than one domain. The ICF framework was well suited for mapping items related to body functions and structures, but less so for items in other areas, including personal factors. Two constructs emerged from qualitative data: quality of life (QOL) and AT. Component domains and themes were identified for each. Preliminary constructs, domains and themes were generated for future PCO measures relevant to BCI. Existing instruments are sufficient for initial items but do not adequately match the values of people with SSPI and their caregivers. Field methods for interviewing people with SSPI were successful, and support the inclusion of these individuals in PCO research. Implications for Rehabilitation Adapted interview methods allow people with severe speech and physical impairments to participate in patient-centered outcomes research. Patient-centered outcome measures are needed to evaluate the clinical implementation of brain-computer interface as an assistive technology.

A traffic light food labeling intervention increases consumer awareness of health and healthy choices at the point-of-purchase.

PubMed

Sonnenberg, Lillian; Gelsomin, Emily; Levy, Douglas E; Riis, Jason; Barraclough, Susan; Thorndike, Anne N

2013-10-01

We surveyed customers in a hospital cafeteria in Boston, Massachusetts before and after implementation of traffic light food labeling to determine the effect of labels on customers' awareness and purchase of healthy foods. Cafeteria items were identified as red (unhealthy), yellow (less healthy), or green (healthy). Customers were interviewed before (N=166) and after (N=223) labeling was implemented. Each respondent was linked to cash register data to determine the proportion of red, yellow, and green items purchased. Data were collected from February-April 2010. We compared responses to survey questions and mean proportion of red, yellow, and green items per transaction between customers interviewed during baseline and customers interviewed during the intervention. Survey response rate was 60%. Comparing responses during labeling intervention to baseline, more respondents identified health/nutrition as an important factor in their purchase (61% vs. 46%, p=0.004) and reported looking at nutrition information (33% vs. 15%, p<0.001). Respondents who noticed labels during the intervention and reported that labels influenced their purchases were more likely to purchase healthier items than respondents who did not notice labels (p<0.001 for both). Traffic light food labels prompted individuals to consider their health and to make healthier choices at point-of-purchase. © 2013.

Measuring burden in dementia caregivers: Confirmatory factor analysis for short forms of the Zarit Burden Interview.

PubMed

Lin, Chung-Ying; Wang, Jung-Der; Pai, Ming-Chyi; Ku, Li-Jung Elizabeth

To examine the psychometric properties of different short versions of the Zarit Burden Interview (ZBI), and to find an efficient and valid short version for clinical use among dementia caregivers. A total of 270 Taiwanese dementia caregivers filled out the full form of the ZBI, which contains 22 items. Using the 22-item ZBI, we used confirmatory factor analysis (CFA) to calculate the fit indices of all proposed short versions with various items to determine useful short versions. Additional associations between each useful short version and informal care hours, as well as subjective financial situations, were examined to understand their concurrent validity. Based on the CFA results, three short versions of the ZBI, performed excellently (4-item version: comparative fit index [CFI]=1.000, Tucker-Lewis index [TLI]=1.035, standardized root mean square residual [SRMR]=0.019, and root mean square error of approximation [RMSEA]=0.000; 8-item version: CFI=0.970, TLI=0.958, SRMR=0.045, and RMSEA=0.065; 12-item version: CFI=0.959, TLI=0.950, SRMR=0.053, and RMSEA=0.075). In addition, the 12-item ZBI, as compared with other versions, had a higher correlation with the number of informal care hours. The 12-item ZBI was also highly correlated with the original 22-item ZBI (r=0.952). We found the 12-item ZBI to be a promising measure for healthcare providers to assess the burden of dementia caregivers quickly and efficiently. Copyright © 2016 Elsevier Ireland Ltd. All rights reserved.

Convergence of scores on the interview and questionnaire versions of the Eating Disorder Examination: a meta-analytic review.

PubMed

Berg, Kelly C; Peterson, Carol B; Frazier, Patricia; Crow, Scott J

2011-09-01

Significant discrepancies have been found between interview- and questionnaire-based assessments of psychopathology; however, these studies have typically compared instruments with unmatched item content. The Eating Disorder Examination (EDE), a structured interview, and the questionnaire version of the EDE (EDE-Q) are considered the preeminent assessments of eating disorder symptoms and provide a unique opportunity to examine the concordance of interview- and questionnaire-based instruments with matched item content. The convergence of EDE and EDE-Q scores has been examined previously; however, past studies have been limited by small sample sizes and have not compared the convergence of scores across diagnostic groups. A meta-analysis of 16 studies was conducted to compare the convergence of EDE and EDE-Q scores across studies and diagnostic groups. With regard to the EDE and EDE-Q subscale scores, the overall correlation coefficient effect sizes ranged from .68 to .76. The overall Cohen's d effect sizes ranged from .31 to .62, with participants consistently scoring higher on the questionnaire. For the items measuring behavior frequency, the overall correlation coefficient effect sizes ranged from .37 to .55 for binge eating and .90 to .92 for compensatory behaviors. The overall Cohen's d effect sizes ranged from -0.16 to -0.22, with participants reporting more binge eating on the interview than in the questionnaire in 70% of the studies. These results suggest the interview and questionnaire assess similar constructs but should not be used interchangeably. Additional research is needed to examine the inconsistencies between binge frequency scores on the 2 instruments.

Assessing patient report of function: content validity of the Functional Performance Inventory-Short Form (FPI-SF) in patients with chronic obstructive pulmonary disease (COPD).

PubMed

Leidy, Nancy Kline; Hamilton, Alan; Becker, Karin

2012-01-01

The performance of daily activities is a major challenge for people with chronic obstructive pulmonary disease (COPD). The Functional Performance Inventory (FPI) was developed based on an analytical framework of functional status and qualitative interviews with COPD patients describing these difficulties. The 65-item FPI was reduced to a 32-item short form (SF) through a systematic process of qualitative and quantitative item reduction and formatted for greater clarity and ease of use. This study examined the content validity of the reduced, reformatted form of the instrument, the FPI-SF. Qualitative cognitive interviews were conducted with COPD patients recruited from three geographically diverse pulmonary clinics in the United States. Interviews were designed to assess respondent interpretation of the instrument, evaluate clarity and ease of completion, and identify any new activities participants found important and difficult to perform that were not represented by the existing items. Twenty subjects comprised the sample; 12 (60%) were male, 14 (70%) were Caucasian, the mean age was 63.0 ± 11.3 years, 12 (60%) were retired, the mean forced expiratory volume in 1 second (FEV(1)) was 1.5 ± 0.5 L, and the mean percent predicted FEV(1) was 48.4% ± 13.1%. Participants understood the FPI-SF as intended, including instructions, items, and response options. Two minor formatting changes were suggested to improve clarity of presentation. Participants found the content of the FPI-SF to be comprehensive, with items covering activities they felt were important and often difficult to perform. These results, together with its development history and previously tested quantitative properties, suggest that the FPI-SF is content valid for use in clinical studies of COPD.

Assessing patient report of function: content validity of the Functional Performance Inventory-Short Form (FPI-SF) in patients with chronic obstructive pulmonary disease (COPD)

PubMed Central

Leidy, Nancy Kline; Hamilton, Alan; Becker, Karin

2012-01-01

Purpose The performance of daily activities is a major challenge for people with chronic obstructive pulmonary disease (COPD). The Functional Performance Inventory (FPI) was developed based on an analytical framework of functional status and qualitative interviews with COPD patients describing these difficulties. The 65-item FPI was reduced to a 32-item short form (SF) through a systematic process of qualitative and quantitative item reduction and formatted for greater clarity and ease of use. This study examined the content validity of the reduced, reformatted form of the instrument, the FPI-SF. Patients and methods Qualitative cognitive interviews were conducted with COPD patients recruited from three geographically diverse pulmonary clinics in the United States. Interviews were designed to assess respondent interpretation of the instrument, evaluate clarity and ease of completion, and identify any new activities participants found important and difficult to perform that were not represented by the existing items. Results Twenty subjects comprised the sample; 12 (60%) were male, 14 (70%) were Caucasian, the mean age was 63.0 ± 11.3 years, 12 (60%) were retired, the mean forced expiratory volume in 1 second (FEV1) was 1.5 ± 0.5 L, and the mean percent predicted FEV1 was 48.4% ± 13.1%. Participants understood the FPI-SF as intended, including instructions, items, and response options. Two minor formatting changes were suggested to improve clarity of presentation. Participants found the content of the FPI-SF to be comprehensive, with items covering activities they felt were important and often difficult to perform. Conclusion These results, together with its development history and previously tested quantitative properties, suggest that the FPI-SF is content valid for use in clinical studies of COPD. PMID:22969295

Interviewing Youthful Suspects in Alleged Sex Crimes: A Descriptive Analysis

ERIC Educational Resources Information Center

Hershkowitz, Irit; Horowitz, Dvora; Lamb, Michael E.; Orbach, Yael; Sternberg, Kathleen J.

2004-01-01

Objective: To introduce and evaluate a structured interview protocol designed for investigative interviews of youthful alleged perpetrators of child sexual abuse. Method: Seventy-two alleged perpetrators ranging from 9 to 14 years of age (M=12 years) were interviewed by 1 of 13 experienced youth investigators, employed by the Israeli Ministry of…

78 FR 48683 - Announcement of Requirements and Registration for Million Hearts® Hypertension Control Challenge

Federal Register 2010, 2011, 2012, 2013, 2014

2013-08-09

.... The interview will include questions about the strategies employed by the individual or organization... protocol with the interviewer, respond to the interview questions, and review a summary data about the... participate in an interview to develop a success story that describes the systems and processes that support...

Automating individualized coaching and authentic role-play practice for brief intervention training.

PubMed

Hayes-Roth, B; Saker, R; Amano, K

2010-01-01

Brief intervention helps to reduce alcohol abuse, but there is a need for accessible, cost-effective training of clinicians. This study evaluated STAR Workshop , a web-based training system that automates efficacious techniques for individualized coaching and authentic role-play practice. We compared STAR Workshop to a web-based, self-guided e-book and a no-treatment control, for training the Engage for Change (E4C) brief intervention protocol. Subjects were medical and nursing students. Brief written skill probes tested subjects' performance of individual protocol steps, in different clinical scenarios, at three test times: pre-training, post-training, and post-delay (two weeks). Subjects also did live phone interviews with a standardized patient, post-delay. STAR subjects performed significantly better than both other groups. They showed significantly greater improvement from pre-training probes to post-training and post-delay probes. They scored significantly higher on post-delay phone interviews. STAR Workshop appears to be an accessible, cost-effective approach for training students to use the E4C protocol for brief intervention in alcohol abuse. It may also be useful for training other clinical interviewing protocols.

Qualitative Methods in the Development of a Bilingual and Bicultural Quality of Life Outcomes Measure for Pediatric Patients With Craniofacial Conditions.

PubMed

Tapia, Viridiana Juarez; Drizin, Julia Helene; Dalle Ore, Cecilia; Nieto, Marcelo; Romero, Yajahira; Magallon, Sandra; Nayak, Rohith; Sigler, Alicia; Malcarne, Vanessa; Gosman, Amanda

2017-05-01

Craniofacial surgeons treat patients with diverse craniofacial conditions (CFCs). Yet, little is known about the health-related quality of life (HRQoL) impact of diverse CFCs. Currently, there are no suitable instruments that measure the HRQoL of patients with diverse CFCs from the perspective of children and parents. The objective of this study was to develop the items and support the content validity of a comprehensive patient and parent-reported outcomes measure. An iterative process consisting of a systematic literature review, expert opinion and in-depth interviews with patients and parents of patients with diverse CFCs was used. The literature review and expert opinion were used to generate in-depth interview questions. We interviewed 127 subjects: 80 parents of patients ages 0 to 18 years or older and 47 patients ages 7 to 18 years or older. English and Spanish speakers were represented in our sample. The majority of subjects originated from the United States and Mexico (83%). Craniofacial conditions included were cleft lip/palate, craniosynostosis, craniofacial microsomia, microtia, and dermatological conditions. Semistructured interviews were conducted until content saturation was achieved. Line-by-line analysis of interview transcripts identified HRQoL themes. Themes were interpreted and organized into larger domains that represent the conceptual framework of CFC-associated HRQoL. Themes were operationalized into items that represent the HRQoL issues of patients for both parent and patient versions. Six final bilingual and bicultural scales based on the domains derived from the literature review, expert opinion, and in-depth interviews were developed: (1) "Social Impact," (2) "Psychological Function," (3) "Physical Function," (4) "Family Impact," (5) "Appearance," And (6) "Finding Meaning." Some cultural differences were identified: in contrast to children from Mexico and other developing nations, families from the United States did not report public harassment or extremely negative public reactions to patients' CFC. Religion and spirituality were common themes in interviews of Spanish-speaking subjects but less common in interviews of English-speaking subjects. Qualitative methods involving pediatric patients with diverse CFCs and their parents in the item development process support the content validity for this bilingual and bicultural HRQoL instrument. The items developed in this study will now undergo psychometric testing in national multisite studies for validation.

A Transcription and Translation Protocol for Sensitive Cross-Cultural Team Research.

PubMed

Clark, Lauren; Birkhead, Ana Sanchez; Fernandez, Cecilia; Egger, Marlene J

2017-10-01

Assurance of transcript accuracy and quality in interview-based qualitative research is foundational for data accuracy and study validity. Based on our experience in a cross-cultural ethnographic study of women's pelvic organ prolapse, we provide practical guidance to set up step-by-step interview transcription and translation protocols for team-based research on sensitive topics. Beginning with team decisions about level of detail in transcription, completeness, and accuracy, we operationalize the process of securing vendors to deliver the required quality of transcription and translation. We also share rubrics for assessing transcript quality and the team protocol for managing transcripts (assuring consistency of format, insertion of metadata, anonymization, and file labeling conventions) and procuring an acceptable initial translation of Spanish-language interviews. Accurate, complete, and systematically constructed transcripts in both source and target languages respond to the call for more transparency and reproducibility of scientific methods.

Proximity Analysis and the Structure of Organization in Free Recall.

ERIC Educational Resources Information Center

Friendly, Michael L.

A method for assessing the structure of organization was developed on the basis of the ordinal separation, or proximity, between pairs ot items in recall protocols over a series of trials. The proximity measure is based on the assumption, common to all indices of organization, that items which are coded together in subjective memory units will…

Factor analysis of the Zarit Burden Interview in family caregivers of patients with amyotrophic lateral sclerosis.

PubMed

Oh, Juyeon; Kim, Jung A

2018-02-01

The Zarit Burden Interview has been used in many studies to assess caregiver burden in family caregivers of patients with amyotrophic lateral sclerosis, but the factor structure of the Zarit Burden Interview in the caregivers of amyotrophic lateral sclerosis patients is unknown. The aim of this study was to explore the factor structure of the Zarit Burden Interview in family caregivers of amyotrophic lateral sclerosis patients using exploratory factor analysis. The exploratory factor analysis was performed using generalized least squares with oblique rotation in a sample of 202 family caregivers. Three factors had an eigenvalue greater than 1 and accounted for 60.33% of the total variance. The three factors were named as follows: (factor 1) "Social restrictions" (items 2, 3, and 10-15); (factor 2) "Self-criticism" (items 20-21); and (factor 3) "Anger and frustration" (items 1, 4-6, 9, and 16-19). The correlation between factors 1 and 3 was much higher (r = 0.79) than that between factors 1 and 2 (r = 0.14) or factors 2 and 3 (r = 0.15). The findings of this study enriched our understanding of several meaningful dimensions of the caregiving burden in caregivers of an amyotrophic lateral sclerosis population and provided opportunities for future intervention.

The Motivation and Pleasure Scale-Self-Report (MAP-SR): reliability and validity of a self-report measure of negative symptoms.

PubMed

Llerena, Katiah; Park, Stephanie G; McCarthy, Julie M; Couture, Shannon M; Bennett, Melanie E; Blanchard, Jack J

2013-07-01

The Clinical Assessment Interview for Negative Symptoms (CAINS) is an empirically developed interview measure of negative symptoms. Building on prior work, this study examined the reliability and validity of a self-report measure based on the CAINS-the Motivation and Pleasure Scale-Self-Report (MAP-SR)-that assesses the motivation and pleasure domain of negative symptoms. Thirty-seven participants with schizophrenia or schizoaffective disorder completed the 18-item MAP-SR, the CAINS, and other measures of functional outcome. Item analyses revealed three items that performed poorly. The revised 15-item MAP-SR demonstrated good internal consistency and convergent validity with the clinician-rated Motivation and Pleasure scale of the CAINS, as well as good discriminant validity, with little association with psychotic symptoms or depression/anxiety. MAP-SR scores were related to social anhedonia, social closeness, and clinician-rated social functioning. The MAP-SR is a promising self-report measure of severity of negative symptoms. Copyright © 2013 Elsevier Inc. All rights reserved.

The Manual Work Instability Scale: development and validation.

PubMed

Gilworth, G; Smyth, M G; Smith, J; Tennant, A

2016-06-01

Increasing awareness of the burden of absenteeism and reduced performance at work highlights the importance of early identification of individuals experiencing work instability (WI), a mismatch between functional and cognitive abilities and job demands. To develop and validate a screening questionnaire to measure WI in manual workers. Questionnaire items were generated via qualitative interviews with manual workers and a draft survey instrument was completed by workers in a variety of fields. Rasch analysis was used interactively to assess the psychometric aspects of the emerging scale, including unidimensionality and absence of item bias (differential item functioning). A total of 17 qualitative interviews generated 110 potential items for the questionnaire. The item set resolved to a 25-item scale, which satisfied model expectations (item residual mean = -0.13, SD = 1.04; person residual mean = -0.29, SD = 0.75), had good reliability (alpha = 0.86) and strict unidimensionality (t-test 7.5% confidence interval 3.8-11.2). The Manual Work Instability Scale is a short psychometrically robust questionnaire based on the concept of WI, which incorporates both musculoskeletal symptoms and relevant psychosocial factors. It may prove effective in screening and identifying WI in workers in predominantly physical occupations. © The Author 2016. Published by Oxford University Press on behalf of the Society of Occupational Medicine. All rights reserved. For Permissions, please email: journals.permissions@oup.com.

Practical quantum private query with better performance in resisting joint-measurement attack

NASA Astrophysics Data System (ADS)

Wei, Chun-Yan; Wang, Tian-Yin; Gao, Fei

2016-04-01

As a kind of practical protocol, quantum-key-distribution (QKD)-based quantum private queries (QPQs) have drawn lots of attention. However, joint-measurement (JM) attack poses a noticeable threat to the database security in such protocols. That is, by JM attack a malicious user can illegally elicit many more items from the database than the average amount an honest one can obtain. Taking Jacobi et al.'s protocol as an example, by JM attack a malicious user can obtain as many as 500 bits, instead of the expected 2.44 bits, from a 104-bit database in one query. It is a noticeable security flaw in theory, and would also arise in application with the development of quantum memories. To solve this problem, we propose a QPQ protocol based on a two-way QKD scheme, which behaves much better in resisting JM attack. Concretely, the user Alice cannot get more database items by conducting JM attack on the qubits because she has to send them back to Bob (the database holder) before knowing which of them should be jointly measured. Furthermore, JM attack by both Alice and Bob would be detected with certain probability, which is quite different from previous protocols. Moreover, our protocol retains the good characters of QKD-based QPQs, e.g., it is loss tolerant and robust against quantum memory attack.

Item generation and design testing of a questionnaire to assess degenerative joint disease-associated pain in cats.

PubMed

Zamprogno, Helia; Hansen, Bernie D; Bondell, Howard D; Sumrell, Andrea Thomson; Simpson, Wendy; Robertson, Ian D; Brown, James; Pease, Anthony P; Roe, Simon C; Hardie, Elizabeth M; Wheeler, Simon J; Lascelles, B Duncan X

2010-12-01

To determine the items (question topics) for a subjective instrument to assess degenerative joint disease (DJD)-associated chronic pain in cats and determine the instrument design most appropriate for use by cat owners. 100 randomly selected client-owned cats from 6 months to 20 years old. Cats were evaluated to determine degree of radiographic DJD and signs of pain throughout the skeletal system. Two groups were identified: high DJD pain and low DJD pain. Owner-answered questions about activity and signs of pain were compared between the 2 groups to define items relating to chronic DJD pain. Interviews with 45 cat owners were performed to generate items. Fifty-three cat owners who had not been involved in any other part of the study, 19 veterinarians, and 2 statisticians assessed 6 preliminary instrument designs. 22 cats were selected for each group; 19 important items were identified, resulting in 12 potential items for the instrument; and 3 additional items were identified from owner interviews. Owners and veterinarians selected a 5-point descriptive instrument design over 11-point or visual analogue scale formats. Behaviors relating to activity were substantially different between healthy cats and cats with signs of DJD-associated pain. Fifteen items were identified as being potentially useful, and the preferred instrument design was identified. This information could be used to construct an owner-based questionnaire to assess feline DJD-associated pain. Once validated, such a questionnaire would assist in evaluating potential analgesic treatments for these patients.

Development and content validation of a patient-reported endometriosis pain daily diary.

PubMed

van Nooten, Floortje E; Cline, Jennifer; Elash, Celeste A; Paty, Jean; Reaney, Matthew

2018-01-04

Endometriosis is a common gynecological disorder that causes inflammation and pelvic pain. Endometriosis-related pain is best captured with patient-reported outcome (PRO) measures, however, assessment of endometriosis-related pain in clinical trials has been difficult in the absence of a reliable and valid PRO instrument. We describe the development of the Endometriosis Pain Daily Diary (EPDD), an electronic PRO developed as a survey instrument to assess endometriosis-related pain and its impact on patients' lives. The EPDD was initially developed on the basis of an existing Endometriosis Pain and Bleeding Diary, a targeted review of relevant literature, clinical expert interviews, and open-ended (concept elicitation) patient interviews in the United States (US) and Japan which captured patients' experience with endometriosis. Cognitive interviews of patients with endometriosis were conducted to evaluate patient comprehension of the EPDD items. A conceptual model of endometriosis was developed, and meetings with US and European regulatory authorities provided feedback for validating the EPDD in the context of clinical trials. Translatability assessments of the EPDD were conducted to confirm its appropriate interpretation and ease of completion across 17 languages. The iterative development progressed through three versions of the instrument. The EPDDv1 included 18 items relating to dysmenorrhea/pelvic pain, dyspareunia and sexual activity, bleeding, hot flashes, daily activities, and use of rescue medication. The EPDDv2 was a larger 43-item survey tested in cognitive interviews and subsequently revised to yield the current 11-item EPDDv3, consisting of five core items relating to dysmenorrhea, non-menstrual pelvic pain, and dyspareunia, and six extension items relating to sexual activity, daily activities, and use of rescue medication. The EPDD is a PRO for the evaluation of endometriosis-related pain and its associated impacts on patients' lives. The EPDD represents an important step in providing a PRO that is relevant to patients with endometriosis-related pain in the context of a clinical study setting (ie, fit-for-purpose), designed to evaluate pain associated with endometriosis, including regulatory agency support for its further exploration in clinical trials.

The development and exploratory analysis of the Back Pain Attitudes Questionnaire (Back-PAQ)

PubMed Central

Darlow, Ben; Perry, Meredith; Mathieson, Fiona; Stanley, James; Melloh, Markus; Marsh, Reginald; Baxter, G David; Dowell, Anthony

2014-01-01

Objectives To develop an instrument to assess attitudes and underlying beliefs about back pain, and subsequently investigate its internal consistency and underlying structures. Design The instrument was developed by a multidisciplinary team of clinicians and researchers based on analysis of qualitative interviews with people experiencing acute and chronic back pain. Exploratory analysis was conducted using data from a population-based cross-sectional survey. Setting Qualitative interviews with community-based participants and subsequent postal survey. Participants Instrument development informed by interviews with 12 participants with acute back pain and 11 participants with chronic back pain. Data for exploratory analysis collected from New Zealand residents and citizens aged 18 years and above. 1000 participants were randomly selected from the New Zealand Electoral Roll. 602 valid responses were received. Measures The 34-item Back Pain Attitudes Questionnaire (Back-PAQ) was developed. Internal consistency was evaluated by the Cronbach α coefficient. Exploratory analysis investigated the structure of the data using Principal Component Analysis. Results The 34-item long form of the scale had acceptable internal consistency (α=0.70; 95% CI 0.66 to 0.73). Exploratory analysis identified five two-item principal components which accounted for 74% of the variance in the reduced data set: ‘vulnerability of the back’; ‘relationship between back pain and injury’; ‘activity participation while experiencing back pain’; ‘prognosis of back pain’ and ‘psychological influences on recovery’. Internal consistency was acceptable for the reduced 10-item scale (α=0.61; 95% CI 0.56 to 0.66) and the identified components (α between 0.50 and 0.78). Conclusions The 34-item long form of the scale may be appropriate for use in future cross-sectional studies. The 10-item short form may be appropriate for use as a screening tool, or an outcome assessment instrument. Further testing of the 10-item Back-PAQ's construct validity, reliability, responsiveness to change and predictive ability needs to be conducted. PMID:24860003

The Caregiver Burden Questionnaire for Heart Failure (CBQ-HF): face and content validity

PubMed Central

2013-01-01

Background A new caregiver burden questionnaire for heart failure (CBQ-HF v1.0) was developed based on previously conducted qualitative interviews with HF caregivers and with input from HF clinical experts. Version 1.0 of the CBQ-HF included 41 items measuring the burden associated with caregiving in the following domains: physical, emotional/psychological, social, and impact on caregiver’s life. Following initial development, the next stage was to evaluate caregivers’ understanding of the questionnaire items and their conceptual relevance. Methods To evaluate the face and content validity of the new questionnaire, cognitive interviews were conducted with caregivers of heart failure patients. The cognitive interviews included a “think aloud” exercise as the patient completed the CBQ-HF, followed by more specific probing questions to better understand caregivers’ understanding, interpretation and the relevance of the instructions, items, response scales and recall period. Results Eighteen caregivers of heart failure patients were recruited. The mean age of the caregivers was 50 years (SD = 10.2). Eighty-three percent of caregivers were female and most commonly the patient was either a spouse (44%) or a parent (28%). Among the patients 55% were NYHA Class 2 and 45% were NYHA Class 3 or 4. The caregiver cognitive interviews demonstrated that the CBQ-HF was well understood, relevant and consistently interpreted. From the initial 41 item questionnaire, fifteen items were deleted due to conceptual overlap and/or item redundancy. The final 26-item CBQ-HF (v3.0) uses a 5-point Likert severity scale, assessing 4 domains of physical, emotional/psychological, social and lifestyle burdens using a 4-week recall period. Conclusions The CBQ-HF (v3.0) is a comprehensive and relevant measure of subjective caregiver burden with strong content validity. This study has established that the CBQ-HF (v3.0) has strong face and content validity and should be valuable as an outcomes measure to help understand and monitor the relationship between patient heart failure severity and caregiver burden. A Translatability AssessmentSM of the measure has since been performed confirming the cultural appropriateness of the measure and psychometric validation is planned for the future to further explore the reliability, and validity of the new questionnaire in a larger caregiver sample. PMID:23706131

Qualitative development of a patient-reported outcome symptom measure in diarrhea-predominant irritable bowel syndrome.

PubMed

Marquis, P; Lasch, K E; Delgado-Herrera, L; Kothari, S; Lembo, A; Lademacher, C; Spears, G; Nishida, A; Tesler, Waldman L; Piault, E; Rosa, K; Zeiher, B

2014-06-26

Despite a documented clinical need, no patient reported outcome (PRO) symptom measure meeting current regulatory requirements for clinically relevant end points is available for the evaluation of treatment benefit in diarrhea-predominant IBS (IBS-D). Patients (N=113) with IBS-D participated in five study phases: (1) eight concept elicitation focus groups (N=34), from which a 17-item IBS-D Daily Symptom Diary and four-item IBS-D Symptom Event Log (Diary and Event Log) were developed; (2) one-on-one cognitive interviews (N=11) to assess the instrument's comprehensiveness, understandability, appropriateness, and readability; (3) four data triangulation focus groups (N=32) to confirm the concepts elicited; (4) two hybrid (concept elicitation and cognitive interview) focus groups (N=16); and (5) two iterative sets of one-on-one cognitive interviews (N=20) to further clarify the symptoms of IBS-D and debrief a revised seven-item Diary and four-item Event Log. Of thirty-six concepts initially identified, 22 were excluded because they were not saturated, not clinically relevant, not critical symptoms of IBS-D, considered upper GI symptoms, or too broad or vaguely defined. The remaining concepts were diarrhea, immediate need (urgency), bloating/pressure, frequency of bowel movements, cramps, abdominal/stomach pain, gas, completely emptied bowels/incomplete evacuation, accidents, bubbling in intestines (bowel sounds), rectal burning, stool consistency, rectal spasm, and pain while wiping. The final instrument included a daily diary with separate items for abdominal and stomach pain and an event log with four items completed after each bowel movement as follows: (1) a record of the bowel movement/event and an assessment of (2) severity of immediacy of need/bowel urgency, (3) incomplete evacuation, and (4) stool consistency (evaluated using the newly developed Astellas Stool Form Scale). Based on rounds of interviews and clinical input, items considered secondary or nonspecific to IBS-D (rectal burning, bubbling in intestines, spasms, and pain while wiping) were excluded. The IBS-D Symptom Diary and Event Log represent a rigorously developed PRO instrument for the measurement of the IBS-D symptom experience from the perspective of the patient. Its content validity has been supported, and future work should evaluate the instrument's psychometric properties.

Patients' general satisfaction with telephone counseling by pharmacists and effects on satisfaction with information and beliefs about medicines: Results from a cluster randomized trial.

PubMed

Kooy, Marcel Jan; Van Geffen, Erica C G; Heerdink, Eibert R; Van Dijk, Liset; Bouvy, Marcel L

2015-06-01

Assess effects of pharmacists' counseling by telephone on patients' satisfaction with counseling, satisfaction with information and beliefs about medicines for newly prescribed medicines. A cluster randomized trial in Dutch community pharmacies. Patients ≥18 years were included when starting with antidepressants, bisphosphonates, RAS-inhibitors or statins. The intervention comprised counseling by telephone to address barriers to adherent behavior. It was supported by an interview protocol. Controls received usual care. Outcomes were effects on beliefs about medication, satisfaction with information and counseling. Data was collected with a questionnaire. Responses of 211 patients in nine pharmacies were analyzed. More intervention arm patients were satisfied with counseling (adj. OR 2.2 (95% CI 1.3, 3.6)). Patients with counseling were significantly more satisfied with information on 4 items, had less concerns and less frequently had a 'skeptical' attitude towards medication (adj. OR 0.5 (0.3-0.9)). Effects on most outcomes were more pronounced in men than in women. Telephone counseling by pharmacists improved satisfaction with counseling and satisfaction with information on some items. It had a small effect on beliefs about medicines. Pharmacists can use counseling by telephone, but more research is needed to find out which patients benefit most. Copyright © 2015 Elsevier Ireland Ltd. All rights reserved.

Readability and Comprehension of the Geriatric Depression Scale and PROMIS® Physical Function Items in Older African Americans and Latinos.

PubMed

Paz, Sylvia H; Jones, Loretta; Calderón, José L; Hays, Ron D

2017-02-01

Depression and physical function are particularly important health domains for the elderly. The Geriatric Depression Scale (GDS) and the Patient-Reported Outcomes Measurement Information System (PROMIS ® ) physical function item bank are two surveys commonly used to measure these domains. It is unclear if these two instruments adequately measure these aspects of health in minority elderly. The aim of this study was to estimate the readability of the GDS and PROMIS ® physical function items and to assess their comprehensibility using a sample of African American and Latino elderly. Readability was estimated using the Flesch-Kincaid and Flesch Reading Ease (FRE) formulae for English versions, and a Spanish adaptation of the FRE formula for the Spanish versions. Comprehension of the GDS and PROMIS ® items by minority elderly was evaluated with 30 cognitive interviews. Readability estimates of a number of items in English and Spanish of the GDS and PROMIS ® physical functioning items exceed the U.S. recommended 5th-grade threshold for vulnerable populations, or were rated as 'fairly difficult', 'difficult', or 'very difficult' to read. Cognitive interviews revealed that many participants felt that more than the two (yes/no) GDS response options were needed to answer the questions. Wording of several PROMIS ® items was considered confusing, and interpreting responses was problematic because they were based on using physical aids. Problems with item wording and response options of the GDS and PROMIS ® physical function items may reduce reliability and validity of measurement when used with minority elderly.

Preliminary development of an ultrabrief two-item bedside test for delirium.

PubMed

Fick, Donna M; Inouye, Sharon K; Guess, Jamey; Ngo, Long H; Jones, Richard N; Saczynski, Jane S; Marcantonio, Edward R

2015-10-01

Delirium is common, morbid, and costly, yet is greatly under-recognized among hospitalized older adults. To identify the best single and pair of mental status test items that predict the presence of delirium. Diagnostic test evaluation study that enrolled medicine inpatients aged 75 years or older at an academic medical center. Patients underwent a clinical reference standard assessment involving a patient interview, medical record review, and interviews with family members and nurses to determine the presence or absence of Diagnostic and Statistical Manual of Mental Disorders, 4th Edition defined delirium. Participants also underwent the three-dimensional Confusion Assessment Method (3D-CAM), a brief, validated assessment for delirium. Individual items and pairs of items from the 3D-CAM were evaluated to determine sensitivity and specificity relative to the reference standard delirium diagnosis. Of the 201 participants (mean age 84 years, 62% female), 42 (21%) had delirium based on the clinical reference standard. The single item with the best test characteristics was "months of the year backwards" with a sensitivity of 83% (95% confidence interval [CI]: 69%-93%) and specificity of 69% (95% CI: 61%-76%). The best 2-item screen was the combination of "months of the year backwards" and "what is the day of the week?" with a sensitivity of 93% (95% CI: 81%-99%) and specificity of 64% (95% CI: 56%-70%). We identified a single item with >80% and pair of items with >90% sensitivity for delirium. If validated prospectively, these items will serve as an initial innovative screening step for delirium identification in hospitalized older adults. © 2015 Society of Hospital Medicine.

Development of six PROMIS pediatrics proxy-report item banks

PubMed Central

2012-01-01

Background Pediatric self-report should be considered the standard for measuring patient reported outcomes (PRO) among children. However, circumstances exist when the child is too young, cognitively impaired, or too ill to complete a PRO instrument and a proxy-report is needed. This paper describes the development process including the proxy cognitive interviews and large-field-test survey methods and sample characteristics employed to produce item parameters for the Patient Reported Outcomes Measurement Information System (PROMIS) pediatric proxy-report item banks. Methods The PROMIS pediatric self-report items were converted into proxy-report items before undergoing cognitive interviews. These items covered six domains (physical function, emotional distress, social peer relationships, fatigue, pain interference, and asthma impact). Caregivers (n = 25) of children ages of 5 and 17 years provided qualitative feedback on proxy-report items to assess any major issues with these items. From May 2008 to March 2009, the large-scale survey enrolled children ages 8-17 years to complete the self-report version and caregivers to complete the proxy-report version of the survey (n = 1548 dyads). Caregivers of children ages 5 to 7 years completed the proxy report survey (n = 432). In addition, caregivers completed other proxy instruments, PedsQL™ 4.0 Generic Core Scales Parent Proxy-Report version, PedsQL™ Asthma Module Parent Proxy-Report version, and KIDSCREEN Parent-Proxy-52. Results Item content was well understood by proxies and did not require item revisions but some proxies clearly noted that determining an answer on behalf of their child was difficult for some items. Dyads and caregivers of children ages 5-17 years old were enrolled in the large-scale testing. The majority were female (85%), married (70%), Caucasian (64%) and had at least a high school education (94%). Approximately 50% had children with a chronic health condition, primarily asthma, which was diagnosed or treated within 6 months prior to the interview. The PROMIS proxy sample scored similar or better on the other proxy instruments compared to normative samples. Conclusions The initial calibration data was provided by a diverse set of caregivers of children with a variety of common chronic illnesses and racial/ethnic backgrounds. The PROMIS pediatric proxy-report item banks include physical function (mobility n = 23; upper extremity n = 29), emotional distress (anxiety n = 15; depressive symptoms n = 14; anger n = 5), social peer relationships (n = 15), fatigue (n = 34), pain interference (n = 13), and asthma impact (n = 17). PMID:22357192

Expected Consequences of Disclosure Revealed in Investigative Interviews with Suspected Victims of Child Sexual Abuse

ERIC Educational Resources Information Center

Malloy, Lindsay C.; Brubacher, Sonja P.; Lamb, Michael E.

2011-01-01

The current study explored the expected consequences of disclosure discussed by 204 5- to 13-year-old suspected victims of child sexual abuse during the course of investigative interviews conducted using the NICHD Investigative Interview Protocol. Expected consequences were mentioned in nearly half of all interviews, with older children and those…

A Practitioner's Commentary on "Making the Most of Information-Gathering Interviews with Children"

ERIC Educational Resources Information Center

Jones, David P. H.

2009-01-01

This article presents a commentary on "Making the Most of Information-Gathering Interviews With Children," in which, according to Jones, Larsson and Lamb provided a helpful overview on memory retrieval and communicative ability and on ways these may be fostered in interviews with children. They explored three interview protocols that have been…

Feasibility of dietary assessment methods, other tools and procedures for a pan-European food consumption survey among infants, toddlers and children.

PubMed

Ocké, Marga; Brants, Henny; Dofkova, Marcela; Freisling, Heinz; van Rossum, Caroline; Ruprich, Jiri; Slimani, Nadia; Temme, Elisabeth; Trolle, Ellen; Vandevijvere, Stefanie; Huybrechts, Inge; de Boer, Evelien

2015-08-01

To test the feasibility of tools and procedures for a pan-European food consumption survey among children 0-10 years and to recommend one of two tested dietary assessment methods. Two pilot studies including 378 children were conducted in Belgium and the Czech Republic in the Pilot studies for Assessment of Nutrient intake and food Consumption among Kids in Europe. One protocol included a 3-day food diary which was checked with a parent, and data were entered afterwards using EPIC-Soft. The alternative protocol consisted of two non-consecutive 1-day food diaries followed by EPIC-Soft completion interviews. Both protocols included general and food propensity questionnaires and anthropometric measurements. The protocols were compared using evaluation questionnaires among the participating parents and study personnel. The parents found the questionnaires and instructions for filling in the food diaries understandable. Food description and food quantification was evaluated as problematic by 29 and 15% of the participants for the 3-day diaries versus 15 and 12% for the 1-day diaries. The protocol with 1-day food diaries was evaluated as less burdensome by the parents and logistically more challenging by the interviewers. Both dietary assessment methods with related tools and administration protocols were evaluated as feasible. The administration protocol with two 1-day food diaries with completion interviews offers more advantages for the future pan-European survey in children 0-10 years. The positive evaluation of feasibility of tools and materials is an important step towards harmonised food consumption data at European level among the younger age groups.

Interns overestimate the effectiveness of their hand-off communication.

PubMed

Chang, Vivian Y; Arora, Vineet M; Lev-Ari, Shiri; D'Arcy, Michael; Keysar, Boaz

2010-03-01

Theories from the psychology of communication may be applicable in understanding why hand-off communication is inherently problematic. The purpose of this study was to assess whether postcall pediatric interns can correctly estimate the patient care information and rationale received by on-call interns during hand-off communication. Pediatric interns at the University of Chicago were interviewed about the hand-off. Postcall interns were asked to predict what on-call interns would report as the important pieces of information communicated during the hand-off about each patient, with accompanying rationale. Postcall interns also guessed on-call interns' rating of how well the hand-offs went. Then, on-call interns were asked to list the most important pieces of information for each patient that postcall interns communicated during the hand-off, with accompanying rationale. On-call interns also rated how well the hand-offs went. Interns had access to written hand-offs during the interviews. We conducted 52 interviews, which constituted 59% of eligible interviews. Seventy-two patients were discussed. The most important piece of information about a patient was not successfully communicated 60% of the time, despite the postcall intern's believing that it was communicated. Postcall and on-call interns did not agree on the rationales provided for 60% of items. In addition, an item was more likely to be effectively communicated when it was a to-do item (65%) or an item related to anticipatory guidance (69%) compared with a knowledge item (38%). Despite the lack of agreement on content and rationale of information communicated during hand-offs, peer ratings of hand-off quality were high. Pediatric interns overestimated the effectiveness of their hand-off communication. Theories from communication psychology suggest that miscommunication is caused by egocentric thought processes and a tendency for the speaker to overestimate the receiver's understanding. This study demonstrates that systematic causes of miscommunication may play a role in hand-off quality.

IRR (Inter-Rater Reliability) of a COP (Classroom Observation Protocol)--A Critical Appraisal

ERIC Educational Resources Information Center

Rui, Ning; Feldman, Jill M.

2012-01-01

Notwithstanding broad utility of COPs (classroom observation protocols), there has been limited documentation of the psychometric properties of even the most popular COPs. This study attempted to fill this void by closely examining the item and domain-level IRR (inter-rater reliability) of a COP that was used in a federally funded striving readers…

Validity of a Protocol for Adult Self-Report of Dyslexia and Related Difficulties

ERIC Educational Resources Information Center

Snowling, Margaret; Dawes, Piers; Nash, Hannah; Hulme, Charles

2012-01-01

Background: There is an increased prevalence of reading and related difficulties in children of dyslexic parents. In order to understand the causes of these difficulties, it is important to quantify the risk factors passed from parents to their offspring. Method: 417 adults completed a protocol comprising a 15-item questionnaire rating reading and…

Rapid and Accurate Behavioral Health Diagnostic Screening: Initial Validation Study of a Web-Based, Self-Report Tool (the SAGE-SR).

PubMed

Brodey, Benjamin; Purcell, Susan E; Rhea, Karen; Maier, Philip; First, Michael; Zweede, Lisa; Sinisterra, Manuela; Nunn, M Brad; Austin, Marie-Paule; Brodey, Inger S

2018-03-23

The Structured Clinical Interview for DSM (SCID) is considered the gold standard assessment for accurate, reliable psychiatric diagnoses; however, because of its length, complexity, and training required, the SCID is rarely used outside of research. This paper aims to describe the development and initial validation of a Web-based, self-report screening instrument (the Screening Assessment for Guiding Evaluation-Self-Report, SAGE-SR) based on the Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition (DSM-5) and the SCID-5-Clinician Version (CV) intended to make accurate, broad-based behavioral health diagnostic screening more accessible within clinical care. First, study staff drafted approximately 1200 self-report items representing individual granular symptoms in the diagnostic criteria for the 8 primary SCID-CV modules. An expert panel iteratively reviewed, critiqued, and revised items. The resulting items were iteratively administered and revised through 3 rounds of cognitive interviewing with community mental health center participants. In the first 2 rounds, the SCID was also administered to participants to directly compare their Likert self-report and SCID responses. A second expert panel evaluated the final pool of items from cognitive interviewing and criteria in the DSM-5 to construct the SAGE-SR, a computerized adaptive instrument that uses branching logic from a screener section to administer appropriate follow-up questions to refine the differential diagnoses. The SAGE-SR was administered to healthy controls and outpatient mental health clinic clients to assess test duration and test-retest reliability. Cutoff scores for screening into follow-up diagnostic sections and criteria for inclusion of diagnoses in the differential diagnosis were evaluated. The expert panel reduced the initial 1200 test items to 664 items that panel members agreed collectively represented the SCID items from the 8 targeted modules and DSM criteria for the covered diagnoses. These 664 items were iteratively submitted to 3 rounds of cognitive interviewing with 50 community mental health center participants; the expert panel reviewed session summaries and agreed on a final set of 661 clear and concise self-report items representing the desired criteria in the DSM-5. The SAGE-SR constructed from this item pool took an average of 14 min to complete in a nonclinical sample versus 24 min in a clinical sample. Responses to individual items can be combined to generate DSM criteria endorsements and differential diagnoses, as well as provide indices of individual symptom severity. Preliminary measures of test-retest reliability in a small, nonclinical sample were promising, with good to excellent reliability for screener items in 11 of 13 diagnostic screening modules (intraclass correlation coefficient [ICC] or kappa coefficients ranging from .60 to .90), with mania achieving fair test-retest reliability (ICC=.50) and other substance use endorsed too infrequently for analysis. The SAGE-SR is a computerized adaptive self-report instrument designed to provide rigorous differential diagnostic information to clinicians. ©Benjamin Brodey, Susan E Purcell, Karen Rhea, Philip Maier, Michael First, Lisa Zweede, Manuela Sinisterra, M Brad Nunn, Marie-Paule Austin, Inger S Brodey. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 23.03.2018.

Approaches to Studying in First-Year Engineering: Comparison between Inventory Scores and Students' Descriptions of Their Approaches through Interviews

ERIC Educational Resources Information Center

Pettersson, Kerstin; Svedin, Maria; Scheja, Max; Bälter, Olle

2018-01-01

This combined interview and survey study explored the relationship between interview data and data from an inventory describing engineering students' ratings of their approaches to studying. Using the 18-item Approaches and Study Skills Inventory for Students (ASSIST) students were asked to rate their approaches to studying in relation to…

Identifying cases of undiagnosed, clinically significant COPD in primary care: qualitative insight from patients in the target population

PubMed Central

Leidy, Nancy K; Kim, Katherine; Bacci, Elizabeth D; Yawn, Barbara P; Mannino, David M; Thomashow, Byron M; Barr, R Graham; Rennard, Stephen I; Houfek, Julia F; Han, Meilan K; Meldrum, Catherine A; Make, Barry J; Bowler, Russ P; Steenrod, Anna W; Murray, Lindsey T; Walsh, John W; Martinez, Fernando

2015-01-01

Background: Many cases of chronic obstructive pulmonary disease (COPD) are diagnosed only after significant loss of lung function or during exacerbations. Aims: This study is part of a multi-method approach to develop a new screening instrument for identifying undiagnosed, clinically significant COPD in primary care. Methods: Subjects with varied histories of COPD diagnosis, risk factors and history of exacerbations were recruited through five US clinics (four pulmonary, one primary care). Phase I: Eight focus groups and six telephone interviews were conducted to elicit descriptions of risk factors for COPD, recent or historical acute respiratory events, and symptoms to inform the development of candidate items for the new questionnaire. Phase II: A new cohort of subjects participated in cognitive interviews to assess and modify candidate items. Two peak expiratory flow (PEF) devices (electronic, manual) were assessed for use in screening. Results: Of 77 subjects, 50 participated in Phase I and 27 in Phase II. Six themes informed item development: exposure (smoking, second-hand smoke); health history (family history of lung problems, recurrent chest infections); recent history of respiratory events (clinic visits, hospitalisations); symptoms (respiratory, non-respiratory); impact (activity limitations); and attribution (age, obesity). PEF devices were rated easy to use; electronic values were significantly higher than manual (P<0.0001). Revisions were made to the draft items on the basis of cognitive interviews. Conclusions: Forty-eight candidate items are ready for quantitative testing to select the best, smallest set of questions that, together with PEF, can efficiently identify patients in need of diagnostic evaluation for clinically significant COPD. PMID:26028486

Validating a Cantonese short version of the Zarit Burden Interview (CZBI-Short) for dementia caregivers.

PubMed

Tang, Jennifer Yee-Man; Ho, Andy Hau-Yan; Luo, Hao; Wong, Gloria Hoi-Yan; Lau, Bobo Hi-Po; Lum, Terry Yat-Sang; Cheung, Karen Siu-Lan

2016-09-01

The present study aimed to develop and validate a Cantonese short version of the Zarit Burden Interview (CZBI-Short) for Hong Kong Chinese dementia caregivers. The 12-item Zarit Burden Interview (ZBI) was translated into spoken Cantonese and back-translated by two bilingual research assistants and face validated by a panel of experts. Five hundred Chinese dementia caregivers showing signs of stress reported their burden using the translated ZBI and rated their depressive symptoms, overall health, and care recipients' physical functioning and behavioral problems. The factor structure of the translated scale was identified using principal component analysis and confirmatory factor analysis; internal consistency and item-total correlations were assessed; and concurrent validity was tested by correlating the ZBI with depressive symptoms, self-rated health, and care recipients' physical functioning and behavioral problems. The principal component analysis resulted in 11 items loading on a three-factor model comprised role strain, self-criticism, and negative emotion, which accounted for 59% of the variance. The confirmatory factor analysis supported the three-factor model (CZBI-Short) that explained 61% of the total variance. Cronbach's alpha (0.84) and item-total correlations (rho = 0.39-0.71) indicated CZBI-Short had good reliability. CZBI-Short showed correlations with depressive symptoms (r = 0.50), self-rated health (r = -0.26) and care recipients' physical functioning (r = 0.18-0.26) and disruptive behaviors (r = 0.36). The 12-item CZBI-Short is a concise, reliable, and valid instrument to assess burden in Chinese dementia caregivers in clinical and social care settings.

Development of the knee osteoarthritis patient education questionnaire: a new measure for evaluating preoperative patient education programmes for patients undergoing total knee replacement.

PubMed

Huber, Erika O; Bastiaenen, Caroline H; Bischoff-Ferrari, Heike A; Meichtry, André; de Bie, Rob A

2015-01-01

The aim of this study was to develop a generic instrument for the use of patients, named the Knee Osteoarthrtis Patient Education Questionnaire (KOPEQ), to assess the validity of a preoperative educational intervention and to make a preliminary test of its psychometric properties. A patient-reported outcome instrument was designed, using the conceptual framework of Wilson and Cleary as a methodological guide. Likert items with a five-point scale were chosen for the scoring option. The feasibility and interpretability of administering the KOPEQ was tested through conducting interviews with targeted patients. Items of the KOPEQ were linked to the International Classification of Functioning, Disability and Health (ICF). Psychometric testing contained internal consistency for reliability, and factor analysis for validity properties. A final list of 16 items was derived and linked to the ICF. Targeted patients confirmed in interviews, that all 16 questions were highly understandable and that the length of the questionnaire was feasible and acceptable. There was a good internal consistency for the 16-item KOPEQ with a Cronbach's alpha of 0.83 (95% confidence interval 0.71-0.94). Sixty-one percent of the variance was explained by a four-factor model and the factors were named "didactics", "addressability", "empowerment" and "theory". Results of a factor analysis provided a loading of the separate items between 0.469 and 0.958. The KOPEQ can help to provide health professionals with reliable feedback on how patients assessed the applied patient education intervention. Interviews with patients and a factor analysis revealed new and important insight.

Development of an Interview Guide Identifying the Rehabilitation Needs of Women from the Middle East Living with Chronic Pain.

PubMed

Zander, Viktoria; Eriksson, Henrik; Christensson, Kyllike; Müllersdorf, Maria

2015-09-25

The purpose of this study was to develop an interview guide for use by primary healthcare professionals to support them in identifying the rehabilitation needs of forced resettled women from the Middle East living with chronic pain. Previous findings together with the existing literature were used as the basis for developing the interview guide in three steps: item generation, cognitive interviews, and a pilot study. The study resulted in a 16-item interview guide focusing on patients' concerns and expectations, with consideration of pre-migration, migration, and post-migration factors that might affect their health. With the help of the guide, patients were also invited to identify difficulties in their daily activities and to take part in setting goals and planning their rehabilitation. The current interview guide provides professional guidance to caretakers, taking a person-centered participative point of departure when meeting and planning care, for and together, with representatives from dispersed ethnic populations in Sweden. It can be used together with the patient by all staff members working in primary healthcare, with the aim of contributing to continuity of care and multi-professional collaboration.

Development of an Interview Guide Identifying the Rehabilitation Needs of Women from the Middle East Living with Chronic Pain

PubMed Central

Zander, Viktoria; Eriksson, Henrik; Christensson, Kyllike; Müllersdorf, Maria

2015-01-01

The purpose of this study was to develop an interview guide for use by primary healthcare professionals to support them in identifying the rehabilitation needs of forced resettled women from the Middle East living with chronic pain. Previous findings together with the existing literature were used as the basis for developing the interview guide in three steps: item generation, cognitive interviews, and a pilot study. The study resulted in a 16-item interview guide focusing on patients’ concerns and expectations, with consideration of pre-migration, migration, and post-migration factors that might affect their health. With the help of the guide, patients were also invited to identify difficulties in their daily activities and to take part in setting goals and planning their rehabilitation. The current interview guide provides professional guidance to caretakers, taking a person-centered participative point of departure when meeting and planning care, for and together, with representatives from dispersed ethnic populations in Sweden. It can be used together with the patient by all staff members working in primary healthcare, with the aim of contributing to continuity of care and multi-professional collaboration. PMID:26404332

[The interview as a research data collection method].

PubMed

Debout, Christophe

2016-04-01

The interview is a widely-used method for collecting research data, notably in qualitative and mixed protocols. However, it is an umbrella term which groups together numerous types of interviews adapted to the methodological diversity which characterises nursing science. Copyright © 2016. Published by Elsevier Masson SAS.

Initial constructs for patient-centered outcome measures to evaluate brain-computer interfaces

PubMed Central

Andresen, Elena M.; Fried-Oken, Melanie; Peters, Betts; Patrick, Donald L.

2016-01-01

Purpose The authors describe preliminary work toward the creation of patient-centered outcome (PCO) measures to evaluate brain-computer interface (BCI) as an assistive technology for individuals with severe speech and physical impairments (SSPI). Method In Phase 1, 591 items from 15 existing measures were mapped to the International Classification of Functioning, Disability and Health (ICF). In Phase 2, qualitative interviews were conducted with eight people with SSPI and seven caregivers. Resulting text data were coded in an iterative analysis. Results Most items (79%) mapped to the ICF environmental domain; over half (53%) mapped to more than one domain. The ICF framework was well suited for mapping items related to body functions and structures, but less so for items in other areas, including personal factors. Two constructs emerged from qualitative data: Quality of Life (QOL) and Assistive Technology. Component domains and themes were identified for each. Conclusions Preliminary constructs, domains, and themes were generated for future PCO measures relevant to BCI. Existing instruments are sufficient for initial items but do not adequately match the values of people with SSPI and their caregivers. Field methods for interviewing people with SSPI were successful, and support the inclusion of these individuals in PCO research. PMID:25806719

A cross-cultural comparison study of depression assessments conducted in Japan

PubMed Central

2013-01-01

Background The advent of global clinical trials has necessitated the use of English-based rating instruments in diverse cultures where English is clearly not the primary language. The cross-cultural applicability of rating instruments developed in one language with only one cultural group is an important issue in both research and clinical settings where these instruments might be used. We examined the cross-cultural applicability of the Montgomery-Asberg Depression Rating Scale (MADRS) in Japan. Methods As part of a rater-training program for a clinical trial in Japan, we assessed inter-rater agreement using two videotaped MADRS interviews administered in Japanese and produced with English subtitles. We looked for possible interpretational variance that might have been generated by cultural differences between Japanese raters in Japan and English-speaking raters in the USA scoring the same interviews. Results The US and Japanese raters demonstrated high inter-rater agreement and no significant scoring difference on the total MADRS score. The subtitles in English did not adversely affect the overall scoring. We separately analyzed the 10 individual items from each of the two MADRS interviews used for rater training. Of the 20 items, 18 were concordant between the US and Japanese raters. In one interview, the US raters scored lassitude significantly higher (p = 0.013) and the inability to feel significantly lower (p = 0.037) than the Japanese raters, reflecting a possible interpretational difference on these items. Conclusion Although developed in Europe, these findings support the general applicability of the MADRS to assess the severity of depressive symptoms in Japan. We did note significant scoring differences on 2 of the 20 individual items, suggesting a possible cultural difference. It is possible that more interviews might have revealed more interpretational differences. These findings highlight the need for cultural familiarity when assessing psychiatric patients. PMID:23551964

A traffic light food labeling intervention increases consumer awareness of health and healthy choices at the point-of-purchase

PubMed Central

Sonnenberg, Lillian; Gelsomin, Emily; Levy, Douglas E.; Riis, Jason; Barraclough, Susan; Thorndike, Anne N.

2014-01-01

Objective We surveyed customers in a hospital cafeteria in Boston, Massachusetts before and after implementation of traffic light food labeling to determine the effect of labels on customers’ awareness and purchase of healthy foods. Methods Cafeteria items were identified as red (unhealthy), yellow (less healthy), or green (healthy). Customers were interviewed before (N = 166) and after (N = 223) labeling was implemented. Each respondent was linked to cash register data to determine the proportion of red, yellow, and green items purchased. Data were collected from February–April 2010. We compared responses to survey questions and mean proportion of red, yellow, and green items per transaction between customers interviewed during baseline and customers interviewed during the intervention. Survey response rate was 60%. Results Comparing responses during labeling intervention to baseline, more respondents identified health/ nutrition as an important factor in their purchase (61% vs. 46%, p = 0.004) and reported looking at nutrition information (33% vs. 15%, p < 0.001). Respondents who noticed labels during the intervention and reported that labels influenced their purchases were more likely to purchase healthier items than respondents who did not notice labels (p < 0.001 for both). Conclusion Traffic light food labels prompted individuals to consider their health and to make healthier choices at point-of-purchase. PMID:23859926

Methodological quality and reporting of systematic reviews in hand and wrist pathology.

PubMed

Wasiak, J; Shen, A Y; Ware, R; O'Donohoe, T J; Faggion, C M

2017-10-01

The objective of this study was to assess methodological and reporting quality of systematic reviews in hand and wrist pathology. MEDLINE, EMBASE and Cochrane Library were searched from inception to November 2016 for relevant studies. Reporting quality was evaluated using Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) and methodological quality using a measurement tool to assess systematic reviews, the Assessment of Multiple Systematic Reviews (AMSTAR). Descriptive statistics and linear regression were used to identify features associated with improved methodological quality. A total of 91 studies were included in the analysis. Most reviews inadequately reported PRISMA items regarding study protocol, search strategy and bias and AMSTAR items regarding protocol, publication bias and funding. Systematic reviews published in a plastics journal, or which included more authors, were associated with higher AMSTAR scores. A large proportion of systematic reviews within hand and wrist pathology literature score poorly with validated methodological assessment tools, which may affect the reliability of their conclusions. I.

[The Basel Interview for Psychosis (BIP): structure, reliability and validity].

PubMed

Riecher-Rössler, A; Ackermann, T; Uttinger, M; Ittig, S; Koranyi, S; Rapp, C; Bugra, H; Studerus, E

2015-02-01

Although several instruments have been developed to identify patients with an at-risk mental state (ARMS) for psychosis and first episode of psychosis (FEP), up to now there were no instruments for a detailed assessment of risk factors and indicators of emerging psychosis and the temporal development of psychiatric symptoms over the whole life span in these patients. We therefore developed the Basle Interview for Psychosis (BIP). The aim of this study is to describe the development of the BIP and to report about its psychometric properties. The BIP is a comprehensive semi-structured interview that was developed for the Basel early detection of psychoses (FePsy) study. Its items were derived from the most important risk factors and indicators of psychosis described in the literature and from several existing instruments. It contains the following six sections: 1) social and physical development and family, 2) signs and symptoms, 3) vulnerability, 4) help-seeking behavior, 5) illness insight, 6) evaluation of the interview. To estimate the inter-rater reliabilities of the items of sections 2 and 3, 20 interviews were conducted and rated by 8 well-trained raters. The factorial structure of the BIP section "signs and symptoms" was explored in a sample of 120 ARMS and 77 FEP patients. On the basis of the discovered factorial structure, we created new subscales and assessed their reliabilities and validities. Of the 153 studied items of sections 2 and 3, 150 (98 %) were rated with sufficiently high agreement (inter-rater reliability > 0.4). The items of section "signs and symptoms" could be grouped into 5 subscales with predominantly good to very good internal consistencies, homogeneities, and discriminant and convergent validities. Predictive validities could be demonstrated for the subscales "Positive Psychotic Symptoms", "Disturbance of Thinking" and the total score. The BIP is the first interview for comprehensively assessing risk factors and indicators of emerging psychosis and the temporal development of psychiatric symptoms over the whole life span, which has been validated in ARMS and FEP patients. We could show that the BIP has excellent psychometric properties. © Georg Thieme Verlag KG Stuttgart · New York.

Recyclable amplification for single-photon entanglement from photon loss and decoherence

NASA Astrophysics Data System (ADS)

Zhou, Lan; Chen, Ling-Quan; Zhong, Wei; Sheng, Yu-Bo

2018-01-01

We put forward a highly efficient recyclable single-photon assisted amplification protocol, which can protect single-photon entanglement (SPE) from photon loss and decoherence. Making use of quantum nondemolition detection gates constructed with the help of cross-Kerr nonlinearity, our protocol has some attractive advantages. First, the parties can recover less-entangled SPE to be maximally entangled SPE, and reduce photon loss simultaneously. Second, if the protocol fails, the parties can repeat the protocol to reuse some discarded items, which can increase the success probability. Third, when the protocol is successful, they can similarly repeat the protocol to further increase the fidelity of the SPE. Thereby, our protocol provides a possible way to obtain high entanglement, high fidelity and high success probability simultaneously. In particular, our protocol shows higher success probability in the practical high photon loss channel. Based on the above features, our amplification protocol has potential for future application in long-distance quantum communication.

Sharing good NEWS across the world: developing comparable scores across 12 countries for the Neighborhood Environment Walkability Scale (NEWS).

PubMed

Cerin, Ester; Conway, Terry L; Cain, Kelli L; Kerr, Jacqueline; De Bourdeaudhuij, Ilse; Owen, Neville; Reis, Rodrigo S; Sarmiento, Olga L; Hinckson, Erica A; Salvo, Deborah; Christiansen, Lars B; Macfarlane, Duncan J; Davey, Rachel; Mitáš, Josef; Aguinaga-Ontoso, Ines; Sallis, James F

2013-04-08

The IPEN (International Physical Activity and Environment Network) Adult project seeks to conduct pooled analyses of associations of perceived neighborhood environment, as measured by the Neighborhood Environment Walkability Scale (NEWS) and its abbreviated version (NEWS-A), with physical activity using data from 12 countries. As IPEN countries used adapted versions of the NEWS/NEWS-A, this paper aimed to develop scoring protocols that maximize cross-country comparability in responses. This information is also highly relevant to non-IPEN studies employing the NEWS/NEWS-A, which is one of the most popular measures of perceived environment globally. The following countries participated in the IPEN Adult study: Australia, Belgium, Brazil, Colombia, Czech Republic, Denmark, Hong Kong, Mexico, New Zealand, Spain, the United Kingdom, and the United States. Participants (N = 14,305) were recruited from neighborhoods varying in walkability and socio-economic status. Countries collected data on the perceived environment using a self- or interviewer-administered version of the NEWS/NEWS-A. Confirmatory Factor Analysis (CFA) was used to derive comparable country-specific measurement models of the NEWS/NEWS-A. The level of correspondence between standard and alternative versions of the NEWS/NEWS-A factor-analyzable subscales was determined by estimating the correlations and mean standardized difference (Cohen's d) between them using data from countries that had included items from both standard and alternative versions of the subscales. Final country-specific measurement models of the NEWS/NEWS-A provided acceptable levels of fit to the data and shared the same factorial structure with six latent factors and two single items. The correspondence between the standard and alternative versions of subscales of Land use mix - access, Infrastructure and safety for walking/cycling, and Aesthetics was high. The Brazilian version of the Traffic safety subscale was highly, while the Australian and Belgian versions were marginally, comparable to the standard version. Single-item versions of the Street connectivity subscale used in Australia and Belgium showed marginally acceptable correspondence to the standard version. We have proposed country-specific modifications to the original scoring protocol of the NEWS/NEWS-A that enhance inter-country comparability. These modifications have yielded sufficiently equivalent measurement models of the NEWS/NEWS-A. Some inter-country discrepancies remain. These need to be considered when interpreting findings from different countries.

Sharing good NEWS across the world: developing comparable scores across 12 countries for the neighborhood environment walkability scale (NEWS)

PubMed Central

2013-01-01

Background The IPEN (International Physical Activity and Environment Network) Adult project seeks to conduct pooled analyses of associations of perceived neighborhood environment, as measured by the Neighborhood Environment Walkability Scale (NEWS) and its abbreviated version (NEWS-A), with physical activity using data from 12 countries. As IPEN countries used adapted versions of the NEWS/NEWS-A, this paper aimed to develop scoring protocols that maximize cross-country comparability in responses. This information is also highly relevant to non-IPEN studies employing the NEWS/NEWS-A, which is one of the most popular measures of perceived environment globally. Methods The following countries participated in the IPEN Adult study: Australia, Belgium, Brazil, Colombia, Czech Republic, Denmark, Hong Kong, Mexico, New Zealand, Spain, the United Kingdom, and the United States. Participants (N = 14,305) were recruited from neighborhoods varying in walkability and socio-economic status. Countries collected data on the perceived environment using a self- or interviewer-administered version of the NEWS/NEWS-A. Confirmatory Factor Analysis (CFA) was used to derive comparable country-specific measurement models of the NEWS/NEWS-A. The level of correspondence between standard and alternative versions of the NEWS/NEWS-A factor-analyzable subscales was determined by estimating the correlations and mean standardized difference (Cohen’s d) between them using data from countries that had included items from both standard and alternative versions of the subscales. Results Final country-specific measurement models of the NEWS/NEWS-A provided acceptable levels of fit to the data and shared the same factorial structure with six latent factors and two single items. The correspondence between the standard and alternative versions of subscales of Land use mix – access, Infrastructure and safety for walking/cycling, and Aesthetics was high. The Brazilian version of the Traffic safety subscale was highly, while the Australian and Belgian versions were marginally, comparable to the standard version. Single-item versions of the Street connectivity subscale used in Australia and Belgium showed marginally acceptable correspondence to the standard version. Conclusions We have proposed country-specific modifications to the original scoring protocol of the NEWS/NEWS-A that enhance inter-country comparability. These modifications have yielded sufficiently equivalent measurement models of the NEWS/NEWS-A. Some inter-country discrepancies remain. These need to be considered when interpreting findings from different countries. PMID:23566032

Development of Research-Based Protocol Aligned to Predict High Levels of Teaching Quality

ERIC Educational Resources Information Center

Schumacher, Gary; Grigsby, Bettye; Vesey, Winona

2011-01-01

This study proposes a research-based teacher selection protocol. The protocol is intended to offer school district hiring authorities a tool to identify teacher candidates with the behaviors expected to predict effective teaching. It is hypothesized that a particular series of research-based interview questions focusing on teaching behaviors in…

Meta-Analysis: An Approach to Interview Success.

ERIC Educational Resources Information Center

McCaslin, Mark; Carlson, Nancy M.

An initial research step, developing an effective interview strategy, presents unique challenges for novice and master research alike. To focus qualitative research in the human ecology of the study, the strategy presented in this paper used an initial interview protocol and preanalysis process, called meta-analysis, prior to developing the formal…

The reliability of the standard for clinicians' interview in psychiatry (SCIP): a clinician-administered tool with categorical, dimensional and numeric output.

PubMed

Aboraya, Ahmed; El-Missiry, Ahmed; Barlowe, Johnna; John, Collin; Ebrahimian, Alireza; Muvvala, Srinivas; Brandish, Ja'me; Mansour, Hader; Zheng, Wanhong; Chumber, Paramjit; Berry, James; Elswick, Daniel; Hill, Cheryl; Swager, Lauren; Abo Elez, Warda; Ashour, Hala; Haikal, Amal; Eissa, Ahmed; Rabie, Menan; El-Missiry, Marwa; El Sheikh, Mona; Hassan, Dina; Ragab, Sherif; Sabry, Mohamed; Hendawy, Heba; Abdel Rahman, Rola; Radwan, Doaa; Sherif, Mohamed; Abou El Asaad, Marwa; Khalil, Sherien; Hashim, Reem; Border, Katherine; Menguito, Roberto; France, Cheryl; Hu, Wei; Shuttleworth, Olivia; Price, Elizabeth

2014-07-01

Existing standardized diagnostic interviews are not used by psychiatrists in clinical settings. There is an urgent need for a clinician-administered tool for assessment of adult psychopathology that produces dimensional measures, in addition to categorical diagnoses. The Standard for Clinicians' Interview in Psychiatry (SCIP) was designed to be used in clinical settings and generates dimensional measures. The reliability of the SCIP was tested at six sites: one hospital and two clinics in USA, two hospitals in Egypt and one clinic in Canada. Participants were adult patients who were admitted for inpatient psychiatric treatment or came for regular office visits in the outpatient clinic. Refusal rate was <1%. Missing data were <1.1%. Patients with dementia, mental retardation or serious medical conditions were excluded. A total of 1,004 subjects were interviewed between 2000 and 2012. Inter-rater reliability (Kappa) was measured for 150 SCIP items: 116 items (77.3%) had good reliability (Kappa>0.7), 28 items (18.7%) had fair reliability (Kappa ranges from 0.5 to 0.7) and six items (4%) had poor reliability (Kappa<0.5). Cronbach's alpha for internal consistency was measured for the SCIP dimensions: anxiety, posttraumatic stress, depression, mania, hallucinations, Schneider first-rank symptoms, delusions, disorganized thoughts, disorganized behavior, negative symptoms, alcohol addiction, drug addiction, attention and hyperactivity. All of the SCIP dimensions had substantial Cronbach's alpha values (>0.7) with the exception of disorganized thoughts (Cronbach's alpha=0.375). The SCIP is a reliable tool for assessing psychological symptoms, signs and dimensions of the main psychiatric diagnoses. Copyright © 2014 Elsevier B.V. All rights reserved.

The Cognitive Assessment Interview (CAI): development and validation of an empirically derived, brief interview-based measure of cognition.

PubMed

Ventura, Joseph; Reise, Steven P; Keefe, Richard S E; Baade, Lyle E; Gold, James M; Green, Michael F; Kern, Robert S; Mesholam-Gately, Raquelle; Nuechterlein, Keith H; Seidman, Larry J; Bilder, Robert M

2010-08-01

Practical, reliable "real world" measures of cognition are needed to supplement neurocognitive performance data to evaluate possible efficacy of new drugs targeting cognitive deficits associated with schizophrenia. Because interview-based measures of cognition offer one possible approach, data from the MATRICS initiative (n=176) were used to examine the psychometric properties of the Schizophrenia Cognition Rating Scale (SCoRS) and the Clinical Global Impression of Cognition in Schizophrenia (CGI-CogS). We used classical test theory methods and item response theory to derive the 10-item Cognitive Assessment Interview (CAI) from the SCoRS and CGI-CogS ("parent instruments"). Sources of information for CAI ratings included the patient and an informant. Validity analyses examined the relationship between the CAI and objective measures of cognitive functioning, intermediate measures of cognition, and functional outcome. The rater's score from the newly derived CAI (10 items) correlate highly (r=.87) with those from the combined set of the SCoRS and CGI-CogS (41 items). Both the patient (r=.82) and the informant (r=.95) data were highly correlated with the rater's score. The CAI was modestly correlated with objectively measured neurocognition (r=-.32), functional capacity (r=-.44), and functional outcome (r=-.32), which was comparable to the parent instruments. The CAI allows for expert judgment in evaluating a patient's cognitive functioning and was modestly correlated with neurocognitive functioning, functional capacity, and functional outcome. The CAI is a brief, repeatable, and potentially valuable tool for rating cognition in schizophrenia patients who are participating in clinical trials. Copyright 2010 Elsevier B.V. All rights reserved.

The Cognitive Assessment Interview (CAI): Development and Validation of an Empirically Derived, Brief Interview-Based Measure of Cognition

PubMed Central

Ventura, Joseph; Reise, Steven P.; Keefe, Richard S. E.; Baade, Lyle E.; Gold, James M.; Green, Michael F.; Kern, Robert S.; Mesholam-Gately, Raquelle; Nuechterlein, Keith H.; Seidman, Larry J.; Bilder, Robert M.

2011-01-01

Background Practical, reliable “real world” measures of cognition are needed to supplement neurocognitive performance data to evaluate possible efficacy of new drugs targeting cognitive deficits associated with schizophrenia. Because interview-based measures of cognition offer one possible approach, data from the MATRICS initiative (n=176) were used to examine the psychometric properties of the Schizophrenia Cognition Rating Scale (SCoRS) and the Clinical Global Impression of Cognition in Schizophrenia (CGI-CogS). Method We used classical test theory methods and item response theory to derive the 10 item Cognitive Assessment Interview (CAI) from the SCoRS and CGI-Cogs (“parent instruments”). Sources of information for CAI ratings included the patient and an informant. Validity analyses examined the relationship between the CAI and objective measures of cognitive functioning, intermediate measures of cognition, and functional outcome. Results The rater’s score from the newly derived CAI (10-items) correlate highly (r = .87) with those from the combined set of the SCoRS and CGI-CogS (41 items). Both the patient (r= .82) and the informant (r= .95) data were highly correlated with the rater’s score. The CAI was modestly correlated with objectively measured neurocognition (r = −.32), functional capacity (r = −.44), and functional outcome (r = −.32), which was comparable to the parent instruments. Conclusions The CAI allows for expert judgment in evaluating a patient’s cognitive functioning and was modestly correlated with neurocognitive functioning, functional capacity, and functional outcome. The CAI is a brief, repeatable, and potentially valuable tool for rating cognition in schizophrenia patients who are participating in clinical trials. PMID:20542412

Celebrating the Familiar: An Interview with Betty Spindler.

ERIC Educational Resources Information Center

Gamble, Harriet

2001-01-01

Presents an interview with ceramic artist, Betty Spindler, who overcame a learning disability and earned associate and bachelor degrees in art. Explains that she creates ceramic sculptures of fruits, vegetables, sandwiches, and other everyday items. Presents a project where children create their own fruit. (CMK)

Full Inclusion: The Least Restrictive Environment

ERIC Educational Resources Information Center

Mullings, Shirley E.

2011-01-01

The purpose of the phenomenological study was to examine elementary educators' perceptions of full inclusion as the least restrictive environment for students with disabilities. Thirty-six teachers and administrators participated in interviews and responded to multiple-choice survey items. The recorded data from the interviews were…

Psychological distress and quality of life: rationale and protocol of a prospective cohort study in a rural district in Bangaladesh

PubMed Central

Uddin, Mohammed Nazim; Bhar, Sunil; Al Mahmud, Abdullah; Islam, Fakir M Amirul

2017-01-01

Introduction A significant proportion of the global burden of disease has been attributed to mental and behavioural disorders. People with mental disorders (MDs) have lower levels of health-related quality of life than those without MDs. Several studies have shown that in low-resource countries, a range of social determinants including poor health literacy is critical in the epidemiological transition of disease outcome. There is a lack of evidence of MDs literacy, the prevalence and risk factors of common mental health conditions, or any validated instruments to measure psychological distress or evaluate the quality of life in rural areas of Bangladesh. Aims The aims of this study are: (1) report the awareness, knowledge, attitudes and practice (KAP) of MDs; (2) estimate the prevalence of and risk factors for psychological distress; (3) measure association of psychological distress and other socio-demographic factors with quality of life and (4) test the feasibility to use Kessler 10-item (K10) and WHO Quality Of Life-BREF (WHOQOL-BREF) questionnaires in rural Bangladesh for measuring psychological distress and quality of life. Methods and analysis A sample of 1500 adults aged 18–59 years and 1200 older adults aged 60–90 years will be interviewed from a multistage cluster random sample. Each participant will go through a face-to-face interview to assess their awareness and KAP of MDs. Information about the participant’s sociodemographic and socioeconomic status will be collected along with the psychological distress (K10) and quality of life (WHOQOL-BREF) questionnaires. Internal consistency, validity, reliability and item discrimination of K10 and WHOQOL-BREF instruments will be determined by using Rasch analysis and regression techniques. Ethics and dissemination Human Ethics Approval was received from the Swinburne University of Technology Human Ethics Committee. Results of this research will be disseminated via scientific forums including peer-reviewed publications and presentations at national and international conferences. PMID:28864700

Developing core economic outcome sets for asthma studies: a protocol for a systematic review.

PubMed

Hounsome, Natalia; Fitzsimmons, Deborah; Phillips, Ceri; Patel, Anita

2017-08-11

Core outcome sets are standardised lists of outcomes, which should be measured and reported in all clinical studies of a specific condition. This study aims to develop core outcome sets for economic evaluations in asthma studies. Economic outcomes include items such as costs, resource use or quality-adjusted life years. The starting point in developing core outcome sets will be conducting a systematic literature review to establish a preliminary list of reporting items to be considered for inclusion in the core outcome set. We will conduct literature searches of peer-reviewed studies published from January 1990 to January 2017. These will include any comparative or observational studies (including economic models) and systematic reviews reporting economic outcomes. All identified economic outcomes will be tabulated together with the major study characteristics, such as population, study design, the nature and intensity of the intervention, mode of data collection and instrument(s) used to derive an outcome. We will undertake a 'realist synthesis review' to analyse the identified economic outcomes. The outcomes will be summarised in the context of evaluation perspectives, types of economic evaluation and methodological approaches. Parallel to undertaking a systematic review, we will conduct semistructured interviews with stakeholders (including people with personal experience of asthma, health professionals, researchers and decision makers) in order to explore additional outcomes which have not been considered, or used, in published studies. The list of outcomes generated from the systematic review and interviews with stakeholders will form the basis of a Delphi survey to refine the identified outcomes into a core outcome set. The review will not involve access to individual-level data. Findings from our systematic review will be communicated to a broad range of stakeholders including clinical guideline developers, research funders, trial registries, ethics committees and other regulators. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Item difficulty and item validity for the Children's Group Embedded Figures Test.

PubMed

Rusch, R R; Trigg, C L; Brogan, R; Petriquin, S

1994-02-01

The validity and reliability of the Children's Group Embedded Figures Test was reported for students in Grade 2 by Cromack and Stone in 1980; however, a search of the literature indicates no evidence for internal consistency or item analysis. Hence the purpose of this study was to examine the item difficulty and item validity of the test with children in Grades 1 and 2. Confusion in the literature over development and use of this test was seemingly resolved through analysis of these descriptions and through an interview with the test developer. One early-appearing item was unreasonably difficult. Two or three other items were quite difficult and made little contribution to the total score. Caution is recommended, however, in any reordering or elimination of items based on these findings, given the limited number of subjects (n = 84).

ESPACOMP Medication Adherence Reporting Guidelines (EMERGE): a reactive-Delphi study protocol

PubMed Central

Helmy, R; Zullig, L L; Dunbar-Jacob, J; Hughes, D A; Vrijens, B; Wilson, I B; De Geest, S

2017-01-01

Introduction Medication adherence is fundamental to achieving optimal patient outcomes. Reporting research on medication adherence suffers from some issues—including conceptualisation, measurement and data analysis—that thwart its advancement. Using the ABC taxonomy for medication adherence as the conceptual basis, a steering committee of members of the European Society for Patient Adherence, COMpliance, and Persistence (ESPACOMP) launched an initiative to develop ESPACOMP Medication Adherence Reporting Guidelines (EMERGE). This paper is a protocol for a Delphi study that aims to build consensus among a group of topic experts regarding an item list that will support developing EMERGE. Methods and analysis This study uses a reactive-Delphi design where a group of topic experts will be asked to rate the relevance and clarity of an initial list of items, in addition to suggesting further items and/or modifications of the initial items. The initial item list, generated by the EMERGE steering committee through a structured process, consists of 26 items distributed in 2 sections: 4 items representing the taxonomy-based minimum reporting criteria, and 22 items organised according to the common reporting sections. A purposive sample of experts will be selected from relevant disciplines and diverse geographical locations. Consensus will be achieved through predefined decision rules to keep, delete or modify the items. An iterative process of online survey rounds will be carried out until consensus is reached. Ethics and dissemination An ethics approval was not required for the study according to the Swiss federal act on research involving human beings. The participating experts will be asked to give an informed consent. The results of this Delphi study will feed into EMERGE, which will be disseminated through peer-reviewed publications and presentations at conferences. Additionally, the steering committee will encourage their endorsement by registering the guidelines at the Enhancing the QUAlity and Transparency Of health Research (EQUATOR) network and other relevant organisations. PMID:28188154

Development of the EORTC QLQ-CAX24, A Questionnaire for Cancer Patients With Cachexia.

PubMed

Wheelwright, Sally J; Hopkinson, Jane B; Darlington, Anne-Sophie; Fitzsimmons, Deborah F; Fayers, Peter; Balstad, Trude R; Bredart, Anne; Hammerlid, Eva; Kaasa, Stein; Nicolatou-Galitis, Ourania; Pinto, Monica; Schmidt, Heike; Solheim, Tora S; Strasser, Florian; Tomaszewska, Iwona M; Johnson, Colin D

2017-02-01

Cachexia is commonly found in cancer patients and has profound consequences; yet there is only one questionnaire that examines the patient's perspective. To report a rigorously developed module for patient self-reported impact of cancer cachexia. Module development followed published guidelines. Patients from across the cancer cachexia trajectory were included. In Phase 1, health-related quality of life (HRQOL) issues were generated from a literature review and interviews with patients in four countries. The issues were revised based on patient and health care professional (HCP) input. In Phase 2, questionnaire items were formulated and translated into the languages required for Phase 3, the pilot phase, in which patients from eight countries scored the relevance and importance of each item, and provided qualitative feedback. A total of 39 patients and 12 HCPs took part in Phase 1. The literature review produced 68 HRQOL issues, with 22 new issues arising from the patient interviews. After patient and HCP input, 44 issues were formulated into questionnaire items in Phase 2. One hundred ten patients took part in Phase 3. One item was reworded, and 20 items were deleted as a consequence of patient feedback. The QLQ-CAX24 is a cancer cachexia-specific questionnaire, comprising 24 items, for HRQOL assessment in clinical trials and practice. It contains five multi-item scales (food aversion, eating and weight-loss worry, eating difficulties, loss of control, and physical decline) and four single items. Copyright © 2016 American Academy of Hospice and Palliative Medicine. Published by Elsevier Inc. All rights reserved.

College of American Pathologists Cancer Protocols: Optimizing Format for Accuracy and Efficiency.

PubMed

Strickland-Marmol, Leah B; Muro-Cacho, Carlos A; Barnett, Scott D; Banas, Matthew R; Foulis, Philip R

2016-06-01

-The data in College of American Pathologists cancer protocols have to be presented effectively to health care providers. There is no consensus on the format of those protocols, resulting in various designs among pathologists. Cancer protocols are independently created by site-specific experts, so there is inconsistent wording and repetition of data. This lack of standardization can be confusing and may lead to interpretation errors. -To define a synopsis format that is effective in delivering essential pathologic information and to evaluate the aesthetic appeal and the impact of varying format styles on the speed and accuracy of data extraction. -We queried individuals from several health care backgrounds using varying formats of the fallopian tube protocol of the College of American Pathologists without content modification to investigate their aesthetic appeal, accuracy, efficiency, and readability/complexity. Descriptive statistics, an item difficulty index, and 3 tests of readability were used. -Columned formats were aesthetically more appealing than justified formats (P < .001) and were associated with greater accuracy and efficiency. Incorrect assumptions were made about items not included in the protocol. Uniform wording and short sentences were associated with better performance by participants. -Based on these data, we propose standardized protocol formats for cancer resections of the fallopian tube and the more-familiar colon, employing headers, short phrases, and uniform terminology. This template can be easily and minimally modified for other sites, standardizing format and verbiage and increasing user accuracy and efficiency. Principles of human factors engineering should be considered in the display of patient data.

Internet-based cognitive behavioural therapy (iCBT) for posttraumatic stress disorder versus waitlist control: study protocol for a randomised controlled trial.

PubMed

Allen, Adrian R; Newby, Jill M; Smith, Jessica; Andrews, Gavin

2015-12-01

This randomised controlled trial (RCT) with two parallel arms will evaluate the efficacy of an internet-delivered six-lesson 10-week cognitive behavioural therapy (iCBT) intervention for posttraumatic stress disorder (PTSD). It will also investigate the association between changes in PTSD symptoms, intolerance of uncertainty (IU) and emotion regulation. Patients with PTSD will be recruited via the research arm of a not-for-profit clinical and research unit in Australia and randomised to a treatment group or waitlist control group. The minimum sample size for each group (alpha 0.05, power 0.80 for a g of 0.47) was identified as 72, but 10 % more will be recruited to hedge against expected attrition. PTSD diagnosis will be determined using the PTSD module from the Mini International Neuropsychiatric Interview version 5.0.0. The PTSD Checklist - Civilian version (PCL-C) will be used to measure PTSD symptoms (the primary outcome measure), with the Intolerance of Uncertainty Scale 12-item version (IUS-12) and the Emotion Regulation Questionnaire (ERQ) used to measure intolerance of uncertainty and emotion regulation, respectively. The PCL-C will be administered to the treatment group before each lesson of the PTSD program and at 3-month follow-up. The IUS-12 and ERQ will be administered before lessons 1 and 4, at post-treatment and at 3-month follow-up. The waitlist control group will complete these measures at week 1, week 5 and week 11 of the waitlist period. PTSD program efficacy will be determined using intent-to-treat mixed models. Maintenance of gains will be assessed at 3-month follow-up. Mediation analyses using PROCESS will be used to examine the association between change in PTSD symptoms over treatment and change in each of IU and emotion regulation ability in separate analyses. The current RCT seeks to replicate previous efficacy findings of iCBT for PTSD in a formally assessed PTSD sample from the general population. Findings may point to future lines of enquiry for the role of IU and emotion regulation in the mechanism of PTSD symptom change during CBT. Australian New Zealand Clinical Trials Registry: ACTRN12614001213639 , registered 18 November 2014. This trial protocol is written in compliance with the Standard Protocol Items: Recommendations for Interventional Trials (SPIRIT) guidelines.

"I Can't Answer What You're Asking Me. Let Me Go, Please.": Cognitive Interviewing to Assess Social Support Measures in Ethiopia and Kenya

ERIC Educational Resources Information Center

Martin, Stephanie L.; Birhanu, Zewdie; Omotayo, Moshood O.; Kebede, Yohannes; Pelto, Gretel H.; Stoltzfus, Rebecca J.; Dickin, Katherine L.

2017-01-01

Cognitive interviewing is a method to develop culturally appropriate survey questions and scale items. We conducted two rounds of cognitive interviews with 24 pregnant women in Ethiopia and Kenya to assess the appropriateness, acceptability, and comprehension of general and micronutrient supplement adherence-specific social support scales. We…

Clinical utility of a single-item test for DSM-5 alcohol use disorder among outpatients with anxiety and depressive disorders.

PubMed

Bartoli, Francesco; Crocamo, Cristina; Biagi, Enrico; Di Carlo, Francesco; Parma, Francesca; Madeddu, Fabio; Capuzzi, Enrico; Colmegna, Fabrizia; Clerici, Massimo; Carrà, Giuseppe

2016-08-01

There is a lack of studies testing accuracy of fast screening methods for alcohol use disorder in mental health settings. We aimed at estimating clinical utility of a standard single-item test for case finding and screening of DSM-5 alcohol use disorder among individuals suffering from anxiety and mood disorders. We recruited adults consecutively referred, in a 12-month period, to an outpatient clinic for anxiety and depressive disorders. We assessed the National Institute on Alcohol Abuse and Alcoholism (NIAAA) single-item test, using the Mini- International Neuropsychiatric Interview (MINI), plus an additional item of Composite International Diagnostic Interview (CIDI) for craving, as reference standard to diagnose a current DSM-5 alcohol use disorder. We estimated sensitivity and specificity of the single-item test, as well as positive and negative Clinical Utility Indexes (CUIs). 242 subjects with anxiety and mood disorders were included. The NIAAA single-item test showed high sensitivity (91.9%) and specificity (91.2%) for DSM-5 alcohol use disorder. The positive CUI was 0.601, whereas the negative one was 0.898, with excellent values also accounting for main individual characteristics (age, gender, diagnosis, psychological distress levels, smoking status). Testing for relevant indexes, we found an excellent clinical utility of the NIAAA single-item test for screening true negative cases. Our findings support a routine use of reliable methods for rapid screening in similar mental health settings. Copyright © 2016 Elsevier Ireland Ltd. All rights reserved.

Reliability of the Brazilian version of the Physical Activity Checklist Interview in children.

PubMed

Adami, Fernando; Cruciani, Fernanda; Douek, Michelle; Sewell, Carolina Dumit; Mariath, Aline Brandão; Hinnig, Patrícia de Fragas; Freaza, Silvia Rafaela Mascarenhas; Bergamaschi, Denise Pimentel

2011-04-01

To assess the reliability of the Lista de Atividades Físicas (Brazilian version of the Physical Activity Checklist Interview) in children. The study is part of a cross-cultural adaptation of the Physical Activity Checklist Interview, conducted with 83 school children aged between seven and ten years, enrolled between the 2nd and 5th grades of primary education in the city of São Paulo, Southeastern Brazil, in 2008. The questionnaire was responded by children through individual interviews. It is comprised of a list of 21 moderate to vigorous physical activities performed on the previous day, it is divided into periods (before, during and after school) and it has a section for interview assessment. This questionnaire enables the quantification of time spent in physical and sedentary activities and the total and weighed metabolic costs. Reliability was assessed by comparing two interviews conducted with a mean interval of three hours. For the interview assessment, data from the first interview and those from an external evaluator were compared. Bland-Altman's proposal, the intraclass correlation coefficient and Lin's concordance correlation coefficient were used to assess reliability. The intraclass correlation coefficient lower limits for the outcomes analyzed varied from 0.84 to 0.96. Precision and agreement varied between 0.83 and 0.97 and between 0.99 and 1, respectively. The line estimated from the pairs of values obtained in both interviews indicates high data precision. The interview item showing the poorest result was the ability to estimate time (fair in 27.7% of interviews). Interview assessment items showed intraclass correlation coefficients between 0.60 and 0.70, except for level of cooperation (0.46). The Brazilian version of the Physical Activity Checklist Interview shows high reliability to assess physical and sedentary activity on the previous day in children.

Treatment Satisfaction in Systemic Lupus Erythematosus: Development of a Patient-Reported Outcome Measure.

PubMed

Mathias, Susan D; Berry, Pamela; Pascoe, Katie; de Vries, Jane; Askanase, Anca D; Colwell, Hilary H; Chang, David J

2017-03-01

The aim of this study was to develop a patient-reported outcome measure specific for systemic lupus erythematosus (SLE) to assess patient satisfaction with treatment, treatment options, and medical care. Patients with SLE were recruited from four US rheumatology practices. Concept elicitation interviews identified aspects that patients considered important and relevant regarding satisfaction with treatment and medical care. Concept elicitation interviews and clinical input were used to draft the Lupus Satisfaction Questionnaire (LSQ). A second cohort of patients with SLE participated in combined concept elicitation/cognitive debriefing interviews, after which the LSQ was revised. Fourteen patients completed concept elicitation interviews: 93% were female, 57% were white, and 85% had moderate/severe SLE. Current treatments included hydroxychloroquine (93%), steroids (79%), and belimumab (57%), and 43% were biologic naive. Patients were generally satisfied with their treatment and medical care; however, they were dissatisfied with treatment adverse effects and the number of available treatment options. Cognitive debriefing interviews (n = 8) demonstrated that the LSQ was comprehensive, clear, and relevant; therefore, only minor revisions were made to the questionnaire. The LSQ assesses satisfaction with current SLE treatments (25 items), medical care (11 items), and insurance coverage (3 items). The draft LSQ was evaluated in 195 adults with SLE. Fifty-eight percent of patients reported that they were "somewhat satisfied" with their SLE treatment. The LSQ has been developed to assess treatment satisfaction among patients with SLE. Following further testing to support its validity and reliability, it will provide a useful tool to facilitate assessment of satisfaction with treatments for SLE and help inform treatment decisions.

'Questerviews': using questionnaires in qualitative interviews as a method of integrating qualitative and quantitative health services research.

PubMed

Adamson, Joy; Gooberman-Hill, Rachael; Woolhead, Gillian; Donovan, Jenny

2004-07-01

Multi-method approaches are increasingly advocated in health services research (HSR). This paper examines the use of standardised self-completion questionnaires and questions, during in-depth interviews, a technique termed 'questerviews'. 'Questerview' techniques were used in four empirical studies of health perceptions conducted by the authors. The studies included both standardised self-completion questions or questionnaires and in-depth interviews. Respondents were tape-recorded while they completed the standardised questionnaires and were encouraged to discuss their definitions of terms and responses to items in-depth. In all studies, 'questerviews' were fully transcribed and data analysis involved the scrutinising of transcripts to identify emergent themes. Responses to the standardised items led to rich sources of qualitative data. They proved to be useful triggers as respondents discussed their understanding and definitions of terms, often explaining their responses with stories from their own experiences. The items triggered detailed exploration of the complex factors that comprise health, illness and healthcare seeking, and gave considerable insight into the ways in which people respond to standardised questions. Apparently simple questions and response categories conceal considerable complexity. Inclusion of standardised survey questions in qualitative interviews can provide an easy and fruitful method to explore research issues and provide triggers to difficult or contested topics. Well designed and validated questionnaires produce data of immense value to HSR, and this value could be further enhanced by their use within a qualitative interview. We suggest that the technique of 'questerviews' is a tangible and pragmatic way of doing this.

A tool for assessing case history and feedback skills in audiology students working with simulated patients.

PubMed

Hughes, Jane; Wilson, Wayne J; MacBean, Naomi; Hill, Anne E

2016-12-01

To develop a tool for assessing audiology students taking a case history and giving feedback with simulated patients (SP). Single observation, single group design. Twenty-four first-year audiology students, five simulated patients, two clinical educators, and three evaluators. The Audiology Simulated Patient Interview Rating Scale (ASPIRS) was developed consisting of six items assessing specific clinical skills, non-verbal communication, verbal communication, interpersonal skills, interviewing skills, and professional practice skills. These items are applied once for taking a case history and again for giving feedback. The ASPIRS showed very high internal consistency (α = 0.91-0.97; mean inter-item r = 0.64-0.85) and fair-to-moderate agreement between evaluators (29.2-54.2% exact and 79.2-100% near agreement; κ weighted up to 0.60). It also showed fair-to-moderate absolute agreement amongst evaluators for single evaluator scores (intraclass correlation coefficient [ICC] r = 0.35-0.59) and substantial consistency of agreement amongst evaluators for three-evaluator averaged scores (ICC r = 0.62-0.81). Factor analysis showed the ASPIRS' 12 items fell into two components, one containing all feedback items and one containing all case history items. The ASPIRS shows promise as the first published tool for assessing audiology students taking a case history and giving feedback with an SP.

The Measurement of Nuclear War Attitudes: Methods and Concerns.

ERIC Educational Resources Information Center

Mayton, Daniel M., II

Measures of adults' attitudes toward nuclear war are briefly discussed, and Mayton's Modified World Affairs Questionnaire (MWAQ) is described. The 23-item MWAQ was developed from Novak and Lerner's World Affairs Questionnaire, a nuclear war attitude measure by Mayton and Delamater, and related interview items by Jeffries. When the MWAQ was…

Soviet Cybernetics: Recent News Items, Number Thirteen.

ERIC Educational Resources Information Center

Holland, Wade B.

An issue of "Soviet Cybernetics: Recent News Items" consists of English translations of the leading recent Soviet contributions to the study of cybernetics. Articles deal with cybernetics in the 21st Century; the Soviet State Committee on Science and Technology; economic reforms in Rudnev's ministry; an interview with Rudnev; Dnepr-2; Dnepr-2…

Detection and validation of unscalable item score patterns using item response theory: an illustration with Harter's Self-Perception Profile for Children.

PubMed

Meijer, Rob R; Egberink, Iris J L; Emons, Wilco H M; Sijtsma, Klaas

2008-05-01

We illustrate the usefulness of person-fit methodology for personality assessment. For this purpose, we use person-fit methods from item response theory. First, we give a nontechnical introduction to existing person-fit statistics. Second, we analyze data from Harter's (1985) Self-Perception Profile for Children (Harter, 1985) in a sample of children ranging from 8 to 12 years of age (N = 611) and argue that for some children, the scale scores should be interpreted with care and caution. Combined information from person-fit indexes and from observation, interviews, and self-concept theory showed that similar score profiles may have a different interpretation. For some children in the sample, item scores did not adequately reflect their trait level. Based on teacher interviews, this was found to be due most likely to a less developed self-concept and/or problems understanding the meaning of the questions. We recommend investigating the scalability of score patterns when using self-report inventories to help the researcher interpret respondents' behavior correctly.

Fifth Graders' Learning About Simple Machines Through Engineering Design-Based Instruction Using LEGO™ Materials

NASA Astrophysics Data System (ADS)

Marulcu, Ismail; Barnett, Mike

2013-10-01

This study is part of a 5-year National Science Foundation-funded project, Transforming Elementary Science Learning Through LEGO™ Engineering Design. In this study, we report on the successes and challenges of implementing an engineering design-based and LEGO™-oriented unit in an urban classroom setting and we focus on the impact of the unit on students' content understanding of simple machines. The LEGO™ engineering-based simple machines module, which was developed for fifth graders by our research team, was implemented in an urban school in a large city in the Northeastern region of the USA. Thirty-three fifth grade students participated in the study, and they showed significant growth in content understanding. We measured students' content knowledge by using identical paper tests and semistructured interviews before and after instruction. Our paired t test analysis results showed that students significantly improved their test and interview scores (t = -3.62, p < 0.001 for multiple-choice items and t = -9.06, p < 0.000 for the open-ended items in the test and t = -12.11, p < 0.000 for the items in interviews). We also identified several alternative conceptions that are held by students on simple machines.

75 FR 46899 - Agency Information Collection Activities: Proposed Collection; Comment Request-In-Depth Case...

Federal Register 2010, 2011, 2012, 2013, 2014

2010-08-04

... conduct interviews of SNAP staff at all levels, visit multiple local offices, hold focus groups with... vendors that contract with State SNAP agencies. Tailored protocols will be used for the interviews... States will receive remuneration of $75,000 to offset the costs of participating in the study. Interview...

Bridging the Measurement Gap Between Research and Clinical Care in Schizophrenia: Positive and Negative Syndrome Scale-6 (PANSS-6) and Other Assessments Based on the Simplified Negative and Positive Symptoms Interview (SNAPSI).

PubMed

Østergaard, Søren D; Opler, Mark G A; Correll, Christoph U

2017-12-01

There is currently a "measurement gap" between research and clinical care in schizophrenia. The main reason behind this gap is that the most widely used rating scale in schizophrenia research, the 30-item Positive and Negative Syndrome Scale (PANSS), takes so long to administer that it is rarely used in clinical practice. This compromises the translation of research findings into clinical care and vice versa. The aim of this paper is to discuss how this measurement gap can be closed. Specifically, the main points of discussion are 1) the practical problems associated with using the full 30-item PANSS in clinical practice; 2) how the brief, six-item version of the Positive and Negative Syndrome Scale (PANSS-6) was derived empirically from the full 30-item PANSS and what the initial results obtained with PANSS-6 entail; and 3) how PANSS-6 ratings, guided by the newly developed, 15-25-minute, stand-alone Simplified Negative and Positive Symptoms Interview (SNAPSI), might help bridge the measurement gap between research and clinical care in schizophrenia. The full 30-item PANSS is often used in research studies, but is too time consuming to allow for routine clinical use. Recent studies suggest that the much briefer PANSS-6 is a psychometrically valid measure of core positive and negative symptoms of schizophrenia and that the scale is sensitive to symptom improvement following pharmacological treatment. SNAPSI is a brief interview that yields the information needed to rate PANSS-6 (and other brief rating scales). We believe that PANSS-6 ratings guided by SNAPSI will help bridge the measurement gap between research and clinical care in schizophrenia.

Development of a French Version of the Edmonton Symptom Assessment System-Revised: A Pilot Study of Palliative Care Patients' Perspectives.

PubMed

Nekolaichuk, Cheryl; Huot, Ann; Gratton, Valérie; Bush, Shirley H; Tarumi, Yoko; Watanabe, Sharon M

2017-09-01

The Edmonton Symptom Assessment System-revised (ESAS-r) is a nine-item self-report symptom intensity tool developed for palliative care patients, with the option of adding a 10th patient-specific symptom. Due to growing international uptake, the ESAS-r has been translated into different languages. There has not been agreement, however, regarding a standard process for translation into multiple languages, which also includes patients' perspectives. The purpose of this study was to develop a French version of the ESAS-r, using a standardized translation protocol, and to obtain palliative care patients' perspectives regarding this translated tool. We developed a French version of the ESAS-r, using a standard translation method, involving both professional translators (n = 2) and bilingual palliative care experts (n = 3). Fifteen Francophone participants recruited from palliative care sites in two urban centers in Canada completed the ESAS-r and provided feedback on the translation, in the presence of a trained interviewer. Descriptive statistics and thematic analysis were used to analyze the quantitative and qualitative data, respectively. Fifteen Francophone participants were recruited from palliative care sites in two urban centers in Canada. Participants completed the ESAS-r and provided feedback on the translation in the presence of a trained interviewer. Descriptive statistics and thematic analysis were used to analyze the quantitative and qualitative data, respectively. Based on participants' concerns, translations for four of the nine symptoms were revised: drowsiness, nausea, lack of appetite, and shortness of breath. Concerns expressed for three additional symptoms (depression, anxiety, and well-being) were related to overall difficulty rating these symptoms, not specific to the translation. The French version of the ESAS-r is a credible tool for symptom assessment in Francophone patients. The study findings provide a vital step in the development of a standardized translation protocol, including patients' perspectives, which can be applied to other languages.

Multinational development of a questionnaire assessing patient satisfaction with anticoagulant treatment: the 'Perception of Anticoagulant Treatment Questionnaire' (PACT-Q©)

PubMed Central

Prins, Martin H; Marrel, Alexia; Carita, Paulo; Anderson, David; Bousser, Marie-Germaine; Crijns, Harry; Consoli, Silla; Arnould, Benoit

2009-01-01

Background The side effects and burden of anticoagulant treatments may contribute to poor compliance and consequently to treatment failure. A specific questionnaire is necessary to assess patients' needs and their perceptions of anticoagulant treatment. Methods A conceptual model of expectation and satisfaction with anticoagulant treatment was designed by an advisory board and used to guide patient (n = 31) and clinician (n = 17) interviews in French, US English and Dutch. Patients had either atrial fibrillation (AF), deep venous thrombosis (DVT), or pulmonary embolism (PE). Following interviews, three PACT-Q language versions were developed simultaneously and further pilot-tested by 19 patients. Linguistic validations were performed for additional language versions. Results Initial concepts were developed to cover three areas of interest: 'Treatment', 'Disease and Complications' and 'Information about disease and anticoagulant treatment'. After clinician and patient interviews, concepts were further refined into four domains and 17 concepts; test versions of the PACT-Q were then created simultaneously in three languages, each containing 27 items grouped into four domains: "Treatment Expectations" (7 items), "Convenience" (11 items), "Burden of Disease and Treatment" (2 items) and "Anticoagulant Treatment Satisfaction" (7 items). No item was deleted or added after pilot testing as patients found the PACT-Q easy to understand and appropriate in length in all languages. The PACT-Q was divided into two parts: the first part to measure the expectations and the second to measure the convenience, burden and treatment satisfaction, for evaluation prior to and after anticoagulant treatment, respectively. Eleven additional language versions were linguistically validated. Conclusion The PACT-Q has been rigorously developed and linguistically validated. It is available in 14 languages for use with thromboembolic patients, including AF, PE and DVT patients. Its validation and psychometric properties have been tested and are presented in a separate manuscript. PMID:19196486

The Plastic Surgery Match: A Quantitative Analysis of Applicant Impressions From the Interview Visit.

PubMed

Frojo, Gianfranco; Tadisina, Kashyap Komarraju; Pressman, Zachary; Chibnall, John T; Lin, Alexander Y; Kraemer, Bruce A

2016-12-01

The integrated plastic surgery match is a competitive process not only for applicants but also for programs vying for highly qualified candidates. Interactions between applicants and program constituents are limited to a single interview visit. The authors aimed to identify components of the interview visit that influence applicant decision making when determining a final program rank list. Thirty-six applicants who were interviewed (100% response) completed the survey. Applicants rated the importance of 20 elements of the interview visit regarding future ranking of the program on a 1 to 5 Likert scale. Data were analyzed using descriptive statistics, hierarchical cluster analysis, analysis of variance, and Pearson correlations. A literature review was performed regarding the plastic surgery integrated residency interview process. Survey questions were categorized into four groups based on mean survey responses:1. Interactions with faculty and residents (mean response > 4),2. Information about the program (3.5-4),3. Ancillaries (food, amenities, stipends) (3-3.5),4. Hospital tour, hotel (<3).Hierarchical item cluster analysis and analysis of variance testing validated these groupings. Average summary scores were calculated for the items representing Interactions, Information, and Ancillaries. Correlation analysis between clusters yielded no significant correlations. A review of the literature yielded a paucity of data on analysis of the interview visit. The interview visit consists of a discrete hierarchy of perceived importance by applicants. The strongest independent factor in determining future program ranking is the quality of interactions between applicants and program constituents on the interview visit. This calls for further investigation and optimization of the interview visit experience.

Parent Interview Schedule.

ERIC Educational Resources Information Center

Purdue Univ., Lafayette, IN. Educational Research Center.

This 116-item interview schedule designed for parents who failed to respond to the Questionnaire for Parents, is individually administered to the mother of the child of elementary school age. It consists of scales measuring 14 parent variables plus a section devoted to demographic variables: (1) parent's achievement aspirations for the child, (2)…

Preservice to Inservice: Does Mathematics Anxiety Change with Teaching Experience?

ERIC Educational Resources Information Center

Gresham, Gina

2018-01-01

Inservice teachers, participants in a prior study on mathematics anxiety, were revisited to determine whether their levels of mathematics anxiety still existed and/or continued to change after 5 years teaching experience. A 98-item Likert-type survey, informal discussions, informal interviews, and questionnaire-guided narrative interviews were…

Evaluating verbal and non-verbal communication skills, in an ethnogeriatric OSCE.

PubMed

Collins, Lauren G; Schrimmer, Anne; Diamond, James; Burke, Janice

2011-05-01

Communication during medical interviews plays a large role in patient adherence, satisfaction with care, and health outcomes. Both verbal and non-verbal communication (NVC) skills are central to the development of rapport between patients and healthcare professionals. The purpose of this study was to assess the role of non-verbal and verbal communication skills on evaluations by standardized patients during an ethnogeriatric Objective Structured Clinical Examination (OSCE). Interviews from 19 medical students, residents, and fellows in an ethnogeriatric OSCE were analyzed. Each interview was videotaped and evaluated on a 14 item verbal and an 8 item non-verbal communication checklist. The relationship between verbal and non-verbal communication skills on interview evaluations by standardized patients were examined using correlational analyses. Maintaining adequate facial expression (FE), using affirmative gestures (AG), and limiting both unpurposive movements (UM) and hand gestures (HG) had a significant positive effect on perception of interview quality during this OSCE. Non-verbal communication skills played a role in perception of overall interview quality as well as perception of culturally competent communication. Incorporating formative and summative evaluation of both verbal and non-verbal communication skills may be a critical component of curricular innovations in ethnogeriatrics, such as the OSCE. Copyright © 2010 Elsevier Ireland Ltd. All rights reserved.

Item Banks for Measuring Emotional Distress From the Patient-Reported Outcomes Measurement Information System (PROMIS®): Depression, Anxiety, and Anger

PubMed Central

Pilkonis, Paul A.; Choi, Seung W.; Reise, Steven P.; Stover, Angela M.; Riley, William T.; Cella, David

2011-01-01

The authors report on the development and calibration of item banks for depression, anxiety, and anger as part of the Patient-Reported Outcomes Measurement Information System (PROMIS®). Comprehensive literature searches yielded an initial bank of 1,404 items from 305 instruments. After qualitative item analysis (including focus groups and cognitive interviewing), 168 items (56 for each construct) were written in a first person, past tense format with a 7-day time frame and five response options reflecting frequency. The calibration sample included nearly 15,000 respondents. Final banks of 28, 29, and 29 items were calibrated for depression, anxiety, and anger, respectively, using item response theory. Test information curves showed that the PROMIS item banks provided more information than conventional measures in a range of severity from approximately −1 to +3 standard deviations (with higher scores indicating greater distress). Short forms consisting of seven to eight items provided information comparable to legacy measures containing more items. PMID:21697139

Item banks for measuring emotional distress from the Patient-Reported Outcomes Measurement Information System (PROMIS®): depression, anxiety, and anger.

PubMed

Pilkonis, Paul A; Choi, Seung W; Reise, Steven P; Stover, Angela M; Riley, William T; Cella, David

2011-09-01

The authors report on the development and calibration of item banks for depression, anxiety, and anger as part of the Patient-Reported Outcomes Measurement Information System (PROMIS®). Comprehensive literature searches yielded an initial bank of 1,404 items from 305 instruments. After qualitative item analysis (including focus groups and cognitive interviewing), 168 items (56 for each construct) were written in a first person, past tense format with a 7-day time frame and five response options reflecting frequency. The calibration sample included nearly 15,000 respondents. Final banks of 28, 29, and 29 items were calibrated for depression, anxiety, and anger, respectively, using item response theory. Test information curves showed that the PROMIS item banks provided more information than conventional measures in a range of severity from approximately -1 to +3 standard deviations (with higher scores indicating greater distress). Short forms consisting of seven to eight items provided information comparable to legacy measures containing more items.

A Psychometric Comparison of the Clinical Assessment Interview for Negative Symptoms and the Brief Negative Symptom Scale.

PubMed

Strauss, Gregory P; Gold, James M

2016-11-01

In 2005, the National Institute of Mental Health held a consensus development conference on negative symptoms of schizophrenia. Among the important conclusions of this meeting were that there are at least 5 commonly accepted domains of negative symptoms (blunted affect, alogia, avolition, anhedonia, asociality) and that new rating scales were needed to adequately assess these constructs. Two next-generation negative symptom scales resulted from this meeting: the Brief Negative Symptom Scale (BNSS) and Clinical Assessment Interview for Negative Symptoms (CAINS). Both measures are becoming widely used and studies have demonstrated good psychometric properties for each scale. The current study provides the first direct psychometric comparison of these scales. Participants included 65 outpatients diagnosed with schizophrenia or schizoaffective disorder who completed clinical interviews, questionnaires, and neuropsychological testing. Separate raters completed the BNSS and CAINS within the same week. Results indicated that both measures had good internal consistency, convergent validity, and discriminant validity. High correspondence was observed between CAINS and BNSS blunted affect and alogia items. Moderate convergence occurred for avolition and asociality items, and low convergence was seen among anhedonia items. Findings suggest that both scales have good psychometric properties, but that there are important distinctions among the items related to motivation and pleasure. © The Author 2016. Published by Oxford University Press on behalf of the Maryland Psychiatric Research Center. All rights reserved. For permissions, please email: journals.permissions@oup.com.

Measuring pain in the context of homelessness

PubMed Central

Matter, Rebecca; Kline, Susan; Cook, Karon F.; Amtmann, Dagmar

2009-01-01

Purpose The primary objective of this study was to inform the development of measures of pain impact appropriate for all respondents, including homeless individuals, so that they can be used in clinical research and practice. The secondary objective was to increase understanding about the unique experience of homeless people with pain. Methods Seventeen homeless individuals with chronic health conditions (often associated with pain) participated in cognitive interviews to test the functioning of 56 pain measurement items and provided information about their experience living with and accessing treatment for pain. Results The most common problems identified with items were that they lacked clarity or were irrelevant in the context of homelessness. Items that were unclear, irrelevant and/or had other identified problems made it difficult for participants to respond. Participants also described multiple ways in which their pain was exacerbated by conditions of homelessness and identified barriers to accessing appropriate treatment. Conclusions Results suggested that the majority of items were problematic for the homeless and require substantial modifications to make the pain impact bank relevant to this population. Additional recommendations include involving homeless in future item bank development, conducting research on the topic of pain and homelessness, and using cognitive interviewing in other types of health disparities research. PMID:19582592

Discrimination and Romani health: a validation study of discrimination scales among Romani women in Macedonia and Serbia.

PubMed

Janevic, T; Gundersen, D; Stojanovski, K; Jankovic, J; Nikolic, Z; Kasapinov, B

2015-09-01

Scales used to assess discrimination in public health research have rarely been validated outside of high income countries. Our objective was to validate the Experiences of Discrimination (EOD) scale and the Everyday Discrimination Scale (EDS) among 410 Romani women in Macedonia and Serbia. Romani female interviewers conducted interviews in 2012-2013. We used a multiple indicator multiple cause approach to test a one-factor model for each scale and to assess differential item functioning (DIF) by age, wealth, country, and education. We also measured associations between the EOD and EDS with smoking in the past year and psychological distress. Three items of the EOD were conceptually irrelevant. Two items of the EDS were not conditionally independent. DIF was found by country for one item in each scale. After excluding these items, all scales exhibited good model fit and were associated with smoking (EOD beta = 0.40, 95% CI = 0.18, 0.63; EDS beta = 0.33, 95% CI = 0.12, 0.54) and psychological distress (EOD beta = 0.26, 95% CI = 0.15, 0.37; EDS beta = 0.26, 95% CI = 0.04, 0.47). Discrimination scales can be adapted for use among Romani women and are associated with both smoking and psychological distress.

The development and exploratory analysis of the Back Pain Attitudes Questionnaire (Back-PAQ).

PubMed

Darlow, Ben; Perry, Meredith; Mathieson, Fiona; Stanley, James; Melloh, Markus; Marsh, Reginald; Baxter, G David; Dowell, Anthony

2014-05-23

To develop an instrument to assess attitudes and underlying beliefs about back pain, and subsequently investigate its internal consistency and underlying structures. The instrument was developed by a multidisciplinary team of clinicians and researchers based on analysis of qualitative interviews with people experiencing acute and chronic back pain. Exploratory analysis was conducted using data from a population-based cross-sectional survey. Qualitative interviews with community-based participants and subsequent postal survey. Instrument development informed by interviews with 12 participants with acute back pain and 11 participants with chronic back pain. Data for exploratory analysis collected from New Zealand residents and citizens aged 18 years and above. 1000 participants were randomly selected from the New Zealand Electoral Roll. 602 valid responses were received. The 34-item Back Pain Attitudes Questionnaire (Back-PAQ) was developed. Internal consistency was evaluated by the Cronbach α coefficient. Exploratory analysis investigated the structure of the data using Principal Component Analysis. The 34-item long form of the scale had acceptable internal consistency (α=0.70; 95% CI 0.66 to 0.73). Exploratory analysis identified five two-item principal components which accounted for 74% of the variance in the reduced data set: 'vulnerability of the back'; 'relationship between back pain and injury'; 'activity participation while experiencing back pain'; 'prognosis of back pain' and 'psychological influences on recovery'. Internal consistency was acceptable for the reduced 10-item scale (α=0.61; 95% CI 0.56 to 0.66) and the identified components (α between 0.50 and 0.78). The 34-item long form of the scale may be appropriate for use in future cross-sectional studies. The 10-item short form may be appropriate for use as a screening tool, or an outcome assessment instrument. Further testing of the 10-item Back-PAQ's construct validity, reliability, responsiveness to change and predictive ability needs to be conducted. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

Development and psychometric evaluation of a Catalan self- and interviewer-administered version of the Pediatric Quality of Life Inventory version 4.0.

PubMed

Huguet, Anna; Miró, Jordi

2008-01-01

The purposes of this study were to develop and to assess the psychometric properties of a Catalan self- and interviewer-administered version of the Pediatric Quality of Life Inventory Generic Core Scales (PedsQL) with a sample of schoolchildren, and to examine the equivalence between both versions. 511 schoolchildren aged between 9 and 17 years old participated in the study. In addition to completing a Catalan self-administered version of the PedsQL, each child was interviewed individually. Confirmatory factor analysis did not support the original Varni's proposal. Instead, a short 12-item version was derived. The higher-order scales for both versions were internally consistent. Moreover, relationships between ratings of children's quality of life were generally significant; both versions were also found to be related with another measure of quality of life supporting their validity. A new administration form for the PedsQL is presented in this study. The psychometric properties of both self- and interviewer-administered short 12-item versions are reassuring albeit with a few areas of improvement. Further studies are needed to investigate whether self- and interviewer-administered versions can really be considered to be comparable.

Item Response Theory Analysis of the Psychopathic Personality Inventory-Revised.

PubMed

Eichenbaum, Alexander E; Marcus, David K; French, Brian F

2017-06-01

This study examined item and scale functioning in the Psychopathic Personality Inventory-Revised (PPI-R) using an item response theory analysis. PPI-R protocols from 1,052 college student participants (348 male, 704 female) were analyzed. Analyses were conducted on the 131 self-report items comprising the PPI-R's eight content scales, using a graded response model. Scales collected a majority of their information about respondents possessing higher than average levels of the traits being measured. Each scale contained at least some items that evidenced limited ability to differentiate between respondents with differing levels of the trait being measured. Moreover, 80 items (61.1%) yielded significantly different responses between men and women presumably possessing similar levels of the trait being measured. Item performance was also influenced by the scoring format (directly scored vs. reverse-scored) of the items. Overall, the results suggest that the PPI-R, despite identifying psychopathic personality traits in individuals possessing high levels of those traits, may not identify these traits equally well for men and women, and scores are likely influenced by the scoring format of the individual item and scale.

Environmental Compliance Assessment for Army Reserves (ECAAR)

DTIC Science & Technology

1991-11-01

The number of environmental laws and regulations has continued to grow in the United States and worldwide, making compliance with these regulations...they became notices of violation. The concept was to combine Code of Federal Regulations and Army environmental regulations, with good management...items or operations to review, and would list a point of contact for that item to help assessors review the questions, or protocols, quickly and easily

Development of the chronic obstructive pulmonary disease morning symptom diary (COPD-MSD).

PubMed

Globe, Gary; Currie, Brooke; Leidy, Nancy Kline; Jones, Paul; Mannino, David; Martinez, Fernando; Klekotka, Paul; O'Quinn, Sean; Karlsson, Niklas; Wiklund, Ingela

2016-07-16

The morning tends to be the most difficult time of day for many patients with chronic obstructive pulmonary disease (COPD) when symptoms can limit one's ability to perform even simple activities. Morning symptoms have been linked to higher levels of work absenteeism, thereby increasing the already substantial economic burden associated with COPD. A validated patient-reported outcome (PRO) instrument designed to capture morning symptoms will allow for a more comprehensive approach to the evaluation of treatment benefit in COPD clinical trials. A qualitative interview study was conducted among a sample of symptomatic adults with COPD. Concept elicitation interviews (n = 35) were conducted to identify COPD morning symptoms, followed by cognitive interviews (n = 21) to ensure patient comprehension of the items, instructions and response options of the draft COPD Morning Symptom Diary (COPD-MSD). All interview transcript data were coded using ATLAS.ti software for content analysis. Mean age of the concept elicitation and cognitive interview sample was 65.0 years (±7.5) and 62.3 years (±8.3), respectively. The study sample represented the full range of COPD severity (Global Initiative for Chronic Lung Disease [GOLD] classifications I-IV) and included a mix of racial backgrounds, employment status and educational achievement. During the concept elicitation interviews, the three most frequently reported morning symptoms were shortness of breath (n = 35/35; 100 %), phlegm/mucus (n = 31/35; 88.6 %), and cough (n = 30/35; 85.7 %). A group of clinical and instrument development experts convened to review the concept elicitation data and develop the initial 32-item draft COPD-MSD. Cognitive interviews indicated subjects found the draft COPD-MSD to be comprehensive, clear, and easy to understand. The COPD-MSD underwent minor editorial revisions and streamlining based on cognitive interviews and input from the experts to yield the final 19-item daily diary. This study supports the content validity of the new COPD-MSD and positions the diary for quantitative psychometric testing.

Factor structure and clinical utility of the Beck depression inventory in patients with binge eating disorder and obesity.

PubMed

Udo, Tomoko; McKee, Sherry A; Grilo, Carlos M

2015-01-01

The Beck Depression Inventory (BDI) is often used to assess depression symptoms, but its factor structure and its clinical utility have not been evaluated in patients with binge eating disorder (BED) and obesity. A total of 882 treatment-seeking obese patients with BED were administered structured interviews (Structured Clinical Interview for Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition Axis I Disorders) and completed self-report questionnaires. Exploratory and confirmatory factor analyses supported a brief 16-item BDI version with a three-factor structure (affective, attitudinal and somatic). Both 21- and 16-item versions showed excellent internal consistency (both α=0.89) and had significant correlation patterns with different aspects of eating disorder psychopathology; three factors showed significant but variable associations with eating disorder psychopathology. Area under the curves (AUC) for both BDI versions were significant in predicting major depressive disorder (MDD; AUC=0.773 [16-item], 73.5% sensitivity/70.2% specificity, AUC=0.769 [21-item], 79.5% sensitivity/64.1% specificity) and mood disorders (AUC=0.763 [16-item], 67.1% sensitivity/71.5% specificity, AUC=0.769 [21-item], 84.2% sensitivity/55.7% specificity). The 21-item BDI (cutoff score ≥16) showed higher negative predictive values (94.0% vs. 93.0% [MDD]; 92.4% vs. 88.3% [mood disorders]) than the brief 16-item BDI (cutoff score ≥13). Both BDI versions demonstrated moderate performance as a screening instrument for MDD/mood disorders in obese patients with BED. Advantages and disadvantages for both versions are discussed. A three-factor structure has potential to inform the conceptualization of depression features. Copyright © 2015 Elsevier Inc. All rights reserved.

Health Literacy Screening of Geriatric Monolingual Spanish-Speaking Patients Using Single-Item Literacy Screening Questions and Education

ERIC Educational Resources Information Center

Cordasco, Kristina M.; Homeier, Diana C.; Franco, Idalid; Wang, Pin-Chieh; Sarkisian, Catherine A.

2012-01-01

Objective: We describe the performance of Single Item Literacy Screener (SILS) questions, and educational attainment, as screening for inadequate health literacy (IHL) in older monolingual Spanish speakers. Design: We used a cross-sectional design, interviewing participants once at the time of their arrival for a clinic appointment. Setting: We…

Development of a Postacute Hospital Item Bank for the New Pediatric Evaluation of Disability Inventory-Computer Adaptive Test

ERIC Educational Resources Information Center

Dumas, Helene M.

2010-01-01

The PEDI-CAT is a new computer adaptive test (CAT) version of the Pediatric Evaluation of Disability Inventory (PEDI). Additional PEDI-CAT items specific to postacute pediatric hospital care were recently developed using expert reviews and cognitive interviewing techniques. Expert reviews established face and construct validity, providing positive…

Assessing Traumatic Event Exposure: Comparing the Traumatic Life Events Questionnaire to the Structured Clinical Interview for "DSM-IV"

ERIC Educational Resources Information Center

Peirce, Jessica M.; Burke, Christopher K.; Stoller, Kenneth B.; Neufeld, Karin J.; Brooner, Robert K.

2009-01-01

Post-traumatic stress disorder (PTSD) diagnosis requires first identifying a traumatic event, but very few studies have evaluated methods of potential traumatic event assessment and their impact on PTSD diagnosis. The authors compared a behaviorally specific comprehensive multiple-item traumatic event measure with a single-item measure to…

Children's Understandings Related to Hazardous Household Items and Waste

ERIC Educational Resources Information Center

Malandrakis, George N.

2008-01-01

This study focuses on children's understanding of hazardous household items (HHI) and waste (HHW). Children from grades 4, 5 and 6 (n=173) participated in a questionnaire and interview research design. The results indicate that: (a) on a daily basis the children used HHI and disposed of HHW, (b) the children did not realize the danger of these…

Adolescent Girls' Perceptions of Smoking Risk and Protective Factors: Implications for Message Design

ERIC Educational Resources Information Center

Curbow, Barbara; Bowie, Janice; Binko, JoAnn; Smith, Stephanie; Dreyling, Erin; McDonnell, Karen A.

2007-01-01

Using a snowball technique, in-depth interviews were conducted with 108 girls emanating from seven demographically dissimilar social networks. Girls were asked to classify 58 items as either a risk or protective factor for smoking initiation and then to assign an importance weighting to each. All items except one (worries about her weight) were…

Development and Field Test of an Audit Tool and Tracer Methodology for Clinician Assessment of Quality in End-of-Life Care.

PubMed

Bookbinder, Marilyn; Hugodot, Amandine; Freeman, Katherine; Homel, Peter; Santiago, Elisabeth; Riggs, Alexa; Gavin, Maggie; Chu, Alice; Brady, Ellen; Lesage, Pauline; Portenoy, Russell K

2018-02-01

Quality improvement in end-of-life care generally acquires data from charts or caregivers. "Tracer" methodology, which assesses real-time information from multiple sources, may provide complementary information. The objective of this study was to develop a valid brief audit tool that can guide assessment and rate care when used in a clinician tracer to evaluate the quality of care for the dying patient. To identify items for a brief audit tool, 248 items were created to evaluate overall quality, quality in specific content areas (e.g., symptom management), and specific practices. Collected into three instruments, these items were used to interview professional caregivers and evaluate the charts of hospitalized patients who died. Evidence that this information could be validly captured using a small number of items was obtained through factor analyses, canonical correlations, and group comparisons. A nurse manager field tested tracer methodology using candidate items to evaluate the care provided to other patients who died. The survey of 145 deaths provided chart data and data from 445 interviews (26 physicians, 108 nurses, 18 social workers, and nine chaplains). The analyses yielded evidence of construct validity for a small number of items, demonstrating significant correlations between these items and content areas identified as latent variables in factor analyses. Criterion validity was suggested by significant differences in the ratings on these items between the palliative care unit and other units. The field test evaluated 127 deaths, demonstrated the feasibility of tracer methodology, and informed reworking of the candidate items into the 14-item Tracer EoLC v1. The Tracer EoLC v1 can be used with tracer methodology to guide the assessment and rate the quality of end-of-life care. Copyright © 2017 American Academy of Hospice and Palliative Medicine. Published by Elsevier Inc. All rights reserved.

Reducing sick leave of Dutch vocational school students: adaptation of a sick leave protocol using the intervention mapping process.

PubMed

de Kroon, Marlou L A; Bulthuis, Jozien; Mulder, Wico; Schaafsma, Frederieke G; Anema, Johannes R

2016-12-01

Since the extent of sick leave and the problems of vocational school students are relatively large, we aimed to tailor a sick leave protocol at Dutch lower secondary education schools to the particular context of vocational schools. Four steps of the iterative process of Intervention Mapping (IM) to adapt this protocol were carried out: (1) performing a needs assessment and defining a program objective, (2) determining the performance and change objectives, (3) identifying theory-based methods and practical strategies and (4) developing a program plan. Interviews with students using structured questionnaires, in-depth interviews with relevant stakeholders, a literature research and, finally, a pilot implementation were carried out. A sick leave protocol was developed that was feasible and acceptable for all stakeholders. The main barriers for widespread implementation are time constraints in both monitoring and acting upon sick leave by school and youth health care. The iterative process of IM has shown its merits in the adaptation of the manual 'A quick return to school is much better' to a sick leave protocol for vocational school students.

Handling of drug-related emergencies: an evaluation of emergency medical dispatch.

PubMed

Tonje, Lorem; Elisabeth, Saether; Lars, Wik

2009-02-01

Documenting the quality of emergency dispatch centres handling of emergency calls regarding intoxicated unconscious patients. Interview with eight emergency dispatch centre directors and a nationwide survey among 313 dispatchers in Norway were performed. In addition, a customized scoring system was used to evaluate dispatcher log recordings of real cases. The recordings were compared with information from corresponding ambulance records. Ninety-nine percent of the dispatchers stated that they used the Norwegian protocol for medical emergencies and 89% of them found it useful. The interviews, the survey, and the recordings, however, documented frequent deviation from the protocol. This instructs ambulance dispatch for any unconscious patient, but 21% stated that they would not dispatch any resource for an unconscious patient without further survey in alcohol-related cases. This was significantly more often (P<0.05) than for the narcotic, combination and prescription - drug-related cases with 4, 10 and 7%, respectively. The recordings revealed deviation from the protocol with dispatchers only determining the patients' level of consciousness and respiratory status in 64 and 70% of the cases, respectively. For 16% of the cases, the dispatcher did not ask the caller about consciousness at all, even though these patients later were found with reduced consciousness. On the basis of the interviews and the survey, cases were handled according to guidelines. The log recordings, however, disclosed deviation from the protocol. Alcohol intoxication was associated with higher rate of deviation from the protocol compared with other intoxications.

Sample size allocation for food item radiation monitoring and safety inspection.

PubMed

Seto, Mayumi; Uriu, Koichiro

2015-03-01

The objective of this study is to identify a procedure for determining sample size allocation for food radiation inspections of more than one food item to minimize the potential risk to consumers of internal radiation exposure. We consider a simplified case of food radiation monitoring and safety inspection in which a risk manager is required to monitor two food items, milk and spinach, in a contaminated area. Three protocols for food radiation monitoring with different sample size allocations were assessed by simulating random sampling and inspections of milk and spinach in a conceptual monitoring site. Distributions of (131)I and radiocesium concentrations were determined in reference to (131)I and radiocesium concentrations detected in Fukushima prefecture, Japan, for March and April 2011. The results of the simulations suggested that a protocol that allocates sample size to milk and spinach based on the estimation of (131)I and radiocesium concentrations using the apparent decay rate constants sequentially calculated from past monitoring data can most effectively minimize the potential risks of internal radiation exposure. © 2014 Society for Risk Analysis.

Quality of life in dementia patients: nursing home versus home care.

PubMed

Nikmat, Azlina Wati; Hawthorne, Graeme; Al-Mashoor, S Hassan

2011-12-01

Care management providing a high quality of life (QoL) is a crucial issue in dealing with increasing numbers of dementia patients. Although the transition from informal (home-based) care to formal (institutional) care is often a function of dementia stage, for those with early dementia there is currently no definitive evidence showing that informal or formal care provides a higher QoL, particularly where informal care is favored for local cultural reasons. This paper outlines the research protocol for a study comparing formal and informal care in Malaysia. It seeks to provide evidence regarding which is more appropriate and results in higher QoL in early dementia. This is a quasi-experimental study design involving 224 early dementia patients from both nursing home and community settings. Participants will be assessed for cognitive severity, QoL, needs, activities of daily living, depression and social isolation/connectedness by using the Mini-Mental State Examination (MMSE), Cognitive Impairment Scale - 4 items (CIS-4), EUROPE Health Interview Survey-Quality of Life (WHO8), Assessment of Quality of Life (AQoL8), Camberwell Assessment of Need for the Elderly - Short Version (CANE-S), Barthel Index (BI), Cornell Scale for Depression (CSDD), Geriatric Depression Scale - 15 items (GDS-15), and Friendship Scale (FS) respectively. This study aims to provide a better understanding of care needs in early dementia. Given population aging, the study findings will provide evidence assisting decision-making for policies aimed at reducing the burden of caregiving and preserving the QoL of dementia patients.

Behaviors in Advance Care Planning and ACtions Survey (BACPACS): development and validation part 1.

PubMed

Kassam, Aliya; Douglas, Maureen L; Simon, Jessica; Cunningham, Shannon; Fassbender, Konrad; Shaw, Marta; Davison, Sara N

2017-11-22

Although advance care planning (ACP) is fairly well understood, significant barriers to patient participation remain. As a result, tools to assess patient behaviour are required. The objective of this study was to improve the measurement of patient engagement in ACP by detecting existing survey design issues and establishing content and response process validity for a new survey entitled Behaviours in Advance Care Planning and ACtions Survey (BACPACS). We based our new tool on that of an existing ACP engagement survey. Initial item reduction was carried out using behavior change theories by content and design experts to help reduce response burden and clarify questions. Thirty-two patients with chronic diseases (cancer, heart failure or renal failure) were recruited for the think aloud cognitive interviewing with the new, shortened survey evaluating patient engagement with ACP. Of these, n = 27 had data eligible for analysis (n = 8 in round 1 and n = 19 in rounds 2 and 3). Interviews were audio-recorded and analyzed using the constant comparison method. Three reviewers independently listened to the interviews, summarized findings and discussed discrepancies until consensus was achieved. Item reduction from key content expert review and conversation analysis helped decrease number of items from 116 in the original ACP Engagement Survey to 24-38 in the new BACPACS depending on branching of responses. For the think aloud study, three rounds of interviews were needed until saturation for patient clarity was achieved. The understanding of ACP as a construct, survey response options, instructions and terminology pertaining to patient engagement in ACP warranted further clarification. Conversation analysis, content expert review and think aloud cognitive interviewing were useful in refining the new survey instrument entitled BACPACS. We found evidence for both content and response process validity for this new tool.

Evaluating a Modular Design Approach to Collecting Survey Data Using Text Messages

PubMed Central

West, Brady T.; Ghimire, Dirgha; Axinn, William G.

2015-01-01

This article presents analyses of data from a pilot study in Nepal that was designed to provide an initial examination of the errors and costs associated with an innovative methodology for survey data collection. We embedded a randomized experiment within a long-standing panel survey, collecting data on a small number of items with varying sensitivity from a probability sample of 450 young Nepalese adults. Survey items ranged from simple demographics to indicators of substance abuse and mental health problems. Sampled adults were randomly assigned to one of three different modes of data collection: 1) a standard one-time telephone interview, 2) a “single sitting” back-and-forth interview with an interviewer using text messaging, and 3) an interview using text messages within a modular design framework (which generally involves breaking the survey response task into distinct parts over a short period of time). Respondents in the modular group were asked to respond (via text message exchanges with an interviewer) to only one question on a given day, rather than complete the entire survey. Both bivariate and multivariate analyses demonstrate that the two text messaging modes increased the probability of disclosing sensitive information relative to the telephone mode, and that respondents in the modular design group, while responding less frequently, found the survey to be significantly easier. Further, those who responded in the modular group were not unique in terms of available covariates, suggesting that the reduced item response rates only introduced limited nonresponse bias. Future research should consider enhancing this methodology, applying it with other modes of data collection (e. g., web surveys), and continuously evaluating its effectiveness from a total survey error perspective. PMID:26322137

[Item function analysis on the Quality of Life-Alzheimer's Disease(QOL-AD)Chinese version, based on the Item Response Theory(IRT)].

PubMed

Wan, Li-ping; He, Run-lian; Ai, Yong-mei; Zhang, Hui-min; Xing, Min; Yang, Lin; Song, Yan-long; Yu, Hong-mei

2013-07-01

To introduce the Item Function Analysis(IFA) of Quality of Life- Alzheimer's disease(QOL-AD)Chinese version and to explore the feasibility of its application on Chinese patients with AD. Two hundred AD patients were interviewed and assessed by QOL-AD, through the stratified cluster sampling method. Multilog 7.03. was used for Item Function Analysis. Difference scale(a), difficulty scale(b)and Item Characteristic Curve(ICC) of each item of QOL-AD were provided. Different scales of the item 1, 7 were below 0.6, while all the others were above 0.6. As for ICC. The first and last lines for the other items were monotonic in which the two in between were in inverted V-shape, with very steep slopes, except for the item 1 and 7. Results form the IFA showed that QOL-AD was applicable to be used in the Chinese patients with AD.

Comparing Cognitive Interviewing and Online Probing: Do They Find Similar Results?

ERIC Educational Resources Information Center

Meitinger, Katharina; Behr, Dorothée

2016-01-01

This study compares the application of probing techniques in cognitive interviewing (CI) and online probing (OP). Even though the probing is similar, the methods differ regarding typical mode setting, sample size, level of interactivity, and goals. We analyzed probing answers to the International Social Survey Programme item battery on specific…

New Interview and Observation Measures of the Broader Autism Phenotype: Impressions of Interviewee Measure

ERIC Educational Resources Information Center

Pickles, A.; Parr, J. R.; Rutter, M. L.; De Jonge, M. V.; Wallace, S.; Le Couteur, A. S.; van Engeland, H.; Wittemeyer, K.; McConachie, H.; Roge, B.; Mantoulan, C.; Pedersen, L.; Isager, T.; Poustka, F.; Bolte, S.; Bolton, P.; Weisblatt, E.; Green, J.; Papanikolaou, K.; Bailey, A. J.

2013-01-01

A 20 item observational measure of social functioning, the Impression of Interviewee rating scale, is one of three measures devised to assess the broader autism phenotype. The sample studied included families containing at least two individuals with autism spectrum disorder; observations were undertaken by the researcher who interviewed the…

The Semistructured Interview for Consideration of Ethnic Culture in Therapy Scale: Initial Psychometric and Outcome Support

ERIC Educational Resources Information Center

Donohue, Brad; Strada, Marilyn J.; Rosales, Rocio; Taylor-Caldwell, Aundrea; Hise, Dortha; Ahman, Sarah; Lefforge, Noelle L.; Kopof, Monique; Devore, Greg; Soares, Bruno; Radkovich, Ben; Laino, Rowena

2006-01-01

There has been recent pressure for practitioners to consider cultural variables when implementing evidence-based interventions. Therefore, the Semistructured Interview for Consideration of Ethnic Culture in Therapy Scale (SSICECTS) was empirically developed to address this issue. First, psychometric properties of a 6-item scale were evaluated in…

Validation of the Brazilian Portuguese Version of Geriatric Anxiety Inventory--GAI-BR.

PubMed

Massena, Patrícia Nitschke; de Araújo, Narahyana Bom; Pachana, Nancy; Laks, Jerson; de Pádua, Analuiza Camozzato

2015-07-01

The Geriatric Anxiety Inventory (GAI) is a recently developed scale aiming to evaluate symptoms of anxiety in later life. This 20-item scale uses dichotomous answers highlighting non-somatic anxiety complaints of elderly people. The present study aimed to evaluate the psychometric properties of the Brazilian Portuguese version GAI (GAI-BR) in a sample from community and outpatient psychogeriatric clinic. A mixed convenience sample of 72 subjects was recruited for answering the research protocol. The interview procedures were structured with questionnaires about sociodemographic data, clinical health status, anxiety, and depression previously validated instruments, Mini-Mental State Examination, Mini International Neuropsychiatric Interview, and GAI-BR. Twenty-two percent of the sample were interviewed twice for test-retest reliability. For internal consistency analyses, the Cronbach's α test was applied. The Spearman correlation test was applied to evaluate the test-retest GAI-BR reliability. A ROC (receiver operating characteristic) curve study was made to estimate the GAI-BR area under curve, cut-off points, sensitivity, and specificity for the Generalized Anxiety Disorder diagnosis. The GAI-BR version showed high internal consistency (Cronbach's α = 0.91) and strong and significant test-retest reliability (ρ = 0.85, p < 0.001). It also showed moderate and significant correlation with the Beck Anxiety Inventory (ρ = 0.68, p < 0.001) and the State-Trait Anxiety Inventory (ρ = 0.61, p < 0.001) showing evidence of concurrent validation. The cut-off point of 13 estimated by ROC curve analyses showed sensitivity of 83.3% and specificity of 84.6% to detect Generalized Anxiety Disorder (DSM-IV). GAI-BR has demonstrated very good psychometric properties and can be a reliable instrument to measure anxiety in Brazilian elderly people.

Rendering clinical psychology an evidence-based scientific discipline: a case study.

PubMed

St Stoyanov, Drozdstoj; Machamer, Peter K; Schaffner, Kenneth F

2012-02-01

Both modern neuroscience and clinical psychology taken as separate fields have failed to reveal the explanatory mechanisms underlying mental disorders. The evidence acquired inside the mono-disciplinary matrices of neurobiology, clinical psychology and psychopathology are deeply insufficient in terms of their validity, reliability and utility. Further, no effective trans-disciplinary connections have been developed between them. In this context, our case study aims at illustrating some specific facets of clinical psychology as a crucial discipline for explaining and understanding mental disorder. The methods employed in clinical psychology are scrutinized using the exemplar case of the Minnesota Multiphasic Personality Inventory (MMPI). We demonstrate that a clinical interview and a clinical psychological rating scale consist of the same kind of cognitive content. The provisional difference can be described in terms of its having two comparable complementary cognitive structures. The test is composed of self-evaluation reports (items) formulated as questions or statements. The psychopathological structured interview is formulated in terms of subjective experience indicated as symptoms (these are self-reports recorded by the physician), complemented with the so-called 'signs' or the presumably 'objective' observations of the overt behaviours of the patient. However, the cognitive content of clinical judgment is beyond any doubt as subjective as the narrative of the patient. None of the components of the structured psychopathological interview is independent of the inter-subjective system created in the situation of clinical assessment. Therefore, the protocols from various clinicians that serve to sustain the reliability claim of the 'scientific' Diagnostic Statistical Manual of Mental Disorders cannot be regarded as independent measurements of the cognitive content and value of the psychological rating scales or vice versa. © 2011 Blackwell Publishing Ltd.

Validating a multiple mini-interview question bank assessing entry-level reasoning skills in candidates for graduate-entry medicine and dentistry programmes.

PubMed

Roberts, Chris; Zoanetti, Nathan; Rothnie, Imogene

2009-04-01

The multiple mini-interview (MMI) was initially designed to test non-cognitive characteristics related to professionalism in entry-level students. However, it may be testing cognitive reasoning skills. Candidates to medical and dental schools come from diverse backgrounds and it is important for the validity and fairness of the MMI that these background factors do not impact on their scores. A suite of advanced psychometric techniques drawn from item response theory (IRT) was used to validate an MMI question bank in order to establish the conceptual equivalence of the questions. Bias against candidate subgroups of equal ability was investigated using differential item functioning (DIF) analysis. All 39 questions had a good fit to the IRT model. Of the 195 checklist items, none were found to have significant DIF after visual inspection of expected score curves, consideration of the number of applicants per category, and evaluation of the magnitude of the DIF parameter estimates. The question bank contains items that have been studied carefully in terms of model fit and DIF. Questions appear to measure a cognitive unidimensional construct, 'entry-level reasoning skills in professionalism', as suggested by goodness-of-fit statistics. The lack of items exhibiting DIF is encouraging in a contemporary high-stakes admission setting where candidates of diverse personal, cultural and academic backgrounds are assessed by common means. This IRT approach has potential to provide assessment designers with a quality control procedure that extends to the level of checklist items.

Content validity of the NCCN-FACT ovarian symptom index-18 (NFOSI-18).

PubMed

Jensen, Sally E; Kaiser, Karen; Lacson, Leilani; Schink, Julian; Cella, David

2015-02-01

This study examined the content validity of the NCCN-FACT Ovarian Symptom Index-18 (NFOSI-18), an advanced ovarian cancer symptom index comprised of symptoms perceived as most important by clinical experts and women with advanced ovarian cancer. Eighteen women with advanced ovarian cancer completed the NFOSI-18 and participated in cognitive interviews to assess: (a) the understandability of the NFOSI-18; and (b) the things patients have in mind when responding to the item, "I am bothered by side effects of treatment;" and (c) the interpretation patients place on items relating to fatigue and lack of energy. Interviews were recorded and transcribed for qualitative analysis. All but 2 (89%) participants indicated that each item was clear and understandable and the same proportion (89%) stated they were "very confident" or "confident" about providing accurate answers to all but one item. When responding to the item, "I am bothered by side effects of treatment," fatigue, nausea, and neuropathy constituted the most frequently mentioned concerns. Among the participants who were asked, eight participants responded that "fatigue" and "lack of energy" were the same concept and nine responded they were different. Participants associated "fatigue" with tiredness and associated "lack of energy" with the inability to perform daily tasks and activities. The findings support the content validity of the NFOSI-18. Item revisions, deletions or additions do not appear warranted. Future research can address the reliability and validity of the NFOSI-18 in clinical research. Copyright © 2014 Elsevier Inc. All rights reserved.

Conducting preference assessments for youth with disorders of consciousness during rehabilitation.

PubMed

Amari, Adrianna; Suskauer, Stacy J; Paasch, Valerie; Grodin, Lauren K; Slomine, Beth S

2017-08-01

Care and rehabilitation for individuals with disorders of consciousness (DOC) can be challenging; the use of observational data collection, individualized treatment programs, and incorporation of preferred, personally meaningful and salient items may be helpful in addressing such challenges during assessment and intervention. In this article, we extend the predominantly adult literature on use of salient items to promote differential responding by describing our methodology to identify preferred items across sensory domains for application during inpatient rehabilitation with children with DOC. Details on the indirect and direct preference assessment procedures rooted in applied behavior analysis that we have tailored for this population are provided. We describe steps of the procedures, including structured caregiver interview, staff survey, item inclusion, in vivo single-item stimulus preference assessment, and treatment. Clinical case examples further illustrate implementation of our methodology, observed response topographies, individually identified preferred items, and their application for 3 children in a minimally conscious state. In addition, we introduce a new structured caregiver interview, the Preference Assessment for Youth with Disorders of Consciousness (PAYDOC), modeled on the Reinforcer Assessment for Individuals with Severe Disabilities (RAISD; Fisher, Piazza, Bowman, & Amari, 1996) and modified to be appropriate for future use as a clinical tool to enhance assessment of preferences with this pediatric brain injury population. This methodology can be used to identify highly idiosyncratic stimuli that can be incorporated in multiple ways throughout rehabilitation to optimize care for youth with DOC. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

Enhancing self-report assessment of PTSD: development of an item bank.

PubMed

Del Vecchio, Nicole; Elwy, A Rani; Smith, Eric; Bottonari, Kathryn A; Eisen, Susan V

2011-04-01

The authors report results of work to enhance self-report posttraumatic stress disorder (PTSD) assessment by developing an item bank for use in a computer-adapted test. Computer-adapted tests have great potential to decrease the burden of PTSD assessment and outcomes monitoring. The authors conducted a systematic literature review of PTSD instruments, created a database of items, performed qualitative review and readability analysis, and conducted cognitive interviews with veterans diagnosed with PTSD. The systematic review yielded 480 studies in which 41 PTSD instruments comprising 993 items met inclusion criteria. The final PTSD item bank includes 104 items representing each of the Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition (DSM-IV; American Psychiatric Association [APA], 1994), PTSD symptom clusters (reexperiencing, avoidance, and hyperarousal), and 3 additional subdomains (depersonalization, guilt, and sexual problems) that expanded the assessment item pool. Copyright © 2011 International Society for Traumatic Stress Studies.

Reducing Operating Room Costs Through Real-Time Cost Information Feedback: A Pilot Study.

PubMed

Tabib, Christian H; Bahler, Clinton D; Hardacker, Thomas J; Ball, Kevin M; Sundaram, Chandru P

2015-08-01

To create a protocol for providing real-time operating room (OR) cost feedback to surgeons. We hypothesize that this protocol will reduce costs in a responsible way without sacrificing quality of care. All OR costs were obtained and recorded for robot-assisted partial nephrectomy and laparoscopic donor nephrectomy. Before the beginning of this project, costs pertaining to the 20 most recent cases were analyzed. Items were identified from previous cases as modifiable for replacement or omission. Timely feedback of total OR costs and cost of each item used was provided to the surgeon after each case, and costs were analyzed. A cost analysis of the robot-assisted partial nephrectomy before the washout period indicates expenditures of $5243.04 per case. Ten recommended modifiable items were found to have an average per case cost of $1229.33 representing 23.4% of the total cost. A postwashout period cost analysis found the total OR cost decreased by $899.67 (17.2%) because of changes directly related to the modifiable items. Therefore, 73.2% of the possible identified savings was realized. The same stepwise approach was applied to laparoscopic donor nephrectomies. The average total cost per case before the washout period was $3530.05 with $457.54 attributed to modifiable items. After the washout period, modifiable items costs were reduced by $289.73 (8.0%). No complications occurred in the donor nephrectomy cases while one postoperative complication occurred in the partial nephrectomy group. Providing surgeons with feedback related to OR costs may lead to a change in surgeon behavior and decreased overall costs. Further studies are needed to show equivalence in patient outcomes.

Decision analysis for a data collection system of patient-controlled analgesia with a multi-attribute utility model.

PubMed

Lee, I-Jung; Huang, Shih-Yu; Tsou, Mei-Yung; Chan, Kwok-Hon; Chang, Kuang-Yi

2010-10-01

Data collection systems are very important for the practice of patient-controlled analgesia (PCA). This study aimed to evaluate 3 PCA data collection systems and selected the most favorable system with the aid of multiattribute utility (MAU) theory. We developed a questionnaire with 10 items to evaluate the PCA data collection system and 1 item for overall satisfaction based on MAU theory. Three systems were compared in the questionnaire, including a paper record, optic card reader and personal digital assistant (PDA). A pilot study demonstrated a good internal and test-retest reliability of the questionnaire. A weighted utility score combining the relative importance of individual items assigned by each participant and their responses to each question was calculated for each system. Sensitivity analyses with distinct weighting protocols were conducted to evaluate the stability of the final results. Thirty potential users of a PCA data collection system were recruited in the study. The item "easy to use" had the highest median rank and received the heaviest mean weight among all items. MAU analysis showed that the PDA system had a higher utility score than that in the other 2 systems. Sensitivity analyses revealed that both inverse and reciprocal weighting processes favored the PDA system. High correlations between overall satisfaction and MAU scores from miscellaneous weighting protocols suggested a good predictive validity of our MAU-based questionnaire. The PDA system was selected as the most favorable PCA data collection system by the MAU analysis. The item "easy to use" was the most important attribute of the PCA data collection system. MAU theory can evaluate alternatives by taking into account individual preferences of stakeholders and aid in better decision-making. Copyright © 2010 Elsevier. Published by Elsevier B.V. All rights reserved.

ESPACOMP Medication Adherence Reporting Guidelines (EMERGE): a reactive-Delphi study protocol.

PubMed

Helmy, R; Zullig, L L; Dunbar-Jacob, J; Hughes, D A; Vrijens, B; Wilson, I B; De Geest, S

2017-02-10

Medication adherence is fundamental to achieving optimal patient outcomes. Reporting research on medication adherence suffers from some issues-including conceptualisation, measurement and data analysis-that thwart its advancement. Using the ABC taxonomy for medication adherence as the conceptual basis, a steering committee of members of the European Society for Patient Adherence, COMpliance, and Persistence (ESPACOMP) launched an initiative to develop ESPACOMP Medication Adherence Reporting Guidelines (EMERGE). This paper is a protocol for a Delphi study that aims to build consensus among a group of topic experts regarding an item list that will support developing EMERGE. This study uses a reactive-Delphi design where a group of topic experts will be asked to rate the relevance and clarity of an initial list of items, in addition to suggesting further items and/or modifications of the initial items. The initial item list, generated by the EMERGE steering committee through a structured process, consists of 26 items distributed in 2 sections: 4 items representing the taxonomy-based minimum reporting criteria, and 22 items organised according to the common reporting sections. A purposive sample of experts will be selected from relevant disciplines and diverse geographical locations. Consensus will be achieved through predefined decision rules to keep, delete or modify the items. An iterative process of online survey rounds will be carried out until consensus is reached. An ethics approval was not required for the study according to the Swiss federal act on research involving human beings. The participating experts will be asked to give an informed consent. The results of this Delphi study will feed into EMERGE, which will be disseminated through peer-reviewed publications and presentations at conferences. Additionally, the steering committee will encourage their endorsement by registering the guidelines at the Enhancing the QUAlity and Transparency Of health Research (EQUATOR) network and other relevant organisations. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/.

Enhanced recovery program (ERP) in major laryngeal surgery: building a protocol and testing its feasibility.

PubMed

Gemma, M; Toma, S; Lira Luce, F; Beretta, L; Braga, M; Bussi, M

2017-12-01

Enhanced recovery programs (ERP) represent a multimodal approach to perioperative patient care. The benefits of ERP are well demonstrated in colorectal surgery and Enhanced Recovery After Surgery (ERAS®) programs, that epitomise the ERP concept, have being introduced in different specialties, including vascular, gastric, pancreatic, urogynecologic and orthopaedic surgery. However, no ERP has been proposed for head and neck surgery. We developed an expert-opinion-based ERP for laryngeal surgery based on the key principles of colorectal surgery ERAS®. Twenty-four patients undergoing major laryngeal surgery (total and partial laryngectomies or surgical removal of oropharyngeal tumour with muscle flap reconstruction) were treated according to such an ERP protocol, which differed under several respects from our previous standard practice (described in 70 consecutive patients who underwent major laryngeal surgery before ERP implementation. The adherence rate to the different ERP items is reported. Adherence to ERP items was high. Nutritional assessment, antibiotic prophylaxis, postoperative nausea and vomit (PONV) prophylaxis and postoperative speech therapy targets were applied as required in 100% of cases. Some ERP items (antibiotic prophylaxis, intraoperative infusion rate, and postoperative speech therapy) were already frequently implemented before ERP adoption. Postoperative medical complications occurred in 8.3% of patients. Our expert opinion-based ERP protocol for major laryngeal surgery proved feasible. The degree of benefit deriving from its implementation has yet to be assessed. © Copyright by Società Italiana di Otorinolaringologia e Chirurgia Cervico-Facciale, Rome, Italy.

Development of an Inconsistent Responding Scale for the Triarchic Psychopathy Measure.

PubMed

Mowle, Elyse N; Kelley, Shannon E; Edens, John F; Donnellan, M Brent; Smith, Shannon Toney; Wygant, Dustin B; Sellbom, Martin

2017-08-01

Inconsistent or careless responding to self-report measures is estimated to occur in approximately 10% of university research participants and may be even more common among offender populations. Inconsistent responding may be a result of a number of factors including inattentiveness, reading or comprehension difficulties, and cognitive impairment. Many stand-alone personality scales used in applied and research settings, however, do not include validity indicators to help identify inattentive response patterns. Using multiple archival samples, the current study describes the development of an inconsistent responding scale for the Triarchic Psychopathy Measure (TriPM; Patrick, 2010), a widely used self-report measure of psychopathy. We first identified pairs of correlated TriPM items in a derivation sample (N = 2,138) and then created a total score based on the sum of the absolute value of the differences for each item pair. The resulting scale, the Triarchic Assessment Procedure for Inconsistent Responding (TAPIR), strongly differentiated between genuine TriPM protocols and randomly generated TriPM data (N = 1,000), as well as between genuine protocols and those in which 50% of the original data were replaced with random item responses. TAPIR scores demonstrated fairly consistent patterns of association with some theoretically relevant correlates (e.g., inconsistency scales embedded in other personality inventories), although not others (e.g., measures of conscientiousness) across our cross-validation samples. Tentative TAPIR cut scores that may discriminate between attentively and carelessly completed protocols are presented. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

Mixed-methods development of a new patient-reported outcome instrument for chronic low back pain: part 1-the Patient Assessment for Low Back Pain - Symptoms (PAL-S).

PubMed

Martin, Mona L; Blum, Steven I; Liedgens, Hiltrud; Bushnell, Donald M; McCarrier, Kelly P; Hatley, Noël V; Ramasamy, Abhilasha; Freynhagen, Rainer; Wallace, Mark; Argoff, Charles; Eerdekens, Mariёlle; Kok, Maurits; Patrick, Donald L

2018-06-01

We describe the mixed-methods (qualitative and quantitative) development and preliminary validation of the Patient Assessment for Low Back Pain-Symptoms (PAL-S), a patient-reported outcome measure for use in chronic low back pain (cLBP) clinical trials. Qualitative methods (concept elicitation and cognitive interviews) were used to identify and refine symptom concepts and quantitative methods (classical test theory and Rasch measurement theory) were used to evaluate item- and scale-level performance of the measure using an iterative approach. Patients with cLBP participated in concept elicitation interviews (N = 43), cognitive interviews (N = 38), and interview-based assessment of paper-to-electronic mode equivalence (N = 8). A web-based sample of patients with self-reported cLBP participated in quantitative studies to evaluate preliminary (N = 598) and revised (n = 401) drafts and a physician-diagnosed cohort of patients with cLBP (N = 45) participated in preliminary validation of the measure. The PAL-S contained 14 items describing symptoms (overall pain, sharp, prickling, sensitive, tender, radiating, shocking, shooting, burning, squeezing, muscle spasms, throbbing, aching, and stiffness). Item-level performance, scale structure, and scoring seemed to be appropriate. One-week test-retest reproducibility was acceptable (intraclass correlation coefficient 0.81 [95% confidence interval, 0.61-0.91]). Convergent validity was demonstrated with total score and MOS-36 Bodily Pain (Pearson correlation -0.79), Neuropathic Pain Symptom Inventory (0.73), Roland-Morris Disability Questionnaire (0.67), and MOS-36 Physical Functioning (-0.65). Individual item scores and total score discriminated between numeric rating scale tertile groups and painDETECT categories. Respondent interpretation of paper and electronic administration modes was equivalent. The PAL-S has demonstrated content validity and is potentially useful to assess treatment benefit in cLBP clinical trials.

Fourth-Grade Children are Less Accurate in Reporting School Breakfast than School Lunch during 24-Hour Dietary Recalls

PubMed Central

Baxter, Suzanne Domel; Royer, Julie A.; Hardin, James W.; Guinn, Caroline H.; Smith, Albert F.

2008-01-01

Objective To compare reporting accuracy for breakfast and lunch in two studies. Design Children were observed eating school meals and interviewed the following morning about the previous day. Study 1 – 104 children were each interviewed one to three times with ≥25 days separating any two interviews. Study 2 – 121 children were each interviewed once in forward (morning-to-evening) and once in reverse (evening-to-morning) order, separated by ≥29 days. Setting 12 schools. Participants Fourth-grade children. Main Outcome Measures For each meal: food-item variables – observed number, reported number, omission rate, intrusion rate, total inaccuracy; kilocalorie variables – observed, reported, correspondence rate, inflation ratio. Analysis General linear mixed-models. Results For each study, observed and reported numbers of items and kilocalories, and correspondence rate (reporting accuracy), were greater for lunch than breakfast; omission rate, intrusion rate, and inflation ratio (measures of reporting error) were greater for breakfast than lunch. Study 1 – for each meal over interviews, total inaccuracy decreased and correspondence rate increased. Study 2 – for each meal for boys for reverse and girls for forward order, omission rate was lower and correspondence rate was higher. Conclusions and Implications Breakfast was reported less accurately than lunch. Despite improvement over interviews (Study 1) and differences for order × sex (Study 2), reporting accuracy was low for breakfast and lunch. PMID:17493562

Children's Depression Inventory (CDI) and the Children's Depression Rating Scale-Revised (CDRS-R): reliability of the Hebrew version.

PubMed

Zalsman, Gil; Misgav, Sagit; Sommerfeld, Eliane; Kohn, Yoav; Brunstein-Klomek, Anat; Diller, Robyne; Sher, Leo; Schwartz, Joseph; Shoval, Gal; Ben-Dor, David H; Wolovik, Luisa; Oquendo, Maria A

2005-01-01

The Children's Depression Inventory (CDI) and Children's Depression Rating Scale-Revised (CDRS-R) are two widely used instruments, which measure depression in children and adolescents. This pilot study assessed the reliability of the Hebrew versions of these two instruments. Both CDRS-R and CDI were translated from English into Hebrew and then back translated. Seventeen healthy Israeli bilingual children volunteers were interviewed with both scales with a one day intermission between the interviews. Non-parametric correlations were used to compare scores in the two versions for each item. Results showed high agreement between the two versions for almost all items of the CDI and moderate to high for the CDRS-R. When CDRS-R summary scores for each item were compared, the agreement was high for this instrument as well. It is concluded that both CDI and CDRS-R Hebrew versions are reliable and can be used for studies of depression in the Israeli pediatric population.

Assessing the 16 hour intern shift limit: Results of a multi-center, mixed-methods study of residents and faculty in general surgery.

PubMed

Coverdill, James E; Alseidi, Adnan; Borgstrom, David C; Dent, Daniel L; Dumire, Russell; Fryer, Jonathan; Hartranft, Thomas H; Holsten, Steven B; Nelson, M Timothy; Shabahang, Mohsen M; Sherman, Stanley R; Termuhlen, Paula M; Woods, Randy J; Mellinger, John D

2018-02-01

The study explores how residents and faculty assess the ACGME's 16-h limit on intern shifts. Questionnaire response rates were 76% for residents (N = 291) and 71% for faculty (N = 279) in 13 general surgery residency programs. Results include means, percentage in agreement, and statistical tests for 15 questionnaire items. Semi-structured interviews conducted with 39 residents and 43 faculty were analyzed for main themes. Few view the intern shift limit as a positive change. Views differ (P < 0.01) for residents and faculty on 12 of 15 item means and across PGY levels on all 15 items. Interviews indicate concerns about losses with respect to education and professional development, difficulties when interns transition to their second year, and how intern shifts may be more fatiguing than expected. The 16-h limit on intern shifts has remained a source of concern and an educational challenge for residents and faculty. Copyright © 2017 Elsevier Inc. All rights reserved.

Single-Item Screening for Agoraphobic Symptoms: Validation of a Web-Based Audiovisual Screening Instrument

PubMed Central

van Ballegooijen, Wouter; Riper, Heleen; Donker, Tara; Martin Abello, Katherina; Marks, Isaac; Cuijpers, Pim

2012-01-01

The advent of web-based treatments for anxiety disorders creates a need for quick and valid online screening instruments, suitable for a range of social groups. This study validates a single-item multimedia screening instrument for agoraphobia, part of the Visual Screener for Common Mental Disorders (VS-CMD), and compares it with the text-based agoraphobia items of the PDSS-SR. The study concerned 85 subjects in an RCT of the effects of web-based therapy for panic symptoms. The VS-CMD item and items 4 and 5 of the PDSS-SR were validated by comparing scores to the outcomes of the CIDI diagnostic interview. Screening for agoraphobia was found moderately valid for both the multimedia item (sensitivity.81, specificity.66, AUC.734) and the text-based items (AUC.607–.697). Single-item multimedia screening for anxiety disorders should be further developed and tested in the general population and in patient, illiterate and immigrant samples. PMID:22844391

Analysis of the psychometric properties of the American Orthopaedic Foot and Ankle Society Score (AOFAS) in rheumatoid arthritis patients: application of the Rasch model.

PubMed

Conceição, Cristiano Sena da; Neto, Mansueto Gomes; Neto, Anolino Costa; Mendes, Selena M D; Baptista, Abrahão Fontes; Sá, Kátia Nunes

2016-01-01

To tested the reliability and validity of Aofas in a sample of rheumatoid arthritis patients. The scale was applicable to rheumatoid arthritis patients, twice by the interviewer 1 and once by the interviewer 2. The Aofas was subjected to test-retest reliability analysis (with 20 Rheumatoid arthritis subjects). The psychometric properties were investigated using Rasch analysis on 33 Rheumatoid arthritis patients. Intra-Class Correlation Coefficient (ICC) were (0.90

Addressing the targeting range of the ABILHAND-56 in relapsing-remitting multiple sclerosis: A mixed methods psychometric study.

PubMed

Cleanthous, Sophie; Strzok, Sara; Pompilus, Farrah; Cano, Stefan; Marquis, Patrick; Cohan, Stanley; Goldman, Myla D; Kresa-Reahl, Kiren; Petrillo, Jennifer; Castrillo-Viguera, Carmen; Cadavid, Diego; Chen, Shih-Yin

2018-01-01

ABILHAND, a manual ability patient-reported outcome instrument originally developed for stroke patients, has been used in multiple sclerosis clinical trials; however, psychometric analyses indicated the measure's limited measurement range and precision in higher-functioning multiple sclerosis patients. The purpose of this study was to identify candidate items to expand the measurement range of the ABILHAND-56, thus improving its ability to detect differences in manual ability in higher-functioning multiple sclerosis patients. A step-wise mixed methods design strategy was used, comprising two waves of patient interviews, a combination of qualitative (concept elicitation and cognitive debriefing) and quantitative (Rasch measurement theory) analytic techniques, and consultation interviews with three clinical neurologists specializing in multiple sclerosis. Original ABILHAND was well understood in this context of use. Eighty-two new manual ability concepts were identified. Draft supplementary items were generated and refined with patient and neurologist input. Rasch measurement theory psychometric analysis indicated supplementary items improved targeting to higher-functioning multiple sclerosis patients and measurement precision. The final pool of Early Multiple Sclerosis Manual Ability items comprises 20 items. The synthesis of qualitative and quantitative methods used in this study improves the ABILHAND content validity to more effectively identify manual ability changes in early multiple sclerosis and potentially help determine treatment effect in higher-functioning patients in clinical trials.

Assessing Hopelessness in Terminally Ill Cancer Patients: Development of the Hopelessness Assessment in Illness Questionnaire

PubMed Central

Rosenfeld, Barry; Pessin, Hayley; Lewis, Charles; Abbey, Jennifer; Olden, Megan; Sachs, Emily; Amakawa, Lia; Kolva, Elissa; Brescia, Robert; Breitbart, William

2013-01-01

Hopelessness has become an increasingly important construct in palliative care research, yet concerns exist regarding the utility of existing measures when applied to patients with a terminal illness. This article describes a series of studies focused on the exploration, development, and analysis of a measure of hopelessness specifically intended for use with terminally ill cancer patients. The 1st stage of measure development involved interviews with 13 palliative care experts and 30 terminally ill patients. Qualitative analysis of the patient interviews culminated in the development of a set of potential questionnaire items. In the 2nd study phase, we evaluated these preliminary items with a sample of 314 participants, using item response theory and classical test theory to identify optimal items and response format. These analyses generated an 8-item measure that we tested in a final study phase, using a 3rd sample (n = 228) to assess reliability and concurrent validity. These analyses demonstrated strong support for the Hopelessness Assessment in Illness Questionnaire providing greater explanatory power than existing measures of hopelessness and found little evidence that this assessment was confounded by illness-related variables (e.g., prognosis). In summary, these 3 studies suggest that this brief measure of hopelessness is particularly useful for palliative care settings. Further research is needed to assess the applicability of the measure to other populations and contexts. PMID:21443366

EORTC QLQ-COMU26: a questionnaire for the assessment of communication between patients and professionals. Phase III of the module development in ten countries.

PubMed

Arraras, Juan Ignacio; Wintner, Lisa M; Sztankay, Monika; Tomaszewski, Krzysztof A; Hofmeister, Dirk; Costantini, Anna; Bredart, Anne; Young, Teresa; Kuljanic, Karin; Tomaszewska, Iwona M; Kontogianni, Meropi; Chie, Wei-Chu; Kulis, Dagmara; Greimel, Eva

2017-05-01

Communication between patients and professionals is one major aspect of the support offered to cancer patients. The European Organisation for Research and Treatment of Cancer (EORTC) Quality of Life Group (QLG) has developed a cancer-specific instrument for the measurement of different issues related to the communication between cancer patients and their health care professionals. Questionnaire development followed the EORTC QLG Module Development Guidelines. A provisional questionnaire was pre-tested (phase III) in a multicenter study within ten countries from five cultural areas (Northern and South Europe, UK, Poland and Taiwan). Patients from seven subgroups (before, during and after treatment, for localized and advanced disease each, plus palliative patients) were recruited. Structured interviews were conducted. Qualitative and quantitative analyses have been performed. One hundred forty patients were interviewed. Nine items were deleted and one shortened. Patients' comments had a key role in item selection. No item was deleted due to just quantitative criteria. Consistency was observed in patients' answers across cultural areas. The revised version of the module EORTC QLQ-COMU26 has 26 items, organized in 6 scales and 4 individual items. The EORTC COMU26 questionnaire can be used in daily clinical practice and research, in various patient groups from different cultures. The next step will be an international field test with a large heterogeneous group of cancer patients.

Dual sensory loss: development of a dual sensory loss protocol and design of a randomized controlled trial

PubMed Central

2013-01-01

Background Dual sensory loss (DSL) has a negative impact on health and wellbeing and its prevalence is expected to increase due to demographic aging. However, specialized care or rehabilitation programs for DSL are scarce. Until now, low vision rehabilitation does not sufficiently target concurrent impairments in vision and hearing. This study aims to 1) develop a DSL protocol (for occupational therapists working in low vision rehabilitation) which focuses on optimal use of the senses and teaches DSL patients and their communication partners to use effective communication strategies, and 2) describe the multicenter parallel randomized controlled trial (RCT) designed to test the effectiveness and cost-effectiveness of the DSL protocol. Methods/design To develop a DSL protocol, literature was reviewed and content was discussed with professionals in eye/ear care (interviews/focus groups) and DSL patients (interviews). A pilot study was conducted to test and confirm the DSL protocol. In addition, a two-armed international multi-center RCT will evaluate the effectiveness and cost-effectiveness of the DSL protocol compared to waiting list controls, in 124 patients in low vision rehabilitation centers in the Netherlands and Belgium. Discussion This study provides a treatment protocol for rehabilitation of DSL within low vision rehabilitation, which aims to be a valuable addition to the general low vision rehabilitation care. Trial registration Netherlands Trial Register (NTR) identifier: NTR2843 PMID:23941667

Validity of Assessments of Youth Access to Tobacco: The Familiarity Effect

PubMed Central

Landrine, Hope; Klonoff, Elizabeth A.

2003-01-01

Objectives. We examined the standard compliance protocol and its validity as a measure of youth access to tobacco. Methods. In Study 1, youth smokers reported buying cigarettes in stores where they are regular customers. In Study 2, youths attempted to purchase cigarettes by using the Standard Protocol, in which they appeared at stores once for cigarettes, and by using the Familiarity Protocol, in which they were rendered regular customers by purchasing nontobacco items 4 times and then requested cigarettes during their fifth visit. Results. Sales to youths aged 17 years in the Familiarity Protocol were significantly higher than sales to the same age group in the Standard Protocols (62.5% vs. 6%, respectively). Conclusions. The Standard Protocol does not match how youths obtain cigarettes. Access is low for stranger youths within compliance studies, but access is high for familiar youths outside of compliance studies. PMID:14600057

"Living in the moment" among cancer survivors who report life-transforming change.

PubMed

Skeath, Perry; Berger, Ann

2017-07-01

Some cancer survivors say that while coping with their illness they have had what they identify as a highly beneficial, personal, life-transforming change (LTC; a self-subscribed condition among participants in this study, not a researcher-defined construct). Previously we found that the content of LTC was highly individual; but certain features of the LTC process were quite uniform. For example, LTC was driven by a very rational desire to remain genuinely functional as a person in the midst of highly stressful circumstances. Our purpose is to further understand LTC by analysis of participants' critique of questionnaire items on positive subjective outcomes. We obtained a set of 67 positive psychosocial questionnaire items from the Psychosocial Impact of Illness (PII) item bank development team of the National Institutes of Health (NIH) Patient-Reported Outcomes Measurement Information Systems (PROMIS) initiative. The PII items are sourced from a variety of instruments, representing more than one theory of personal growth. This enabled a grounded theory approach, allowing a theory of LTC to emerge from the data. Each of nine cancer survivors participated in a single, two-part session: an hour-long semi-structured qualitative interview regarding their LTC (previously reported), then individually critiquing the 67 items in terms of relevance and importance to their self-reported LTC experience (their critique is analyzed in this article). The PII items were grouped into 20 researcher-defined conceptual themes and average scores for each theme were computed and compared. The theme "living in the moment" (LITM; sometimes referred to as "Being in the moment" in other literature) scored significantly higher than other themes. Qualitative interview transcripts revealed that participants spontaneously used LITM as a coping tactic that reduced worries to manageable levels. These participants noticed subsequently that LITM also produced unexpected substantial benefits in many aspects of their lives unrelated to cancer. This experience motivated increased use of LITM that led to LTC beyond coping with cancer. LITM can be a practical, effective coping tactic to manage worries and promote adaptation to the challenges of a life-threatening illness. Participant interviews indicated the motivation for LITM is not traumatic experience, but seems to be conservation of their own personal resources for coping with increased stresses. Hobfoll's conservation of resources model appears to be more consistent with LITM among our participants than Tedeshi's posttraumatic growth (PTG) model. Several PII items that represent LITM have unfortunately been removed from the current PROMIS PII item bank, indicating a need for improved of item selection criteria. Further research is needed first to identify or develop assessment items that more effectively capture the precursors and phases of LITM, and then develop interventions that facilitate LITM and LTC for patients.

Planning an Information System for a Small College. AIR Forum Paper 1978.

ERIC Educational Resources Information Center

Toombs, William; Sagaria, Mary Ann

Data collection and analyses of college records and interviewing provided a cross-sectional view of data flow and information transmission in a small college. The micro-analysis of interview data, forms, and reports yielded a picture of functional relationships, clarified loci of decision making, and stipulated functions served by data items.…

Anglos Are Weird People For Me. Interviews with Chicanos and Puerto Ricans. Materialien 12.

ERIC Educational Resources Information Center

Binder, Wolfgang

The book presents the statements of 8 Mexican Americans and 10 Puerto Ricans, aged from 19 to 29, who were interviewed to reveal their degree of acculturation. Questions include attitude, behavior and/or fact-finding items and cover habitat; family background; intactness of family; educational, income, and occupational levels of parents and…

Measuring psychological trauma after spinal cord injury: Development and psychometric characteristics of the SCI-QOL Psychological Trauma item bank and short form

PubMed Central

Kisala, Pamela A.; Victorson, David; Pace, Natalie; Heinemann, Allen W.; Choi, Seung W.; Tulsky, David S.

2015-01-01

Objective To describe the development and psychometric properties of the SCI-QOL Psychological Trauma item bank and short form. Design Using a mixed-methods design, we developed and tested a Psychological Trauma item bank with patient and provider focus groups, cognitive interviews, and item response theory based analytic approaches, including tests of model fit, differential item functioning (DIF) and precision. Setting We tested a 31-item pool at several medical institutions across the United States, including the University of Michigan, Kessler Foundation, Rehabilitation Institute of Chicago, the University of Washington, Craig Hospital and the James J. Peters/Bronx Veterans Administration hospital. Participants A total of 716 individuals with SCI completed the trauma items Results The 31 items fit a unidimensional model (CFI=0.952; RMSEA=0.061) and demonstrated good precision (theta range between 0.6 and 2.5). Nine items demonstrated negligible DIF with little impact on score estimates. The final calibrated item bank contains 19 items Conclusion The SCI-QOL Psychological Trauma item bank is a psychometrically robust measurement tool from which a short form and a computer adaptive test (CAT) version are available. PMID:26010967

The admissions process of a bachelor of science in nursing program: initial reliability and validity of the personal interview.

PubMed

Carpio, B; Brown, B

1993-01-01

The undergraduate nursing degree program (B.Sc.N.) at McMaster University School of Nursing uses small groups, and is learner-centered and problem-based. A study was conducted during the 1991 admissions cycle to determine the initial reliability and validity of the semi-structured personal interview which constitutes the final component of candidate selection for this program. During the interview, three-member teams assess applicant suitability to the program based on six dimensions: applicant motivation, awareness of the program, problem-solving abilities, ability to relate to others, self-appraisal skills, and career goals. Each interviewer assigns the applicant a global rating using a seven-point scale. For the purposes of this study four interviewer teams were randomly selected from the pool of 31 teams to interview four simulated (preprogrammed) applicants. Using two-factor repeated-measures ANOVA to analyze interview ratings, inter-rater and inter-team intraclass correlation coefficients (ICC) were calculated. Inter-team reliability ranged from .64 to .97 for the individual dimensions, and .66 to .89 on global ratings. Inter-rater ICC for the six dimensions ranged from .81 to .99, and .96 to .99 for the global ratings. The item-to-total correlation coefficients between individual dimensions and global ratings ranged from .8 to 1.0. Pearson correlations between items ranged from .77 to 1.0. The ICC were then calculated for the interview scores of 108 actual applicants to the program. Inter-rater reliability based on global ratings was .79 for the single (1 rater) observation, and .91 for the multiple (3 rater) observation. These findings support the continued use of the interview as a reliable instrument with face validity. Studies of predictive validity will be undertaken.

78 FR 51730 - Agency Information Collection Activities: Proposed Collection; Comment Request

Federal Register 2010, 2011, 2012, 2013, 2014

2013-08-21

... Evaluation of the Medicare Health Care Quality (MHCQ) Demonstration Evaluation: Focus Group and Interview... Collection: Evaluation of the Medicare Health Care Quality (MHCQ) Demonstration Evaluation: Focus Group and Interview Protocols; Use: The Medicare Health Care Quality (MHCQ) Demonstration was developed to address...

Evaluating measurement invariance across assessment modes of phone interview and computer self-administered survey for the PROMIS measures in a population-based cohort of localized prostate cancer survivors.

PubMed

Wang, Mian; Chen, Ronald C; Usinger, Deborah S; Reeve, Bryce B

2017-11-01

To evaluate measurement invariance (phone interview vs computer self-administered survey) of 15 PROMIS measures responded by a population-based cohort of localized prostate cancer survivors. Participants were part of the North Carolina Prostate Cancer Comparative Effectiveness and Survivorship Study. Out of the 952 men who took the phone interview at 24 months post-treatment, 401 of them also completed the same survey online using a home computer. Unidimensionality of the PROMIS measures was examined using single-factor confirmatory factor analysis (CFA) models. Measurement invariance testing was conducted using longitudinal CFA via a model comparison approach. For strongly or partially strongly invariant measures, changes in the latent factors and factor autocorrelations were also estimated and tested. Six measures (sleep disturbance, sleep-related impairment, diarrhea, illness impact-negative, illness impact-positive, and global satisfaction with sex life) had locally dependent items, and therefore model modifications had to be made on these domains prior to measurement invariance testing. Overall, seven measures achieved strong invariance (all items had equal loadings and thresholds), and four measures achieved partial strong invariance (each measure had one item with unequal loadings and thresholds). Three measures (pain interference, interest in sexual activity, and global satisfaction with sex life) failed to establish configural invariance due to between-mode differences in factor patterns. This study supports the use of phone-based live interviewers in lieu of PC-based assessment (when needed) for many of the PROMIS measures.

Translation and linguistic validation of the Pediatric Patient-Reported Outcomes Measurement Information System measures into simplified Chinese using cognitive interviewing methodology.

PubMed

Liu, Yanyan; Hinds, Pamela S; Wang, Jichuan; Correia, Helena; Du, Shizheng; Ding, Jian; Gao, Wen Jun; Yuan, Changrong

2013-01-01

The Pediatric Patient-Reported Outcomes Measurement Information System (PROMIS) measures were developed using modern measurement theory and tested in a variety of settings to assess the quality of life, function, and symptoms of children and adolescents experiencing a chronic illness and its treatment. Developed in English, this set of measures had not been translated into Chinese. The objective of this study was to develop the Chinese version of the Pediatric PROMIS measures (C-Ped-PROMIS), specifically 8 short forms, and to pretest the translated measures in children and adolescents through cognitive interviewing methodology. The C-Ped-PROMIS was developed following the standard Functional Assessment of Chronic Illness Therapy Translation Methodology. Bilingual teams from the United States and China reviewed the translation to develop a provisional version, which was then pretested with cognitive interview by probing 10 native Chinese-speaking children aged 8 to 17 years in China. The translation was finalized by the bilingual teams. Most items, response options, and instructions were well understood by the children, and some revisions were made to address patient's comments during the cognitive interview. The results indicated that the C-Ped-PROMIS items were semantically and conceptually equivalent to the original. Children aged 8 to 17 years in China were able to comprehend these measures and express their experience and feelings about illness or their life. The C-Ped-PROMIS is available for psychometric validation. Future work will be directed at translating the rest of the item banks, calibrating them and creating a Chinese final version of the short forms.

Sensitivity and specificity of a two-question screening tool for depression in a specialist palliative care unit.

PubMed

Payne, Ann; Barry, Sandra; Creedon, Brian; Stone, Carol; Sweeney, Catherine; O' Brien, Tony; O' Sullivan, Kathleen

2007-04-01

The primary objective in this study is to determine the sensitivity and specificity of a two-item screening interview for depression versus the formal psychiatric interview, in the setting of a specialist palliative in-patient unit so that we may identify those individuals suffering from depressive disorder and therefore optimise their management in this often-complex population. A prospective sample of consecutive admissions (n = 167) consented to partake in the study, and the screening interview was asked separately to the formal psychiatric interview. The two-item questionnaire, achieved a sensitivity of 90.7% (95% CI 76.9-97.0) but a lower specificity of 67.7% (95% CI 58.7-75.7). The false positive rate was 32.3% (95% CI 24.3-41.3), but the false negative rate was found to be a low 9.3% (95% CI 3.0-23.1). A subgroup analysis of individuals with a past experience of depressive illness, (n = 95), revealed that a significant number screened positive for depression by the screening test, 55.2% (16/29) compared to those with no background history of depression, 33.3% (22/66) (P = 0.045). The high sensitivity and low false negative rate of the two-question screening tool will aid health professionals in identifying depression in the in-patient specialist palliative care unit. Individuals, who admit to a previous experience of depressive illness, are more likely to respond positively to the two-item questionnaire than those who report no prior history of depressive illness (P = 0.045).

Development and Validation of the Chinese Making Sense of Adversity Scale: Acculturative Stressors as an Example

ERIC Educational Resources Information Center

Pan, Jia-Yan; Wong, Daniel Fu Keung; Chan, Kin Sun; Chan, Cecilia Lai Wan

2008-01-01

Objective: The objective of this study is to develop and validate the Chinese Making Sense of Adversity Scale (CMSAS) to measure the cognitive coping strategies that Chinese people adopt to make sense of adversity. Method: A 12-item CMSAS was developed by in-depth interview and item analysis. The scale was validated with a sample of 627 Chinese…

Validation of the Sexual Assault Symptom Scale II (SASS II) Using a Panel Research Design

ERIC Educational Resources Information Center

Ruch, Libby O.; Wang, Chang-Hwai

2006-01-01

To examine the utility of a self-report scale of sexual assault trauma, 223 female victims were interviewed with the 43-item Sexual Assault Symptom Scale II (SASS II) at 1, 3, 7, 11, and 15 months postassault. Factor analyses using principal-components extraction with an oblimin rotation yielded 7 common factors with 31 items. The internal…

The Swedish translation and cross-cultural adaptation of the Functional Assessment of Chronic Illness Therapy - Cervical Dysplasia (FACIT-CD): linguistic validity and reliability of the Swedish version.

PubMed

Rask, Marie; Oscarsson, Marie; Ludwig, Neil; Swahnberg, Katarina

2017-04-04

Cervical dysplasia is a precancerous condition, which has been shown to create anxiety in women. To be able to investigate these women's health-related quality of life, a disease-specific instrument is required. There does not seem to be a Swedish version of an instrument to screen for this specific disease. Therefore, this study aims to translate and cross-culturally adapt the Functional Assessment of Chronic Illness Therapy - Cervical Dysplasia (FACIT-CD) into a Swedish context and evaluate its linguistic validity and reliability. The Functional Assessment of Chronic Illness Therapy (FACIT) translation methodology was used, which consists of several steps including pilot testing of the FACIT-CD instrument through cognitive debriefing interviews. Ten women diagnosed with cervical dysplasia participated in the cognitive debriefing interviews. The internal consistency reliability of the Swedish FACIT-CD was estimated by Cronbach's alpha coefficient. Homogeneity of the items was evaluated by corrected item-total correlations. The sample consists of 34 women who were diagnosed with cervical dysplasia. The translation and cross-cultural adaptation went smoothly without any problems for the majority of the items. The cognitive debriefing interviews indicated that the Swedish FACIT-CD consists of relevant items, is easy to understand and complete, and has unambiguous and comprehensive response categories. The translation and cross-cultural adaptation resulted in a Swedish FACIT-CD, which is conceptually and semantically equivalent to the English version and linguistically valid. The total scale of the Swedish FACIT-CD exhibited good internal consistency reliability with a Cronbach's alpha coefficient of 0.84, and all of the subscales exhibited acceptable value between 0.71 and 0.81 except the Relationships subscale, which had a value of 0.67. Finally, all but four items exceeded the acceptable level for the corrected item-total correlations of ≥ 0.20. The Swedish FACIT-CD is conceptually and semantically equivalent to the English version and linguistically valid; further, it exhibits good internal consistency reliability.

Correlates of cognitive function scores in elderly outpatients.

PubMed

Mangione, C M; Seddon, J M; Cook, E F; Krug, J H; Sahagian, C R; Campion, E W; Glynn, R J

1993-05-01

To determine medical, ophthalmologic, and demographic predictors of cognitive function scores as measured by the Telephone Interview for Cognitive Status (TICS), an adaptation of the Folstein Mini-Mental Status Exam. A secondary objective was to perform an item-by-item analysis of the TICS scores to determine which items correlated most highly with the overall scores. Cross-sectional cohort study. The Glaucoma Consultation Service of the Massachusetts Eye and Ear Infirmary. 472 of 565 consecutive patients age 65 and older who were seen at the Glaucoma Consultation Service between November 1, 1987 and October 31, 1988. Each subject had a standard visual examination and review of medical history at entry, followed by a telephone interview that collected information on demographic characteristics, cognitive status, health status, accidents, falls, symptoms of depression, and alcohol intake. A multivariate linear regression model of correlates of TICS score found the strongest correlates to be education, age, occupation, and the presence of depressive symptoms. The only significant ocular condition that correlated with lower TICS score was the presence of surgical aphakia (model R2 = .46). Forty-six percent (216/472) of patients fell below the established definition of normal on the mental status scale. In a logistic regression analysis, the strongest correlates of an abnormal cognitive function score were age, diabetes, educational status, and occupational status. An item analysis using step-wise linear regression showed that 85 percent of the variance in the TICS score was explained by the ability to perform serial sevens and to repeat 10 items immediately after hearing them. Educational status correlated most highly with both of these items (Kendall Tau R = .43 and Kendall Tau R = .30, respectively). Education, occupation, depression, and age were the strongest correlates of the score on this new screening test for assessing cognitive status. These factors were stronger correlates of the TICS score than chronic medical conditions, visual loss, or medications. The Telephone Interview for Cognitive Status is a useful instrument, but it may overestimate the prevalence of dementia in studies with a high prevalence of persons with less than a high school education.

Detecting child abuse based on parental characteristics: does the Hague Protocol cause parents to avoid the emergency department?

PubMed

Diderich, Hester M; Fekkes, Minne; Dechesne, Mark; Buitendijk, Simone E; Oudesluys-Murphy, Anne Marie

2015-04-01

The Hague Protocol is used by professionals at the adult Emergency Departments (ED) in The Netherlands to detect child abuse based on three parental characteristics: (1) domestic violence, (2) substance abuse or (3) suicide attempt or self-harm. After detection, a referral is made to the Reporting Center for Child Abuse and Neglect (RCCAN). This study investigates whether implementing this Protocol will lead parents to avoid medical care. We compared the number of patients (for whom the Protocol applied) who attended the ED prior to implementation with those attending after implementation. We conducted telephone interviews (n = 14) with parents whose children were referred to the RCCAN to investigate their experience with the procedure. We found no decline in the number of patients, included in the Protocol, visiting the ED during the 4 year implementation period (2008-2011). Most parents (n = 10 of the 14 interviewed) were positive and stated that they would, if necessary, re-attend the ED with the same complaints in the future. ED nurses and doctors referring children based on parental characteristics do not have to fear losing these families as patients. Copyright © 2014 Elsevier Ltd. All rights reserved.

The economic, institutional, and political determinants of public health delivery system structures.

PubMed

Ingram, Richard C; Scutchfield, F Douglas; Mays, Glen P; Bhandari, Michelyn W

2012-01-01

A typology of local public health systems was recently introduced, and a large degree of structural transformation over time was discovered in the systems analyzed. We present a qualitative exploration of the factors that determine variation and change in the seven structural configurations that comprise the local public health delivery system typology. We applied a 10-item semistructured telephone interview protocol to representatives from the local health agency in two randomly selected systems from each configuration--one that had maintained configuration over time and one that had changed configuration over time. We assessed the interviews for patterns of variation between the configurations. Four key determinants of structural change emerged: availability of financial resources, interorganizational relationships, public health agency organization, and political relationships. Systems that had changed were more likely to experience strengthened partnerships between public health agencies and other community organizations and enjoy support from policy makers, while stable systems were more likely to be characterized by strong partnerships between public health agencies and other governmental bodies and less supportive relationships with policy makers. This research provides information regarding the determinants of system change, and may help public health leaders to better prepare for the impacts of change in the areas discussed. It may also help those who are seeking to implement change to determine the contextual factors that need to be in place before change can happen, or how best to implement change in the face of contextual factors that are beyond their control.

Genetics problem solving and worldview

NASA Astrophysics Data System (ADS)

Dale, Esther

The research goal was to determine whether worldview relates to traditional and real-world genetics problem solving. Traditionally, scientific literacy emphasized content knowledge alone because it was sufficient to solve traditional problems. The contemporary definition of scientific literacy is, "The knowledge and understanding of scientific concepts and processes required for personal decision-making, participation in civic and cultural affairs and economic productivity" (NRC, 1996). An expanded definition of scientific literacy is needed to solve socioscientific issues (SSI), complex social issues with conceptual, procedural, or technological associations with science. Teaching content knowledge alone assumes that students will find the scientific explanation of a phenomenon to be superior to a non-science explanation. Formal science and everyday ways of thinking about science are two different cultures (Palmer, 1999). Students address this rift with cognitive apartheid, the boxing away of science knowledge from other types of knowledge (Jedege & Aikenhead, 1999). By addressing worldview, cognitive apartheid may decrease and scientific literacy may increase. Introductory biology students at the University of Minnesota during fall semester 2005 completed a written questionnaire-including a genetics content-knowledge test, four genetic dilemmas, the Worldview Assessment Instrument (WAI) and some items about demographics and religiosity. Six students responded to the interview protocol. Based on statistical analysis and interview data, this study concluded the following: (1) Worldview, in the form of metaphysics, relates to solving traditional genetic dilemmas. (2) Worldview, in the form of agency, relates to solving traditional genetics problems. (3) Thus, worldview must be addressed in curriculum, instruction, and assessment.

Adverse experiences in infancy and toddlerhood: Relations to adaptive behavior and academic status in middle childhood.

PubMed

McKelvey, Lorraine M; Edge, Nicola Conners; Mesman, Glenn R; Whiteside-Mansell, Leanne; Bradley, Robert H

2018-06-13

Findings from the Adverse Childhood Experiences (ACE) study articulated the negative effects of childhood trauma on long-term well-being. The purpose of the current study is to examine the associations between ACEs experienced in infancy and toddlerhood and adaptive behavior and academic status in middle childhood. We used data collected from a sample of low-income families during the impacts study of Early Head Start (EHS). Data were collected by trained interviewers demonstrating at least 85% reliability with protocols. Data come from 1469 socio-demographically diverse mothers and children collected at or near ages 1, 2, 3, and 11. At ages 1, 2, and 3, an EHS-ACEs index was created based on interview and observation items. The EHS-ACEs indices were averaged to represent exposure across infancy and toddlerhood. At age 11, parents were asked about school outcomes and completed the Child Behavior Checklist. Across development, children were exposed to zero (19%), one (31%), two (27%), and three or more ACEs (23%). Logistic regression analyses, controlling for EHS program assignment, and parent, school, and child characteristics, showed ACEs were significantly associated with parental report of the child: having an individualized educational program since starting school and in the current school year, having been retained a grade in school, and problems with externalizing and internalizing behavior, as well as attention. Findings suggest that ACEs influence children's behavioral and academic outcomes early in development. Copyright © 2018 Elsevier Ltd. All rights reserved.

Development and validation of a tool to assess the physical and social environment associated with physical activity among adults in Sri Lanka.

PubMed

De Silva Weliange, Shreenika H; Fernando, Dulitha; Gunatilake, Jagath

2014-05-03

Environmental characteristics are known to be associated with patterns of physical activity (PA). Although several validated tools exist, to measure the environment characteristics, these instruments are not necessarily suitable for application in all settings especially in a developing country. This study was carried out to develop and validate an instrument named the "Physical And Social Environment Scale--PASES" to assess the physical and social environmental factors associated with PA. This will enable identification of various physical and social environmental factors affecting PA in Sri Lanka, which will help in the development of more tailored intervention strategies for promoting higher PA levels in Sri Lanka. The PASES was developed using a scientific approach of defining the construct, item generation, analysis of content of items and item reduction. Both qualitative and quantitative methods of key informant interviews, in-depth interviews and rating of the items generated by experts were conducted. A cross sectional survey among 180 adults was carried out to assess the factor structure through principal component analysis. Another cross sectional survey among a different group of 180 adults was carried out to assess the construct validity through confirmatory factor analysis. Reliability was assessed with test re-test reliability and internal consistency using Spearman r and Cronbach's alpha respectively. Thirty six items were selected after the expert ratings and were developed into interviewer administered questions. Exploration of factor structure of the 34 items which were factorable through principal component analysis with Quartimax rotation extracted 8 factors. The 34 item instrument was assessed for construct validity with confirmatory factor analysis which confirmed an 8 factor model (x2 = 339.9, GFI = 0.90). The identified factors were infrastructure for walking, aesthetics and facilities for cycling, vehicular traffic safety, access and connectivity, recreational facilities for PA, safety, social cohesion and social acceptance of PA with the two non-factorable factors, residential density and land use mix. The PASES also showed good test re-test reliability and a moderate level of internal consistency. The PASES is a valid and reliable tool which could be used to assess the physical and social environment associated with PA in Sri Lanka.

Development of a Psychosocial Risk Screener for Siblings of Children With Cancer: Incorporating the Perspectives of Parents.

PubMed

Long, Kristin A; Pariseau, Emily M; Muriel, Anna C; Chu, Andrea; Kazak, Anne E; Alderfer, Melissa A

2018-04-03

Although many siblings experience distress after a child's cancer diagnosis, their psychosocial functioning is seldom assessed in clinical oncology settings. One barrier to systematic sibling screening is the lack of a validated, sibling-specific screening instrument. Thus, this study developed sibling-specific screening modules in English and Spanish for the Psychosocial Assessment Tool (PAT), a well-validated screener of family psychosocial risk. A purposive sample of English- and Spanish-speaking parents of children with cancer (N = 29) completed cognitive interviews to provide in-depth feedback on the development of the new PAT sibling modules. Interviews were transcribed verbatim, cleaned, and analyzed using applied thematic analysis. Items were updated iteratively according to participants' feedback. Data collection continued until saturation was reached (i.e., all items were clear and valid). Two sibling modules were developed to assess siblings' psychosocial risk at diagnosis (preexisting risk factors) and several months thereafter (reactions to cancer). Most prior PAT items were retained; however, parents recommended changes to improve screening format (separately assessing each sibling within the family and expanding response options to include "sometimes"), developmental sensitivity (developing or revising items for ages 0-2, 3-4, 5-9, and 10+ years), and content (adding items related to sibling-specific social support, global assessments of sibling risk, emotional/behavioral reactions to cancer, and social ecological factors such as family and school). Psychosocial screening requires sibling-specific screening items that correspond to preexisting risk (at diagnosis) and reactions to cancer (several months after diagnosis). Validated, sibling-specific screeners will facilitate identification of siblings with elevated psychosocial risk.

An international measure of awareness and beliefs about cancer: development and testing of the ABC

PubMed Central

Simon, Alice E; Forbes, Lindsay J L; Boniface, David; Warburton, Fiona; Brain, Kate E; Dessaix, Anita; Donnelly, Michael; Haynes, Kerry; Hvidberg, Line; Lagerlund, Magdalena; Petermann, Lisa; Tishelman, Carol; Vedsted, Peter; Vigmostad, Maria Nyre; Wardle, Jane; Ramirez, Amanda J

2012-01-01

Objectives To develop an internationally validated measure of cancer awareness and beliefs; the awareness and beliefs about cancer (ABC) measure. Design and setting Items modified from existing measures were assessed by a working group in six countries (Australia, Canada, Denmark, Norway, Sweden and the UK). Validation studies were completed in the UK, and cross-sectional surveys of the general population were carried out in the six participating countries. Participants Testing in UK English included cognitive interviewing for face validity (N=10), calculation of content validity indexes (six assessors), and assessment of test–retest reliability (N=97). Conceptual and cultural equivalence of modified (Canadian and Australian) and translated (Danish, Norwegian, Swedish and Canadian French) ABC versions were tested quantitatively for equivalence of meaning (≥4 assessors per country) and in bilingual cognitive interviews (three interviews per translation). Response patterns were assessed in surveys of adults aged 50+ years (N≥2000) in each country. Main outcomes Psychometric properties were evaluated through tests of validity and reliability, conceptual and cultural equivalence and systematic item analysis. Test–retest reliability used weighted-κ and intraclass correlations. Construction and validation of aggregate scores was by factor analysis for (1) beliefs about cancer outcomes, (2) beliefs about barriers to symptomatic presentation, and item summation for (3) awareness of cancer symptoms and (4) awareness of cancer risk factors. Results The English ABC had acceptable test–retest reliability and content validity. International assessments of equivalence identified a small number of items where wording needed adjustment. Survey response patterns showed that items performed well in terms of difficulty and discrimination across countries except for awareness of cancer outcomes in Australia. Aggregate scores had consistent factor structures across countries. Conclusions The ABC is a reliable and valid international measure of cancer awareness and beliefs. The methods used to validate and harmonise the ABC may serve as a methodological guide in international survey research. PMID:23253874

Circumventing the “Ick” Factor: A Randomized Trial of the Effects of Omitting Affective Attitudes Questions to Increase Intention to Become an Organ Donor

PubMed Central

Doherty, Sally; Dolan, Elizabeth; Flynn, Jennifer; O’Carroll, Ronan E.; Doyle, Frank

2017-01-01

Objectives: Including or excluding certain questions about organ donation may influence peoples’ intention to donate. We investigated the effect of omitting certain affective attitudinal items on potential donors’ intention and behavior for donation. Design: A cross-sectional survey with a subgroup nested randomized trial. Methods: A total of 578 members of the public in four shopping centers were surveyed on their attitudes to organ donation. Non-donors (n = 349) were randomly assigned to one of three groups: Group 1 completed items on affective and cognitive attitudes, anticipated regret, intention, subjective norm and perceived behavioral control. Group 2 completed all items above but excluded affective attitudes. Group 3 completed all items but omitted negatively worded affective attitudes. The primary outcome was intention to donate, taking a donor card after the interview was a secondary behavioral outcome, and both were predicted using linear and logistic regression with group 1 as the reference. Results: Mean (SD) 1–7 intention scores for groups 1, 2 and 3 were, respectively: 4.43 (SD 1.89), 4.95 (SD 1.64) and 4.88 (SD 1.81), with group 2 significantly higher than group 1 (β = 0.518, 95% confidence interval [CI] 0.18 to 0.86).At the end of the interview, people in group 2 (66.7%; OR = 1.40, 95% CI 0.94 to 2.07, p = 0.096) but not those in group 3 (61.7%; OR = 1.10, 95% CI 0.69 to 1.75, p = 0.685), were marginally more likely to accept a donor card from the interviewer than people in group 1 (59.7%). Conclusion: Omitting affective attitudinal items results in higher intention to donate organs and marginally higher rates of acceptance of donor cards, which has important implications for future organ donation public health campaigns. PMID:28894429

Using Cognitive Testing to Develop Items for Surveying Asian American Cancer Patients and Their Caregivers as a Pathway to Culturally Competent Care.

PubMed

Bolcic-Jankovic, Dragana; Lu, Fengxin; Colten, Mary Ellen; McCarthy, Ellen P

2016-02-01

We report the results from cognitive interviews with Asian American patients and their caregivers. We interviewed seven caregivers and six patients who were all bilingual Asian Americans. The main goal of the cognitive interviews was to test a survey instrument developed for a study about perspectives of Asian American patients with advanced cancer who are facing decisions around end-of-life care. We were particularly interested to see whether items commonly used in White and Black populations are culturally meaningful and equivalent in Asian populations, primarily those of Chinese and Vietnamese ethnicity. Our exploration shows that understanding respondents' language proficiency, degree of acculturation, and cultural context of receiving, processing, and communicating information about medical care can help design questions that are appropriate for Asian American patients and caregivers, and therefore can help researchers obtain quality data about the care Asian American cancer patients receive. © The Author(s) 2016.

Examining Expertise Using Interviews and Verbal Protocols

ERIC Educational Resources Information Center

van de Wiel, Margje W. J.

2017-01-01

To understand expertise and expertise development, interactions between knowledge, cognitive processing and task characteristics must be examined in people at different levels of training, experience, and performance. Interviewing is widely used in the initial exploration of domain expertise. Work and cognitive task analysis chart the knowledge,…

Discovering Physical Abuse: Insights from a Follow-Up Study of Delinquents.

ERIC Educational Resources Information Center

Stein, Abby; Lewis, Dorothy Otnow

1992-01-01

Incarcerated Connecticut youth (n=66) were interviewed using a protocol that elicited more self-reports of abusive experiences than did earlier direct questions about maltreatment. Conflicts underlying denial or minimization of abuse are discussed, along with interview strategies for overcoming them. (Author/DB)

Randomised controlled comparison of the Health Survey Short Form (SF-12) and the Graded Chronic Pain Scale (GCPS) in telephone interviews versus self-administered questionnaires. Are the results equivalent?

PubMed

Lungenhausen, Margitta; Lange, Stefan; Maier, Christoph; Schaub, Claudia; Trampisch, Hans J; Endres, Heinz G

2007-11-22

The most commonly used survey methods are self-administered questionnaires, telephone interviews, and a mixture of both. But until now evidence out of randomised controlled trials as to whether patient responses differ depending on the survey mode is lacking. Therefore this study assessed whether patient responses to surveys depend on the mode of survey administration. The comparison was between mailed, self-administered questionnaires and telephone interviews. A four-armed, randomised controlled two-period change-over design. Each patient responded to the same survey twice, once in written form and once by telephone interview, separated by at least a fortnight. The study was conducted in 2003/2004 in Germany. 1087 patients taking part in the German Acupuncture Trials (GERAC cohort study), who agreed to participate in a survey after completing acupuncture treatment from an acupuncture-certified family physician for headache, were randomised. Of these, 823 (664 women) from the ages of 18 to 83 (mean 51.7) completed both parts of the study. The main outcome measure was the comparison of the scores on the 12-Item Short-Form Health Survey (SF-12) and the Graded Chronic Pain Scale (GCPS) questionnaire for the two survey modes. Computer-aided telephone interviews (CATI) resulted in significantly fewer missing data (0.5%) than did mailed questionnaires (2.8%; p < 0.001). The analysis of equivalence revealed a difference between the survey modes only for the SF-12 mental scales. On average, reported mental status score was 3.5 score points (2.9 to 4.0) lower on the self-administered questionnaire compared to the telephone interview. The order of administration affected results. Patients who responded to the telephone interview first reported better mental health in the subsequent paper questionnaire (mean difference 2.8 score points) compared to those who responded to the paper questionnaire first (mean difference 4.1 score points). Despite the comparatively high cost of telephone interviews, they offer clear advantages over mailed self-administered questionnaires as regards completeness of data. Only items concerning mental status were dependent on the survey mode and sequence of administration. Items on physical status were not affected. Normative data for standardized telephone questionnaires could contribute to a better comparability with the results of the corresponding standardized paper questionnaires.

Randomised controlled comparison of the Health Survey Short Form (SF-12) and the Graded Chronic Pain Scale (GCPS) in telephone interviews versus self-administered questionnaires. Are the results equivalent?

PubMed Central

Lungenhausen, Margitta; Lange, Stefan; Maier, Christoph; Schaub, Claudia; Trampisch, Hans J; Endres, Heinz G

2007-01-01

Background The most commonly used survey methods are self-administered questionnaires, telephone interviews, and a mixture of both. But until now evidence out of randomised controlled trials as to whether patient responses differ depending on the survey mode is lacking. Therefore this study assessed whether patient responses to surveys depend on the mode of survey administration. The comparison was between mailed, self-administered questionnaires and telephone interviews. Methods A four-armed, randomised controlled two-period change-over design. Each patient responded to the same survey twice, once in written form and once by telephone interview, separated by at least a fortnight. The study was conducted in 2003/2004 in Germany. 1087 patients taking part in the German Acupuncture Trials (GERAC cohort study), who agreed to participate in a survey after completing acupuncture treatment from an acupuncture-certified family physician for headache, were randomised. Of these, 823 (664 women) from the ages of 18 to 83 (mean 51.7) completed both parts of the study. The main outcome measure was the comparison of the scores on the 12-Item Short-Form Health Survey (SF-12) and the Graded Chronic Pain Scale (GCPS) questionnaire for the two survey modes. Results Computer-aided telephone interviews (CATI) resulted in significantly fewer missing data (0.5%) than did mailed questionnaires (2.8%; p < 0.001). The analysis of equivalence revealed a difference between the survey modes only for the SF-12 mental scales. On average, reported mental status score was 3.5 score points (2.9 to 4.0) lower on the self-administered questionnaire compared to the telephone interview. The order of administration affected results. Patients who responded to the telephone interview first reported better mental health in the subsequent paper questionnaire (mean difference 2.8 score points) compared to those who responded to the paper questionnaire first (mean difference 4.1 score points). Conclusion Despite the comparatively high cost of telephone interviews, they offer clear advantages over mailed self-administered questionnaires as regards completeness of data. Only items concerning mental status were dependent on the survey mode and sequence of administration. Items on physical status were not affected. Normative data for standardized telephone questionnaires could contribute to a better comparability with the results of the corresponding standardized paper questionnaires. PMID:18034900

Serial Assessment of Trauma Care Capacity in Ghana in 2004 and 2014.

PubMed

Stewart, Barclay T; Quansah, Robert; Gyedu, Adam; Boakye, Godfred; Abantanga, Francis; Ankomah, James; Donkor, Peter; Mock, Charles

2016-02-01

Trauma care capacity assessments in developing countries have generated evidence to support advocacy, detailed baseline capabilities, and informed targeted interventions. However, serial assessments to determine the effect of capacity improvements or changes over time have rarely been performed. To compare the availability of trauma care resources in Ghana between 2004 and 2014 to assess the effects of a decade of change in the trauma care landscape and derive recommendations for improvements. Capacity assessments were performed using direct inspection and structured interviews derived from the World Health Organization's Guidelines for Essential Trauma Care. In Ghana, 10 hospitals in 2004 and 32 hospitals in 2014 were purposively sampled to represent those most likely to care for injuries. Clinical staff, administrators, logistic/procurement officers, and technicians/biomedical engineers who interacted, directly or indirectly, with trauma care resources were interviewed at each hospital. Availability of items for trauma care was rated from 0 (complete absence) to 3 (fully available). Factors contributing to deficiency in 2014 were determined for items rated lower than 3. Each item rated lower than 3 at a specific hospital was defined as a hospital-item deficiency. Scores for total number of hospital-item deficiencies were derived for each contributing factor. There were significant improvements in mean ratings for trauma care resources: district-level (smaller) hospitals had a mean rating of 0.8 for all items in 2004 vs 1.3 in 2014 (P = .002); regional (larger) hospitals had a mean rating of 1.1 in 2004 vs 1.4 in 2014 (P = .01). However, a number of critical deficiencies remain (eg, chest tubes, diagnostics, and orthopedic and neurosurgical care; mean ratings ≤ 2). Leading contributing factors were item absence (503 hospital-item deficiencies), lack of training (335 hospital-item deficiencies), and stockout of consumables (137 hospital-item deficiencies). There has been significant improvement in trauma care capacity during the past decade in Ghana; however, critical deficiencies remain and require urgent redress to avert preventable death and disability. Serial capacity assessment is a valuable tool for monitoring efforts to strengthen trauma care systems, identifying what has been successful, and highlighting needs.

Multiple Mini-Interviews in the Age of the Internet: Does Preparation Help Applicants to Medical School?

ERIC Educational Resources Information Center

Moshinsky, Avital; Ziegler, David; Gafni, Naomi

2017-01-01

Many medical schools have adopted multiple mini-interviews (MMI) as an advanced selection tool. MMIs are expensive and used to test only a few dozen candidates per day, making it infeasible to develop a different test version for each test administration. Therefore, some items are reused both within and across years. This study investigated the…

Nebraska Collegiate Methods Professors' Perceptions of the Next Generation Science Standards: A Semi-Structured Interview Approach

ERIC Educational Resources Information Center

Rasmussen, Ashley B.

2017-01-01

This study utilized a semi-structured interview approach to identify how college methods professors in Nebraska are engaging pre-service K-12 teachers with the Next Generation Science Standards and to determine if this information is being carried over to Nebraska K-12 classrooms. The study attempted to address these items by answering the…

Suicide Attempt Self-Injury Interview (SASII): Development, Reliability, and Validity of a Scale to Assess Suicide Attempts and Intentional Self-Injury

ERIC Educational Resources Information Center

Linehan, Marsha M.; Comtois, Katherine Anne; Brown, Milton Z.; Heard, Heidi L.; Wagner, Amy

2006-01-01

The authors describe the development of the Suicide Attempt Self-Injury Interview (SASII), an instrument designed to assess the factors involved in nonfatal suicide attempts and intentional self-injury. Using 4 cohorts of participants, authors generated SASII items and evaluated them with factor and content analyses and internal consistency…

The Development and Validation of a Generic Instrument, QoDoS, for Assessing the Quality of Decision Making.

PubMed

Donelan, Ronan; Walker, Stuart; Salek, Sam

2016-01-01

The impact of decision-making during the development and the regulatory review of medicines greatly influences the delivery of new medicinal products. Currently, there is no generic instrument that can be used to assess the quality of decision-making. This study describes the development of the Quality of Decision-Making Orientation Scheme QoDoS(©) instrument for appraising the quality of decision-making. Semi-structured interviews about decision-making were carried out with 29 senior decision makers from the pharmaceutical industry (10), regulatory authorities (9) and contract research organizations (10). The interviews offered a qualified understanding of the subjective decision-making approach, influences, behaviors and other factors that impact such processes for individuals and organizations involved in the delivery of new medicines. Thematic analysis of the transcribed interviews was carried out using NVivo8® software. Content validity was carried out using qualitative and quantitative data by an expert panel, which led to the developmental version of the QoDoS. Further psychometric evaluations were performed, including factor analysis, item reduction, reliability testing and construct validation. The thematic analysis of the interviews yielded a 94-item initial version of the QoDoS(©) with a 5-point Likert scale. The instrument was tested for content validity using a panel of experts for language clarity, completeness, relevance and scaling, resulting in a favorable agreement by panel members with an intra-class correlation coefficient value of 0.89 (95% confidence interval = 0.56, 0.99). A 76-item QoDoS(©) (version 2) emerged from content validation. Factor analysis produced a 47-item measure with four domains. The 47-item QoDoS(©) (version 3) showed high internal consistency (n = 120, Cronbach's alpha = 0.89), high reproducibility (n = 20, intra-class correlation = 0.77) and a mean completion time of 10 min. Reliability testing and construct validation was successfully performed. The QoDoS(©) is both reliable and valid for use. It has the potential for extensive use in medicines development by both the pharmaceutical industry and regulatory authorities. The QoDoS(©) can be used to assess the quality of decision-making and to inform decision makers of the factors that influence decision-making.

Chameleon Changes: An Exploration of Racial Identity Themes of Multiracial People

ERIC Educational Resources Information Center

Miville, Marie L.; Constantine, Madonna G.; Baysden, Matthew F.; So-Lloyd, Gloria

2005-01-01

The current study explored essential themes of racial identity development among 10 self-identified multiracial adults from a variety of racial backgrounds. Participants were interviewed using a semistructured protocol, and the interviews were recorded, transcribed, and then coded for themes by research team members. Four primary themes were…

Quantitative Analysis of Qualitative Information from Interviews: A Systematic Literature Review

ERIC Educational Resources Information Center

Fakis, Apostolos; Hilliam, Rachel; Stoneley, Helen; Townend, Michael

2014-01-01

Background: A systematic literature review was conducted on mixed methods area. Objectives: The overall aim was to explore how qualitative information from interviews has been analyzed using quantitative methods. Methods: A contemporary review was undertaken and based on a predefined protocol. The references were identified using inclusion and…

A Constructivist Case Study Examining the Leadership Development of Undergraduate Students in Campus Recreational Sports

ERIC Educational Resources Information Center

Hall, Stacey L.; Forrester, Scott; Borsz, Melissa

2008-01-01

This constructivist case study examined undergraduate student leadership development. Twenty-one student leaders, 13 females and 8 males, in a campus recreational sports department were interviewed using a semi-structured interview protocol. Seven broad themes: organizing, planning, and delegating; balancing academic, personal and professional…

Internal and External Constraints on Teenage Mothering.

ERIC Educational Resources Information Center

Mercer, Ramona T.

This paper reports findings of an exploratory field study of the teenager's first year of motherhood. Twelve subjects, aged 14-19, were interviewed a number of times during that year. Interviews were largely unstructured, allowing mothers to express their concerns and feelings. Data for analysis were: (1) narrative style protocols that were…

What Do Instructional Designers in Higher Education Really Do?

ERIC Educational Resources Information Center

Kumar, Swapna; Ritzhaupt, Albert

2017-01-01

What do instructional designers in higher education really do? With the rise in online courses and programs in higher education, this question is especially important. We interviewed eight instructional designers from across the United States using a semi-structured interview protocol. The results were analyzed using the constant comparative…

The heritability of cluster A personality disorders assessed by both personal interview and questionnaire.

PubMed

Kendler, Kenneth S; Myers, John; Torgersen, Svenn; Neale, Michael C; Reichborn-Kjennerud, Ted

2007-05-01

Personality disorders (PDs) as assessed by questionnaires and personal interviews are heritable. However, we know neither how much unreliability of measurement impacts on heritability estimates nor whether the genetic and environmental risk factors assessed by these two methods are the same. We wish to know whether the same set of PD vulnerability factors are assessed by these two methods. A total of 3334 young adult twin pairs from the Norwegian Institute of Public Health Twin Panel (NIPHTP) completed a questionnaire containing 91 PD items. One to 6 years later, 1386 of these pairs were interviewed with the Structured Interview for DSM-IV Personality (SIDP-IV). Self-report items predicting interview results were selected by regression. Measurement models were fitted using Mx. In the best-fit models, the latent liabilities to paranoid personality disorder (PPD), schizoid personality disorder (SPD) and schizotypal personality disorder (STPD) were all highly heritable with no evidence of shared environmental effects. For PPD and STPD, only unique environmental effects were specific to the interview measure whereas both environmental and genetic effects were found to be specific to the questionnaire assessment. For SPD, the best-fit model contained genetic and environmental effects specific to both forms of assessment. The latent liabilities to the cluster A PDs are highly heritable but are assessed by current methods with only moderate reliability. The personal interviews assessed the genetic risk for the latent trait with excellent specificity for PPD and STPD and good specificity for SPD. However, for all three PDs, the questionnaires were less specific, also indexing an independent set of genetic risk factors.

The development of the PARENTS: a tool for parents to assess residents' non-technical skills in pediatric emergency departments.

PubMed

Moreau, Katherine A; Eady, Kaylee; Tang, Kenneth; Jabbour, Mona; Frank, Jason R; Campbell, Meaghan; Hamstra, Stanley J

2017-11-14

Parents can assess residents' non-technical skills (NTS) in pediatric emergency departments (EDs). There are no assessment tools, with validity evidence, for parental use in pediatric EDs. The purpose of this study was to develop the Parents' Assessment of Residents Enacting Non-Technical Skills (PARENTS) educational assessment tool and collect three sources of validity evidence (i.e., content, response process, internal structure) for it. We established content evidence for the PARENTS through interviews with physician-educators and residents, focus groups with parents, a literature review, and a modified nominal group technique with experts. We collected response process evidence through cognitive interviews with parents. To examine the internal structure evidence, we administered the PARENTS and performed exploratory factor analysis. Initially, a 20-item PARENTS was developed. Cognitive interviews led to the removal of one closed-ended item, the addition of resident photographs, and wording/formatting changes. Thirty-seven residents and 434 parents participated in the administration of the resulting 19-item PARENTS. Following factor analysis, a one-factor model prevailed. The study presents initial validity evidence for the PARENTS. It also highlights strategies for potentially: (a) involving parents in the assessment of residents, (b) improving the assessment of NTS in pediatric EDs, and (c) capturing parents' perspectives to improve the preparation of future physicians.

Development and Validation of a Computerized-Adaptive Test for PTSD (P-CAT).

PubMed

Eisen, Susan V; Schultz, Mark R; Ni, Pengsheng; Haley, Stephen M; Smith, Eric G; Spiro, Avron; Osei-Bonsu, Princess E; Nordberg, Sam; Jette, Alan M

2016-10-01

The primary purpose was to develop, field test, and validate a computerized-adaptive test (CAT) for posttraumatic stress disorder (PTSD) to enhance PTSD assessment and decrease the burden of symptom monitoring. Data sources included self-report and interviewer-administered diagnostic interviews. The sample included 1,288 veterans. In phase 1, 89 items from a previously developed PTSD item pool were administered to a national sample of 1,085 veterans. A multidimensional graded-response item response theory model was used to calibrate items for incorporation into a CAT for PTSD (P-CAT). In phase 2, in a separate sample of 203 veterans, the P-CAT was validated against three other self-report measures (PTSD Checklist, Civilian Version; Mississippi Scale for Combat-Related PTSD; and Primary Care PTSD Screen) and the PTSD module of the Structured Clinical Interview for DSM-IV. A bifactor model with one general PTSD factor and four subfactors consistent with DSM-5 (reexperiencing, avoidance, negative mood-cognitions, and arousal), yielded good fit. The P-CAT discriminated veterans with PTSD from those with other mental health conditions and those with no mental health conditions (Cohen's d effect sizes >.90). The P-CAT also discriminated those with and without a PTSD diagnosis and those who screened positive versus negative for PTSD. Concurrent validity was supported by high correlations (r=.85-.89) with the validation measures. The P-CAT appears to be a promising tool for efficient and accurate assessment of PTSD symptomatology. Further testing is needed to evaluate its responsiveness to change. With increasing availability of computers and other technologies, CAT may be a viable and efficient assessment method.

Reliability and validity of the Norwegian WHOQOL-OLD module.

PubMed

Halvorsrud, Liv; Kalfoss, Mary; Diseth, Age

2008-06-01

The aim of this study was to examine the validity and reliability of the Norwegian WHOQOL-OLD six-facet, 24-item module designed for assessing generic quality of life cross-culturally among the elderly. Using quota-stratified sampling defined on the basis of sex, age and geographical representation, 401 respondents were drawn from Statistics Norway and completed postal surveys. An additional 89 elderly completed personal interviews. Correlation and multivariate analyses partly confirmed the relevance of individual items and facets in both groups. All items correlated significantly higher with their original facets, although almost half of these items correlated with other facets in both groups. Multiple regression analysis of the module and two overall questions (dependent variables) showed that three facets made significant contributions to overall health, with Social Participation (B = 0.09) contributing most strongly in the postal-group. In the interview-group, only Social Participation (B = 0.20) was found to make a significant contribution, and this was in relation to overall health satisfaction. When the WHOQOL-BREF total score was considered as the dependent variable, different facets contributed significantly in both groups. Exploratory factor analysis of the WHOQOL-OLD in the combined group of both postal and interview samples, resulted in a five-factor solution (eigenvalues >1) explaining 65% of the cumulative variance in five of the six originally operationalized facets. The most conceptually clear facets were Death and Dying and Sensory Abilities. Further, confirmatory factor analyses in the combined group demonstrated a model with good fit, but with high covariance between the factors. Acceptable internal consistency was shown except for the Past, Present and Future Activities in both groups. Since construct validity was only partially confirmed, exploration of the scale's conceptual validity needs further testing in Norwegian and international samples.

Efficacy of the alcohol use disorders identification test as a screening tool for hazardous alcohol intake and related disorders in primary care: a validity study.

PubMed Central

Piccinelli, M.; Tessari, E.; Bortolomasi, M.; Piasere, O.; Semenzin, M.; Garzotto, N.; Tansella, M.

1997-01-01

OBJECTIVE: To determine the properties of the alcohol use disorders identification test in screening primary care attenders for alcohol problems. DESIGN: A validity study among consecutive primary care attenders aged 18-65 years. Every third subject completed the alcohol use disorders identification test (a 10 item self report questionnaire on alcohol intake and related problems) and was interviewed by an investigator with the composite international diagnostic interview alcohol use module (a standardised interview for the independent assessment of alcohol intake and related disorders). SETTING: 10 primary care clinics in Verona, north eastern Italy. PATIENTS: 500 subjects were approached and 482 (96.4%) completed evaluation. RESULTS: When the alcohol use disorders identification test was used to detect subjects with alcohol problems the area under the receiver operating characteristic curve was 0.95. The cut off score of 5 was associated with a sensitivity of 0.84, a specificity of 0.90, and a positive predictive value of 0.60. The screening ability of the total score derived from summing the responses to the five items minimising the probability of misclassification between subjects with and without alcohol problems provided an area under the receiver operating characteristic curve of 0.93. A score of 5 or more on the five items was associated with a sensitivity of 0.79, a specificity of 0.95, and a positive predictive value of 0.73. CONCLUSIONS: The alcohol use disorders identification test performs well in detecting subjects with formal alcohol disorders and those with hazardous alcohol intake. Using five of the 10 items on the questionnaire gives reasonable accuracy, and these are recommended as questions of choice to screen patients for alcohol problems. PMID:9040389

Item generation in the development of an inpatient experience questionnaire: a qualitative study

PubMed Central

2013-01-01

Background Patient experience is a key feature of quality improvement in modern health-care delivery. Measuring patient experience is one of several tools used to assess and monitor the quality of health services. This study aims to develop a tool for assessing patient experience with inpatient care in public hospitals in Hong Kong. Methods Based on the General Inpatient Questionnaire (GIQ) framework of the Care Quality Commission as a discussion guide, a qualitative study involving focus group discussions and in-depth individual interviews with patients was employed to develop a tool for measuring inpatient experience in Hong Kong. Results All participants agreed that a patient satisfaction survey is an important platform for collecting patients’ views on improving the quality of health-care services. Findings of the focus group discussions and in-depth individual interviews identified nine key themes as important hospital quality indicators: prompt access, information provision, care and involvement in decision making, physical and emotional needs, coordination of care, respect and privacy, environment and facilities, handling of patient feedback, and overall care from health-care professionals and quality of care. Privacy, complaint mechanisms, patient involvement, and information provision were further highlighted as particularly important areas for item revision by the in-depth individual interviews. Thus, the initial version of the Hong Kong Inpatient Experience Questionnaire (HKIEQ), comprising 58 core items under nine themes, was developed. Conclusions A set of dimensions and core items of the HKIEQ was developed and the instrument will undergo validity and reliability tests through a validation survey. A valid and reliable tool is important in accurately assessing patient experience with care delivery in hospitals to improve the quality of health-care services. PMID:23835186

Development of a disease-specific quality of life questionnaire for patients with aplastic anemia and/or paroxysmal nocturnal hemoglobinuria (QLQ-AA/PNH)-report on phases I and II.

PubMed

Groth, Martha; Singer, Susanne; Niedeggen, Cathrin; Petermann-Meyer, Andrea; Röth, Alexander; Schrezenmeier, Hubert; Höchsmann, Britta; Brümmendorf, Tim H; Panse, Jens

2017-02-01

Acquired aplastic anemia (AA) and paroxysmal nocturnal hemoglobinuria (PNH) are interrelated ultra-rare diseases. Quality of life (QoL) evaluation tools used in studies for AA and PNH are unspecific and designed for cancer patients (e.g., the European Organization for Research and Treatment of Cancer Quality of Life Questionnaire, EORTC QLQ-C30). Given the complexity of AA and PNH, variation in symptoms and treatments, younger age of many patients, and the fact that AA and PNH are not classified as malignant diseases, it is likely that cancer-specific questionnaires are inappropriate. We generate an AA/PNH-specific QoL questionnaire (QLQ-AA/PNH), performed according to EORTC guidelines. QoL issues were obtained from the literature and interviews with patients and physicians (phase I), then ranked by patients and physicians. In phase II, items were created. Patients in more than 25 German and Swiss cities were interviewed face to face. In phase I, interviews of 19 patients and 8 physicians specialized in AA/PNH treatment resulted in 649 QoL issues; these were condensed to 175 and graded according to their importance by 30 patients and 14 physicians (phase II). Five physicians took part in phases I and II. Altogether, 97 issues were rated important. Twelve EORTC QLQ-C30 items were not rated important, while several new QoL aspects were brought up. Modifications in wording and phrasing led to two questionnaires with 77 items regarding general QoL aspects and 20 items regarding medical care. Important QoL aspects of PNH/AA patients are inappropriately captured with available QoL tools. Developing a new QoL questionnaire specific for this patient group is warranted.

Analysis of Nonequivalent Assessments across Different Linguistic Groups Using a Mixed Methods Approach: Understanding the Causes of Differential Item Functioning by Cognitive Interviewing

ERIC Educational Resources Information Center

Benítez, Isabel; Padilla, José-Luis

2014-01-01

Differential item functioning (DIF) can undermine the validity of cross-lingual comparisons. While a lot of efficient statistics for detecting DIF are available, few general findings have been found to explain DIF results. The objective of the article was to study DIF sources by using a mixed method design. The design involves a quantitative phase…

Reliability and validity of a scale to measure consumer attitudes regarding the private food safety certification of restaurants.

PubMed

Uggioni, Paula Lazzarin; Salay, Elisabete

2012-04-01

Validated and reliable instruments for measuring consumer attitudes regarding food quality certifications are lacking, but the measurement of consumer attitude could be an important tool for understanding consumer behavior. Thus the objective of this study was to develop an instrument for measuring consumer attitudes regarding private food safety certifications for commercial restaurants. To this end, the following steps were carried out: development of the interview items; complete pilot testing; item analyses (influence of social desirability and total-item correlation); reliability test (internal consistency and test-retest); and validity assessment (content and discriminative validity and exploratory and confirmatory factor analysis). The subjects, all over the age of 18 and drawn from six non-probabilistic samples (n=7-350) in the city of Campinas, Brazil, were all subjected to an interview. The final scale included 24 items and had a Cronbach's alpha coefficient of 0.79 and a content validation coefficient of 0.99, both within acceptable limits. The confirmatory factor analysis validated a model with five factors and the final instrument discriminated reasonably well between the groups and showed satisfactory reproducibility (r=0.955). Furthermore, the scale validity and reliability were satisfactory, suggesting it could also be applied to future studies. Copyright © 2011 Elsevier Ltd. All rights reserved.

Merging video coaching and an anthropologic approach to understand health care provider behavior toward hand hygiene protocols.

PubMed

Boudjema, Sophia; Tarantini, Clément; Peretti-Watel, Patrick; Brouqui, Philippe

2017-05-01

We used videorecordings of routine care to analyze health care providers' deviance from protocols and organized follow-up interviews that were conducted by an anthropologist and a nurse. After consent, health care workers were recorded during routine care by an automatic video remote control. Each participant was invited to watch her or his recorded behaviors on 2 different videos showing routine practices and her or his deviance from protocols, and to comment on them. After this step an in-depth interview based on preestablished guidelines was organized and explanations regarding the observed deviance was discussed. This design was intended to reveal the HCWs' subjectivity; that is, how they perceive hand hygiene issues in their daily routine, what concrete difficulties they face, and how they try to resolve them. We selected 43 of 250 videorecordings created during the study, which allowed us to study 15 out of 20 health care professionals. Twenty out of 43 videos showed 1 or more breaches in the hand hygiene protocol. The breaches were frequently linked to glove abuse. Deviance from protocols was explained by the health care workers as the result of an adaptive behavior; that is, facing work constraints that were disconnected from infection control protocols. Professional practices and protocols should be revisited to create simple messages that are adapted to the mandatory needs in a real life clinic environment. Copyright © 2017 Association for Professionals in Infection Control and Epidemiology, Inc. Published by Elsevier Inc. All rights reserved.

Clients' Retrospective Accounts of Corrective Experiences in Psychotherapy: An International, Multisite Collaboration.

PubMed

Constantino, Michael J; Angus, Lynne

2017-02-01

This article introduces a series of 4 original research reports that used varied qualitative methods for understanding an internationally diverse sample of clients' own accounts of corrective experiences (CEs), as they looked back on their completed psychotherapy. The basis for all studies, which were conducted across 4 different countries, was the Patients' Perceptions of Corrective Experiences in Individual Therapy (PPCEIT) semistructured interview protocol (Constantino, Angus, Friedlander, Messer, & Moertl, 2011). The PPCEIT interview assesses clients' retrospective accounts of aspects of self, other, and/or relationships that may have been corrected, and what they perceived as corrective experiences that facilitated such transformations. It also asks for specific, detailed examples of these accounts and experiences. Across all studies, the PPCEIT interview generated rich clinical material and resulting empirically generated themes that may inform clinical practice. After briefly defining the CE construct and highlighting a lack of research on clients' own accounts of such experiences, we describe the development of the PPCEIT interview (and provide the full interview manual and question protocol as appendices). We then summarize the foci of the culturally diverse reports in this series. © 2016 Wiley Periodicals, Inc.

Development of the Pulmonary Arterial Hypertension-Symptoms and Impact (PAH-SYMPACT®) questionnaire: a new patient-reported outcome instrument for PAH.

PubMed

McCollister, Deborah; Shaffer, Shannon; Badesch, David B; Filusch, Arthur; Hunsche, Elke; Schüler, René; Wiklund, Ingela; Peacock, Andrew

2016-06-14

Regulators and clinical experts increasingly recognize the importance of incorporating patient-reported outcomes (PROs) in clinical studies of therapies for pulmonary arterial hypertension (PAH). No PAH-specific instruments have been developed to date in accordance with the 2009 FDA guidance for the development of PROs as endpoints in clinical trials. A qualitative research study was conducted to develop a new instrument assessing PAH symptoms and their impacts following the FDA PRO guidance. A cross-sectional study was conducted at 5 centers in the US in symptomatic PAH patients aged 18-80 years. Concept elicitation was based on 5 focus group discussions, after which saturation of emergent concepts was reached. A PRO instrument for PAH symptoms and their impacts was drafted. To assess the appropriateness of items, instructions, response options, and recall periods, 2 rounds of one-on-one cognitive interviews were conducted, with instrument revisions following each round. Additional interviews tested the usability of an electronic version (ePRO). PRO development considered input from an international Steering Committee, and translatability and lexibility assessments. Focus groups comprised 25 patients (5 per group); 20 additional patients participated in cognitive interviews (10 per round); and 10 participated in usability interviews. Participants had a mean ± SD age of 53.1 ± 15.8 years, were predominantly female (93 %), and were diverse in race/ethnicity, WHO functional class (FC I/II: 56 %, III/IV: 44 %), and PAH etiology (idiopathic: 56 %, familial: 2 %, associated: 42 %). The draft PRO instrument (PAH-SYMPACT®) was found to be clear, comprehensive, and relevant to PAH patients in cognitive interviews. Items were organized in a draft conceptual framework with 16 symptom items in 4 domains (respiratory symptoms, tiredness, cardiovascular symptoms, other symptoms) and 25 impact items in 5 domains (physical activities, daily activities, social impact, cognition, emotional impact). The recall period is the past 24 h for symptoms, and the past 7 days for impacts. The PAH-SYMPACT® was shown to capture symptoms and their impacts relevant to PAH patients, demonstrating content saturation, concept validity, and ePRO usability. Final content and psychometric validation of the instrument will be based on the results of an ongoing Phase IIIb clinical trial in PAH patients.

The Content Validity of a Chemotherapy-Induced Peripheral Neuropathy Patient-Reported Outcome Measure

PubMed Central

Lavoie Smith, Ellen M.; Haupt, Rylie; Kelly, James P.; Lee, Deborah; Kanzawa-Lee, Grace; Knoerl, Robert; Bridges, Celia; Alberti, Paola; Prasertsri, Nusara; Donohoe, Clare

2018-01-01

Purpose/Objectives To test the content validity of a 16-item version of the European Organisation for Research and Treatment of Cancer (EORTC) Quality of Life Questionnaire–Chemotherapy-Induced Peripheral Neuropathy (QLQ-CIPN20). Research Approach Cross-sectional, prospective, qualitative design. Setting Six outpatient oncology clinics within the University of Michigan Health System’s comprehensive cancer center in Ann Arbor. Participants 25 adults with multiple myeloma or breast, gynecologic, gastrointestinal, or head and neck malignancies experiencing peripheral neuropathy caused by neurotoxic chemotherapy. Methodologic Approach Cognitive interviewing methodology was used to evaluate the content validity of a 16-item version of the QLQ-CIPN20 instrument. Findings Minor changes were made to three questions to enhance readability. Twelve questions were revised to define unfamiliar terminology, clarify the location of neuropathy, and emphasize important aspects. One question was deleted because of clinical and conceptual redundancy with other items, as well as concerns regarding generalizability and social desirability. Interpretation Cognitive interviewing methodology revealed inconsistencies between patients’ understanding and researchers’ intent, along with points that required clarification to avoid misunderstanding. Implications for Nursing Patients’ interpretations of the instrument’s items were inconsistent with the intended meanings of the questions. One item was dropped and others were revised, resulting in greater consistency in how patients, clinicians, and researchers interpreted the items’ meanings and improving the instrument’s content validity. Following additional revision and psychometric testing, the QLQ-CIPN20 could evolve into a gold-standard CIPN patient-reported outcome measure. PMID:28820525

Building the BIKE: Development and Testing of the Biotechnology Instrument for Knowledge Elicitation (BIKE)

NASA Astrophysics Data System (ADS)

Witzig, Stephen B.; Rebello, Carina M.; Siegel, Marcelle A.; Freyermuth, Sharyn K.; Izci, Kemal; McClure, Bruce

2014-10-01

Identifying students' conceptual scientific understanding is difficult if the appropriate tools are not available for educators. Concept inventories have become a popular tool to assess student understanding; however, traditionally, they are multiple choice tests. International science education standard documents advocate that assessments should be reform based, contain diverse question types, and should align with instructional approaches. To date, no instrument of this type targeting student conceptions in biotechnology has been developed. We report here the development, testing, and validation of a 35-item Biotechnology Instrument for Knowledge Elicitation (BIKE) that includes a mix of question types. The BIKE was designed to elicit student thinking and a variety of conceptual understandings, as opposed to testing closed-ended responses. The design phase contained nine steps including a literature search for content, student interviews, a pilot test, as well as expert review. Data from 175 students over two semesters, including 16 student interviews and six expert reviewers (professors from six different institutions), were used to validate the instrument. Cronbach's alpha on the pre/posttest was 0.664 and 0.668, respectively, indicating the BIKE has internal consistency. Cohen's kappa for inter-rater reliability among the 6,525 total items was 0.684 indicating substantial agreement among scorers. Item analysis demonstrated that the items were challenging, there was discrimination among the individual items, and there was alignment with research-based design principles for construct validity. This study provides a reliable and valid conceptual understanding instrument in the understudied area of biotechnology.

Differential item functioning of the Geriatric Depression Scale in an Asian population.

PubMed

Broekman, B F P; Nyunt, S Z; Niti, M; Jin, A Z; Ko, S M; Kumar, R; Fones, C S L; Ng, T P

2008-06-01

The Geriatric Depression Scale (GDS) is widely used for screening and assessment of major depressive disorder (MDD). Screening scales are often culture-specific and should be evaluated for item response bias (synonymously differential item functioning, DIF) before use in clinical practice and research in a different population. In this study, we examined DIF associated with age, gender, ethnicity and chronic illness in a heterogeneous Asian population in Singapore. The GDS-15 and Structured Clinical Interview for DSM-IV diagnosis of MDD were independently administered by interviewers on 4253 non-institutionalized community living elderly subjects aged 60 years and above who were users of social service agencies. Multiple Indicator Multiple Cause latent variable modelling was used to identify DIF. We found evidence of significant DIF associated with age, gender, ethnicity and chronic illness for 8 items: dropped many activities and interests, afraid something bad is going to happen, prefer staying home to going out, more problems with memory than most, think it is (not) wonderful to be alive, feel pretty worthless, feel (not) full of energy, feel that situation is hopeless. The smaller number of minority Indian and Malay subjects and the self-report of chronic medical illnesses. In a heterogeneous mix of respondents in Singapore, eight items of the GDS-15 showed DIF for age, gender, ethnicity and chronic illness. The awareness and identification of DIF in the GDS-15 provides a rational basis for its use in diverse population groups and guiding the derivation of abbreviated scales.

Specifications Used for ASA24® Digital Images

Cancer.gov

The Children's Nutrition Research Center's (CNRC) at the Baylor College of Medicine developed a food photography system to photograph precise portion sizes of a large number of food items to create quality standardized images used for dietary recall protocols.

NEREC, an effective brain mapping protocol for combined language and long-term memory functions.

PubMed

Perrone-Bertolotti, Marcela; Girard, Cléa; Cousin, Emilie; Vidal, Juan Ricardo; Pichat, Cédric; Kahane, Philippe; Baciu, Monica

2015-12-01

Temporal lobe epilepsy can induce functional plasticity in temporoparietal networks involved in language and long-term memory processing. Previous studies in healthy subjects have revealed the relative difficulty for this network to respond effectively across different experimental designs, as compared to more reactive regions such as frontal lobes. For a protocol to be optimal for clinical use, it has to first show robust effects in a healthy cohort. In this study, we developed a novel experimental paradigm entitled NEREC, which is able to reveal the robust participation of temporoparietal networks in a uniquely combined language and memory task, validated in an fMRI study with healthy subjects. Concretely, NEREC is composed of two runs: (a) an intermixed language-memory task (confrontation naming associated with encoding in nonverbal items, NE) to map language (i.e., word retrieval and lexico-semantic processes) combined with simultaneous long-term verbal memory encoding (NE items named but also explicitly memorized) and (b) a memory retrieval task of items encoded during NE (word recognition, REC) intermixed with new items. Word recognition is based on both perceptual-semantic familiarity (feeling of 'know') and accessing stored memory representations (remembering). In order to maximize the remembering and recruitment of medial temporal lobe structures, we increased REC difficulty by changing the modality of stimulus presentation (from nonverbal during NE to verbal during REC). We report that (a) temporoparietal activation during NE was attributable to both lexico-semantic (language) and memory (episodic encoding and semantic retrieval) processes; that (b) encoding activated the left hippocampus, bilateral fusiform, and bilateral inferior temporal gyri; and that (c) task recognition (recollection) activated the right hippocampus and bilateral but predominant left fusiform gyrus. The novelty of this protocol consists of (a) combining two tasks in one (language and long-term memory encoding/recall) instead of applying isolated tasks to map temporoparietal regions, (b) analyzing NE data based on performances recorded during REC, (c) double-mapping networks involved in naming and in long-term memory encoding and retrieval, (d) focusing on remembering with hippocampal activation and familiarity judgment with lateral temporal cortices activation, and (e) short duration of examination and feasibility. These aspects are of particular interest in patients with TLE, who frequently show impairment of these cognitive functions. Here, we show that the novel protocol is suited for this clinical evaluation. Copyright © 2015 Elsevier Inc. All rights reserved.

QKD-based quantum private query without a failure probability

NASA Astrophysics Data System (ADS)

Liu, Bin; Gao, Fei; Huang, Wei; Wen, QiaoYan

2015-10-01

In this paper, we present a quantum-key-distribution (QKD)-based quantum private query (QPQ) protocol utilizing single-photon signal of multiple optical pulses. It maintains the advantages of the QKD-based QPQ, i.e., easy to implement and loss tolerant. In addition, different from the situations in the previous QKD-based QPQ protocols, in our protocol, the number of the items an honest user will obtain is always one and the failure probability is always zero. This characteristic not only improves the stability (in the sense that, ignoring the noise and the attack, the protocol would always succeed), but also benefits the privacy of the database (since the database will no more reveal additional secrets to the honest users). Furthermore, for the user's privacy, the proposed protocol is cheat sensitive, and for security of the database, we obtain an upper bound for the leaked information of the database in theory.

AIDS Knowledge and Attitudes, Provisional Data from the National Health Interview Survey: United States, August 1987. Advance Data from Vital and Health Statistics. No. 146.

ERIC Educational Resources Information Center

Dawson, Deborah A.; And Others

This document presents provisional data for all Acquired Immune Deficiency Syndrome (AIDS) questionnaire items from the National Health Interview Survey (NHIS) for August 1987. It notes that the AIDS questionnaire was designed to provide baseline estimates of public knowledge and attitudes about AIDS transmission, the prevention of AIDS virus…

Psychometrics of the Zarit Burden Interview in Caregivers of Patients With Heart Failure.

PubMed

Al-Rawashdeh, Sami Y; Lennie, Terry A; Chung, Misook L

Identification of family caregivers who are burdened by the caregiving experience is vital to prevention of poor outcomes associated with caregiving. The Zarit Burden Interview (ZBI), a well-known measure of caregiving burden in caregivers of patients with dementia, has been used without being validated in caregivers of patients with heart failure (HF). The purpose of this study is to examine the reliability and validity of the ZBI in caregivers of patients with HF. A total of 124 primary caregivers of patients with HF completed survey questionnaires. Caregiving burden was measured by the ZBI. Reliability was examined using Cronbach's α and item-total/item-item correlations. Convergent validity was examined using correlations with the Oberst Caregiving Burden Scale. Construct validity was demonstrated by exploratory factor analysis and known hypothesis testing (ie, the hypothesis of the association between caregiving burden and depressive symptoms). Cronbach's α for the ZBI was .921. The ZBI had good item-total (r = 0.395-0.764) and item-item (mean r = 0.365) correlations. Significant correlations between the ZBI and the Oberst Caregiving Burden Scale (r = 0.466 for the caregiving time subscale and 0.583 for the caregiving task difficulty subscale; P < .001 for both) supported convergent validity. Four factors were identified (ie, consequences of caregiving, patient's dependence, exhaustion with caregiving and uncertainty, and guilt and fear for the patient's future) using factor analysis, which are consistent with previous studies. Caregivers with high burden scores had significantly higher depressive symptoms than did caregivers with lower burden scores (7.0 ± 6.8 vs 3.1 ± 4.3; P < .01). The findings provide evidence that the ZBI is a reliable and valid measure for assessing burden in caregivers of patients with HF.

Key Hospital Anxiety and Depression Scale (HADS) items associated with DSM-IV depressive and anxiety disorder 12-months post traumatic brain injury.

PubMed

McKenzie, Dean P; Downing, Marina G; Ponsford, Jennie L

2018-08-15

Anxiety and depression are common problems following traumatic brain injury (TBI), warranting routine screening. Self-report rating scales including the Hospital Anxiety and Depression Scale (HADS) are associated with depression and anxiety diagnoses in individuals with TBI. The relationship between individual HADS symptoms and structured clinical interview methods (SCID) requires further investigation, particularly in regard to identifying a small number of key items that can potentially be recognised by clinicians and carers of individuals with TBI. 138 individuals sustaining a complicated-mild to severe TBI completed the HADS, and the Structured Clinical Interview for DSM-IV, Research Version (SCID) at 12-months post-injury. The associations between individual HADS items, separately and in combination, as well as overall depression and anxiety subscale scores, and SCID-diagnosed depressive and anxiety disorders were analysed. CART (Classification and Regression Tree) analysis found HADS depression item 2 "I still enjoy the things I used to enjoy" and a combination of two anxiety items, 3 "I get a sort of frightened feeling as if something awful is about to happen" and 5 "worrying thoughts go through my mind", performed similarly to total depression and anxiety subscales in terms of their association with depressive and anxiety disorders respectively, at 12-months post-injury. Patients were predominantly injured in motor vehicle accidents and received comprehensive care within a no-fault accident compensation system and so may not be representative of the wider TBI population. Although validation is required, a small number of self-report items are highly associated with 12-month post-injury diagnoses. Copyright © 2018 Elsevier B.V. All rights reserved.

Measuring attributes of health literate health care organizations from the patients' perspective: Development and validation of a questionnaire to assess health literacy-sensitive communication (HL-COM).

PubMed

Ernstmann, Nicole; Halbach, Sarah; Kowalski, Christoph; Pfaff, Holger; Ansmann, Lena

2017-04-01

Studies addressing the organizational contexts of care that may help increase the patients' ability to cope with a disease and to navigate through the health care system are still rare. Especially instruments allowing the assessment of such organizational efforts from the patients' perspective are missing. The aim of our study was to develop a survey instrument assessing organizational health literacy (HL) from the patients' perspective, i. e., health care organizations' responsiveness to patients' individual needs. A pool of 30 items was developed by a group of experts based on a literature review. The items were developed, tested and prioritized according to their importance in 11 semi-structured interviews and cognitive think-aloud interviews with cancer patients. The resulting 16 items were rated in a standardized postal survey involving a total of N=453 colon and breast cancer patients treated in cancer centers in Germany. An exploratory factor analysis, a confirmatory factor analysis and structural equation modelling were conducted. Item properties were analyzed. 83.2 % of the patients were diagnosed with breast cancer, 16.8 % had a diagnosis of colon cancer. The patients' mean age was 61 (26-88), 89.4 % were female. The most common comorbidities were hypertension (34.0 %) and cardiovascular disease (11.0 %). The final prediction model included nine items measuring the degree of health literacy-sensitivity of communication. The model showed an acceptable model fit. The nine items showed corrected item-total correlations between .622 and .762 and item difficulties between 0.77 and 0.87. Cronbach's α was .912. In a comprehensive development process, the original item pool comprising several aspects of organizational HL was reduced to a one-dimensional scale. The instrument measures an important aspect of organizational HL; i.e., the degree of health literacy-sensitivity of communication (HL-COM). HL-COM was found to impact patient enablement, mediated through the support by physicians. Future research will have to test these associations in the context of other diseases or institutions. Copyright © 2017. Published by Elsevier GmbH.

Strategic assessment of the availability of pediatric trauma care equipment, technology and supplies in Ghana.

PubMed

Ankomah, James; Stewart, Barclay T; Oppong-Nketia, Victor; Koranteng, Adofo; Gyedu, Adam; Quansah, Robert; Donkor, Peter; Abantanga, Francis; Mock, Charles

2015-11-01

This study aimed to assess the availability of pediatric trauma care items (i.e. equipment, supplies, technology) and factors contributing to deficiencies in Ghana. Ten universal and 9 pediatric-sized items were selected from the World Health Organization's Guidelines for Essential Trauma Care. Direct inspection and structured interviews with administrative, clinical and biomedical engineering staff were used to assess item availability at 40 purposively sampled district, regional and tertiary hospitals in Ghana. Hospital assessments demonstrated marked deficiencies for a number of essential items (e.g. basic airway supplies, chest tubes, blood pressure cuffs, electrolyte determination, portable X-ray). Lack of pediatric-sized items resulting from equipment absence, lack of training, frequent stock-outs and technology breakage were common. Pediatric items were consistently less available than adult-sized items at each hospital level. This study identified several successes and problems with pediatric trauma care item availability in Ghana. Item availability could be improved, both affordably and reliably, by better organization and planning (e.g. regular assessment of demand and inventory, reliable financing for essential trauma care items). In addition, technology items were often broken. Developing local service and biomedical engineering capability was highlighted as a priority to avoid long periods of equipment breakage. Copyright © 2015 Elsevier Inc. All rights reserved.

Strategic assessment of the availability of pediatric trauma care equipment, technology and supplies in Ghana

PubMed Central

Ankomah, James; Stewart, Barclay T; Oppong-Nketia, Victor; Koranteng, Adofo; Gyedu, Adam; Quansah, Robert; Donkor, Peter; Abantanga, Francis; Mock, Charles

2015-01-01

Background This study aimed to assess the availability of pediatric trauma care items (i.e. equipment, supplies, technology) and factors contributing to deficiencies in Ghana. Methods Ten universal and 9 pediatric-sized items were selected from the World Health Organization’s Guidelines for Essential Trauma Care. Direct inspection and structured interviews with administrative, clinical and biomedical engineering staff were used to assess item availability at 40 purposively sampled district, regional and tertiary hospitals in Ghana. Results Hospital assessments demonstrated marked deficiencies for a number of essential items (e.g. basic airway supplies, chest tubes, blood pressure cuffs, electrolyte determination, portable Xray). Lack of pediatric-sized items resulting from equipment absence, lack of training, frequent stock-outs and technology breakage were common. Pediatric items were consistently less available than adult-sized items at each hospital level. Conclusion This study identified several successes and problems with pediatric trauma care item availability in Ghana. Item availability could be improved, both affordably and reliably, by better organization and planning (e.g. regular assessment of demand and inventory, reliable financing for essential trauma care items). In addition, technology items were often broken. Developing local service and biomedical engineering capability was highlighted as a priority to avoid long periods of equipment breakage. PMID:25841284

Turkish Preservice Science Teachers' Informal Reasoning regarding Socioscientific Issues and the Factors Influencing Their Informal Reasoning

ERIC Educational Resources Information Center

Topcu, Mustafa Sami; Yilmaz-Tuzun, Ozgul; Sadler, Troy D.

2011-01-01

The purpose of the study is to explore Turkish preservice science teachers' informal reasoning regarding socioscientific issues and the factors influencing their informal reasoning. The researchers engaged 39 preservice science teachers in informal reasoning interview and moral decision-making interview protocols. Of the seven socioscientific…

Influence of Mentorship Experiences in the Development of Women Superintendents in Texas as Transformational Leaders

ERIC Educational Resources Information Center

Howard, Elaine; Msengi, Clementine; Harris, Sandra

2017-01-01

Ten women superintendents in Texas were interviewed for this phenomenological narrative study to understand their mentoring experiences framed within transformational leadership theory. The research used a guided protocol to conduct face-to-face interviews. In this study, authors sought to answer questions about the influence of mentorship…

Adult Adjustment of Survivors of Institutional Child Abuse in Ireland

ERIC Educational Resources Information Center

Carr, Alan; Dooley, Barbara; Fitzpatrick, Mark; Flanagan, Edel; Flanagan-Howard, Roisin; Tierney, Kevin; White, Megan; Daly, Margaret; Egan, Jonathan

2010-01-01

Objective: To document the adult adjustment of survivors of childhood institutional abuse. Method: Two hundred and forty-seven adult survivors of institutional abuse with a mean age of 60 were interviewed with a protocol that included the Childhood Trauma Questionnaire, modules from the Structured Clinical Interview for Axis I Disorders of DSM IV…

Connected Learning in Co-Operative Education

ERIC Educational Resources Information Center

Jones, Jeela

2007-01-01

This qualitative research study explored the experiences of students who had attended a co operative (co-op) education program, with a focus on what makes the experience meaningful to them. Utilizing a basic interpretive research design, students who graduated from a co-op program were interviewed using an open-ended interview protocol. Both male…

Using Think-Aloud Protocols to Investigate Secondary School Chemistry Teachers' Misconceptions about Chemical Equilibrium

ERIC Educational Resources Information Center

Cheung, Derek

2009-01-01

Secondary school chemistry teachers' understanding of chemical equilibrium was investigated through interviews using the think-aloud technique. The interviews were conducted with twelve volunteer chemistry teachers in Hong Kong. Their teaching experience ranged from 3 to 18 years. They were asked to predict what would happen to the equilibrium…

Consumer use of health-related endorsements on food labels in the United Kingdom and Australia.

PubMed

Rayner, M; Boaz, A; Higginson, C

2001-01-01

The objective of this research was to examine how consumers use health-related food endorsements on food labels. Three endorsement programs were examined: those of the two major retailers in the United Kingdom, Tesco and Sainsbury's, and the "Pick the Tick" program of the National Heart Foundation of Australia. The main methodology used was protocol analysis. This involves the subject "thinking aloud" while performing a task--in this case, (a) shopping normally and (b) shopping "healthily" for foods on a predetermined list--to generate a protocol. Each subject was also interviewed to investigate reported use of endorsements. Subjects were a quota sample (N = 44) of shoppers representative of the U.K. and Australian populations. Information about the subjects, the protocols, and interview data were analyzed quantitatively; the protocols were also analyzed qualitatively. Sainsbury's and Australian shoppers never used the endorsements when shopping but Tesco shoppers did, albeit rarely. Tesco shoppers used the endorsement in complex ways and not just as a trigger to food selection. They sometimes used the endorsement to reject endorsed foods. Subjects claimed to use the endorsements even though the protocol analysis revealed no actual use. There are features of the Tesco endorsement program that make it more helpful to consumers than the other programs.

Communication Strategies in the Practice of Lawyering. Proceedings of the 1983 Summer Conference on Communication Strategies in the Practice of Lawyering (Oracle, AZ, June 24-27, 1983).

ERIC Educational Resources Information Center

Matlon, Ronald J., Ed.; Crawford, Richard J., Ed.

Drawn from a conference intended as a step toward reuniting the disciplines of behavioral sciences and law, the items in this compilation were prepared by practitioners and educators in the areas of law, communication, social psychology, and sociology. The items are arranged in five sections according to these topics: interviewing and counseling,…

What aspects of intentional rounding work in hospital wards, for whom and in what circumstances? A realist evaluation protocol.

PubMed

Harris, Ruth; Sims, Sarah; Levenson, Ros; Gourlay, Stephen; Ross Cbe, Fiona; Davies, Nigel; Brearley, Sally; Favato, Giampiero; Grant, Robert

2017-01-09

Intentional rounding (IR) is a structured process whereby nurses in hospitals carry out regular checks, usually hourly, with individual patients using a standardised protocol to address issues of positioning, pain, personal needs and placement of items. The widespread implementation of IR across the UK has been driven by the recommendations of the Francis Inquiry although empirical evidence of its effectiveness is poor. This paper presents a protocol of a multimethod study using a realist evaluation approach to investigate the impact and effectiveness of IR in hospital wards on the organisation, delivery and experience of care from the perspective of patients, their family members and staff. The study will be conducted in four phases. Phase 1: theory development using realist synthesis to generate hypotheses about what the mechanisms of IR may be, what particular groups may benefit most or least and what contextual factors might be important to its success or failure which will be tested in subsequent phases of the study. Phase 2: a national survey of all NHS acute trusts to explore how IR is implemented and supported across England. Phase 3: case studies to explore how IR is implemented 'on the ground', including individual interviews with patients, family members and staff, non-participant observation, retrieval of routinely collected patient outcomes and cost analysis. Phase 4: accumulative data analysis across the phases to scrutinise data for patterns of congruence and discordance and develop an overall evaluation of what aspects of IR work, for whom and in what circumstances. The study has been approved by NHS South East Coast-Surrey Research Ethics Committee. Findings will be published in a wide range of outputs targeted at key audiences, including patient and carer organisations, nursing staff and healthcare managers. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/.

Teaching and Learning Foreign Languages via System of "Voice over Internet Protocol" and Language Interactions Case Study: Skype

ERIC Educational Resources Information Center

Wahid, Wazira Ali Abdul; Ahmed, Eqbal Sulaiman; Wahid, Muntaha Ali Abdul

2015-01-01

This issue expresses a research study based on the online interactions of English teaching specially conversation through utilizing VOIP (Voice over Internet Protocol) and cosmopolitan online theme. Data has been achieved by interviews. Simplifiers indicate how oral tasks require to be planned upon to facilitate engagement models propitious to…

Applying the Notion of Metaphor Types to Enhance Counseling Protocols

ERIC Educational Resources Information Center

Tay, Dennis

2012-01-01

This article introduces the notion of metaphor types to show how the more nuanced aspects of metaphor theory can be applied to counseling practice. The author suggests that metaphor types can enhance existing interview protocols designed to help clients expand the source domain imagery of their metaphors and "bridge back" the expanded imagery to…

Community of Practice: A Path to Strategic Learning

DOE Office of Scientific and Technical Information (OSTI.GOV)

Nancy M. Carlson

2003-04-01

To explore the concept of community of practice, the research initially concentrates on a strategic business process in a research and applied engineering laboratory discovering essential communication tools and processes needed to cultivate a high functioning cross-disciplinary team engaged in proposal preparation. Qualitative research in the human ecology of the proposal process blends topic-oriented ethnography and grounded theory and includes an innovative addition to qualitative interviewing, called meta-inquiry. Meta-inquiry uses an initial interview protocol with a homogeneous pool of informants to enhance the researcher's sensitivity to the unique cultures involved in the proposal process before developing a formal interview protocol.more » In this study the preanalysis process uses data from editors, graphic artists, text processors, and production coordinators to assess, modify, enhance, and focus the formal interview protocol with scientists, engineers, and technical managers-the heterogeneous informants. Thus this human ecology-based interview protocol values homogeneous and heterogeneous informant data and acquires data from which concepts, categories, properties, and both substantive and formal theory emerges. The research discovers the five essential processes of owning, visioning, reviewing, producing, and contributing for strategic learning to occur in a proposal community of practice. The apprenticeship, developmental, and nurturing perspectives of adult learning provide the proposal community of practice with cohesion, interdependence, and caring, while core and boundary practices provide insight into the tacit and explicit dimensions of the proposal process. By making these dimensions explicit, the necessary competencies, absorptive capacity, and capabilities needed for strategic learning are discovered. Substantive theory emerges and provides insight into the ability of the proposal community of practice to evolve, flourish, and adapt to the strategic advantage of the laboratory. The substantive theory explores the dimensions of owning, visioning, reviewing, producing, and contributing and their interrelationship to community learning dynamics. Through dialogue, creative tension, and imagination, the proposal community of practice focuses on actionable goals linked by proactively participating in practice, creating possibilities, evaluating and enhancing potential, producing a valued product, and confirming strategic value. Lastly, a formal theory emerges linking competency-capacity-capability, cohesion, interdependence, and caring as essential attributes of strategic learning communities.« less

Development and psychometric properties of the Suicidality of Adolescent Screening Scale (SASS) using Multidimensional Item Response Theory.

PubMed

Sukhawaha, Supattra; Arunpongpaisal, Suwanna; Hurst, Cameron

2016-09-30

Suicide prevention in adolescents by early detection using screening tools to identify high suicidal risk is a priority. Our objective was to build a multidimensional scale namely "Suicidality of Adolescent Screening Scale (SASS)" to identify adolescents at risk of suicide. An initial pool of items was developed by using in-depth interview, focus groups and a literature review. Initially, 77 items were administered to 307 adolescents and analyzed using the exploratory Multidimensional Item Response Theory (MIRT) to remove unnecessary items. A subsequent exploratory factor analysis revealed 35 items that collected into 4 factors: Stressors, Pessimism, Suicidality and Depression. To confirm this structure, a new sample of 450 adolescents were collected and confirmatory MIRT factor analysis was performed. The resulting scale was shown to be both construct valid and able to discriminate well between adolescents that had, and hadn't previous attempted suicide. Copyright © 2016 Elsevier Ireland Ltd. All rights reserved.

An interventionist adherence scale for a specialized brief negotiation interview focused on treatment engagement for opioid use disorders.

PubMed

Pantalon, Michael V; Dziura, James; Li, Fang-Yong; Owens, Patricia H; O'Connor, Patrick G; D'Onofrio, Gail

2017-01-01

No psychometrically validated instrument for evaluating the extent to which interventionists correctly implement brief interventions designed to motivate treatment engagement for opioid use disorders has been reported in the literature. The objective of this study was to develop and examine the psychometric properties of the Brief Negotiation Interview (BNI) Adherence Scale for Opioid Use Disorders (BAS-O). In the context of a randomized controlled trial evaluating the efficacy of 3 models of emergency department care for opioid use disorders, the authors developed and subsequently examined the psychometric properties of the BAS-O, a 38-item scale that required raters to answer whether or not ("Yes" or "No") each of the critical actions of the BNI was correctly implemented by the research interventionist. BAS-O items pertained to the BNI's 4 steps: (1) Raise the Subject, (2) Provide Feedback, (3) Enhance Motivation, and (4) Negotiate and Advise. A total of 215 audio-recorded BNI and 88 control encounters were rated by 3 trained raters who were independent of the study team and blind to study hypotheses, treatment, and assignment. The results indicated the BAS-O has fair to excellent psychometric properties, in terms of good internal consistency, excellent interrater reliability, discriminant validity, and construct validity, and fair predictive validity. A 13-item, 2-factor solution accounted for nearly 80% of the variance, where factor 1 addressed "Autonomy and Planning" (7 items) and factor 2 addressed "Motivation and Problems" (6 items). However, predictive validity was found for only one of the BAS-O factor items (i.e., Telling patients that treatment will address a range of issues related to their opioid use disorder). This study suggests that the BAS-O is a psychometrically valid measure of adherence to the specialized BNI for motivating treatment engagement in patients with opioid use disorders, thus providing a brief (13-item), objective method of evaluating BNI skill performance.

Questionnaire for low back pain in the garment industry workers

PubMed Central

Bindra, Supreet; Sinha, A. G. K.; Benjamin, A. I.

2013-01-01

Low back pain affects up to 90% of the world's population at some point in their lives. Until date no questionnaire has been designed for back pain in the garment industry workers. Therefore, the objective of this study is to design a questionnaire to determine the prevalence, risk factors, impact, health care service utilization and back pain features in the garment industry workers and gain preliminary experience of its use. The content validity and reliability of the questionnaire was established. Items showing acceptable internal consistency and moderate to high test re-test reliability were retained in the questionnaire. Items showing unacceptable internal consistency, low test re-test reliability or poor differentiation were reworded, redrafted and re-tested on the workers. It took 20 min to complete one interview schedule. Environmental factors such as the absence of the garment industry owner/supervisor or co-workers at the time of the interview and interview during leisure hours need to be standardized. Thus, final questionnaire is ready for use after necessary amendments and will be used on the larger sample size in the main study. PMID:24421591

Questionnaire for low back pain in the garment industry workers.

PubMed

Bindra, Supreet; Sinha, A G K; Benjamin, A I

2013-05-01

Low back pain affects up to 90% of the world's population at some point in their lives. Until date no questionnaire has been designed for back pain in the garment industry workers. Therefore, the objective of this study is to design a questionnaire to determine the prevalence, risk factors, impact, health care service utilization and back pain features in the garment industry workers and gain preliminary experience of its use. The content validity and reliability of the questionnaire was established. Items showing acceptable internal consistency and moderate to high test re-test reliability were retained in the questionnaire. Items showing unacceptable internal consistency, low test re-test reliability or poor differentiation were reworded, redrafted and re-tested on the workers. It took 20 min to complete one interview schedule. Environmental factors such as the absence of the garment industry owner/supervisor or co-workers at the time of the interview and interview during leisure hours need to be standardized. Thus, final questionnaire is ready for use after necessary amendments and will be used on the larger sample size in the main study.

[Satisfaction with obstetrical care: development and validation of a scale on quality of care].

PubMed

Ramanah, R; Dumont, A; Schepens, F; Traore, M; Gaye, A; Schaal, J-P; Riethmuller, D; Rude, N

2014-01-01

To develop and validate a subjective and multidimensional scale to measure satisfaction in obstetrical care (SSO) during labour, delivery and two hours postpartum, which is relevant to the French-speaking context. Forty partially directed patient interviews during the 48 hours after delivery and four care-giver interviews were conducted to build up the questionnaire. After a prior feasibility study on 40 patients, the psychometric validity of the questionnaire was evaluated by calculating the Cronbach coefficient of reliability for 432 patients. Hundred and eighty items were initially obtained after content analysis of the patient interviews. Expert meetings finally selected 49 items classified within 5 dimensions. The feasibility study showed that the questionnaire was easily accepted and understood with a mean time of 15 minutes to answer it. Cronbach coefficients were respectively at 0.941, 0.949, 0.808, 0.814 et 0.869 for the 5 dimensions. SSO questionnaire is a reliable and relevant scale to measure immediate postpartum quality of care in French. Copyright © 2014 Elsevier Masson SAS. All rights reserved.

Measuring self-esteem after spinal cord injury: Development, validation and psychometric characteristics of the SCI-QOL Self-esteem item bank and short form

PubMed Central

Kalpakjian, Claire Z.; Tate, Denise G.; Kisala, Pamela A.; Tulsky, David S.

2015-01-01

Objective To describe the development and psychometric properties of the Spinal Cord Injury-Quality of Life (SCI-QOL) Self-esteem item bank. Design Using a mixed-methods design, we developed and tested a self-esteem item bank through the use of focus groups with individuals with SCI and clinicians with expertise in SCI, cognitive interviews, and item-response theory- (IRT) based analytic approaches, including tests of model fit, differential item functioning (DIF) and precision. Setting We tested a pool of 30 items at several medical institutions across the United States, including the University of Michigan, Kessler Foundation, the Rehabilitation Institute of Chicago, the University of Washington, Craig Hospital, and the James J. Peters/Bronx Department of Veterans Affairs hospital. Participants A total of 717 individuals with SCI completed the self-esteem items. Results A unidimensional model was observed (CFI = 0.946; RMSEA = 0.087) and measurement precision was good (theta range between −2.7 and 0.7). Eleven items were flagged for DIF; however, effect sizes were negligible with little practical impact on score estimates. The final calibrated item bank resulted in 23 retained items. Conclusion This study indicates that the SCI-QOL Self-esteem item bank represents a psychometrically robust measurement tool. Short form items are also suggested and computer adaptive tests are available. PMID:26010972

Measuring self-esteem after spinal cord injury: Development, validation and psychometric characteristics of the SCI-QOL Self-esteem item bank and short form.

PubMed

Kalpakjian, Claire Z; Tate, Denise G; Kisala, Pamela A; Tulsky, David S

2015-05-01

To describe the development and psychometric properties of the Spinal Cord Injury-Quality of Life (SCI-QOL) Self-esteem item bank. Using a mixed-methods design, we developed and tested a self-esteem item bank through the use of focus groups with individuals with SCI and clinicians with expertise in SCI, cognitive interviews, and item-response theory-(IRT) based analytic approaches, including tests of model fit, differential item functioning (DIF) and precision. We tested a pool of 30 items at several medical institutions across the United States, including the University of Michigan, Kessler Foundation, the Rehabilitation Institute of Chicago, the University of Washington, Craig Hospital, and the James J. Peters/Bronx Department of Veterans Affairs hospital. A total of 717 individuals with SCI completed the self-esteem items. A unidimensional model was observed (CFI=0.946; RMSEA=0.087) and measurement precision was good (theta range between -2.7 and 0.7). Eleven items were flagged for DIF; however, effect sizes were negligible with little practical impact on score estimates. The final calibrated item bank resulted in 23 retained items. This study indicates that the SCI-QOL Self-esteem item bank represents a psychometrically robust measurement tool. Short form items are also suggested and computer adaptive tests are available.

Measuring resilience after spinal cord injury: Development, validation and psychometric characteristics of the SCI-QOL Resilience item bank and short form.

PubMed

Victorson, David; Tulsky, David S; Kisala, Pamela A; Kalpakjian, Claire Z; Weiland, Brian; Choi, Seung W

2015-05-01

To describe the development and psychometric properties of the Spinal Cord Injury--Quality of Life (SCI-QOL) Resilience item bank and short form. Using a mixed-methods design, we developed and tested a resilience item bank through the use of focus groups with individuals with SCI and clinicians with expertise in SCI, cognitive interviews, and item-response theory based analytic approaches, including tests of model fit and differential item functioning (DIF). We tested a 32-item pool at several medical institutions across the United States, including the University of Michigan, Kessler Foundation, the Rehabilitation Institute of Chicago, the University of Washington, Craig Hospital and the James J. Peters/Bronx Department of Veterans Affairs medical center. A total of 717 individuals with SCI completed the Resilience items. A unidimensional model was observed (CFI=0.968; RMSEA=0.074) and measurement precision was good (theta range between -3.1 and 0.9). Ten items were flagged for DIF, however, after examination of effect sizes we found this to be negligible with little practical impact on score estimates. The final calibrated item bank resulted in 21 retained items. This study indicates that the SCI-QOL Resilience item bank represents a psychometrically robust measurement tool. Short form items are also suggested and computer adaptive tests are available.

Measuring resilience after spinal cord injury: Development, validation and psychometric characteristics of the SCI-QOL Resilience item bank and short form

PubMed Central

Victorson, David; Tulsky, David S.; Kisala, Pamela A.; Kalpakjian, Claire Z.; Weiland, Brian; Choi, Seung W.

2015-01-01

Objective To describe the development and psychometric properties of the Spinal Cord Injury - Quality of Life (SCI-QOL) Resilience item bank and short form. Design Using a mixed-methods design, we developed and tested a resilience item bank through the use of focus groups with individuals with SCI and clinicians with expertise in SCI, cognitive interviews, and item-response theory based analytic approaches, including tests of model fit and differential item functioning (DIF). Setting We tested a 32-item pool at several medical institutions across the United States, including the University of Michigan, Kessler Foundation, the Rehabilitation Institute of Chicago, the University of Washington, Craig Hospital and the James J. Peters/Bronx Department of Veterans Affairs medical center. Participants A total of 717 individuals with SCI completed the Resilience items. Results A unidimensional model was observed (CFI = 0.968; RMSEA = 0.074) and measurement precision was good (theta range between −3.1 and 0.9). Ten items were flagged for DIF, however, after examination of effect sizes we found this to be negligible with little practical impact on score estimates. The final calibrated item bank resulted in 21 retained items. Conclusion This study indicates that the SCI-QOL Resilience item bank represents a psychometrically robust measurement tool. Short form items are also suggested and computer adaptive tests are available. PMID:26010971

Testing the reliability of the Fall Risk Screening Tool in an elderly ambulatory population.

PubMed

Fielding, Susan J; McKay, Michael; Hyrkas, Kristiina

2013-11-01

To identify and test the reliability of a fall risk screening tool in an ambulatory outpatient clinic. The Fall Risk Screening Tool (Albert Lea Medical Center, MN, USA) was scripted for an interview format. Two interviewers separately screened a convenience sample of 111 patients (age ≥ 65 years) in an ambulatory outpatient clinic in a northeastern US city. The interviewers' scoring of fall risk categories was similar. There was good internal consistency (Cronbach's α = 0.834-0.889) and inter-rater reliability [intra-class correlation coefficients (ICC) = 0.824-0.881] for total, Risk Factor and Client's Health Status subscales. The Physical Environment scores indicated acceptable internal consistency (Cronbach's α = 0.742) and adequate reliability (ICC = 0.688). Two Physical Environment items (furniture and medical equipment condition) had low reliabilities [Kappa (K) = 0.323, P = 0.08; K = -0.078, P = 0.648), respectively. The scripted Fall Risk Screening Tool demonstrated good reliability in this sample. Rewording two Physical Environment items will be considered. A reliable instrument such as the scripted Fall Risk Screening Tool provides a standardised assessment for identifying high fall risk patients. This tool is especially useful because it assesses personal, behavioural and environmental factors specific to community-dwelling patients; the interview format also facilitates patient-provider interaction. © 2013 John Wiley & Sons Ltd.

Development and content validation of the information assessment method for patients and consumers.

PubMed

Pluye, Pierre; Granikov, Vera; Bartlett, Gillian; Grad, Roland M; Tang, David L; Johnson-Lafleur, Janique; Shulha, Michael; Barbosa Galvão, Maria Cristiane; Ricarte, Ivan Lm; Stephenson, Randolph; Shohet, Linda; Hutsul, Jo-Anne; Repchinsky, Carol A; Rosenberg, Ellen; Burnand, Bernard; Légaré, France; Dunikowski, Lynn; Murray, Susan; Boruff, Jill; Frati, Francesca; Kloda, Lorie; Macaulay, Ann; Lagarde, François; Doray, Geneviève

2014-02-18

Online consumer health information addresses health problems, self-care, disease prevention, and health care services and is intended for the general public. Using this information, people can improve their knowledge, participation in health decision-making, and health. However, there are no comprehensive instruments to evaluate the value of health information from a consumer perspective. We collaborated with information providers to develop and validate the Information Assessment Method for all (IAM4all) that can be used to collect feedback from information consumers (including patients), and to enable a two-way knowledge translation between information providers and consumers. Content validation steps were followed to develop the IAM4all questionnaire. The first version was based on a theoretical framework from information science, a critical literature review and prior work. Then, 16 laypersons were interviewed on their experience with online health information and specifically their impression of the IAM4all questionnaire. Based on the summaries and interpretations of interviews, questionnaire items were revised, added, and excluded, thus creating the second version of the questionnaire. Subsequently, a panel of 12 information specialists and 8 health researchers participated in an online survey to rate each questionnaire item for relevance, clarity, representativeness, and specificity. The result of this expert panel contributed to the third, current, version of the questionnaire. The current version of the IAM4all questionnaire is structured by four levels of outcomes of information seeking/receiving: situational relevance, cognitive impact, information use, and health benefits. Following the interviews and the expert panel survey, 9 questionnaire items were confirmed as relevant, clear, representative, and specific. To improve readability and accessibility for users with a lower level of literacy, 19 items were reworded and all inconsistencies in using a passive or active voice have been solved. One item was removed due to redundancy. The current version of the IAM4all questionnaire contains 28 items. We developed and content validated the IAM4all in partnership with information providers, information specialists, researchers and representatives of information consumers. This questionnaire can be integrated within electronic knowledge resources to stimulate users' reflection (eg, their intention to use information). We claim that any organization (eg, publishers, community organizations, or patient associations), can evaluate and improve their online consumer health information from a consumers' perspective using this method.

A qualitative approach to recovery after open tibial fracture: the road to a novel, patient-derived recovery scale.

PubMed

Trickett, R W; Mudge, Elizabeth; Price, Patricia; Pallister, Ian

2012-07-01

The aim of this study was to describe how patients perceive their recovery following open tibial fractures using a qualitative approach. Following the appropriate ethical approval, adult patients with a diagnosis of open tibial fracture were recruited after completion of their surgical treatment and discharge from Morriston Hospital, a centre with orthoplastic surgical care. A purposive sampling method was employed to ensure that a range of injuries as well as clinical outcomes were included. All patients took part in an in-depth semi-structured interview, exploring aspects of their injury, treatment, rehabilitation and psychosocial and financial situations. Interviews were completed with two interviewers present and were recorded for verbatim transcription. Interview transcripts were analysed to identify items important to patients during their recovery. Nine patients with a mean injury to interview interval of 2.3 years were interviewed. A total of 538 items were identified and subsequently mapped onto 18 categories: pain; mobility; flexibility; temperature (effects on symptoms); fear; appearance; sleep; diet/weight; employment; social; finance; impact on others; self-care; recovery (patient perceptions of recovery); frustration; goal setting (by patients and health-care providers); and adaptation (both physical and mental). There is a wide range of factors that our cohort found important during their recovery from open tibial fracture. Despite being considered as 'healed' by the medical staff, patients did not report a corresponding full recovery and return to pre-injury normality. The categories identified will enable the development of a patient-reported recovery scale to be used in lower-limb trauma. Copyright © 2012 Elsevier Ltd. All rights reserved.

Making sense of sexual orientation measures: findings from a cognitive processing study with adolescents on health survey questions.

PubMed

Austin, S Bryn; Conron, Kerith; Patel, Aarti; Freedner, Naomi

2007-01-01

To carry out a study using cognitive processing interview methods to explore ways in which adolescents understand sexual orientation questions currently used on epidemiologic surveys. In-depth, individual interviews were conducted to probe cognitive processes involved in answering four self-report survey questions assessing sexual identity, sexual attraction, and sex of sexual partners.A semi-structured interview guide was used to explore variation in question interpretation, information retrieval patterns and problems, item clarity, valence of reactions to items (positive, negative, neutral), respondent burden, and perceived threat associated with the measures. Thirty adolescents aged 15 to 21 of diverse sexual orientations and race/ethnicities participated in the study, including female, male, and transgender youth. A question on sexual attraction was the most consistently understood and thus was easy for nearly all youth to answer. In contrast, a measure of sexual identity with options heterosexual, bisexual, gay/lesbian, and unsure was the most difficult to answer. Most preferred a sexual identity item that also provided the intermediate options mostly heterosexual and mostly homosexual, which many said reflected their experience of feeling between categories. Participants had varying and inconsistent interpretations of sexual behavior terms, such as sex and sexual intercourse, used in assessing the sex of sexual partners. Differences in understanding could affect interpretation of survey data in important ways. Development of valid measures of sexual orientation will be essential to better monitor health disparities.

Conventional Energy and Macronutrient Variables Distort the Accuracy of Children’s Dietary Reports: Illustrative Data from a Validation Study of Effect of Order Prompts

PubMed Central

Baxter, Suzanne Domel; Smith, Albert F.; Hardin, James W.; Nichols, Michele D.

2008-01-01

Objective Validation-study data are used to illustrate that conventional energy and macronutrient (protein, carbohydrate, fat) variables, which disregard accuracy of reported items and amounts, misrepresent reporting accuracy. Reporting-error-sensitive variables are proposed which classify reported items as matches or intrusions, and reported amounts as corresponding or overreported. Methods 58 girls and 63 boys were each observed eating school meals on 2 days separated by ≥4 weeks, and interviewed the morning after each observation day. One interview per child had forward-order (morning-to-evening) prompts; one had reverse-order prompts. Original food-item-level analyses found a sex-x-order prompt interaction for omission rates. Current analyses compared reference (observed) and reported information transformed to energy and macronutrients. Results Using conventional variables, reported amounts were less than reference amounts (ps<0.001; paired t-tests); report rates were higher for the first than second interview for energy, protein, and carbohydrate (ps≤0.049; mixed models). Using reporting-error-sensitive variables, correspondence rates were higher for girls with forward- but boys with reverse-order prompts (ps≤0.041; mixed models); inflation ratios were lower with reverse- than forward-order prompts for energy, carbohydrate, and fat (ps≤0.045; mixed models). Conclusions Conventional variables overestimated reporting accuracy and masked order prompt and sex effects. Reporting-error-sensitive variables are recommended when assessing accuracy for energy and macronutrients in validation studies. PMID:16959308

Missing content from health-related quality of life instruments: interviews with young adult survivors of childhood cancer.

PubMed

Quinn, Gwendolyn P; Huang, I-Chan; Murphy, Devin; Zidonik-Eddelton, Katie; Krull, Kevin R

2013-02-01

Young adult survivors of childhood cancer (YASCC) are an ever-growing cohort of survivors due to increasing advances in technology. Today, there is a shift of focus to not just ensuring survivorship but also the quality of survivorship, which can be assessed with standardized instruments. The majority of standardized health related quality of life (HRQoL) instruments, however, are non-specific to this age group and the unique late effects within YASCC populations. The purpose of this study was to investigate the relevance and accuracy of standardized HRQoL instruments used with YASCC. In a previous study, HRQoL items from several instruments (SF-36, QLACS, QLS-CS) were examined for relevance with a population of YASCC. Participants (n = 30) from this study were recruited for a follow-up qualitative interview to expand on their perceptions of missing content from existing instruments. Respondents reported missing, relevant content among all three of the HRQoL instruments. Results identified three content areas of missing information: (1) Perceived sense of self, (2) Relationships, and (3) Parenthood. Existing HRQoL instruments do not take into account the progression and interdependence of emotional development impacted by a cancer diagnosis. The themes derived from our qualitative interviews may serve as a foundation for the generation of new items in future HRQoL instruments for YASCC populations. Further testing is required to examine the prevalence, frequency, and breadth of these items in a larger sample.

Symmetrically private information retrieval based on blind quantum computing

NASA Astrophysics Data System (ADS)

Sun, Zhiwei; Yu, Jianping; Wang, Ping; Xu, Lingling

2015-05-01

Universal blind quantum computation (UBQC) is a new secure quantum computing protocol which allows a user Alice who does not have any sophisticated quantum technology to delegate her computing to a server Bob without leaking any privacy. Using the features of UBQC, we propose a protocol to achieve symmetrically private information retrieval, which allows a quantum limited Alice to query an item from Bob with a fully fledged quantum computer; meanwhile, the privacy of both parties is preserved. The security of our protocol is based on the assumption that malicious Alice has no quantum computer, which avoids the impossibility proof of Lo. For the honest Alice, she is almost classical and only requires minimal quantum resources to carry out the proposed protocol. Therefore, she does not need any expensive laboratory which can maintain the coherence of complicated quantum experimental setups.

Development of a method to assess compliance with ergonomic posture in dental students

PubMed Central

Garcia, Patrícia Petromilli Nordi Sasso; Wajngarten, Danielle; Campos, Juliana Alvares Duarte Bonini

2018-01-01

CONTEXT: The ergonomic posture protocol is extremely important for the maintenance of occupational health in dentistry. The lack of compliance with this protocol results in a high risk of developing musculoskeletal disorders. AIMS: This study developed a direct observation method for the evaluation of dental student compliance with ergonomic posture protocol. SUBJECTS AND METHODS: The method is named compliance assessment of dental ergonomic posture requirements (CADEP). During the development of the method, 14 items were elaborated considering the theory of dental ergonomics. Each item should be classified as appropriate, partially appropriate, or inappropriate. After evaluation, all item values should be added, and the final score expressed as the percent of compliance with correct postures, with a score range of 0%–100%. STATISTICAL ANALYSIS USED: The reliability of CADEP was assessed through intra- and interobserver reproducibility. For the CADEP application, 73 senior year students from the undergraduate course in dentistry were evaluated. The intra- and interexaminer concordance was estimated using the intraclass correlation coefficient (ρ). A descriptive statistical analysis was performed. RESULTS: The reproducibility of evaluator 1 (ρ =0.90; confidence interval [CI] 95%: 0.83–0.94), evaluator 2 (ρ = 0.83; CI 95%: 0.70–0.90), the interexaminer in the first evaluation (ρ = 0.81; CI 95%:0.67–0.89), and in the second one (ρ = 0.76; CI 95%: 0.59–0.87) was classified as good. In the analysis of the compliance, it was verified that moderate compliance was the most prevalent among the evaluated students (65.6%, CI 95%: 60.3%–70.7%). CONCLUSIONS: CADEP was valid and reliable for the assessment of dentistry students’ compliance regarding ergonomic posture requirements. PMID:29693025

Sexual behaviors among club drug users: prevalence and reliability

PubMed Central

Shacham, Enbal; Cottler, Linda B.

2013-01-01

HIV prevention efforts require a focus on reducing high risk sexual behavior. Because these are self-reported, assessments that reduce memory bias and improve elicitation of data are needed. As part of a multi-site psychometric study of club drug use, abuse, and dependence, data were collected with a test-retest design that measured the reliability of the Washington University Risk Behavior Assessment for Club Drugs (WU-RBA-CD). Reliability was assessed separately by sex via kappa coefficients and intraclass correlation coefficients (ICC); z tests compared coefficients by sex. A total of 603 participants were interviewed by independent assessors with 5 days in between interviews. Reliability for all 51 items of the sexual activity section of the WU-RBA-CD ranged from .23 to 1.00; 71% (n = 36) of items resulted in moderate to high reliability (.55–1.00). Number of lifetime sex partners was consistently reported for same-sex partners for both men and women and opposite-sex partners. Items with high reliability included reporting ever being under the influence of ecstasy (.87) or GHB (.87) while having sex. Items with lower reliability included those that queried the determinants of condom use (.45–.82) and about behaviors and attitudes experienced while using drugs (.23–.87). Very few sex differences were revealed in the reliability of reported sexual activities. Overall, the WU-RBA-CD performed with fairly high reliability rates. Assessing situations of when, how, and why individuals use condoms may offer the clearest evaluation of determinants of sexual behaviors, yet those items are not as reliable. PMID:19757011

Establishing the content validity of the Sexual Arousal, Interest, and Drive Scale and the Hypogonadism Energy Diary.

PubMed

Hayes, R P; Henne, J; Kinchen, K S

2015-04-01

The aim of this qualitative analysis was to establish the content validity of two new patient-reported outcome (PRO) measures: Sexual Arousal, Interest, and Drive Scale (SAID) and Hypogonadism Energy Diary (HED). Four separate qualitative studies were conducted with 125 men with hypogonadism (mean age: 53 years, 85% adult onset). Study 1 used focus groups/interviews to identify important and relevant concepts related to the experience of hypogonadism and its treatment in men primarily with adult-onset hypogonadism. Study 2 tested items generated for assessments of low sex drive and low energy. Study 3 used interviews to confirm in men with early-onset hypogonadism that low sex drive and low energy were also important and relevant symptoms. Study 4 tested final versions of the two PROs and determined equivalency of paper-based and electronic versions of the two PROs. Of the concepts emerging in Studies 1 and 3, low sex drive and low energy were the symptoms most often spontaneously mentioned. Coding of transcripts from Studies 1 and 3 led to the generation of items for the SAID and HED. After item testing (Studies 2 and 4), the final SAID included five items pertaining to arousal, interest in sex and sex drive with a 7-day recall period and the final HED included two items (energy, tired/exhausted) to be administered three times per day. The SAID and HED have content validity established according to regulatory guidance and, therefore, the potential to provide the patient perspective of treatments for hypogonadism. © 2014 John Wiley & Sons Ltd.

Development and initial validation of the Bristol Impact of Hypermobility questionnaire.

PubMed

Palmer, S; Cramp, F; Lewis, R; Gould, G; Clark, E M

2017-06-01

Stage 1 - to identify the impact of joint hypermobility syndrome (JHS) on adults; Stage 2 - to develop a questionnaire to assess the impact of JHS; and Stage 3 - to undertake item reduction and establish the questionnaire's concurrent validity. A mixed methods study employing qualitative focus groups and interviews (Stage 1); a working group of patients, clinicians and researchers, and 'think aloud' interviews (Stage 2); and quantitative analysis of questionnaire responses (Stage 3). Stages 1 and 2 took place in one secondary care hospital in the UK. Members of a UK-wide patient organisation were recruited in Stage 3. In total, 15, four and 615 participants took part in Stages 1, 2 and 3, respectively. Inclusion criteria were: age ≥18 years; diagnosis of JHS; no other conditions affecting physical function; able to give informed consent; and able to understand and communicate in English. None. The development of a questionnaire to assess the impact of JHS. Stage 1 identified a wide range of impairments, activity limitations and participation restrictions In Stage 2, a draft questionnaire was developed and refined following 'think aloud' analysis, leaving 94 scored items. In Stage 3, items were removed on the basis of low severity and/or high correlation with other items. The final Bristol Impact of Hypermobility (BIoH) questionnaire had 55 scored items, and correlated well with the physical component score of the Short Form 36 health questionnaire (r=-0.725). The BIoH questionnaire demonstrated good concurrent validity. Further psychometric properties need to be established. Copyright © 2016 Chartered Society of Physiotherapy. Published by Elsevier Ltd. All rights reserved.

Limited clinical reasoning skills used by novice physiotherapists when involved in the assessment and management of patients with shoulder problems: a qualitative study

PubMed Central

May, Stephen; Withers, Sarah; Reeve, Sarah; Greasley, Alison

2010-01-01

The aim of this study was to explore the clinical reasoning process used by novice physical therapists in specific patient problems. Nine physical therapists in the UK with limited experience of managing musculoskeletal problems were included. Semi-structured interviews were conducted on how novice physical therapists would assess and manage a patient with a shoulder problem; interviews were transcribed and analyzed using framework analysis. To be included as a final theme at least 50% of participants had to mention that theme. A large number of items (n = 93) were excluded as fewer than 50% of participants referred to each item. Included items related to seven main themes: history (16), physical exam (13), investigations (1), diagnostic reasoning (1), clinical reasoning process (diagnostic pathway) (3), clinical reasoning process (management pathway) (5) and treatment options (1). Items mostly related to information gathering, although there was some use of hypothetico-deductive clinical reasoning there appeared to be limited understanding of the clinical implications of data gathered, and clinical reasoning through use of pattern recognition was minimal. Major weaknesses were apparent in the clinical reasoning skills of these novice therapists compared to previous reports of expert clinical reasoning, indicating areas for development in the education of student and junior physical therapists. PMID:21655390

Repeated Interviews with Children Who Are the Alleged Victims of Sexual Abuse

ERIC Educational Resources Information Center

Katz, Carmit; Hershkowitz, Irit

2013-01-01

Objective: The present study was designed to test the effects of repeated retrievals in the course of forensic investigations with children who are the alleged victims of sexual abuse. Method: Using the National Institute of Child Health and Human Development protocol, 56 children participated in a first free-recall interview that was followed by…

Differences between Higher and Lower Achievement Rate and Leadership Qualities, Instructional Practices, Parental Involvement, Opportunity to Learn, and Professional Development

ERIC Educational Resources Information Center

Ficarra, Laura

2017-01-01

The purpose of this mixed study was to investigate the differences between higher and lower achievement middle school rates pertaining to leadership qualities, opportunity to learn, instructional practices, parental involvement, and professional development. Qualitatively, principals were interviewed using a semi-structured interview protocol.…

Thinking about Digestive System in Early Childhood: A Comparative Study about Biological Knowledge

ERIC Educational Resources Information Center

AHI, Berat

2017-01-01

The current study aims to explore how children explain the concepts of biology and how biological knowledge develops across ages by focusing on the structure and functions of the digestive system. The study was conducted with 60 children. The data were collected through the interviews conducted within a think-aloud protocol. The interview data…

Dutch translation and cross-cultural adaptation of the PROMIS® physical function item bank and cognitive pre-test in Dutch arthritis patients.

PubMed

Oude Voshaar, Martijn Ah; Ten Klooster, Peter M; Taal, Erik; Krishnan, Eswar; van de Laar, Mart Afj

2012-03-05

Patient-reported physical function is an established outcome domain in clinical studies in rheumatology. To overcome the limitations of the current generation of questionnaires, the Patient-Reported Outcomes Measurement Information System (PROMIS®) project in the USA has developed calibrated item banks for measuring several domains of health status in people with a wide range of chronic diseases. The aim of this study was to translate and cross-culturally adapt the PROMIS physical function item bank to the Dutch language and to pretest it in a sample of patients with arthritis. The items of the PROMIS physical function item bank were translated using rigorous forward-backward protocols and the translated version was subsequently cognitively pretested in a sample of Dutch patients with rheumatoid arthritis. Few issues were encountered in the forward-backward translation. Only 5 of the 124 items to be translated had to be rewritten because of culturally inappropriate content. Subsequent pretesting showed that overall, questions of the Dutch version were understood as they were intended, while only one item required rewriting. Results suggest that the translated version of the PROMIS physical function item bank is semantically and conceptually equivalent to the original. Future work will be directed at creating a Dutch-Flemish final version of the item bank to be used in research with Dutch speaking populations.

Cognitive ability, social desirability, body mass index and socioeconomic status as correlates of fourth-grade children's dietary-reporting accuracy.

PubMed

Smith, A F; Baxter, S D; Hitchcock, D B; Finney, C J; Royer, J A; Guinn, C H

2016-09-01

To investigate the relationship of reporting accuracy in 24-h dietary recalls to child-respondent characteristics-cognitive ability, social desirability, body mass index (BMI) percentile and socioeconomic status (SES). Fourth-grade children (mean age 10.1 years) were observed eating two school meals and interviewed about dietary intake for 24 h that included those meals. (Eight multiple-pass interview protocols operationalized the conditions of an experiment that crossed two retention intervals-short and long-with four prompts (ways of eliciting reports in the first pass)). Academic achievement-test scores indexed cognitive ability; social desirability was assessed by questionnaire; height and weight were measured to calculate BMI; nutrition-assistance program eligibility information was obtained to index SES. Reported intake was compared to observed intake to calculate measures of reporting accuracy for school meals at the food-item (omission rate; intrusion rate) and energy (correspondence rate; inflation ratio) levels. Complete data were available for 425 of 480 validation-study participants. Controlling for manipulated variables and other measured respondent characteristics, for one or more of the outcome variables, reporting accuracy increased with cognitive ability (omission rate, intrusion rate, correspondence rate, P<0.001), decreased with social desirability (correspondence rate, P<0.0004), decreased with BMI percentile (correspondence rate, P=0.001) and was better by higher- than by lower-SES children (intrusion rate, P=0.001). Some of these effects were moderated by interactions with retention interval and sex. Children's dietary-reporting accuracy is systematically related to such respondent characteristics as cognitive ability, social desirability, BMI percentile and SES.

Development and psychometric characteristics of the SCI-QOL Ability to Participate and Satisfaction with Social Roles and Activities item banks and short forms.

PubMed

Heinemann, Allen W; Kisala, Pamela A; Hahn, Elizabeth A; Tulsky, David S

2015-05-01

To develop a spinal cord injury (SCI)-focused version of PROMIS and Neuro-QOL social domain item banks; evaluate the psychometric properties of items developed for adults with SCI; and report information to facilitate clinical and research use. We used a mixed-methods design to develop and evaluate Ability to Participate in Social Roles and Activities and Satisfaction with Social Roles and Activities items. Focus groups helped define the constructs; cognitive interviews helped revise items; and confirmatory factor analysis and item response theory methods helped calibrate item banks and evaluate differential item functioning related to demographic and injury characteristics. Five SCI Model System sites and one Veterans Administration medical center. The calibration sample consisted of 641 individuals; a reliability sample consisted of 245 individuals residing in the community. A subset of 27 Ability to Participate and 35 Satisfaction items demonstrated good measurement properties and negligible differential item functioning related to demographic and injury characteristics. The SCI-specific measures correlate strongly with the PROMIS and Neuro-QOL versions. Ten item short forms correlate >0.96 with the full banks. Variable-length CATs with a minimum of 4 items, variable-length CATs with a minimum of 8 items, fixed-length CATs of 10 items, and the 10-item short forms demonstrate construct coverage and measurement error that is comparable to the full item bank. The Ability to Participate and Satisfaction with Social Roles and Activities CATs and short forms demonstrate excellent psychometric properties and are suitable for clinical and research applications.

Toward a More Systematic Assessment of Smoking: Development of a Smoking Module for PROMIS®

PubMed Central

Tucker, Joan S.; Shadel, William G.; Stucky, Brian D.; Cai, Li

2012-01-01

Introduction The aim of the PROMIS® Smoking Initiative is to develop, evaluate, and standardize item banks to assess cigarette smoking behavior and biopsychosocial constructs associated with smoking for both daily and non-daily smokers. Methods We used qualitative methods to develop the item pool (following the PROMIS® approach: e.g., literature search, “binning and winnowing” of items, and focus groups and cognitive interviews to finalize wording and format), and quantitative methods (e.g., factor analysis) to develop the item banks. Results We considered a total of 1622 extant items, and 44 new items for inclusion in the smoking item banks. A final set of 277 items representing 11 conceptual domains was selected for field testing in a national sample of smokers. Using data from 3021 daily smokers in the field test, an iterative series of exploratory factor analyses and project team discussions resulted in six item banks: Positive Consequences of Smoking (40 items), Smoking Dependence/Craving (55 items), Health Consequences of Smoking (26 items), Psychosocial Consequences of Smoking (37 items), Coping Aspects of Smoking (30 items), and Social Factors of Smoking (23 items). Conclusions Inclusion of a smoking domain in the PROMIS® framework will standardize measurement of key smoking constructs using state-of-the-art psychometric methods, and make them widely accessible to health care providers, smoking researchers and the large community of researchers using PROMIS® who might not otherwise include an assessment of smoking in their design. Next steps include reducing the number of items in each domain, conducting confirmatory analyses, and duplicating the process for non-daily smokers. PMID:22770824

Toward a more systematic assessment of smoking: development of a smoking module for PROMIS®.

PubMed

Edelen, Maria O; Tucker, Joan S; Shadel, William G; Stucky, Brian D; Cai, Li

2012-11-01

The aim of the PROMIS® Smoking Initiative is to develop, evaluate, and standardize item banks to assess cigarette smoking behavior and biopsychosocial constructs associated with smoking for both daily and non-daily smokers. We used qualitative methods to develop the item pool (following the PROMIS® approach: e.g., literature search, "binning and winnowing" of items, and focus groups and cognitive interviews to finalize wording and format), and quantitative methods (e.g., factor analysis) to develop the item banks. We considered a total of 1622 extant items, and 44 new items for inclusion in the smoking item banks. A final set of 277 items representing 11 conceptual domains was selected for field testing in a national sample of smokers. Using data from 3021 daily smokers in the field test, an iterative series of exploratory factor analyses and project team discussions resulted in six item banks: Positive Consequences of Smoking (40 items), Smoking Dependence/Craving (55 items), Health Consequences of Smoking (26 items), Psychosocial Consequences of Smoking (37 items), Coping Aspects of Smoking (30 items), and Social Factors of Smoking (23 items). Inclusion of a smoking domain in the PROMIS® framework will standardize measurement of key smoking constructs using state-of-the-art psychometric methods, and make them widely accessible to health care providers, smoking researchers and the large community of researchers using PROMIS® who might not otherwise include an assessment of smoking in their design. Next steps include reducing the number of items in each domain, conducting confirmatory analyses, and duplicating the process for non-daily smokers. Copyright © 2012 Elsevier Ltd. All rights reserved.

Differential item functioning in the Cambridge Mental Disorders in the Elderly (CAMDEX) Depression Scale across middle age and late life.

PubMed

Estabrook, Ryne; Sadler, Michael E; McGue, Matt

2015-12-01

A long-standing and critical problem in the study of aging and depression is the comparability of measurement across age groups. While psychological measures of depression typically show increased incidence of symptoms with increasing age, rates of depression diagnosis do not show the same age trend. This analysis presents tests of differential item functioning on the depression section of the CAMDEX interview schedule, using factor analysis-derived affective and somatic subscales (McGue & Christensen, 1997). Results for the affective subscale show significant differences in item functioning in the majority of the affective items as a function of age (items "Happy Life," "Lonely," "Nervous" "Worthless," and "Future": χ6(2) = [30.193, 255.971] across items, all p < .0001). Analyses for the somatic subscale show differential item functioning is limited to a single item relating to coping (χ6(2) = 180.754, p < .0001). These results indicate that differences in depression symptoms across age groups are not entirely consistent with a unidimensional depression trait, and that the measurement structure of depression varies over the life span. (c) 2015 APA, all rights reserved).

Development and Content Validation of the Transition Readiness Inventory Item Pool for Adolescent and Young Adult Survivors of Childhood Cancer.

PubMed

Schwartz, Lisa A; Hamilton, Jessica L; Brumley, Lauren D; Barakat, Lamia P; Deatrick, Janet A; Szalda, Dava E; Bevans, Katherine B; Tucker, Carole A; Daniel, Lauren C; Butler, Eliana; Kazak, Anne E; Hobbie, Wendy L; Ginsberg, Jill P; Psihogios, Alexandra M; Ver Hoeve, Elizabeth; Tuchman, Lisa K

2017-10-01

The development of the Transition Readiness Inventory (TRI) item pool for adolescent and young adult childhood cancer survivors is described, aiming to both advance transition research and provide an example of the application of NIH Patient Reported Outcomes Information System methods. Using rigorous measurement development methods including mixed methods, patient and parent versions of the TRI item pool were created based on the Social-ecological Model of Adolescent and young adult Readiness for Transition (SMART). Each stage informed development and refinement of the item pool. Content validity ratings and cognitive interviews resulted in 81 content valid items for the patient version and 85 items for the parent version. TRI represents the first multi-informant, rigorously developed transition readiness item pool that comprehensively measures the social-ecological components of transition readiness. Discussion includes clinical implications, the application of TRI and the methods to develop the item pool to other populations, and next steps for further validation and refinement. © The Author 2017. Published by Oxford University Press on behalf of the Society of Pediatric Psychology. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com

Reports of Perceived Adverse Events of Stimulant Medication on Cognition, Motivation, and Mood: Qualitative Investigation and the Generation of Items for the Medication and Cognition Rating Scale

PubMed Central

Kovshoff, Hanna; Banaschewski, Tobias; Buitelaar, Jan K.; Carucci, Sara; Coghill, David; Danckaerts, Marina; Dittmann, Ralf W.; Falissard, Bruno; Grimshaw, Dina Gojkovic; Hollis, Chris; Inglis, Sarah; Konrad, Kerstin; Liddle, Elizabeth; McCarthy, Suzanne; Nagy, Peter; Thompson, Margaret; Wong, Ian C.K.; Zuddas, Alessandro

2016-01-01

Abstract Objective: There is no questionnaire to specifically monitor perceived adverse events of methylphenidate (MPH) on cognition, motivation, and mood. The current study therefore had two goals. First, to harvest accounts of such putative events from transcripts of interviews in samples enriched for such potential experiences. Second, to use the derived data to generate items for a new questionnaire that can be used for monitoring such events in medication trials or routine clinical care. Methods: Following a literature search aimed at identifying associations between MPH and cognition and/or motivation, a qualitative semistructured interview was designed to focus specifically on the domains of cognition (i.e., reasoning, depth/breadth of thinking, intellectual capacity, and creativity) and motivation (i.e., drive, effort, and attitudes toward rewards/incentives). Interviews were conducted with 45 participants drawn from the following four groups: (a) clinicians, child and adolescent psychiatrists, and pediatricians specializing in attention-deficit/hyperactivity disorder (ADHD) (n = 15); (2) teachers, with experience of teaching at least 10 medicated children with ADHD (n = 10); (3) parents of children with ADHD (n = 8) treated with MPH; and (4) adolescents/adults with ADHD (n = 12). Purposeful sampling was used to selectively recruit ADHD participants whose histories suggested a degree of vulnerability to MPH adverse events. Data were analyzed using a deductive approach to content analysis. Results: While we probed purposefully for cognitive and motivational adverse events, a third domain, related to mood, emerged from the reports. Therefore, three domains, each with a number of subdomains, were identified from the interview accounts: (i) Cognition (six subdomains; attention/concentration, changes in thinking, reduced creativity, sensory overload, memory, slower processing speed); (ii) motivation (four subdomains; loss of intrinsic motivation for goal-directed activities, external locus of control, lack of effort/engagement in daily tasks, increased focus on incentives); and (iii) mood (three subdomains; dampening of spontaneity/flat affect, mood dysregulation, increased anxiety/edginess). On the basis of these reports, 34 items were specified and incorporated into a prototype questionnaire, which was piloted and refined on the basis of field-testing. Conclusions: Items were identified that capture potential/perceived cognitive, motivational, and mood-related adverse events of MPH. The items generated will allow us to further develop and psychometrically examine their prevalence, and the extent to which they are associated with medication adherence, treatment outcome, impairment, and other reported adverse events (e.g., loss of appetite/cardiovascular effects). PMID:27007169

Reports of Perceived Adverse Events of Stimulant Medication on Cognition, Motivation, and Mood: Qualitative Investigation and the Generation of Items for the Medication and Cognition Rating Scale.

PubMed

Kovshoff, Hanna; Banaschewski, Tobias; Buitelaar, Jan K; Carucci, Sara; Coghill, David; Danckaerts, Marina; Dittmann, Ralf W; Falissard, Bruno; Grimshaw, Dina Gojkovic; Hollis, Chris; Inglis, Sarah; Konrad, Kerstin; Liddle, Elizabeth; McCarthy, Suzanne; Nagy, Peter; Thompson, Margaret; Wong, Ian C K; Zuddas, Alessandro; Sonuga-Barke, Edmund J S

2016-08-01

There is no questionnaire to specifically monitor perceived adverse events of methylphenidate (MPH) on cognition, motivation, and mood. The current study therefore had two goals. First, to harvest accounts of such putative events from transcripts of interviews in samples enriched for such potential experiences. Second, to use the derived data to generate items for a new questionnaire that can be used for monitoring such events in medication trials or routine clinical care. Following a literature search aimed at identifying associations between MPH and cognition and/or motivation, a qualitative semistructured interview was designed to focus specifically on the domains of cognition (i.e., reasoning, depth/breadth of thinking, intellectual capacity, and creativity) and motivation (i.e., drive, effort, and attitudes toward rewards/incentives). Interviews were conducted with 45 participants drawn from the following four groups: (a) clinicians, child and adolescent psychiatrists, and pediatricians specializing in attention-deficit/hyperactivity disorder (ADHD) (n = 15); (2) teachers, with experience of teaching at least 10 medicated children with ADHD (n = 10); (3) parents of children with ADHD (n = 8) treated with MPH; and (4) adolescents/adults with ADHD (n = 12). Purposeful sampling was used to selectively recruit ADHD participants whose histories suggested a degree of vulnerability to MPH adverse events. Data were analyzed using a deductive approach to content analysis. While we probed purposefully for cognitive and motivational adverse events, a third domain, related to mood, emerged from the reports. Therefore, three domains, each with a number of subdomains, were identified from the interview accounts: (i) Cognition (six subdomains; attention/concentration, changes in thinking, reduced creativity, sensory overload, memory, slower processing speed); (ii) motivation (four subdomains; loss of intrinsic motivation for goal-directed activities, external locus of control, lack of effort/engagement in daily tasks, increased focus on incentives); and (iii) mood (three subdomains; dampening of spontaneity/flat affect, mood dysregulation, increased anxiety/edginess). On the basis of these reports, 34 items were specified and incorporated into a prototype questionnaire, which was piloted and refined on the basis of field-testing. Items were identified that capture potential/perceived cognitive, motivational, and mood-related adverse events of MPH. The items generated will allow us to further develop and psychometrically examine their prevalence, and the extent to which they are associated with medication adherence, treatment outcome, impairment, and other reported adverse events (e.g., loss of appetite/cardiovascular effects).

Using electronic technology to improve clinical care - results from a before-after cluster trial to evaluate assessment and classification of sick children according to Integrated Management of Childhood Illness (IMCI) protocol in Tanzania.

PubMed

Mitchell, Marc; Hedt-Gauthier, Bethany L; Msellemu, Daniel; Nkaka, Melania; Lesh, Neal

2013-08-27

Poor adherence to the Integrated Management of Childhood Illness (IMCI) protocol reduces the potential impact on under-five morbidity and mortality. Electronic technology could improve adherence; however there are few studies demonstrating the benefits of such technology in a resource-poor settings. This study estimates the impact of electronic technology on adherence to the IMCI protocols as compared to the current paper-based protocols in Tanzania. In four districts in Tanzania, 18 clinics were randomly selected for inclusion. At each site, observers documented critical parts of the clinical assessment of children aged 2 months to 5 years. The first set of observations occurred during examination of children using paper-based IMCI (pIMCI) and the next set of observations occurred during examination using the electronic IMCI (eIMCI). Children were re-examined by an IMCI expert and the diagnoses were compared. A total of 1221 children (671 paper, 550 electronic) were observed. For all ten critical IMCI items included in both systems, adherence to the protocol was greater for eIMCI than for pIMCI. The proportion assessed under pIMCI ranged from 61% to 98% compared to 92% to 100% under eIMCI (p < 0.05 for each of the ten assessment items). Use of electronic systems improved the completeness of assessment of children with acute illness in Tanzania. With the before-after nature of the design, potential for temporal confounding is the primary limitation. However, the data collection for both phases occurred over a short period (one month) and so temporal confounding was expected to be minimal. The results suggest that the use of electronic IMCI protocols can improve the completeness and consistency of clinical assessments and future studies will examine the long-term health and health systems impact of eIMCI.

Validation of a mobility item bank for older patients in primary care.

PubMed

Cabrero-García, Julio; Ramos-Pichardo, Juan Diego; Muñoz-Mendoza, Carmen Luz; Cabañero-Martínez, María José; González-Llopis, Lorena; Reig-Ferrer, Abilio

2012-12-05

To develop and validate an item bank to measure mobility in older people in primary care and to analyse differential item functioning (DIF) and differential bundle functioning (DBF) by sex. A pool of 48 mobility items was administered by interview to 593 older people attending primary health care practices. The pool contained four domains based on the International Classification of Functioning: changing and maintaining body position, carrying, lifting and pushing, walking and going up and down stairs. The Late Life Mobility item bank consisted of 35 items, and measured with a reliability of 0.90 or more across the full spectrum of mobility, except at the higher end of better functioning. No evidence was found of non-uniform DIF but uniform DIF was observed, mainly for items in the changing and maintaining body position and carrying, lifting and pushing domains. The walking domain did not display DBF, but the other three domains did, principally the carrying, lifting and pushing items. During the design and validation of an item bank to measure mobility in older people, we found that strength (carrying, lifting and pushing) items formed a secondary dimension that produced DBF. More research is needed to determine how best to include strength items in a mobility measure, or whether it would be more appropriate to design separate measures for each construct.

Usability Evaluation of a Web-Based Symptom Monitoring Application for Heart Failure.

PubMed

Wakefield, Bonnie; Pham, Kassie; Scherubel, Melody

2015-07-01

Symptom recognition and reporting by patients with heart failure are critical to avoid hospitalization. This project evaluated a patient symptom tracking application. Fourteen end users (nine patients, five clinicians) from a Midwestern Veterans Affairs Medical Center evaluated the website using a think aloud protocol. A structured observation protocol was used to assess success or failure for each task. Measures included task time, success, and satisfaction. Patients had a mean age of 70 years; clinicians averaged 42 years in age. Patients took 9.3 min and clinicians took less than 3 min per scenario. Most patients needed some assistance, but few patients were completely unable to complete some tasks. Clinicians demonstrated few problems navigating the site. Patient System Usability Scale item scores ranged from 2.0 to 3.6; clinician item scores ranged from 1.8 to 4.0. Further work is needed to determine whether using the web-based tool improves symptom recognition and reporting. © The Author(s) 2015.

Mercury Shopping Cart Interface

NASA Technical Reports Server (NTRS)

Pfister, Robin; McMahon, Joe

2006-01-01

Mercury Shopping Cart Interface (MSCI) is a reusable component of the Power User Interface 5.0 (PUI) program described in another article. MSCI is a means of encapsulating the logic and information needed to describe an orderable item consistent with Mercury Shopping Cart service protocol. Designed to be used with Web-browser software, MSCI generates Hypertext Markup Language (HTML) pages on which ordering information can be entered. MSCI comprises two types of Practical Extraction and Report Language (PERL) modules: template modules and shopping-cart logic modules. Template modules generate HTML pages for entering the required ordering details and enable submission of the order via a Hypertext Transfer Protocol (HTTP) post. Shopping cart modules encapsulate the logic and data needed to describe an individual orderable item to the Mercury Shopping Cart service. These modules evaluate information entered by the user to determine whether it is sufficient for the Shopping Cart service to process the order. Once an order has been passed from MSCI to a deployed Mercury Shopping Cart server, there is no further interaction with the user.

Item Banks for Substance Use from the Patient-Reported Outcomes Measurement Information System (PROMIS®): Severity of Use and Positive Appeal of Use*

PubMed Central

Pilkonis, Paul A.; Yu, Lan; Dodds, Nathan E.; Johnston, Kelly L.; Lawrence, Suzanne; Hilton, Thomas F.; Daley, Dennis C.; Patkar, Ashwin A.; McCarty, Dennis

2015-01-01

Background Two item banks for substance use were developed as part of the Patient-Reported Outcomes Measurement Information System (PROMIS®): severity of substance use and positive appeal of substance use. Methods Qualitative item analysis (including focus groups, cognitive interviewing, expert review, and item revision) reduced an initial pool of more than 5,300 items for substance use to 119 items included in field testing. Items were written in a first-person, past-tense format, with 5 response options reflecting frequency or severity. Both 30-day and 3-month time frames were tested. The calibration sample of 1,336 respondents included 875 individuals from the general population (ascertained through an internet panel) and 461patients from addiction treatment centers participating in the National Drug Abuse Treatment Clinical Trials Network. Results Final banks of 37 and 18 items were calibrated for severity of substance use and positive appeal of substance use, respectively, using the two-parameter graded response model from item response theory (IRT). Initial calibrations were similar for the 30-day and 3-month time frames, and final calibrations used data combined across the time frames, making the items applicable with either interval. Seven-item static short forms were also developed from each item bank. Conclusions Test information curves showed that the PROMIS item banks provided substantial information in a broad range of severity, making them suitable for treatment, observational, and epidemiological research in both clinical and community settings. PMID:26423364

The impact of the Family Communication Coordinator (FCC) Protocol on the role stress of hospital chaplains.

PubMed

Dodd-McCue, Diane; Tartaglia, Alexander

2005-01-01

The Family Communication Coordinator (FCC) Protocol was implemented to provide early family intervention and to facilitate effective communications during potential organ donation cases. Previous studies found the Protocol associated with improved donor outcome measures and with reduced role stress for ICU nurses caring for potential donors. The present study examines the impact of the Protocol on the perceived role stress of hospital chaplains serving as FCCs. All hospital chaplains serving as FCCs at an academic teaching hospital were surveyed. Their perceptions of job dimensions, role stress, job satisfaction, and commitment were measured; interviews and secondary data supplemented the surveys. The findings demonstrate that the FCC Protocol is associated with improved role stress, specifically role ambiguity and role conflict, among hospital chaplains serving as FCCs. Additionally, the findings suggest that satisfaction with the Protocol may be associated with experience with the Protocol.

Development of an item bank for computerized adaptive test (CAT) measurement of pain.

PubMed

Petersen, Morten Aa; Aaronson, Neil K; Chie, Wei-Chu; Conroy, Thierry; Costantini, Anna; Hammerlid, Eva; Hjermstad, Marianne J; Kaasa, Stein; Loge, Jon H; Velikova, Galina; Young, Teresa; Groenvold, Mogens

2016-01-01

Patient-reported outcomes should ideally be adapted to the individual patient while maintaining comparability of scores across patients. This is achievable using computerized adaptive testing (CAT). The aim here was to develop an item bank for CAT measurement of the pain domain as measured by the EORTC QLQ-C30 questionnaire. The development process consisted of four steps: (1) literature search, (2) formulation of new items and expert evaluations, (3) pretesting and (4) field-testing and psychometric analyses for the final selection of items. In step 1, we identified 337 pain items from the literature. Twenty-nine new items fitting the QLQ-C30 item style were formulated in step 2 that were reduced to 26 items by expert evaluations. Based on interviews with 31 patients from Denmark, France and the UK, the list was further reduced to 21 items in step 3. In phase 4, responses were obtained from 1103 cancer patients from five countries. Psychometric evaluations showed that 16 items could be retained in a unidimensional item bank. Evaluations indicated that use of the CAT measure may reduce sample size requirements with 15-25% compared to using the QLQ-C30 pain scale. We have established an item bank of 16 items suitable for CAT measurement of pain. While being backward compatible with the QLQ-C30, the new item bank will significantly improve measurement precision of pain. We recommend initiating CAT measurement by screening for pain using the two original QLQ-C30 pain items. The EORTC pain CAT is currently available for "experimental" purposes.

Development of a Comprehensive Programme to Prevent and Reduce the Negative Impact of Railway Fatalities, Injuries and Close Calls on Railway Employees.

PubMed

Bardon, Cécile; Mishara, Brian L

2015-09-01

This article presents a strategy to prevent trauma, support and care for railway personnel who experience critical incidents (CI) on the job, usually fatalities by accident or suicide. We reviewed all publications on CI management, support and care practices in the railway industry, as well as practices in place in Canada (unpublished protocols). Semi structured interviews were conducted with 40 train engineers and conductors involved in CIs and the content was coded and analysed quantitatively. Employees' satisfaction with the help received after the incident varies according to the behaviour of the local manager, company officers and police, the level of compliance with existing company protocols to help them, the presence of unmet expectations for support and care, their perceived competency of clinicians they consulted and the level of trust toward their employers. On the basis of the interview results, the review of existing railway practices and discussions with railway stakeholders, a model protocol was developed for a comprehensive workplace prevention, support and care protocol to reduce the negative impact of railway critical incidents on employees. This protocol includes preventive actions before traumatic events occur, immediate responses at the site of incident, interventions within the first few days after the incident and longer term support and interventions provided by the company and by outsourced experts.

Novel clustering of items from the Autism Diagnostic Interview-Revised to define phenotypes within autism spectrum disorders

PubMed Central

Hu, Valerie W.; Steinberg, Mara E.

2009-01-01

Heterogeneity in phenotypic presentation of ASD has been cited as one explanation for the difficulty in pinpointing specific genes involved in autism. Recent studies have attempted to reduce the “noise” in genetic and other biological data by reducing the phenotypic heterogeneity of the sample population. The current study employs multiple clustering algorithms on 123 item scores from the Autism Diagnostic Interview-Revised (ADI-R) diagnostic instrument of nearly 2000 autistic individuals to identify subgroups of autistic probands with clinically relevant behavioral phenotypes in order to isolate more homogeneous groups of subjects for gene expression analyses. Our combined cluster analyses suggest optimal division of the autistic probands into 4 phenotypic clusters based on similarity of symptom severity across the 123 selected item scores. One cluster is characterized by severe language deficits, while another exhibits milder symptoms across the domains. A third group possesses a higher frequency of savant skills while the fourth group exhibited intermediate severity across all domains. Grouping autistic individuals by multivariate cluster analysis of ADI-R scores reveals meaningful phenotypes of subgroups within the autistic spectrum which we show, in a related (accompanying) study, to be associated with distinct gene expression profiles. PMID:19455643

Customizing Survey Instruments and Data Collection to Reach Hispanic/Latino Adults in Border Communities in Texas

PubMed Central

Pederson, Linda L.; Thorne, Stacy L.; Caraballo, Ralph S.; Evans, Brian; Athey, Leslie; McMichael, Joseph

2010-01-01

Objectives. We sought to modify an instrument and to use it to collect information on smoking knowledge, attitudes, beliefs, and behaviors among Hispanics/Latinos, and to adapt survey methods to obtain high participation levels. Methods. Promotoras (outreach workers) conducted face-to-face interviews with 1485 Hispanic adults (July 2007–April 2008). The project team used GeoFrame field enumeration methods to develop a sampling frame from households in randomly selected colonias (residential areas along the Texas–Mexico border that may lack some basic necessities (e.g. portable water), in El Paso, Texas. Results. The revised questionnaire included 36 unchanged items from the State Adult Tobacco Survey, 7 modified items, and 17 new items focusing on possible culturally specific quitting methods, secondhand smoke issues, and attitudes and knowledge about tobacco use that might be unique for Hispanic/Latino groups. The eligibility rate was 90.2%, and the conservative combined completed screener and interview response rate was 80.0%. Conclusions. Strategic, targeted, carefully designed methods and surveys can achieve high reach and response rates in hard-to-reach populations. Similar procedures could be used to obtain cooperation of groups who may not be accessible with traditional methods. PMID:20147687

The association between socioeconomic characteristics and consumption of food items among Brazilian industry workers.

PubMed

Vinholes, Daniele B; Melo, Ione M F; Machado, Carlos Alberto; de Castro Chaves, Hilton; Fuchs, Flavio D; Fuchs, Sandra C

2012-01-01

Dietary pattern plays a causative role in the rising of noncommunicable diseases. The SESI (Serviço Social da Indústria) study was designed to evaluate risk factors for noncommunicable diseases. We aimed to describe food items consumed by Brazilian workers and to assess their association with socioeconomic status. Cross-sectional study was carried out among Brazilian industrial workers, selected by multistage sampling, from 157 companies. Interviews were conducted at the work place using standardized forms. 4818 workers were interviewed, aged 35.4 ± 10.7 years, 76.5% were men. The workers had an average of 8.7 ± 4.1 years of schooling and 25.4 ± 4.1 kg/m² of BMI. Men and individuals with less than high school education were less likely to consume dairy products, fruits, and vegetables daily, even after control for confounding factors. Men consumed rice and beans daily more often than women. In comparison to workers aged 50-76 years, those under 30 years old consumed less fruits and green leafy vegetables daily. The food items consumed by Brazilian workers show that there are insufficient consumption according to the guidelines of healthy foods, particularly of dairy products, vegetables, and fruits.

Developing Tools for Identifying Employer and Employee Satisfaction of Nursing New Graduates in China

PubMed Central

Fan, Yuying; Li, Qiujie; Yang, Shufen; Guo, Ying; Yang, Libin; Zhao, Shibin

2014-01-01

Purpose. Researchers developed evaluation tools measuring employment relevant satisfaction for nursing new graduates. The evaluation tools were designed to be relevant to nursing managers who make employment decisions and nursing new graduates who were just employed. Methods. In-depth interviews and an expert panel were established to review the activities that evaluate the employee and employer satisfaction of nursing new graduates. Based on individual interviews and literature review, evaluation items were selected. A two-round Delphi study was then conducted from September 2008 to May 2009 with a panel of experts from a range of nursing colleges in China. Results. The response rate was 100% and Kendall's W was 0.73 in the second round of Delphi study. After two rounds of Delphi surveys, a list of 5 employee satisfaction items and 4 employer satisfaction items was identified for nursing new graduates. Conclusions. The findings of this study identified a different but multidimensional set of factors for employment relevant satisfaction, which confirmed the importance of certain fundamental aspects of practice. We developed the evaluation tools to assess the employer and employee satisfaction of nursing new graduates, which provided a database for further study. PMID:25097876

Developing tools for identifying employer and employee satisfaction of nursing new graduates in China.

PubMed

Fan, Yuying; Li, Qiujie; Yang, Shufen; Guo, Ying; Yang, Libin; Zhao, Shibin

2014-01-01

Researchers developed evaluation tools measuring employment relevant satisfaction for nursing new graduates. The evaluation tools were designed to be relevant to nursing managers who make employment decisions and nursing new graduates who were just employed. In-depth interviews and an expert panel were established to review the activities that evaluate the employee and employer satisfaction of nursing new graduates. Based on individual interviews and literature review, evaluation items were selected. A two-round Delphi study was then conducted from September 2008 to May 2009 with a panel of experts from a range of nursing colleges in China. The response rate was 100% and Kendall's W was 0.73 in the second round of Delphi study. After two rounds of Delphi surveys, a list of 5 employee satisfaction items and 4 employer satisfaction items was identified for nursing new graduates. The findings of this study identified a different but multidimensional set of factors for employment relevant satisfaction, which confirmed the importance of certain fundamental aspects of practice. We developed the evaluation tools to assess the employer and employee satisfaction of nursing new graduates, which provided a database for further study.

Cognitive testing with female nutrition and education assistance program participants informs validity of the Satter eating competence inventory.

PubMed

Krall, Jodi Stotts; Lohse, Barbara

2010-01-01

Examine the validity of a self-report measure of eating competence with low-income women. Twenty-five females (18-49 years old) recruited from low-income venues in Pennsylvania completed cognitive testing through an iterative interview process. Respondents' oral responses were compared to researchers' intended meaning of ecSatter Inventory (ecSI) items; responses were mapped to evaluate the similarity between respondents' internally generated answers and their ecSI choices for survey items; and scored responses were compared among participants. Interview findings provided a rationale for modifying the ecSI prior to use with low-income women. Four items were misinterpreted for various reasons, including problems with clarity and wording. The modified ecSI, termed the ecSatter Inventory for Low-Income (ecSI/LI), was comprehended as intended by researchers. Congruence of cognitive responses and ecS/LI scores further supported the instrument's validity. Cognitive testing resulted in the development of an instrument to measure eating competence in low-income adults. The ecSI/LI requires validation with a large, heterogeneous low-income sample. Copyright 2010 Society for Nutrition Education. Published by Elsevier Inc. All rights reserved.

Development of the pediatric quality of life inventory neurofibromatosis type 1 module items for children, adolescents and young adults: qualitative methods.

PubMed

Nutakki, Kavitha; Varni, James W; Steinbrenner, Sheila; Draucker, Claire B; Swigonski, Nancy L

2017-03-01

Health-related quality of life (HRQOL) is arguably one of the most important measures in evaluating effectiveness of clinical treatments. At present, there is no disease-specific outcome measure to assess the HRQOL of children, adolescents and young adults with Neurofibromatosis Type 1 (NF1). This study aimed to develop the items and support the content validity for the Pediatric Quality of Life Inventory™ (PedsQL™) NF1 Module for children, adolescents and young adults. The iterative process included multiphase qualitative methods including a literature review, survey of expert opinions, semi-structured interviews, cognitive interviews and pilot testing. Fifteen domains were derived from the qualitative methods, with content saturation achieved, resulting in 115 items. The domains include skin, pain, pain impact, pain management, cognitive functioning, speech, fine motor, balance, vision, perceived physical appearance, communication, worry, treatment, medicines and gastrointestinal symptoms. This study is limited because all participants are recruited from a single-site. Qualitative methods support the content validity for the PedsQL™ NF1 Module for children, adolescents and young adults. The PedsQL™ NF1 Module is now undergoing national multisite field testing for the psychometric validation of the instrument development.

Use of Concept Profile Analysis to Identify Difficulties in Solving Science Problems.

ERIC Educational Resources Information Center

Gorodetsky, Malka; Hoz, Ron

1980-01-01

Proposed is a new method for analyzing how concepts are used in the process of problem solving in science. Through the use of a "thinking aloud" interview technique, 21 tenth-grade students worked with a problem concerning the boiling point of water at the Dead Sea. Interview protocols were analyzed to develop students' concept profiles.…

Professional Development Needs of Directors Leading in a Mixed Service Delivery Preschool System

ERIC Educational Resources Information Center

Ryan, Sharon; Whitebook, Marcy; Kipnis, Fran; Sakai, Laura

2011-01-01

This paper reports on an interview study with directors of Head Start and child care programs who are collaborating with local education authorities to provide publicly funded preschool in New Jersey, USA. A standardized interview protocol was utilized with 98 directors chosen to represent a range of center types from across the three main regions…

The Interplay of Gender in the Careers of White Female and Male Senior Professors. ASHE Annual Meeting Paper.

ERIC Educational Resources Information Center

Beaman-Smith, Kandis; Placier, Margaret

A grounded theory study was conducted using open-ended interviews with white male and female senior, tenured faculty members. The setting was a major Midwestern research one university. Four male and five female participants, all white agreed to participate. An open-ended interview protocol was used. Following grounded theory strategies, open…

Development of Rasch-based item banks for the assessment of work performance in patients with musculoskeletal diseases.

PubMed

Mueller, Evelyn A; Bengel, Juergen; Wirtz, Markus A

2013-12-01

This study aimed to develop a self-description assessment instrument to measure work performance in patients with musculoskeletal diseases. In terms of the International Classification of Functioning, Disability and Health (ICF), work performance is defined as the degree of meeting the work demands (activities) at the actual workplace (environment). To account for the fact that work performance depends on the work demands of the job, we strived to develop item banks that allow a flexible use of item subgroups depending on the specific work demands of the patients' jobs. Item development included the collection of work tasks from literature and content validation through expert surveys and patient interviews. The resulting 122 items were answered by 621 patients with musculoskeletal diseases. Exploratory factor analysis to ascertain dimensionality and Rasch analysis (partial credit model) for each of the resulting dimensions were performed. Exploratory factor analysis resulted in four dimensions, and subsequent Rasch analysis led to the following item banks: 'impaired productivity' (15 items), 'impaired cognitive performance' (18), 'impaired coping with stress' (13) and 'impaired physical performance' (low physical workload 20 items, high physical workload 10 items). The item banks exhibited person separation indices (reliability) between 0.89 and 0.96. The assessment of work performance adds the activities component to the more commonly employed participation component of the ICF-model. The four item banks can be adapted to specific jobs where necessary without losing comparability of person measures, as the item banks are based on Rasch analysis.

Predictors of persistence after a positive depression screen among adolescents.

PubMed

Richardson, Laura P; McCauley, Elizabeth; McCarty, Carolyn A; Grossman, David C; Myaing, Mon; Zhou, Chuan; Richards, Julie; Rockhill, Carol; Katon, Wayne

2012-12-01

To examine predictors of depression persistence after a positive screening test to inform management protocols for screened youth. We conducted a cohort study of 444 youth (aged 13-17 years) from a large health care delivery system. Youth with depressive symptoms, based on a 2-item depression screen, were oversampled for the baseline interview. Baseline assessments included the Patient Health Questionnaire 9-item (PHQ-9) depression screen as well as clinical factors that were hypothesized to influence depression persistence (family history of depression, functional impairment, perceived social support, anxiety symptoms, externalizing symptoms, and medical comorbidity). Logistic regression analysis was used to examine factors associated with the persistence of depression at 6 months postbaseline. Of 113 youth with a positive baseline screen (PHQ-9 ≥11), 47% and 35% continued to be positive at 6-week and 6-month follow-up, respectively. After controlling for treatment status, only 2 factors were significantly associated with depression persistence at 6 months: baseline depressive symptom score and continuing to have a positive screen at 6 weeks. For each 1-point increase on the PHQ-9 score at baseline, youth had a 16% increased odds of continuing to be depressed at 6 months (odds ratio: 1.16, 95% confidence interval: 1.01-1.34). Youth who continued to screen positive 6 weeks later had almost 3 times the odds of being depressed at 6 months (odds ratio: 2.89, 95% confidence interval: 1.09-7.61). Depressive symptom severity at presentation and continued symptoms at 6 weeks postscreening are the strongest predictors of depression persistence. Patients with high depressive symptom scores and continued symptoms at 6 weeks should receive active treatment.

Evaluating training of screening, brief intervention, and referral to treatment (SBIRT) for substance use: Reliability of the MD3 SBIRT Coding Scale.

PubMed

DiClemente, Carlo C; Crouch, Taylor Berens; Norwood, Amber E Q; Delahanty, Janine; Welsh, Christopher

2015-03-01

Screening, brief intervention, and referral to treatment (SBIRT) has become an empirically supported and widely implemented approach in primary and specialty care for addressing substance misuse. Accordingly, training of providers in SBIRT has increased exponentially in recent years. However, the quality and fidelity of training programs and subsequent interventions are largely unknown because of the lack of SBIRT-specific evaluation tools. The purpose of this study was to create a coding scale to assess quality and fidelity of SBIRT interactions addressing alcohol, tobacco, illicit drugs, and prescription medication misuse. The scale was developed to evaluate performance in an SBIRT residency training program. Scale development was based on training protocol and competencies with consultation from Motivational Interviewing coding experts. Trained medical residents practiced SBIRT with standardized patients during 10- to 15-min videotaped interactions. This study included 25 tapes from the Family Medicine program coded by 3 unique coder pairs with varying levels of coding experience. Interrater reliability was assessed for overall scale components and individual items via intraclass correlation coefficients. Coder pair-specific reliability was also assessed. Interrater reliability was excellent overall for the scale components (>.85) and nearly all items. Reliability was higher for more experienced coders, though still adequate for the trained coder pair. Descriptive data demonstrated a broad range of adherence and skills. Subscale correlations supported concurrent and discriminant validity. Data provide evidence that the MD3 SBIRT Coding Scale is a psychometrically reliable coding system for evaluating SBIRT interactions and can be used to evaluate implementation skills for fidelity, training, assessment, and research. Recommendations for refinement and further testing of the measure are discussed. (PsycINFO Database Record (c) 2015 APA, all rights reserved).

How well-run boards make decisions.

PubMed

Useem, Michael

2006-11-01

In the aftermath of seismic debacles like those that toppled Enron and WorldCom, corporate boards have been shaken up and made over. More directors are independent these days, for instance, and corporations now disclose directors' salaries and committee members' names. Research shows that most of the changes are having a positive effect on companies' performance. They are primarily structural, though, and don't go to the heart of a board's work: making the choices that shape a firm's future. Which decisions boards own and how those calls are made are largely hidden from the public. As a result, boards are often unable to learn from the best governance practices of their counterparts at other companies. This article pulls back the curtain and provides an inside look. Drawing on interviews with board members and executives at 31 companies, along with a close examination of three boardroom decisions, the author identifies several formal processes that can help companies improve their decision making: creating calendars that specify when the board and the standing committees will consider key items; drafting charters that define the decisions committees are responsible for; and developing decision protocols that divvy up responsibilities between directors and executives. The author also identifies a number of informal decision-making principles: Items that are strategically significant and touch on the firm's core values should go to the board. Large decisions should be divided into small pieces, so the board can devote sufficient attention to each one. Directors must remain vigilant to ensure that their decisions are effectively implemented. The CEO and either the nonexecutive chair or the lead director should engage in ongoing dialogue regarding which decisions to take to the full board and when. And directors should challenge assumptions before making yes-or-no decisions on management proposals.

Developing a cultural competence inventory for nurses in China.

PubMed

Cai, D; Kunaviktikul, W; Klunklin, A; Sripusanapan, A; Avant, P K

2017-06-01

To develop and psychometrically test the Cultural Competence Inventory for Nurses in China. Cultural competence is expected worldwide from nurses due to the increasing cultural diversity of people in healthcare establishments. Yet, no cultural competence framework or instrument for nurses has been identified to guide nursing practice in China where the cultural diversity of the populations and the characteristics of the healthcare system are different from those of the West. A review of literature and individual interviews among nurse experts generated 74 items, which were evaluated by six experts in transcultural nursing. A stratified random sampling technique was used to recruit 520 Chinese nurses for the field test. Construct validity and internal consistency reliability of the instrument were estimated by exploratory factor analysis and Cronbach's alpha, respectively. The data were collected from May 2015 to January 2016. The final instrument consists of 29 items in five dimensions, namely 'cultural awareness, cultural respect, cultural knowledge, cultural understanding and cultural skills'. Cronbach's alpha for the instrument was 0.94, with a range of 0.79-0.92 for the individual dimensions. The evidence for contrast-group validity (P < 0.001) was also obtained. The study provides evidence that the Cultural Competence Inventory for Nurses in China is reliable, valid and culturally sensitive for measuring nurses' cultural competence. The instrument development process facilitates the understanding of cultural competence globally. Cultural competence of nurses can be evaluated for self-development, workforce management and quality assurance. The instrument can also serve as the foundation to develop education curricula and nursing procedures or protocols to improve culturally competent nursing practice. © 2017 International Council of Nurses.

The implementation of a new Malaria Treatment Protocol in Timor-Leste: challenges and constraints

PubMed Central

Martins, João Soares; Zwi, Anthony B; Hobday, Karen; Bonaparte, Fernando; Kelly, Paul M

2012-01-01

Background Timor-Leste changed its malaria treatment protocol in 2007, replacing the first-line for falciparum malaria from sulphadoxine-pyrimethamine to artemether-lumefantrine. This study explored the factors affecting the implementation of the revised treatment protocol, with an emphasis on identifying key constraints. Methods A mixed method approach drew on both qualitative and quantitative data. The study included data from District Health Services in seven districts, community health centres in 14 sub-districts, four hospitals, five private clinics, one private pharmacy and the country's autonomous medical store. In-depth interviews with 36 key informants, five group interviews and 15 focus group discussions were conducted. A survey was also undertaken at community health centres and hospitals to assess the availability of a physical copy of the Malaria Treatment Protocol, as well as the availability and utilization of artemether-lumefantrine and sulphadoxine-pyrimethamine. Results Many factors impeded the implementation of the new malaria protocol. These included: inadequate introduction and training around the revised treatment protocol; unclear phasing out of sulphadoxine-pyrimethamine and phasing in of the revised treatment, artemether-lumefantrine, and the rapid diagnostic test (RDT); lack of supervision; lack of adherence to the revised guidelines by foreign health workers; lack of access to the new drug by the private sector; obstacles in the procurement process; and the use of trade names rather than generic drug description. Insufficient understanding of the rapid diagnostic test and the untimely supply of drugs further hampered implementation. Conclusion To effectively implement a revised malaria treatment protocol, barriers should be identified during the policy formulation process and those emerging during implementation should be recognized promptly and addressed. PMID:22460007

Screening for major and minor depression in a multiethnic sample of Asian primary care patients: a comparison of the nine-item Patient Health Questionnaire (PHQ-9) and the 16-item Quick Inventory of Depressive Symptomatology - Self-Report (QIDS-SR16 ).

PubMed

Sung, Sharon Cohan; Low, Charity Cheng Hong; Fung, Daniel Shuen Sheng; Chan, Yiong Huak

2013-12-01

Depression is common, disabling, and the single most important factor leading to suicide, yet it is underdiagnosed in busy primary care settings. A key challenge facing primary care clinicians in Asia is the selection of instruments to facilitate depression screening. Although the nine-item Patient Health Questionnaire (PHQ-9) and 16-item Quick Inventory of Depressive Symptomatology - Self-Report (QIDS-SR16 ) are used internationally, they have not been directly compared or widely validated in Asian primary care populations. This study aimed to validate the PHQ-9 and QIDS-SR16 against a structured interview diagnosis of Diagnostic and Statistical Manual, 4th Edition, depression based on the Mini-International Neuropsychiatric Interview in a multiethnic Asian sample. From April through August 2011, we enrolled 400 English-speaking Singaporean primary care patients. Participants completed a demographic data form, the PHQ-9, and the QIDS-SR16 . They were assessed independently for major and minor depression using the Mini-International Neuropsychiatric Interview. Sensitivity and specificity for diagnosing major depression were 91.7% and 72.2%, respectively, for the PHQ-9 (optimal cutoff score of 6), and 83.3% and 84.7%, respectively, for the QIDS-SR16 (optimal cutoff score of 9). The QIDS-SR16 also detected minor depression at an optimal cutoff score of 7, with a sensitivity of 94.4% and specificity of 77.9%. The PHQ-9 and QIDS-SR16 showed good internal consistency (Cronbach's α: 0.87 and 0.79, respectively) and good convergent validity (correlation coefficient: r = 0.73, P < 0.001). The overall prevalence of major and minor depressive disorders was 9%. The PHQ-9 and QIDS-SR16 appear to be valid and reliable for depression screening in Asian primary care settings. Copyright © 2013 Wiley Publishing Asia Pty Ltd.

A Mixed-methods Study to Assess Interrater Reliability and Nurse Perception of the Braden Scale in a Tertiary Acute Care Setting.

PubMed

Ho, Chester H; Cheung, Amanda; Southern, Danielle; Ocampo, Wrechelle; Kaufman, Jaime; Hogan, David B; Baylis, Barry; Conly, John M; Stelfox, Henry T; Ghali, William A

2016-12-01

Research regarding the reliability of the Braden Scale and nurses' perspectives on the instrument for predicting pressure ulcer (PU) risk in acute care settings is limited. A mixed-methods study was conducted in a tertiary acute care facility to examine interrater reliability (IRR) of the Braden Scale and its subscales, and a qualitative survey using semi-structured interviews was conducted among nurses caring for patients in acute care units to gain nurse perspective regarding scale usability. Data were extracted from a previous retrospective, randomized, controlled trial involving adult patients with compromised mobility receiving care in a tertiary acute care hospital in Canada. One-way, intraclass correlation coefficients (ICCs) were calculated on item and total scores, and kappa statistics were used to determine reliability of categorizing patients on their risk. Interview results were categorized by common themes. Reliability was assessed on 64 patients, where nurses and research staff independently assessed enrolled participants at baseline and after 72 hours using the Braden Scale as it appeared on an electronic medical record. IRR for the total score was high (ICC = 0.807). The friction and shear item had the lowest reliability (ICC = 0.266). Reliability of categorizing patients' level of risk had moderate agreement (κ = 0.408). Three (3) major and 12 subthemes emerged from the 14 nurse interviews; nurses were aware of the scale's purpose but were uncertain of its effectiveness, some items were difficult to rate, and questions were raised as to whether using the scale enhanced patient care. Aspects identified by nurses to enhance usability included: 1) changes to the electronic version (incorporating the scale into daily assessment documents with readily available item descriptions), 2) additional training, and 3) easily available resource material to improve reliability and usability of scale. These findings need to be considered when using the Braden Scale in clinical practice. Further study of the value of the total Braden Scale and its subscales is warranted.

RECAPDOC - a questionnaire for the documentation of rehabilitation care utilization in individuals with disorders of consciousness in long-term care in Germany: development and pretesting.

PubMed

Klingshirn, Hanna; Mittrach, Rene; Braitmayer, Kathrin; Strobl, Ralf; Bender, Andreas; Grill, Eva; Müller, Martin

2018-05-04

A multitude of different rehabilitation interventions and other specific health care services are offered for individuals with disorders of consciousness in long-term care settings. To investigate the association of those services and patient-relevant outcomes, a specific instrument to document the utilization of those services is needed. The purpose of this study was to develop such a questionnaire administered to caregivers in epidemiological studies or patient registries in Germany. The development process of the RECAPDOC questionnaire was carried out in three steps. Step 1 consisted of a systematic literature review and an online-based expert survey to define the general content. Step 2 was an expert interview to evaluate the preliminary content of the questionnaire. Step 3 was a pretest including cognitive interviews with caregivers. After each step, the results were combined into a new version of the questionnaire. The first version of the questionnaire included items on utilization of medical care, medical aids, nursing and therapeutic care. The results of the expert interview led to the integration of five new items and the modification of six other items. The pretest led to some minor modifications of the questionnaire since it was rated as feasible and acceptable. The final questionnaire consisted of 29 items covering the domains "living situation", "social insurance status", "utilisation of home health care", "domestic services", "outpatient health care", "specific diagnostic measures", "adaptive technologies", "medical aids" and "utilization of therapies". Also the experience of family support and multidisciplinary collaboration of health professionals is covered. The developed questionnaire is a first step to make the situation of patients with disorders of consciousness in the long-term care setting accessible for evaluation in epidemiological studies and in the context of patient registries. However, further reliability and validity studies are needed.

A qualitative examination of the content validity of the EQ-5D-5L in patients with type 2 diabetes.

PubMed

Matza, Louis S; Boye, Kristina S; Stewart, Katie D; Curtis, Bradley H; Reaney, Matthew; Landrian, Amanda S

2015-12-01

The EQ-5D is frequently used to derive utilities for patients with type 2 diabetes (T2D). Despite widely available quantitative psychometric data on the EQ-5D, little is known about content validity in this population. Thus, the purpose of this qualitative study was to examine content validity of the EQ-5D in patients with T2D. Patients with T2D in the UK completed concept elicitation interviews, followed by administration of the EQ-5D-5L and cognitive interviewing focused on the instrument's relevance, clarity, and comprehensiveness. A total of 25 participants completed interviews (52.0 % male; mean age = 53.5 years). Approximately half (52 %) reported that the EQ-5D-5L was relevant to their experience with T2D. When asked if each individual item was relevant to their experience with T2D, responses varied widely (24.0 % said the self-care item was relevant; 68.0 % said the anxiety/depression item was relevant). Participants frequently said items were not relevant to themselves, but could be relevant to patients with more severe diabetes. Most participants (92.0 %) reported that T2D and/or its treatment/monitoring requirements had an impact on their quality of life that was not captured by the EQ-5D-5L. Common missing concepts included food awareness/restriction (n = 13, 52.0 %); activities (n = 11, 44.0 %); emotional functioning other than depression/anxiety (n = 8, 32.0 %); and social/relationship functioning (n = 8, 32.0 %). The results highlight strengths and potential limitations of the EQ-5D-5L, including missing content that could be important for some patients with T2D. Suggestions for addressing limitations are provided.

Conversational Behaviors in Youth with High-functioning ASD and Asperger Syndrome

PubMed Central

Orlovski, Stephanie Miles; Marcinko, Hillary Chuba; Volkmar, Fred

2010-01-01

Twenty-nine youth with autism spectrum disorders and 26 with typical development between 12 and 18 years of age were engaged in structured interviews (ADOS). The interviews were videotaped and rated for atypical conversational behaviors by trained raters, using the Pragmatic Rating Scale (Landa et al. Psychol Med 22:245–254, 1992). The ASD group was divided into AS and HFA/PDD-NOS subgroups. Significant differences were found among groups on approximately one-third of the PRS items. These items involved primarily the management of topics and information, reciprocity, intonation, and gaze management. The only differences to reach significance between the AS and HFA/PDD-NOS group were a greater tendency for overly formal speech on the part of the AS group, and more difficulty with gaze management on the part of the group with HFA/PDD-NOS. The implications of these findings for understanding and treating conversational deficits in ASD are discussed. PMID:18607708

The development of an integrated assessment instrument for measuring analytical thinking and science process skills

NASA Astrophysics Data System (ADS)

Irwanto, Rohaeti, Eli; LFX, Endang Widjajanti; Suyanta

2017-05-01

This research aims to develop instrument and determine the characteristics of an integrated assessment instrument. This research uses 4-D model, which includes define, design, develop, and disseminate. The primary product is validated by expert judgment, tested it's readability by students, and assessed it's feasibility by chemistry teachers. This research involved 246 students of grade XI of four senior high schools in Yogyakarta, Indonesia. Data collection techniques include interview, questionnaire, and test. Data collection instruments include interview guideline, item validation sheet, users' response questionnaire, instrument readability questionnaire, and essay test. The results show that the integrated assessment instrument has Aiken validity value of 0.95. Item reliability was 0.99 and person reliability was 0.69. Teachers' response to the integrated assessment instrument is very good. Therefore, the integrated assessment instrument is feasible to be applied to measure the students' analytical thinking and science process skills.

Unintentional Misreporting on Self-Report Measures of Sexually Aggressive Behavior: An Interview Study.

PubMed

Strang, Emily; Peterson, Zoё D

2017-10-01

The development of effective sexual aggression prevention programs for men relies on data garnered from studies using self-report measures of sexual aggression perpetration. However, few studies have focused on understanding and improving self-report measures of sexual aggression perpetration. The current study used open-ended interviews to explore the nature and frequency of community men's (N = 34) unintentional misreporting-including both overreporting and underreporting-on two self-report measures of sexual aggression perpetration: the Sexual Experiences Survey-Long Form Perpetration (SES-LFP; Koss et al., 2007) and the Sexual Strategies Scale (SSS; Strang, Peterson, Hill, & Heiman, 2013a). Item misinterpretation led to both overreporting and underreporting of sexual aggression, although underreporting was more common. Men's interpretations of items, decision-making processes, and reasons for producing discrepant reports across measures were analyzed and discussed. Results could help inform efforts to refine self-report measurement of men's sexual aggression.

The Swedish version of the Acceptance of Chronic Health Conditions Scale for people with multiple sclerosis: Translation, cultural adaptation and psychometric properties.

PubMed

Forslin, Mia; Kottorp, Anders; Kierkegaard, Marie; Johansson, Sverker

2016-11-11

To translate and culturally adapt the Acceptance of Chronic Health Conditions (ACHC) Scale for people with multiple sclerosis into Swedish, and to analyse the psychometric properties of the Swedish version. Ten people with multiple sclerosis participated in translation and cultural adaptation of the ACHC Scale; 148 people with multiple sclerosis were included in evaluation of the psychometric properties of the scale. Translation and cultural adaptation were carried out through translation and back-translation, by expert committee evaluation and pre-test with cognitive interviews in people with multiple sclerosis. The psychometric properties of the Swedish version were evaluated using Rasch analysis. The Swedish version of the ACHC Scale was an acceptable equivalent to the original version. Seven of the original 10 items fitted the Rasch model and demonstrated ability to separate between groups. A 5-item version, including 2 items and 3 super-items, demonstrated better psychometric properties, but lower ability to separate between groups. The Swedish version of the ACHC Scale with the original 10 items did not fit the Rasch model. Two solutions, either with 7 items (ACHC-7) or with 2 items and 3 super-items (ACHC-5), demonstrated acceptable psychometric properties. Use of the ACHC-5 Scale with super-items is recommended, since this solution adjusts for local dependency among items.

A comparison of the prevalence of lead-contaminated imported Chinese ceramic dinnerware purchased inside versus outside Philadelphia's Chinatown.

PubMed

Gilmore, Thomas; O'Malley, Gerald F; Lau, Wayne Bond; Vann, David R; Bromberg, Adam; Martin, Aaron; Gibbons, Andrea; Rimmer, Evan

2013-03-01

Lead-contaminated ceramics can be a clinically significant source of lead poisoning, with the potential to cause illness in children and adults; one death in a child has been described. We hypothesized that the prevalence of lead-contaminated ceramics would be higher within Chinatown versus outside of Chinatown. The study was a prospective observational cross-sectional study. Two areas were defined geographically as being within and outside of Philadelphia's Chinatown, and a predefined number of items were purchased in each area. Each item was screened for lead utilizing a colorimetric testing swab. Positive items were leached for lead using the ASTM C738-94 protocol for lead level quantification. The primary outcome was the prevalence of ceramics not compliant with the FDA standard for leachable lead within and outside of Philadelphia's Chinatown. A total of 132 items were purchased, 46 outside of and 86 within Chinatown. More lead-positive items originated within Chinatown than outside of Chinatown [five positive items, 5.8 % prevalence within Chinatown (95 % confidence interval, CI, 2.5-12.9 %), and zero positive, 0 % prevalence outside of Chinatown (95 % CI 0-7.5 %)]. However, this difference was not found to be statistically significant (P = 0.1624). The leachable lead-positive items were up to 40-fold the acceptable FDA levels. Testing a larger number of items may demonstrate a significant source of lead exposure.

Hand assessment in older adults with musculoskeletal hand problems: a reliability study.

PubMed

Myers, Helen L; Thomas, Elaine; Hay, Elaine M; Dziedzic, Krysia S

2011-01-07

Musculoskeletal hand pain is common in the general population. This study aims to investigate the inter- and intra-observer reliability of two trained observers conducting a simple clinical interview and physical examination for hand problems in older adults. The reliability of applying the American College of Rheumatology (ACR) criteria for hand osteoarthritis to community-dwelling older adults will also be investigated. Fifty-five participants aged 50 years and over with a current self-reported hand problem and registered with one general practice were recruited from a previous health questionnaire study. Participants underwent a standardised, structured clinical interview and physical examination by two independent trained observers and again by one of these observers a month later. Agreement beyond chance was summarised using Kappa statistics and intra-class correlation coefficients. Median values for inter- and intra-observer reliability for clinical interview questions were found to be "substantial" and "moderate" respectively [median agreement beyond chance (Kappa) was 0.75 (range: -0.03, 0.93) for inter-observer ratings and 0.57 (range: -0.02, 1.00) for intra-observer ratings]. Inter- and intra-observer reliability for physical examination items was variable, with good reliability observed for some items, such as grip and pinch strength, and poor reliability observed for others, notably assessment of altered sensation, pain on resisted movement and judgements based on observation and palpation of individual features at single joints, such as bony enlargement, nodes and swelling. Moderate agreement was observed both between and within observers when applying the ACR criteria for hand osteoarthritis. Standardised, structured clinical interview is reliable for taking a history in community-dwelling older adults with self reported hand problems. Agreement between and within observers for physical examination items is variable. Low Kappa values may have resulted, in part, from a low prevalence of clinical signs and symptoms in the study participants. The decision to use clinical interview and hand assessment variables in clinical practice or further research in primary care should include consideration of clinical applicability and training alongside reliability. Further investigation is required to determine the relationship between these clinical questions and assessments and the clinical course of hand pain and hand problems in community-dwelling older adults.

Development of an overactive bladder assessment tool (BAT): A potential improvement to the standard bladder diary.

PubMed

Kelleher, Con; Chapple, Christopher; Johnson, Nathan; Payne, Christopher; Homma, Yukio; Hakimi, Zalmai; Siddiqui, Emad; Evans, Christopher; Egan, Shayna; Kopp, Zoe

2018-01-23

To develop a comprehensive patient-reported bladder assessment tool (BAT) for assessing overactive bladder (OAB) symptoms, bother, impacts, and satisfaction with treatment. Subjects were consented and eligibility was confirmed by a recruiting physician; subjects were then scheduled for in-person interviews. For concept elicitation and cognitive interviews, 30 and 20 subjects, respectively, were targeted for recruitment from US sites. All interviews were conducted face-to-face, audio-recorded, transcribed verbatim, anonymized, and analyzed using a qualitative data analysis software program. A draft BAT was created based on the results of the concept elicitation interviews and further revised based on cognitive interviews as well as feedback from an advisory board of clinical and patient-reported outcome (PRO) experts. Nocturia, daytime frequency, and urgency were reported by all subjects (n = 30, 100.0%), and incontinence was reported by most subjects (n = 25, 83.3%). The most frequently reported impacts were waking up to urinate (n = 30, 100.0%), embarrassment/shame (n = 24, 80.0%), stress/anxiety (n = 23, 76.7%), and lack of control (n = 23, 76.7%). Following analysis, item generation, cognitive interviews, and advisory board feedback, the resulting BAT contains four hypothesized domains (symptom frequency, symptom bother, impacts, and satisfaction with treatment) and 17 items with a 7-day recall period. The BAT has been developed in multiple stages with input from both OAB patients and clinical experts following the recommended processes included in the FDA PRO Guidance for Industry. Once fully validated, we believe it will offer a superior alternative to use of the bladder diary and other PROs for monitoring OAB patients in clinical trials and clinical practice. © 2018 Wiley Periodicals, Inc.

Conclusions about children's reporting accuracy for energy and macronutrients over multiple interviews depend on the analytic approach for comparing reported information to reference information.

PubMed

Baxter, Suzanne Domel; Smith, Albert F; Hardin, James W; Nichols, Michele D

2007-04-01

Validation study data are used to illustrate that conclusions about children's reporting accuracy for energy and macronutrients over multiple interviews (ie, time) depend on the analytic approach for comparing reported and reference information-conventional, which disregards accuracy of reported items and amounts, or reporting-error-sensitive, which classifies reported items as matches (eaten) or intrusions (not eaten), and amounts as corresponding or overreported. Children were observed eating school meals on 1 day (n=12), or 2 (n=13) or 3 (n=79) nonconsecutive days separated by >or=25 days, and interviewed in the morning after each observation day about intake the previous day. Reference (observed) and reported information were transformed to energy and macronutrients (ie, protein, carbohydrate, and fat), and compared. For energy and each macronutrient: report rates (reported/reference), correspondence rates (genuine accuracy measures), and inflation ratios (error measures). Mixed-model analyses. Using the conventional approach for analyzing energy and macronutrients, report rates did not vary systematically over interviews (all four P values >0.61). Using the reporting-error-sensitive approach for analyzing energy and macronutrients, correspondence rates increased over interviews (all four P values <0.04), indicating that reporting accuracy improved over time; inflation ratios decreased, although not significantly, over interviews, also suggesting that reporting accuracy improved over time. Correspondence rates were lower than report rates, indicating that reporting accuracy was worse than implied by conventional measures. When analyzed using the reporting-error-sensitive approach, children's dietary reporting accuracy for energy and macronutrients improved over time, but the conventional approach masked improvements and overestimated accuracy. The reporting-error-sensitive approach is recommended when analyzing data from validation studies of dietary reporting accuracy for energy and macronutrients.

Conclusions about children’s reporting accuracy for energy and macronutrients over multiple interviews depend on the analytic approach for comparing reported information to reference information

PubMed Central

Baxter, Suzanne Domel; Smith, Albert F.; Hardin, James W.; Nichols, Michele D.

2008-01-01

Objective Validation-study data are used to illustrate that conclusions about children’s reporting accuracy for energy and macronutrients over multiple interviews (ie, time) depend on the analytic approach for comparing reported and reference information—conventional, which disregards accuracy of reported items and amounts, or reporting-error-sensitive, which classifies reported items as matches (eaten) or intrusions (not eaten), and amounts as corresponding or overreported. Subjects and design Children were observed eating school meals on one day (n = 12), or two (n = 13) or three (n = 79) nonconsecutive days separated by ≥25 days, and interviewed in the morning after each observation day about intake the previous day. Reference (observed) and reported information were transformed to energy and macronutrients (protein, carbohydrate, fat), and compared. Main outcome measures For energy and each macronutrient: report rates (reported/reference), correspondence rates (genuine accuracy measures), inflation ratios (error measures). Statistical analyses Mixed-model analyses. Results Using the conventional approach for analyzing energy and macronutrients, report rates did not vary systematically over interviews (Ps > .61). Using the reporting-error-sensitive approach for analyzing energy and macronutrients, correspondence rates increased over interviews (Ps < .04), indicating that reporting accuracy improved over time; inflation ratios decreased, although not significantly, over interviews, also suggesting that reporting accuracy improved over time. Correspondence rates were lower than report rates, indicating that reporting accuracy was worse than implied by conventional measures. Conclusions When analyzed using the reporting-error-sensitive approach, children’s dietary reporting accuracy for energy and macronutrients improved over time, but the conventional approach masked improvements and overestimated accuracy. Applications The reporting-error-sensitive approach is recommended when analyzing data from validation studies of dietary reporting accuracy for energy and macronutrients. PMID:17383265

Developing a Questionnaire to Evaluate College Students' Knowledge, Attitude, Behavior, Self-efficacy, and Environmental Factors Related to Canned Foods.

PubMed

Richards, Rickelle; Brown, Lora Beth; Williams, D Pauline; Eggett, Dennis L

2017-02-01

Develop a questionnaire to measure students' knowledge, attitude, behavior, self-efficacy, and environmental factors related to the use of canned foods. The Knowledge-Attitude-Behavior Model, Social Cognitive Theory, and Canned Foods Alliance survey were used as frameworks for questionnaire development. Cognitive interviews were conducted with college students (n = 8). Nutrition and survey experts assessed content validity. Reliability was measured via Cronbach α and 2 rounds (1, n = 81; 2, n = 65) of test-retest statistics. Means and frequencies were used. The 65-item questionnaire had a test-retest reliability of .69. Cronbach α scores were .87 for knowledge (9 items), .86 for attitude (30 items), .80 for self-efficacy (12 items), .68 for canned foods use (8 items), and .30 for environment (6 items). A reliable questionnaire was developed to measure perceptions and use of canned foods. Nutrition educators may find this questionnaire useful to evaluate pretest-posttest changes from canned foods-based interventions among college students. Copyright © 2016 Society for Nutrition Education and Behavior. Published by Elsevier Inc. All rights reserved.

Knowledge, attitudes and practices of dental hygienists regarding caries management by risk assessment.

PubMed

Urban, Ruth A; Rowe, Dorothy J

2015-02-01

The purpose of this study was to survey dental hygienists to determine their knowledge, attitudes and practices regarding the implementation of caries risk assessment, particularly caries management by risk assessment (CAMBRA), in private dental practices. A 17 item survey was developed to evaluate dental hygienists' knowledge, attitudes and practices related to CAMBRA and perceived barriers to CAMBRA implementation in private dental practice. Surveys were mailed to a randomized sample of 1,000 dental hygienists licensed to practice in California. Responses were tabulated for each respondent, and the response frequency for each survey item was calculated. Respondents' comments to the open-ended question were compiled, according to themes. The response rate was 18%. Only 66% of the respondents were familiar with the term CAMBRA, although 89% agreed with its underlying principles of risk assessment. CAMBRA protocol had been implemented in 40% of the respondents' employment sites. Respondents disagreed that time (45%) and cost of products (68%) were barriers to implementation. Many did not know their employers' knowledge or attitudes about CAMBRA and its implementation, as evidenced by a "don't know" response range of 29 to 48% for the 4 relevant statements. Respondents' comments included both successes and barriers implementing CAMBRA. CAMBRA protocol has not been widely implemented in private practice, although the current data do not indicate insurmountable barriers. Broader dissemination may be feasible if dental hygienists would obtain more comprehensive knowledge of evidence-based risk assessment protocols and would assume a leadership role in implementing CAMBRA protocols and procedures in private dental practices. Copyright © 2015 The American Dental Hygienists’ Association.

Protocol: the effect of 12 weeks of Tai Chi practice on anxiety in healthy but stressed people compared to exercise and wait-list comparison groups: a randomized controlled trial.

PubMed

Zheng, Shuai; Lal, Sara; Meier, Peter; Sibbritt, David; Zaslawski, Chris

2014-06-01

Stress is a major problem in today's fast-paced society and can lead to serious psychosomatic complications. The ancient Chinese mind-body exercise of Tai Chi may provide an alternative and self-sustaining option to pharmaceutical medication for stressed individuals to improve their coping mechanisms. The protocol of this study is designed to evaluate whether Tai Chi practice is equivalent to standard exercise and whether the Tai Chi group is superior to a wait-list control group in improving stress coping levels. This study is a 6-week, three-arm, parallel, randomized, clinical trial designed to evaluate Tai Chi practice against standard exercise and a Tai Chi group against a nonactive control group over a period of 6 weeks with a 6-week follow-up. A total of 72 healthy adult participants (aged 18-60 years) who are either Tai Chi naïve or have not practiced Tai Chi in the past 12 months will be randomized into a Tai Chi group (n = 24), an exercise group (n = 24) or a wait-list group (n = 24). The primary outcome measure will be the State Trait Anxiety Inventory with secondary outcome measures being the Perceived Stress Scale 14, heart rate variability, blood pressure, Short Form 36 and a visual analog scale. The protocol is reported using the appropriate Standard Protocol Items: Recommendations for Interventional Trials (SPIRIT) items. Copyright © 2014. Published by Elsevier B.V.

Sources of Intrusions in Children’s Dietary Recalls from a Validation Study of Order Prompts

PubMed Central

Baxter, Suzanne Domel; Hardin, James W.; Royer, Julie A.; Smith, Albert F.; Guinn, Caroline H.

2008-01-01

Validation-study data and foodservice production records were analyzed to test hypotheses concerning sources of intrusions (reports of uneaten items) in the school-meal parts of children’s dietary recalls. Each child was observed eating school meals on two days, and interviewed the morning after each observation day; one interview used forward-order (morning-to-evening) and one used reverse-order (evening-to-morning) prompts. Lunch intrusions were likelier to have been available in the foodservice environment at lunch as day before the interview came closer, and on days before than after the interview. Temporal dating errors are contributing sources of intrusions in the school-lunch parts of children’s recalls. PMID:18987088

Schizophrenia research participants' responses to protocol safeguards: recruitment, consent, and debriefing.

PubMed

Roberts, Laura Weiss; Warner, Teddy D; Anderson, Charles T; Smithpeter, Megan V; Rogers, Melinda K

2004-04-01

To examine the perspectives and preferences regarding ethically important aspects of recruitment, consent, and debriefing of people with schizophrenia who volunteered for research protocols. A structured interview to assess research-related views of people with schizophrenia was developed and piloted. Data collection occurred at three sites. For this analysis, we examined the subset of responses from schizophrenia patients currently enrolled in a protocol. Data from 28 schizophrenia research volunteers were analyzed. Of these, 22 were men and 11 were voluntary inpatients. Most (n=23) recalled speaking with someone before enrolling in the protocol, and most (n=26) reported trusting the person who told them about it. Participants reported a moderate understanding of their protocols. All but one person (n=27) remembered signing a consent form. Twenty-one volunteers indicated that consent forms are meant to help both the patient and the researcher. Most (n=23) reported making the enrollment decision alone, with 22 making this decision prior to reviewing the consent form. The decision was described as relatively easy. Respondents felt some pressure to enroll, with women experiencing more pressure. Debriefing practices were strongly endorsed by participants. All 28 of the volunteers wished to be informed if a health problem (i.e., "something wrong") was discovered during the protocol. The persons living with schizophrenia who were interviewed for this project expressed interesting perspectives and preferences regarding ethically important aspects of recruitment, consent, and debriefing in clinical research that may help guide efforts to make research processes more attuned to participants and merit further inquiry.

NADA Protocol for Behavioral Health. Putting Tools in the Hands of Behavioral Health Providers: The Case for Auricular Detoxification Specialists.

PubMed

Stuyt, Elizabeth B; Voyles, Claudia A; Bursac, Sara

2018-02-07

Background: The National Acupuncture Detoxification Association (NADA) protocol, a simple standardized auricular treatment has the potential to provide vast public health relief on issues currently challenging our world. This includes but is not limited to addiction, such as the opioid epidemic, but also encompasses mental health, trauma, PTSD, chronic stress, and the symptoms associated with these conditions. Simple accessible tools that improve outcomes can make profound differences. We assert that the NADA protocol can have greatest impact when broadly applied by behavioral health professionals, Auricular Detoxification Specialists (ADSes). Methods: The concept of ADS is described and how current laws vary from state to state. Using available national data, a survey of practitioners in three selected states with vastly different laws regarding ADSes, and interviews of publicly funded programs which are successfully incorporating the NADA protocol, we consider possible effects of ADS-friendly conditions. Results: Data presented supports the idea that conditions conducive to ADS practice lead to greater implementation. Program interviews reflect settings in which adding ADSes can in turn lead to improved outcomes. Discussion: The primary purpose of non-acupuncturist ADSes is to expand the access of this simple but effective treatment to all who are suffering from addictions, stress, or trauma and to allow programs to incorporate acupuncture in the form of the NADA protocol at minimal cost, when and where it is needed. States that have changed laws to allow ADS practice for this standardized ear acupuncture protocol have seen increased access to this treatment, benefiting both patients and the programs.

Attitudes of physical therapist students toward physical therapist assistants before and after full-time clinical internships.

PubMed

Cavallo, Cheryl L; Richter, Randy R

2004-01-01

Development of attitudes of physical therapists (PTs) toward physical therapist assistants (PTAs) begins during their professional education, and attitudes are influenced further by clinical experiences. The purpose of this study was to understand attitudes of student PTs toward PTAs. We surveyed 66 clinical intern students enrolled in an entry-level master of physical therapy program. PT students received the same survey before and after their full-time clinical internship. Eleven Likert scale items were used to assess students' attitudes toward PTAs in the areas of competence, financial remuneration, and job security. One item was designed to determine whether PT students' level of contact with PTAs influenced attitudes. A random sample of 13 (20.9%) students who returned surveys were asked to participate in a telephone interview designed to enrich the quantitative data. After item analysis, five of the scale items were eliminated from the analyses due to poor internal consistency. Cronbach's alpha of the remaining six scale items was 0.75. Survey results reveal that PT students maintain an overall positive attitude toward PTAs before and after full-time clinical internship. Qualitative interview data support this finding. Students' attitudes in specific areas of PTA competence were negative and positive, however. The negative attitude may have been based on the students' beliefs that PTAs are not competent to perform physical therapy in situations that are changing or unpredictable. Positive attitudes may have been reflective of the students' beliefs that PTAs are competent to implement established plans of care. Student ranking of four professional issues showed a significant difference before and after full-time clinical internships.

The EORTC QLQ-OH17: a supplementary module to the EORTC QLQ-C30 for assessment of oral health and quality of life in cancer patients.

PubMed

Hjermstad, Marianne Jensen; Bergenmar, Mia; Fisher, Sheila E; Montel, Sébastien; Nicolatou-Galitis, Ourania; Raber-Durlacher, Judith; Singer, Susanne; Verdonck-de Leeuw, Irma; Weis, Joachim; Yarom, Noam; Herlofson, Bente B

2012-09-01

Assessment of oral and dental problems is seldom routine in clinical oncology, despite the potential negative impact of these problems on nutritional status, social function and quality of life (QoL). The aim was to develop a supplementary module to the European Organisation for Research and Treatment of Cancer Core Questionnaire (EORTC QLQ-C30) focusing on oral health and related QoL issues in all cancer diagnoses. The module development followed the EORTC guidelines. Phases 1&2 were conducted in France, Germany, Greece, Netherlands, Norway and United Kingdom, while seven countries representing seven languages were included in Phase 3. Eighty-five QoL-items were identified from systematic literature searches. Semi-structured interviews with health-care professionals experienced in oncology and oral/dental care (n=18) and patients (n=133) resulted in a provisional module with 41 items. In phase 3 this was further tested in 178 European patients representing different phases of disease and treatment. Results from the interviews, clinical experiences and statistical analyses resulted in the EORTC QLQ-OH17. The module consists of 17 items conceptualised into four multi-item scales (pain/discomfort, xerostomia, eating, information) and three single items related to use of dentures and future worries. This study provides a useful tool intended for use in conjunction with the EORTC QLQ-C30 for assessment of oral and dental problems. The increased awareness may lead to proper interventions, thereby preventing more serious problems and negative impact on QoL. The reliability and validity, the cross-cultural applicability and the psychometric properties of the module will be tested in a larger international study. Copyright © 2012 Elsevier Ltd. All rights reserved.

A comprehensive questionnaire for the assessment of health-related quality of life in coeliac disease (CDQL).

PubMed

Skjerning, Halfdan; Hourihane, Jonathan; Husby, Steffen; DunnGalvin, Audrey

2017-10-01

Coeliac disease (CD) is a chronic immune-mediated disease in genetically susceptible individuals, induced by ingested gluten. The treatment for CD is a lifelong gluten-free diet (GFD). The GFD involves restrictions in diet that may impact on a person's Health-Related Quality of Life (HRQoL). The aim of the present study was to develop the Coeliac Disease Quality of Life questionnaire (CDQL): a comprehensive CD-specific HRQoL measure that can be completed by children, adolescents, and adults or by proxy. The questionnaire was developed in three phases. In phase 1, focus group methods and qualitative analysis of verbatim transcripts generated CD-specific items for a prototype instrument to sensitively captured patient concerns. In phase 2, CD patients completed the prototype CDQL. The questionnaire was refined through analysis of data and cognitive interviewing. In phase 3, the final version of the CDQL was answered by Danish respondents. The psychometric properties of the CDQL were assessed, and the HRQoL data were analyzed. The CDQL was completed by 422 respondents. The CDQL has 12 patient background items, 2 generic HRQoL items, and 30 CD-specific HRQoL item. The CD-specific HRQoL items were distributed on eight scales with acceptable to excellent reliability. Comprehensiveness and understandability was shown by feedback from cognitive interviewing from children, adolescents, and adults. Content validity was ensured by involving patients and clinicians in the development of the questionnaire. Sensitivity of the questionnaire was demonstrated in differences found between children, adolescents, and adult's perception of their HRQoL in relation to having CD. The CDQL comprehensively measures HRQoL in CD, and is psychometrically robust. The questionnaire may prove useful in tracking HRQoL in CD across age groups.