Interpretation of biological and mechanical variations between the Lowry versus Bradford method for protein quantification.

PubMed

Lu, Tzong-Shi; Yiao, Szu-Yu; Lim, Kenneth; Jensen, Roderick V; Hsiao, Li-Li

2010-07-01

The identification of differences in protein expression resulting from methodical variations is an essential component to the interpretation of true, biologically significant results. We used the Lowry and Bradford methods- two most commonly used methods for protein quantification, to assess whether differential protein expressions are a result of true biological or methodical variations. MATERIAL #ENTITYSTARTX00026; Differential protein expression patterns was assessed by western blot following protein quantification by the Lowry and Bradford methods. We have observed significant variations in protein concentrations following assessment with the Lowry versus Bradford methods, using identical samples. Greater variations in protein concentration readings were observed over time and in samples with higher concentrations, with the Bradford method. Identical samples quantified using both methods yielded significantly different expression patterns on Western blot. We show for the first time that methodical variations observed in these protein assay techniques, can potentially translate into differential protein expression patterns, that can be falsely taken to be biologically significant. Our study therefore highlights the pivotal need to carefully consider methodical approaches to protein quantification in techniques that report quantitative differences.

Values of a Patient and Observer Scar Assessment Scale to Evaluate the Facial Skin Graft Scar

PubMed Central

Chae, Jin Kyung; Kim, Eun Jung; Park, Kun

2016-01-01

Background The patient and observer scar assessment scale (POSAS) recently emerged as a promising method, reflecting both observer's and patient's opinions in evaluating scar. This tool was shown to be consistent and reliable in burn scar assessment, but it has not been tested in the setting of skin graft scar in skin cancer patients. Objective To evaluate facial skin graft scar applied to POSAS and to compare with objective scar assessment tools. Methods Twenty three patients, who diagnosed with facial cutaneous malignancy and transplanted skin after Mohs micrographic surgery, were recruited. Observer assessment was performed by three independent rates using the observer component of the POSAS and Vancouver scar scale (VSS). Patient self-assessment was performed using the patient component of the POSAS. To quantify scar color and scar thickness more objectively, spectrophotometer and ultrasonography was applied. Results Inter-observer reliability was substantial with both VSS and the observer component of the POSAS (average measure intraclass coefficient correlation, 0.76 and 0.80, respectively). The observer component consistently showed significant correlations with patients' ratings for the parameters of the POSAS (all p-values<0.05). The correlation between subjective assessment using POSAS and objective assessment using spectrophotometer and ultrasonography showed low relationship. Conclusion In facial skin graft scar assessment in skin cancer patients, the POSAS showed acceptable inter-observer reliability. This tool was more comprehensive and had higher correlation with patient's opinion. PMID:27746642

Work organization in hospital wards and nurses' emotional exhaustion: A multi-method study of observation-based assessment and nurses' self-reports.

PubMed

Stab, Nicole; Hacker, Winfried; Weigl, Matthias

2016-09-01

Ward organization is a major determinant for nurses' well-being on the job. The majority of previous research on this relationship is based on single source methods, which have been criticized as skewed estimations mainly due to subjectivity of the ratings and due to common source bias. To investigate the association of ward organization characteristics and nurses' exhaustion by combining observation-based assessments with nurses' self-reports. Cross-sectional study on 25 wards of four hospitals and 245 nurses. Our multi-method approach to evaluate hospital ward organization consisted of on-site observations with a standardized assessment tool and of questionnaires to evaluate nurses' self-reports and exhaustion. After establishing the reliability of our measures, we applied multi-level regression analyses to determine associations between determinant and outcome variables. We found substantial convergence in ward organization between the observation-based assessments and nurses' self-reports, which supports the validity of our external assessments. Furthermore, two observation-based characteristics, namely participation and patient-focused care, were significantly associated with lower emotional exhaustion among the nurses. Our results suggest that observation-based assessments are a valid and feasible way to assess ward organization in hospitals. Nurses' self-reported as well as observation-based ratings on ward organization were associated with nurses' emotional exhaustion. This is of interest mainly for identifying alternative measures in evaluating nurses' work environments, to inform health promotion activities and to evaluate job redesign intervention. Copyright © 2016 Elsevier Ltd. All rights reserved.

Early Parental Positive Behavior Support and Childhood Adjustment: Addressing Enduring Questions with New Methods

PubMed Central

Waller, Rebecca; Gardner, Frances; Dishion, Thomas; Sitnick, Stephanie L.; Shaw, Daniel S.; Winter, Charlotte E.; Wilson, Melvin

2016-01-01

A large literature provides strong empirical support for the influence of parenting on child outcomes. The current study addresses enduring research questions testing the importance of early parenting behavior to children’s adjustment. Specifically, we developed and tested a novel multi-method observational measure of parental positive behavior support at age 2. Next, we tested whether early parental positive behavior support was related to child adjustment at school age, within a multi-agent and multi-method measurement approach and design. Observational and parent-reported data from mother–child dyads (N = 731; 49 percent female) were collected from a high-risk sample at age 2. Follow-up data were collected via teacher report and child assessment at age 7.5. The results supported combining three different observational methods to assess positive behavior support at age 2 within a latent factor. Further, parents’ observed positive behavior support at age 2 predicted multiple types of teacher-reported and child-assessed problem behavior and competencies at 7.5 years old. Results supported the validity and predictive capability of a multi-method observational measure of parenting and the importance of a continued focus on the early years within preventive interventions. PMID:26997757

Early Parental Positive Behavior Support and Childhood Adjustment: Addressing Enduring Questions with New Methods.

PubMed

Waller, Rebecca; Gardner, Frances; Dishion, Thomas; Sitnick, Stephanie L; Shaw, Daniel S; Winter, Charlotte E; Wilson, Melvin

2015-05-01

A large literature provides strong empirical support for the influence of parenting on child outcomes. The current study addresses enduring research questions testing the importance of early parenting behavior to children's adjustment. Specifically, we developed and tested a novel multi-method observational measure of parental positive behavior support at age 2. Next, we tested whether early parental positive behavior support was related to child adjustment at school age, within a multi-agent and multi-method measurement approach and design. Observational and parent-reported data from mother-child dyads (N = 731; 49 percent female) were collected from a high-risk sample at age 2. Follow-up data were collected via teacher report and child assessment at age 7.5. The results supported combining three different observational methods to assess positive behavior support at age 2 within a latent factor. Further, parents' observed positive behavior support at age 2 predicted multiple types of teacher-reported and child-assessed problem behavior and competencies at 7.5 years old. Results supported the validity and predictive capability of a multi-method observational measure of parenting and the importance of a continued focus on the early years within preventive interventions.

Video observation of procedural skills for assessment of trabeculectomy performed by residents.

PubMed

Hassanpour, Narges; Chen, Rebecca; Baikpour, Masoud; Moghimi, Sasan

2016-06-01

The efficacy and sufficiency of a healthcare system is directly related to the knowledge and skills of graduates working in the system. In this regard, many different assessment methods have been proposed to evaluate various skills of the learners. Video Observation of Procedural Skills (VOPS) is one newly-proposed method. In this study we aimed to compare the results of the VOPS method with the more commonly used Direct Observation of Procedural Skills (DOPS). In this prospective study conducted in 2012, all 10 ophthalmology residents of post graduate year 4 were selected for participation. Three months into training in the glaucoma ward, these residents performed trabeculectomy surgery on patients, and their procedural skills were assessed in real time by an expert via the DOPS method. All surgeries were also recorded and later evaluated via the VOPS method by an expert. Bland-Altman plot also was used to compare the two methods and calculating the mean and 95% limit of agreement. Residents have been done a mean of 14.9 ± 3.5 (range 10-20) independent trabeculectomy before the assessments. DOPS grade was positively associated with number of independent trabeculectomy during glaucoma rotation (β=0.227, p = 0.004). The intra-observer reproducibility of VOPS measurements was 0.847 (95% CI: 0.634, 0.961). The mean VOPS grade was significantly lower than the mean DOPS grade (8.4 vs. 8.9, p = 0.02). However, a good correlation was observed between the grades of VOPS and DOPS (r = 0.89, p = 0.001). Bland-Altman analysis demonstrated that all data points fell within the 95% limits of agreement (-1.46, 0.46). The present study showed that VOPS might be considered a feasible, valid, and reliable assessment method for procedural skills of medical students and residents that can be used as an alternative to the DOPS method. However, VOPS might underestimate DOPS in evaluating surgical skills of residents.

Live versus Video Observations: Comparing the Reliability and Validity of Two Methods of Assessing Classroom Quality

ERIC Educational Resources Information Center

Curby, Timothy W.; Johnson, Price; Mashburn, Andrew J.; Carlis, Lydia

2016-01-01

When conducting classroom observations, researchers are often confronted with the decision of whether to conduct observations live or by using pre-recorded video. The present study focuses on comparing and contrasting observations of live and video administrations of the Classroom Assessment Scoring System-PreK (CLASS-PreK). Associations between…

Dietary assessment in elderly people: experiences gained from studies in the Netherlands.

PubMed

de Vries, J H M; de Groot, L C P G M; van Staveren, W A

2009-02-01

In selecting a dietary assessment method, several aspects such as the aim of the study and the characteristics of the target population should be taken into account. In elderly people, diminished functionality and cognitive decline may hamper dietary assessment and require tailored approaches to assess dietary intake. The objective of this paper is to summarize our experience in dietary assessment in a number of different studies in population groups over 65 years of age in the Netherlands, and to discuss this experience in the perspective of other nutrition surveys in the elderly. In longitudinal studies, we applied a modified dietary history; in clinical nursing home studies, trained staff observed and recorded food consumption; and in a controlled trial in healthy elderly men, we used a food frequency questionnaire (FFQ). For all methods applied in the community-dwelling elderly people, validation studies showed a similar underestimation of intake of 10-15% compared with the reference value. In the care-depending elderly, the underestimation was less: 5% according to an observational method. The methods varied widely in the resources required, including burden to the participants, field staff and finances. For effective dietary assessment in older adults, the major challenge will be to distinguish between those elderly who are able to respond correctly to the less intensive methods, such as 24-h recalls or FFQ, and those who are not able to respond to these methods and require adapted techniques, for example, observational records.

Appraising the reliability of visual impact assessment methods

Treesearch

Nickolaus R. Feimer; Kenneth H. Craik; Richard C. Smardon; Stephen R.J. Sheppard

1979-01-01

This paper presents the research approach and selected results of an empirical investigation aimed at the evaluation of selected observer-based visual impact assessment (VIA) methods. The VIA methods under examination were chosen to cover a range of VIA methods currently in use in both applied and research settings. Variation in three facets of VIA methods were...

Personality Stability from Childhood to Midlife: Relating Teachers' Assessments in Elementary School to Observer- and Self-Ratings 40 Years Later.

PubMed

Edmonds, Grant W; Goldberg, Lewis R; Hampson, Sarah E; Barckley, Maureen

2013-10-01

We report on the longitudinal stability of personality traits across an average 40 years in the Hawaii Personality and Health Cohort relating childhood teacher assessments of personality to adult self- and observer- reports. Stabilities based on self-ratings in adulthood were compared to those measured by the Structured Interview for the Five-Factor Model (SIFFM; Trull & Widiger, 1997), and trait ratings completed by interviewers. Although convergence between self-reports and observer-ratings was modest, childhood traits demonstrated similar levels of stability across methods in adulthood. Extraversion and Conscientiousness generally showed higher stabilities, whereas Neuroticism showed none. For Agreeableness and Intellect/Openness, stability was highest when assessed with observer-ratings. These findings are discussed in terms of differences in trait evaluativeness and observability across measurement methods.

Personality Stability from Childhood to Midlife: Relating Teachers’ Assessments in Elementary School to Observer- and Self-Ratings 40 Years Later

PubMed Central

Edmonds, Grant W.; Goldberg, Lewis R.; Hampson, Sarah E.; Barckley, Maureen

2013-01-01

We report on the longitudinal stability of personality traits across an average 40 years in the Hawaii Personality and Health Cohort relating childhood teacher assessments of personality to adult self- and observer- reports. Stabilities based on self-ratings in adulthood were compared to those measured by the Structured Interview for the Five-Factor Model (SIFFM; Trull & Widiger, 1997), and trait ratings completed by interviewers. Although convergence between self-reports and observer-ratings was modest, childhood traits demonstrated similar levels of stability across methods in adulthood. Extraversion and Conscientiousness generally showed higher stabilities, whereas Neuroticism showed none. For Agreeableness and Intellect/Openness, stability was highest when assessed with observer-ratings. These findings are discussed in terms of differences in trait evaluativeness and observability across measurement methods. PMID:24039315

Inventory versus Checklist Approach to Assess Middle School a la Carte Food Availability

ERIC Educational Resources Information Center

Hearst, Mary O.; Lytle, Leslie A.; Pasch, Keryn E.; Heitzler, Carrie D.

2009-01-01

Background: The purpose of this research is to evaluate 2 methods of assessing foods available on school a la carte lines for schools' ability to assess the proportion of foods that are healthful options. Methods: This observational study used data collected at 38 middle schools, October 2006-May 2007. An inventory method was used to collect…

Baseline estimation from simultaneous satellite laser tracking

NASA Technical Reports Server (NTRS)

Dedes, George C.

1987-01-01

Simultaneous Range Differences (SRDs) to Lageos are obtained by dividing the observing stations into pairs with quasi-simultaneous observations. For each of those pairs the station with the least number of observations is identified, and at its observing epochs interpolated ranges for the alternate station are generated. The SRD observables are obtained by subtracting the actually observed laser range of the station having the least number of observations from the interpolated ranges of the alternate station. On the basis of these observables semidynamic single baseline solutions were performed. The aim of these solutions is to further develop and implement the SRD method in the real data environment, to assess its accuracy, its advantages and disadvantages as related to the range dynamic mode methods, when the baselines are the only parameters of interest. Baselines, using simultaneous laser range observations to Lageos, were also estimated through the purely geometric method. These baselines formed the standards the standards of comparison in the accuracy assessment of the SRD method when compared to that of the range dynamic mode methods. On the basis of this comparison it was concluded that for baselines of regional extent the SRD method is very effective, efficient, and at least as accurate as the range dynamic mode methods, and that on the basis of a simple orbital modeling and a limited orbit adjustment. The SRD method is insensitive to the inconsistencies affecting the terrestrial reference frame and simultaneous adjustment of the Earth Rotation Parameters (ERPs) is not necessary.

Quantitative Assessment of Knee Progression Angle During Gait in Children With Cerebral Palsy.

PubMed

Davids, Jon R; Cung, Nina Q; Pomeroy, Robin; Schultz, Brooke; Torburn, Leslie; Kulkarni, Vedant A; Brown, Sean; Bagley, Anita M

2018-04-01

Abnormal hip rotation is a common deviation in children with cerebral palsy (CP). Clinicians typically assess hip rotation during gait by observing the direction that the patella points relative to the path of walking, which is referred to as the knee progression angle (KPA). Two kinematic methods for calculating the KPA are compared with each other. Video-based qualitative assessment of KPA is compared with the quantitative methods to determine reliability and validity. The KPA was calculated by both direct and indirect methods for 32 typically developing (TD) children and a convenience cohort of 43 children with hemiplegic type CP. An additional convenience cohort of 26 children with hemiplegic type CP was selected for qualitative assessment of KPA, performed by 3 experienced clinicians, using 3 categories (internal, >10 degrees; neutral, -10 to 10 degrees; and external, >-10 degrees). Root mean square (RMS) analysis comparing the direct and indirect KPAs was 1.14+0.43 degrees for TD children, and 1.75+1.54 degrees for the affected side of children with CP. The difference in RMS among the 2 groups was statistically, but not clinically, significant (P=0.019). Intraclass correlation coefficient revealed excellent agreement between the direct and indirect methods of KPA for TD and CP children (0.996 and 0.992, respectively; P<0.001).For the qualitative assessment of KPA there was complete agreement among all examiners for 17 of 26 cases (65%). Direct KPA matched for 49 of 78 observations (63%) and indirect KPA matched for 52 of 78 observations (67%). The RMS analysis of direct and indirect methods for KPA was statistically but not clinically significant, which supports the use of either method based upon availability. Video-based qualitative assessment of KPA showed moderate reliability and validity. The differences between observed and calculated KPA indicate the need for caution when relying on visual assessments for clinical interpretation, and demonstrate the value of adding KPA calculation to standard kinematic analysis. Level II-diagnostic test.

The Effects of Three Methods of Observation on Couples in Interactional Research.

ERIC Educational Resources Information Center

Carpenter, Linda J.; Merkel, William T.

1988-01-01

Assessed the effects of three different methods of observation of couples (one-way mirror, audio recording, and video recording) on 30 volunteer, nonclinical married couples. Results suggest that types of observation do not produce significantly different effects on nonclinical couples. (Author/ABL)

Evaluation of nursing faculty through observation.

PubMed

Crawford, L H

1998-10-01

The purpose of this study was to assess current use and faculty perceptions of classroom observation as a method of faculty evaluation in schools of nursing. Baccalaureate schools of nursing were surveyed to determine current use of classroom observation and its worth from the perception of administrators and faculty. Although most schools used classroom observation as a method of faculty evaluation, further clarification and research is needed in the following areas: purpose of classroom observation; number of observations necessary; weight given to classroom observation in relation to other evaluation methods; and tools used.

Method of assessing parent-child grocery store purchasing interactions using a micro-camcorder.

PubMed

Calloway, Eric E; Roberts-Gray, Cindy; Ranjit, Nalini; Sweitzer, Sara J; McInnis, Katie A; Romo-Palafox, Maria J; Briley, Margaret E

2014-12-01

The purpose of this study was to assess the validity of using participant worn micro-camcorders (PWMC) to collect data on parent-child food and beverage purchasing interactions in the grocery store. Parent-child dyads (n = 32) were met at their usual grocery store and shopping time. Parents were mostly Caucasian (n = 27, 84.4%), mothers (n = 30, 93.8%). Children were 2-6 years old with 15 girls and 17 boys. A micro-camcorder was affixed to a baseball style hat worn by the child. The dyad proceeded to shop while being shadowed by an in-person observer. Video/audio data were coded for behavioral and environmental variables. The PWMC method was compared to in-person observation to assess sensitivity and relative validity for measuring parent-child interactions, and compared to receipt data to assess criterion validity for evaluating purchasing decisions. Inter-rater reliability for coding video/audio data collected using the PWMC method was also assessed. The PWMC method proved to be more sensitive than in-person observation revealing on average 1.4 (p < 0.01) more parent-child food and beverage purchasing interactions per shopping trip. Inter-rater reliability for coding PWMC data showed moderate to almost perfect agreement (Cohen's kappa = 0.461-0.937). The PWMC method was significantly correlated with in-person observation for measuring occurrences of parent-child food purchasing interactions (rho = 0.911, p < 0.01) and characteristics of those interactions (rho = 0.345-0.850, p < 0.01). Additionally, there was substantial agreement between the PWMC method and receipt data for measuring purchasing decisions (Cohen's kappa = 0.787). The PWMC method proved to be well suited to assess parent-child food and beverage purchasing interactions in the grocery store. Copyright © 2014 Elsevier Ltd. All rights reserved.

A Review of Observational Pain Scales in Nonverbal Elderly with Cognitive Impairments

ERIC Educational Resources Information Center

Park, Juyoung; Castellanos-Brown, Karen; Belcher, John

2010-01-01

Objective: Pain assessment for nonverbal older adults with cognitive impairments or dementia presents many challenges, and it is important to determine which scales are most useful in assessing pain among this population. Method: In this review 11 observational scales for assessment of pain in older adults with dementia or cognitive impairments…

Interdisciplinary research on patient-provider communication: a cross-method comparison.

PubMed

Chou, Wen-Ying Sylvia; Han, Paul; Pilsner, Alison; Coa, Kisha; Greenberg, Larrie; Blatt, Benjamin

2011-01-01

Patient-provider communication, a key aspect of healthcare delivery, has been assessed through multiple methods for purposes of research, education, and quality control. Common techniques include satisfaction ratings and quantitatively- and qualitatively-oriented direct observations. Identifying the strengths and weaknesses of different approaches is critically important in determining the appropriate assessment method for a specific research or practical goal. Analyzing ten videotaped simulated encounters between medical students and Standardized Patients (SPs), this study compared three existing assessment methods through the same data set. Methods included: (1) dichotomized SP ratings on students' communication skills; (2) Roter Interaction Analysis System (RIAS) analysis; and (3) inductive discourse analysis informed by sociolinguistic theories. The large dichotomous contrast between good and poor ratings in (1) was not evidenced in any of the other methods. Following a discussion of strengths and weaknesses of each approach, we pilot-tested a combined assessment done by coders blinded to results of (1)-(3). This type of integrative approach has the potential of adding a quantifiable dimension to qualitative, discourse-based observations. Subjecting the same data set to separate analytic methods provides an excellent opportunity for methodological comparisons with the goal of informing future assessment of clinical encounters.

Development and Initial Testing of a Structured Clinical Observation Tool to Assess Pharmacotherapy Competence

ERIC Educational Resources Information Center

Young, John Q.; Lieu, Sandra; O'Sullivan, Patricia; Tong, Lowell

2011-01-01

Objective: The authors developed and tested the feasibility and utility of a new direct-observation instrument to assess trainee performance of a medication management session. Methods: The Psychopharmacotherapy-Structured Clinical Observation (P-SCO) instrument was developed based on multiple sources of expertise and then implemented in 4…

Systematic review of methods for quantifying teamwork in the operating theatre

PubMed Central

Marshall, D.; Sykes, M.; McCulloch, P.; Shalhoub, J.; Maruthappu, M.

2018-01-01

Background Teamwork in the operating theatre is becoming increasingly recognized as a major factor in clinical outcomes. Many tools have been developed to measure teamwork. Most fall into two categories: self‐assessment by theatre staff and assessment by observers. A critical and comparative analysis of the validity and reliability of these tools is lacking. Methods MEDLINE and Embase databases were searched following PRISMA guidelines. Content validity was assessed using measurements of inter‐rater agreement, predictive validity and multisite reliability, and interobserver reliability using statistical measures of inter‐rater agreement and reliability. Quantitative meta‐analysis was deemed unsuitable. Results Forty‐eight articles were selected for final inclusion; self‐assessment tools were used in 18 and observational tools in 28, and there were two qualitative studies. Self‐assessment of teamwork by profession varied with the profession of the assessor. The most robust self‐assessment tool was the Safety Attitudes Questionnaire (SAQ), although this failed to demonstrate multisite reliability. The most robust observational tool was the Non‐Technical Skills (NOTECHS) system, which demonstrated both test–retest reliability (P > 0·09) and interobserver reliability (Rwg = 0·96). Conclusion Self‐assessment of teamwork by the theatre team was influenced by professional differences. Observational tools, when used by trained observers, circumvented this.

An Improved Version of the Cervical Vertebral Maturation (CVM) Method for the Assessment of Mandibular Growth in Deutero-Malay Sub Race

NASA Astrophysics Data System (ADS)

Oscandar, Fahmi; Malinda, Yuti; Azhari, H.; Murniati, Nani; Yeh Ong, Sing; Subiyanto; Supian, Sudradjat

2018-01-01

In this paper, Cervical Vertebral Maturation method was used to assess the mandibular growth in Deutero-Malay sub race. Twenty eight laterals Cephalometric radiographs of Deutero-Malay sub race aged 9-15 were observed. The observation used stratified random sampling by measuring the quantitative and qualitative assessment of the 2nd through 4th cervical vertebra of the subjects. It produced the diagram of developmental stages of cervical vertebrae for Deutero-Malay sub race. The diagram can be used to determine mandibular growth in term of qualitative by matching the shape of cervical vertebrae. It was obtained that the Cervical Vertebral Maturation method can be used to assess mandibular growth in Deutero-Malay sub race by matching the shape of cervical vertebrae to the diagram of developmental stages of cervical vertebrae. In addition, Cervical Vertebral Maturation method can be used to identification person’s age.

Development and reliability of an observation method to assess food intake of young children in child care.

PubMed

Ball, Sarah C; Benjamin, Sara E; Ward, Dianne S

2007-04-01

To our knowledge, a direct observation protocol for assessing dietary intake among young children in child care has not been published. This article reviews the development and testing of a diet observation system for child care facilities that occurred during a larger intervention trial. Development of this system was divided into five phases, done in conjunction with a larger intervention study; (a) protocol development, (b) training of field staff, (c) certification of field staff in a laboratory setting, (d) implementation in a child-care setting, and (e) certification of field staff in a child-care setting. During the certification phases, methods were used to assess the accuracy and reliability of all observers at estimating types and amounts of food and beverages commonly served in child care. Tests of agreement show strong agreement among five observers, as well as strong accuracy between the observers and 20 measured portions of foods and beverages with a mean intraclass correlation coefficient value of 0.99. This structured observation system shows promise as a valid and reliable approach for assessing dietary intake of children in child care and makes a valuable contribution to the growing body of literature on the dietary assessment of young children.

Informal caregivers and detection of delirium in postacute care: a correlational study of the confusion assessment method (CAM), confusion assessment method-family assessment method (CAM-FAM) and DSM-IV criteria.

PubMed

Flanagan, Nina M; Spencer, Gale

2016-09-01

Delirium is a common, serious and potentially life-threatening syndrome affecting older adults. This syndrome continues to be under-recognised and under treated by healthcare professionals across all care settings. Older adults who develop delirium have poorer outcomes, higher mortality and higher care costs. The purposes of this study were to correlate the confusion assessment method-family assessment method and confusion assessment method in the detection of delirium in postacute care, to correlate the confusion assessment method-family assessment method and diagnostic and statistical manual of mental disorders text revision criteria in detection of delirium in postacute care, to determine the prevalence of delirium in postacute care elders and to describe the relationship of level of cognitive impairment and delirium in the postacute care setting. Implications for Practice Delirium is disturbing for patients and caregivers. Frequently . family members want to provide information about their loved one. The use of the CAM-FAM and CAM can give a more definitive determination of baseline status. Frequent observations using both instruments may lead to better recognition of delirium and implementation of interventions to prevent lasting sequelae. Descriptive studies determined the strengths of relationship between the confusion assessment method, confusion assessment method-family assessment method, Mini-Cog and diagnostic and statistical manual of mental disorders text revision criteria in detection of delirium in the postacute care setting. Prevalence of delirium in this study was 35%. The confusion assessment method-family assessment method highly correlates with the confusion assessment method and diagnostic and statistical manual of mental disorders text revision criteria for detecting delirium in older adults in the postacute care setting. Persons with cognitive impairment are more likely to develop delirium. Family members recognise symptoms of delirium when asked. The confusion assessment method-family assessment method is a valid tool for detection of delirium. Delirium is disturbing for patients and caregivers. Frequently. family members want to provide information about their loved one. The use of the CAM-FAM and CAM can give a more definitive determination of baseline status. Frequent observations using both instruments may lead to better recognition of delirium and implementation of interventions to prevent lasting sequelae. © 2015 John Wiley & Sons Ltd.

Can we rely on simulated patients' satisfaction with their consultation for assessing medical students' communication skills? A cross-sectional study.

PubMed

Gude, T; Grimstad, H; Holen, A; Anvik, T; Baerheim, A; Fasmer, O B; Hjortdahl, P; Vaglum, P

2015-12-18

In medical education, teaching methods offering intensive practice without high utilization of faculty resources are needed. We investigated whether simulated patients' (SPs') satisfaction with a consultation could predict professional observers' assessment of young doctors' communication skills. This was a comparative cross-sectional study of 62 videotaped consultations in a general practice setting with young doctors who were finishing their internship. The SPs played a female patient who had observed blood when using the toilet, which had prompted a fear of cancer. Immediately afterwards, the SP rated her level of satisfaction with the consultation, and the scores were dichotomized into satisfaction or dissatisfaction. Professional observers viewed the videotapes and assessed the doctors' communication skills using the Arizona Communication Interview Rating Scale (ACIR). Their ratings of communication skills were dichotomized into acceptable versus unacceptable levels of competence. The SPs' satisfaction showed a predictive power of 0.74 for the observers' assessment of the young doctors and whether they reached an acceptable level of communication skills. The SPs' dissatisfaction had a predictive power of 0.71 for the observers' assessment of an unacceptable communication level. The two assessment methods differed in 26% of the consultations. When SPs felt relief about their cancer concern after the consultation, they assessed the doctors' skills as satisfactory independent of the observers' assessment. Accordance between the dichotomized SPs' satisfaction score and communication skills assessed by observers (using the ACIR) was in the acceptable range. These findings suggest that SPs' satisfaction scores may provide a reliable source for assessing communication skills in educational programs for medical trainees (students and young doctors). Awareness of the patient's concerns seems to be of vital importance to patient satisfaction.

The Electronically Activated Recorder (EAR): A Method for the Naturalistic Observation of Daily Social Behavior

PubMed Central

Mehl, Matthias R.

2016-01-01

This article reviews the Electronically Activated Recorder or EAR as an ambulatory ecological momentary assessment tool for the real-world observation of daily behavior. Technically, the EAR is an audio recorder that intermittently records snippets of ambient sounds while participants go about their lives. Conceptually, it is a naturalistic observation method that yields an acoustic log of a person’s day as it unfolds. The power of the EAR lies in unobtrusively collecting authentic real-life observational data. In preserving a high degree of naturalism at the level of the raw recordings, it resembles ethnographic methods; through its sampling and coding, it enables larger empirical studies. The article provides an overview of the EAR method, reviews its validity, utility, and limitations, and discusses it in the context of current developments in ambulatory assessment, specifically the emerging field of mobile sensing. PMID:28529411

The Electronically Activated Recorder (EAR): A Method for the Naturalistic Observation of Daily Social Behavior.

PubMed

Mehl, Matthias R

2017-04-01

This article reviews the Electronically Activated Recorder or EAR as an ambulatory ecological momentary assessment tool for the real-world observation of daily behavior. Technically, the EAR is an audio recorder that intermittently records snippets of ambient sounds while participants go about their lives. Conceptually, it is a naturalistic observation method that yields an acoustic log of a person's day as it unfolds. The power of the EAR lies in unobtrusively collecting authentic real-life observational data. In preserving a high degree of naturalism at the level of the raw recordings, it resembles ethnographic methods; through its sampling and coding, it enables larger empirical studies. The article provides an overview of the EAR method, reviews its validity, utility, and limitations, and discusses it in the context of current developments in ambulatory assessment, specifically the emerging field of mobile sensing.

Comparing multiple statistical methods for inverse prediction in nuclear forensics applications

DOE PAGES

Lewis, John R.; Zhang, Adah; Anderson-Cook, Christine Michaela

2017-10-29

Forensic science seeks to predict source characteristics using measured observables. Statistically, this objective can be thought of as an inverse problem where interest is in the unknown source characteristics or factors ( X) of some underlying causal model producing the observables or responses (Y = g ( X) + error). Here, this paper reviews several statistical methods for use in inverse problems and demonstrates that comparing results from multiple methods can be used to assess predictive capability. Motivation for assessing inverse predictions comes from the desired application to historical and future experiments involving nuclear material production for forensics research inmore » which inverse predictions, along with an assessment of predictive capability, are desired.« less

Comparing multiple statistical methods for inverse prediction in nuclear forensics applications

DOE Office of Scientific and Technical Information (OSTI.GOV)

Lewis, John R.; Zhang, Adah; Anderson-Cook, Christine Michaela

Forensic science seeks to predict source characteristics using measured observables. Statistically, this objective can be thought of as an inverse problem where interest is in the unknown source characteristics or factors ( X) of some underlying causal model producing the observables or responses (Y = g ( X) + error). Here, this paper reviews several statistical methods for use in inverse problems and demonstrates that comparing results from multiple methods can be used to assess predictive capability. Motivation for assessing inverse predictions comes from the desired application to historical and future experiments involving nuclear material production for forensics research inmore » which inverse predictions, along with an assessment of predictive capability, are desired.« less

75 FR 13515 - Office of Innovation and Improvement (OII); Overview Information; Ready-to-Learn Television...

Federal Register 2010, 2011, 2012, 2013, 2014

2010-03-22

... on rigorous scientifically based research methods to assess the effectiveness of a particular... activities and programs; and (B) Includes research that-- (i) Employs systematic, empirical methods that draw... or observational methods that provide reliable and valid data across evaluators and observers, across...

Observation procedure, observer gender, and behavior valence as determinants of sampling error in a behavior assessment analogue

PubMed Central

Farkas, Gary M.; Tharp, Roland G.

1980-01-01

Several factors thought to influence the representativeness of behavioral assessment data were examined in an analogue study using a multifactorial design. Systematic and unsystematic methods of observing group behavior were investigated using 18 male and 18 female observers. Additionally, valence properties of the observed behaviors were inspected. Observers' assessments of a videotape were compared to a criterion code that defined the population of behaviors. Results indicated that systematic observation procedures were more accurate than unsystematic procedures, though this factor interacted with gender of observer and valence of behavior. Additionally, males tended to sample more representatively than females. A third finding indicated that the negatively valenced behavior was overestimated, whereas the neutral and positively valenced behaviors were accurately assessed. PMID:16795631

Validation of personal digital photography to assess dietary quality among people with intellectual disabilities.

PubMed

Elinder, L S; Brunosson, A; Bergström, H; Hagströmer, M; Patterson, E

2012-02-01

Dietary assessment is a challenge in general, and specifically in individuals with intellectual disabilities (ID). This study aimed to evaluate personal digital photography as a method of assessing different aspects of dietary quality in this target group. Eighteen adults with ID were recruited from community residences and activity centres in Stockholm County. Participants were instructed to photograph all foods and beverages consumed during 1 day, while observed. Photographs were coded by two raters. Observations and photographs of meal frequency, intake occasions of four specific food and beverage items, meal quality and dietary diversity were compared. Evaluation of inter-rater reliability and validity of the method was performed by intra-class correlation analysis. With reminders from staff, 85% of all observed eating or drinking occasions were photographed. The inter-rater reliability was excellent for all assessed variables (ICC ≥ 0.88), except for meal quality where ICC was 0.66. The correlations between items assessed in photos and observations were strong to almost perfect with ICC values ranging from 0.71 to 0.92 and all were statistically significant. Personal digital photography appears to be a feasible, reliable and valid method for assessing dietary quality in people with mild to moderate ID, who have daily staff support. © 2011 The Authors. Journal of Intellectual Disability Research © 2011 Blackwell Publishing Ltd.

Quality improvement in multidisciplinary cancer teams: an investigation of teamwork and clinical decision-making and cross-validation of assessments.

PubMed

Lamb, B W; Sevdalis, N; Mostafid, H; Vincent, C; Green, J S A

2011-12-01

Teamworking and clinical decision-making are important in multidisciplinary cancer teams (MDTs). Our objective is to assess the quality of information presentation and MDT members' contribution to decision-making via expert observation and self-report, aiming to cross-validate the two methods and assess the insight of MDT members into their own team performance. Behaviors were scored using (i) a validated observational tool employing Likert scales with objective anchors, and (ii) a 29-question online self-report tool. Data were collected from observation of 164 cases in five MDTs, and 47 surveys from MDT members (response rate 70%). Presentation of information (case history, radiological, pathological, comorbidities, psychosocial, and patients' views) and quality of contribution to decision-making of MDT members (surgeons, oncologists, radiologists, pathologists, nurses, and MDT coordinators) were analyzed via descriptive statistics and the Jonckheere-Terpstra test. Correlation between observational and self-report assessments was assessed with Spearman's correlations. Quality of information presentation: Case histories and radiology information rated highest; patients' views and comorbidities/psychosocial issues rated lowest (observed: Z = 14.80, P ≤ 0.001; self-report: Z = 3.70, P < 0.001). Contribution to decision-making: Surgeons and oncologists rated highest, nurses and MDT coordinators rated lowest, and others in between (observed: Z = 20.00, P ≤ 0.001; self-report: Z = 8.10, P < 0.001). Correlations between observational and self-report assessments: Median Spearman's rho = 0.74 (range = 0.66-0.91; P < 0.05). The quality of teamworking and clinical decision-making in MDTs can reliably be assessed using observational and self-report metrics. MDT members have good insight into their own team performance. Such robust assessment methods could provide the basis of a toolkit for MDT team evaluation and improvement.

Becoming a Reflective Mathematics Teacher: A Guide for Observations and Self-Assessment. Studies in Mathematical Thinking and Learning Series.

ERIC Educational Resources Information Center

Artzt, Alice F.; Armour-Thomas, Eleanor

This activity-oriented book for preservice mathematics teachers who are taking methods courses or who have been student teaching offers a framework for teacher reflection and self- assessment. It supplies detailed observation instruments for observing other teachers, reflective activities, and guidelines and instruments for supervisors. There are…

High-frequency video capture and a computer program with frame-by-frame angle determination functionality as tools that support judging in artistic gymnastics.

PubMed

Omorczyk, Jarosław; Nosiadek, Leszek; Ambroży, Tadeusz; Nosiadek, Andrzej

2015-01-01

The main aim of this study was to verify the usefulness of selected simple methods of recording and fast biomechanical analysis performed by judges of artistic gymnastics in assessing a gymnast's movement technique. The study participants comprised six artistic gymnastics judges, who assessed back handsprings using two methods: a real-time observation method and a frame-by-frame video analysis method. They also determined flexion angles of knee and hip joints using the computer program. In the case of the real-time observation method, the judges gave a total of 5.8 error points with an arithmetic mean of 0.16 points for the flexion of the knee joints. In the high-speed video analysis method, the total amounted to 8.6 error points and the mean value amounted to 0.24 error points. For the excessive flexion of hip joints, the sum of the error values was 2.2 error points and the arithmetic mean was 0.06 error points during real-time observation. The sum obtained using frame-by-frame analysis method equaled 10.8 and the mean equaled 0.30 error points. Error values obtained through the frame-by-frame video analysis of movement technique were higher than those obtained through the real-time observation method. The judges were able to indicate the number of the frame in which the maximal joint flexion occurred with good accuracy. Using the real-time observation method as well as the high-speed video analysis performed without determining the exact angle for assessing movement technique were found to be insufficient tools for improving the quality of judging.

Comparison of ergonomic risk assessment outputs from rapid entire body assessment and quick exposure check in an engine oil company.

PubMed

Motamedzade, Majid; Ashuri, Mohammad Reza; Golmohammadi, Rostam; Mahjub, Hossein

2011-06-13

During the last decades, to assess the risk factors of work-related musculoskeletal disorders (WMSDs), enormous observational methods have been developed. Rapid Entire Body Assessment (REBA) and Quick Exposure Check (QEC) are two general methods in this field. This study aimed to compare ergonomic risk assessment outputs from QEC and REBA in terms of agreement in distribution of postural loading scores based on analysis of working postures. This cross-sectional study was conducted in an engine oil company in which 40 jobs were studied. All jobs were observed by a trained occupational health practitioner. Job information was collected to ensure the completion of ergonomic risk assessment tools, including QEC, and REBA. The result revealed that there was a significant correlation between final scores (r=0.731) and the action levels (r =0.893) of two applied methods. Comparison between the action levels and final scores of two methods showed that there was no significant difference among working departments. Most of studied postures acquired low and moderate risk level in QEC assessment (low risk=20%, moderate risk=50% and High risk=30%) and in REBA assessment (low risk=15%, moderate risk=60% and high risk=25%). There is a significant correlation between two methods. They have a strong correlation in identifying risky jobs, and determining the potential risk for incidence of WMSDs. Therefore, there is possibility for researchers to apply interchangeably both methods, for postural risk assessment in appropriate working environments.

A Reliable, Feasible Method to Observe Neighborhoods at High Spatial Resolution

PubMed Central

Kepper, Maura M.; Sothern, Melinda S.; Theall, Katherine P.; Griffiths, Lauren A.; Scribner, Richard; Tseng, Tung-Sung; Schaettle, Paul; Cwik, Jessica M.; Felker-Kantor, Erica; Broyles, Stephanie T.

2016-01-01

Introduction Systematic social observation (SSO) methods traditionally measure neighborhoods at street level and have been performed reliably using virtual applications to increase feasibility. Research indicates that collection at even higher spatial resolution may better elucidate the health impact of neighborhood factors, but whether virtual applications can reliably capture social determinants of health at the smallest geographic resolution (parcel level) remains uncertain. This paper presents a novel, parcel-level SSO methodology and assesses whether this new method can be collected reliably using Google Street View and is feasible. Methods Multiple raters (N=5) observed 42 neighborhoods. In 2016, inter-rater reliability (observed agreement and kappa coefficient) was compared for four SSO methods: (1) street-level in person; (2) street-level virtual; (3) parcel-level in person; and (4) parcel-level virtual. Intra-rater reliability (observed agreement and kappa coefficient) was calculated to determine whether parcel-level methods produce results comparable to traditional street-level observation. Results Substantial levels of inter-rater agreement were documented across all four methods; all methods had >70% of items with at least substantial agreement. Only physical decay showed higher levels of agreement (83% of items with >75% agreement) for direct versus virtual rating source. Intra-rater agreement comparing street- versus parcel-level methods resulted in observed agreement >75% for all but one item (90%). Conclusions Results support the use of Google Street View as a reliable, feasible tool for performing SSO at the smallest geographic resolution. Validation of a new parcel-level method collected virtually may improve the assessment of social determinants contributing to disparities in health behaviors and outcomes. PMID:27989289

A stepwedge-based method for measuring breast density: observer variability and comparison with human reading

NASA Astrophysics Data System (ADS)

Diffey, Jenny; Berks, Michael; Hufton, Alan; Chung, Camilla; Verow, Rosanne; Morrison, Joanna; Wilson, Mary; Boggis, Caroline; Morris, Julie; Maxwell, Anthony; Astley, Susan

2010-04-01

Breast density is positively linked to the risk of developing breast cancer. We have developed a semi-automated, stepwedge-based method that has been applied to the mammograms of 1,289 women in the UK breast screening programme to measure breast density by volume and area. 116 images were analysed by three independent operators to assess inter-observer variability; 24 of these were analysed on 10 separate occasions by the same operator to determine intra-observer variability. 168 separate images were analysed using the stepwedge method and by two radiologists who independently estimated percentage breast density by area. There was little intra-observer variability in the stepwedge method (average coefficients of variation 3.49% - 5.73%). There were significant differences in the volumes of glandular tissue obtained by the three operators. This was attributed to variations in the operators' definition of the breast edge. For fatty and dense breasts, there was good correlation between breast density assessed by the stepwedge method and the radiologists. This was also observed between radiologists, despite significant inter-observer variation. Based on analysis of thresholds used in the stepwedge method, radiologists' definition of a dense pixel is one in which the percentage of glandular tissue is between 10 and 20% of the total thickness of tissue.

Stereological Analysis of Liver Biopsy Histology Sections as a Reference Standard for Validating Non-Invasive Liver Fat Fraction Measurements by MRI

PubMed Central

St. Pierre, Tim G.; House, Michael J.; Bangma, Sander J.; Pang, Wenjie; Bathgate, Andrew; Gan, Eng K.; Ayonrinde, Oyekoya T.; Bhathal, Prithi S.; Clouston, Andrew; Olynyk, John K.; Adams, Leon A.

2016-01-01

Background and Aims Validation of non-invasive methods of liver fat quantification requires a reference standard. However, using standard histopathology assessment of liver biopsies is problematical because of poor repeatability. We aimed to assess a stereological method of measuring volumetric liver fat fraction (VLFF) in liver biopsies and to use the method to validate a magnetic resonance imaging method for measurement of VLFF. Methods VLFFs were measured in 59 subjects (1) by three independent analysts using a stereological point counting technique combined with the Delesse principle on liver biopsy histological sections and (2) by three independent analysts using the HepaFat-Scan® technique on magnetic resonance images of the liver. Bland Altman statistics and intraclass correlation (IC) were used to assess the repeatability of each method and the bias between the methods of liver fat fraction measurement. Results Inter-analyst repeatability coefficients for the stereology and HepaFat-Scan® methods were 8.2 (95% CI 7.7–8.8)% and 2.4 (95% CI 2.2–2.5)% VLFF respectively. IC coefficients were 0.86 (95% CI 0.69–0.93) and 0.990 (95% CI 0.985–0.994) respectively. Small biases (≤3.4%) were observable between two pairs of analysts using stereology while no significant biases were observable between any of the three pairs of analysts using HepaFat-Scan®. A bias of 1.4±0.5% VLFF was observed between the HepaFat-Scan® method and the stereological method. Conclusions Repeatability of the stereological method is superior to the previously reported performance of assessment of hepatic steatosis by histopathologists and is a suitable reference standard for validating non-invasive methods of measurement of VLFF. PMID:27501242

Search by photo methodology for signature properties assessment by human observers

NASA Astrophysics Data System (ADS)

Selj, Gorm K.; Heinrich, Daniela H.

2015-05-01

Reliable, low-cost and simple methods for assessment of signature properties for military purposes are very important. In this paper we present such an approach that uses human observers in a search by photo assessment of signature properties of generic test targets. The method was carried out by logging a large number of detection times of targets recorded in relevant terrain backgrounds. The detection times were harvested by using human observers searching for targets in scene images shown by a high definition pc screen. All targets were identically located in each "search image", allowing relative comparisons (and not just rank by order) of targets. To avoid biased detections, each observer only searched for one target per scene. Statistical analyses were carried out for the detection times data. Analysis of variance was chosen if detection times distribution associated with all targets satisfied normality, and non-parametric tests, such as Wilcoxon's rank test, if otherwise. The new methodology allows assessment of signature properties in a reproducible, rapid and reliable setting. Such assessments are very complex as they must sort out what is of relevance in a signature test, but not loose information of value. We believe that choosing detection times as the primary variable for a comparison of signature properties, allows a careful and necessary inspection of observer data as the variable is continuous rather than discrete. Our method thus stands in opposition to approaches based on detections by subsequent, stepwise reductions in distance to target, or based on probability of detection.

Marginal and Internal Adaptation of Zirconia Crowns: A Comparative Study of Assessment Methods.

PubMed

Cunali, Rafael Schlögel; Saab, Rafaella Caramori; Correr, Gisele Maria; Cunha, Leonardo Fernandes da; Ornaghi, Bárbara Pick; Ritter, André V; Gonzaga, Carla Castiglia

2017-01-01

Marginal and internal adaptation is critical for the success of indirect restorations. New imaging systems make it possible to evaluate these parameters with precision and non-destructively. This study evaluated the marginal and internal adaptation of zirconia copings fabricated with two different systems using both silicone replica and microcomputed tomography (micro-CT) assessment methods. A metal master model, representing a preparation for an all-ceramic full crown, was digitally scanned and polycrystalline zirconia copings were fabricated with either Ceramill Zi (Amann-Girrbach) or inCoris Zi (Dentslpy-Sirona), n=10. For each coping, marginal and internal gaps were evaluated by silicone replica and micro-CT assessment methods. Four assessment points of each replica cross-section and micro-CT image were evaluated using imaging software: marginal gap (MG), axial wall (AW), axio-occlusal angle (AO) and mid-occlusal wall (MO). Data were statistically analyzed by factorial ANOVA and Tukey test (a=0.05). There was no statistically significant difference between the methods for MG and AW. For AO, there were significant differences between methods for Amann copings, while for Dentsply-Sirona copings similar values were observed. For MO, both methods presented statistically significant differences. A positive correlation was observed determined by the two assessment methods for MG values. In conclusion, the assessment method influenced the evaluation of marginal and internal adaptation of zirconia copings. Micro-CT showed lower marginal and internal gap values when compared to the silicone replica technique, although the difference was not always statistically significant. Marginal gap and axial wall assessment points showed the lower gap values, regardless of ceramic system and assessment method used.

Addressing unmeasured confounding in comparative observational research.

PubMed

Zhang, Xiang; Faries, Douglas E; Li, Hu; Stamey, James D; Imbens, Guido W

2018-04-01

Observational pharmacoepidemiological studies can provide valuable information on the effectiveness or safety of interventions in the real world, but one major challenge is the existence of unmeasured confounder(s). While many analytical methods have been developed for dealing with this challenge, they appear under-utilized, perhaps due to the complexity and varied requirements for implementation. Thus, there is an unmet need to improve understanding the appropriate course of action to address unmeasured confounding under a variety of research scenarios. We implemented a stepwise search strategy to find articles discussing the assessment of unmeasured confounding in electronic literature databases. Identified publications were reviewed and characterized by the applicable research settings and information requirements required for implementing each method. We further used this information to develop a best practice recommendation to help guide the selection of appropriate analytical methods for assessing the potential impact of unmeasured confounding. Over 100 papers were reviewed, and 15 methods were identified. We used a flowchart to illustrate the best practice recommendation which was driven by 2 critical components: (1) availability of information on the unmeasured confounders; and (2) goals of the unmeasured confounding assessment. Key factors for implementation of each method were summarized in a checklist to provide further assistance to researchers for implementing these methods. When assessing comparative effectiveness or safety in observational research, the impact of unmeasured confounding should not be ignored. Instead, we suggest quantitatively evaluating the impact of unmeasured confounding and provided a best practice recommendation for selecting appropriate analytical methods. Copyright © 2018 John Wiley & Sons, Ltd.

Diffuse intrinsic pontine glioma: is MRI surveillance improved by region of interest volumetry?

PubMed

Riley, Garan T; Armitage, Paul A; Batty, Ruth; Griffiths, Paul D; Lee, Vicki; McMullan, John; Connolly, Daniel J A

2015-02-01

Paediatric diffuse intrinsic pontine glioma (DIPG) is noteworthy for its fibrillary infiltration through neuroparenchyma and its resultant irregular shape. Conventional volumetry methods aim to approximate such irregular tumours to a regular ellipse, which could be less accurate when assessing treatment response on surveillance MRI. Region-of-interest (ROI) volumetry methods, using manually traced tumour profiles on contiguous imaging slices and subsequent computer-aided calculations, may prove more reliable. To evaluate whether the reliability of MRI surveillance of DIPGs can be improved by the use of ROI-based volumetry. We investigated the use of ROI- and ellipsoid-based methods of volumetry for paediatric DIPGs in a retrospective review of 22 MRI examinations. We assessed the inter- and intraobserver variability of the two methods when performed by four observers. ROI- and ellipsoid-based methods strongly correlated for all four observers. The ROI-based volumes showed slightly better agreement both between and within observers than the ellipsoid-based volumes (inter-[intra-]observer agreement 89.8% [92.3%] and 83.1% [88.2%], respectively). Bland-Altman plots show tighter limits of agreement for the ROI-based method. Both methods are reproducible and transferrable among observers. ROI-based volumetry appears to perform better with greater intra- and interobserver agreement for complex-shaped DIPG.

Naturalistic observation of health-relevant social processes: the electronically activated recorder methodology in psychosomatics.

PubMed

Mehl, Matthias R; Robbins, Megan L; Deters, Fenne Große

2012-05-01

This article introduces a novel observational ambulatory monitoring method called the electronically activated recorder (EAR). The EAR is a digital audio recorder that runs on a handheld computer and periodically and unobtrusively records snippets of ambient sounds from participants' momentary environments. In tracking moment-to-moment ambient sounds, it yields acoustic logs of people's days as they naturally unfold. In sampling only a fraction of the time, it protects participants' privacy and makes large observational studies feasible. As a naturalistic observation method, it provides an observer's account of daily life and is optimized for the objective assessment of audible aspects of social environments, behaviors, and interactions (e.g., habitual preferences for social settings, idiosyncratic interaction styles, subtle emotional expressions). This article discusses the EAR method conceptually and methodologically, reviews prior research with it, and identifies three concrete ways in which it can enrich psychosomatic research. Specifically, it can (a) calibrate psychosocial effects on health against frequencies of real-world behavior; (b) provide ecological observational measures of health-related social processes that are independent of self-report; and (c) help with the assessment of subtle and habitual social behaviors that evade self-report but have important health implications. An important avenue for future research lies in merging traditional self-report-based ambulatory monitoring methods with observational approaches such as the EAR to allow for the simultaneous yet methodologically independent assessment of inner, experiential aspects (e.g., loneliness) and outer, observable aspects (e.g., social isolation) of real-world social processes to reveal their unique effects on health.

Assessing environmental features related to mental health: a reliability study of visual streetscape images.

PubMed

Wu, Yu-Tzu; Nash, Paul; Barnes, Linda E; Minett, Thais; Matthews, Fiona E; Jones, Andy; Brayne, Carol

2014-10-22

An association between depressive symptoms and features of built environment has been reported in the literature. A remaining research challenge is the development of methods to efficiently capture pertinent environmental features in relevant study settings. Visual streetscape images have been used to replace traditional physical audits and directly observe the built environment of communities. The aim of this work is to examine the inter-method reliability of the two audit methods for assessing community environments with a specific focus on physical features related to mental health. Forty-eight postcodes in urban and rural areas of Cambridgeshire, England were randomly selected from an alphabetical list of streets hosted on a UK property website. The assessment was conducted in July and August 2012 by both physical and visual image audits based on the items in Residential Environment Assessment Tool (REAT), an observational instrument targeting the micro-scale environmental features related to mental health in UK postcodes. The assessor used the images of Google Street View and virtually "walked through" the streets to conduct the property and street level assessments. Gwet's AC1 coefficients and Bland-Altman plots were used to compare the concordance of two audits. The results of conducting the REAT by visual image audits generally correspond to direct observations. More variations were found in property level items regarding physical incivilities, with broad limits of agreement which importantly lead to most of the variation in the overall REAT score. Postcodes in urban areas had lower consistency between the two methods than rural areas. Google Street View has the potential to assess environmental features related to mental health with fair reliability and provide a less resource intense method of assessing community environments than physical audits.

Assessing pre-service science teachers' technological pedagogical content knowledge (TPACK) through observations and lesson plans

NASA Astrophysics Data System (ADS)

Canbazoglu Bilici, Sedef; Selcen Guzey, S.; Yamak, Havva

2016-05-01

Background: Technological pedagogical content knowledge (TPACK) is critical for effective teaching with technology. However, generally science teacher education programs do not help pre-service teachers develop TPACK. Purpose: The purpose of this study was to assess pre-service science teachers' TPACK over a semester-long Science Methods. Sample: Twenty-seven pre-service science teachers took the course toward the end of their four-year teacher education program. Design and method: The study employed the case study methodology. Lesson plans and microteaching observations were used as data collection tools. Technological Pedagogical Content Knowledge-based lesson plan assessment instrument (TPACK-LpAI) and Technological Pedagogical Content Knowledge Observation Protocol (TPACK-OP) were used to analyze data obtained from observations and lesson plans. Results: The results showed that the TPACK-focused Science Methods course had an impact on pre-service teachers' TPACK to varying degrees. Most importantly, the course helped teachers gain knowledge of effective usage of educational technology tools. Conclusion: Teacher education programs should provide opportunities to pre-service teachers to develop their TPACK so that they can effectively integrate technology into their teaching.

Non-Invasive Methods for Iron Concentration Assessment

NASA Astrophysics Data System (ADS)

Carneiro, Antonio A. O.; Baffa, Oswaldo; Angulo, Ivan L.; Covas, Dimas T.

2002-08-01

Iron excess is commonly observed in patients with transfusional iron overload. The iron chelation therapy in these patients require accurate determination of the magnitude of iron excess. The most promising method for noninvasive assessment of iron stores is based on measurements of hepatic magnetic susceptibility.

Concurrent Validity Between Live and Home Video Observations Using the Alberta Infant Motor Scale

PubMed Central

van Dam, Ellen; van Haastert, Ingrid C.; Nuysink, Jacqueline

2017-01-01

Purpose: Serial assessment of gross motor development of infants at risk is an established procedure in neonatal follow-up clinics. Assessments based on home video recordings could be a relevant addition. Methods: In 48 infants (1.5-19 months), the concurrent validity of 2 applications was examined using the Alberta Infant Motor Scale: (1) a home video made by parents and (2) simultaneous observation on-site by a pediatric physical therapist. Parents' experiences were explored using a questionnaire. Results: The intraclass correlation coefficient agreement between live and home video assessment was 0.99, with a standard error of measurement of 1.41 items. Intra- and interrater reliability: intraclass correlation coefficients were more than 0.99. According to 94% of the parents, recording their infant's movement repertoire was easy to perform. Conclusion: Assessing the Alberta Infant Motor Scale based on home video recordings is comparable to assessment by live observation. The video method is a promising application that can be used with low burden for parents and infants. PMID:28350771

Incorporating Animals in Phenological Assessments: USA National Phenology Network Methods to Observe Animal Phenology

NASA Astrophysics Data System (ADS)

Miller-Rushing, A. J.; Weltzin, J. F.

2009-12-01

Many assessments of phenology, particularly those operating at large scales, focus on the phenology of plants, in part because of the relevance of plants in cycles of leaf greening and browning that are visible from satellite-based remote sensing, and because plants contribute significantly to global and regional biogeochemical cycles. The USA National Phenology Network (USA-NPN), a consortium of individuals, agencies, and organizations, promotes integrated assessments of both plant and animal phenology. The network is currently developing standard methods to add animal phenology to existing assessments of plant phenology. The first phase will of the standard methods will be implemented online in spring 2010. The methods for observing animals will be similar to the standard methods for making on-the-ground observations of plants—observers will be asked to monitor a fixed location regularly throughout the year. During each visit, observers will answer a series of “yes-no” questions that address the phenological state of the species of interest: Is the species present? Is it mating? Is it feeding? And so on. We are currently testing this method in several national parks in the northeastern United States, including Acadia National Park and the Appalachian Trail. By collecting new observations of this sort for a range of animals—amphibians, birds, fish, insects, mammals, and reptiles—we will greatly increase the ability of scientists and natural resource managers to understand how temporal relationships among these species and the plants on which they depend may be changing. To bolster the data available, we are collaborating with existing monitoring programs to develop common monitoring techniques, data sharing technologies, and visualizations. We are also beginning to collect legacy datasets, such as one from North American Bird Phenology Program that includes 90 years of observations of bird migration times from across the continent. We believe that increasing the amount of animal phenology data available for scientists, natural resource managers, and educators, will greatly advance our understanding of phenological changes and their causes and consequences, particularly in this time of rapid environmental change.

VISUALLY OBSERVED MOLD AND MOLDY ODOR VERSUS QUANTITATIVELY MEASURED MICROBIAL EXPOSURE IN HOMES

EPA Science Inventory

The main study objective was to compare different methods for assessing mold exposure in conjunction with an epidemiologic study on the development of children's asthma. Homes of 184 children were assessed for mold by visual observations and dust sampling at child's age 1 (Year ...

Intersubjectivity as a Measure of Social Competence among Children Attending Head Start: Assessing the Measure's Validity and Relation to Context

ERIC Educational Resources Information Center

Garte, Rebecca R.

2015-01-01

The present paper reported on a new method and procedure for assessing preschooler's social competence. This method utilized an observational measure of intersubjectivity to assess the social competence that develops in real time during interaction between two or more children. The measure of intersubjectivity reflected a conceptualization of the…

How Reliable is the Acetabular Cup Position Assessment from Routine Radiographs?

PubMed Central

Carvajal Alba, Jaime A.; Vincent, Heather K.; Sodhi, Jagdeep S.; Latta, Loren L.; Parvataneni, Hari K.

2017-01-01

Abstract Background: Cup position is crucial for optimal outcomes in total hip arthroplasty. Radiographic assessment of component position is routinely performed in the early postoperative period. Aims: The aims of this study were to determine in a controlled environment if routine radiographic methods accurately and reliably assess the acetabular cup position and to assess if there is a statistical difference related to the rater’s level of training. Methods: A pelvic model was mounted in a spatial frame. An acetabular cup was fixed in different degrees of version and inclination. Standardized radiographs were obtained. Ten observers including five fellowship-trained orthopaedic surgeons and five orthopaedic residents performed a blind assessment of cup position. Inclination was assessed from anteroposterior radiographs of the pelvis and version from cross-table lateral radiographs of the hip. Results: The radiographic methods used showed to be imprecise specially when the cup was positioned at the extremes of version and inclination. An excellent inter-observer reliability (Intra-class coefficient > 0,9) was evidenced. There were no differences related to the level of training of the raters. Conclusions: These widely used radiographic methods should be interpreted cautiously and computed tomography should be utilized in cases when further intervention is contemplated. PMID:28852355

Comparing Methods for Assessing Reliability Uncertainty Based on Pass/Fail Data Collected Over Time

DOE PAGES

Abes, Jeff I.; Hamada, Michael S.; Hills, Charles R.

2017-12-20

In this paper, we compare statistical methods for analyzing pass/fail data collected over time; some methods are traditional and one (the RADAR or Rationale for Assessing Degradation Arriving at Random) was recently developed. These methods are used to provide uncertainty bounds on reliability. We make observations about the methods' assumptions and properties. Finally, we illustrate the differences between two traditional methods, logistic regression and Weibull failure time analysis, and the RADAR method using a numerical example.

Comparing Methods for Assessing Reliability Uncertainty Based on Pass/Fail Data Collected Over Time

DOE Office of Scientific and Technical Information (OSTI.GOV)

Abes, Jeff I.; Hamada, Michael S.; Hills, Charles R.

In this paper, we compare statistical methods for analyzing pass/fail data collected over time; some methods are traditional and one (the RADAR or Rationale for Assessing Degradation Arriving at Random) was recently developed. These methods are used to provide uncertainty bounds on reliability. We make observations about the methods' assumptions and properties. Finally, we illustrate the differences between two traditional methods, logistic regression and Weibull failure time analysis, and the RADAR method using a numerical example.

Objective assessment of the contribution of the RECOPESCA network to the monitoring of 3D coastal ocean variables in the Bay of Biscay and the English Channel

NASA Astrophysics Data System (ADS)

Lamouroux, Julien; Charria, Guillaume; De Mey, Pierre; Raynaud, Stéphane; Heyraud, Catherine; Craneguy, Philippe; Dumas, Franck; Le Hénaff, Matthieu

2016-04-01

In the Bay of Biscay and the English Channel, in situ observations represent a key element to monitor and to understand the wide range of processes in the coastal ocean and their direct impacts on human activities. An efficient way to measure the hydrological content of the water column over the main part of the continental shelf is to consider ships of opportunity as the surface to cover is wide and could be far from the coast. In the French observation strategy, the RECOPESCA programme, as a component of the High frequency Observation network for the environment in coastal SEAs (HOSEA), aims to collect environmental observations from sensors attached to fishing nets. In the present study, we assess that network using the Array Modes (ArM) method (a stochastic implementation of Le Hénaff et al. Ocean Dyn 59: 3-20. doi: 10.1007/s10236-008-0144-7, 2009). That model ensemble-based method is used here to compare model and observation errors and to quantitatively evaluate the performance of the observation network at detecting prior (model) uncertainties, based on hypotheses on error sources. A reference network, based on fishing vessel observations in 2008, is assessed using that method. Considering the various seasons, we show the efficiency of the network at detecting the main model uncertainties. Moreover, three scenarios, based on the reference network, a denser network in 2010 and a fictive network aggregated from a pluri-annual collection of profiles, are also analysed. Our sensitivity study shows the importance of the profile positions with respect to the sheer number of profiles for ensuring the ability of the network to describe the main error modes. More generally, we demonstrate the capacity of this method, with a low computational cost, to assess and to design new in situ observation networks.

Methods for assessing Phytophthora ramorum chlamydospore germination

Treesearch

Joyce Eberhart; Elilzabeth Stamm; Jennifer Parke

2013-01-01

Germination of chlamydospores is difficult to accurately assess when chlamydospores are attached to remnants of supporting hyphae. We developed two approaches for closely observing and rigorously quantifying the frequency of chlamydospore germination in vitro. The plate marking and scanning method was useful for quantifying germination of large...

Automated segmentation of myocardial scar in late enhancement MRI using combined intensity and spatial information.

PubMed

Tao, Qian; Milles, Julien; Zeppenfeld, Katja; Lamb, Hildo J; Bax, Jeroen J; Reiber, Johan H C; van der Geest, Rob J

2010-08-01

Accurate assessment of the size and distribution of a myocardial infarction (MI) from late gadolinium enhancement (LGE) MRI is of significant prognostic value for postinfarction patients. In this paper, an automatic MI identification method combining both intensity and spatial information is presented in a clear framework of (i) initialization, (ii) false acceptance removal, and (iii) false rejection removal. The method was validated on LGE MR images of 20 chronic postinfarction patients, using manually traced MI contours from two independent observers as reference. Good agreement was observed between automatic and manual MI identification. Validation results showed that the average Dice indices, which describe the percentage of overlap between two regions, were 0.83 +/- 0.07 and 0.79 +/- 0.08 between the automatic identification and the manual tracing from observer 1 and observer 2, and the errors in estimated infarct percentage were 0.0 +/- 1.9% and 3.8 +/- 4.7% compared with observer 1 and observer 2. The difference between the automatic method and manual tracing is in the order of interobserver variation. In conclusion, the developed automatic method is accurate and robust in MI delineation, providing an objective tool for quantitative assessment of MI in LGE MR imaging.

Naturalistic Observation of Health-Relevant Social Processes: The Electronically Activated Recorder (EAR) Methodology in Psychosomatics

PubMed Central

Mehl, Matthias R.; Robbins, Megan L.; Deters, Fenne große

2012-01-01

This article introduces a novel, observational ambulatory monitoring method called the Electronically Activated Recorder or EAR. The EAR is a digital audio recorder that runs on a handheld computer and periodically and unobtrusively records snippets of ambient sounds from participants’ momentary environments. In tracking moment-to-moment ambient sounds, it yields acoustic logs of people’s days as they naturally unfold. In sampling only a fraction of the time, it protects participants’ privacy and makes large observational studies feasible. As a naturalistic observation method, it provides an observer’s account of daily life and is optimized for the objective assessment of audible aspects of social environments, behaviors, and interactions (e.g., habitual preferences for social settings, idiosyncratic interaction styles, and subtle emotional expressions). The article discusses the EAR method conceptually and methodologically, reviews prior research with it, and identifies three concrete ways in which it can enrich psychosomatic research. Specifically, it can (a) calibrate psychosocial effects on health against frequencies of real-world behavior, (b) provide ecological, observational measures of health-related social processes that are independent of self-report, and (c) help with the assessment of subtle and habitual social behaviors that evade self-report but have important health implications. An important avenue for future research lies in merging traditional, self-report based ambulatory monitoring methods with observational approaches such as the EAR to allow for the simultaneous yet methodologically independent assessment of inner, experiential (e.g., loneliness) and outer, observable aspects (e.g., social isolation) of real-world social processes to reveal their unique effects on health. PMID:22582338

Sociometric Indicators of Leadership: An Exploratory Analysis

DTIC Science & Technology

2018-01-01

streamline existing observational protocols and assessment methods . This research provides an initial test of sociometric badges in the context of the U.S...understand, the requirements of the mission. Traditional research and assessment methods focusing on leader and follower interactions require direct...based methods of social network analysis. Novel Measures of Leadership Building on these findings and earlier research , it is apparent that

Do observational studies using propensity score methods agree with randomized trials? A systematic comparison of studies on acute coronary syndromes

PubMed Central

Dahabreh, Issa J.; Sheldrick, Radley C.; Paulus, Jessica K.; Chung, Mei; Varvarigou, Vasileia; Jafri, Haseeb; Rassen, Jeremy A.; Trikalinos, Thomas A.; Kitsios, Georgios D.

2012-01-01

Aims Randomized controlled trials (RCTs) are the gold standard for assessing the efficacy of therapeutic interventions because randomization protects from biases inherent in observational studies. Propensity score (PS) methods, proposed as a potential solution to confounding of the treatment–outcome association, are widely used in observational studies of therapeutic interventions for acute coronary syndromes (ACS). We aimed to systematically assess agreement between observational studies using PS methods and RCTs on therapeutic interventions for ACS. Methods and results We searched for observational studies of interventions for ACS that used PS methods to estimate treatment effects on short- or long-term mortality. Using a standardized algorithm, we matched observational studies to RCTs based on patients’ characteristics, interventions, and outcomes (‘topics’), and we compared estimates of treatment effect between the two designs. When multiple observational studies or RCTs were identified for the same topic, we performed a meta-analysis and used the summary relative risk for comparisons. We matched 21 observational studies investigating 17 distinct clinical topics to 63 RCTs (median = 3 RCTs per observational study) for short-term (7 topics) and long-term (10 topics) mortality. Estimates from PS analyses differed statistically significantly from randomized evidence in two instances; however, observational studies reported more extreme beneficial treatment effects compared with RCTs in 13 of 17 instances (P = 0.049). Sensitivity analyses limited to large RCTs, and using alternative meta-analysis models yielded similar results. Conclusion For the treatment of ACS, observational studies using PS methods produce treatment effect estimates that are of more extreme magnitude compared with those from RCTs, although the differences are rarely statistically significant. PMID:22711757

Assessing child time-activity patterns in relation to indoor cooking fires in developing countries: a methodological comparison.

PubMed

Barnes, Brendon; Mathee, Angela; Moiloa, Kebitsamang

2005-01-01

Indoor air pollution, caused by the indoor burning of biomass fuels, has been associated with an increased risk of child acute respiratory infections in developing countries. The amount of time that children spend in proximity to fires is a crucial determinant of the health impact of indoor air pollution. Researchers are reliant on social scientific methods to assess exposure based on child location patterns in relation to indoor fires. The inappropriate use of methods could lead to misclassification of exposure. The aim of this paper is to compare two methods (observations and questionnaire interview) with video analysis (which is thought to offer a more accurate assessment of exposure) in rural South African villages. Compared to video analysis, results show that observations may underestimate the amount of time that children spend very close (within 1.5 m) to fires. This is possibly due to reactivity caused by the presence of an observer. The questionnaire interview offers a more accurate assessment of the amounts of time that children spend within 1.5 m of fires at the expense of a detailed behavioural analysis. By drawing on the strengths and weaknesses of each, this paper discusses the appropriateness of methods to different research contexts.

Using direct clinical observation to assess the quality of cesarean delivery in Afghanistan: an exploratory study

PubMed Central

2014-01-01

Background As part of a National Emergency Obstetric and Newborn Care (EmONC) Needs Assessment, a special study was undertaken in July 2010 to examine the quality of cesarean deliveries in Afghanistan and examine the utility of direct clinical observation as an assessment method in low-resource settings. Methods This cross-sectional assessment of the quality of cesareans at 14 facilities in Afghanistan included a survey of surgeons regarding their routine cesarean practices, direct observation of 29 cesarean deliveries and comparison of observations with facility records for 34 additional cesareans conducted during the 3 days prior to the observation period at each facility. For both observed cases and record reviews, we assessed time intervals between specified points of care-arrival to the ward, first evaluation, detection of a complication, decision for cesarean, incision, and birth. Results All time intervals with the exception of “decision to skin incision” were longer in the record reviews than in observed cases. Prior cesarean was the most common primary indication for all cases. All mothers in both groups observed survived through one hour postpartum. Among newborns there were two stillbirths (7%) in observed births and seven (21%) record reviews. Although our sample is too small to show statistical significance, the difference is noteworthy. In six of the reviewed cesareans resulting in stillbirth, a fetal heart rate was recorded in the operating theater, although four were recorded as macerated. For the two fresh stillbirths, the cesarean surgeries were recorded as scheduled and not urgent. Conclusions Direct observation of cesarean deliveries enabled us to assess a number of preoperative, postoperative, and intraoperative procedures that are often not described in medical records in low resource settings. Comparison of observations with findings from provider interviews and facility records allowed us to infer whether observed practices were typical of providers and facilities and detect potential Hawthorne effects. PMID:24886143

Data Challenges of Leveraging a Simulation to Assess Learning

ERIC Educational Resources Information Center

Gibson, David; Jakl, Peter

2013-01-01

Among the unique affordances of digital simulations are changes in the possibilities for targets as well as the methods of assessment, most significantly, toward integration of thinking with action, embedding of tasks-as-performance of knowledge-in-action, and unobtrusive observational methods. This paper raises and briefly defines key data…

Estimating carnivoran diets using a combination of carcass observations and scats from GPS clusters

PubMed Central

Tambling, C.J.; Laurence, S.D.; Bellan, S.E.; Cameron, E.Z.; du Toit, J.T.; Getz, W.M.

2011-01-01

Scat analysis is one of the most frequently used methods to assess carnivoran diets and Global Positioning System (GPS) cluster methods are increasingly being used to locate feeding sites for large carnivorans. However, both methods have inherent biases that limit their use. GPS methods to locate kill sites are biased towards large carcasses, while scat analysis over-estimates the biomass consumed from smaller prey. We combined carcass observations and scats collected along known movement routes, assessed using GPS data from four African lion (Panthera leo) prides in the Kruger National Park, South Africa, to determine how a combination of these two datasets change diet estimates. As expected, using carcasses alone under-estimated the number of feeding events on small species, primarily impala (Aepyceros melampus) and warthog (Phacochoerus africanus), in our case by more than 50% and thus significantly under-estimated the biomass consumed per pride per day in comparison to when the diet was assessed using carcass observations alone. We show that an approach that supplements carcass observations with scats that enables the identification of potentially missed feeding events increases the estimates of food intake rates for large carnivorans, with possible ramifications for predator-prey interaction studies dealing with biomass intake rate. PMID:22408290

Assessing methane emission estimation methods based on atmospheric measurements from oil and gas production using LES simulations

NASA Astrophysics Data System (ADS)

Saide, P. E.; Steinhoff, D.; Kosovic, B.; Weil, J.; Smith, N.; Blewitt, D.; Delle Monache, L.

2017-12-01

There are a wide variety of methods that have been proposed and used to estimate methane emissions from oil and gas production by using air composition and meteorology observations in conjunction with dispersion models. Although there has been some verification of these methodologies using controlled releases and concurrent atmospheric measurements, it is difficult to assess the accuracy of these methods for more realistic scenarios considering factors such as terrain, emissions from multiple components within a well pad, and time-varying emissions representative of typical operations. In this work we use a large-eddy simulation (LES) to generate controlled but realistic synthetic observations, which can be used to test multiple source term estimation methods, also known as an Observing System Simulation Experiment (OSSE). The LES is based on idealized simulations of the Weather Research & Forecasting (WRF) model at 10 m horizontal grid-spacing covering an 8 km by 7 km domain with terrain representative of a region located in the Barnett shale. Well pads are setup in the domain following a realistic distribution and emissions are prescribed every second for the components of each well pad (e.g., chemical injection pump, pneumatics, compressor, tanks, and dehydrator) using a simulator driven by oil and gas production volume, composition and realistic operational conditions. The system is setup to allow assessments under different scenarios such as normal operations, during liquids unloading events, or during other prescribed operational upset events. Methane and meteorology model output are sampled following the specifications of the emission estimation methodologies and considering typical instrument uncertainties, resulting in realistic observations (see Figure 1). We will show the evaluation of several emission estimation methods including the EPA Other Test Method 33A and estimates using the EPA AERMOD regulatory model. We will also show source estimation results from advanced methods such as variational inverse modeling, and Bayesian inference and stochastic sampling techniques. Future directions including other types of observations, other hydrocarbons being considered, and assessment of additional emission estimation methods will be discussed.

Assessing QuADEM: Preliminary Notes on a New Method for Evaluating Online Language Learning Courseware

ERIC Educational Resources Information Center

Strobl, Carola; Jacobs, Geert

2011-01-01

In this article, we set out to assess QuADEM (Quality Assessment of Digital Educational Material), one of the latest methods for evaluating online language learning courseware. What is special about QuADEM is that the evaluation is based on observing the actual usage of the online courseware and that, from a checklist of 12 different components,…

A Mixed-Methods Study Assessing Special Education Preservice Candidates' Preparedness for Their First Year of Teaching

ERIC Educational Resources Information Center

Tillman, Beverly A.; Richards, Stephen B.; Frank, Catherine Lawless

2011-01-01

This study employed a Likert-type survey, "Praxis/Pathwise" written observations, as well as guided and open-ended reflections to assess the perceptions of preparedness for the first year of teaching for special education student teaching candidates. Cooperating teachers completed the survey and "Praxis/Pathwise" observations.…

An Observational Assessment of Physical Activity Levels and Social Behaviour during Elementary School Recess

ERIC Educational Resources Information Center

Roberts, Simon J.; Fairclough, Stuart J.; Ridgers, Nicola D.; Porteous, Conor

2013-01-01

Objective: The purpose of the present study was to assess children's physical activity, social play behaviour, activity type and social interactions during elementary school recess using a pre-validated systematic observation system. Design: Cross-sectional. Setting: Two elementary schools located in Merseyside, England. Method: Fifty-six…

A review of the use of a systematic observation method in coaching research between 1997 and 2016.

PubMed

Cope, Ed; Partington, Mark; Harvey, Stephen

2017-10-01

A systematic observation method has been one of the most popularly employed methods in coaching research. Kahan's review of this method conducted between 1975 and 1997 highlighted the key trends in this research, and offered methodological guidance for researchers wishing to use this method in their research. The purpose of this review was to provide an update of the use of a systematic observation method in coaching research and assess the extent to which the calls made by Kahan have been addressed. While in some respect this field of study has progressed (i.e., the introduction of qualitative methods), researchers adopting this method have failed to attend to many of the issues Kahan raised. For this method to continue to make a positive contribution towards the coaching research literature, researchers need to more critically reflect on how and why they are employing this method. At present, some of the decisions made by researchers who have conducted work in this area are not justified with a rationale. It is our intention that this review will serve as guidance for researchers and practitioners, and editors and reviewers of journals when attempting to assess the quality of this type of work.

The assessment of cognitive errors using an observer-rated method.

PubMed

Drapeau, Martin

2014-01-01

Cognitive Errors (CEs) are a key construct in cognitive behavioral therapy (CBT). Integral to CBT is that individuals with depression process information in an overly negative or biased way, and that this bias is reflected in specific depressotypic CEs which are distinct from normal information processing. Despite the importance of this construct in CBT theory, practice, and research, few methods are available to researchers and clinicians to reliably identify CEs as they occur. In this paper, the author presents a rating system, the Cognitive Error Rating Scale, which can be used by trained observers to identify and assess the cognitive errors of patients or research participants in vivo, i.e., as they are used or reported by the patients or participants. The method is described, including some of the more important rating conventions to be considered when using the method. This paper also describes the 15 cognitive errors assessed, and the different summary scores, including valence of the CEs, that can be derived from the method.

ARCADO - Adding random case analysis to direct observation in workplace-based formative assessment of general practice registrars.

PubMed

Ingham, Gerard; Fry, Jennifer; Morgan, Simon; Ward, Bernadette

2015-12-10

Workplace-based formative assessments using consultation observation are currently conducted during the Australian general practice training program. Assessment reliability is improved by using multiple assessment methods. The aim of this study was to explore experiences of general practice medical educator assessors and registrars (trainees) when adding random case analysis to direct observation (ARCADO) during formative workplace-based assessments. A sample of general practice medical educators and matched registrars were recruited. Following the ARCADO workplace assessment, semi-structured qualitative interviews were conducted. The data was analysed thematically. Ten registrars and eight medical educators participated. Four major themes emerged - formative versus summative assessment; strengths (acceptability, flexibility, time efficiency, complementarity and authenticity); weaknesses (reduced observation and integrity risks); and contextual factors (variation in assessment content, assessment timing, registrar-medical educator relationship, medical educator's approach and registrar ability). ARCADO is a well-accepted workplace-based formative assessment perceived by registrars and assessors to be valid and flexible. The use of ARCADO enabled complementary insights that would not have been achieved with direct observation alone. Whilst there are some contextual factors to be considered in its implementation, ARCADO appears to have utility as formative assessment and, subject to further evaluation, high-stakes assessment.

Values of a Patient and Observer Scar Assessment Scale to Evaluate the Facial Skin Graft Scar.

PubMed

Chae, Jin Kyung; Kim, Jeong Hee; Kim, Eun Jung; Park, Kun

2016-10-01

The patient and observer scar assessment scale (POSAS) recently emerged as a promising method, reflecting both observer's and patient's opinions in evaluating scar. This tool was shown to be consistent and reliable in burn scar assessment, but it has not been tested in the setting of skin graft scar in skin cancer patients. To evaluate facial skin graft scar applied to POSAS and to compare with objective scar assessment tools. Twenty three patients, who diagnosed with facial cutaneous malignancy and transplanted skin after Mohs micrographic surgery, were recruited. Observer assessment was performed by three independent rates using the observer component of the POSAS and Vancouver scar scale (VSS). Patient self-assessment was performed using the patient component of the POSAS. To quantify scar color and scar thickness more objectively, spectrophotometer and ultrasonography was applied. Inter-observer reliability was substantial with both VSS and the observer component of the POSAS (average measure intraclass coefficient correlation, 0.76 and 0.80, respectively). The observer component consistently showed significant correlations with patients' ratings for the parameters of the POSAS (all p -values<0.05). The correlation between subjective assessment using POSAS and objective assessment using spectrophotometer and ultrasonography showed low relationship. In facial skin graft scar assessment in skin cancer patients, the POSAS showed acceptable inter-observer reliability. This tool was more comprehensive and had higher correlation with patient's opinion.

Elliptical broken line method for calculating capillary density in nailfold capillaroscopy: Proposal and evaluation.

PubMed

Karbalaie, Abdolamir; Abtahi, Farhad; Fatemi, Alimohammad; Etehadtavakol, Mahnaz; Emrani, Zahra; Erlandsson, Björn-Erik

2017-09-01

Nailfold capillaroscopy is a practical method for identifying and obtaining morphological changes in capillaries which might reveal relevant information about diseases and health. Capillaroscopy is harmless, and seems simple and repeatable. However, there is lack of established guidelines and instructions for acquisition as well as the interpretation of the obtained images; which might lead to various ambiguities. In addition, assessment and interpretation of the acquired images are very subjective. In an attempt to overcome some of these problems, in this study a new modified technique for assessment of nailfold capillary density is introduced. The new method is named elliptic broken line (EBL) which is an extension of the two previously known methods by defining clear criteria for finding the apex of capillaries in different scenarios by using a fitted elliptic. A graphical user interface (GUI) is developed for pre-processing, manual assessment of capillary apexes and automatic correction of selected apexes based on 90° rule. Intra- and inter-observer reliability of EBL and corrected EBL is evaluated in this study. Four independent observers familiar with capillaroscopy performed the assessment for 200 nailfold videocapillaroscopy images, form healthy subject and systemic lupus erythematosus patients, in two different sessions. The results show elevation from moderate (ICC=0.691) and good (ICC=0.753) agreements to good (ICC=0.750) and good (ICC=0.801) for intra- and inter-observer reliability after automatic correction of EBL. This clearly shows the potential of this method to improve the reliability and repeatability of assessment which motivates us for further development of automatic tool for EBL method. Copyright © 2017 Elsevier Inc. All rights reserved.

Evaluation of naranjo adverse drug reactions probability scale in causality assessment of drug-induced liver injury.

PubMed

García-Cortés, M; Lucena, M I; Pachkoria, K; Borraz, Y; Hidalgo, R; Andrade, R J

2008-05-01

Causality assessment in hepatotoxicity is challenging. The current standard liver-specific Council for International Organizations of Medical Sciences/Roussel Uclaf Causality Assessment Method scale is complex and difficult to implement in daily practice. The Naranjo Adverse Drug Reactions Probability Scale is a simple and widely used nonspecific scale, which has not been specifically evaluated in drug-induced liver injury. To compare the Naranjo method with the standard liver-specific Council for International Organizations of Medical Sciences/Roussel Uclaf Causality Assessment Method scale in evaluating the accuracy and reproducibility of Naranjo Adverse Drug Reactions Probability Scale in the diagnosis of hepatotoxicity. Two hundred and twenty-five cases of suspected hepatotoxicity submitted to a national registry were evaluated by two independent observers and assessed for between-observer and between-scale differences using percentages of agreement and the weighted kappa (kappa(w)) test. A total of 249 ratings were generated. Between-observer agreement was 45% with a kappa(w) value of 0.17 for the Naranjo Adverse Drug Reactions Probability Scale, while there was a higher agreement when using the Council for International Organizations of Medical Sciences/Roussel Uclaf Causality Assessment Method scale (72%, kappa(w): 0.71). Concordance between the two scales was 24% (kappa(w): 0.15). The Naranjo Adverse Drug Reactions Probability Scale had low sensitivity (54%) and poor negative predictive value (29%) and showed a limited capability to distinguish between adjacent categories of probability. The Naranjo scale lacks validity and reproducibility in the attribution of causality in hepatotoxicity.

Establishing the Feasibility of Direct Observation in the Assessment of Tics in Children with Chronic Tic Disorders

ERIC Educational Resources Information Center

Himle, Michael B.; Chang, Susanna; Woods, Douglas W.; Pearlman, Amanda; Buzzella, Brian; Bunaciu, Liviu; Piacentini, John C.

2006-01-01

Behavior analysis has been at the forefront in establishing effective treatments for children and adults with chronic tic disorders. As is customary in behavior analysis, the efficacy of these treatments has been established using direct-observation assessment methods. Although behavior-analytic treatments have enjoyed acceptance and integration…

Verification Modal Summation Technique for Synthetic and Observation Seismogram for Pidie Jaya Earthquake M6.5

NASA Astrophysics Data System (ADS)

Irwandi, Irwandi; Fashbir; Daryono

2018-04-01

Neo-Deterministic Seismic Hazard Assessment (NDSHA) method is a seismic hazard assessment method that has an advantage on realistic physical simulation of the source, propagation, and geological-geophysical structure. This simulation is capable on generating the synthetics seismograms at the sites that being observed. At the regional NDSHA scale, calculation of the strong ground motion is based on 1D modal summation technique because it is more efficient in computation. In this article, we verify the result of synthetic seismogram calculations with the result of field observations when Pidie Jaya earthquake on 7 December 2016 occurred with the moment magnitude of M6.5. Those data were recorded by broadband seismometers installed by BMKG (Indonesian Agency for Meteorology, Climatology and Geophysics). The result of the synthetic seismogram calculations verifies that some stations well show the suitability with observation while some other stations show the discrepancies with observation results. Based on the results of the observation of some stations, evidently 1D modal summation technique method has been well verified for thin sediment region (near the pre-tertiary basement), but less suitable for thick sediment region. The reason is that the 1D modal summation technique excludes the amplification effect of seismic wave occurring within thick sediment region. So, another approach is needed, e.g., 2D finite difference hybrid method, which is a part of local scale NDSHA method.

The use and reliability of SymNose for quantitative measurement of the nose and lip in unilateral cleft lip and palate patients.

PubMed

Mosmuller, David; Tan, Robin; Mulder, Frans; Bachour, Yara; de Vet, Henrica; Don Griot, Peter

2016-10-01

It is essential to have a reliable assessment method in order to compare the results of cleft lip and palate surgery. In this study the computer-based program SymNose, a method for quantitative assessment of the nose and lip, will be assessed on usability and reliability. The symmetry of the nose and lip was measured twice in 50 six-year-old complete and incomplete unilateral cleft lip and palate patients by four observers. For the frontal view the asymmetry level of the nose and upper lip were evaluated and for the basal view the asymmetry level of the nose and nostrils were evaluated. A mean inter-observer reliability when tracing each image once or twice was 0.70 and 0.75, respectively. Tracing the photographs with 2 observers and 4 observers gave a mean inter-observer score of 0.86 and 0.92, respectively. The mean intra-observer reliability varied between 0.80 and 0.84. SymNose is a practical and reliable tool for the retrospective assessment of large caseloads of 2D photographs of cleft patients for research purposes. Moderate to high single inter-observer reliability was found. For future research with SymNose reliable outcomes can be achieved by using the average outcomes of single tracings of two observers. Copyright © 2016 European Association for Cranio-Maxillo-Facial Surgery. Published by Elsevier Ltd. All rights reserved.

Spatio-temporal pattern clustering for skill assessment of the Korea Operational Oceanographic System

NASA Astrophysics Data System (ADS)

Kim, J.; Park, K.

2016-12-01

In order to evaluate the performance of operational forecast models in the Korea operational oceanographic system (KOOS) which has been developed by Korea Institute of Ocean Science and Technology (KIOST), a skill assessment (SA) tool has developed and provided multiple skill metrics including not only correlation and error skills by comparing predictions and observation but also pattern clustering with numerical models, satellite, and observation. The KOOS has produced 72 hours forecast information on atmospheric and hydrodynamic forecast variables of wind, pressure, current, tide, wave, temperature, and salinity at every 12 hours per day produced by operating numerical models such as WRF, ROMS, MOM5, WW-III, and SWAN and the SA has conducted to evaluate the forecasts. We have been operationally operated several kinds of numerical models such as WRF, ROMS, MOM5, MOHID, WW-III. Quantitative assessment of operational ocean forecast model is very important to provide accurate ocean forecast information not only to general public but also to support ocean-related problems. In this work, we propose a method of pattern clustering using machine learning method and GIS-based spatial analytics to evaluate spatial distribution of numerical models and spatial observation data such as satellite and HF radar. For the clustering, we use 10 or 15 years-long reanalysis data which was computed by the KOOS, ECMWF, and HYCOM to make best matching clusters which are classified physical meaning with time variation and then we compare it with forecast data. Moreover, for evaluating current, we develop extraction method of dominant flow and apply it to hydrodynamic models and HF radar's sea surface current data. By applying pattern clustering method, it allows more accurate and effective assessment of ocean forecast models' performance by comparing not only specific observation positions which are determined by observation stations but also spatio-temporal distribution of whole model areas. We believe that our proposed method will be very useful to examine and evaluate large amount of numerical modeling data as well as satellite data.

The transect method: a novel approach to on-farm welfare assessment of commercial turkeys

PubMed Central

Marchewka, Joanna; Estevez, Inma; Vezzoli, Giuseppe; Ferrante, Valentina; Makagon, Maja M.

2015-01-01

Currently, no animal-based protocol for on-farm welfare assessment of commercial turkeys is available. The birds’ size and flighty nature make obtaining a representative sample using traditional methods difficult. The transect walks (TW) approach provides a potential alternative for on-farm assessments of turkey welfare. We compared the TW approach with a traditional method, and data collected as the birds were moved out of the house during the load out process (L). Ten commercial 19- to 20-week-old Hybrid turkey flocks were evaluated (1 flock/house/farm). Half of the flocks were housed on farms deemed as “faring well” by the company, the other half were on “suboptimal” farms. Each house was subdivided longitudinally into 4 transects. Two observers walked the transects in random order, recording the total number of birds per transect that were immobile; lame; aggressive towards a mate; interacting with humans; with visible head, vent, or back wounds; engaging in mounting behaviors; small; featherless; dirty; sick; terminal; or dead. Flocks were re-evaluated on the same day using the individual sampling method (S), where randomly selected birds were scored as they took 10 steps. Flocks were re-assessed within 48 h of the transect evaluation, as birds were funneled out of the house during load out. Using ANOVAs we determined the effects of observers, method, management, and their interactions on proportions of turkeys per house within each category. Outcome parameters were not affected by management (P > 0.05 for all) or observer (P > 0.05 for most), but an assessment method effect was detected (P < 0.05). S differed from the 2 other methods (P < 0.05) for most parameters except aggression towards a mate, back wounds, dirty, sick, and vent wounds. Differences were not detected between data collected using TW and during L, except for dead (P = 0.0007) and immobile (P = 0.007). Results suggest that the TW method is a promising tool for on-farm turkey welfare assessment as it produced results similar to those obtained at L when all birds could be scored individually. PMID:25577791

The transect method: a novel approach to on-farm welfare assessment of commercial turkeys.

PubMed

Marchewka, Joanna; Estevez, Inma; Vezzoli, Giuseppe; Ferrante, Valentina; Makagon, Maja M

2015-01-01

Currently, no animal-based protocol for on-farm welfare assessment of commercial turkeys is available. The birds' size and flighty nature make obtaining a representative sample using traditional methods difficult. The transect walks (TW) approach provides a potential alternative for on-farm assessments of turkey welfare. We compared the TW approach with a traditional method, and data collected as the birds were moved out of the house during the load out process (L). Ten commercial 19- to 20-week-old Hybrid turkey flocks were evaluated (1 flock/house/farm). Half of the flocks were housed on farms deemed as "faring well" by the company, the other half were on "suboptimal" farms. Each house was subdivided longitudinally into 4 transects. Two observers walked the transects in random order, recording the total number of birds per transect that were immobile; lame; aggressive towards a mate; interacting with humans; with visible head, vent, or back wounds; engaging in mounting behaviors; small; featherless; dirty; sick; terminal; or dead. Flocks were re-evaluated on the same day using the individual sampling method (S), where randomly selected birds were scored as they took 10 steps. Flocks were re-assessed within 48 h of the transect evaluation, as birds were funneled out of the house during load out. Using ANOVAs we determined the effects of observers, method, management, and their interactions on proportions of turkeys per house within each category. Outcome parameters were not affected by management (P>0.05 for all) or observer (P>0.05 for most), but an assessment method effect was detected (P<0.05). S differed from the 2 other methods (P<0.05) for most parameters except aggression towards a mate, back wounds, dirty, sick, and vent wounds. Differences were not detected between data collected using TW and during L, except for dead (P=0.0007) and immobile (P=0.007). Results suggest that the TW method is a promising tool for on-farm turkey welfare assessment as it produced results similar to those obtained at L when all birds could be scored individually. © The Author 2015. Published by Oxford University Press on behalf of Poultry Science Association.

Focused Observations: How to Observe Young Children for Assessment and Curriculum Planning, Second Edition

ERIC Educational Resources Information Center

Gronlund, Gaye; James, Marlyn

2013-01-01

Intentional teaching begins with focused observations and systematic documentation of children's learning and development. "Focused Observations, Second Edition," explains why observation is one of the best methods to get to know each child well, track progress, and plan individualized curriculum. It also provides tools and techniques to…

Blind Demodulation of Pass Band OFDMA Signals and Jamming Battle Damage Assessment Utilizing Link Adaptation

DTIC Science & Technology

2014-03-27

Access (OFDMA) signal so that jamming effectiveness can be assessed; referred to in this research as Battle Damage Assessment ( BDA ). The research extends...the 802.16 Wireless Metropolitan Area Network (MAN) OFDMA standard, and presents a novel method for performing BDA via observation of Sub Carrier (SC...interferer is also evaluated where the blind demodulator’s performance is degraded. BDA is achieved via observing SC LA modulation behavior of the

Assessing Changes in High School Students' Conceptual Understanding through Concept Maps before and after the Computer-Based Predict-Observe-Explain (CB-POE) Tasks on Acid-Base Chemistry at the Secondary Level

ERIC Educational Resources Information Center

Yaman, Fatma; Ayas, Alipasa

2015-01-01

Although concept maps have been used as alternative assessment methods in education, there has been an ongoing debate on how to evaluate students' concept maps. This study discusses how to evaluate students' concept maps as an assessment tool before and after 15 computer-based Predict-Observe-Explain (CB-POE) tasks related to acid-base chemistry.…

Assessing the Impact of Influential Observations on Multiple Regression Analysis on Human Resource Research.

ERIC Educational Resources Information Center

Bates, Reid A.; Holton, Elwood F., III; Burnett, Michael F.

1999-01-01

A case study of learning transfer demonstrates the possible effect of influential observation on linear regression analysis. A diagnostic method that tests for violation of assumptions, multicollinearity, and individual and multiple influential observations helps determine which observation to delete to eliminate bias. (SK)

Evaluation of bone marrow aspirates in patients with acute myeloid leukemia at day 14 of induction therapy.

PubMed

Souto Filho, João Tadeu D; Loureiro, Monique M; Pulcheri, Wolmar; Morais, José Carlos; Nucci, Marcio; Portugal, Rodrigo D

2015-07-25

Early assessment of response to chemotherapy in acute myeloid leukemia may be performed by examining bone marrow aspirate (BMA) or biopsy (BMB); a hypocellular bone marrow sample indicates adequate anti-leukemic activity. We sought to evaluate the quantitative and qualitative assessment of BMA performed on day 14 (D14) of chemotherapy, to verify the inter-observer agreement, to compare the results of BMA and BMB, and to evaluate the impact of D14 blast clearance on the overall survival (OS). A total of 107 patients who received standard induction chemotherapy and had bone marrow samples were included. BMA evaluation was performed by two observers using two methods: quantitative assessment and a qualitative (Likert) scale. ROC curves were obtained correlating the BMA quantification of blasts and the qualitative scale, by both observers, with BMB result as gold-standard. There was a significant agreement between the two observers in both the qualitative and quantitative assessments (Kw = 0.737, p < 0.001, and rs = 0.798, p < 0.001; ICC = 0.836, p < 0.001, respectively). The areas under the curve (AUC) were 0.924 and 0.946 for observer 1 and 0.867 and 0.870 for observer 2 for assessments of the percentage of blasts and qualitative scale, respectively. The best cutoff for blast percentage in BMA was 6% and 7% for observers 1 and 2, respectively. A similar analysis for the qualitative scale showed the best cutoff as "probably infiltrated". Patients who attained higher grades of cytoreduction on D14 had better OS. Evaluation of D14 BMA using both methods had a significant agreement with BMB and between observers, identifying a population of patients with poor outcome.

Influences on the use of observational methods by practitioners when identifying risk factors in physical work.

PubMed

Diego-Mas, Jose-Antonio; Poveda-Bautista, Rocio; Garzon-Leal, Diana-Carolina

2015-01-01

Most observational methods for musculoskeletal disorder risk assessment have been developed by researchers to be applied in specific situations, and practitioners could find difficulties in their use in real-work conditions. The main objective of this study was to identify the factors which have an influence on how useful the observational techniques are perceived to be by practitioners and to what extent these factors influence their perception. A survey was conducted on practitioners regarding the problems normally encountered when implementing these methods, as well as the perceived overall utility of these techniques. The results show that practitioners place particular importance on the support the methods provide in making decisions regarding changes in work systems and how applicable they are to different types of jobs. The results of this study can serve as guide to researchers for the development of new assessment techniques that are more useful and applicable in real-work situations.

Top 10 Research Questions Related to Assessing Physical Activity and Its Contexts Using Systematic Observation

ERIC Educational Resources Information Center

McKenzie, Thomas L.; van der Mars, Hans

2015-01-01

Numerous methods are available to assess physical activity (PA) but systematic observation (SO) excels in being able to provide contextually rich data on the setting in which the activity occurs. As SO is particularly useful for determining how activity is influenced by the immediate physical and social environments, its use is becoming more…

A new method for water quality assessment: by harmony degree equation.

PubMed

Zuo, Qiting; Han, Chunhui; Liu, Jing; Ma, Junxia

2018-02-22

Water quality assessment is an important basic work in the development, utilization, management, and protection of water resources, and also a prerequisite for water safety. In this paper, the harmony degree equation (HDE) was introduced into the research of water quality assessment, and a new method for water quality assessment was proposed according to the HDE: by harmony degree equation (WQA-HDE). First of all, the calculation steps and ideas of this method were described in detail, and then, this method with some other important methods of water quality assessment (single factor assessment method, mean-type comprehensive index assessment method, and multi-level gray correlation assessment method) were used to assess the water quality of the Shaying River (the largest tributary of the Huaihe in China). For this purpose, 2 years (2013-2014) dataset of nine water quality variables covering seven monitoring sites, and approximately 189 observations were used to compare and analyze the characteristics and advantages of the new method. The results showed that the calculation steps of WQA-HDE are similar to the comprehensive assessment method, and WQA-HDE is more operational comparing with the results of other water quality assessment methods. In addition, this new method shows good flexibility by setting the judgment criteria value HD 0 of water quality; when HD 0  = 0.8, the results are closer to reality, and more realistic and reliable. Particularly, when HD 0  = 1, the results of WQA-HDE are consistent with the single factor assessment method, both methods are subject to the most stringent "one vote veto" judgment condition. So, WQA-HDE is a composite method that combines the single factor assessment and comprehensive assessment. This research not only broadens the research field of theoretical method system of harmony theory but also promotes the unity of water quality assessment method and can be used for reference in other comprehensive assessment.

Superitem Test: An Alternative Assessment Tool to Assess Students' Algebraic Solving Ability

ERIC Educational Resources Information Center

Lian, Lim Hooi; Yew, Wun Thiam; Idris, Noraini

2010-01-01

Superitem test based on the SOLO model (Structure of the Observing Learning Outcome) has become a powerful alternative assessment tool for monitoring the growth of students' cognitive ability in solving mathematics problems. This article focused on developing a superitem test to assess students' algebraic solving ability through interview method.…

Plant Disease Severity Assessment-How Rater Bias, Assessment Method, and Experimental Design Affect Hypothesis Testing and Resource Use Efficiency.

PubMed

Chiang, Kuo-Szu; Bock, Clive H; Lee, I-Hsuan; El Jarroudi, Moussa; Delfosse, Philippe

2016-12-01

The effect of rater bias and assessment method on hypothesis testing was studied for representative experimental designs for plant disease assessment using balanced and unbalanced data sets. Data sets with the same number of replicate estimates for each of two treatments are termed "balanced" and those with unequal numbers of replicate estimates are termed "unbalanced". The three assessment methods considered were nearest percent estimates (NPEs), an amended 10% incremental scale, and the Horsfall-Barratt (H-B) scale. Estimates of severity of Septoria leaf blotch on leaves of winter wheat were used to develop distributions for a simulation model. The experimental designs are presented here in the context of simulation experiments which consider the optimal design for the number of specimens (individual units sampled) and the number of replicate estimates per specimen for a fixed total number of observations (total sample size for the treatments being compared). The criterion used to gauge each method was the power of the hypothesis test. As expected, at a given fixed number of observations, the balanced experimental designs invariably resulted in a higher power compared with the unbalanced designs at different disease severity means, mean differences, and variances. Based on these results, with unbiased estimates using NPE, the recommended number of replicate estimates taken per specimen is 2 (from a sample of specimens of at least 30), because this conserves resources. Furthermore, for biased estimates, an apparent difference in the power of the hypothesis test was observed between assessment methods and between experimental designs. Results indicated that, regardless of experimental design or rater bias, an amended 10% incremental scale has slightly less power compared with NPEs, and that the H-B scale is more likely than the others to cause a type II error. These results suggest that choice of assessment method, optimizing sample number and number of replicate estimates, and using a balanced experimental design are important criteria to consider to maximize the power of hypothesis tests for comparing treatments using disease severity estimates.

Development of a Peer Teaching-Assessment Program and a Peer Observation and Evaluation Tool

PubMed Central

Trujillo, Jennifer M.; Barr, Judith; Gonyeau, Michael; Van Amburgh, Jenny A.; Matthews, S. James; Qualters, Donna

2008-01-01

Objectives To develop a formalized, comprehensive, peer-driven teaching assessment program and a valid and reliable assessment tool. Methods A volunteer taskforce was formed and a peer-assessment program was developed using a multistep, sequential approach and the Peer Observation and Evaluation Tool (POET). A pilot study was conducted to evaluate the efficiency and practicality of the process and to establish interrater reliability of the tool. Intra-class correlation coefficients (ICC) were calculated. Results ICCs for 8 separate lectures evaluated by 2-3 observers ranged from 0.66 to 0.97, indicating good interrater reliability of the tool. Conclusion Our peer assessment program for large classroom teaching, which includes a valid and reliable evaluation tool, is comprehensive, feasible, and can be adopted by other schools of pharmacy. PMID:19325963

An observational assessment method for aging laboratory rats

EPA Science Inventory

The growth of the aging population highlights the need for laboratory animal models to study the basic biological processes ofaging and susceptibility to toxic chemicals and disease. Methods to evaluate health ofaging animals over time are needed, especially efficient methods for...

Learning Theories and Assessment Methodologies--An Engineering Educational Perspective

ERIC Educational Resources Information Center

Hassan, O. A. B.

2011-01-01

This paper attempts to critically review theories of learning from the perspective of engineering education in order to align relevant assessment methods with each respective learning theory, considering theoretical aspects and practical observations and reflections. The role of formative assessment, taxonomies, peer learning and educational…

The Influence of Observation Length on the Dependability of Data

ERIC Educational Resources Information Center

David Ferguson, Tyler; Briesch, Amy M.; Volpe, Robert J.; Daniels, Brian

2012-01-01

Although direct observation is one of the most frequently used assessment methods by school psychologists, studies have shown that the number of observations needed to obtain a dependable estimate of student behavior may be impractical. Because direct observation may be used to inform important decisions about students, it is crucial that data be…

Efficacy of Carotid Artery Stenting by the Universal Protection Method.

PubMed

Goto, Shunsaku; Ohshima, Tomotaka; Kato, Kyozo; Izumi, Takashi; Wakabayashi, Toshihiko

2018-04-18

To avoid distal plaques embolization during carotid artery stenting, we developed Universal Protection Method that combined the use of a proximal common carotid artery balloon, an external carotid artery balloon, and a distal internal carotid artery filter, with continuous flow reversal to the femoral vein. Herein, we assessed the efficacy of the Universal Protection Method by comparing stenting outcomes before and after its introduction. We assessed outcomes for 115 cases before and 41 cases after the Universal Protection Method was adopted (non-Universal Protection Method and Universal Protection Method groups, respectively). We then compared procedure details, magnetic resonance imaging (within 48 hours after the procedure), intraprocedural complications, and postoperative stroke rates. Ischemic stroke was not observed in the Universal Protection Method group, but 1 major stroke and 2 minor strokes were observed in the non-Universal Protection Method group. High-intensity areas were seen in 6 (15.0%) and 49 (42.6%) cases in the Universal Protection Method and non-Universal Protection Method groups, respectively (P = .001). Contrastingly, intraprocedural complications were observed in 9 (22.5%) and 21 (18.3%) cases in the Universal Protection Method and non-Universal Protection Method groups, respectively. Among these intraprocedural complication cases, high-intensity areas were observed in 1 case (11.1%) in the Universal Protection Method group and in 15 cases (71.4%) in the non-Universal Protection Method group. Universal Protection Method is a safe technique that is applicable to all patients undergoing carotid artery stenting, irrespective of individual risk factors. Notably, the incidence rates of both distal embolization and unexpected intraprocedural complications are low. Copyright © 2018 National Stroke Association. Published by Elsevier Inc. All rights reserved.

Observational Assessment of Preschool Disruptive Behavior, Part II: validity of the Disruptive Behavior Diagnostic Observation Schedule (DB-DOS).

PubMed

Wakschlag, Lauren S; Briggs-Gowan, Margaret J; Hill, Carri; Danis, Barbara; Leventhal, Bennett L; Keenan, Kate; Egger, Helen L; Cicchetti, Domenic; Burns, James; Carter, Alice S

2008-06-01

To examine the validity of the Disruptive Behavior Diagnostic Observation Schedule (DB-DOS), a new observational method for assessing preschool disruptive behavior. A total of 327 behaviorally heterogeneous preschoolers from low-income environments comprised the validation sample. Parent and teacher reports were used to identify children with clinically significant disruptive behavior. The DB-DOS assessed observed disruptive behavior in two domains, problems in Behavioral Regulation and Anger Modulation, across three interactional contexts: Examiner Engaged, Examiner Busy, and Parent. Convergent and divergent validity of the DB-DOS were tested in relation to parent and teacher reports and independently observed behavior. Clinical validity was tested in terms of criterion and incremental validity of the DB-DOS for discriminating disruptive behavior status and impairment, concurrently and longitudinally. DB-DOS scores were significantly associated with reported and independently observed behavior in a theoretically meaningful fashion. Scores from both DB-DOS domains and each of the three DB-DOS contexts contributed uniquely to discrimination of disruptive behavior status, concurrently and predictively. Observed behavior on the DB-DOS also contributed incrementally to prediction of impairment over time, beyond variance explained by meeting DSM-IV disruptive behavior disorder symptom criteria based on parent/teacher report. The multidomain, multicontext approach of the DB-DOS is a valid method for direct assessment of preschool disruptive behavior. This approach shows promise for enhancing accurate identification of clinically significant disruptive behavior in young children and for characterizing subtypes in a manner that can directly inform etiological and intervention research.

Infants' social withdrawal symptoms assessed with a direct infant observation method in primary health care.

PubMed

Puura, Kaija; Mäntymaa, Mirjami; Luoma, Ilona; Kaukonen, Pälvi; Guedeney, Antoine; Salmelin, Raili; Tamminen, Tuula

2010-12-01

Distressed infants may withdraw from social interaction, but recognising infants' social withdrawal is difficult. The aims of the study were to see whether an infant observation method can be reliably used by front line workers, and to examine the prevalence of infants' social withdrawal symptoms. A random sample of 363 families with four, eight or 18-month-old infants participated in the study. The infants were examined by general practitioners (GPs) in well-baby clinics with the Alarm Distress BaBy Scale (ADBB), an observation method developed for clinical settings. A score of five or more on the ADBB Scale in two subsequent assessments at a two-week interval was regarded as a sign of clinically significant infant social withdrawal. Kappas were calculated for the GPs' correct rating of withdrawn/not withdrawn against a set of videotapes rated by developer of the method, Professor Guedeney and his research group. The kappas for their ratings ranged from 0.5 to 1. The frequency of infants scoring above the cut off in two subsequent assessments was 3%. The ADBB Scale is a promising method for detecting infant social withdrawal in front line services. Three percents of infants were showing sustained social withdrawal as a sign of distress in this normal population sample. Copyright © 2010 Elsevier Inc. All rights reserved.

Innovative research methods for studying treatments for rare diseases: methodological review.

PubMed

Gagne, Joshua J; Thompson, Lauren; O'Keefe, Kelly; Kesselheim, Aaron S

2014-11-24

To examine methods for generating evidence on health outcomes in patients with rare diseases. Methodological review of existing literature. PubMed, Embase, and Academic Search Premier searched for articles describing innovative approaches to randomized trial design and analysis methods and methods for conducting observational research in patients with rare diseases. We assessed information related to the proposed methods, the specific rare disease being studied, and outcomes from the application of the methods. We summarize methods with respect to their advantages in studying health outcomes in rare diseases and provide examples of their application. We identified 46 articles that proposed or described methods for studying patient health outcomes in rare diseases. Articles covered a wide range of rare diseases and most (72%) were published in 2008 or later. We identified 16 research strategies for studying rare disease. Innovative clinical trial methods minimize sample size requirements (n=4) and maximize the proportion of patients who receive active treatment (n=2), strategies crucial to studying small populations of patients with limited treatment choices. No studies describing unique methods for conducting observational studies in patients with rare diseases were identified. Though numerous studies apply unique clinical trial designs and considerations to assess patient health outcomes in rare diseases, less attention has been paid to innovative methods for studying rare diseases using observational data. © Gagne et al 2014.

Using slides to test for changes in crown defoliation assessment methods. Part I: Visual assessment of slides.

PubMed

Dobbertin, Matthias; Hug, Christian; Mizoue, Nobuya

2004-11-01

In this study we used photographs of tree crowns to test whether the assessment methods for tree defoliation in Switzerland have changed over time. We randomly selected 24 series of slides of Norway spruce with field assessments made between 1986 and 1995. The slides were randomly arranged and assessed by three experts without prior knowledge of the year when the slide was taken or the tree number. Defoliation was assessed using the Swiss reference photo guide. Although the correlations between the field assessments and slide assessments were high (Spearman's rank correlation coefficient ranged between 0.79 and 0.83), we found significant differences between field and slide assessments (4.3 to 9% underprediction by the slide assessors) and between the slide assessments. However, no significant trends in field assessment methods could be detected. When the mean differences between field and slide assessments were subtracted, in some years, field assessors consistently underpredicted (1990, 1992) or overpredicted defoliation (1987, 1991). Defoliation tended to be overpredicted in slides taken against the light, and underpredicted for trees with more than 25% crown overlap. We conclude that slide series can be used to detect changes in assessment methods. However, potential observer bias calls for more objective methods of assessment.

Regression-Based Estimates of Observed Functional Status in Centenarians

PubMed Central

Mitchell, Meghan B.; Miller, L. Stephen; Woodard, John L.; Davey, Adam; Martin, Peter; Burgess, Molly; Poon, Leonard W.

2011-01-01

Purpose of the Study: There is lack of consensus on the best method of functional assessment, and there is a paucity of studies on daily functioning in centenarians. We sought to compare associations between performance-based, self-report, and proxy report of functional status in centenarians. We expected the strongest relationships between proxy reports and observed performance of basic activities of daily living (BADLs) and instrumental activities of daily living (IADLs). We hypothesized that the discrepancy between self-report and observed daily functioning would be modified by cognitive status. We additionally sought to provide clinicians with estimates of centenarians’ observed daily functioning based on their mental status in combination with subjective measures of activities of daily living (ADLs). Design and Methods: Two hundred and forty-four centenarians from the Georgia Centenarian Study were included in this cross-sectional population-based study. Measures included the Direct Assessment of Functional Status, self-report and proxy report of functional status, and the Mini-Mental State Examination (MMSE). Results: Associations between observed and proxy reports were stronger than between observed and self-report across BADL and IADL measures. A significant MMSE by type of report interaction was found, indicating that lower MMSE performance is associated with a greater discrepancy between subjective and objective ADL measures. Implications: Results demonstrate associations between 3 methods of assessing functional status and suggest proxy reports are generally more accurate than self-report measures. Cognitive status accounted for some of the discrepancy between observed and self-reports, and we provide clinicians with tables to estimate centenarians’ performance on observed functional measures based on MMSE and subjective report of functional status. PMID:20974657

Assessing Equating Results on Different Equating Criteria

ERIC Educational Resources Information Center

Tong, Ye; Kolen, Michael

2005-01-01

The performance of three equating methods--the presmoothed equipercentile method, the item response theory (IRT) true score method, and the IRT observed score method--were examined based on three equating criteria: the same distributions property, the first-order equity property, and the second-order equity property. The magnitude of the…

Cross-comparison and evaluation of air pollution field estimation methods

NASA Astrophysics Data System (ADS)

Yu, Haofei; Russell, Armistead; Mulholland, James; Odman, Talat; Hu, Yongtao; Chang, Howard H.; Kumar, Naresh

2018-04-01

Accurate estimates of human exposure is critical for air pollution health studies and a variety of methods are currently being used to assign pollutant concentrations to populations. Results from these methods may differ substantially, which can affect the outcomes of health impact assessments. Here, we applied 14 methods for developing spatiotemporal air pollutant concentration fields of eight pollutants to the Atlanta, Georgia region. These methods include eight methods relying mostly on air quality observations (CM: central monitor; SA: spatial average; IDW: inverse distance weighting; KRIG: kriging; TESS-D: discontinuous tessellation; TESS-NN: natural neighbor tessellation with interpolation; LUR: land use regression; AOD: downscaled satellite-derived aerosol optical depth), one using the RLINE dispersion model, and five methods using a chemical transport model (CMAQ), with and without using observational data to constrain results. The derived fields were evaluated and compared. Overall, all methods generally perform better at urban than rural area, and for secondary than primary pollutants. We found the CM and SA methods may be appropriate only for small domains, and for secondary pollutants, though the SA method lead to large negative spatial correlations when using data withholding for PM2.5 (spatial correlation coefficient R = -0.81). The TESS-D method was found to have major limitations. Results of the IDW, KRIG and TESS-NN methods are similar. They are found to be better suited for secondary pollutants because of their satisfactory temporal performance (e.g. average temporal R2 > 0.85 for PM2.5 but less than 0.35 for primary pollutant NO2). In addition, they are suitable for areas with relatively dense monitoring networks due to their inability to capture spatial concentration variabilities, as indicated by the negative spatial R (lower than -0.2 for PM2.5 when assessed using data withholding). The performance of LUR and AOD methods were similar to kriging. Using RLINE and CMAQ fields without fusing observational data led to substantial errors and biases, though the CMAQ model captured spatial gradients reasonably well (spatial R = 0.45 for PM2.5). Two unique tests conducted here included quantifying autocorrelation of method biases (which can be important in time series analyses) and how well the methods capture the observed interspecies correlations (which would be of particular importance in multipollutant health assessments). Autocorrelation of method biases lasted longest and interspecies correlations of primary pollutants was higher than observations when air quality models were used without data fusing. Use of hybrid methods that combine air quality model outputs with observational data overcome some of these limitations and is better suited for health studies. Results from this study contribute to better understanding the strengths and weaknesses of different methods for estimating human exposures.

Non-invasive, investigative methods in skin aging.

PubMed

Longo, C; Ciardo, S; Pellacani, G

2015-12-01

A precise and noninvasive quantification of aging is of outmost importance for in vivo assessment of the skin aging "stage", and thus acts to minimize it. Several bioengineering methods have been proposed to objectively, precisely, and non-invasively measure skin aging, and to detect early skin damage, that is sub-clinically observable. In this review we have described the most relevant methods that have emerged from recently introduced technologies, aiming at quantitatively assessing the effects of aging on the skin.

Unified Multimodal Measurement for Performance Indication Research, Evaluation, and Effectiveness (UMMPIREE): Phase I Report

DTIC Science & Technology

2018-01-25

generally a researcher into methods and techniques (i.e., the science) of assessment. This stakeholder may observe ongoing events/experiments or may use... Research Visualization Tool. A first step toward finding a method to link research . 3.1.2 Phase II: Linking and the Network Approach During Phase I, we...innovations. In the former realm, UMMPIREE will develop a method to link assessments from different research studies to guide research

Human touch vs. axillary digital thermometry for detection of neonatal hypothermia at community level.

PubMed

Agarwal, Siddharth; Sethi, Vani; Pandey, Ravindra Mohan; Kondal, Dimple

2008-06-01

We examined the diagnostic accuracy of human touch (HT) method in assessing hypothermia against axillary digital thermometry (ADT) by a trained non-medical field investigator (who supervised activities of community health volunteers) in seven villages of Agra district, Uttar Pradesh, India. Body temperature of 148 newborns born between March and August 2005 was measured at four points in time for each enrolled newborn (within 48 h and on days 7, 30 and 60) by the field investigator under the axilla using a digital thermometer and by HT method using standard methodology. Total observations were 533. Hypothermia assessed by HT was in agreement with that assessed by ADT (<36.5 degrees C) in 498 observations. Hypothermia assessed by HT showed a high diagnostic accuracy when compared against ADT (kappa 0.65-0.81; sensitivity 74%; specificity 96.7%; positive predictive value 22; negative predictive value 0.26). HT is a simple, quick, inexpensive and programmatically important method. However, being a subjective assessment, its reliability depends on the investigator being adequately trained and competent in making consistently accurate assessments. There is also a need to assess whether with training and supervision even the less literate mothers, traditional birth attendants and community health volunteers can accurately assess mild and moderate hypothermia before promoting HT for early identification of neonatal risk in community-based programs.

Multiple exposure photographic (MEP) technique: an objective assessment of sperm motility in infertility management.

PubMed

Adetoro, O O

1988-06-01

Multiple exposure photography (MEP), an objective technique, was used in determining the percentage of motile sperms in the semen samples from 41 males being investigated for infertility. This technique was compared with the conventional subjective ordinary microscopy method of spermatozoal motility assessment. A satisfactory correlation was observed in percentage sperm motility assessment using the two methods but the MEP estimation was more consistent and reliable. The value of this technique of sperm motility study in the developing world is discussed.

The role of observational reference data for climate downscaling: Insights from the VALUE COST Action

NASA Astrophysics Data System (ADS)

Kotlarski, Sven; Gutiérrez, José M.; Boberg, Fredrik; Bosshard, Thomas; Cardoso, Rita M.; Herrera, Sixto; Maraun, Douglas; Mezghani, Abdelkader; Pagé, Christian; Räty, Olle; Stepanek, Petr; Soares, Pedro M. M.; Szabo, Peter

2016-04-01

VALUE is an open European network to validate and compare downscaling methods for climate change research (http://www.value-cost.eu). A key deliverable of VALUE is the development of a systematic validation framework to enable the assessment and comparison of downscaling methods. Such assessments can be expected to crucially depend on the existence of accurate and reliable observational reference data. In dynamical downscaling, observational data can influence model development itself and, later on, model evaluation, parameter calibration and added value assessment. In empirical-statistical downscaling, observations serve as predictand data and directly influence model calibration with corresponding effects on downscaled climate change projections. We here present a comprehensive assessment of the influence of uncertainties in observational reference data and of scale-related issues on several of the above-mentioned aspects. First, temperature and precipitation characteristics as simulated by a set of reanalysis-driven EURO-CORDEX RCM experiments are validated against three different gridded reference data products, namely (1) the EOBS dataset (2) the recently developed EURO4M-MESAN regional re-analysis, and (3) several national high-resolution and quality-controlled gridded datasets that recently became available. The analysis reveals a considerable influence of the choice of the reference data on the evaluation results, especially for precipitation. It is also illustrated how differences between the reference data sets influence the ranking of RCMs according to a comprehensive set of performance measures.

Fully automatic measurements of axial vertebral rotation for assessment of spinal deformity in idiopathic scoliosis

NASA Astrophysics Data System (ADS)

Forsberg, Daniel; Lundström, Claes; Andersson, Mats; Vavruch, Ludvig; Tropp, Hans; Knutsson, Hans

2013-03-01

Reliable measurements of spinal deformities in idiopathic scoliosis are vital, since they are used for assessing the degree of scoliosis, deciding upon treatment and monitoring the progression of the disease. However, commonly used two dimensional methods (e.g. the Cobb angle) do not fully capture the three dimensional deformity at hand in scoliosis, of which axial vertebral rotation (AVR) is considered to be of great importance. There are manual methods for measuring the AVR, but they are often time-consuming and related with a high intra- and inter-observer variability. In this paper, we present a fully automatic method for estimating the AVR in images from computed tomography. The proposed method is evaluated on four scoliotic patients with 17 vertebrae each and compared with manual measurements performed by three observers using the standard method by Aaro-Dahlborn. The comparison shows that the difference in measured AVR between automatic and manual measurements are on the same level as the inter-observer difference. This is further supported by a high intraclass correlation coefficient (0.971-0.979), obtained when comparing the automatic measurements with the manual measurements of each observer. Hence, the provided results and the computational performance, only requiring approximately 10 to 15 s for processing an entire volume, demonstrate the potential clinical value of the proposed method.

Bridging the Gap: Direct Behavior Rating-Single Item Scales

ERIC Educational Resources Information Center

Miller, Faith G.; Crovello, Nicholas; Swenson, Nicole

2017-01-01

Direct Behavior Ratings (DBRs) are behavioral assessment methods that combine the benefits of systematic direct observation and behavior rating scales. That is, DBRs involve the observation of operationally defined target behaviors during a prespecified observation period and the evaluation of those behaviors via brief ratings. In this way, DBR is…

Ecological Equivalence Assessment Methods: What Trade-Offs between Operationality, Scientific Basis and Comprehensiveness?

PubMed

Bezombes, Lucie; Gaucherand, Stéphanie; Kerbiriou, Christian; Reinert, Marie-Eve; Spiegelberger, Thomas

2017-08-01

In many countries, biodiversity compensation is required to counterbalance negative impacts of development projects on biodiversity by carrying out ecological measures, called offset when the goal is to reach "no net loss" of biodiversity. One main issue is to ensure that offset gains are equivalent to impact-related losses. Ecological equivalence is assessed with ecological equivalence assessment methods taking into account a range of key considerations that we summarized as ecological, spatial, temporal, and uncertainty. When equivalence assessment methods take into account all considerations, we call them "comprehensive". Equivalence assessment methods should also aim to be science-based and operational, which is challenging. Many equivalence assessment methods have been developed worldwide but none is fully satisfying. In the present study, we examine 13 equivalence assessment methods in order to identify (i) their general structure and (ii) the synergies and trade-offs between equivalence assessment methods characteristics related to operationality, scientific-basis and comprehensiveness (called "challenges" in his paper). We evaluate each equivalence assessment methods on the basis of 12 criteria describing the level of achievement of each challenge. We observe that all equivalence assessment methods share a general structure, with possible improvements in the choice of target biodiversity, the indicators used, the integration of landscape context and the multipliers reflecting time lags and uncertainties. We show that no equivalence assessment methods combines all challenges perfectly. There are trade-offs between and within the challenges: operationality tends to be favored while scientific basis are integrated heterogeneously in equivalence assessment methods development. One way of improving the challenges combination would be the use of offset dedicated data-bases providing scientific feedbacks on previous offset measures.

The value of earth observations: methods and findings on the value of Landsat imagery

USGS Publications Warehouse

Miller, Holly M.; Serbina, Larisa O.; Richardson, Leslie A.; Ryker, Sarah J.; Newman, Timothy R.

2016-01-01

Data from Earth observation systems are used extensively in managing and monitoring natural resources, natural hazards, and the impacts of climate change, but the value of such data can be difficult to estimate, particularly when it is available at no cost. Assessing the socioeconomic and scientific value of these data provides a better understanding of the existing and emerging research, science, and applications related to this information and contributes to the decision making process regarding current and future Earth observation systems. Recent USGS research on Landsat data has advanced the literature in this area by using a variety of methods to estimate value. The results of a 2012 survey of Landsat users, a 2013 requirements assessment, and 2013 case studies of applications of Landsat imagery are discussed.

Assessing and improving health in the workplace: an integration of subjective and objective measures with the STress Assessment and Research Toolkit (St.A.R.T.) method

PubMed Central

2012-01-01

Background The aim of this work was to introduce a new combined method of subjective and objective measures to assess psychosocial risk factors at work and improve workers’ health and well-being. In the literature most of the research on work-related stress focuses on self-report measures and this work represents the first methodology capable of integrating different sources of data. Method An integrated method entitled St.A.R.T. (STress Assessment and Research Toolkit) was used in order to assess psychosocial risk factors and two health outcomes. In particular, a self-report questionnaire combined with an observational structured checklist was administered to 113 workers from an Italian retail company. Results The data showed a correlation between subjective data and the rating data of the observational checklist for the psychosocial risk factors related to work contexts such as customer relationship management and customer queue. Conversely, the factors related to work content (workload and boredom) measured with different methods (subjective vs. objective) showed a discrepancy. Furthermore, subjective measures of psychosocial risk factors were more predictive of workers’ psychological health and exhaustion than rating data. The different objective measures played different roles, however, in terms of their influence on the two health outcomes considered. Conclusions It is important to integrate self-related assessment of stressors with objective measures for a better understanding of workers’ conditions in the workplace. The method presented could be considered a useful methodology for combining the two measures and differentiating the impact of different psychological risk factors related to work content and context on workers’ health. PMID:22995286

Assessing the performance of dynamical trajectory estimates

NASA Astrophysics Data System (ADS)

Bröcker, Jochen

2014-06-01

Estimating trajectories and parameters of dynamical systems from observations is a problem frequently encountered in various branches of science; geophysicists for example refer to this problem as data assimilation. Unlike as in estimation problems with exchangeable observations, in data assimilation the observations cannot easily be divided into separate sets for estimation and validation; this creates serious problems, since simply using the same observations for estimation and validation might result in overly optimistic performance assessments. To circumvent this problem, a result is presented which allows us to estimate this optimism, thus allowing for a more realistic performance assessment in data assimilation. The presented approach becomes particularly simple for data assimilation methods employing a linear error feedback (such as synchronization schemes, nudging, incremental 3DVAR and 4DVar, and various Kalman filter approaches). Numerical examples considering a high gain observer confirm the theory.

Assessing the performance of dynamical trajectory estimates.

PubMed

Bröcker, Jochen

2014-06-01

Estimating trajectories and parameters of dynamical systems from observations is a problem frequently encountered in various branches of science; geophysicists for example refer to this problem as data assimilation. Unlike as in estimation problems with exchangeable observations, in data assimilation the observations cannot easily be divided into separate sets for estimation and validation; this creates serious problems, since simply using the same observations for estimation and validation might result in overly optimistic performance assessments. To circumvent this problem, a result is presented which allows us to estimate this optimism, thus allowing for a more realistic performance assessment in data assimilation. The presented approach becomes particularly simple for data assimilation methods employing a linear error feedback (such as synchronization schemes, nudging, incremental 3DVAR and 4DVar, and various Kalman filter approaches). Numerical examples considering a high gain observer confirm the theory.

A method to determine the impact of reduced visual function on nodule detection performance.

PubMed

Thompson, J D; Lança, C; Lança, L; Hogg, P

2017-02-01

In this study we aim to validate a method to assess the impact of reduced visual function and observer performance concurrently with a nodule detection task. Three consultant radiologists completed a nodule detection task under three conditions: without visual defocus (0.00 Dioptres; D), and with two different magnitudes of visual defocus (-1.00 D and -2.00 D). Defocus was applied with lenses and visual function was assessed prior to each image evaluation. Observers evaluated the same cases on each occasion; this comprised of 50 abnormal cases containing 1-4 simulated nodules (5, 8, 10 and 12 mm spherical diameter, 100 HU) placed within a phantom, and 25 normal cases (images containing no nodules). Data was collected under the free-response paradigm and analysed using Rjafroc. A difference in nodule detection performance would be considered significant at p < 0.05. All observers had acceptable visual function prior to beginning the nodule detection task. Visual acuity was reduced to an unacceptable level for two observers when defocussed to -1.00 D and for one observer when defocussed to -2.00 D. Stereoacuity was unacceptable for one observer when defocussed to -2.00 D. Despite unsatisfactory visual function in the presence of defocus we were unable to find a statistically significant difference in nodule detection performance (F(2,4) = 3.55, p = 0.130). A method to assess visual function and observer performance is proposed. In this pilot evaluation we were unable to detect any difference in nodule detection performance when using lenses to reduce visual function. Copyright © 2016 The College of Radiographers. Published by Elsevier Ltd. All rights reserved.

Development of a quantitative morphological assessment of toxicant-treated zebrafish larvae using brightfield imaging and high-content analysis.

PubMed

Deal, Samantha; Wambaugh, John; Judson, Richard; Mosher, Shad; Radio, Nick; Houck, Keith; Padilla, Stephanie

2016-09-01

One of the rate-limiting procedures in a developmental zebrafish screen is the morphological assessment of each larva. Most researchers opt for a time-consuming, structured visual assessment by trained human observer(s). The present studies were designed to develop a more objective, accurate and rapid method for screening zebrafish for dysmorphology. Instead of the very detailed human assessment, we have developed the computational malformation index, which combines the use of high-content imaging with a very brief human visual assessment. Each larva was quickly assessed by a human observer (basic visual assessment), killed, fixed and assessed for dysmorphology with the Zebratox V4 BioApplication using the Cellomics® ArrayScan® V(TI) high-content image analysis platform. The basic visual assessment adds in-life parameters, and the high-content analysis assesses each individual larva for various features (total area, width, spine length, head-tail length, length-width ratio, perimeter-area ratio). In developing the computational malformation index, a training set of hundreds of embryos treated with hundreds of chemicals were visually assessed using the basic or detailed method. In the second phase, we assessed both the stability of these high-content measurements and its performance using a test set of zebrafish treated with a dose range of two reference chemicals (trans-retinoic acid or cadmium). We found the measures were stable for at least 1 week and comparison of these automated measures to detailed visual inspection of the larvae showed excellent congruence. Our computational malformation index provides an objective manner for rapid phenotypic brightfield assessment of individual larva in a developmental zebrafish assay. Copyright © 2016 John Wiley & Sons, Ltd. Copyright © 2016 John Wiley & Sons, Ltd.

Identification and quantification of human microcirculatory leukocytes using handheld video microscopes at the bedside.

PubMed

Uz, Zühre; van Gulik, Thomas M; Aydemirli, Mehtap Derya; Guerci, Philippe; Ince, Yasin; Cuppen, Diede V; Ergin, Bulent; Aksu, Ugur; de Mol, Bas A; Ince, Can

2018-03-08

Leukocyte recruitment and adhesion to the endothelium are hallmarks of systemic inflammation that manifest in a wide range of diseases. At present, no method is available to directly measure leukocyte kinetics at the bedside. In this study, we validate a new method to identify and quantify microcirculatory leukocytes observed by handheld vital microscopy (HVM) using space-time diagram (STD) analysis. Video clips (N=59) containing one capillary-post capillary venule (C-PCV) unit where leukocytes could be observed emanating from a capillary into a venule in cardiac surgery patients (N=20) were included. STD analysis and manual counting were used to quantify the number of leukocytes (total, rolling and non-rolling). Pearson's correlation and Bland-Altman analysis were used to determine agreement between the STDs and manual counting. For reproducibility, intra- and inter-observer coefficients of variation (CVs) were assessed. Leukocyte (rolling and non-rolling) and red blood cell velocities were assessed. The STDs and manual counting procedures for the quantification of rolling leukocytes showed good agreement (r=0.8197, P<0.0001), with a Bland-Altman analysis mean difference of -0.0 (-6.56; 6.56). The overall intra-observer CV for the STD method was 1.5%. The overall inter-observer CVs for the STD and the manual method were 5.6% and 9.4%, respectively. The non-rolling velocity was significantly higher than the rolling velocity (812{plus minus}519 µm/s vs 201{plus minus}149 µm/s, P=0.001). The STD results agreed with the manual counting procedure results, had a better reproducibility and could assess the leukocyte velocity. STD analysis using bedside HVM imaging presented a new methodology for quantifying leukocyte kinetics and functions in the microcirculation.

An approach for evaluating the repeatability of rapid wetland assessment methods: The effects of training and experience

EPA Science Inventory

We sampled 92 wetlands from four different basins in the United States to quantify observer repeatability in rapid wetland condition assessment using the Delaware Rapid Assessment Protocol (DERAP). In the Inland Bays basin of Delaware, 58 wetland sites were sampled by multiple ob...

Xenon-enhanced CT using subtraction CT: Basic and preliminary clinical studies for comparison of its efficacy with that of dual-energy CT and ventilation SPECT/CT to assess regional ventilation and pulmonary functional loss in smokers.

PubMed

Ohno, Yoshiharu; Yoshikawa, Takeshi; Takenaka, Daisuke; Fujisawa, Yasuko; Sugihara, Naoki; Kishida, Yuji; Seki, Shinichiro; Koyama, Hisanobu; Sugimura, Kazuro

2017-01-01

To prospectively and directly compare the capability for assessments of regional ventilation and pulmonary functional loss in smokers of xenon-ventilation CT obtained with the dual-energy CT (DE-CT) and subtraction CT (Sub-CT) MATERIALS AND METHODS: Twenty-three consecutive smokers (15 men and 8 women, mean age: 69.7±8.7years) underwent prospective unenhanced and xenon-enhanced CTs, the latter by Sub-CT and DE-CT methods, ventilation SPECT and pulmonary function tests. Sub-CT was generated from unenhanced and xenon-enhanced CT, and all co-registered SPECT/CT data were produced from SPECT and unenhanced CT data. For each method, regional ventilation was assessed by using a 11-point scoring system on a per-lobe basis. To determine the functional lung volume by each method, it was also calculated for individual sublets with a previously reported method. To determine inter-observer agreement for each method, ventilation defect assessment was evaluated by using the χ2 test with weighted kappa statistics. For evaluation of the efficacy of each method for pulmonary functional loss assessment, functional lung volume was correlated with%FEV 1 . Each inter-observer agreement was rated as substantial (Sub-CT: κ=0.69, p<0.0001; DE-CT: κ=0.64, p<0.0001; SPECT/CT: κ=0.64, p<0.0001). Functional lung volume for each method showed significant to good correlation with%FEV 1 (Sub-CT: r=0.72, p=0.0001; DE-CT: r=0.74, p<0.0001; SPECT/CT: r=0.66, p=0.0006). Xenon-enhanced CT obtained by Sub-CT can be considered at least as efficacious as that obtained by DE-CT and SPECT/CT for assessment of ventilation abnormality and pulmonary functional loss in smokers. Copyright © 2016 Elsevier Ireland Ltd. All rights reserved.

The Effect of DNA Extraction Methods on Observed Microbial Communities from Fibrous and Liquid Rumen Fractions of Dairy Cows

PubMed Central

Vaidya, Jueeli D.; van den Bogert, Bartholomeus; Edwards, Joan E.; Boekhorst, Jos; van Gastelen, Sanne; Saccenti, Edoardo; Plugge, Caroline M.; Smidt, Hauke

2018-01-01

DNA based methods have been widely used to study the complexity of the rumen microbiota, and it is well known that the method of DNA extraction is a critical step in enabling accurate assessment of this complexity. Rumen fluid (RF) and fibrous content (FC) fractions differ substantially in terms of their physical nature and associated microorganisms. The aim of this study was therefore to assess the effect of four DNA extraction methods (RBB, PBB, FDSS, PQIAmini) differing in cell lysis and/or DNA recovery methods on the observed microbial diversity in RF and FC fractions using samples from four rumen cannulated dairy cows fed 100% grass silage (GS100), 67% GS and 33% maize silage (GS67MS33), 33% GS and 67% MS (GS33MS67), or 100% MS (MS100). An ANOVA statistical test was applied on DNA quality and yield measurements, and it was found that the DNA yield was significantly affected by extraction method (p < 0.001) and fraction (p < 0.001). The 260/280 ratio was not affected by extraction (p = 0.08) but was affected by fraction (p = 0.03). On the other hand, the 260/230 ratio was affected by extraction method (p < 0.001) but not affected by fraction (p = 0.8). However, all four extraction procedures yielded DNA suitable for further analysis of bacterial, archaeal and anaerobic fungal communities using quantitative PCR and pyrosequencing of relevant taxonomic markers. Redundancy analysis (RDA) of bacterial 16S rRNA gene sequence data at the family level showed that there was a significant effect of rumen fraction (p = 0.012), and that PBB (p = 0.012) and FDSS (p = 0.024) also significantly contributed to explaining the observed variation in bacterial community composition. Whilst the DNA extraction method affected the apparent bacterial community composition, no single extraction method could be concluded to be ineffective. No obvious effect of DNA extraction method on the anaerobic fungi or archaea was observed, although fraction effects were evident for both. In summary, the comprehensive assessment of observed communities of bacteria, archaea and anaerobic fungi described here provides insight into a rational basis for selecting an optimal methodology to obtain a representative picture of the rumen microbiota. PMID:29445366

The Effect of DNA Extraction Methods on Observed Microbial Communities from Fibrous and Liquid Rumen Fractions of Dairy Cows.

PubMed

Vaidya, Jueeli D; van den Bogert, Bartholomeus; Edwards, Joan E; Boekhorst, Jos; van Gastelen, Sanne; Saccenti, Edoardo; Plugge, Caroline M; Smidt, Hauke

2018-01-01

DNA based methods have been widely used to study the complexity of the rumen microbiota, and it is well known that the method of DNA extraction is a critical step in enabling accurate assessment of this complexity. Rumen fluid (RF) and fibrous content (FC) fractions differ substantially in terms of their physical nature and associated microorganisms. The aim of this study was therefore to assess the effect of four DNA extraction methods (RBB, PBB, FDSS, PQIAmini) differing in cell lysis and/or DNA recovery methods on the observed microbial diversity in RF and FC fractions using samples from four rumen cannulated dairy cows fed 100% grass silage (GS100), 67% GS and 33% maize silage (GS67MS33), 33% GS and 67% MS (GS33MS67), or 100% MS (MS100). An ANOVA statistical test was applied on DNA quality and yield measurements, and it was found that the DNA yield was significantly affected by extraction method ( p < 0.001) and fraction ( p < 0.001). The 260/280 ratio was not affected by extraction ( p = 0.08) but was affected by fraction ( p = 0.03). On the other hand, the 260/230 ratio was affected by extraction method ( p < 0.001) but not affected by fraction ( p = 0.8). However, all four extraction procedures yielded DNA suitable for further analysis of bacterial, archaeal and anaerobic fungal communities using quantitative PCR and pyrosequencing of relevant taxonomic markers. Redundancy analysis (RDA) of bacterial 16S rRNA gene sequence data at the family level showed that there was a significant effect of rumen fraction ( p = 0.012), and that PBB ( p = 0.012) and FDSS ( p = 0.024) also significantly contributed to explaining the observed variation in bacterial community composition. Whilst the DNA extraction method affected the apparent bacterial community composition, no single extraction method could be concluded to be ineffective. No obvious effect of DNA extraction method on the anaerobic fungi or archaea was observed, although fraction effects were evident for both. In summary, the comprehensive assessment of observed communities of bacteria, archaea and anaerobic fungi described here provides insight into a rational basis for selecting an optimal methodology to obtain a representative picture of the rumen microbiota.

Enhanced Gender Recognition System Using an Improved Histogram of Oriented Gradient (HOG) Feature from Quality Assessment of Visible Light and Thermal Images of the Human Body.

PubMed

Nguyen, Dat Tien; Park, Kang Ryoung

2016-07-21

With higher demand from users, surveillance systems are currently being designed to provide more information about the observed scene, such as the appearance of objects, types of objects, and other information extracted from detected objects. Although the recognition of gender of an observed human can be easily performed using human perception, it remains a difficult task when using computer vision system images. In this paper, we propose a new human gender recognition method that can be applied to surveillance systems based on quality assessment of human areas in visible light and thermal camera images. Our research is novel in the following two ways: First, we utilize the combination of visible light and thermal images of the human body for a recognition task based on quality assessment. We propose a quality measurement method to assess the quality of image regions so as to remove the effects of background regions in the recognition system. Second, by combining the features extracted using the histogram of oriented gradient (HOG) method and the measured qualities of image regions, we form a new image features, called the weighted HOG (wHOG), which is used for efficient gender recognition. Experimental results show that our method produces more accurate estimation results than the state-of-the-art recognition method that uses human body images.

Enhanced Gender Recognition System Using an Improved Histogram of Oriented Gradient (HOG) Feature from Quality Assessment of Visible Light and Thermal Images of the Human Body

PubMed Central

Nguyen, Dat Tien; Park, Kang Ryoung

2016-01-01

With higher demand from users, surveillance systems are currently being designed to provide more information about the observed scene, such as the appearance of objects, types of objects, and other information extracted from detected objects. Although the recognition of gender of an observed human can be easily performed using human perception, it remains a difficult task when using computer vision system images. In this paper, we propose a new human gender recognition method that can be applied to surveillance systems based on quality assessment of human areas in visible light and thermal camera images. Our research is novel in the following two ways: First, we utilize the combination of visible light and thermal images of the human body for a recognition task based on quality assessment. We propose a quality measurement method to assess the quality of image regions so as to remove the effects of background regions in the recognition system. Second, by combining the features extracted using the histogram of oriented gradient (HOG) method and the measured qualities of image regions, we form a new image features, called the weighted HOG (wHOG), which is used for efficient gender recognition. Experimental results show that our method produces more accurate estimation results than the state-of-the-art recognition method that uses human body images. PMID:27455264

An Instrument to Assess the Obesogenic Environment of Child Care Centers

ERIC Educational Resources Information Center

Ward, Dianne; Hales, Derek; Haverly, Katie; Marks, Julie; Benjamin, Sara; Ball, Sarah; Trost, Stewart

2008-01-01

Objectives: To describe protocol and interobserver agreements of an instrument to evaluate nutrition and physical activity environments at child care. Methods: Interobserver data were collected from 9 child care centers, through direct observation and document review (17 observer pairs). Results: Mean agreement between observer pairs was 87.26%…

The Association between Observed Parental Emotion Socialization and Adolescent Self-Medication

ERIC Educational Resources Information Center

Hersh, Matthew A.; Hussong, Andrea M.

2009-01-01

The current study examined the moderating influence of observed parental emotion socialization (PES) on self-medication in adolescents. Strengths of the study include the use of a newly developed observational coding system further extending the study of PES to adolescence, the use of an experience sampling method to assess the daily covariation…

Channelized relevance vector machine as a numerical observer for cardiac perfusion defect detection task

NASA Astrophysics Data System (ADS)

Kalayeh, Mahdi M.; Marin, Thibault; Pretorius, P. Hendrik; Wernick, Miles N.; Yang, Yongyi; Brankov, Jovan G.

2011-03-01

In this paper, we present a numerical observer for image quality assessment, aiming to predict human observer accuracy in a cardiac perfusion defect detection task for single-photon emission computed tomography (SPECT). In medical imaging, image quality should be assessed by evaluating the human observer accuracy for a specific diagnostic task. This approach is known as task-based assessment. Such evaluations are important for optimizing and testing imaging devices and algorithms. Unfortunately, human observer studies with expert readers are costly and time-demanding. To address this problem, numerical observers have been developed as a surrogate for human readers to predict human diagnostic performance. The channelized Hotelling observer (CHO) with internal noise model has been found to predict human performance well in some situations, but does not always generalize well to unseen data. We have argued in the past that finding a model to predict human observers could be viewed as a machine learning problem. Following this approach, in this paper we propose a channelized relevance vector machine (CRVM) to predict human diagnostic scores in a detection task. We have previously used channelized support vector machines (CSVM) to predict human scores and have shown that this approach offers better and more robust predictions than the classical CHO method. The comparison of the proposed CRVM with our previously introduced CSVM method suggests that CRVM can achieve similar generalization accuracy, while dramatically reducing model complexity and computation time.

Assessing hospital disaster preparedness: a comparison of an on-site survey, directly observed drill performance, and video analysis of teamwork.

PubMed

Kaji, Amy H; Langford, Vinette; Lewis, Roger J

2008-09-01

There is currently no validated method for assessing hospital disaster preparedness. We determine the degree of correlation between the results of 3 methods for assessing hospital disaster preparedness: administration of an on-site survey, drill observation using a structured evaluation tool, and video analysis of team performance in the hospital incident command center. This was a prospective, observational study conducted during a regional disaster drill, comparing the results from an on-site survey, a structured disaster drill evaluation tool, and a video analysis of teamwork, performed at 6 911-receiving hospitals in Los Angeles County, CA. The on-site survey was conducted separately from the drill and assessed hospital disaster plan structure, vendor agreements, modes of communication, medical and surgical supplies, involvement of law enforcement, mutual aid agreements with other facilities, drills and training, surge capacity, decontamination capability, and pharmaceutical stockpiles. The drill evaluation tool, developed by Johns Hopkins University under contract from the Agency for Healthcare Research and Quality, was used to assess various aspects of drill performance, such as the availability of the hospital disaster plan, the geographic configuration of the incident command center, whether drill participants were identifiable, whether the noise level interfered with effective communication, and how often key information (eg, number of available staffed floor, intensive care, and isolation beds; number of arriving victims; expected triage level of victims; number of potential discharges) was received by the incident command center. Teamwork behaviors in the incident command center were quantitatively assessed, using the MedTeams analysis of the video recordings obtained during the disaster drill. Spearman rank correlations of the results between pair-wise groupings of the 3 assessment methods were calculated. The 3 evaluation methods demonstrated qualitatively different results with respect to each hospital's level of disaster preparedness. The Spearman rank correlation coefficient between the results of the on-site survey and the video analysis of teamwork was -0.34; between the results of the on-site survey and the structured drill evaluation tool, 0.15; and between the results of the video analysis and the drill evaluation tool, 0.82. The disparate results obtained from the 3 methods suggest that each measures distinct aspects of disaster preparedness, and perhaps no single method adequately characterizes overall hospital preparedness.

75 FR 13745 - Office of Innovation and Improvement Overview Information; Ready To Teach Program-General...

Federal Register 2010, 2011, 2012, 2013, 2014

2010-03-23

... on rigorous, scientifically based research methods to assess the effectiveness of a particular... and programs; and (B) Includes research that-- (i) Employs systematic, empirical methods that draw on... hypotheses and justify the general conclusions drawn; (iii) Relies on measurements or observational methods...

Comparison of midwifery students' satisfaction with direct observation of procedural skills and current methods in evaluation of procedural skills in Mashhad Nursing and Midwifery School.

PubMed

Hoseini, Bibi Leila; Mazloum, Seyed Reza; Jafarnejad, Farzaneh; Foroughipour, Mohsen

2013-03-01

The clinical evaluation, as one of the most important elements in medical education, must measure students' competencies and abilities. The implementation of any assessment tool is basically dependent on the acceptance of students. This study tried to assess midwifery students' satisfaction with Direct Observation of Procedural Skills (DOPS) and current clinical evaluation methods. This quasi-experimental study was conducted in the university hospitals affiliated to Mashhad University of Medical Sciences. The subjects comprised 67 undergraduate midwifery students selected by convenience sampling and allocated to control and intervention groups according to the training transposition. Current method was performed in the control group, and DOPS was conducted in the intervention group. The applied tools included DOPS rating scales, logbook, and satisfaction questionnaires with clinical evaluation methods. Validity and reliability of these tools were approved. At the end of training, students' satisfaction with the evaluation methods was assessed by the mentioned tools. The data were analyzed by descriptive and analytical statistics. Satisfaction mean scores of midwifery students with DOPS and current methods were 76.7 ± 12.9 and 62.6 ± 14.7 (out of 100), respectively. DOPS students' satisfaction mean score was significantly higher than the score obtained in current method (P < 0.000). The most satisfactory domains in the current method were "consistence with learning objectives" (71.2 ± 14.9) and "objectiveness" in DOPS (87.9 ± 15.0). In contrast, the least satisfactory domains in the current method were "interested in applying the method" (57.8 ± 26.5) and "number of assessments for each skill" (58.8 ± 25.9) in DOPS method. This study showed that DOPS method is associated with greater students' satisfaction. Since the students' satisfaction with the current method was also acceptable, we recommend combining this new clinical evaluation method with the current method, which covers its weaknesses, to promote the students' satisfaction with clinical evaluation methods in a perfect manner.

The reliability of clinical decisions based on the cervical vertebrae maturation staging method.

PubMed

Sohrabi, Aydin; Babay Ahari, Sahar; Moslemzadeh, Hossein; Rafighi, Ali; Aghazadeh, Zahra

2016-02-01

Of the various techniques used to determine the optimum timing for growth modification treatments, the cervical vertebrae maturation method has great advantages, including validity and no need for extra X-ray exposure. Recently, the reproducibility of this method has been questioned. The aim of this study was to investigate the cause of poor reproducibility of this method and to assess the reproducibility of the clinical decisions made based on it. Seventy lateral cephalograms of Iranian patients aged 9‒15 years were observed twice by five experienced orthodontists. In addition to determining the developmental stage, each single parameter involved in this method was assessed in terms of inter- and intra-observer reproducibility. In order to evaluate the reproducibility of clinical decisions based on this method, cervical vertebrae maturation staging (CVMS) I and II were considered as phase 1 and CVMS IV and V were considered as phase 3. By considering the clinical approach of the CVMS method, inter-observer reproducibility of this method increased from 0.48 to 0.61 (moderate to substantial) and intra-observer reproducibility enhanced from 0.72 to 0.74. 1. Complete visualization of the first four cervical vertebrae was an inclusion criterion, which also limits the clinical application of CVMS method. 2. These results can be generalized when determining growth modification treatments solely for Class II patients. Difficulty in determining the morphology of C3 and C4 leads to poor reproducibility of the CVMS method. Despite this, it has acceptable reproducibility in determining the timing of functional treatment for Class II patients. © The Author 2015. Published by Oxford University Press on behalf of the European Orthodontic Society. All rights reserved. For permissions, please email: journals.permissions@oup.com.

Everyday classroom assessment practices in science classrooms in Sweden

NASA Astrophysics Data System (ADS)

Gómez, María del Carmen; Jakobsson, Anders

2014-12-01

The focus of this study is to examine to what extent and in what ways science teachers practice assessment during classroom interactions in everyday activities in an upper-secondary school in Sweden. We are science teachers working now with a larger research project on assessment in science education that seeks to examine teachers' assessment practices in the upper-secondary school. Framing questions include: are teachers performing an integrated assessment of students' skills as the national curriculum mandates? If so, what do the instructional discourses look like in those situations and what are students' experiences regarding their agency on learning and assessment? We emphasize the social, cultural and historic character of assessment and sustain a situated character of learning instead of the notion that learning is "stored inside the head". Teacher led lessons in three science classrooms were video-recorded and analyzed by combining ethnographic and discourse methods of analysis. Both methods are appropriate to the theoretical foundation of our approach on learning and can give some answers to questions about how individuals interact socially, how their experience is passed on to next generations through language and how language use may reveal cultural changes in the studied context. Making the study of action in a classroom the focal point of sociocultural analysis supports the examination of assessment processes and identification of the social roles in which teachers and students are immersed. Such an approach requires observations of how teachers act in authentic teaching situations when they interact with their students in classroom making possible to observe negotiation processes, agencies when both teachers and students are involved in every-day activities. Our study showed that teachers mostly ignored students' questions and that students solved their own problems by helping each other. Teachers did not provide opportunities for students to discuss or argue scientific issues as the national science curriculum stipulates. We found that traditional assessment methods, such as tests, examinations and assignments were the most common methods used to assess and grade students' learning. Different aspects of knowledge stipulated in the national Swedish curriculum, such as lifelong learning, stimulation to students' creativity, curiosity as well as their wish to explore and convert new ideas into action, and find solutions to problems, were restricted by teachers' discourses. The observed teachers' learning and assessment practices constrain students' agency leading to students' silence consequently hindering students' development.

Pharmacoeconomics

PubMed Central

Hughes, Dyfrig A

2012-01-01

Pharmacoeconomics is an essential component of health technology assessment and the appraisal of medicines for use by UK National Health Service (NHS) patients. As a comparatively young discipline, its methods continue to evolve. Priority research areas for development include methods for synthesizing indirect comparisons when head-to-head trials have not been performed, synthesizing qualitative evidence (for example, stakeholder views), addressing the limitations of the EQ-5D tool for assessing quality of life, including benefits not captured in quality-adjusted life years (QALYs), ways of assessing valuation methods (for determining utility scores), extrapolation of costs and benefits beyond those observed in trials, early estimation of cost-effectiveness (including mechanism-based economic evaluation), methods for incorporating the impact of non-adherence and the role of behavioural economics in influencing patients and prescribers. PMID:22360714

Measurement of Physical Activity.

ERIC Educational Resources Information Center

Dishman, Rod K.; Washburn, Richard A.; Schoeller, Dale A.

2001-01-01

Valid assessment of physical activity must be unobtrusive, practical to administer, and specific about physical activity type, frequency, duration, and intensity. Assessment methods can be categorized according to whether they provide direct or indirect (e.g., self-report) observation of physical activity, body motion, physiological response…

Getting Real: Implementing Assessment Alternatives in Mathematics.

ERIC Educational Resources Information Center

Hopkins, Martha H.

1997-01-01

Recounts experiences of a university professor who returned to the elementary classroom and attempted to implement the National Council of Teachers of Mathematics Standards and appropriate assessment methods, including nontraditional paper-and-pencil tasks, journal-like writing assignments, focused observations, and performance-based assessments…

Sealant retention is better assessed through colour photographs than through the replica and the visual examination methods.

PubMed

Hu, Xuan; Fan, Mingwan; Rong, Wensheng; Lo, Edward C M; Bronkhorst, Ewald; Frencken, Jo E

2014-08-01

The aim of this study was to test the hypothesis that the colour photograph method has a higher level of validity for assessing sealant retention than the visual clinical examination and replica methods. Sealed molars were assessed by two evaluators. The scores for the three methods were compared against consensus scores derived through assessing retention from scanning electron microscopy images (reference standard). The presence/absence (survival) of retained sealants on occlusal surfaces was determined according to the traditional and modified categorizations of retention. Sensitivity, specificity, and Youden-index scores were calculated. Sealant retention assessment scores for visual clinical examinations and for colour photographs were compared with those of the reference standard on 95 surfaces, and sealant retention assessment scores for replicas were compared with those of the reference standard on 33 surfaces. The highest mean Youden-index score for the presence/absence of sealant material was observed for the colour photograph method, followed by that for the replica method; the visual clinical examination method scored lowest. The mean Youden-index score for the survival of retained sealants was highest for the colour photograph method for both the traditional (0.882) and the modified (0.768) categories of sealant retention, whilst the visual clinical examination method had the lowest Youden-index score for these categories (0.745 and 0.063, respectively). The colour photograph method had a higher validity than the replica and the visual examination methods for assessing sealant retention. © 2014 Eur J Oral Sci.

Evidence-based dentistry: analysis of dental anxiety scales for children.

PubMed

Al-Namankany, A; de Souza, M; Ashley, P

2012-03-09

To review paediatric dental anxiety measures (DAMs) and assess the statistical methods used for validation and their clinical implications. A search of four computerised databases between 1960 and January 2011 associated with DAMs, using pre-specified search terms, to assess the method of validation including the reliability as intra-observer agreement 'repeatability or stability' and inter-observer agreement 'reproducibility' and all types of validity. Fourteen paediatric DAMs were predominantly validated in schools and not in the clinical setting while five of the DAMs were not validated at all. The DAMs that were validated were done so against other paediatric DAMs which may not have been validated previously. Reliability was not assessed in four of the DAMs. However, all of the validated studies assessed reliability which was usually 'good' or 'acceptable'. None of the current DAMs used a formal sample size technique. Diversity was seen between the studies ranging from a few simple pictograms to lists of questions reported by either the individual or an observer. To date there is no scale that can be considered as a gold standard, and there is a need to further develop an anxiety scale with a cognitive component for children and adolescents.

Statistical Inference and Reverse Engineering of Gene Regulatory Networks from Observational Expression Data

PubMed Central

Emmert-Streib, Frank; Glazko, Galina V.; Altay, Gökmen; de Matos Simoes, Ricardo

2012-01-01

In this paper, we present a systematic and conceptual overview of methods for inferring gene regulatory networks from observational gene expression data. Further, we discuss two classic approaches to infer causal structures and compare them with contemporary methods by providing a conceptual categorization thereof. We complement the above by surveying global and local evaluation measures for assessing the performance of inference algorithms. PMID:22408642

Potential Pitfalls of Reporting and Bias in Observational Studies With Propensity Score Analysis Assessing a Surgical Procedure: A Methodological Systematic Review.

PubMed

Lonjon, Guillaume; Porcher, Raphael; Ergina, Patrick; Fouet, Mathilde; Boutron, Isabelle

2017-05-01

To describe the evolution of the use and reporting of propensity score (PS) analysis in observational studies assessing a surgical procedure. Assessing surgery in randomized controlled trials raises several challenges. Observational studies with PS analysis are a robust alternative for comparative effectiveness research. In this methodological systematic review, we identified all PubMed reports of observational studies with PS analysis that evaluated a surgical procedure and described the evolution of their use over time. Then, we selected a sample of articles published from August 2013 to July 2014 and systematically appraised the quality of reporting and potential bias of the PS analysis used. We selected 652 reports of observational studies with PS analysis. The publications increased over time, from 1 report in 1987 to 198 in 2013. Among the 129 reports assessed, 20% (n = 24) did not detail the covariates included in the PS and 77% (n = 100) did not report a justification for including these covariates in the PS. The rate of missing data for potential covariates was reported in 9% of articles. When a crossover by conversion was possible, only 14% of reports (n = 12) mentioned this issue. For matched analysis, 10% of articles reported all 4 key elements that allow for reproducibility of a PS-matched analysis (matching ratio, method to choose the nearest neighbors, replacement and method for statistical analysis). Observational studies with PS analysis in surgery are increasing in frequency, but specific methodological issues and weaknesses in reporting exist.

Antenatal care and opportunities for quality improvement of service provision in resource limited settings: A mixed methods study

PubMed Central

van der Eem, Lisette; Nyanza, Elias C.; van Pelt, Sandra; Ndaki, Pendo; Basinda, Namanya; Sundby, Johanne

2017-01-01

Antenatal care is essential to improve maternal and newborn health and wellbeing. The majority of pregnant women in Tanzania attend at least one visit. Since implementation of the focused antenatal care model, quality of care assessments have mostly focused on utilization and coverage of routine interventions for antenatal care. This study aims to assess the quality of antenatal care provision from a holistic perspective in a rural district in Tanzania. Structure, process and outcome components of quality are explored. This paper reports on data collected over several periods from 2012 to 2015 through facility audits of supplies and services, ANC observations and exit interviews with pregnant women. Additional qualitative methods were used such as interviews, focus group observations and participant observations. Findings indicate variable performance of routine ANC services, partly explained by insufficient resources. Poor performance was also observed for appropriate history taking, attention for client’s wellbeing, basic physical examination and adequate counseling and education. Achieving quality improvement for ANC requires increased attention for the process of care provision beyond coverage, including attention for response-based services, which should be assessed based on locally determined criteria. PMID:29236699

Risk assessment of tropical cyclone rainfall flooding in the Delaware River Basin

NASA Astrophysics Data System (ADS)

Lu, P.; Lin, N.; Smith, J. A.; Emanuel, K.

2016-12-01

Rainfall-induced inland flooding is a leading cause of death, injury, and property damage from tropical cyclones (TCs). In the context of climate change, it has been shown that extreme precipitation from TCs is likely to increase during the 21st century. Assessing the long-term risk of inland flooding associated with landfalling TCs is therefore an important task. Standard risk assessment techniques, which are based on observations from rain gauges and stream gauges, are not broadly applicable to TC induced flooding, since TCs are rare, extreme events with very limited historical observations at any specific location. Also, rain gauges and stream gauges can hardly capture the complex spatial variation of TC rainfall and flooding. Furthermore, the utility of historically based assessments is compromised by climate change. Regional dynamical downscaling models can resolve many features of TC precipitation. In terms of risk assessment, however, it is computationally demanding to run such models to obtain long-term climatology of TC induced flooding. Here we apply a computationally efficient climatological-hydrological method to assess the risk of inland flooding associated with landfalling TCs. It includes: 1) a deterministic TC climatology modeling method to generate large numbers of synthetic TCs with physically correlated characteristics (i.e., track, intensity, size) under observed and projected climates; 2) a simple physics-based tropical cyclone rainfall model which is able to simulate rainfall fields associated with each synthetic storm; 3) a hydrologic modeling system that takes in rainfall fields to simulate flood peaks over an entire drainage basin. We will present results of this method applied to the Delaware River Basin in the mid-Atlantic US.

Interval sampling methods and measurement error: a computer simulation.

PubMed

Wirth, Oliver; Slaven, James; Taylor, Matthew A

2014-01-01

A simulation study was conducted to provide a more thorough account of measurement error associated with interval sampling methods. A computer program simulated the application of momentary time sampling, partial-interval recording, and whole-interval recording methods on target events randomly distributed across an observation period. The simulation yielded measures of error for multiple combinations of observation period, interval duration, event duration, and cumulative event duration. The simulations were conducted up to 100 times to yield measures of error variability. Although the present simulation confirmed some previously reported characteristics of interval sampling methods, it also revealed many new findings that pertain to each method's inherent strengths and weaknesses. The analysis and resulting error tables can help guide the selection of the most appropriate sampling method for observation-based behavioral assessments. © Society for the Experimental Analysis of Behavior.

Development of a quality assessment tool for systematic reviews of observational studies (QATSO) of HIV prevalence in men having sex with men and associated risk behaviours

PubMed Central

Wong, William CW; Cheung, Catherine SK; Hart, Graham J

2008-01-01

Background Systematic reviews based on the critical appraisal of observational and analytic studies on HIV prevalence and risk factors for HIV transmission among men having sex with men are very useful for health care decisions and planning. Such appraisal is particularly difficult, however, as the quality assessment tools available for use with observational and analytic studies are poorly established. Methods We reviewed the existing quality assessment tools for systematic reviews of observational studies and developed a concise quality assessment checklist to help standardise decisions regarding the quality of studies, with careful consideration of issues such as external and internal validity. Results A pilot version of the checklist was developed based on epidemiological principles, reviews of study designs, and existing checklists for the assessment of observational studies. The Quality Assessment Tool for Systematic Reviews of Observational Studies (QATSO) Score consists of five items: External validity (1 item), reporting (2 items), bias (1 item) and confounding factors (1 item). Expert opinions were sought and it was tested on manuscripts that fulfil the inclusion criteria of a systematic review. Like all assessment scales, QATSO may oversimplify and generalise information yet it is inclusive, simple and practical to use, and allows comparability between papers. Conclusion A specific tool that allows researchers to appraise and guide study quality of observational studies is developed and can be modified for similar studies in the future. PMID:19014686

Increasing the Rigor of Procedural Fidelity Assessment: An Empirical Comparison of Direct Observation and Permanent Product Review Methods

ERIC Educational Resources Information Center

Sanetti, Lisa M. Hagermoser; Collier-Meek, Melissa A.

2014-01-01

Although it is widely accepted that procedural fidelity data are important for making valid decisions about intervention effectiveness, there is little empirical guidance for researchers and practitioners regarding how to assess procedural fidelity. A first step in moving procedural fidelity assessment research forward is to develop a…

Using Self-Assessments to Detect Workshop Success: Do They Work?

ERIC Educational Resources Information Center

D'Eon, Marcel; Sadownik, Leslie; Harrison, Alexandra; Nation, Jill

2008-01-01

An accepted gold standard for measuring change in participant behavior is third-party observation. This method is highly resource intensive, and many small-scale evaluations may not be in a position to use this approach. This study was designed to assess the validity and reliably of aggregated group self-assessments as one way to measure workshop…

Assessing and improving health in the workplace: an integration of subjective and objective measures with the STress Assessment and Research Toolkit (St.A.R.T.) method.

PubMed

Panari, Chiara; Guglielmi, Dina; Ricci, Aurora; Tabanelli, Maria Carla; Violante, Francesco Saverio

2012-09-20

The aim of this work was to introduce a new combined method of subjective and objective measures to assess psychosocial risk factors at work and improve workers' health and well-being. In the literature most of the research on work-related stress focuses on self-report measures and this work represents the first methodology capable of integrating different sources of data. An integrated method entitled St.A.R.T. (STress Assessment and Research Toolkit) was used in order to assess psychosocial risk factors and two health outcomes. In particular, a self-report questionnaire combined with an observational structured checklist was administered to 113 workers from an Italian retail company. The data showed a correlation between subjective data and the rating data of the observational checklist for the psychosocial risk factors related to work contexts such as customer relationship management and customer queue. Conversely, the factors related to work content (workload and boredom) measured with different methods (subjective vs. objective) showed a discrepancy. Furthermore, subjective measures of psychosocial risk factors were more predictive of workers' psychological health and exhaustion than rating data. The different objective measures played different roles, however, in terms of their influence on the two health outcomes considered. It is important to integrate self-related assessment of stressors with objective measures for a better understanding of workers' conditions in the workplace. The method presented could be considered a useful methodology for combining the two measures and differentiating the impact of different psychological risk factors related to work content and context on workers' health.

Different Methods for Long-term Systematic Assessment of Challenging Behaviors in People with Severe Intellectual Disability

PubMed Central

Delgado, Candida; Gonzalez-Gordon, Rodrigo G.; Aragón, Estívaliz; Navarro, Jose I.

2017-01-01

The aim of this study was to compare the advantages and disadvantages of different behavioral assessment procedures with the purpose of design a long-term assessment procedure that brings together the benefits observed. The study involved four adults with severe and profound intellectual disabilities and severe behavioral problems. A behavioral assessment has been carried out with Scatter Plot, Antecedent-Behavior-Consequence record sheets and, finally, The Observer XT. We conducted a comprehensive assessment of challenging behavior of each participant, by reviewing bio-psychosocial records, interviewing family and direct caregiver staff, as well as direct observation. A large inter-subject behavior variability and instability of intra-subject behavior were found, raising questions about the election of the period to evaluate. The first evaluation level highlighted information about stability of behavior, the second level stand out the context in which it occurs and the third level detailed the different topographies of each behavioral category. The results suggest the desirability of a continuous assessment by combining these three levels for adjusting to the specific characteristics of behavior. We suggest the need of designing a single behavioral assessment procedure that includes the benefits observed in each of the instruments used. PMID:28154543

Different Methods for Long-term Systematic Assessment of Challenging Behaviors in People with Severe Intellectual Disability.

PubMed

Delgado, Candida; Gonzalez-Gordon, Rodrigo G; Aragón, Estívaliz; Navarro, Jose I

2017-01-01

The aim of this study was to compare the advantages and disadvantages of different behavioral assessment procedures with the purpose of design a long-term assessment procedure that brings together the benefits observed. The study involved four adults with severe and profound intellectual disabilities and severe behavioral problems. A behavioral assessment has been carried out with Scatter Plot, Antecedent-Behavior-Consequence record sheets and, finally, The Observer XT. We conducted a comprehensive assessment of challenging behavior of each participant, by reviewing bio-psychosocial records, interviewing family and direct caregiver staff, as well as direct observation. A large inter-subject behavior variability and instability of intra-subject behavior were found, raising questions about the election of the period to evaluate. The first evaluation level highlighted information about stability of behavior, the second level stand out the context in which it occurs and the third level detailed the different topographies of each behavioral category. The results suggest the desirability of a continuous assessment by combining these three levels for adjusting to the specific characteristics of behavior. We suggest the need of designing a single behavioral assessment procedure that includes the benefits observed in each of the instruments used.

Comparative abrasive wear resistance and surface analysis of dental resin-based materials

PubMed Central

Nayyer, Maleeha; Zahid, Shahreen; Hassan, Syed Hammad; Mian, Salman Aziz; Mehmood, Sana; Khan, Haroon Ahmed; Kaleem, Muhammad; Zafar, Muhammad Sohail; Khan, Abdul Samad

2018-01-01

Objective: The objective of this study was to assess the surface properties (microhardness and wear resistance) of various composites and compomer materials. In addition, the methodologies used for assessing wear resistance were compared. Materials and Methods: This study was conducted using restorative material (Filtek Z250, Filtek Z350, QuiXfil, SureFil SDR, and Dyract XP) to assess wear resistance. A custom-made toothbrush simulator was employed for wear testing. Before and after wear resistance, structural, surface, and physical properties were assessed using various techniques. Results: Structural changes and mass loss were observed after treatment, whereas no significant difference in terms of microhardness was observed. The correlation between atomic force microscopy (AFM) and profilometer and between wear resistance and filler volume was highly significant. The correlation between wear resistance and microhardness were insignificant. Conclusions: The AFM presented higher precision compared to optical profilometers at a nanoscale level, but both methods can be used in tandem for a more detailed and precise roughness analysis. PMID:29657526

A Comparison of Assessment Tools: Is Direct Observation an Improvement Over Objective Structured Clinical Examinations for Communications Skills Evaluation?

PubMed

Goch, Abraham M; Karia, Raj; Taormina, David; Kalet, Adina; Zuckerman, Joseph; Egol, Kenneth A; Phillips, Donna

2018-04-01

Evaluation of resident physicians' communications skills is a challenging task and is increasingly accomplished with standardized examinations. There exists a need to identify the effective, efficient methods for assessment of communications skills. We compared objective structured clinical examination (OSCE) and direct observation as approaches for assessing resident communications skills. We conducted a retrospective cohort analysis of orthopaedic surgery resident physicians at a single tertiary care academic institution, using the Institute for Healthcare Communication "4 Es" model for effective communication. Data were collected between 2011 and 2015. A total of 28 residents, each with OSCE and complete direct observation assessment checklists, were included in the analysis. Residents were included if they had 1 OSCE assessment and 2 or more complete direct observation assessments. There were 28 of a possible 59 residents (47%) included. A total of 89% (25 of 28) of residents passed the communications skills OSCE; only 54% (15 of 28) of residents passed the direct observation communications assessment. There was a positive, moderate correlation between OSCE and direct observation scores overall ( r  = 0.415, P  = .028). There was no agreement between OSCE and direct observation in categorizing residents into passing and failing scores (κ = 0.205, P  = .16), after adjusting for chance agreement. Our results suggest that OSCE and direct observation tools provide different insights into resident communications skills (simulation of rare and challenging situations versus real-life daily encounters), and may provide useful perspectives on resident communications skills in different contexts.

Comparison of two methods of digital imaging technology for small diameter K-file length determination.

PubMed

Maryam, Ehsani; Farida, Abesi; Farhad, Akbarzade; Soraya, Khafri

2013-11-01

Obtaining the proper working length in endodontic treatment is essential. The aim of this study was to compare the working length (WL) assessment of small diameter K-files using the two different digital imaging methods. The samples for this in-vitro experimental study consisted of 40 extracted single-rooted premolars. After access cavity preparation, the ISO files no. 6, 8, and 10 stainless steel K-files were inserted in the canals in the three different lengths to evaluate the results in a blinded manner: At the level of apical foramen(actual)1 mm short of apical foramen2 mm short of apical foramen A digital caliper was used to measure the length of the files which was considered as the Gold Standard. Five observers (two oral and maxillofacial radiologists and three endodontists) observed the digital radiographs which were obtained using PSP and CCD digital imaging sensors. The collected data were analyzed by SPSS 17 and Repeated Measures Paired T-test. In WL assessment of small diameter K-files, a significant statistical relationship was seen among the observers of two digital imaging techniques (P<0.001). However, no significant difference was observed between the two digital techniques in WL assessment of small diameter K-files (P<0.05). PSP and CCD digital imaging techniques were similar in WL assessment of canals using no. 6, 8, and 10 K-files.

Multi-observation PET image analysis for patient follow-up quantitation and therapy assessment

NASA Astrophysics Data System (ADS)

David, S.; Visvikis, D.; Roux, C.; Hatt, M.

2011-09-01

In positron emission tomography (PET) imaging, an early therapeutic response is usually characterized by variations of semi-quantitative parameters restricted to maximum SUV measured in PET scans during the treatment. Such measurements do not reflect overall tumor volume and radiotracer uptake variations. The proposed approach is based on multi-observation image analysis for merging several PET acquisitions to assess tumor metabolic volume and uptake variations. The fusion algorithm is based on iterative estimation using a stochastic expectation maximization (SEM) algorithm. The proposed method was applied to simulated and clinical follow-up PET images. We compared the multi-observation fusion performance to threshold-based methods, proposed for the assessment of the therapeutic response based on functional volumes. On simulated datasets the adaptive threshold applied independently on both images led to higher errors than the ASEM fusion and on clinical datasets it failed to provide coherent measurements for four patients out of seven due to aberrant delineations. The ASEM method demonstrated improved and more robust estimation of the evaluation leading to more pertinent measurements. Future work will consist in extending the methodology and applying it to clinical multi-tracer datasets in order to evaluate its potential impact on the biological tumor volume definition for radiotherapy applications.

Controlling firearms use in Australia: has the 1996 gun law reform produced the decrease in rates of suicide with this method?

PubMed

Klieve, Helen; Barnes, Michael; De Leo, Diego

2009-04-01

Observed reductions in firearm suicides in Australia have been linked to the 1997 national firearms agreement (NFA) introduced following the 1996 Port Arthur massacre. The NFA placed strong access restrictions on firearms. To assess the impact of legislative restrictions on the incidence of firearm suicide in Queensland and explore alternative or contributory factors behind observed declines. The Queensland suicide register (QSR) provided detailed information on all male suicides in Queensland (1990-2004), with additional data for Australia (1968-2004) accessed from other official sources. Trends in suicide rates pre/post NFA, and in method selection, were assessed using negative binomial regressions. Changing method selection patterns were examined using a cohort analysis of 5 years of age classes for Australian males. The observed reduction in firearms suicides was initiated prior to the 1997 introduction of the NFA in Queensland and Australia, with a clear decline observed in Australian figures from 1988. No significant difference was found in the rate pre/post the introduction of the NFA in Queensland; however, a significant difference was found for Australian data, the quality of which is noticeably less satisfactory. A marked age-difference in method choice was observed through a cohort analysis demonstrating both time and age influences. Within sequential birth cohorts, rates of firearms suicides decreased in younger males but increased in hanging suicides; this trend was far less marked in older males. The implemented restrictions may not be responsible for the observed reductions in firearms suicide. Data suggest that a change in social and cultural attitudes could have contributed to the shift in method preference.

Analyzing Empirical Evaluations of Non-Experimental Methods in Field Settings

ERIC Educational Resources Information Center

Steiner, Peter M.; Wong, Vivian

2016-01-01

Despite recent emphasis on the use of randomized control trials (RCTs) for evaluating education interventions, in most areas of education research, observational methods remain the dominant approach for assessing program effects. Over the last three decades, the within-study comparison (WSC) design has emerged as a method for evaluating the…

Teaching Electroconvulsive Therapy to Medical Students: Effects of Instructional Method on Knowledge and Attitudes

ERIC Educational Resources Information Center

Warnell, Ronald L.; Duk, Anthony D.; Christison, George W.; Haviland, Mark G.

2005-01-01

Objective: To compare the effects of learning about electroconvulsive therapy (ECT) via live observation to learning via an instructional videotape. Method: During their psychiatry clerkship, 122 medical students were randomized using these two educational methods, and their ECT knowledge and attitudes were assessed during the first and last weeks…

Comfort in palliative sedation (Compas): a transdisciplinary mixed method study protocol for linking objective assessments to subjective experiences.

PubMed

Six, Stefaan; Laureys, Steven; Poelaert, Jan; Bilsen, Johan; Theuns, Peter; Deschepper, Reginald

2018-04-18

In case of untreatable suffering at the end of life, palliative sedation may be chosen to assure comfort by reducing the patient's level of consciousness. An important question here is whether such sedated patients are completely free of pain. Because these patients cannot communicate anymore, caregivers have to rely on observation to assess the patient's comfort. Recently however, more sophisticated techniques from the neurosciences have shown that sometimes consciousness and pain are undetectable with these traditional behavioral methods. The aim of this study is to better understand how unconscious palliative sedated patients experience the last days of their life and to find out if they are really free of pain. In this study we will observe 40 patients starting with initiation of palliative sedation until death. Assessment of comfort based on behavioral observations will be related with the results from a NeuroSense monitor, an EEG-based monitor used for evaluation of the adequacy of anesthesia and sedation in the operating room and an ECG-based Analgesia Nociception Index (ANI) monitor, which informs about comfort or discomfort condition, based on the parasympathetic tone. An innovative and challenging aspect of this study is its qualitative approach; "objective" and "subjective" data will be linked to achieve a holistic understanding of the study topic. The following data will be collected: assessment of pain/comfort by the patients themselves (if possible) by scoring a Visual Analogue Scale (VAS); brain function monitoring; monitoring of parasympathetic tone; caregivers' assessment (pain, awareness, communication); relatives' perception of the quality of the dying process; assessment by 2 trained investigators using observational scales; video and audio registration. Measuring pain and awareness in non-communicative dying patients is both technically and ethically challenging. ANI and EEG have shown to be promising technologies to detect pain that otherwise cannot be detected with the "traditional" methods. Although these technologies have the potential to provide objective quantifiable indicators for distress and awareness in non-communicative patients, strikingly they have not yet been used to check whether the current assessments for non-communicative patients are reliable. The study is registered on ClinicalTrials.gov (Identifier: NCT03273244 ; registration date: 7.9.2017).

Comparing observer models and feature selection methods for a task-based statistical assessment of digital breast tomsynthesis in reconstruction space

NASA Astrophysics Data System (ADS)

Park, Subok; Zhang, George Z.; Zeng, Rongping; Myers, Kyle J.

2014-03-01

A task-based assessment of image quality1 for digital breast tomosynthesis (DBT) can be done in either the projected or reconstructed data space. As the choice of observer models and feature selection methods can vary depending on the type of task and data statistics, we previously investigated the performance of two channelized- Hotelling observer models in conjunction with 2D Laguerre-Gauss (LG) and two implementations of partial least squares (PLS) channels along with that of the Hotelling observer in binary detection tasks involving DBT projections.2, 3 The difference in these observers lies in how the spatial correlation in DBT angular projections is incorporated in the observer's strategy to perform the given task. In the current work, we extend our method to the reconstructed data space of DBT. We investigate how various model observers including the aforementioned compare for performing the binary detection of a spherical signal embedded in structured breast phantoms with the use of DBT slices reconstructed via filtered back projection. We explore how well the model observers incorporate the spatial correlation between different numbers of reconstructed DBT slices while varying the number of projections. For this, relatively small and large scan angles (24° and 96°) are used for comparison. Our results indicate that 1) given a particular scan angle, the number of projections needed to achieve the best performance for each observer is similar across all observer/channel combinations, i.e., Np = 25 for scan angle 96° and Np = 13 for scan angle 24°, and 2) given these sufficient numbers of projections, the number of slices for each observer to achieve the best performance differs depending on the channel/observer types, which is more pronounced in the narrow scan angle case.

Fat scoring: Sources of variability

USGS Publications Warehouse

Krementz, D.G.; Pendleton, G.W.

1990-01-01

Fat scoring is a widely used nondestructive method of assessing total body fat in birds. This method has not been rigorously investigated. We investigated inter- and intraobserver variability in scoring as well as the predictive ability of fat scoring using five species of passerines. Between-observer variation in scoring was variable and great at times. Observers did not consistently score species higher or lower relative to other observers nor did they always score birds with more total body fat higher. We found that within-observer variation was acceptable but was dependent on the species being scored. The precision of fat scoring was species-specific and for most species, fat scores accounted for less than 50% of the variation in true total body fat. Overall, we would describe fat scoring as a fairly precise method of indexing total body fat but with limited reliability among observers.

A new method to assess the sustainability performance of events: Application to the 2014 World Orienteering Championship

DOE Office of Scientific and Technical Information (OSTI.GOV)

Scrucca, Flavio; Severi, Claudio; Galvan, Nicola

Nowadays an increasing attention of public and private agencies to the sustainability performance of events is observed, since it is recognized as a key issue in the context of sustainable development. Assessing the sustainability performance of events involves environmental, social and economic aspects; their impacts are complex and a quantitative assessment is often difficult. This paper presents a new quali-quantitative method developed to measure the sustainability of events, taking into account all its potential impacts. The 2014 World Orienteering Championship, held in Italy, was selected to test the proposed evaluation methodology. The total carbon footprint of the event was 165.34more » tCO{sub 2}eq and the avoided emissions were estimated as being 46 tCO{sub 2}eq. The adopted quali-quantitative method resulted to be efficient in assessing the sustainability impacts and can be applied for the evaluation of similar events. - Highlights: • A quali-quantitative method to assess events' sustainability is presented. • All the methodological issues related to the method are explained. • The method is used to evaluate the sustainability of an international sports event. • The method resulted to be valid to assess the event's sustainability level. • The carbon footprint of the event has been calculated.« less

The intra- and inter-observer reliability of the physical examination methods used to assess patients with patellofemoral joint instability.

PubMed

Smith, Toby O; Clark, Allan; Neda, Sophia; Arendt, Elizabeth A; Post, William R; Grelsamer, Ronald P; Dejour, David; Almqvist, Karl Fredrik; Donell, Simon T

2012-08-01

An accurate physical examination of patients with patellar instability is an important aspect of the diagnosis and treatment. While previous studies have assessed the diagnostic accuracy of such physical examination tests, little has been undertaken to assess the inter- and intra-tester reliability of such techniques. The purpose of this study was to determine the inter- and intra-tester reliability of the physical examination tests used for patients with patellar instability. Five patients (10 knees) with bilateral recurrent patellar instability were assessed by five members of the International Patellofemoral Study Group. Each surgeon assessed each patient twice using 18 reported physical examination tests. The inter- and intra-observer reliability was assessed using weighted Kappa statistics with 95% confidence intervals. The findings of the study suggested that there were very poor inter-observer reliability for the majority of the physical tests, with only the assessments of patellofemoral crepitus, foot arch position and the J-sign presenting with fair to moderate agreement respectively. The intra-observer reliability indicated largely moderate to substantial agreement between the first and second tests performed by each assessor, with the greatest agreement seen for the assessment of tibial torsion, popliteal angle and the Bassett's sign. For the common physical examination tests used in the management of patients with patellar instability inter-observer reliability is poor, while intra-observer reliability is moderate. Standardization of physical exam assessments and further study of these results among different clinicians and more divergent patient groups is indicated. Copyright © 2011 Elsevier B.V. All rights reserved.

Clinical utility of the Structured Observation of Motor Performance in Infants within the child health services

PubMed Central

Persson, Kristina; Sonnander, Karin; Magnusson, Margaretha; Sarkadi, Anna; Lucas, Steven

2017-01-01

Aim This study aimed to evaluate the clinical utility of the Structured Observation of Motor Performance in Infants (SOMP-I) when used by nurses in routine child healthcare by analyzing the nurses’ SOMP-I assessments and the actions taken when motor problems were suspected. Method Infants from three child health centers in Uppsala County, Sweden, were consecutively enrolled in a longitudinal study. The 242 infants were assessed using SOMP-I by the nurse responsible for the infant as part of the regular well-child visits at as close to 2, 4, 6 and 10 months of age as possible. The nurses noted actions taken such as giving advice, scheduling an extra follow-up or referring the infant to specialized care. The infants’ motor development was reassessed at 18 months of age through review of medical records or parental report. Results The assessments of level of motor development at 2 and 10 months showed a distribution corresponding to the percentile distribution of the SOMP-I method. Fewer infants than expected were assessed as delayed at 4 and 6 months or deficient in quality at all assessment ages. When an infant was assessed as delayed in level or deficient in quality, the likelihood of the nurse taking actions increased. This increased further if both delay and quality deficit were found at the same assessment or if one or both were found at repeated assessments. The reassessment of the motor development at 18 months did not reveal any missed infants with major motor impairments. Interpretation The use of SOMP-I appears to demonstrate favorable clinical utility in routine child healthcare as tested here. Child health nurses can assess early motor performance using this standardized assessment method, and using the method appears to support them the clinical decision-making. PMID:28723929

TU-A-17A-02: In Memoriam of Ben Galkin: Virtual Tools for Validation of X-Ray Breast Imaging Systems

DOE Office of Scientific and Technical Information (OSTI.GOV)

Myers, K; Bakic, P; Abbey, C

2014-06-15

This symposium will explore simulation methods for the preclinical evaluation of novel 3D and 4D x-ray breast imaging systems – the subject of AAPM taskgroup TG234. Given the complex design of modern imaging systems, simulations offer significant advantages over long and costly clinical studies in terms of reproducibility, reduced radiation exposures, a known reference standard, and the capability for studying patient and disease subpopulations through appropriate choice of simulation parameters. Our focus will be on testing the realism of software anthropomorphic phantoms and virtual clinical trials tools developed for the optimization and validation of breast imaging systems. The symposium willmore » review the stateof- the-science, as well as the advantages and limitations of various approaches to testing realism of phantoms and simulated breast images. Approaches based upon the visual assessment of synthetic breast images by expert observers will be contrasted with approaches based upon comparing statistical properties between synthetic and clinical images. The role of observer models in the assessment of realism will be considered. Finally, an industry perspective will be presented, summarizing the role and importance of virtual tools and simulation methods in product development. The challenges and conditions that must be satisfied in order for computational modeling and simulation to play a significantly increased role in the design and evaluation of novel breast imaging systems will be addressed. Learning Objectives: Review the state-of-the science in testing realism of software anthropomorphic phantoms and virtual clinical trials tools; Compare approaches based upon the visual assessment by expert observers vs. the analysis of statistical properties of synthetic images; Discuss the role of observer models in the assessment of realism; Summarize the industry perspective to virtual methods for breast imaging.« less

Multisensor satellite data for water quality analysis and water pollution risk assessment: decision making under deep uncertainty with fuzzy algorithm in framework of multimodel approach

NASA Astrophysics Data System (ADS)

Kostyuchenko, Yuriy V.; Sztoyka, Yulia; Kopachevsky, Ivan; Artemenko, Igor; Yuschenko, Maxim

2017-10-01

Multi-model approach for remote sensing data processing and interpretation is described. The problem of satellite data utilization in multi-modeling approach for socio-ecological risks assessment is formally defined. Observation, measurement and modeling data utilization method in the framework of multi-model approach is described. Methodology and models of risk assessment in framework of decision support approach are defined and described. Method of water quality assessment using satellite observation data is described. Method is based on analysis of spectral reflectance of aquifers. Spectral signatures of freshwater bodies and offshores are analyzed. Correlations between spectral reflectance, pollutions and selected water quality parameters are analyzed and quantified. Data of MODIS, MISR, AIRS and Landsat sensors received in 2002-2014 have been utilized verified by in-field spectrometry and lab measurements. Fuzzy logic based approach for decision support in field of water quality degradation risk is discussed. Decision on water quality category is making based on fuzzy algorithm using limited set of uncertain parameters. Data from satellite observations, field measurements and modeling is utilizing in the framework of the approach proposed. It is shown that this algorithm allows estimate water quality degradation rate and pollution risks. Problems of construction of spatial and temporal distribution of calculated parameters, as well as a problem of data regularization are discussed. Using proposed approach, maps of surface water pollution risk from point and diffuse sources are calculated and discussed.

Test-Retest Stability of the Task and Ego Orientation Questionnaire

ERIC Educational Resources Information Center

Lane, Andrew M.; Nevill, Alan M.; Bowes, Neal; Fox, Kenneth R.

2005-01-01

Establishing stability, defined as observing minimal measurement error in a test-retest assessment, is vital to validating psychometric tools. Correlational methods, such as Pearson product-moment, intraclass, and kappa are tests of association or consistency, whereas stability or reproducibility (regarded here as synonymous) assesses the…

Inter-observer reliability of animal-based welfare indicators included in the Animal Welfare Indicators welfare assessment protocol for dairy goats.

PubMed

Vieira, A; Battini, M; Can, E; Mattiello, S; Stilwell, G

2018-01-08

This study was conducted within the context of the Animal Welfare Indicators (AWIN) project and the underlying scientific motivation for the development of the study was the scarcity of data regarding inter-observer reliability (IOR) of welfare indicators, particularly given the importance of reliability as a further step for developing on-farm welfare assessment protocols. The objective of this study is therefore to evaluate IOR of animal-based indicators (at group and individual-level) of the AWIN welfare assessment protocol (prototype) for dairy goats. In the design of the study, two pairs of observers, one in Portugal and another in Italy, visited 10 farms each and applied the AWIN prototype protocol. Farms in both countries were visited between January and March 2014, and all the observers received the same training before the farm visits were initiated. Data collected during farm visits, and analysed in this study, include group-level and individual-level observations. The results of our study allow us to conclude that most of the group-level indicators presented the highest IOR level ('substantial', 0.85 to 0.99) in both field studies, pointing to a usable set of animal-based welfare indicators that were therefore included in the first level of the final AWIN welfare assessment protocol for dairy goats. Inter-observer reliability of individual-level indicators was lower, but the majority of them still reached 'fair to good' (0.41 to 0.75) and 'excellent' (0.76 to 1) levels. In the paper we explore reasons for the differences found in IOR between the group and individual-level indicators, including how the number of individual-level indicators to be assessed on each animal and the restraining method may have affected the results. Furthermore, we discuss the differences found in the IOR of individual-level indicators in both countries: the Portuguese pair of observers reached a higher level of IOR, when compared with the Italian observers. We argue how the reasons behind these differences may stem from the restraining method applied, or the different background and experience of the observers. Finally, the discussion of the results emphasizes the importance of considering that reliability is not an absolute attribute of an indicator, but derives from an interaction between the indicators, the observers and the situation in which the assessment is taking place. This highlights the importance of further considering the indicators' reliability while developing welfare assessment protocols.

Assessing Hourly Precipitation Forecast Skill with the Fractions Skill Score

NASA Astrophysics Data System (ADS)

Zhao, Bin; Zhang, Bo

2018-02-01

Statistical methods for category (yes/no) forecasts, such as the Threat Score, are typically used in the verification of precipitation forecasts. However, these standard methods are affected by the so-called "double-penalty" problem caused by slight displacements in either space or time with respect to the observations. Spatial techniques have recently been developed to help solve this problem. The fractions skill score (FSS), a neighborhood spatial verification method, directly compares the fractional coverage of events in windows surrounding the observations and forecasts. We applied the FSS to hourly precipitation verification by taking hourly forecast products from the GRAPES (Global/Regional Assimilation Prediction System) regional model and quantitative precipitation estimation products from the National Meteorological Information Center of China during July and August 2016, and investigated the difference between these results and those obtained with the traditional category score. We found that the model spin-up period affected the assessment of stability. Systematic errors had an insignificant role in the fraction Brier score and could be ignored. The dispersion of observations followed a diurnal cycle and the standard deviation of the forecast had a similar pattern to the reference maximum of the fraction Brier score. The coefficient of the forecasts and the observations is similar to the FSS; that is, the FSS may be a useful index that can be used to indicate correlation. Compared with the traditional skill score, the FSS has obvious advantages in distinguishing differences in precipitation time series, especially in the assessment of heavy rainfall.

Assessment with Digital Pictures; Using Images and Intentional Conversation to Scaffold the Experiences of Student Teachers

ERIC Educational Resources Information Center

Cross, Dawn M.

2017-01-01

Observation is the preferred method of assessing small children in school and play settings. Despite being taught this, based on statements during the interviews of this study, it appears little instruction is dedicated to the performance of this type of authentic assessment. The professional literature surveyed for this study finds that due to…

Trail resource impacts and an examination of alternative assessment techniques

USGS Publications Warehouse

Marion, J.L.; Leung, Y.-F.

2001-01-01

Trails are a primary recreation resource facility on which recreation activities are performed. They provide safe access to non-roaded areas, support recreational opportunities such as hiking, biking, and wildlife observation, and protect natural resources by concentrating visitor traffic on resistant treads. However, increasing recreational use, coupled with poorly designed and/or maintained trails, has led to a variety of resource impacts. Trail managers require objective information on trails and their conditions to monitor trends, direct trail maintenance efforts, and evaluate the need for visitor management and resource protection actions. This paper reviews trail impacts and different types of trail assessments, including inventory, maintenance, and condition assessment approaches. Two assessment methods, point sampling and problem assessment, are compared empirically from separate assessments of a 15-mile segment of the Appalachian Trail in Great Smoky Mountains National Park. Results indicate that point sampling and problem assessment methods yield distinctly different types of quantitative information. The point sampling method provides more accurate and precise measures of trail characteristics that are continuous or frequent (e.g., tread width or exposed soil). The problem assessment method is a preferred approach for monitoring trail characteristics that can be easily predefined or are infrequent (e.g., excessive width or secondary treads), particularly when information on the location of specific trail impact problems is needed. The advantages and limitations of these two assessment methods are examined in relation to various management and research information needs. The choice and utility of these assessment methods are also discussed.

Design, application and testing of the Work Observation Method by Activity Timing (WOMBAT) to measure clinicians' patterns of work and communication.

PubMed

Westbrook, Johanna I; Ampt, Amanda

2009-04-01

Evidence regarding how health information technologies influence clinicians' patterns of work and support efficient practices is limited. Traditional paper-based data collection methods are unable to capture clinical work complexity and communication patterns. The use of electronic data collection tools for such studies is emerging yet is rarely assessed for reliability or validity. Our aim was to design, apply and test an observational method which incorporated the use of an electronic data collection tool for work measurement studies which would allow efficient, accurate and reliable data collection, and capture greater degrees of work complexity than current approaches. We developed an observational method and software for personal digital assistants (PDAs) which captures multiple dimensions of clinicians' work tasks, namely what task, with whom, and with what; tasks conducted in parallel (multi-tasking); interruptions and task duration. During field-testing over 7 months across four hospital wards, fifty-two nurses were observed for 250 h. Inter-rater reliability was tested and validity was measured by (i) assessing whether observational data reflected known differences in clinical role work tasks and (ii) by comparing observational data with participants' estimates of their task time distribution. Observers took 15-20 h of training to master the method and data collection process. Only 1% of tasks observed did not match the classification developed and were classified as 'other'. Inter-rater reliability scores of observers were maintained at over 85%. The results discriminated between the work patterns of enrolled and registered nurses consistent with differences in their roles. Survey data (n=27) revealed consistent ratings of tasks by nurses, and their rankings of most to least time-consuming tasks were significantly correlated with those derived from the observational data. Over 40% of nurses' time was spent in direct care or professional communication, with 11.8% of time spent multi-tasking. Nurses were interrupted approximately every 49 min. One quarter of interruptions occurred while nurses were preparing or administering medications. This method efficiently produces reliable and valid data. The multi-dimensional nature of the data collected provides greater insights into patterns of clinicians' work and communication than has previously been possible using other methods.

Estimation of Fine Particulate Matter in Taipei Using Landuse Regression and Bayesian Maximum Entropy Methods

PubMed Central

Yu, Hwa-Lung; Wang, Chih-Hsih; Liu, Ming-Che; Kuo, Yi-Ming

2011-01-01

Fine airborne particulate matter (PM2.5) has adverse effects on human health. Assessing the long-term effects of PM2.5 exposure on human health and ecology is often limited by a lack of reliable PM2.5 measurements. In Taipei, PM2.5 levels were not systematically measured until August, 2005. Due to the popularity of geographic information systems (GIS), the landuse regression method has been widely used in the spatial estimation of PM concentrations. This method accounts for the potential contributing factors of the local environment, such as traffic volume. Geostatistical methods, on other hand, account for the spatiotemporal dependence among the observations of ambient pollutants. This study assesses the performance of the landuse regression model for the spatiotemporal estimation of PM2.5 in the Taipei area. Specifically, this study integrates the landuse regression model with the geostatistical approach within the framework of the Bayesian maximum entropy (BME) method. The resulting epistemic framework can assimilate knowledge bases including: (a) empirical-based spatial trends of PM concentration based on landuse regression, (b) the spatio-temporal dependence among PM observation information, and (c) site-specific PM observations. The proposed approach performs the spatiotemporal estimation of PM2.5 levels in the Taipei area (Taiwan) from 2005–2007. PMID:21776223

Estimation of fine particulate matter in Taipei using landuse regression and bayesian maximum entropy methods.

PubMed

Yu, Hwa-Lung; Wang, Chih-Hsih; Liu, Ming-Che; Kuo, Yi-Ming

2011-06-01

Fine airborne particulate matter (PM2.5) has adverse effects on human health. Assessing the long-term effects of PM2.5 exposure on human health and ecology is often limited by a lack of reliable PM2.5 measurements. In Taipei, PM2.5 levels were not systematically measured until August, 2005. Due to the popularity of geographic information systems (GIS), the landuse regression method has been widely used in the spatial estimation of PM concentrations. This method accounts for the potential contributing factors of the local environment, such as traffic volume. Geostatistical methods, on other hand, account for the spatiotemporal dependence among the observations of ambient pollutants. This study assesses the performance of the landuse regression model for the spatiotemporal estimation of PM2.5 in the Taipei area. Specifically, this study integrates the landuse regression model with the geostatistical approach within the framework of the Bayesian maximum entropy (BME) method. The resulting epistemic framework can assimilate knowledge bases including: (a) empirical-based spatial trends of PM concentration based on landuse regression, (b) the spatio-temporal dependence among PM observation information, and (c) site-specific PM observations. The proposed approach performs the spatiotemporal estimation of PM2.5 levels in the Taipei area (Taiwan) from 2005-2007.

Agreement between the methods: Subjective Global Nutritional Assessment and the nutritional assessment of the World Health Organization.

PubMed

Pimenta, Fabiana S; Oliveira, Cássia M; Hattori, Wallisen T; Teixeira, Kely R

2017-11-12

To assess the agreement between the results of the Subjective Global Nutritional Assessment questionnaire, adapted for children and adolescents of the Brazilian population, and the nutritional status assessment method through growth curves and the classification of the World Health Organization in a pediatric hospital service. This was an analytical, quantitative, cross-sectional study. During the data collection period, the nutritional status of all patients from 0 to 12 years of age, admitted to the pediatric unit of a university hospital, was concomitantly assessed according to the Subjective Global Nutritional Assessment and World Health Organization curves. To determine the assessment and agreement between these methods, the Kappa and Kendall coefficients were used, respectively, considering a significance level of 5%. Sixty-one children participated, with a predominance of males. It was observed that the highest frequency of equivalent results occurred among the group classified as well nourished, and that only the height/age variable showed a close agreement between the methods. Additionally, there was a good correlation only for the weight/height variable between the assessment tools used. Due to the low agreement between the methods, the combination of both may be beneficial for the nutritional assessment of pediatric patients, collaborating with the early diagnosis of nutritional alterations and facilitating the use of adequate dietary therapy. Copyright © 2017. Published by Elsevier Editora Ltda.

The reliability of a modified Kalamazoo Consensus Statement Checklist for assessing the communication skills of multidisciplinary clinicians in the simulated environment.

PubMed

Peterson, Eleanor B; Calhoun, Aaron W; Rider, Elizabeth A

2014-09-01

With increased recognition of the importance of sound communication skills and communication skills education, reliable assessment tools are essential. This study reports on the psychometric properties of an assessment tool based on the Kalamazoo Consensus Statement Essential Elements Communication Checklist. The Gap-Kalamazoo Communication Skills Assessment Form (GKCSAF), a modified version of an existing communication skills assessment tool, the Kalamazoo Essential Elements Communication Checklist-Adapted, was used to assess learners in a multidisciplinary, simulation-based communication skills educational program using multiple raters. 118 simulated conversations were available for analysis. Internal consistency and inter-rater reliability were determined by calculating a Cronbach's alpha score and intra-class correlation coefficients (ICC), respectively. The GKCSAF demonstrated high internal consistency with a Cronbach's alpha score of 0.844 (faculty raters) and 0.880 (peer observer raters), and high inter-rater reliability with an ICC of 0.830 (faculty raters) and 0.89 (peer observer raters). The Gap-Kalamazoo Communication Skills Assessment Form is a reliable method of assessing the communication skills of multidisciplinary learners using multi-rater methods within the learning environment. The Gap-Kalamazoo Communication Skills Assessment Form can be used by educational programs that wish to implement a reliable assessment and feedback system for a variety of learners. Copyright © 2014 Elsevier Ireland Ltd. All rights reserved.

Assessing treatment effects in older breast cancer patients: systematic review of observational research methods.

PubMed

de Glas, N A; Kiderlen, M; de Craen, A J M; Hamaker, M E; Portielje, J E A; van de Velde, C J H; Liefers, G J; Bastiaannet, E

2015-03-01

Solid evidence of treatment effects in older women with breast cancer is lacking, as they are generally underrepresented in randomized clinical trials on which guideline recommendations are based. An alternative way to study treatment effects in older patients could be to use data from observational studies. However, using appropriate methods in analyzing observational data is a key condition in order to draw valid conclusions, as directly comparing treatments generally results in biased estimates due to confounding by indication. The aim of this systematic review was to investigate the methods that have been used in observational studies that assessed the effects of breast cancer treatment on survival, breast cancer survival and recurrence in older patients (aged 65 years and older). Studies were identified through systematic review of the literature published between January 1st 2009 and December 13th 2013 in the PubMed database and EMBASe. Finally, 31 studies fulfilled the inclusion criteria. Of these, 22 studies directly compared two treatments. Fifteen out of these 22 studies addressed the problem of confounding by indication, while seven studies did not. Nine studies used some form of instrumental variable analysis. In conclusion, the vast majority of observational studies that investigate treatment effects in older breast cancer patients compared treatments directly. These studies are therefore likely to be biased. Observational research will be essential to improve treatment and outcome of older breast cancer patients, but the use of accurate methods is essential to draw valid conclusions from this type of data. Copyright © 2015 Elsevier Ltd. All rights reserved.

Concurrent validity of different functional and neuroproteomic pain assessment methods in the rat osteoarthritis monosodium iodoacetate (MIA) model.

PubMed

Otis, Colombe; Gervais, Julie; Guillot, Martin; Gervais, Julie-Anne; Gauvin, Dominique; Péthel, Catherine; Authier, Simon; Dansereau, Marc-André; Sarret, Philippe; Martel-Pelletier, Johanne; Pelletier, Jean-Pierre; Beaudry, Francis; Troncy, Eric

2016-06-23

Lack of validity in osteoarthritis pain models and assessment methods is suspected. Our goal was to 1) assess the repeatability and reproducibility of measurement and the influence of environment, and acclimatization, to different pain assessment outcomes in normal rats, and 2) test the concurrent validity of the most reliable methods in relation to the expression of different spinal neuropeptides in a chemical model of osteoarthritic pain. Repeatability and inter-rater reliability of reflexive nociceptive mechanical thresholds, spontaneous static weight-bearing, treadmill, rotarod, and operant place escape/avoidance paradigm (PEAP) were assessed by the intraclass correlation coefficient (ICC). The most reliable acclimatization protocol was determined by comparing coefficients of variation. In a pilot comparative study, the sensitivity and responsiveness to treatment of the most reliable methods were tested in the monosodium iodoacetate (MIA) model over 21 days. Two MIA (2 mg) groups (including one lidocaine treatment group) and one sham group (0.9 % saline) received an intra-articular (50 μL) injection. No effect of environment (observer, inverted circadian cycle, or exercise) was observed; all tested methods except mechanical sensitivity (ICC <0.3), offered good repeatability (ICC ≥0.7). The most reliable acclimatization protocol included five assessments over two weeks. MIA-related osteoarthritic change in pain was demonstrated with static weight-bearing, punctate tactile allodynia evaluation, treadmill exercise and operant PEAP, the latter being the most responsive to analgesic intra-articular lidocaine. Substance P and calcitonin gene-related peptide were higher in MIA groups compared to naive (adjusted P (adj-P) = 0.016) or sham-treated (adj-P = 0.029) rats. Repeated post-MIA lidocaine injection resulted in 34 times lower downregulation for spinal substance P compared to MIA alone (adj-P = 0.029), with a concomitant increase of 17 % in time spent on the PEAP dark side (indicative of increased comfort). This study of normal rats and rats with pain established the most reliable and sensitive pain assessment methods and an optimized acclimatization protocol. Operant PEAP testing was more responsive to lidocaine analgesia than other tests used, while neuropeptide spinal concentration is an objective quantification method attractive to support and validate different centralized pain functional assessment methods.

Validation of the Portuguese self-administered computerised 24-hour dietary recall among second-, third- and fourth-grade children.

PubMed

Carvalho, M A; Baranowski, T; Foster, E; Santos, O; Cardoso, B; Rito, A; Pereira Miguel, J

2015-12-01

Current methods for assessing children's dietary intake, such as interviewer-administered 24-h dietary recall (24-h DR), are time consuming and resource intensive. Self-administered instruments offer a low-cost diet assessment method for use with children. The present study assessed the validity of the Portuguese self-administered, computerised, 24-h DR (PAC24) against the observation of school lunch. Forty-one, 7-10-year-old children from two elementary schools, in Lisbon, were observed during school lunch followed by completion of the PAC24 the next day. Accuracy for reporting items was measured in terms of matches, intrusions and omissions; accuracy for reporting amounts was measured in terms of arithmetic and absolute differences for matches and amounts for omissions and intrusions; and accuracy for reporting items and amounts combined was measured in terms of total inaccuracy. The ratio of the estimated weight of food consumed with the actual weight consumed was calculated along with the limits of agreement using the method of Bland and Altman. Comparison of PAC24 against observations at the food level resulted in values of 67.0% for matches, 11.5% for intrusions and 21.5% for omissions. The mean for total inaccuracy was 3.44 servings. For amounts, accuracy was high for matches (-0.17 and 0.23 servings for arithmetic and absolute differences, respectively) and lower for omissions (0.61 servings) and intrusions (0.55 servings). PAC24 was found to under-estimate the weight of food on average by 32% of actual intake. PAC24 is a lower-burden procedure for both respondents and researchers and, with slight modification, comprises a promising method for assessing diet among children. © 2014 The British Dietetic Association Ltd.

Prevalence of sarcopenia in elderly maintenance hemodialysis patients: the impact of different diagnostic criteria.

PubMed

Lamarca, F; Carrero, J J; Rodrigues, J C D; Bigogno, F G; Fetter, R L; Avesani, C M

2014-07-01

The prevalence of sarcopenia on elderly maintenance hemodialysis (MHD) has been scarcely investigated. To investigate the prevalence of decreased muscle mass and strength alone or combined (true sarcopenia) in elderly patients on MHD according to different methods and cutoff limits. Additionally, we evaluated the agreement between dual energy x-ray absorptiometry (DXA) and surrogate methods for the assessment of muscle mass. Observational and cross-sectional study. Non-institutionalized 102 elderly (age > 60 years) patients on MHD. Sarcopenia was considered when the patient fit one criteria for low muscle mass assessed by DXA, bioelectrical impedance (BIA), sum of skinfold thicknesses (SKF), calf circumference and mid-arm muscle circumference (MAMC) and one for low muscle strength evaluated by handgrip dynamometer. Decreased muscle strength was found in 85% of the patients. The prevalence of decreased muscle mass varied from 4 to 73.5% and of sarcopenia (decreased muscle mass and strength combined) from 4 to 63%, depending on the method and cutoff limit applied. A small percentage of patients (2 to 15%) were classified as sarcopenic by more than one diagnostic criteria. The agreement between DXA and the surrogate methods to assess muscle mass showed better kappa coefficients with BIA (r=0.36; P<0.01) and SKF (r=0.40; P<0.01). A wide prevalence of sarcopenia is observed depending on the method and cutoff limit applied. This may limit extrapolate on to clinical practice. BIA and SKF were the surrogate methods to assess muscle mass with the best concordance with DXA in elderly MHD patients.

Solving a methodological challenge in work stress evaluation with the Stress Assessment and Research Toolkit (StART): a study protocol.

PubMed

Guglielmi, Dina; Simbula, Silvia; Vignoli, Michela; Bruni, Ilaria; Depolo, Marco; Bonfiglioli, Roberta; Tabanelli, Maria Carla; Violante, Francesco Saverio

2013-06-22

Stress evaluation is a field of strong interest and challenging due to several methodological aspects in the evaluation process. The aim of this study is to propose a study protocol to test a new method (i.e., the Stress Assessment and Research Toolkit) to assess psychosocial risk factors at work. This method addresses several methodological issues (e.g., subjective vs. objective, qualitative vs quantitative data) by assessing work-related stressors using different kinds of data: i) organisational archival data (organisational indicators sheet); ii) qualitative data (focus group); iii) worker perception (questionnaire); and iv) observational data (observational checklist) using mixed methods research. In addition, it allows positive and negative aspects of work to be considered conjointly, using an approach that considers at the same time job demands and job resources. The integration of these sources of data can reduce the theoretical and methodological bias related to stress research in the work setting, allows researchers and professionals to obtain a reliable description of workers' stress, providing a more articulate vision of psychosocial risks, and allows a large amount of data to be collected. Finally, the implementation of the method ensures in the long term a primary prevention for psychosocial risk management in that it aims to reduce or modify the intensity, frequency or duration of organisational demands.

Solving a methodological challenge in work stress evaluation with the Stress Assessment and Research Toolkit (StART): a study protocol

PubMed Central

2013-01-01

Background Stress evaluation is a field of strong interest and challenging due to several methodological aspects in the evaluation process. The aim of this study is to propose a study protocol to test a new method (i.e., the Stress Assessment and Research Toolkit) to assess psychosocial risk factors at work. Design This method addresses several methodological issues (e.g., subjective vs. objective, qualitative vs quantitative data) by assessing work-related stressors using different kinds of data: i) organisational archival data (organisational indicators sheet); ii) qualitative data (focus group); iii) worker perception (questionnaire); and iv) observational data (observational checklist) using mixed methods research. In addition, it allows positive and negative aspects of work to be considered conjointly, using an approach that considers at the same time job demands and job resources. Discussion The integration of these sources of data can reduce the theoretical and methodological bias related to stress research in the work setting, allows researchers and professionals to obtain a reliable description of workers’ stress, providing a more articulate vision of psychosocial risks, and allows a large amount of data to be collected. Finally, the implementation of the method ensures in the long term a primary prevention for psychosocial risk management in that it aims to reduce or modify the intensity, frequency or duration of organisational demands. PMID:23799950

Improving satellite vulnerability assessment to untrackable orbital debris

NASA Astrophysics Data System (ADS)

Welty, Nathan; Schaefer, Frank; Rudolph, Martin; Destefanis, Roberto; Grassi, Lilith

2012-07-01

The projected growth in the untrackable orbital debris population will place an increased emphasis on satellite vulnerability assessments during both design and mission operations. This study presents an enhanced method for assessing satellite vulnerability to untrackable orbital debris that expands on traditional practices. By looking beyond structural penetration of the spacecraft, the method predicts the survivability of individual components and the associated degradation of system functionality resulting from untrackable debris impacts. A new risk assessment tool, the Particle Impact Risk and Vulnerability Assessment Tool (PIRAT), has been developed based on this method and is also presented here. It interfaces with both the NASA ORDEM2000 and ESA MASTER-2009 debris models and has been validated against the benchmark test cases from the Inter-Agency Space Debris Coordination Committee (IADC). This study concludes with an example vulnerability assessment using PIRAT for a generic Earth observation satellite in a Sun-synchronous low-Earth orbit. The results illustrate the additional insight provided by this method that can be used to improve the robustness of future satellite designs and mitigate the overall mission risk posed by untrackable orbital debris.

Reconstructing El Niño Southern Oscillation using data from ships' logbooks, 1815-1854. Part I: methodology and evaluation

NASA Astrophysics Data System (ADS)

Barrett, Hannah G.; Jones, Julie M.; Bigg, Grant R.

2018-02-01

The meteorological information found within ships' logbooks is a unique and fascinating source of data for historical climatology. This study uses wind observations from logbooks covering the period 1815 to 1854 to reconstruct an index of El Niño Southern Oscillation (ENSO) for boreal winter (DJF). Statistically-based reconstructions of the Southern Oscillation Index (SOI) are obtained using two methods: principal component regression (PCR) and composite-plus-scale (CPS). Calibration and validation are carried out over the modern period 1979-2014, assessing the relationship between re-gridded seasonal ERA-Interim reanalysis wind data and the instrumental SOI. The reconstruction skill of both the PCR and CPS methods is found to be high with reduction of error skill scores of 0.80 and 0.75, respectively. The relationships derived during the fitting period are then applied to the logbook wind data to reconstruct the historical SOI. We develop a new method to assess the sensitivity of the reconstructions to using a limited number of observations per season and find that the CPS method performs better than PCR with a limited number of observations. A difference in the distribution of wind force terms used by British and Dutch ships is found, and its impact on the reconstruction assessed. The logbook reconstructions agree well with a previous SOI reconstructed from Jakarta rain day counts, 1830-1850, adding robustness to our reconstructions. Comparisons to additional documentary and proxy data sources are provided in a companion paper.

National Ecosystem Assessments in Europe: A Review

PubMed Central

Schröter, Matthias; Albert, Christian; Marques, Alexandra; Tobon, Wolke; Lavorel, Sandra; Maes, Joachim; Brown, Claire; Klotz, Stefan; Bonn, Aletta

2016-01-01

Abstract National ecosystem assessments form an essential knowledge base for safeguarding biodiversity and ecosystem services. We analyze eight European (sub-)national ecosystem assessments (Portugal, United Kingdom, Spain, Norway, Flanders, Netherlands, Finland, and Germany) and compare their objectives, political context, methods, and operationalization. We observed remarkable differences in breadth of the assessment, methods employed, variety of services considered, policy mandates, and funding mechanisms. Biodiversity and ecosystem services are mainly assessed independently, with biodiversity conceptualized as underpinning services, as a source of conflict with services, or as a service in itself. Recommendations derived from our analysis for future ecosystem assessments include the needs to improve the common evidence base, to advance the mapping of services, to consider international flows of services, and to connect more strongly to policy questions. Although the context specificity of national ecosystem assessments is acknowledged as important, a greater harmonization across assessments could help to better inform common European policies and future pan-regional assessments. PMID:28533561

Outcomes assessment in men undergoing open retropubic radical prostatectomy, laparoscopic radical prostatectomy, and robotic-assisted radical prostatectomy.

PubMed

Kowalczyk, Keith J; Yu, Hua-Yin; Ulmer, William; Williams, Stephen B; Hu, Jim C

2012-02-01

To review the various methods of outcomes assessment used for effectiveness studies comparing retropubic radical prostatectomy (RRP), laparoscopic radical prostatectomy (LRP), and robotic-assisted laparoscopic prostatectomy (RALP). A review of the peer reviewed literature was performed for reported series of RRP, LRP, and RALP using Pubmed and MEDLINE with emphasis on comparing perioperative, functional, and oncologic outcomes. Common methods used for outcomes assessment were categorized and compared, highlighting the pros and cons of each approach. The majority of the literature comparing RRP, LRP, and RALP comes in the form of observational data or administrative data from secondary datasets. While randomized controlled trials are ideal for outcomes assessment, only one such study was identified and was limited. Non-randomized observational studies contribute to the majority of data, however are limited due to retrospective study design, lack of consistent endpoints, and limited application to the general community. Administrative data provide accurate assessment of operative outcomes in both academic and community settings, however has limited ability to convey accurate functional outcomes. Non-randomized observational studies and secondary data are useful resources for assessment of outcomes; however, limitations exist for both. Neither is without flaws, and conclusions drawn from either should be viewed with caution. Until standardized prospective comparative analyses of RRP, LRP, and RALP are established, comparative outcomes data will remain imperfect. Urologic researchers must strive to provide the best available outcomes data through accurate prospective data collection and consistent outcomes reporting.

Comparison of performance-based assessment and real world skill in people with serious mental illness: Ecological validity of the Test of Grocery Shopping Skills.

PubMed

Faith, Laura A; Rempfer, Melisa V

2018-05-07

Valid functional measures are essential for clinical and research efforts that address recovery and community functioning in people with serious mental illness. Although there is a great deal of interest in functional assessment, there is limited research supporting how well current evaluation methods provide a true assessment of real world functioning or naturalistic behavior. To address this gap in the literature, the present study examined the performance of individuals with serious mental illness (i.e., diagnosis of schizophrenia-spectrum, bipolar disorder, or other depression/anxiety diagnoses and accompanying functional disability) on the Test of Grocery Shopping Skills (TOGSS), a performance-based naturalistic task. We compared TOGSS performance to two dimensions of real world functioning: directly observed real world grocery shopping and ratings of community functioning. Results indicated that the TOGSS was significantly associated with real life grocery shopping, in terms of both shopping accuracy (r = 0.424) and time (r = 0.491). Further, self-report and observer-rated methods of assessing real world shopping behaviors were significantly correlated (r = 0.455). To our knowledge, this is one of the first studies to directly compare a performance-based naturalistic skill assessment with carefully observed real world performance of that skill in people with serious mental illness. These findings support the feasibility and ecological validity of performance-based naturalistic assessment with the TOGSS. Copyright © 2018 Elsevier B.V. All rights reserved.

Geo-spatial Informatics in International Public Health Nursing Education.

PubMed

Kerr, Madeleine J; Honey, Michelle L L; Krzyzanowski, Brittany

2016-01-01

This poster describes results of an undergraduate nursing informatics experience. Students applied geo-spatial methods to community assessments in two urban regions of New Zealand and the United States. Students used the Omaha System standardized language to code their observations during a brief community assessment activity and entered their data into a mapping program developed in Esri ArcGIS Online, a geographic information system. Results will be displayed in tables and maps to allow comparison among the communities. The next generation of nurses can employ geo-spatial informatics methods to contribute to innovative community assessment, planning and policy development.

Assessing Tradeoffs between Observational and Experimental Designs for Charter School Research. Program on Education Policy and Governance Working Papers Series. PEPG 15-04

ERIC Educational Resources Information Center

Ackerman, Matthew; Egalite, Anna J.

2015-01-01

When lotteries are infeasible, researchers must rely on observational methods to estimate charter effectiveness at raising student test scores. Considerable attention has been paid to observational studies by the Stanford Center for Research on Education Outcomes (CREDO), which have analyzed charter performance in 27 states. However, the…

Quantifying Peer Interactions for Research and Clinical Use: The Manchester Inventory for Playground Observation

ERIC Educational Resources Information Center

Gibson, Jenny; Hussain, Jamilla; Holsgrove, Samina; Adams, Catherine; Green, Jonathan

2011-01-01

Direct observation of peer relating is potentially a sensitive and ecologically valid measure of child social functioning, but there has been a lack of standardised methods. The Manchester Inventory for Playground Observation (MIPO) was developed as a practical yet rigorous assessment of this kind for 5-11 year olds. We report on the initial…

Development of Creative Behavior Observation Form: A Study on Validity and Reliability

ERIC Educational Resources Information Center

Dere, Zeynep; Ömeroglu, Esra

2018-01-01

This study, Creative Behavior Observation Form was developed to assess creativity of the children. While the study group on the reliability and validity of Creative Behavior Observation Form was being developed, 257 children in total who were at the ages of 5-6 were used as samples with stratified sampling method. Content Validity Index (CVI) and…

Probing Needs Assessment Data in Depth to Target Programs More Effectively

ERIC Educational Resources Information Center

Skelly, JoAnne; Hill, George; Singletary, Loretta

2014-01-01

Extension professionals often assess community needs to determine programs and target audiences. Data can be collected through surveys, focus group and individual interviews, meta-analysis, systematic observation, and other methods. Knowledge gaps are identified, and programs are designed to resolve the deficiencies. However, do Extension…

The Lay Assessment of Subclinical Depression in Daily Life

ERIC Educational Resources Information Center

Mehl, Matthias R.

2006-01-01

This study examined how laypersons assess subclinical depression in others on the basis of information about their daily lives. For 2 days, 96 participants were tracked with the Electronically Activated Recorder, a naturalistic observation method that samples ambient sounds from participants' momentary environments. Judges rated participants'…

Story-Telling: A Method for Assessing Children's Creativity.

ERIC Educational Resources Information Center

Hennessey, Beth Ann; Amabile, Teresa M.

1988-01-01

The subjective judgment of observers was used to assess verbal creativity. Students, aged 5-10, told a story to accompany a picture series. Teachers rated the stories relative to one another. Interjudge reliability of the creativity measure was highly satisfactory. Two subsequent studies affirmed the results, with slightly lower interjudge…

Diagnosis of vertical motions from VAS retrievals during a convective outbreak

NASA Technical Reports Server (NTRS)

Funk, T. W.; Fuelberg, H. E.

1985-01-01

GOES-VAS satellite retrievals are used to investigate an intense convective outbreak over the Mississippi River Valley on 21-22 July 1982. The primary goals are to assess the strengths and weaknesses of three methods for computing vertical motion using satellite retrievals and to determine the effects of short interval observations on the calculations. Then, the vertical motions are incorporated with thermodynamic parameters to assess the usefulness of VAS data in delineating factors leading to storm formation. Results indicate that the quasi-geotrophic omega equation provided patterns and magnitudes most consistent with observed weather events and the 12 h radiosonde-derived motions. The vorticity method generally produced reasonable patterns, especially over the convective outbreak, although magnitudes were large due to its time derivative.

The Chandra Source Catalog: Source Variability

NASA Astrophysics Data System (ADS)

Nowak, Michael; Rots, A. H.; McCollough, M. L.; Primini, F. A.; Glotfelty, K. J.; Bonaventura, N. R.; Chen, J. C.; Davis, J. E.; Doe, S. M.; Evans, J. D.; Fabbiano, G.; Galle, E.; Gibbs, D. G.; Grier, J. D.; Hain, R.; Hall, D. M.; Harbo, P. N.; He, X.; Houck, J. C.; Karovska, M.; Lauer, J.; McDowell, J. C.; Miller, J. B.; Mitschang, A. W.; Morgan, D. L.; Nichols, J. S.; Plummer, D. A.; Refsdal, B. L.; Siemiginowska, A. L.; Sundheim, B. A.; Tibbetts, M. S.; Van Stone, D. W.; Winkelman, S. L.; Zografou, P.

2009-01-01

The Chandra Source Catalog (CSC) contains fields of view that have been studied with individual, uninterrupted observations that span integration times ranging from 1 ksec to 160 ksec, and a large number of which have received (multiple) repeat observations days to years later. The CSC thus offers an unprecedented look at the variability of the X-ray sky over a broad range of time scales, and across a wide diversity of variable X-ray sources: stars in the local galactic neighborhood, galactic and extragalactic X-ray binaries, Active Galactic Nuclei, etc. Here we describe the methods used to identify and quantify source variability within a single observation, and the methods used to assess the variability of a source when detected in multiple, individual observations. Three tests are used to detect source variability within a single observation: the Kolmogorov-Smirnov test and its variant, the Kuiper test, and a Bayesian approach originally suggested by Gregory and Loredo. The latter test not only provides an indicator of variability, but is also used to create a best estimate of the variable lightcurve shape. We assess the performance of these tests via simulation of statistically stationary, variable processes with arbitrary input power spectral densities (here we concentrate on results of red noise simulations) at variety of mean count rates and fractional root mean square variabilities relevant to CSC sources. We also assess the false positive rate via simulations of constant sources whose sole source of fluctuation is Poisson noise. We compare these simulations to a preliminary assessment of the variability found in real CSC sources, and estimate the variability sensitivities of the CSC.

The Chandra Source Catalog: Source Variability

NASA Astrophysics Data System (ADS)

Nowak, Michael; Rots, A. H.; McCollough, M. L.; Primini, F. A.; Glotfelty, K. J.; Bonaventura, N. R.; Chen, J. C.; Davis, J. E.; Doe, S. M.; Evans, J. D.; Evans, I.; Fabbiano, G.; Galle, E. C.; Gibbs, D. G., II; Grier, J. D.; Hain, R.; Hall, D. M.; Harbo, P. N.; He, X.; Houck, J. C.; Karovska, M.; Lauer, J.; McDowell, J. C.; Miller, J. B.; Mitschang, A. W.; Morgan, D. L.; Nichols, J. S.; Plummer, D. A.; Refsdal, B. L.; Siemiginowska, A. L.; Sundheim, B. A.; Tibbetts, M. S.; van Stone, D. W.; Winkelman, S. L.; Zografou, P.

2009-09-01

The Chandra Source Catalog (CSC) contains fields of view that have been studied with individual, uninterrupted observations that span integration times ranging from 1 ksec to 160 ksec, and a large number of which have received (multiple) repeat observations days to years later. The CSC thus offers an unprecedented look at the variability of the X-ray sky over a broad range of time scales, and across a wide diversity of variable X-ray sources: stars in the local galactic neighborhood, galactic and extragalactic X-ray binaries, Active Galactic Nuclei, etc. Here we describe the methods used to identify and quantify source variability within a single observation, and the methods used to assess the variability of a source when detected in multiple, individual observations. Three tests are used to detect source variability within a single observation: the Kolmogorov-Smirnov test and its variant, the Kuiper test, and a Bayesian approach originally suggested by Gregory and Loredo. The latter test not only provides an indicator of variability, but is also used to create a best estimate of the variable lightcurve shape. We assess the performance of these tests via simulation of statistically stationary, variable processes with arbitrary input power spectral densities (here we concentrate on results of red noise simulations) at variety of mean count rates and fractional root mean square variabilities relevant to CSC sources. We also assess the false positive rate via simulations of constant sources whose sole source of fluctuation is Poisson noise. We compare these simulations to an assessment of the variability found in real CSC sources, and estimate the variability sensitivities of the CSC.

Quantifying Soiling Loss Directly From PV Yield

DOE PAGES

Deceglie, Michael G.; Micheli, Leonardo; Muller, Matthew

2018-01-23

Soiling of photovoltaic (PV) panels is typically quantified through the use of specialized sensors. Here, we describe and validate a method for estimating soiling loss experienced by PV systems directly from system yield without the need for precipitation data. The method, termed the stochastic rate and recovery (SRR) method, automatically detects soiling intervals in a dataset, then stochastically generates a sample of possible soiling profiles based on the observed characteristics of each interval. In this paper, we describe the method, validate it against soiling station measurements, and compare it with other PV-yield-based soiling estimation methods. The broader application of themore » SRR method will enable the fleet scale assessment of soiling loss to facilitate mitigation planning and risk assessment.« less

Quantifying Soiling Loss Directly From PV Yield

DOE Office of Scientific and Technical Information (OSTI.GOV)

Deceglie, Michael G.; Micheli, Leonardo; Muller, Matthew

Soiling of photovoltaic (PV) panels is typically quantified through the use of specialized sensors. Here, we describe and validate a method for estimating soiling loss experienced by PV systems directly from system yield without the need for precipitation data. The method, termed the stochastic rate and recovery (SRR) method, automatically detects soiling intervals in a dataset, then stochastically generates a sample of possible soiling profiles based on the observed characteristics of each interval. In this paper, we describe the method, validate it against soiling station measurements, and compare it with other PV-yield-based soiling estimation methods. The broader application of themore » SRR method will enable the fleet scale assessment of soiling loss to facilitate mitigation planning and risk assessment.« less

Visual assessment of breast density using Visual Analogue Scales: observer variability, reader attributes and reading time

NASA Astrophysics Data System (ADS)

Ang, Teri; Harkness, Elaine F.; Maxwell, Anthony J.; Lim, Yit Y.; Emsley, Richard; Howell, Anthony; Evans, D. Gareth; Astley, Susan; Gadde, Soujanya

2017-03-01

Breast density is a strong risk factor for breast cancer and has potential use in breast cancer risk prediction, with subjective methods of density assessment providing a strong relationship with the development of breast cancer. This study aims to assess intra- and inter-observer variability in visual density assessment recorded on Visual Analogue Scales (VAS) among trained readers, and examine whether reader age, gender and experience are associated with assessed density. Eleven readers estimated the breast density of 120 mammograms on two occasions 3 years apart using VAS. Intra- and inter-observer agreement was assessed with Intraclass Correlation Coefficient (ICC) and variation between readers visualised on Bland-Altman plots. The mean scores of all mammograms per reader were used to analyse the effect of reader attributes on assessed density. Excellent intra-observer agreement (ICC>0.80) was found in the majority of the readers. All but one reader had a mean difference of <10 percentage points from the first to the second reading. Inter-observer agreement was excellent for consistency (ICC 0.82) and substantial for absolute agreement (ICC 0.69). However, the 95% limits of agreement for pairwise differences were -6.8 to 15.7 at the narrowest and 0.8 to 62.3 at the widest. No significant association was found between assessed density and reader age, experience or gender, or with reading time. Overall, the readers were consistent in their scores, although some large variations were observed. Reader evaluation and targeted training may alleviate this problem.

Evaluation of medical management during a mass casualty incident exercise: an objective assessment tool to enhance direct observation.

PubMed

Ingrassia, Pier Luigi; Prato, Federico; Geddo, Alessandro; Colombo, Davide; Tengattini, Marco; Calligaro, Sara; La Mura, Fabrizio; Franc, Jeffrey Michael; Della Corte, Francesco

2010-11-01

Functional exercises represent an important link between disaster planning and disaster response. Although these exercises are widely performed, no standardized method exists for their evaluation. To describe a simple and objective method to assess medical performance during functional exercise events. An evaluation tool comprising three data fields (triage, clinical maneuvers, and radio usage), accompanied by direct anecdotal observational methods, was used to evaluate a large functional mass casualty incident exercise. Seventeen medical responders managed 112 victims of a simulated building explosion. Although 81% of the patients were assigned the appropriate triage codes, evacuation from the site did not follow in priority. Required maneuvers were performed correctly in 85.2% of airway maneuvers and 78.7% of breathing maneuvers, however, significant under-treatment occurred, possibly due to equipment shortages. Extensive use of radio communication was documented. In evaluating this tool, the structured markers were informative, but further information provided by direct observation was invaluable. A three-part tool (triage, medical maneuvers, and radio usage) can provide a method to evaluate functional mass casualty incident exercises, and is easily implemented. For the best results, it should be used in conjunction with direct observation. The evaluation tool has great potential as a reproducible and internationally recognized tool for evaluating disaster management exercises. Copyright © 2010 Elsevier Inc. All rights reserved.

Evaluation of the Technical Adequacy of Three Methods for Identifying Specific Learning Disabilities Based on Cognitive Discrepancies

ERIC Educational Resources Information Center

Stuebing, Karla K.; Fletcher, Jack M.; Branum-Martin, Lee; Francis, David J.

2012-01-01

This study used simulation techniques to evaluate the technical adequacy of three methods for the identification of specific learning disabilities via patterns of strengths and weaknesses in cognitive processing. Latent and observed data were generated and the decision-making process of each method was applied to assess concordance in…

A rapid method to assess grape rust mites on leaves and observations from case studies in western Oregon vineyards

USDA-ARS?s Scientific Manuscript database

A rapid method for extracting eriophyoid mites was adapted from previous studies to provide growers and IPM consultants with a practical, efficient, and reliable tool to monitor for rust mites in vineyards. The rinse in bag (RIB) method allows quick extraction of mites from collected plant parts (sh...

Investigating Surface and Near-Surface Bushfire Fuel Attributes: A Comparison between Visual Assessments and Image-Based Point Clouds.

PubMed

Spits, Christine; Wallace, Luke; Reinke, Karin

2017-04-20

Visual assessment, following guides such as the Overall Fuel Hazard Assessment Guide (OFHAG), is a common approach for assessing the structure and hazard of varying bushfire fuel layers. Visual assessments can be vulnerable to imprecision due to subjectivity between assessors, while emerging techniques such as image-based point clouds can offer land managers potentially more repeatable descriptions of fuel structure. This study compared the variability of estimates of surface and near-surface fuel attributes generated by eight assessment teams using the OFHAG and Fuels3D, a smartphone method utilising image-based point clouds, within three assessment plots in an Australian lowland forest. Surface fuel hazard scores derived from underpinning attributes were also assessed. Overall, this study found considerable variability between teams on most visually assessed variables, resulting in inconsistent hazard scores. Variability was observed within point cloud estimates but was, however, on average two to eight times less than that seen in visual estimates, indicating greater consistency and repeatability of this method. It is proposed that while variability within the Fuels3D method may be overcome through improved methods and equipment, inconsistencies in the OFHAG are likely due to the inherent subjectivity between assessors, which may be more difficult to overcome. This study demonstrates the capability of the Fuels3D method to efficiently and consistently collect data on fuel hazard and structure, and, as such, this method shows potential for use in fire management practices where accurate and reliable data is essential.

PEOR--Engaging Students in Demonstrations

ERIC Educational Resources Information Center

Bonello, Charles; Scaife, Jon

2009-01-01

Demonstrations are a core part of science teaching. In 1980 a three-part assessment method using demonstrating was proposed. Known as DOE this consisted of demonstration, observation and explanation. DOE quickly evolved into POE: predict, observe, explain. In the light of experiences with POE and insights from constructivist theory we set out in…

Administrators' Perceptions Regarding the Effectiveness of the Teacher Observation Evaluation System

ERIC Educational Resources Information Center

Williams, Kathleen Riley

2015-01-01

This phenomenological narrative study was designed to explore public school administrators' perceptions regarding Louisiana's Compass teacher observation evaluation system as a method for assessing teacher performance. Participants were administrators with at least two years of experience as a public school administrator at the secondary level,…

Impact of water use efficiency parameterization on partitioning evapotranspiration with the eddy covariance flux variance method

USDA-ARS?s Scientific Manuscript database

Partitioned observations of evapotranspiration (ET) into its constituent components of soil and canopy evaporation (E) and plant transpiration (T) are needed to validate many agricultural water use models. E and T observations are also useful for assessing management practices to reduce crop water ...

Concurrent Validity Between Live and Home Video Observations Using the Alberta Infant Motor Scale.

PubMed

Boonzaaijer, Marike; van Dam, Ellen; van Haastert, Ingrid C; Nuysink, Jacqueline

2017-04-01

Serial assessment of gross motor development of infants at risk is an established procedure in neonatal follow-up clinics. Assessments based on home video recordings could be a relevant addition. In 48 infants (1.5-19 months), the concurrent validity of 2 applications was examined using the Alberta Infant Motor Scale: (1) a home video made by parents and (2) simultaneous observation on-site by a pediatric physical therapist. Parents' experiences were explored using a questionnaire. The intraclass correlation coefficient agreement between live and home video assessment was 0.99, with a standard error of measurement of 1.41 items. Intra- and interrater reliability: intraclass correlation coefficients were more than 0.99. According to 94% of the parents, recording their infant's movement repertoire was easy to perform. Assessing the Alberta Infant Motor Scale based on home video recordings is comparable to assessment by live observation. The video method is a promising application that can be used with low burden for parents and infants.

[Risk assessment comparison of biomechanical overloading of the musculoskeletal system: 10 years' applied experience].

PubMed

Sala, Emma; Bonfiglioli, Roberta; Fostinellil, Jacopo; Tomasi, Cesare; Graziosi, Francesca; Violante, Francesco S; Apostoli, Pietro

2014-01-01

Risk assessment for upper extremity work related muscoloskeletal disorders by applying six methods of ergonomic: a ten years experience. The objective of this research was to verify and validate the multiple step method suggested by SIMLII guidelines and to compare results obtained by use of these methods: Washington State Standard, OCRA, HAL, RULA, OREGE and STRAIN INDEX. 598 workstations for a total of 1800 analysis by different methods were considered, by adopting the following multiple step procedure: prelinminary evaluation by Washington State method and OCRA checklist in all the working stations, RULA or HAL as first level evaluation, OREGE or SI as second level evaluation. The preliminary evaluation resulted negative (risk absent) in the 75% of examined work stations and by using checklist OCRA optimal-acceptable condition was found in 58% by HAL in 92% of analysis, by RULA in 100%, by OREGE in 64%; by SI in 70% of examined working positions. We observed similar evaluation of strain among methods and main differences have been observed in posture and frequency assessment. The preliminary evaluation by State of Washington method appears to be an adequate instrument for identify the working condition at risk. All the adopted methods were in a good agreement in two estreme situations: high risk or absent risk, expecially in absent risk conditions. Level of accordance varied on the basis of their rationale and of the role of their different components so SIML indications about the critical use of biouzechanical methods and about the possible use of more than one of them (considering working chlaracteristics) have been confirmed.

Image quality assessment using deep convolutional networks

NASA Astrophysics Data System (ADS)

Li, Yezhou; Ye, Xiang; Li, Yong

2017-12-01

This paper proposes a method of accurately assessing image quality without a reference image by using a deep convolutional neural network. Existing training based methods usually utilize a compact set of linear filters for learning features of images captured by different sensors to assess their quality. These methods may not be able to learn the semantic features that are intimately related with the features used in human subject assessment. Observing this drawback, this work proposes training a deep convolutional neural network (CNN) with labelled images for image quality assessment. The ReLU in the CNN allows non-linear transformations for extracting high-level image features, providing a more reliable assessment of image quality than linear filters. To enable the neural network to take images of any arbitrary size as input, the spatial pyramid pooling (SPP) is introduced connecting the top convolutional layer and the fully-connected layer. In addition, the SPP makes the CNN robust to object deformations to a certain extent. The proposed method taking an image as input carries out an end-to-end learning process, and outputs the quality of the image. It is tested on public datasets. Experimental results show that it outperforms existing methods by a large margin and can accurately assess the image quality on images taken by different sensors of varying sizes.

Evaluation of ergonomic physical risk factors in a truck manufacturing plant: case study in SCANIA Production Angers

PubMed Central

ZARE, Mohsen; MALINGE-OUDENOT, Agnes; HÖGLUND, Robert; BIAU, Sophie; ROQUELAURE, Yves

2015-01-01

The aims of this study were 1) to assess the ergonomic physical risk factors from practitioner’s viewpoint in a truck assembly plant with an in-house observational method and the NIOSH lifting equation, and 2) to compare the results of both methods and their differences. The in-house ergonomic observational method for truck assembly i.e. the SCANIA Ergonomics Standard (SES) and the NIOSH lifting equation were applied to evaluate physical risk factors and lifting of loads by operators. Both risk assessment approaches revealed various levels of risk, ranging from low to high. Two workstations were identified by the SES method as high risk. The NIOSH lifting index (LI) was greater than two for four lifting tasks. The results of the SES method disagreed with the NIOSH lifting equation for lifting tasks. Moreover, meaningful variations in ergonomic risk patterns were found for various truck models at each workstation. These results provide a better understanding of the physical ergonomic exposure from practitioner’s point of view in the automotive assembly plant. PMID:26423331

Evaluation of ergonomic physical risk factors in a truck manufacturing plant: case study in SCANIA Production Angers.

PubMed

Zare, Mohsen; Malinge-Oudenot, Agnes; Höglund, Robert; Biau, Sophie; Roquelaure, Yves

2016-01-01

The aims of this study were 1) to assess the ergonomic physical risk factors from practitioner's viewpoint in a truck assembly plant with an in-house observational method and the NIOSH lifting equation, and 2) to compare the results of both methods and their differences. The in-house ergonomic observational method for truck assembly i.e. the SCANIA Ergonomics Standard (SES) and the NIOSH lifting equation were applied to evaluate physical risk factors and lifting of loads by operators. Both risk assessment approaches revealed various levels of risk, ranging from low to high. Two workstations were identified by the SES method as high risk. The NIOSH lifting index (LI) was greater than two for four lifting tasks. The results of the SES method disagreed with the NIOSH lifting equation for lifting tasks. Moreover, meaningful variations in ergonomic risk patterns were found for various truck models at each workstation. These results provide a better understanding of the physical ergonomic exposure from practitioner's point of view in the automotive assembly plant.

Neuroimaging supports behavioral personality assessment: Overlapping activations during reflective and impulsive risk taking.

PubMed

Pletzer, Belinda; M Ortner, Tuulia

2016-09-01

Personality assessment has been challenged by the fact that different assessment methods (implicit measures, behavioral measures and explicit rating scales) show little or no convergence in behavioral studies. In this neuroimaging study we address for the first time, whether different assessment methods rely on separate or overlapping neuronal systems. Fifty nine healthy adult participants completed two objective personality tests of risk propensity: the more implicit Balloon Analogue Risk Task (BART) and the more explicit Game of Dice Task (GDT). Significant differences in activation, as well as connectivity patterns between both tasks were observed. In both tasks, risky decisions yielded significantly stronger activations than safe decisions in the bilateral caudate, as well as the bilateral Insula. The finding of overlapping brain areas validates different assessment methods, despite their behavioral non-convergence. This suggests that neuroimaging can be an important tool of validation in the field of personality assessment. Copyright © 2016 Elsevier B.V. All rights reserved.

Assessing Extratropical Influence on Tropical Climatology and Variability with Regional Coupled Data Assimilation

NASA Astrophysics Data System (ADS)

Lu, F.; Liu, Z.; Liu, Y.; Zhang, S.; Jacob, R. L.

2017-12-01

The Regional Coupled Data Assimilation (RCDA) method is introduced as a tool to study coupled climate dynamics and teleconnections. The RCDA method is built on an ensemble-based coupled data assimilation (CDA) system in a coupled general circulation model (CGCM). The RCDA method limits the data assimilation to the desired model components (e.g. atmosphere) and regions (e.g. the extratropics), and studies the ensemble-mean model response (e.g. tropical response to "observed" extratropical atmospheric variability). When applied to the extratropical influence on tropical climate, the RCDA method has shown some unique advantages, namely the combination of a fully coupled model, real-world observations and an ensemble approach. Tropical variability (e.g. El Niño-Southern Oscillation or ENSO) and climatology (e.g. asymmetric Inter-Tropical Convergence Zone or ITCZ) were initially thought to be determined mostly by local forcing and ocean-atmosphere interaction in the tropics. Since late 20th century, numerous studies have showed that extratropical forcing could affect, or even largely determine some aspects of the tropical climate. Due to the coupled nature of the climate system, however, the challenge of determining and further quantifying the causality of extratropical forcing on the tropical climate remains. Using the RCDA method, we have demonstrated significant control of extratropical atmospheric forcing on ENSO variability in a CGCM, both with model-generated and real-world observation datasets. The RCDA method has also shown robust extratropical impact on the tropical double-ITCZ bias in a CGCM. The RCDA method has provided the first systematic and quantitative assessment of extratropical influence on tropical climatology and variability by incorporating real world observations in a CGCM.

Parent-rated externalizing behavior in preschoolers: the predictive utility of structured interviews, teacher reports, and classroom observations.

PubMed

Doctoroff, Greta L; Arnold, David H

2004-12-01

This study investigated multiple forms of home and school assessment as predictors of parent-rated behavior problems across a preschool year. Participants were a community sample of 79 preschool children, their parents, and their teachers. Parent ratings of behavior problems were obtained toward the beginning of the school year and approximately 6 months later. Behavior problems were also assessed early in the school year using parent structured interviews, teacher-rating scales, and classroom observations of problem and prosocial behavior. Consistent with hypotheses, each assessment method significantly predicted year-end parent ratings of behavior problems, even above initial ratings.

Observational studies in systematic [corrected] reviews of comparative effectiveness: AHRQ and the Effective Health Care Program.

PubMed

Norris, Susan L; Atkins, David; Bruening, Wendy; Fox, Steven; Johnson, Eric; Kane, Robert; Morton, Sally C; Oremus, Mark; Ospina, Maria; Randhawa, Gurvaneet; Schoelles, Karen; Shekelle, Paul; Viswanathan, Meera

2011-11-01

Systematic reviewers disagree about the ability of observational studies to answer questions about the benefits or intended effects of pharmacotherapeutic, device, or procedural interventions. This study provides a framework for decision making on the inclusion of observational studies to assess benefits and intended effects in comparative effectiveness reviews (CERs). The conceptual model and recommendations were developed using a consensus process by members of the methods workgroup of the Effective Health Care Program of the Agency for Healthcare Research and Quality. In considering whether to use observational studies in CERs for addressing beneficial effects, reviewers should answer two questions: (1) Are there gaps in the evidence from randomized controlled trials (RCTs)? (2) Will observational studies provide valid and useful information? The latter question involves the following: (a) refocusing the study questions on gaps in the evidence from RCTs, (b) assessing the risk of bias of the body of evidence of observational studies, and (c) assessing whether available observational studies address the gap review questions. Because it is unusual to find sufficient evidence from RCTs to answer all key questions concerning benefit or the balance of benefits and harms, comparative effectiveness reviewers should routinely assess the appropriateness of inclusion of observational studies for questions of benefit. Furthermore, reviewers should explicitly state the rationale for inclusion or exclusion of observational studies when conducting CERs. Copyright © 2011 Elsevier Inc. All rights reserved.

Accuracy and Utility of Estimating Lean Body Mass and Nutritional Status in Patients with Chronic Kidney Disease on Long-Term Hemodialysis Using Anthropometric Skinfold Thickness Measurements.

PubMed

Leong, Khai Gene; Chee, Jia Lian; Karahalios, Amalia; Skelley, Annabelle; Wong, Kim

2018-01-01

Malnutrition is common in patients on hemodialysis (prevalence of 30% to 50%) and is associated with higher mortality. Lean body mass (LBM) assessment is an accurate way of assessing nutritional status. The dual-energy X-ray absorptiometry (DEXA) scan is a reliable method in assessing body compositions and LBM; however, it is expensive and largely inaccessible. Anthropometric skinfold thickness measurement (ASFM) is useful in assessing LBM. It is cheaper and accessible, but underutilized clinically. The subjective global score (SGA) is a well-established method of assessing nutritional status. All three methods of assessing nutritional status were compared. In this pilot observational study, there was a significant correlation between LBM% estimated by DEXA and ASFM (mean difference -1.46% [95% CI -4.09 to 1.18]; LOA -14.0 to 11.1). Nutritional status by SGA could only detect those severely malnourished when using LBM% by ASFM as comparison. Our study demonstrated that ASFM is a useful method of assessing LBM and nutritional status, which can be easily utilized clinically. Copyright© by the American Nephrology Nurses Association.

Developing an expert panel process to refine health outcome definitions in observational data.

PubMed

Fox, Brent I; Hollingsworth, Joshua C; Gray, Michael D; Hollingsworth, Michael L; Gao, Juan; Hansen, Richard A

2013-10-01

Drug safety surveillance using observational data requires valid adverse event, or health outcome of interest (HOI) measurement. The objectives of this study were to develop a method to review HOI definitions in claims databases using (1) web-based digital tools to present de-identified patient data, (2) a systematic expert panel review process, and (3) a data collection process enabling analysis of concepts-of-interest that influence panelists' determination of HOI. De-identified patient data were presented via an interactive web-based dashboard to enable case review and determine if specific HOIs were present or absent. Criteria for determining HOIs and their severity were provided to each panelist. Using a modified Delphi method, six panelist pairs independently reviewed approximately 200 cases across each of three HOIs (acute liver injury, acute kidney injury, and acute myocardial infarction) such that panelist pairs independently reviewed the same cases. Panelists completed an assessment within the dashboard for each case that included their assessment of the presence or absence of the HOI, HOI severity (if present), and data contributing to their decision. Discrepancies within panelist pairs were resolved during a consensus process. Dashboard development was iterative, focusing on data presentation and recording panelists' assessments. Panelists reported quickly learning how to use the dashboard. The assessment module was used consistently. The dashboard was reliable, enabling an efficient review process for panelists. Modifications were made to the dashboard and review process when necessary to facilitate case review. Our methods should be applied to other health outcomes of interest to further refine the dashboard and case review process. The expert review process was effective and was supported by the web-based dashboard. Our methods for case review and classification can be applied to future methods for case identification in observational data sources. Copyright © 2013 Elsevier Inc. All rights reserved.

Biometrical issues in the analysis of adverse events within the benefit assessment of drugs.

PubMed

Bender, Ralf; Beckmann, Lars; Lange, Stefan

2016-07-01

The analysis of adverse events plays an important role in the benefit assessment of drugs. Consequently, results on adverse events are an integral part of reimbursement dossiers submitted by pharmaceutical companies to health policy decision-makers. Methods applied in the analysis of adverse events commonly include simple standard methods for contingency tables. However, the results produced may be misleading if observations are censored at the time of discontinuation due to treatment switching or noncompliance, resulting in unequal follow-up periods. In this paper, we present examples to show that the application of inadequate methods for the analysis of adverse events in the reimbursement dossier can lead to a downgrading of the evidence on a drug's benefit in the subsequent assessment, as greater harm from the drug cannot be excluded with sufficient certainty. Legal regulations on the benefit assessment of drugs in Germany are presented, in particular, with regard to the analysis of adverse events. Differences in safety considerations between the drug approval process and the benefit assessment are discussed. We show that the naive application of simple proportions in reimbursement dossiers frequently leads to uninterpretable results if observations are censored and the average follow-up periods differ between treatment groups. Likewise, the application of incidence rates may be misleading in the case of recurrent events and unequal follow-up periods. To allow for an appropriate benefit assessment of drugs, adequate survival time methods accounting for time dependencies and duration of follow-up are required, not only for time-to-event efficacy endpoints but also for adverse events. © 2016 The Authors. Pharmaceutical Statistics published by John Wiley & Sons Ltd. © 2016 The Authors. Pharmaceutical Statistics published by John Wiley & Sons Ltd.

Assessing learning outcomes in middle-division classical mechanics: The Colorado Classical Mechanics and Math Methods Instrument

NASA Astrophysics Data System (ADS)

Caballero, Marcos D.; Doughty, Leanne; Turnbull, Anna M.; Pepper, Rachel E.; Pollock, Steven J.

2017-06-01

Reliable and validated assessments of introductory physics have been instrumental in driving curricular and pedagogical reforms that lead to improved student learning. As part of an effort to systematically improve our sophomore-level classical mechanics and math methods course (CM 1) at CU Boulder, we have developed a tool to assess student learning of CM 1 concepts in the upper division. The Colorado Classical Mechanics and Math Methods Instrument (CCMI) builds on faculty consensus learning goals and systematic observations of student difficulties. The result is a 9-question open-ended post test that probes student learning in the first half of a two-semester classical mechanics and math methods sequence. In this paper, we describe the design and development of this instrument, its validation, and measurements made in classes at CU Boulder and elsewhere.

Watershed reliability, resilience and vulnerability analysis under uncertainty using water quality data.

PubMed

Hoque, Yamen M; Tripathi, Shivam; Hantush, Mohamed M; Govindaraju, Rao S

2012-10-30

A method for assessment of watershed health is developed by employing measures of reliability, resilience and vulnerability (R-R-V) using stream water quality data. Observed water quality data are usually sparse, so that a water quality time-series is often reconstructed using surrogate variables (streamflow). A Bayesian algorithm based on relevance vector machine (RVM) was employed to quantify the error in the reconstructed series, and a probabilistic assessment of watershed status was conducted based on established thresholds for various constituents. As an application example, observed water quality data for several constituents at different monitoring points within the Cedar Creek watershed in north-east Indiana (USA) were utilized. Considering uncertainty in the data for the period 2002-2007, the R-R-V analysis revealed that the Cedar Creek watershed tends to be in compliance with respect to selected pesticides, ammonia and total phosphorus. However, the watershed was found to be prone to violations of sediment standards. Ignoring uncertainty in the water quality time-series led to misleading results especially in the case of sediments. Results indicate that the methods presented in this study may be used for assessing the effects of different stressors over a watershed. The method shows promise as a management tool for assessing watershed health. Copyright © 2012 Elsevier Ltd. All rights reserved.

A method for examining temporal changes in cyanobacterial ...

EPA Pesticide Factsheets

Cyanobacterial harmful algal blooms (CyanoHAB) are thought to be increasing globally over the past few decades, but relatively little quantitative information is available about the spatial extent of blooms. Satellite remote sensing provides a potential technology for identifying cyanoHABs in multiple water bodies and across geo-political boundaries. An assessment method was developed using MEdium Resolution Imaging Spectrometer (MERIS) imagery to quantify cyanoHAB surface area extent, transferable to different spatial areas, in Florida, Ohio, and California for the test period of 2008 to 2012. Temporal assessment was used to evaluate changes in satellite resolvable inland waterbodies for each state of interest. To further assess cyanoHAB risk within the states, the World Health Organization’s (WHO) recreational guidance level thresholds were used to categorize surface area of cyanoHABs into three risk categories: low, moderate, and high-risk bloom area. Results showed that in Florida, the area of cyanoHABs increased largely due to observed increases in high-risk bloom area. California exhibited a slight decrease in cyanoHAB extent, primarily attributed to decreases in Northern California. In Ohio (excluding Lake Erie), little change in cyanoHAB surface area was observed. This study uses satellite remote sensing to quantify changes in inland cyanoHAB surface area across numerous water bodies within an entire state. The temporal assessment method developed here

Assessing Technical Competence in Surgical Trainees: A Systematic Review.

PubMed

Szasz, Peter; Louridas, Marisa; Harris, Kenneth A; Aggarwal, Rajesh; Grantcharov, Teodor P

2015-06-01

To systematically examine the literature describing the methods by which technical competence is assessed in surgical trainees. The last decade has witnessed an evolution away from time-based surgical education. In response, governing bodies worldwide have implemented competency-based education paradigms. The definition of competence, however, remains elusive, and the impact of these education initiatives in terms of assessment methods remains unclear. A systematic review examining the methods by which technical competence is assessed was conducted by searching MEDLINE, EMBASE, PsychINFO, and the Cochrane database of systematic reviews. Abstracts of retrieved studies were reviewed and those meeting inclusion criteria were selected for full review. Data were retrieved in a systematic manner, the validity and reliability of the assessment methods was evaluated, and quality was assessed using the Grading of Recommendations Assessment, Development and Evaluation classification. Of the 6814 studies identified, 85 studies involving 2369 surgical residents were included in this review. The methods used to assess technical competence were categorized into 5 groups; Likert scales (37), benchmarks (31), binary outcomes (11), novel tools (4), and surrogate outcomes (2). Their validity and reliability were mostly previously established. The overall Grading of Recommendations Assessment, Development and Evaluation for randomized controlled trials was high and low for the observational studies. The definition of technical competence continues to be debated within the medical literature. The methods used to evaluate technical competence predominantly include instruments that were originally created to assess technical skill. Very few studies identify standard setting approaches that differentiate competent versus noncompetent performers; subsequently, this has been identified as an area with great research potential.

Cone-Beam Computed Tomography as a Diagnostic Method for Determination of Gingival Thickness and Distance between Gingival Margin and Bone Crest

PubMed Central

Borges, Germana Jayme; Ruiz, Luis Fernando Naldi; de Alencar, Ana Helena Gonçalves; Porto, Olavo César Lyra; Estrela, Carlos

2015-01-01

The objective of the present study was to assess cone-beam computed tomography (CBCT) as a diagnostic method for determination of gingival thickness (GT) and distance between gingival margin and vestibular (GMBC-V) and interproximal bone crests (GMBC-I). GT and GMBC-V were measured in 348 teeth and GMBC-I was measured in 377 tooth regions of 29 patients with gummy smile. GT was assessed using transgingival probing (TP), ultrasound (US), and CBCT, whereas GMBC-V and GMBC-I were assessed by transsurgical clinical evaluation (TCE) and CBCT. Statistical analyses used independent t-test, Pearson's correlation coefficient, and simple linear regression. Difference was observed for GT: between TP, CBCT, and US considering all teeth; between TP and CBCT and between TP and US in incisors and canines; between TP and US in premolars and first molars. TP presented the highest means for GT. Positive correlation and linear regression were observed between TP and CBCT, TP and US, and CBCT and US. Difference was observed for GMBC-V and GMBC-I using TCE and CBCT, considering all teeth. Correlation and linear regression results were significant for GMBC-V and GMBC-I in incisors, canines, and premolars. CBCT is an effective diagnostic method to visualize and measure GT, GMBC-V, and GMBC-I. PMID:25918737

Observational studies of the association between glucose-lowering medications and cardiovascular outcomes: addressing methodological limitations.

PubMed

Patorno, Elisabetta; Patrick, Amanda R; Garry, Elizabeth M; Schneeweiss, Sebastian; Gillet, Victoria G; Bartels, Dorothee B; Masso-Gonzalez, Elvira; Seeger, John D

2014-11-01

Recent years have witnessed a growing body of observational literature on the association between glucose-lowering treatments and cardiovascular disease. However, many of the studies are based on designs or analyses that inadequately address the methodological challenges involved. We reviewed recent observational literature on the association between glucose-lowering medications and cardiovascular outcomes and assessed the design and analysis methods used, with a focus on their ability to address specific methodological challenges. We describe and illustrate these methodological issues and their impact on observed associations, providing examples from the reviewed literature. We suggest approaches that may be employed to manage these methodological challenges. From the evaluation of 81 publications of observational investigations assessing the association between glucose-lowering treatments and cardiovascular outcomes, we identified the following methodological challenges: 1) handling of temporality in administrative databases; 2) handling of risks that vary with time and treatment duration; 3) definitions of the exposure risk window; 4) handling of exposures that change over time; and 5) handling of confounding by indication. Most of these methodological challenges may be suitably addressed through application of appropriate methods. Observational research plays an increasingly important role in the evaluation of the clinical effects of diabetes treatment. Implementation of appropriate research methods holds the promise of reducing the potential for spurious findings and the risk that the spurious findings will mislead the medical community about risks and benefits of diabetes medications.

Analysis of terrestrial conditions and dynamics

NASA Technical Reports Server (NTRS)

Goward, S. N. (Principal Investigator)

1984-01-01

Land spectral reflectance properties for selected locations, including the Goddard Space Flight Center, the Wallops Flight Facility, a MLA test site in Cambridge, Maryland, and an acid test site in Burlington, Vermont, were measured. Methods to simulate the bidirectional reflectance properties of vegetated landscapes and a data base for spatial resolution were developed. North American vegetation patterns observed with the Advanced Very High Resolution Radiometer were assessed. Data and methods needed to model large-scale vegetation activity with remotely sensed observations and climate data were compiled.

Development and Demonstration of an Aerial Imagery Assessment Method to Monitor Changes in Restored Stream Condition

NASA Astrophysics Data System (ADS)

Fong, L. S.; Ambrose, R. F.

2017-12-01

Remote sensing is an excellent way to assess the changing condition of streams and wetlands. Several studies have measured large-scale changes in riparian condition indicators, but few have remotely applied multi-metric assessments on a finer scale to measure changes, such as those caused by restoration, in the condition of small riparian areas. We developed an aerial imagery assessment method (AIAM) that combines landscape, hydrology, and vegetation observations into one index describing overall ecological condition of non-confined streams. Verification of AIAM demonstrated that sites in good condition (as assessed on-site by the California Rapid Assessment Method) received high AIAM scores. (AIAM was not verified with poor condition sites.) Spearman rank correlation tests comparing AIAM and the field-based California Rapid Assessment Method (CRAM) results revealed that some components of the two methods were highly correlated. The application of AIAM is illustrated with time-series restoration trajectories of three southern California stream restoration projects aged 15 to 21 years. The trajectories indicate that the projects improved in condition in years following their restoration, with vegetation showing the most dynamic change over time. AIAM restoration trajectories also overlapped to different degrees with CRAM chronosequence restoration performance curves that demonstrate the hypothetical development of high-performing projects. AIAM has high potential as a remote ecological assessment method and effective tool to determine restoration trajectories. Ultimately, this tool could be used to further improve stream and wetland restoration management.

Evaluating Rater Accuracy in Rater-Mediated Assessments Using an Unfolding Model

ERIC Educational Resources Information Center

Wang, Jue; Engelhard, George, Jr.; Wolfe, Edward W.

2016-01-01

The number of performance assessments continues to increase around the world, and it is important to explore new methods for evaluating the quality of ratings obtained from raters. This study describes an unfolding model for examining rater accuracy. Accuracy is defined as the difference between observed and expert ratings. Dichotomous accuracy…

Resident-Directed Long-Term Care: Staff Provision of Choice during Morning Care

ERIC Educational Resources Information Center

Simmons, Sandra F.; Rahman, Annie; Beuscher, Linda; Jani, Victoria; Durkin, Daniel W.; Schnelle, John F.

2011-01-01

Purpose: To develop an observational protocol to assess the quality of staff-resident communication relevant to choice and describe staff-resident interactions as preliminary evidence of the usefulness of the tool to assess current nursing home practices related to offering choice during morning care provision. Design and Methods: This study…

Teacher Management of Elementary Classroom Social Dynamics: Associations with Changes in Student Adjustment

ERIC Educational Resources Information Center

Gest, Scott D.; Madill, Rebecca A.; Zadzora, Kathleen M.; Miller, Aaron M.; Rodkin, Philip C.

2014-01-01

Teachers and students in 54 elementary school classrooms (first, third, and fifth grades) participated in a multi-method longitudinal study of classroom social dynamics. At each of three assessments within a single school year, observers rated teacher-student interaction quality, students completed sociometric assessments and reported on their…

Auditory Assessment of Children from a Psychologist's Point of View.

ERIC Educational Resources Information Center

Mira, Mary P.

Behavioral studies of listening in children with both normal and exceptional hearing are presented. The conjugate of assessing listening is discussed. This method provides a continuous record of ongoing behavior allowing for observation of moment-to-moment changes in listening. It determines how sustained, how strong, and how continuous a child's…

Bayes Nets in Educational Assessment: Where Do the Numbers Come from? CSE Technical Report.

ERIC Educational Resources Information Center

Mislevy, Robert J.; Almond, Russell G.; Yan, Duanli; Steinberg, Linda S.

Educational assessments that exploit advances in technology and cognitive psychology can produce observations and pose student models that outstrip familiar test-theoretic models and analytic methods. Bayesian inference networks (BINs), which include familiar models and techniques as special cases, can be used to manage belief about students'…

75 FR 2523 - Office of Innovation and Improvement; Overview Information; Arts in Education Model Development...

Federal Register 2010, 2011, 2012, 2013, 2014

2010-01-15

... that is based on rigorous scientifically based research methods to assess the effectiveness of a...) Relies on measurements or observational methods that provide reliable and valid data across evaluators... of innovative, cohesive models that are based on research and have demonstrated that they effectively...

The effect of handling method on the mouse grimace scale in two strains of laboratory mice

PubMed Central

Leach, Matthew C

2015-01-01

Pain assessment in laboratory animals is an ethical and legal requirement. The mouse grimace scale (MGS) is a new method of pain assessment deemed to be both accurate and reliable, and observers can be rapidly trained to use it. In order for a new pain assessment technique to be effective, we must ensure that the score awarded by the technique is only influenced by pain and not by other husbandry or non-painful but integral aspects of research protocols. Here, we studied 16 male mice, housed under standard laboratory conditions. Eight mice were randomly assigned to tail handling and eight to tube handling on arrival at the unit. On each occasion the mice were removed from their cage for routine husbandry, they were picked up using their assigned handling method. Photographs of the mouse faces were then scored by treatment-blind observers as per the MGS manual (see Nature Methods 2010, Vol. 7, pp 447–449), and scores from the two groups were compared. There was no significant difference in MGS scores between the mice that had been handled using a tube compared with the tail. Consequently, these methods of handling did not influence the baseline grimace score given, suggesting that these handling techniques are not confounding factors when establishing baseline MGS scores, further validating this technique. PMID:26657061

The effect of handling method on the mouse grimace scale in two strains of laboratory mice.

PubMed

Miller, Amy L; Leach, Matthew C

2016-08-01

Pain assessment in laboratory animals is an ethical and legal requirement. The mouse grimace scale (MGS) is a new method of pain assessment deemed to be both accurate and reliable, and observers can be rapidly trained to use it. In order for a new pain assessment technique to be effective, we must ensure that the score awarded by the technique is only influenced by pain and not by other husbandry or non-painful but integral aspects of research protocols. Here, we studied 16 male mice, housed under standard laboratory conditions. Eight mice were randomly assigned to tail handling and eight to tube handling on arrival at the unit. On each occasion the mice were removed from their cage for routine husbandry, they were picked up using their assigned handling method. Photographs of the mouse faces were then scored by treatment-blind observers as per the MGS manual (see Nature Methods 2010, Vol. 7, pp 447-449), and scores from the two groups were compared. There was no significant difference in MGS scores between the mice that had been handled using a tube compared with the tail. Consequently, these methods of handling did not influence the baseline grimace score given, suggesting that these handling techniques are not confounding factors when establishing baseline MGS scores, further validating this technique. © The Author(s) 2015.

A test of four innominate bone age assessment methods in a modern skeletal collection from Medellin, Colombia.

PubMed

Rivera-Sandoval, Javier; Monsalve, Timisay; Cattaneo, Cristina

2018-01-01

Studying bone collections with known data has proven to be useful in assessing reliability and accuracy of biological profile reconstruction methods used in Forensic Anthropology. Thus, it is necessary to calibrate these methods to clarify issues such as population variability and accuracy of estimations for the elderly. This work considers observations of morphological features examined by four innominate bone age assessment methods: (1) Suchey-Brooks Pubic Symphysis, (2) Lovejoy Iliac Auricular Surface, (3) Buckberry and Chamberlain Iliac Auricular Surface, and (4) Rouge-Maillart Iliac Auricular Surface and Acetabulum. This study conducted a blind test of a sample of 277 individuals from two contemporary skeletal collections from Universal and San Pedro cemeteries in Medellin, for which known pre-mortem data support the statistical analysis of results obtained using the four age assessment methods. Results from every method show tendency to increase bias and inaccuracy in relation to age, but Buckberry-Chamberlain and Rougé-Maillart's methods are the most precise for this particular Colombian population, where Buckberry-Chamberlain's is the best for analysis of older individuals. Copyright © 2017 Elsevier B.V. All rights reserved.

Particle image velocimetry of a flow at a vaulted wall.

PubMed

Kertzscher, U; Berthe, A; Goubergrits, L; Affeld, K

2008-05-01

The assessment of flow along a vaulted wall (with two main finite radii of curvature) is of general interest; in biofluid mechanics, it is of special interest. Unlike the geometry of flows in engineering, flow geometry in nature is often determined by vaulted walls. Specifically the flow adjacent to the wall of blood vessels is particularly interesting since this is where either thrombi are formed or atherosclerosis develops. Current measurement methods have problems assessing the flow along vaulted walls. In contrast with conventional particle image velocimetry (PIV), this new method, called wall PIV, allows the investigation of a flow adjacent to transparent flexible surfaces with two finite radii of curvature. Using an optical method which allows the observation of particles up to a predefined depth enables the visualization solely of the boundary layer flow. This is accomplished by adding a specific dye to the fluid which absorbs the monochromatic light used to illuminate the region of observation. The obtained images can be analysed with the methods of conventional PIV and result in a vector field of the velocities along the wall. With wall PIV, the steady flow adjacent to the vaulted wall of a blood pump was investigated and the resulting velocity field as well as the velocity fluctuations were assessed.

Data collection costs in industrial environments for three occupational posture exposure assessment methods

PubMed Central

2012-01-01

Background Documentation of posture measurement costs is rare and cost models that do exist are generally naïve. This paper provides a comprehensive cost model for biomechanical exposure assessment in occupational studies, documents the monetary costs of three exposure assessment methods for different stakeholders in data collection, and uses simulations to evaluate the relative importance of cost components. Methods Trunk and shoulder posture variables were assessed for 27 aircraft baggage handlers for 3 full shifts each using three methods typical to ergonomic studies: self-report via questionnaire, observation via video film, and full-shift inclinometer registration. The cost model accounted for expenses related to meetings to plan the study, administration, recruitment, equipment, training of data collectors, travel, and onsite data collection. Sensitivity analyses were conducted using simulated study parameters and cost components to investigate the impact on total study cost. Results Inclinometry was the most expensive method (with a total study cost of € 66,657), followed by observation (€ 55,369) and then self report (€ 36,865). The majority of costs (90%) were borne by researchers. Study design parameters such as sample size, measurement scheduling and spacing, concurrent measurements, location and travel, and equipment acquisition were shown to have wide-ranging impacts on costs. Conclusions This study provided a general cost modeling approach that can facilitate decision making and planning of data collection in future studies, as well as investigation into cost efficiency and cost efficient study design. Empirical cost data from a large field study demonstrated the usefulness of the proposed models. PMID:22738341

Teaching acute care nurses cognitive assessment using LOCFAS: what's the best method?

PubMed

Flannery, J; Land, K

2001-02-01

The Levels of Cognitive Functioning Assessment Scale (LOCFAS) is a behavioral checklist used by nurses in the acute care setting to assess the level of cognitive functioning in severely brain-injured patients in the early post-trauma period. Previous research studies have supported the reliability and validity of LOCFAS. For LOCFAS to become a more firmly established method of cognitive assessment, nurses must become familiar with and proficient in the use of this instrument. The purpose of this study was to find the most effective method of instruction by comparing three methods: a self-directed manual, a teaching video, and a classroom presentation. Videotaped vignettes of actual brain-injured patients were presented at the end of each training session, and participants were required to categorize these videotaped patients by using LOCFAS. High levels of reliability were observed for both the self-directed manual group and the teaching video group, but an overall lower level of reliability was observed for the classroom presentation group. Examination of the accuracy of overall LOCFAS ratings revealed a significant difference for instructional groups; the accuracy of the classroom presentation group was significantly lower than that of either the self-directed manual group or the teaching video group. The three instructional groups also differed on the average accuracy of ratings of the individual behaviors; the accuracy of the classroom presentation group was significantly lower than that of the teaching video group, whereas the self-directed manual group fell in between. Nurses also rated the instructional methods across a number of evaluative dimensions on a 5-point Likert-type scale. Evaluative statements ranged from average to good, with no significant differences among instructional methods.

Immunocytometric quantitation of foeto-maternal haemorrhage with the Abbott Cell-Dyn CD4000 haematology analyser.

PubMed

Little, B H; Robson, R; Roemer, B; Scott, C S

2005-02-01

This study evaluated the extended use of a haematology analyser (Abbott Cell-Dyn CD4000) for the immunofluorescent enumeration of foeto-maternal haemorrhage (FMH) with fluorescein isothiocyanate-labelled monoclonal anti-RhD. Method performance was assessed with artificial FMH standards, and a series of 44 clinical samples. Within run precision was <15% (coefficient of variation, CV) for FMH volumes of 3 ml and above, 18.8% at an FMH volume of 2 ml and 31.7% at an FMH volume of 1 ml. Linearity analysis showed excellent agreement (observed FMH% = 0.98x expected FMH% + 0.02), and a close relationship (R(2) = 0.99) between observed and expected FMH percentages. The lower limit of quantification of the CD4000 (SRP-Ret) method with a maximum CV of 15% was 1.6 ml, and the limit of detection was <1 ml. Parallel Kleihauer-Betke test (KBT) assessments of FMH standards showed an overall trend for higher KBT values (observed = 1.25x expected - 0.38). At an FMH level of 4 ml, KBT observer estimates ranged from 0.57 to 11.94 ml with a mean inter-observer CV of 63%. For 44 clinical samples, there was decision point agreement between KBT and SRP-Ret results for 42 samples with an FMH of <2 ml. Analysis in the low FMH range (<1 ml) showed that small volume foetal leaks could be detected with the SRP-Ret method in most of 23 samples with negative KBT results. CD4000 SRP-Ret method performance for FMH determination was similar to that reported for flow cytometry.

Evaluating the Performance of Repeated Measures Approaches in Replicating Experimental Benchmark Results

ERIC Educational Resources Information Center

McConeghy, Kevin; Wing, Coady; Wong, Vivian C.

2015-01-01

Randomized experiments have long been established as the gold standard for addressing causal questions. However, experiments are not always feasible or desired, so observational methods are also needed. When multiple observations on the same variable are available, a repeated measures design may be used to assess whether a treatment administered…

Recent developments in imaging system assessment methodology, FROC analysis and the search model.

PubMed

Chakraborty, Dev P

2011-08-21

A frequent problem in imaging is assessing whether a new imaging system is an improvement over an existing standard. Observer performance methods, in particular the receiver operating characteristic (ROC) paradigm, are widely used in this context. In ROC analysis lesion location information is not used and consequently scoring ambiguities can arise in tasks, such as nodule detection, involving finding localized lesions. This paper reviews progress in the free-response ROC (FROC) paradigm in which the observer marks and rates suspicious regions and the location information is used to determine whether lesions were correctly localized. Reviewed are FROC data analysis, a search-model for simulating FROC data, predictions of the model and a method for estimating the parameters. The search model parameters are physically meaningful quantities that can guide system optimization.

Brief debrisoquin administration to assess central dopaminergic function in children.

PubMed

Riddle, M A; Shaywitz, B A; Leckman, J F; Anderson, G M; Shaywitz, S E; Hardin, M T; Ort, S I; Cohen, D J

1986-03-17

Central dopaminergic (DA) function in children was assessed by monitoring plasma-free homovanillic acid (pHVA) levels after brief (18 hour) administration with debrisoquin sulfate, a peripherally active antihypertensive agent that blocks peripheral, but not central, HVA production. Brief debrisoquin administration resulted in marked reductions in pHVA in each of six patients studied. In five of the six patients, post-debrisoquin pHVA levels remained relatively stable over the six-hour period of observation. No significant cardiovascular or behavioral side effects of debrisoquin were observed. The brief debrisoquin administration method appears to be a safe, simple, and potentially valid peripheral technique for evaluating aspects of central dopaminergic function in children with neuropsychiatric disorders. Additional work is needed to further establish this method's validity and reliability.

Emerging Methods and Systems for Observing Life in the Sea

NASA Astrophysics Data System (ADS)

Chavez, F.; Pearlman, J.; Simmons, S. E.

2016-12-01

There is a growing need for observations of life in the sea at time and space scales consistent with those made for physical and chemical parameters. International programs such as the Global Ocean Observing System (GOOS) and Marine Biodiversity Observation Networks (MBON) are making the case for expanded biological observations and working diligently to prioritize essential variables. Here we review past, present and emerging systems and methods for observing life in the sea from the perspective of maintaining continuous observations over long time periods. Methods that rely on ships with instrumentation and over-the-side sample collections will need to be supplemented and eventually replaced with those based from autonomous platforms. Ship-based optical and acoustic instruments are being reduced in size and power for deployment on moorings and autonomous vehicles. In parallel a new generation of low power, improved resolution sensors are being developed. Animal bio-logging is evolving with new, smaller and more sophisticated tags being developed. New genomic methods, capable of assessing multiple trophic levels from a single water sample, are emerging. Autonomous devices for genomic sample collection are being miniaturized and adapted to autonomous vehicles. The required processing schemes and methods for these emerging data collections are being developed in parallel with the instrumentation. An evolving challenge will be the integration of information from these disparate methods given that each provides their own unique view of life in the sea.

Herbal hepatotoxicity: Challenges and pitfalls of causality assessment methods

PubMed Central

Teschke, Rolf; Frenzel, Christian; Schulze, Johannes; Eickhoff, Axel

2013-01-01

The diagnosis of herbal hepatotoxicity or herb induced liver injury (HILI) represents a particular clinical and regulatory challenge with major pitfalls for the causality evaluation. At the day HILI is suspected in a patient, physicians should start assessing the quality of the used herbal product, optimizing the clinical data for completeness, and applying the Council for International Organizations of Medical Sciences (CIOMS) scale for initial causality assessment. This scale is structured, quantitative, liver specific, and validated for hepatotoxicity cases. Its items provide individual scores, which together yield causality levels of highly probable, probable, possible, unlikely, and excluded. After completion by additional information including raw data, this scale with all items should be reported to regulatory agencies and manufacturers for further evaluation. The CIOMS scale is preferred as tool for assessing causality in hepatotoxicity cases, compared to numerous other causality assessment methods, which are inferior on various grounds. Among these disputed methods are the Maria and Victorino scale, an insufficiently qualified, shortened version of the CIOMS scale, as well as various liver unspecific methods such as the ad hoc causality approach, the Naranjo scale, the World Health Organization (WHO) method, and the Karch and Lasagna method. An expert panel is required for the Drug Induced Liver Injury Network method, the WHO method, and other approaches based on expert opinion, which provide retrospective analyses with a long delay and thereby prevent a timely assessment of the illness in question by the physician. In conclusion, HILI causality assessment is challenging and is best achieved by the liver specific CIOMS scale, avoiding pitfalls commonly observed with other approaches. PMID:23704820

The Assessment of Parameters Affecting the Quality of Cord Blood by the Appliance of the Annexin V Staining Method and Correlation with CFU Assays

PubMed Central

Radke, Teja Falk; Barbosa, David; Duggleby, Richard Charles; Saccardi, Riccardo; Querol, Sergio; Kögler, Gesine

2013-01-01

The assessment of nonviable haematopoietic cells by Annexin V staining method in flow cytometry has recently been published by Duggleby et al. Resulting in a better correlation with the observed colony formation in methylcellulose assays than the standard ISHAGE protocol, it presents a promising method to predict cord blood potency. Herein, we applied this method for examining the parameters during processing which potentially could affect cord blood viability. We could verify that the current standards regarding time and temperature are sufficient, since no significant difference was observed within 48 hours or in storage at 4°C up to 26°C. However, the addition of DMSO for cryopreservation alone leads to an inevitable increase in nonviable haematopoietic stem cells from initially 14.8% ± 4.3% to at least 30.6% ± 5.5%. Furthermore, CFU-assays with varied seeding density were performed in order to evaluate the applicability as a quantitative method. The results revealed that only in a narrow range reproducible clonogenic efficiency (ClonE) could be assessed, giving at least a semiquantitative estimation. We conclude that both Annexin V staining method and CFU-assays with defined seeding density are reliable means leading to a better prediction of the final potency. Especially Annexin V, due to its fast readout, is a practical tool for examining and optimising specific steps in processing, while CFU-assays add a functional confirmation. PMID:23533443

Automated cerebral infarct volume measurement in follow-up noncontrast CT scans of patients with acute ischemic stroke.

PubMed

Boers, A M; Marquering, H A; Jochem, J J; Besselink, N J; Berkhemer, O A; van der Lugt, A; Beenen, L F; Majoie, C B

2013-08-01

Cerebral infarct volume as observed in follow-up CT is an important radiologic outcome measure of the effectiveness of treatment of patients with acute ischemic stroke. However, manual measurement of CIV is time-consuming and operator-dependent. The purpose of this study was to develop and evaluate a robust automated measurement of the CIV. The CIV in early follow-up CT images of 34 consecutive patients with acute ischemic stroke was segmented with an automated intensity-based region-growing algorithm, which includes partial volume effect correction near the skull, midline determination, and ventricle and hemorrhage exclusion. Two observers manually delineated the CIV. Interobserver variability of the manual assessments and the accuracy of the automated method were evaluated by using the Pearson correlation, Bland-Altman analysis, and Dice coefficients. The accuracy was defined as the correlation with the manual assessment as a reference standard. The Pearson correlation for the automated method compared with the reference standard was similar to the manual correlation (R = 0.98). The accuracy of the automated method was excellent with a mean difference of 0.5 mL with limits of agreement of -38.0-39.1 mL, which were more consistent than the interobserver variability of the 2 observers (-40.9-44.1 mL). However, the Dice coefficients were higher for the manual delineation. The automated method showed a strong correlation and accuracy with the manual reference measurement. This approach has the potential to become the standard in assessing the infarct volume as a secondary outcome measure for evaluating the effectiveness of treatment.

A General Method for Assessing the Origin of Interstellar Small Bodies: The Case of 1I/2017 U1 (‘Oumuamua)

NASA Astrophysics Data System (ADS)

Zuluaga, Jorge I.; Sánchez-Hernández, Oscar; Sucerquia, Mario; Ferrín, Ignacio

2018-06-01

With the advent of more and deeper sky surveys, the discovery of interstellar small objects entering into the solar system has been finally possible. In 2017 October 19, using observations of the Pan-STARRS survey, a fast moving object, now officially named 1I/2017 U1 (‘Oumuamua), was discovered in a heliocentric unbound trajectory, suggesting an interstellar origin. Assessing the provenance of interstellar small objects is key for understanding their distribution, spatial density, and the processes responsible for their ejection from planetary systems. However, their peculiar trajectories place a limit on the number of observations available to determine a precise orbit. As a result, when its position is propagated ∼105–106 years backward in time, small errors in orbital elements become large uncertainties in position in the interstellar space. In this paper we present a general method for assigning probabilities to nearby stars of being the parent system of an observed interstellar object. We describe the method in detail and apply it for assessing the origin of ‘Oumuamua. A preliminary list of potential progenitors and their corresponding probabilities is provided. In the future, when further information about the object and/or the nearby stars be refined, the probabilities computed with our method can be updated. We provide all the data and codes we developed for this purpose in the form of an open source C/C++/Python package, iWander, which is publicly available at http://github.com/seap-udea/iWander.

The implementation of skill assessment by the educators on the mathematics learning process in senior high school

NASA Astrophysics Data System (ADS)

Lestariani, I.; Sujadi, I.; Pramudya, I.

2018-03-01

The purpose of research to describe and know the implementation of skill assessment on the mathematics learning process with the high school mathematics teacher as the subject because it is less fully implemented. This research is the type of the descriptive qualitative method. The data was collecting observation method, interview and documentation. The result showed that on the planning stage of the implementation of skill assessment, there were many teachers who had not prepared all the completeness with various assessment techniques through performance, project and portfolio. The teacher was prepared the list of questions. On the implementation stage, there were many teachers who had not understand the stage of completing the assessment with the appropriate instrument method and development. On the reporting stage, discovered that teachers faced the difficulty on preparing scoring report with the range value. Aside from that, the teachers had not prepared the assessment instrument very well on the planning stage. It can be concluded that the implementation of skill assessment has been implemented but not maximally because educators don’t understand about the skill assessment and the number of instrument that must be prepared before the assessment.

Investigating Surface and Near-Surface Bushfire Fuel Attributes: A Comparison between Visual Assessments and Image-Based Point Clouds

PubMed Central

Spits, Christine; Wallace, Luke; Reinke, Karin

2017-01-01

Visual assessment, following guides such as the Overall Fuel Hazard Assessment Guide (OFHAG), is a common approach for assessing the structure and hazard of varying bushfire fuel layers. Visual assessments can be vulnerable to imprecision due to subjectivity between assessors, while emerging techniques such as image-based point clouds can offer land managers potentially more repeatable descriptions of fuel structure. This study compared the variability of estimates of surface and near-surface fuel attributes generated by eight assessment teams using the OFHAG and Fuels3D, a smartphone method utilising image-based point clouds, within three assessment plots in an Australian lowland forest. Surface fuel hazard scores derived from underpinning attributes were also assessed. Overall, this study found considerable variability between teams on most visually assessed variables, resulting in inconsistent hazard scores. Variability was observed within point cloud estimates but was, however, on average two to eight times less than that seen in visual estimates, indicating greater consistency and repeatability of this method. It is proposed that while variability within the Fuels3D method may be overcome through improved methods and equipment, inconsistencies in the OFHAG are likely due to the inherent subjectivity between assessors, which may be more difficult to overcome. This study demonstrates the capability of the Fuels3D method to efficiently and consistently collect data on fuel hazard and structure, and, as such, this method shows potential for use in fire management practices where accurate and reliable data is essential. PMID:28425957

The impact of childhood maltreatment history on parenting: a comparison of maltreatment types and assessment methods.

PubMed

Bailey, Heidi N; DeOliveira, Carey Anne; Wolfe, Vicky Veitch; Evans, Elspeth M; Hartwick, Cailey

2012-03-01

Childhood maltreatment is associated with subsequent parenting difficulties; however, most research has relied on self-reported parenting outcomes, and observational measures have revealed mixed findings. Furthermore, research has focused predominantly on histories of sexual and/or physical abuse. This study explored associations between a wide range of childhood maltreatment experiences and both observed and self-reported parenting outcomes. Mothers of 4- to 6-year-old children at moderate social risk completed the History of Maltreatment and Trauma Form (HMTF), which assesses a range of maltreatment experiences and delineates specific characteristics such as chronicity and severity. Participants completed questionnaires assessing parenting stress and competence, and their emotional availability (sensitivity, intrusiveness, hostility) toward their children was coded from videorecorded interactions. Construct (factorial, convergent and discriminant) validity of the HMTF was demonstrated through factor analysis and a multi-trait, multi-method matrix comparing it to the Childhood Trauma Questionnaire. HMTF-assessed childhood maltreatment, specifically witnessing family violence, neglect and emotional maltreatment, were significantly associated with mothers' observed hostility toward their children, even after controlling for potentially traumatic adult experiences. In contrast, childhood sexual abuse history was associated with self-reported concerns regarding parenting competence, and this association held even after controlling for other forms of childhood maltreatment and potentially traumatic adult experiences. Self-reported parenting outcomes were unrelated to observed parenting behavior. Findings highlight the complexity of associations between child maltreatment and subsequent parenting outcomes. Although much previous research has focused on sexual and physical abuse, other more contextual forms of maltreatment may be similarly or more strongly associated with certain parenting outcomes. Furthermore, different forms of maltreatment may be associated with perceived versus observed parenting outcomes. Crown Copyright © 2012. Published by Elsevier Ltd. All rights reserved.

Accuracy, precision, and economic efficiency for three methods of thrips (Thysanoptera: Thripidae) population density assessment.

PubMed

Sutherland, Andrew M; Parrella, Michael P

2011-08-01

Western flower thrips, Frankliniella occidentalis (Pergande) (Thysanoptera: Thripidae), is a major horticultural pest and an important vector of plant viruses in many parts of the world. Methods for assessing thrips population density for pest management decision support are often inaccurate or imprecise due to thrips' positive thigmotaxis, small size, and naturally aggregated populations. Two established methods, flower tapping and an alcohol wash, were compared with a novel method, plant desiccation coupled with passive trapping, using accuracy, precision and economic efficiency as comparative variables. Observed accuracy was statistically similar and low (37.8-53.6%) for all three methods. Flower tapping was the least expensive method, in terms of person-hours, whereas the alcohol wash method was the most expensive. Precision, expressed by relative variation, depended on location within the greenhouse, location on greenhouse benches, and the sampling week, but it was generally highest for the flower tapping and desiccation methods. Economic efficiency, expressed by relative net precision, was highest for the flower tapping method and lowest for the alcohol wash method. Advantages and disadvantages are discussed for all three methods used. If relative density assessment methods such as these can all be assumed to accurately estimate a constant proportion of absolute density, then high precision becomes the methodological goal in terms of measuring insect population density, decision making for pest management, and pesticide efficacy assessments.

Naturalistically-Observed Conflict and Youth Asthma Symptoms

PubMed Central

Tobin, Erin T.; Kane, Heidi S.; Saleh, Daniel J.; Naar-King, Sylvie; Poowuttikul, Pavadee; Secord, Elizabeth; Pierantoni, Wayne; Simon, Valerie; Slatcher, Richard B.

2014-01-01

Objective To investigate the links between naturalistically-observed conflict, self-reported caregiver-youth conflict, and youth asthma symptoms. Method Fifty-four youth with asthma (aged 10-17) wore the Electronically Activated Recorder (EAR) for a 4-day period to assess interpersonal conflict and caregiver-youth conflict as they occur in daily life. Conflict also was assessed with baseline self-report questionnaires and daily diaries completed by the youth participants and their caregiver. Asthma symptoms were assessed via daily diaries and baseline self-reports and wheezing as coded from the EAR. Results EAR-observed measures of conflict were strongly associated with self-reported asthma symptoms (both baseline and daily diaries) and wheezing coded from the EAR. Further, when entered together in regression analyses, youth daily reports of negative caregiver-youth interactions and EAR-observed conflict uniquely predicted asthma symptoms; only EAR-observed conflict was associated with EAR-observed wheezing. Conclusions These findings demonstrate the potential impact of daily conflict on youth asthma symptoms and the importance of assessing conflict as it occurs in everyday life. More broadly, they point to the importance of formulating a clear picture of family interactions outside of the lab, which is essential for understanding how family relationships “get under the skin” to affect youth health. PMID:25222090

Rapid systematic assessment of the detection and attribution of regional anthropogenic climate change

NASA Astrophysics Data System (ADS)

Stone, Dáithí A.; Hansen, Gerrit

2016-09-01

Despite being a well-established research field, the detection and attribution of observed climate change to anthropogenic forcing is not yet provided as a climate service. One reason for this is the lack of a methodology for performing tailored detection and attribution assessments on a rapid time scale. Here we develop such an approach, based on the translation of quantitative analysis into the "confidence" language employed in recent Assessment Reports of the Intergovernmental Panel on Climate Change. While its systematic nature necessarily ignores some nuances examined in detailed expert assessments, the approach nevertheless goes beyond most detection and attribution studies in considering contributors to building confidence such as errors in observational data products arising from sparse monitoring networks. When compared against recent expert assessments, the results of this approach closely match those of the existing assessments. Where there are small discrepancies, these variously reflect ambiguities in the details of what is being assessed, reveal nuances or limitations of the expert assessments, or indicate limitations of the accuracy of the sort of systematic approach employed here. Deployment of the method on 116 regional assessments of recent temperature and precipitation changes indicates that existing rules of thumb concerning the detectability of climate change ignore the full range of sources of uncertainty, most particularly the importance of adequate observational monitoring.

How reliable is apparent age at death on cadavers?

PubMed

Amadasi, Alberto; Merusi, Nicolò; Cattaneo, Cristina

2015-07-01

The assessment of age at death for identification purposes is a frequent and tough challenge for forensic pathologists and anthropologists. Too frequently, visual assessment of age is performed on well-preserved corpses, a method considered subjective and full of pitfalls, but whose level of inadequacy no one has yet tested or proven. This study consisted in the visual estimation of the age of 100 cadavers performed by a total of 37 observers among those usually attending the dissection room. Cadavers were of Caucasian ethnicity, well preserved, belonging to individuals who died of natural death. All the evaluations were performed prior to autopsy. Observers assessed the age with ranges of 5 and 10 years, indicating also the body part they mainly observed for each case. Globally, the 5-year range had an accuracy of 35%, increasing to 69% with the 10-year range. The highest accuracy was in the 31-60 age category (74.7% with the 10-year range), and the skin seemed to be the most reliable age parameter (71.5% of accuracy when observed), while the face was considered most frequently, in 92.4% of cases. A simple formula with the general "mean of averages" in the range given by the observers and related standard deviations was then developed; the average values with standard deviations of 4.62 lead to age estimation with ranges of some 20 years that seem to be fairly reliable and suitable, sometimes in alignment with classic anthropological methods, in the age estimation of well-preserved corpses.

Timeliness “at a glance”: assessing the turnaround time through the six sigma metrics.

PubMed

Ialongo, Cristiano; Bernardini, Sergio

2016-01-01

Almost thirty years of systematic analysis have proven the turnaround time to be a fundamental dimension for the clinical laboratory. Several indicators are to date available to assess and report quality with respect to timeliness, but they sometimes lack the communicative immediacy and accuracy. The six sigma is a paradigm developed within the industrial domain for assessing quality and addressing goal and issues. The sigma level computed through the Z-score method is a simple and straightforward tool which delivers quality by a universal dimensionless scale and allows to handle non-normal data. Herein we report our preliminary experience in using the sigma level to assess the change in urgent (STAT) test turnaround time due to the implementation of total automation. We found that the Z-score method is a valuable and easy to use method for assessing and communicating the quality level of laboratory timeliness, providing a good correspondence with the actual change in efficiency which was retrospectively observed.

A Review of Methods Applied by the U.S. Geological Survey in the Assessment of Identified Geothermal Resources

USGS Publications Warehouse

Williams, Colin F.; Reed, Marshall J.; Mariner, Robert H.

2008-01-01

The U. S. Geological Survey (USGS) is conducting an updated assessment of geothermal resources in the United States. The primary method applied in assessments of identified geothermal systems by the USGS and other organizations is the volume method, in which the recoverable heat is estimated from the thermal energy available in a reservoir. An important focus in the assessment project is on the development of geothermal resource models consistent with the production histories and observed characteristics of exploited geothermal fields. The new assessment will incorporate some changes in the models for temperature and depth ranges for electric power production, preferred chemical geothermometers for estimates of reservoir temperatures, estimates of reservoir volumes, and geothermal energy recovery factors. Monte Carlo simulations are used to characterize uncertainties in the estimates of electric power generation. These new models for the recovery of heat from heterogeneous, fractured reservoirs provide a physically realistic basis for evaluating the production potential of natural geothermal reservoirs.

Comparison of three methods for evaluation of work postures in a truck assembly plant.

PubMed

Zare, Mohsen; Biau, Sophie; Brunet, Rene; Roquelaure, Yves

2017-11-01

This study compared the results of three risk assessment tools (self-reported questionnaire, observational tool, direct measurement method) for the upper limbs and back in a truck assembly plant at two cycle times (11 and 8 min). The weighted Kappa factor showed fair agreement between the observational and direct measurement method for the arm (0.39) and back (0.47). The weighted Kappa factor for these methods was poor for the neck (0) and wrist (0) but the observed proportional agreement (P o ) was 0.78 for the neck and 0.83 for the wrist. The weighted Kappa factor between questionnaire and direct measurement showed poor or slight agreement (0) for different body segments in both cycle times. The results revealed moderate agreement between the observational tool and the direct measurement method, and poor agreement between the self-reported questionnaire and direct measurement. Practitioner Summary: This study provides risk exposure measurement by different common ergonomic methods in the field. The results help to develop valid measurements and improve exposure evaluation. Hence, the ergonomist/practitioners should apply the methods with caution, or at least knowing what the issues/errors are.

Effects of music therapy and distraction cards on pain relief during phlebotomy in children.

PubMed

Aydin, Diler; Sahiner, Nejla Canbulat

2017-02-01

To investigate three different distraction methods (distraction cards, listening to music, and distraction cards + music) on pain and anxiety relief in children during phlebotomy. This study was a prospective, randomized, controlled trial. The sample consisted of children aged 7 to 12years who required blood tests. The children were randomized into four groups, distraction cards, music, distraction cards + music, and controls. Data were obtained through face-to-face interviews with the children, their parents, and the observer before and after the procedure. The children's pain levels were assessed and reported by the parents and observers, and the children themselves who self-reported using Wong-Baker FACES. The children's anxiety levels were also assessed using the Children's Fear Scale. Two hundred children (mean age: 9.01±2.35years) were included. No difference was found between the groups in the self, parent, and observer reported procedural pain levels (p=0.72, p=0.23, p=0.15, respectively). Furthermore, no significant differences were observed between groups in procedural child anxiety levels according to the parents and observer (p=0.092, p=0.096, respectively). Pain and anxiety relief was seen in all three methods during phlebotomy; however, no statistically significant difference was observed. Copyright © 2016 Elsevier Inc. All rights reserved.

Effect of citizen engagement levels in flood forecasting by assimilating crowdsourced observations in hydrological models

NASA Astrophysics Data System (ADS)

Mazzoleni, Maurizio; Cortes Arevalo, Juliette; Alfonso, Leonardo; Wehn, Uta; Norbiato, Daniele; Monego, Martina; Ferri, Michele; Solomatine, Dimitri

2017-04-01

In the past years, a number of methods have been proposed to reduce uncertainty in flood prediction by means of model updating techniques. Traditional physical observations are usually integrated into hydrological and hydraulic models to improve model performances and consequent flood predictions. Nowadays, low-cost sensors can be used for crowdsourced observations. Different type of social sensors can measure, in a more distributed way, physical variables such as precipitation and water level. However, these crowdsourced observations are not integrated into a real-time fashion into water-system models due to their varying accuracy and random spatial-temporal coverage. We assess the effect in model performance due to the assimilation of crowdsourced observations of water level. Our method consists in (1) implementing a Kalman filter into a cascade of hydrological and hydraulic models. (2) defining observation errors depending on the type of sensor either physical or social. Randomly distributed errors are based on accuracy ranges that slightly improve according to the citizens' expertise level. (3) Using a simplified social model to realistically represent citizen engagement levels based on population density and citizens' motivation scenarios. To test our method, we synthetically derive crowdsourced observations for different citizen engagement levels from a distributed network of physical and social sensors. The observations are assimilated during a particular flood event occurred in the Bacchiglione catchment, Italy. The results of this study demonstrate that sharing crowdsourced water level observations (often motivated by a feeling of belonging to a community of friends) can help in improving flood prediction. On the other hand, a growing participation of individual citizens or weather enthusiasts sharing hydrological observations in cities can help to improve model performance. This study is a first step to assess the effects of crowdsourced observations in flood model predictions. Effective communication and feedback about the quality of observations from water authorities to engaged citizens are further required to minimize their intrinsic low-variable accuracy.

Relationship of maximum strength to weightlifting performance.

PubMed

Stone, Michael H; Sands, William A; Pierce, Kyle C; Carlock, Jon; Cardinale, Marco; Newton, Robert U

2005-06-01

The primary objective was to assess the relationship of maximum strength to weightlifting ability using established scaling methods. The secondary objective was to compare men and women weightlifters on strength and weightlifting ability. Two correlational observations were carried out using Pearson's r. In the first observation (N = 65) the relationship of dynamic maximum strength (one-repetition maximum (1RM) squat) was compared with weightlifting ability; in the second observation (N = 16), isometric maximum strength (midthigh pull) was studied. Scaling methods for equating maximum strength and weightlifting results were used (load x (Ht), load x kg, load x lbm(-1), allometric, and Sinclair formula) to assess the association between measures of maximum strength and weightlifting performance. Using scaled values; correlations between maximum strength and weightlifting results were generally strong in both observations (e.g., using allometric scaling for the 1RM squat vs the 1RM snatch: r = 0.84, N = 65). Men were stronger than women (e.g., 1RM squat, N = 65: men = 188.1 +/- 48.6 kg; women = 126.7 +/- 28.3 kg); differences generally held when scaling was applied (e.g., 1RM squat scaled with the Sinclair formula: men = 224.7 +/- 36.5 kg; women = 144.2 +/- 25.4 kg). When collectively considering scaling methods, maximum strength is strongly related to weightlifting performance independent of body mass and height differences. Furthermore, men are stronger than women even when body mass and height are obviated by scaling methods.

Is STAPLE algorithm confident to assess segmentation methods in PET imaging?

NASA Astrophysics Data System (ADS)

Dewalle-Vignion, Anne-Sophie; Betrouni, Nacim; Baillet, Clio; Vermandel, Maximilien

2015-12-01

Accurate tumor segmentation in [18F]-fluorodeoxyglucose positron emission tomography is crucial for tumor response assessment and target volume definition in radiation therapy. Evaluation of segmentation methods from clinical data without ground truth is usually based on physicians’ manual delineations. In this context, the simultaneous truth and performance level estimation (STAPLE) algorithm could be useful to manage the multi-observers variability. In this paper, we evaluated how this algorithm could accurately estimate the ground truth in PET imaging. Complete evaluation study using different criteria was performed on simulated data. The STAPLE algorithm was applied to manual and automatic segmentation results. A specific configuration of the implementation provided by the Computational Radiology Laboratory was used. Consensus obtained by the STAPLE algorithm from manual delineations appeared to be more accurate than manual delineations themselves (80% of overlap). An improvement of the accuracy was also observed when applying the STAPLE algorithm to automatic segmentations results. The STAPLE algorithm, with the configuration used in this paper, is more appropriate than manual delineations alone or automatic segmentations results alone to estimate the ground truth in PET imaging. Therefore, it might be preferred to assess the accuracy of tumor segmentation methods in PET imaging.

Is STAPLE algorithm confident to assess segmentation methods in PET imaging?

PubMed

Dewalle-Vignion, Anne-Sophie; Betrouni, Nacim; Baillet, Clio; Vermandel, Maximilien

2015-12-21

Accurate tumor segmentation in [18F]-fluorodeoxyglucose positron emission tomography is crucial for tumor response assessment and target volume definition in radiation therapy. Evaluation of segmentation methods from clinical data without ground truth is usually based on physicians' manual delineations. In this context, the simultaneous truth and performance level estimation (STAPLE) algorithm could be useful to manage the multi-observers variability. In this paper, we evaluated how this algorithm could accurately estimate the ground truth in PET imaging. Complete evaluation study using different criteria was performed on simulated data. The STAPLE algorithm was applied to manual and automatic segmentation results. A specific configuration of the implementation provided by the Computational Radiology Laboratory was used. Consensus obtained by the STAPLE algorithm from manual delineations appeared to be more accurate than manual delineations themselves (80% of overlap). An improvement of the accuracy was also observed when applying the STAPLE algorithm to automatic segmentations results. The STAPLE algorithm, with the configuration used in this paper, is more appropriate than manual delineations alone or automatic segmentations results alone to estimate the ground truth in PET imaging. Therefore, it might be preferred to assess the accuracy of tumor segmentation methods in PET imaging.

What are we missing? Advantages of more than one viewpoint to estimate fish assemblages using baited video

PubMed Central

Huveneers, Charlie; Fairweather, Peter G.

2018-01-01

Counting errors can bias assessments of species abundance and richness, which can affect assessments of stock structure, population structure and monitoring programmes. Many methods for studying ecology use fixed viewpoints (e.g. camera traps, underwater video), but there is little known about how this biases the data obtained. In the marine realm, most studies using baited underwater video, a common method for monitoring fish and nekton, have previously only assessed fishes using a single bait-facing viewpoint. To investigate the biases stemming from using fixed viewpoints, we added cameras to cover 360° views around the units. We found similar species richness for all observed viewpoints but the bait-facing viewpoint recorded the highest fish abundance. Sightings of infrequently seen and shy species increased with the additional cameras and the extra viewpoints allowed the abundance estimates of highly abundant schooling species to be up to 60% higher. We specifically recommend the use of additional cameras for studies focusing on shyer species or those particularly interested in increasing the sensitivity of the method by avoiding saturation in highly abundant species. Studies may also benefit from using additional cameras to focus observation on the downstream viewpoint. PMID:29892386

Stochastic modeling for time series InSAR: with emphasis on atmospheric effects

NASA Astrophysics Data System (ADS)

Cao, Yunmeng; Li, Zhiwei; Wei, Jianchao; Hu, Jun; Duan, Meng; Feng, Guangcai

2018-02-01

Despite the many applications of time series interferometric synthetic aperture radar (TS-InSAR) techniques in geophysical problems, error analysis and assessment have been largely overlooked. Tropospheric propagation error is still the dominant error source of InSAR observations. However, the spatiotemporal variation of atmospheric effects is seldom considered in the present standard TS-InSAR techniques, such as persistent scatterer interferometry and small baseline subset interferometry. The failure to consider the stochastic properties of atmospheric effects not only affects the accuracy of the estimators, but also makes it difficult to assess the uncertainty of the final geophysical results. To address this issue, this paper proposes a network-based variance-covariance estimation method to model the spatiotemporal variation of tropospheric signals, and to estimate the temporal variance-covariance matrix of TS-InSAR observations. The constructed stochastic model is then incorporated into the TS-InSAR estimators both for parameters (e.g., deformation velocity, topography residual) estimation and uncertainty assessment. It is an incremental and positive improvement to the traditional weighted least squares methods to solve the multitemporal InSAR time series. The performance of the proposed method is validated by using both simulated and real datasets.

Stress assessment in small ruminants kept on city farms in southern Germany.

PubMed

Schilling, Anna-Katarina; Reese, Sven; Palme, Rupert; Erhard, Michael; Wöhr, Anna-Caroline

2015-01-01

Sheep and goats are frequently used in nonhuman animal-assisted activities on city farms. There are few data available on this type of usage of small ruminants. Health evaluations, behavioral observations (feeding, resting, comfort, explorative and social behaviors), behavioral tests (human approach tests and touch test), and measurements of fecal cortisol metabolites and heart rate were performed to assess stress levels in 25 sheep and 32 goats on 7 city farms and 2 activity playgrounds in Germany. No evidence was found that the animals suffered from major distress. Health evaluations, behavioral observations, and behavioral tests proved to be the methods of stress assessment most suitable for routine on-farm checks in these settings.

Unmanned aerial vehicles for surveying marine fauna: assessing detection probability.

PubMed

Hodgson, Amanda; Peel, David; Kelly, Natalie

2017-06-01

Aerial surveys are conducted for various fauna to assess abundance, distribution, and habitat use over large spatial scales. They are traditionally conducted using light aircraft with observers recording sightings in real time. Unmanned Aerial Vehicles (UAVs) offer an alternative with many potential advantages, including eliminating human risk. To be effective, this emerging platform needs to provide detection rates of animals comparable to traditional methods. UAVs can also acquire new types of information, and this new data requires a reevaluation of traditional analyses used in aerial surveys; including estimating the probability of detecting animals. We conducted 17 replicate UAV surveys of humpback whales (Megaptera novaeangliae) while simultaneously obtaining a 'census' of the population from land-based observations, to assess UAV detection probability. The ScanEagle UAV, carrying a digital SLR camera, continuously captured images (with 75% overlap) along transects covering the visual range of land-based observers. We also used ScanEagle to conduct focal follows of whale pods (n = 12, mean duration = 40 min), to assess a new method of estimating availability. A comparison of the whale detections from the UAV to the land-based census provided an estimated UAV detection probability of 0.33 (CV = 0.25; incorporating both availability and perception biases), which was not affected by environmental covariates (Beaufort sea state, glare, and cloud cover). According to our focal follows, the mean availability was 0.63 (CV = 0.37), with pods including mother/calf pairs having a higher availability (0.86, CV = 0.20) than those without (0.59, CV = 0.38). The follows also revealed (and provided a potential correction for) a downward bias in group size estimates from the UAV surveys, which resulted from asynchronous diving within whale pods, and a relatively short observation window of 9 s. We have shown that UAVs are an effective alternative to traditional methods, providing a detection probability that is within the range of previous studies for our target species. We also describe a method of assessing availability bias that represents spatial and temporal characteristics of a survey, from the same perspective as the survey platform, is benign, and provides additional data on animal behavior. © 2017 by the Ecological Society of America.

Correlation between human observer performance and model observer performance in differential phase contrast CT

DOE Office of Scientific and Technical Information (OSTI.GOV)

Li, Ke; Garrett, John; Chen, Guang-Hong

2013-11-15

Purpose: With the recently expanding interest and developments in x-ray differential phase contrast CT (DPC-CT), the evaluation of its task-specific detection performance and comparison with the corresponding absorption CT under a given radiation dose constraint become increasingly important. Mathematical model observers are often used to quantify the performance of imaging systems, but their correlations with actual human observers need to be confirmed for each new imaging method. This work is an investigation of the effects of stochastic DPC-CT noise on the correlation of detection performance between model and human observers with signal-known-exactly (SKE) detection tasks.Methods: The detectabilities of different objectsmore » (five disks with different diameters and two breast lesion masses) embedded in an experimental DPC-CT noise background were assessed using both model and human observers. The detectability of the disk and lesion signals was then measured using five types of model observers including the prewhitening ideal observer, the nonprewhitening (NPW) observer, the nonprewhitening observer with eye filter and internal noise (NPWEi), the prewhitening observer with eye filter and internal noise (PWEi), and the channelized Hotelling observer (CHO). The same objects were also evaluated by four human observers using the two-alternative forced choice method. The results from the model observer experiment were quantitatively compared to the human observer results to assess the correlation between the two techniques.Results: The contrast-to-detail (CD) curve generated by the human observers for the disk-detection experiments shows that the required contrast to detect a disk is inversely proportional to the square root of the disk size. Based on the CD curves, the ideal and NPW observers tend to systematically overestimate the performance of the human observers. The NPWEi and PWEi observers did not predict human performance well either, as the slopes of their CD curves tended to be steeper. The CHO generated the best quantitative agreement with human observers with its CD curve overlapping with that of human observer. Statistical equivalence between CHO and humans can be claimed within 11% of the human observer results, including both the disk and lesion detection experiments.Conclusions: The model observer method can be used to accurately represent human observer performance with the stochastic DPC-CT noise for SKE tasks with sizes ranging from 8 to 128 pixels. The incorporation of the anatomical noise remains to be studied.« less

Numerical observer for atherosclerotic plaque classification in spectral computed tomography

PubMed Central

Lorsakul, Auranuch; Fakhri, Georges El; Worstell, William; Ouyang, Jinsong; Rakvongthai, Yothin; Laine, Andrew F.; Li, Quanzheng

2016-01-01

Abstract. Spectral computed tomography (SCT) generates better image quality than conventional computed tomography (CT). It has overcome several limitations for imaging atherosclerotic plaque. However, the literature evaluating the performance of SCT based on objective image assessment is very limited for the task of discriminating plaques. We developed a numerical-observer method and used it to assess performance on discrimination vulnerable-plaque features and compared the performance among multienergy CT (MECT), dual-energy CT (DECT), and conventional CT methods. Our numerical observer was designed to incorporate all spectral information and comprised two-processing stages. First, each energy-window domain was preprocessed by a set of localized channelized Hotelling observers (CHO). In this step, the spectral image in each energy bin was decorrelated using localized prewhitening and matched filtering with a set of Laguerre–Gaussian channel functions. Second, the series of the intermediate scores computed from all the CHOs were integrated by a Hotelling observer with an additional prewhitening and matched filter. The overall signal-to-noise ratio (SNR) and the area under the receiver operating characteristic curve (AUC) were obtained, yielding an overall discrimination performance metric. The performance of our new observer was evaluated for the particular binary classification task of differentiating between alternative plaque characterizations in carotid arteries. A clinically realistic model of signal variability was also included in our simulation of the discrimination tasks. The inclusion of signal variation is a key to applying the proposed observer method to spectral CT data. Hence, the task-based approaches based on the signal-known-exactly/background-known-exactly (SKE/BKE) framework and the clinical-relevant signal-known-statistically/background-known-exactly (SKS/BKE) framework were applied for analytical computation of figures of merit (FOM). Simulated data of a carotid-atherosclerosis patient were used to validate our methods. We used an extended cardiac-torso anthropomorphic digital phantom and three simulated plaque types (i.e., calcified plaque, fatty-mixed plaque, and iodine-mixed blood). The images were reconstructed using a standard filtered backprojection (FBP) algorithm for all the acquisition methods and were applied to perform two different discrimination tasks of: (1) calcified plaque versus fatty-mixed plaque and (2) calcified plaque versus iodine-mixed blood. MECT outperformed DECT and conventional CT systems for all cases of the SKE/BKE and SKS/BKE tasks (all p<0.01). On average of signal variability, MECT yielded the SNR improvements over other acquisition methods in the range of 46.8% to 65.3% (all p<0.01) for FBP-Ramp images and 53.2% to 67.7% (all p<0.01) for FBP-Hanning images for both identification tasks. This proposed numerical observer combined with our signal variability framework is promising for assessing material characterization obtained through the additional energy-dependent attenuation information of SCT. These methods can be further extended to other clinical tasks such as kidney or urinary stone identification applications. PMID:27429999

Exploring Assessment Tools for Research and Evaluation in Astronomy Education and Outreach

NASA Astrophysics Data System (ADS)

Buxner, S. R.; Wenger, M. C.; Dokter, E. F. C.

2011-09-01

The ability to effectively measure knowledge, attitudes, and skills in formal and informal educational settings is an important aspect of astronomy education research and evaluation. Assessments may take the form of interviews, observations, surveys, exams, or other probes to help unpack people's understandings or beliefs. In this workshop, we discussed characteristics of a variety of tools that exist to assess understandings of different concepts in astronomy as well as attitudes towards science and science teaching; these include concept inventories, surveys, interview protocols, observation protocols, card sorting, reflection videos, and other methods currently being used in astronomy education research and EPO program evaluations. In addition, we discussed common questions in the selection of assessment tools including issues of reliability and validity, time to administer, format of implementation, analysis, and human subject concerns.

Direct Behavior Rating: A Review of the Issues and Research in Its Development

ERIC Educational Resources Information Center

Chafouleas, Sandra M.

2011-01-01

The conceptual foundation for Direct Behavior Rating as a behavior assessment method is reviewed. A contemporary definition of Direct Behavior Rating is framed as combining strengths of systematic direct observation and behavior rating scales, which may result in a usable and defensible assessment tool for educators engaged in formative purposes.…

Records and Reports Guide

DTIC Science & Technology

2017-07-01

2017 to incorporate revised factors from the DEOMI Organizational Climate Survey (DEOCS) version 4.0 to version 4.1. This update primarily effects...begins with a survey , such as the DEOMI Organizational Climate Survey (DEOCS). Once survey themes, indicators, or concerns are identified, other...climate assessment to verify indicators and concerns identified through other assessment methods ( surveys , observations, and interviews

A Model for New Linkages for Prior Learning Assessment

ERIC Educational Resources Information Center

Kalz, Marco; van Bruggen, Jan; Giesbers, Bas; Waterink, Wim; Eshuis, Jannes; Koper, Rob

2008-01-01

Purpose: The purpose of this paper is twofold: first the paper aims to sketch the theoretical basis for the use of electronic portfolios for prior learning assessment; second it endeavours to introduce latent semantic analysis (LSA) as a powerful method for the computation of semantic similarity between texts and a basis for a new observation link…

Living memorials project: year 1 social and site assessment

Treesearch

Erika S. Svendsen; Lindsay K. Campbell

2005-01-01

The Living Memorials Project (LMP) social and site assessment identified more than 200 public open spaces created, used, or enhanced in memory of the tragic events of September 11, 2001 (9-11). A national registry of these sites is available for viewing and updating online. Researchers interviewed 100 community groups using social ecology methods of observation,...

Assessing Pre-Service Science Teachers' Technological Pedagogical Content Knowledge (TPACK) through Observations and Lesson Plans

ERIC Educational Resources Information Center

Canbazoglu Bilici, Sedef; Guzey, S. Selcen; Yamak, Havva

2016-01-01

Background: Technological pedagogical content knowledge (TPACK) is critical for effective teaching with technology. However, generally science teacher education programs do not help pre-service teachers develop TPACK. Purpose: The purpose of this study was to assess pre-service science teachers' TPACK over a semester-long Science Methods. Sample:…

A Standards-Based Approach for Reporting Assessment Results in South Africa

ERIC Educational Resources Information Center

Kanjee, Anil; Moloi, Qetelo

2016-01-01

This article proposes the use of a standards-based approach to reporting results from large-scale assessment surveys in South Africa. The use of this approach is intended to address the key shortcomings observed in the current reporting framework prescribed in the national curriculum documents. Using the Angoff method and data from the Annual…

Linking Indigenous Knowledge and Observed Climate Change Studies

NASA Technical Reports Server (NTRS)

Alexander, Chief Clarence; Bynum, Nora; Johnson, Liz; King, Ursula; Mustonen, Tero; Neofotis, Peter; Oettle, Noel; Rosenzweig, Cynthia; Sakakibara, Chie; Shadrin, Chief Vyacheslav;

An optimization approach for observation association with systemic uncertainty applied to electro-optical systems

NASA Astrophysics Data System (ADS)

Worthy, Johnny L.; Holzinger, Marcus J.; Scheeres, Daniel J.

2018-06-01

The observation to observation measurement association problem for dynamical systems can be addressed by determining if the uncertain admissible regions produced from each observation have one or more points of intersection in state space. An observation association method is developed which uses an optimization based approach to identify local Mahalanobis distance minima in state space between two uncertain admissible regions. A binary hypothesis test with a selected false alarm rate is used to assess the probability that an intersection exists at the point(s) of minimum distance. The systemic uncertainties, such as measurement uncertainties, timing errors, and other parameter errors, define a distribution about a state estimate located at the local Mahalanobis distance minima. If local minima do not exist, then the observations are not associated. The proposed method utilizes an optimization approach defined on a reduced dimension state space to reduce the computational load of the algorithm. The efficacy and efficiency of the proposed method is demonstrated on observation data collected from the Georgia Tech Space Object Research Telescope.

Beyond Instrumentation: Redesigning Measures and Methods for Evaluating the Graduate College Experience

ERIC Educational Resources Information Center

Hardré, Patricia L.; Hackett, Shannon

2015-01-01

This manuscript chronicles the process and products of a redesign for evaluation of the graduate college experience (GCE) which was initiated by a university graduate college, based on its observed need to reconsider and update its measures and methods for assessing graduate students' experiences. We examined the existing instrumentation and…

Modern methods of surveyor observations in opencast mining under complex hydrogeological conditions.

NASA Astrophysics Data System (ADS)

Usoltseva, L. A.; Lushpei, V. P.; Mursin, VA

2017-10-01

The article considers the possibility of linking the modern methods of surveying security of open mining works to improve industrial safety in the Primorsky Territory, as well as their use in the educational process. Industrial Safety in the management of Surface Mining depends largely on the applied assessment methods and methods of stability of pit walls and slopes of dumps in the complex mining and hydro-geological conditions.

Assessing Intracranial Vascular Compliance Using Dynamic Arterial Spin Labeling

PubMed Central

Yan, Lirong; Liu, Collin Y.; Smith, Robert X.; Jog, Mayank; Langham, Michael; Krasileva, Kate; Chen, Yufen; Ringman, John M.; Wang, Danny J.J.

2015-01-01

Vascular compliance (VC) is an important marker for a number of cardiovascular diseases and dementia, which is typically assessed in central and peripheral arteries indirectly by quantifying pulse wave velocity (PWV), and/or pulse pressure waveform. To date, very few methods are available for the quantification of intracranial VC. In the present study, a novel MRI technique for in-vivo assessment of intracranial VC was introduced, where dynamic arterial spin labeling (ASL) scans were synchronized with the systolic and diastolic phases of the cardiac cycle. VC is defined as the ratio of change in arterial cerebral blood volume (ΔCBV) and change in arterial pressure (ΔBP). Intracranial VC was assessed in different vascular components using the proposed dynamic ASL method. Our results show that VC mainly occurs in large arteries, gradually decreases in small arteries and arterioles. The comparison of intracranial VC between young and elderly subjects shows that aging is accompanied by a reduction of intracranial VC, in good agreement with the literature. Furthermore, a positive association between intracranial VC and cerebral perfusion measured using pseudo-continuous ASL with 3D GRASE MRI was observed independent of aging effects, suggesting loss of VC is associated with a decline in perfusion. Finally, a significant positive correlation between intracranial and central (aortic arch) VC was observed using an ungated phase-contrast 1D projection PWV technique. The proposed dynamic ASL method offers a promising approach for assessing intracranial VC in a range of cardiovascular diseases and dementia. PMID:26364865

A low-cost rapid upper limb assessment method in manual assembly line based on somatosensory interaction technology

NASA Astrophysics Data System (ADS)

Jiang, Shengqian; Liu, Peng; Fu, Danni; Xue, Yiming; Luo, Wentao; Wang, Mingjie

2017-04-01

As an effective survey method of upper limb disorder, rapid upper limb assessment (RULA) has a wide application in industry period. However, it is very difficult to rapidly evaluate operator's postures in real complex work place. In this paper, a real-time RULA method is proposed to accurately assess the potential risk of operator's postures based on the somatosensory data collected from Kinect sensor, which is a line of motion sensing input devices by Microsoft. First, the static position information of each bone point is collected to obtain the effective angles of body parts based on the calculating methods based on joints angles. Second, a whole RULA score of body is obtained to assess the risk level of current posture in real time. Third, those RULA scores are compared with the results provided by a group of ergonomic practitionerswho were asked to observe the same static postures. All the experiments were carried out in an ergonomic lab. The results show that the proposed method can detect operator's postures more accurately. What's more, this method is applied in a real-time condition which can improve the evaluating efficiency.

Neutral red cytotoxicity assays for assessing in vivo carbon nanotube ecotoxicity in mussels--Comparing microscope and microplate methods.

PubMed

Miller, M A; Bankier, C; Al-Shaeri, M A M; Hartl, M G J

2015-12-30

The purpose of the present study was to compare two neutral red retention methods, the more established but very labour-intensive microscope method (NRR) against the more recently developed microplate method (NRU). The intention was to explore whether the sample volume throughput could be increased and potential operator bias avoided. Mussels Mytilus sp. were exposed in vivo to 50, 250 and 500 μg L(-1) single (SWCNTs) or multi-walled carbon nanotubes (MWCNTs). Using the NRR method, SWCNTs and MWCNTs caused concentration dependent decreases in neutral red retention time. However, a concentration dependent decrease in optical density was not observed using the NRU method. We conclude that the NRU method is not sensitive enough to assess carbon nanotube ecotoxicity in vivo in environmentally relevant media, and recommend using the NRR method. Copyright © 2015 Elsevier Ltd. All rights reserved.

Direct runoff assessment using modified SME method in catchments in the Upper Vistula River Basin

NASA Astrophysics Data System (ADS)

Wałęga, A.; Rutkowska, A.; Grzebinoga, M.

2017-04-01

Correct determination of direct runoff is crucial for proper and safe dimensioning of hydroengineering structures. It is commonly assessed using SCS-CN method developed in the United States. However, due to deficiencies of this method, many improvements and modifications have been proposed. In this paper, a modified Sahu-Mishra-Eldo (SME) method was introduced and tested for three catchments located in the upper Vistula basin. Modification of SME method involved a determination of maximum potential retention S based on CN parameter derived from SCS-CN method. The modified SME method yielded direct runoff values very similar to those observed in the investigated catchments. Moreover, it generated significantly smaller errors in the direct runoff estimation as compared with SCS-CN and SME methods in the analyzed catchments. This approach may be used for estimating the runoff in uncontrolled catchments.

A CT scan protocol for the detection of radiographic loosening of the glenoid component after total shoulder arthroplasty

PubMed Central

2014-01-01

Background and purpose It is difficult to evaluate glenoid component periprosthetic radiolucencies in total shoulder arthroplasties (TSAs) using plain radiographs. This study was performed to evaluate whether computed tomography (CT) using a specific patient position in the CT scanner provides a better method for assessing radiolucencies in TSA. Methods Following TSA, 11 patients were CT scanned in a lateral decubitus position with maximum forward flexion, which aligns the glenoid orientation with the axis of the CT scanner. Follow-up CT scanning is part of our routine patient care. Glenoid component periprosthetic lucency was assessed according to the Molé score and it was compared to routine plain radiographs by 5 observers. Results The protocol almost completely eliminated metal artifacts in the CT images and allowed accurate assessment of periprosthetic lucency of the glenoid fixation. Positioning of the patient within the CT scanner as described was possible for all 11 patients. A radiolucent line was identified in 54 of the 55 observed CT scans and osteolysis was identified in 25 observations. The average radiolucent line Molé score was 3.4 (SD 2.7) points with plain radiographs and 9.5 (SD 0.8) points with CT scans (p = 0.001). The mean intra-observer variance was lower in the CT scan group than in the plain radiograph group (p = 0.001). Interpretation The CT scan protocol we used is of clinical value in routine assessment of glenoid periprosthetic lucency after TSA. The technique improves the ability to detect and monitor radiolucent lines and, therefore, possibly implant loosening also. PMID:24286563

Validation of a Smartphone Image-Based Dietary Assessment Method for Pregnant Women

PubMed Central

Ashman, Amy M.; Collins, Clare E.; Brown, Leanne J.; Rae, Kym M.; Rollo, Megan E.

2017-01-01

Image-based dietary records could lower participant burden associated with traditional prospective methods of dietary assessment. They have been used in children, adolescents and adults, but have not been evaluated in pregnant women. The current study evaluated relative validity of the DietBytes image-based dietary assessment method for assessing energy and nutrient intakes. Pregnant women collected image-based dietary records (via a smartphone application) of all food, drinks and supplements consumed over three non-consecutive days. Intakes from the image-based method were compared to intakes collected from three 24-h recalls, taken on random days; once per week, in the weeks following the image-based record. Data were analyzed using nutrient analysis software. Agreement between methods was ascertained using Pearson correlations and Bland-Altman plots. Twenty-five women (27 recruited, one withdrew, one incomplete), median age 29 years, 15 primiparas, eight Aboriginal Australians, completed image-based records for analysis. Significant correlations between the two methods were observed for energy, macronutrients and fiber (r = 0.58–0.84, all p < 0.05), and for micronutrients both including (r = 0.47–0.94, all p < 0.05) and excluding (r = 0.40–0.85, all p < 0.05) supplements in the analysis. Bland-Altman plots confirmed acceptable agreement with no systematic bias. The DietBytes method demonstrated acceptable relative validity for assessment of nutrient intakes of pregnant women. PMID:28106758

A Tobacco-Free Campus Ambassador Program and Policy Compliance

ERIC Educational Resources Information Center

Ickes, Melinda. J.; Rayens, Mary Kay; Wiggins, Amanda T.; Hahn, Ellen J.

2015-01-01

Objective: Assess impact and feasibility of a Tobacco-Free Ambassador Program on campus policy compliance. Participants: Trained Ambassadors made 253 visits to campus sites over 15 months to observe and/or approach violators. Methods: Policy violators were observed at 23 locations during Wave 1 (April-June 2012) and/or Wave 2 (April-June 2013).…

A New Experimental Method Assessing Attitudes toward Adolescent Dating and Sibling Violence Using Observations of Violent Interactions

ERIC Educational Resources Information Center

Reese-Weber, Marla

2008-01-01

The present study provides experimental data comparing emerging adults' attitudes toward dating and sibling violence in adolescence using a new methodology in which participants observe a violent interaction between adolescents. The reported amount of violence experienced in dating and sibling relationships among emerging adults is also compared.…

The effects of climate downscaling technique and observational data set on modeled ecological responses

Treesearch

Afshin Pourmokhtarian; Charles T. Driscoll; John L. Campbell; Katharine Hayhoe; Anne M. K. Stoner

2016-01-01

Assessments of future climate change impacts on ecosystems typically rely on multiple climate model projections, but often utilize only one downscaling approach trained on one set of observations. Here, we explore the extent to which modeled biogeochemical responses to changing climate are affected by the selection of the climate downscaling method and training...

A systematic framework for Monte Carlo simulation of remote sensing errors map in carbon assessments

Treesearch

S. Healey; P. Patterson; S. Urbanski

2014-01-01

Remotely sensed observations can provide unique perspective on how management and natural disturbance affect carbon stocks in forests. However, integration of these observations into formal decision support will rely upon improved uncertainty accounting. Monte Carlo (MC) simulations offer a practical, empirical method of accounting for potential remote sensing errors...

Intra- and inter-observer agreement in MRI assessment of rotator cuff healing using the Sugaya classification 10years after surgery.

PubMed

Niglis, L; Collin, P; Dosch, J-C; Meyer, N; Kempf, J-F

2017-10-01

The long-term outcomes of rotator cuff repair are unclear. Recurrent tears are common, although their reported frequency varies depending on the type and interpretation challenges of the imaging method used. The primary objective of this study was to assess the intra- and inter-observer reproducibility of the MRI assessment of rotator cuff repair using the Sugaya classification 10years after surgery. The secondary objective was to determine whether poor reproducibility, if found, could be improved by using a simplified yet clinically relevant classification. Our hypothesis was that reproducibility was limited but could be improved by simplifying the classification. In a retrospective study, we assessed intra- and inter-observer agreement in interpreting 49 magnetic resonance imaging (MRI) scans performed 10years after rotator cuff repair. These 49 scans were taken at random among 609 cases that underwent re-evaluation, with imaging, for the 2015 SoFCOT symposium on 10-year and 20-year clinical and anatomical outcomes of rotator cuff repair for full-thickness tears. Each of three observers read each of the 49 scans on two separate occasions. At each reading, they assessed the supra-spinatus tendon according to the Sugaya classification in five types. Intra-observer agreement for the Sugaya type was substantial (κ=0.64) but inter-observer agreement was only fair (κ=0.39). Agreement improved when the five Sugaya types were collapsed into two categories (1-2-3 and 4-5) (intra-observer κ=0.74 and inter-observer κ=0.68). Using the Sugaya classification to assess post-operative rotator cuff healing was associated with substantial intra-observer and fair inter-observer agreement. A simpler classification into two categories improved agreement while remaining clinically relevant. II, prospective randomised low-power study. Copyright © 2017 Elsevier Masson SAS. All rights reserved.

Using Support Vector Machine on EEG for Advertisement Impact Assessment.

PubMed

Wei, Zhen; Wu, Chao; Wang, Xiaoyi; Supratak, Akara; Wang, Pan; Guo, Yike

2018-01-01

The advertising industry depends on an effective assessment of the impact of advertising as a key performance metric for their products. However, current assessment methods have relied on either indirect inference from observing changes in consumer behavior after the launch of an advertising campaign, which has long cycle times and requires an ad campaign to have already have been launched (often meaning costs having been sunk). Or through surveys or focus groups, which have a potential for experimental biases, peer pressure, and other psychological and sociological phenomena that can reduce the effectiveness of the study. In this paper, we investigate a new approach to assess the impact of advertisement by utilizing low-cost EEG headbands to record and assess the measurable impact of advertising on the brain. Our evaluation shows the desired performance of our method based on user experiment with 30 recruited subjects after watching 220 different advertisements. We believe the proposed SVM method can be further developed to a general and scalable methodology that can enable advertising agencies to assess impact rapidly, quantitatively, and without bias.

Using Support Vector Machine on EEG for Advertisement Impact Assessment

PubMed Central

Wei, Zhen; Wu, Chao; Wang, Xiaoyi; Supratak, Akara; Wang, Pan; Guo, Yike

2018-01-01

The advertising industry depends on an effective assessment of the impact of advertising as a key performance metric for their products. However, current assessment methods have relied on either indirect inference from observing changes in consumer behavior after the launch of an advertising campaign, which has long cycle times and requires an ad campaign to have already have been launched (often meaning costs having been sunk). Or through surveys or focus groups, which have a potential for experimental biases, peer pressure, and other psychological and sociological phenomena that can reduce the effectiveness of the study. In this paper, we investigate a new approach to assess the impact of advertisement by utilizing low-cost EEG headbands to record and assess the measurable impact of advertising on the brain. Our evaluation shows the desired performance of our method based on user experiment with 30 recruited subjects after watching 220 different advertisements. We believe the proposed SVM method can be further developed to a general and scalable methodology that can enable advertising agencies to assess impact rapidly, quantitatively, and without bias. PMID:29593481

DOE Office of Scientific and Technical Information (OSTI.GOV)

Stone, Daithi A.; Hansen, Gerrit

Despite being a well-established research field, the detection and attribution of observed climate change to anthropogenic forcing is not yet provided as a climate service. One reason for this is the lack of a methodology for performing tailored detection and attribution assessments on a rapid time scale. Here we develop such an approach, based on the translation of quantitative analysis into the “confidence” language employed in recent Assessment Reports of the Intergovernmental Panel on Climate Change. While its systematic nature necessarily ignores some nuances examined in detailed expert assessments, the approach nevertheless goes beyond most detection and attribution studies inmore » considering contributors to building confidence such as errors in observational data products arising from sparse monitoring networks. When compared against recent expert assessments, the results of this approach closely match those of the existing assessments. Where there are small discrepancies, these variously reflect ambiguities in the details of what is being assessed, reveal nuances or limitations of the expert assessments, or indicate limitations of the accuracy of the sort of systematic approach employed here. Deployment of the method on 116 regional assessments of recent temperature and precipitation changes indicates that existing rules of thumb concerning the detectability of climate change ignore the full range of sources of uncertainty, most particularly the importance of adequate observational monitoring.« less

Investigating the relationship between two home numeracy measures: A questionnaire and observations during Lego building and book reading.

PubMed

Mutaf Yildiz, Belde; Sasanguie, Delphine; De Smedt, Bert; Reynvoet, Bert

2018-06-01

Home numeracy has been defined as the parent-child interactions that include experiences with numerical content in daily-life settings. Previous studies have commonly operationalized home numeracy either via questionnaires or via observational methods. These studies have shown that both types of measures are positively related to variability in children's mathematical skills. This study investigated whether these distinctive data collection methods index the same aspect of home numeracy. The frequencies of home numeracy activities and parents' opinions about their children's mathematics education were assessed via a questionnaire. The amount of home numeracy talk was observed via two semi-structured videotaped parent-child activity sessions (Lego building and book reading). Children's mathematical skills were examined with two calculation subtests. We observed that parents' reports and number of observed numeracy interactions were not related to each other. Interestingly, parents' reports of numeracy activities were positively related to children's calculation abilities, whereas the observed home numeracy talk was negatively related to children's calculation abilities. These results indicate that these two methods tap on different aspects of home numeracy. Statement of contribution What is already known on this subject? Home numeracy, that is, parent-child interactions that include experiences with numerical content, is supposed to have a positive impact on calculation or mathematical ability in general. Despite many positive results, some studies have failed to find such an association. Home numeracy has been assessed with questionnaires on the frequency of numerical experiences and observations of parent-child interactions; however, those two measures of home numeracy have never been compared directly. What does this study add? This study assessed home numeracy through questionnaires and observations in the 44 parent-child dyads and showed that home numeracy measures derived from questionnaires and observations are not related. Moreover, the relation between the reported frequency of home numeracy activities and calculation on the one hand, and parent-child number talk (derived from observations) and calculation on the other hand is in opposite directions; the frequency of activities is positively related to calculation performance; and the amount of number talk is negatively related to calculation. This study shows that both measures tap into different aspects of home numeracy and can be an important factor explaining inconsistencies in literature. © 2018 The British Psychological Society.

An exploratory study of the influence of national and state standards on middle school science teachers' classroom assessment practices

NASA Astrophysics Data System (ADS)

McWaters, Kathy Jean

2001-07-01

Classroom assessment practices of middle school science teachers were identified and the influence of national and state science standards on these practices was examined. In Phase I of this study a mail questionnaire was sent to 450 middle school (grades 5,6,7 and 8) science teachers in 17 parishes in Louisiana to obtain information about their classroom assessment practices. In Phase II, nine middle school teachers in eight departmentalized classrooms, two classes at each grade, participated in a qualitative study. Data were collected through questionnaires, classroom observations, interviews and document analysis. Data analysis revealed three major categories of classroom assessment targets: (a) student achievement, (b) student attitudes and, (c) student products. Results indicated that most teachers are using different assessment methods when assessing different achievement targets, as recommended by science reform documents. It was also determined that many teachers are using appropriate methods to assess student learning. While teachers reported that students spend an inordinate amount of time engaged in assessment activities, classroom observations suggested that the activities were not always written tests or graded activities. Another key finding is that there is a disconnect between the quality of teaching and the quality of assessment. Teachers who teach the material recommended by science reform documents and use recommended instructional strategies were observed to stop teaching and engage students in a "test rehearsal" geared towards rote memorization of factual information. Data suggest that the national and state science content standards are influencing the content and the format of teacher-made tests. Teachers' reported using the standards during assessment construction or selection in a wide variety of ways. The most direct use of the standards reported was to select content, format and cognitive level for test items. A more circumspect approach used by teachers was to use the standards to write lesson plans and objectives and then to plan assessments based on these teacher-constructed objectives. Questionnaire data indicated that the three factors having the most influence on teachers' selection or construction of a particular type of assessment were: (a) how students learn, (b) alignment with state/district standards, and (c) purpose for assessment.

Transparency-enhancing technology allows three-dimensional assessment of gastrointestinal mucosa: A porcine model.

PubMed

Mizutani, Hiroya; Ono, Satoshi; Ushiku, Tetsuo; Kudo, Yotaro; Ikemura, Masako; Kageyama, Natsuko; Yamamichi, Nobutake; Fujishiro, Mitsuhiro; Someya, Takao; Fukayama, Masashi; Koike, Kazuhiko; Onodera, Hiroshi

2018-02-01

Although high-resolution three-dimensional imaging of endoscopically resected gastrointestinal specimens can help elucidating morphological features of gastrointestinal mucosa or tumor, there are no established methods to achieve this without breaking specimens apart. We evaluated the utility of transparency-enhancing technology for three-dimensional assessment of gastrointestinal mucosa in porcine models. Esophagus, stomach, and colon mucosa samples obtained from a sacrificed swine were formalin-fixed and paraffin-embedded, and subsequently deparaffinized for analysis. The samples were fluorescently stained, optically cleared using transparency-enhancing technology: ilLUmination of Cleared organs to IDentify target molecules method (LUCID), and visualized using laser scanning microscopy. After observation, all specimens were paraffin-embedded again and evaluated by conventional histopathological assessment to measure the impact of transparency-enhancing procedures. As a result, microscopic observation revealed horizontal section views of mucosa at deeper levels and enabled the three-dimensional image reconstruction of glandular and vascular structures. Besides, paraffin-embedded specimens after transparency-enhancing procedures were all assessed appropriately by conventional histopathological staining. These results suggest that transparency-enhancing technology may be feasible for clinical application and enable the three-dimensional structural analysis of endoscopic resected specimen non-destructively. Although there remain many limitations or problems to be solved, this promising technology might represent a novel histopathological method for evaluating gastrointestinal cancers. © 2018 Japanese Society of Pathology and John Wiley & Sons Australia, Ltd.

Milestone-specific, Observed data points for evaluating levels of performance (MODEL) assessment strategy for anesthesiology residency programs.

PubMed

Nagy, Christopher J; Fitzgerald, Brian M; Kraus, Gregory P

2014-01-01

Anesthesiology residency programs will be expected to have Milestones-based evaluation systems in place by July 2014 as part of the Next Accreditation System. The San Antonio Uniformed Services Health Education Consortium (SAUSHEC) anesthesiology residency program developed and implemented a Milestones-based feedback and evaluation system a year ahead of schedule. It has been named the Milestone-specific, Observed Data points for Evaluating Levels of performance (MODEL) assessment strategy. The "MODEL Menu" and the "MODEL Blueprint" are tools that other anesthesiology residency programs can use in developing their own Milestones-based feedback and evaluation systems prior to ACGME-required implementation. Data from our early experience with the streamlined MODEL blueprint assessment strategy showed substantially improved faculty compliance with reporting requirements. The MODEL assessment strategy provides programs with a workable assessment method for residents, and important Milestones data points to programs for ACGME reporting.

Assessing the surgical skills of trainees in the operating theatre: a prospective observational study of the methodology.

PubMed

Beard, J D; Marriott, J; Purdie, H; Crossley, J

2011-01-01

To compare user satisfaction and acceptability, reliability and validity of three different methods of assessing the surgical skills of trainees by direct observation in the operating theatre across a range of different surgical specialties and index procedures. A 2-year prospective, observational study in the operating theatres of three teaching hospitals in Sheffield. The assessment methods were procedure-based assessment (PBA), Objective Structured Assessment of Technical Skills (OSATS) and Non-technical Skills for Surgeons (NOTSS). The specialties were obstetrics and gynaecology (O&G) and upper gastrointestinal, colorectal, cardiac, vascular and orthopaedic surgery. Two to four typical index procedures were selected from each specialty. Surgical trainees were directly observed performing typical index procedures and assessed using a combination of two of the three methods (OSATS or PBA and NOTSS for O&G, PBA and NOTSS for the other specialties) by the consultant clinical supervisor for the case and the anaesthetist and/or scrub nurse, as well as one or more independent assessors from the research team. Information on user satisfaction and acceptability of each assessment method from both assessor and trainee perspectives was obtained from structured questionnaires. The reliability of each method was measured using generalisability theory. Aspects of validity included the internal structure of each tool and correlation between tools, construct validity, predictive validity, interprocedural differences, the effect of assessor designation and the effect of assessment on performance. Of the 558 patients who were consented, a total of 437 (78%) cases were included in the study: 51 consultant clinical supervisors, 56 anaesthetists, 39 nurses, 2 surgical care practitioners and 4 independent assessors provided 1635 assessments on 85 trainees undertaking the 437 cases. A total of 749 PBAs, 695 NOTSS and 191 OSATSs were performed. Non-O&G clinical supervisors and trainees provided mixed, but predominantly positive, responses about a range of applications of PBA. Most felt that PBA was important in surgical education, and would use it again in the future and did not feel that it added time to the operating list. The overall satisfaction of O&G clinical supervisors and trainees with OSATS was not as high, and a majority of those who used both preferred PBA. A majority of anaesthetists and nurses felt that NOTSS allowed them to rate interpersonal skills (communication, teamwork and leadership) more easily than cognitive skills (situation awareness and decision-making), that it had formative value and that it was a valuable adjunct to the assessment of technical skills. PBA demonstrated high reliability (G > 0.8 for only three assessor judgements on the same index procedure). OSATS had lower reliability (G > 0.8 for five assessor judgements on the same index procedure). Both were less reliable on a mix of procedures because of strong procedure-specific factors. A direct comparison of PBA between O&G and non-O&G cases showed a striking difference in reliability. Within O&G, a good level of reliability (G > 0.8) could not be obtained using a feasible number of assessments. Conversely, the reliability within non-O&G cases was exceptionally high, with only two assessor judgements being required. The reasons for this difference probably include the more summative purpose of assessment in O&G and the much higher proportion of O&G trainees in this study with training concerns (42% vs 4%). The reliability of NOTSS was lower than that for PBA. Reliability for the same procedure (G > 0.8) required six assessor judgements. However, as procedure-specific factors exerted a lesser influence on NOTSS, reliability on a mix of procedures could be achieved using only eight assessor judgements. NOTSS also demonstrated a valid internal structure. The strongest correlations between NOTSS and PBA or OSATS were in the 'decision-making' domain. PBA and NOTSS showed better construct validity than OSATS, the year of training and the number of recent index procedures performed being significant independent predictors of performance. There was little variation in scoring between different procedures or different designations of assessor. The results suggest that PBA is a reliable and acceptable method of assessing surgical skills, with good construct validity. Specialties that use OSATS may wish to consider changing the design or switching to PBA. Whatever workplace-based assessment method is used, the purpose, timing and frequency of assessment require detailed guidance. NOTSS is a promising tool for the assessment of non-technical skills, and surgical specialties may wish to consider its inclusion in their assessment framework. Further research is required into the use of health-care professionals other than consultant surgeons to assess trainees, the relationship between performance and experience, the educational impact of assessment and the additional value of video recording.

The Parental Overprotection Scale: Associations with child and parental anxiety☆

PubMed Central

Clarke, Kiri; Cooper, Peter; Creswell, Cathy

2013-01-01

Background Parental overprotection has commonly been implicated in the development and maintenance of childhood anxiety disorders. Overprotection has been assessed using questionnaire and observational methods interchangeably; however, the extent to which these methods access the same construct has received little attention. Edwards et al. (2008, 2010) developed a promising parent-report measure of overprotection (OP) and reported that, with parents of pre-school children, the measure correlated with observational assessments and predicted changes in child anxiety symptoms. We aimed to validate the use of the OP measure with mothers of children in middle childhood, and examine its association with child and parental anxiety. Methods Mothers of 90 children (60 clinically anxious, 30 non-anxious) aged 7–12 years completed the measure and engaged in a series of mildly stressful tasks with their child. Results The internal reliability of the measure was good and scores correlated significantly with observations of maternal overprotection in a challenging puzzle task. Contrary to expectations, OP was not significantly associated with child anxiety status or symptoms, but was significantly associated with maternal anxiety symptoms. Limitations Participants were predominantly from affluent social groups and of non-minority status. Overprotection is a broad construct, the use of specific sub-dimensions of behavioural constructs may be preferable. Conclusions The findings support the use of the OP measure to assess parental overprotection among 7–12 year-old children; however, they suggest that parental responses may be more closely related to the degree of parental rather than child anxiety. PMID:23916305

Assessing covariate balance when using the generalized propensity score with quantitative or continuous exposures.

PubMed

Austin, Peter C

2018-01-01

Propensity score methods are increasingly being used to estimate the effects of treatments and exposures when using observational data. The propensity score was initially developed for use with binary exposures (e.g., active treatment vs. control). The generalized propensity score is an extension of the propensity score for use with quantitative exposures (e.g., dose or quantity of medication, income, years of education). A crucial component of any propensity score analysis is that of balance assessment. This entails assessing the degree to which conditioning on the propensity score (via matching, weighting, or stratification) has balanced measured baseline covariates between exposure groups. Methods for balance assessment have been well described and are frequently implemented when using the propensity score with binary exposures. However, there is a paucity of information on how to assess baseline covariate balance when using the generalized propensity score. We describe how methods based on the standardized difference can be adapted for use with quantitative exposures when using the generalized propensity score. We also describe a method based on assessing the correlation between the quantitative exposure and each covariate in the sample when weighted using generalized propensity score -based weights. We conducted a series of Monte Carlo simulations to evaluate the performance of these methods. We also compared two different methods of estimating the generalized propensity score: ordinary least squared regression and the covariate balancing propensity score method. We illustrate the application of these methods using data on patients hospitalized with a heart attack with the quantitative exposure being creatinine level.

Lunar Surface Habitat Configuration Assessment: Methodology and Observations

NASA Technical Reports Server (NTRS)

Carpenter, Amanda

2008-01-01

The Lunar Habitat Configuration Assessment evaluated the major habitat approaches that were conceptually developed during the Lunar Architecture Team II Study. The objective of the configuration assessment was to identify desired features, operational considerations, and risks to derive habitat requirements. This assessment only considered operations pertaining to the lunar surface and did not consider all habitat conceptual designs developed. To examine multiple architectures, the Habitation Focus Element Team defined several adequate concepts which warranted the need for a method to assess the various configurations. The fundamental requirement designed into each concept included the functional and operational capability to support a crew of four on a six-month lunar surface mission; however, other conceptual aspects were diverse in comparison. The methodology utilized for this assessment consisted of defining figure of merits, providing relevant information, and establishing a scoring system. In summary, the assessment considered the geometric configuration of each concept to determine the complexity of unloading, handling, mobility, leveling, aligning, mating to other elements, and the accessibility to the lunar surface. In theory, the assessment was designed to derive habitat requirements, potential technology development needs and identify risks associated with living and working on the lunar surface. Although the results were more subjective opposed to objective, the assessment provided insightful observations for further assessments and trade studies of lunar surface habitats. This overall methodology and resulting observations will be describe in detail and illustrative examples will be discussed.

Applying Propensity Score Methods in Medical Research: Pitfalls and Prospects

PubMed Central

Luo, Zhehui; Gardiner, Joseph C.; Bradley, Cathy J.

2012-01-01

The authors review experimental and nonexperimental causal inference methods, focusing on assumptions for the validity of instrumental variables and propensity score (PS) methods. They provide guidance in four areas for the analysis and reporting of PS methods in medical research and selectively evaluate mainstream medical journal articles from 2000 to 2005 in the four areas, namely, examination of balance, overlapping support description, use of estimated PS for evaluation of treatment effect, and sensitivity analyses. In spite of the many pitfalls, when appropriately evaluated and applied, PS methods can be powerful tools in assessing average treatment effects in observational studies. Appropriate PS applications can create experimental conditions using observational data when randomized controlled trials are not feasible and, thus, lead researchers to an efficient estimator of the average treatment effect. PMID:20442340

Evaluation of patients with painful total hip arthroplasty using combined single photon emission tomography and conventional computerized tomography (SPECT/CT) - a comparison of semi-quantitative versus 3D volumetric quantitative measurements.

PubMed

Barthassat, Emilienne; Afifi, Faik; Konala, Praveen; Rasch, Helmut; Hirschmann, Michael T

2017-05-08

It was the primary purpose of our study to evaluate the inter- and intra-observer reliability of a standardized SPECT/CT algorithm for evaluating patients with painful primary total hip arthroplasty (THA). The secondary purpose was a comparison of semi-quantitative and 3D volumetric quantification method for assessment of bone tracer uptake (BTU) in those patients. A novel SPECT/CT localization scheme consisting of 14 femoral and 4 acetabular regions on standardized axial and coronal slices was introduced and evaluated in terms of inter- and intra-observer reliability in 37 consecutive patients with hip pain after THA. BTU for each anatomical region was assessed semi-quantitatively using a color-coded Likert type scale (0-10) and volumetrically quantified using a validated software. Two observers interpreted the SPECT/CT findings in all patients two times with six weeks interval between interpretations in random order. Semi-quantitative and quantitative measurements were compared in terms of reliability. In addition, the values were correlated using Pearson`s correlation. A factorial cluster analysis of BTU was performed to identify clinically relevant regions, which should be grouped and analysed together. The localization scheme showed high inter- and intra-observer reliabilities for all femoral and acetabular regions independent of the measurement method used (semiquantitative versus 3D volumetric quantitative measurements). A high to moderate correlation between both measurement methods was shown for the distal femur, the proximal femur and the acetabular cup. The factorial cluster analysis showed that the anatomical regions might be summarized into three distinct anatomical regions. These were the proximal femur, the distal femur and the acetabular cup region. The SPECT/CT algorithm for assessment of patients with pain after THA is highly reliable independent from the measurement method used. Three clinically relevant anatomical regions (proximal femoral, distal femoral, acetabular) were identified.

Monitoring progression of clinical reasoning skills during health sciences education using the case method - a qualitative observational study.

PubMed

Orban, Kristina; Ekelin, Maria; Edgren, Gudrun; Sandgren, Olof; Hovbrandt, Pia; Persson, Eva K

2017-09-11

Outcome- or competency-based education is well established in medical and health sciences education. Curricula are based on courses where students develop their competences and assessment is also usually course-based. Clinical reasoning is an important competence, and the aim of this study was to monitor and describe students' progression in professional clinical reasoning skills during health sciences education using observations of group discussions following the case method. In this qualitative study students from three different health education programmes were observed while discussing clinical cases in a modified Harvard case method session. A rubric with four dimensions - problem-solving process, disciplinary knowledge, character of discussion and communication - was used as an observational tool to identify clinical reasoning. A deductive content analysis was performed. The results revealed the students' transition over time from reasoning based strictly on theoretical knowledge to reasoning ability characterized by clinical considerations and experiences. Students who were approaching the end of their education immediately identified the most important problem and then focused on this in their discussion. Practice knowledge increased over time, which was seen as progression in the use of professional language, concepts, terms and the use of prior clinical experience. The character of the discussion evolved from theoretical considerations early in the education to clinical reasoning in later years. Communication within the groups was supportive and conducted with a professional tone. Our observations revealed progression in several aspects of students' clinical reasoning skills on a group level in their discussions of clinical cases. We suggest that the case method can be a useful tool in assessing quality in health sciences education.

Observer variation in the assessment of root canal curvature.

PubMed

Faraj, S; Boutsioukis, C

2017-02-01

To evaluate the inter- and intra-observer agreement between training/trained endodontists regarding the ex vivo classification of root canal curvature into three categories and its measurement using three quantitative methods. Periapical radiographs of seven extracted human posterior teeth with varying degrees of curvature were exposed ex vivo. Twenty training/trained endodontists were asked to classify the root canal curvature into three categories (<10°, 10-30°, >30°), to measure the curvature using three quantitative methods (Schneider, Weine, Pruett) and to draw angles of 10° or 30°, as a control experiment. The procedure was repeated after six weeks. Inter- and intra-observer agreement was evaluated by the intraclass correlation coefficient and weighted kappa. The inter-observer agreement on the visual classification of root canal curvature was substantial (ICC = 0.65, P < 0.018), but a trend towards underestimation of the angle was evident. Participants modified their classifications both within and between the two sessions. Median angles drawn as a control experiment were not significantly different from the target values (P > 0.10), but the results of individual participants varied. When quantitative methods were used, the inter- and intra-observer agreement on the angle measurements was considerably better (ICC = 0.76-0.82, P < 0.001) than on the radius measurements (ICC = 0.16-0.19, P > 0.895). Visual estimation of root canal curvature was not reliable. The use of computer-based quantitative methods is recommended. The measurement of radius of curvature was more subjective than angle measurement. Endodontic Associations need to provide specific guidelines on how to estimate root canal curvature in case difficulty assessment forms. © 2015 International Endodontic Journal. Published by John Wiley & Sons Ltd.

Suicide Risk Assessment and Prevention: A Systematic Review Focusing on Veterans.

PubMed

Nelson, Heidi D; Denneson, Lauren M; Low, Allison R; Bauer, Brian W; O'Neil, Maya; Kansagara, Devan; Teo, Alan R

2017-10-01

Suicide rates in veteran and military populations in the United States are high. This article reviews studies of the accuracy of methods to identify individuals at increased risk of suicide and the effectiveness and adverse effects of health care interventions relevant to U.S. veteran and military populations in reducing suicide and suicide attempts. Trials, observational studies, and systematic reviews relevant to U.S. veterans and military personnel were identified in searches of MEDLINE, PsycINFO, SocINDEX, and Cochrane databases (January 1, 2008, to September 11, 2015), on Web sites, and in reference lists. Investigators extracted and confirmed data and dual-rated risk of bias for included studies. Nineteen studies evaluated accuracy of risk assessment methods, including models using retrospective electronic records data and clinician- or patient-rated instruments. Most methods demonstrated sensitivity ≥80% or area-under-the-curve values ≥.70 in single studies, including two studies based on electronic records of veterans and military personnel, but specificity varied. Suicide rates were reduced in six of eight observational studies of population-level interventions. Only two of ten trials of individual-level psychotherapy reported statistically significant differences between treatment and usual care. Risk assessment methods have been shown to be sensitive predictors of suicide and suicide attempts, but the frequency of false positives limits their clinical utility. Research to refine these methods and examine clinical applications is needed. Studies of suicide prevention interventions are inconclusive; trials of population-level interventions and promising therapies are required to support their clinical use.

Impact of workplace based assessment on doctors' education and performance: a systematic review.

PubMed

Miller, Alice; Archer, Julian

2010-09-24

To investigate the literature for evidence that workplace based assessment affects doctors' education and performance. Systematic review. The primary data sources were the databases Journals@Ovid, Medline, Embase, CINAHL, PsycINFO, and ERIC. Evidence based reviews (Bandolier, Cochrane Library, DARE, HTA Database, and NHS EED) were accessed and searched via the Health Information Resources website. Reference lists of relevant studies and bibliographies of review articles were also searched. Review methods Studies of any design that attempted to evaluate either the educational impact of workplace based assessment, or the effect of workplace based assessment on doctors' performance, were included. Studies were excluded if the sampled population was non-medical or the study was performed with medical students. Review articles, commentaries, and letters were also excluded. The final exclusion criterion was the use of simulated patients or models rather than real life clinical encounters. Sixteen studies were included. Fifteen of these were non-comparative descriptive or observational studies; the other was a randomised controlled trial. Study quality was mixed. Eight studies examined multisource feedback with mixed results; most doctors felt that multisource feedback had educational value, although the evidence for practice change was conflicting. Some junior doctors and surgeons displayed little willingness to change in response to multisource feedback, whereas family physicians might be more prepared to initiate change. Performance changes were more likely to occur when feedback was credible and accurate or when coaching was provided to help subjects identify their strengths and weaknesses. Four studies examined the mini-clinical evaluation exercise, one looked at direct observation of procedural skills, and three were concerned with multiple assessment methods: all these studies reported positive results for the educational impact of workplace based assessment tools. However, there was no objective evidence of improved performance with these tools. Considering the emphasis placed on workplace based assessment as a method of formative performance assessment, there are few published articles exploring its impact on doctors' education and performance. This review shows that multisource feedback can lead to performance improvement, although individual factors, the context of the feedback, and the presence of facilitation have a profound effect on the response. There is no evidence that alternative workplace based assessment tools (mini-clinical evaluation exercise, direct observation of procedural skills, and case based discussion) lead to improvement in performance, although subjective reports on their educational impact are positive.

Gingival Retraction Methods: A Systematic Review.

PubMed

Tabassum, Sadia; Adnan, Samira; Khan, Farhan Raza

2017-12-01

The aim of this systematic review was to assess the gingival retraction methods in terms of the amount of gingival retraction achieved and changes observed in various clinical parameters: gingival index (GI), plaque index (PI), probing depth (PD), and attachment loss (AL). Data sources included three major databases, PubMed, CINAHL plus (Ebsco), and Cochrane, along with hand search. Search was made using the key terms in different permutations of gingival retraction* AND displacement method* OR technique* OR agents OR material* OR medicament*. The initial search results yielded 145 articles which were narrowed down to 10 articles using a strict eligibility criteria of including clinical trials or experimental studies on gingival retraction methods with the amount of tooth structure gained and assessment of clinical parameters as the outcomes conducted on human permanent teeth only. Gingival retraction was measured in 6/10 studies whereas the clinical parameters were assessed in 5/10 studies. The total number of teeth assessed in the 10 included studies was 400. The most common method used for gingival retraction was chemomechanical. The results were heterogeneous with regards to the outcome variables. No method seemed to be significantly superior to the other in terms of gingival retraction achieved. Clinical parameters were not significantly affected by the gingival retraction method. © 2016 by the American College of Prosthodontists.

Developing an Automated Method for Detection of Operationally Relevant Ocean Fronts and Eddies

NASA Astrophysics Data System (ADS)

Rogers-Cotrone, J. D.; Cadden, D. D. H.; Rivera, P.; Wynn, L. L.

2016-02-01

Since the early 90's, the U.S. Navy has utilized an observation-based process for identification of frontal systems and eddies. These Ocean Feature Assessments (OFA) rely on trained analysts to identify and position ocean features using satellite-observed sea surface temperatures. Meanwhile, as enhancements and expansion of the navy's Hybrid Coastal Ocean Model (HYCOM) and Regional Navy Coastal Ocean Model (RNCOM) domains have proceeded, the Naval Oceanographic Office (NAVO) has provided Tactical Oceanographic Feature Assessments (TOFA) that are based on data-validated model output but also rely on analyst identification of significant features. A recently completed project has migrated OFA production to the ArcGIS-based Acoustic Reach-back Cell Ocean Analysis Suite (ARCOAS), enabling use of additional observational datasets and significantly decreasing production time; however, it has highlighted inconsistencies inherent to this analyst-based identification process. Current efforts are focused on development of an automated method for detecting operationally significant fronts and eddies that integrates model output and observational data on a global scale. Previous attempts to employ techniques from the scientific community have been unable to meet the production tempo at NAVO. Thus, a system that incorporates existing techniques (Marr-Hildreth, Okubo-Weiss, etc.) with internally-developed feature identification methods (from model-derived physical and acoustic properties) is required. Ongoing expansions to the ARCOAS toolset have shown promising early results.

Fracture prediction and calibration of a Canadian FRAX® tool: a population-based report from CaMos

PubMed Central

Fraser, L.-A.; Langsetmo, L.; Berger, C.; Ioannidis, G.; Goltzman, D.; Adachi, J. D.; Papaioannou, A.; Josse, R.; Kovacs, C. S.; Olszynski, W. P.; Towheed, T.; Hanley, D. A.; Kaiser, S. M.; Prior, J.; Jamal, S.; Kreiger, N.; Brown, J. P.; Johansson, H.; Oden, A.; McCloskey, E.; Kanis, J. A.

2016-01-01

Summary A new Canadian WHO fracture risk assessment (FRAX®) tool to predict 10-year fracture probability was compared with observed 10-year fracture outcomes in a large Canadian population-based study (CaMos). The Canadian FRAX tool showed good calibration and discrimination for both hip and major osteoporotic fractures. Introduction The purpose of this study was to validate a new Canadian WHO fracture risk assessment (FRAX®) tool in a prospective, population-based cohort, the Canadian Multi-centre Osteoporosis Study (CaMos). Methods A FRAX tool calibrated to the Canadian population was developed by the WHO Collaborating Centre for Metabolic Bone Diseases using national hip fracture and mortality data. Ten-year FRAX probabilities with and without bone mineral density (BMD) were derived for CaMos women (N=4,778) and men (N=1,919) and compared with observed fracture outcomes to 10 years (Kaplan–Meier method). Cox proportional hazard models were used to investigate the contribution of individual FRAX variables. Results Mean overall 10-year FRAX probability with BMD for major osteoporotic fractures was not significantly different from the observed value in men [predicted 5.4% vs. observed 6.4% (95%CI 5.2–7.5%)] and only slightly lower in women [predicted 10.8% vs. observed 12.0% (95%CI 11.0–12.9%)]. FRAX was well calibrated for hip fracture assessment in women [predicted 2.7% vs. observed 2.7% (95%CI 2.2–3.2%)] but underestimated risk in men [predicted 1.3% vs. observed 2.4% (95%CI 1.7–3.1%)]. FRAX with BMD showed better fracture discrimination than FRAX without BMD or BMD alone. Age, body mass index, prior fragility fracture and femoral neck BMD were significant independent predictors of major osteoporotic fractures; sex, age, prior fragility fracture and femoral neck BMD were significant independent predictors of hip fractures. Conclusion The Canadian FRAX tool provides predictions consistent with observed fracture rates in Canadian women and men, thereby providing a valuable tool for Canadian clinicians assessing patients at risk of fracture. PMID:21161508

Accelerated aging: prediction of chemical stability of pharmaceuticals.

PubMed

Waterman, Kenneth C; Adami, Roger C

2005-04-11

Methods of rapidly and accurately assessing the chemical stability of pharmaceutical dosage forms are reviewed with respect to the major degradation mechanisms generally observed in pharmaceutical development. Methods are discussed, with the appropriate caveats, for accelerated aging of liquid and solid dosage forms, including small and large molecule active pharmaceutical ingredients. In particular, this review covers general thermal methods, as well as accelerated aging methods appropriate to oxidation, hydrolysis, reaction with reactive excipient impurities, photolysis and protein denaturation.

Development and comparison in uncertainty assessment based Bayesian modularization method in hydrological modeling

NASA Astrophysics Data System (ADS)

Li, Lu; Xu, Chong-Yu; Engeland, Kolbjørn

2013-04-01

SummaryWith respect to model calibration, parameter estimation and analysis of uncertainty sources, various regression and probabilistic approaches are used in hydrological modeling. A family of Bayesian methods, which incorporates different sources of information into a single analysis through Bayes' theorem, is widely used for uncertainty assessment. However, none of these approaches can well treat the impact of high flows in hydrological modeling. This study proposes a Bayesian modularization uncertainty assessment approach in which the highest streamflow observations are treated as suspect information that should not influence the inference of the main bulk of the model parameters. This study includes a comprehensive comparison and evaluation of uncertainty assessments by our new Bayesian modularization method and standard Bayesian methods using the Metropolis-Hastings (MH) algorithm with the daily hydrological model WASMOD. Three likelihood functions were used in combination with standard Bayesian method: the AR(1) plus Normal model independent of time (Model 1), the AR(1) plus Normal model dependent on time (Model 2) and the AR(1) plus Multi-normal model (Model 3). The results reveal that the Bayesian modularization method provides the most accurate streamflow estimates measured by the Nash-Sutcliffe efficiency and provide the best in uncertainty estimates for low, medium and entire flows compared to standard Bayesian methods. The study thus provides a new approach for reducing the impact of high flows on the discharge uncertainty assessment of hydrological models via Bayesian method.

Forecasting Japanese encephalitis incidence from historical morbidity patterns: Statistical analysis with 27 years of observation in Assam, India.

PubMed

Handique, Bijoy K; Khan, Siraj A; Mahanta, J; Sudhakar, S

2014-09-01

Japanese encephalitis (JE) is one of the dreaded mosquito-borne viral diseases mostly prevalent in south Asian countries including India. Early warning of the disease in terms of disease intensity is crucial for taking adequate and appropriate intervention measures. The present study was carried out in Dibrugarh district in the state of Assam located in the northeastern region of India to assess the accuracy of selected forecasting methods based on historical morbidity patterns of JE incidence during the past 22 years (1985-2006). Four selected forecasting methods, viz. seasonal average (SA), seasonal adjustment with last three observations (SAT), modified method adjusting long-term and cyclic trend (MSAT), and autoregressive integrated moving average (ARIMA) have been employed to assess the accuracy of each of the forecasting methods. The forecasting methods were validated for five consecutive years from 2007-2012 and accuracy of each method has been assessed. The forecasting method utilising seasonal adjustment with long-term and cyclic trend emerged as best forecasting method among the four selected forecasting methods and outperformed the even statistically more advanced ARIMA method. Peak of the disease incidence could effectively be predicted with all the methods, but there are significant variations in magnitude of forecast errors among the selected methods. As expected, variation in forecasts at primary health centre (PHC) level is wide as compared to that of district level forecasts. The study showed that adopted forecasting techniques could reasonably forecast the intensity of JE cases at PHC level without considering the external variables. The results indicate that the understanding of long-term and cyclic trend of the disease intensity will improve the accuracy of the forecasts, but there is a need for making the forecast models more robust to explain sudden variation in the disease intensity with detail analysis of parasite and host population dynamics.

Controlling Type I Error Rates in Assessing DIF for Logistic Regression Method Combined with SIBTEST Regression Correction Procedure and DIF-Free-Then-DIF Strategy

ERIC Educational Resources Information Center

Shih, Ching-Lin; Liu, Tien-Hsiang; Wang, Wen-Chung

2014-01-01

The simultaneous item bias test (SIBTEST) method regression procedure and the differential item functioning (DIF)-free-then-DIF strategy are applied to the logistic regression (LR) method simultaneously in this study. These procedures are used to adjust the effects of matching true score on observed score and to better control the Type I error…

Using mixed methods to assess fidelity of delivery and its influencing factors in a complex self-management intervention for people with osteoarthritis and low back pain

PubMed Central

Toomey, Elaine; Matthews, James; Hurley, Deirdre A

2017-01-01

Objectives and design Despite an increasing awareness of the importance of fidelity of delivery within complex behaviour change interventions, it is often poorly assessed. This mixed methods study aimed to establish the fidelity of delivery of a complex self-management intervention and explore the reasons for these findings using a convergent/triangulation design. Setting Feasibility trial of the Self-management of Osteoarthritis and Low back pain through Activity and Skills (SOLAS) intervention (ISRCTN49875385), delivered in primary care physiotherapy. Methods and outcomes 60 SOLAS sessions were delivered across seven sites by nine physiotherapists. Fidelity of delivery of prespecified intervention components was evaluated using (1) audio-recordings (n=60), direct observations (n=24) and self-report checklists (n=60) and (2) individual interviews with physiotherapists (n=9). Quantitatively, fidelity scores were calculated using percentage means and SD of components delivered. Associations between fidelity scores and physiotherapist variables were analysed using Spearman’s correlations. Interviews were analysed using thematic analysis to explore potential reasons for fidelity scores. Integration of quantitative and qualitative data occurred at an interpretation level using triangulation. Results Quantitatively, fidelity scores were high for all assessment methods; with self-report (92.7%) consistently higher than direct observations (82.7%) or audio-recordings (81.7%). There was significant variation between physiotherapists’ individual scores (69.8% - 100%). Both qualitative and quantitative data (from physiotherapist variables) found that physiotherapists’ knowledge (Spearman’s association at p=0.003) and previous experience (p=0.008) were factors that influenced their fidelity. The qualitative data also postulated participant-level (eg, individual needs) and programme-level factors (eg, resources) as additional elements that influenced fidelity. Conclusion The intervention was delivered with high fidelity. This study contributes to the limited evidence regarding fidelity assessment methods within complex behaviour change interventions. The findings suggest a combination of quantitative methods is suitable for the assessment of fidelity of delivery. A mixed methods approach provided a more insightful understanding of fidelity and its influencing factors. Trial registration number ISRCTN49875385; Pre-results. PMID:28780544

Observational methods in comparative effectiveness research.

PubMed

Concato, John; Lawler, Elizabeth V; Lew, Robert A; Gaziano, J Michael; Aslan, Mihaela; Huang, Grant D

2010-12-01

Comparative effectiveness research (CER) may be defined informally as an assessment of available options for treating specific medical conditions in selected groups of patients. In this context, the most prominent features of CER are the various patient populations, medical ailments, and treatment options involved in any particular project. Yet, each research investigation also has a corresponding study design or "architecture," and in patient-oriented research a common distinction used to describe such designs are randomized controlled trials (RCTs) versus observational studies. The purposes of this overview, with regard to CER, are to (1) understand how observational studies can provide accurate results, comparable to RCTs; (2) recognize strategies used in selected newer methods for conducting observational studies; (3) review selected observational studies from the Veterans Health Administration; and (4) appreciate the importance of fundamental methodological principles when conducting or evaluating individual studies. Published by Elsevier Inc.

Design of a practical model-observer-based image quality assessment method for CT imaging systems

NASA Astrophysics Data System (ADS)

Tseng, Hsin-Wu; Fan, Jiahua; Cao, Guangzhi; Kupinski, Matthew A.; Sainath, Paavana

2014-03-01

The channelized Hotelling observer (CHO) is a powerful method for quantitative image quality evaluations of CT systems and their image reconstruction algorithms. It has recently been used to validate the dose reduction capability of iterative image-reconstruction algorithms implemented on CT imaging systems. The use of the CHO for routine and frequent system evaluations is desirable both for quality assurance evaluations as well as further system optimizations. The use of channels substantially reduces the amount of data required to achieve accurate estimates of observer performance. However, the number of scans required is still large even with the use of channels. This work explores different data reduction schemes and designs a new approach that requires only a few CT scans of a phantom. For this work, the leave-one-out likelihood (LOOL) method developed by Hoffbeck and Landgrebe is studied as an efficient method of estimating the covariance matrices needed to compute CHO performance. Three different kinds of approaches are included in the study: a conventional CHO estimation technique with a large sample size, a conventional technique with fewer samples, and the new LOOL-based approach with fewer samples. The mean value and standard deviation of area under ROC curve (AUC) is estimated by shuffle method. Both simulation and real data results indicate that an 80% data reduction can be achieved without loss of accuracy. This data reduction makes the proposed approach a practical tool for routine CT system assessment.

How 7th Graders Are Using Asynchronous Resources in an Online Science Course: A Mixed Methods Study

ERIC Educational Resources Information Center

Schafer-Mayse, Diane L.

2013-01-01

In this study 7th grade students were observed completing a series of lessons in an online science course to explore their thinking and strategies for using curriculum resources for learning, to explore their thinking and strategies for self-assessing their readiness for lesson assessment, and to explore the relationship between resource use and…

Chair Report Consultancy Meeting on Nuclear Security Assessment Methodologies (NUSAM) Transport Case Study Working Group

DOE Office of Scientific and Technical Information (OSTI.GOV)

Shull, Doug

The purpose of the consultancy assignment was to (i) apply the NUSAM assessment methods to hypothetical transport security table top exercise (TTX) analyses and (ii) document its results to working materials of NUSAM case study on transport. A number of working group observations, using the results of TTX methodologies, are noted in the report.

Validity, Reliability, and Equity Issues in an Observational Talent Assessment Process in the Performing Arts

ERIC Educational Resources Information Center

Oreck, Barry A.; Owen, Steven V.; Baum, Susan M.

2003-01-01

The lack of valid, research-based methods to identify potential artistic talent hampers the inclusion of the arts in programs for the gifted and talented. The Talent Assessment Process in Dance, Music, and Theater (D/M/T TAP) was designed to identify potential performing arts talent in diverse populations, including bilingual and special education…

Scaring the Students Away? Institutional Selection through Assessment Practices in the Danish Vocational and Educational Training System

ERIC Educational Resources Information Center

Grønborg, Lisbeth

2013-01-01

This paper sheds light on how competence assessment takes place in the Danish Vocational and Educational Training System. It discusses how intentions formulated by the government have unintentional effects when implemented in practice. The qualitative methods used in this study consist of participant observations from my field study of dropouts in…

Systematic behavioural observation of executive performance after brain injury.

PubMed

Lewis, Mark W; Babbage, Duncan R; Leathem, Janet M

2017-01-01

To develop an ecologically valid measure of executive functioning (i.e. Planning and Organization, Executive Memory, Initiation, Cognitive Shifting, Impulsivity, Sustained and Directed Attention, Error Detection, Error Correction and Time Management) during a functional chocolate brownie cooking task. In Study 1, the inter-rater reliability of a novel behavioural observation assessment method was assessed with 10 people with traumatic brain injury (TBI). In Study 2, 27 people with TBI and 16 healthy controls completed the functional task along with other measures of executive functioning to assess validity. Intraclass correlation coefficients for six of the nine aspects of executive functioning ranged from .54 to 1.00. Percentage agreements for the remaining aspects ranged from 70% to 90%. Significant and non-significant, moderate, correlations were found between the functional cooking task and standard neuropsychological measures. The healthy control group performed better than the TBI group in six areas (d = 0.56 to 1.23). In this initial trial of a novel assessment method, adequate inter-rater reliability was found. The measure was associated with standard neuropsychological measures, and our healthy control group performed better than the TBI group. The measure appears to be an ecologically valid measure of executive functioning.

A Comparison of Pragmatic Language in Boys with Autism and Fragile X Syndrome

PubMed Central

Klusek, Jessica; Martin, Gary E.; Losh, Molly

2014-01-01

Purpose Impaired pragmatic language (i.e., language use for social interaction) is a hallmark feature of both autism spectrum disorder (ASD) and fragile X syndrome (FXS), the most common known monogenic disorder associated with ASD. However, few cross-population comparisons of ASD and FXS have been conducted, and it is unclear whether pragmatic language profiles in these conditions overlap. Method This study used semi-naturalistic and standardized assessment methods to characterize pragmatic language abilities of 29 school-aged boys with idiopathic ASD, 38 with FXS and comorbid ASD, 16 with FXS without ASD, 20 with Down syndrome and 20 with typical development. Results Similar severity of pragmatic language deficits was observed in both of the groups with ASD (idiopathic and fragile X-associated). ASD comorbidity had a detrimental effect on the pragmatic language skills of boys with FXS. Some different patterns emerged across the two pragmatic assessment tools, with more robust group differences observed in pragmatics assessed in a semi-naturalistic conversational context. Conclusions These findings have implications for pragmatic language assessment and intervention, as well as for understanding the potential role of the fragile X gene, Fragile X Mental Retardation-1, in the pragmatic language phenotype of ASD. PMID:24686468

Forensic age estimation based on magnetic resonance imaging of third molars: converting 2D staging into 3D staging.

PubMed

De Tobel, Jannick; Hillewig, Elke; Verstraete, Koenraad

2017-03-01

Established methods to stage development of third molars for forensic age estimation are based on the evaluation of radiographs, which show a 2D projection. It has not been investigated whether these methods require any adjustments in order to apply them to stage third molars on magnetic resonance imaging (MRI), which shows 3D information. To prospectively study root stage assessment of third molars in age estimation using 3 Tesla MRI and to compare this with panoramic radiographs, in order to provide considerations for converting 2D staging into 3D staging and to determine the decisive root. All third molars were evaluated in 52 healthy participants aged 14-26 years using MRI in three planes. Three staging methods were investigated by two observers. In sixteen of the participants, MRI findings were compared with findings on panoramic radiographs. Decisive roots were palatal in upper third molars and distal in lower third molars. Fifty-seven per cent of upper third molars were not assessable on the radiograph, while 96.9% were on MRI. Upper third molars were more difficult to evaluate on radiographs than on MRI (p < .001). Lower third molars were equally assessable on both imaging techniques (93.8% MRI, 98.4% radiograph), with no difference in level of difficulty (p = .375). Inter- and intra-observer agreement for evaluation was higher in MRI than in radiographs. In both imaging techniques lower third molars showed greater inter- and intra-observer agreement compared to upper third molars. MR images in the sagittal plane proved to be essential for staging. In age estimation, 3T MRI of third molars could be valuable. Some considerations are, however, necessary to transfer known staging methods to this 3D technique.

Assessing resident's knowledge and communication skills using four different evaluation tools.

PubMed

Nuovo, Jim; Bertakis, Klea D; Azari, Rahman

2006-07-01

This study assesses the relationship between 4 Accreditation Council for Graduate Medical Education (ACGME) outcome project measures for interpersonal and communication skills and medical knowledge; specifically, monthly performance evaluations, objective structured clinical examinations (OSCEs), the American Board of Family Practice in-training examination (ABFP-ITE) and the Davis observation code (DOC) practice style profiles. Based on previous work, we have DOC scoring for 29 residents from the University of California, Davis Department of Family and Community Medicine. For all these residents we also had the results of monthly performance evaluations, 2 required OSCE exercises, and the results of 3 American Board of Family Medicine (ABFM) ITEs. Data for each of these measures were abstracted for each resident. The Pearson correlation coefficient was used to assess the presence or lack of correlation between each of these evaluation methods. There is little correlation between various evaluation methods used to assess medical knowledge, and there is also little correlation between various evaluation methods used to assess communication skills. The outcome project remains a 'work in progress', with the need for larger studies to assess the value of different assessment measures of resident competence. It is unlikely that DOC will become a useful evaluation tool.

Optimal observables for multiparameter seismic tomography

NASA Astrophysics Data System (ADS)

Bernauer, Moritz; Fichtner, Andreas; Igel, Heiner

2014-08-01

We propose a method for the design of seismic observables with maximum sensitivity to a target model parameter class, and minimum sensitivity to all remaining parameter classes. The resulting optimal observables thereby minimize interparameter trade-offs in multiparameter inverse problems. Our method is based on the linear combination of fundamental observables that can be any scalar measurement extracted from seismic waveforms. Optimal weights of the fundamental observables are determined with an efficient global search algorithm. While most optimal design methods assume variable source and/or receiver positions, our method has the flexibility to operate with a fixed source-receiver geometry, making it particularly attractive in studies where the mobility of sources and receivers is limited. In a series of examples we illustrate the construction of optimal observables, and assess the potentials and limitations of the method. The combination of Rayleigh-wave traveltimes in four frequency bands yields an observable with strongly enhanced sensitivity to 3-D density structure. Simultaneously, sensitivity to S velocity is reduced, and sensitivity to P velocity is eliminated. The original three-parameter problem thereby collapses into a simpler two-parameter problem with one dominant parameter. By defining parameter classes to equal earth model properties within specific regions, our approach mimics the Backus-Gilbert method where data are combined to focus sensitivity in a target region. This concept is illustrated using rotational ground motion measurements as fundamental observables. Forcing dominant sensitivity in the near-receiver region produces an observable that is insensitive to the Earth structure at more than a few wavelengths' distance from the receiver. This observable may be used for local tomography with teleseismic data. While our test examples use a small number of well-understood fundamental observables, few parameter classes and a radially symmetric earth model, the method itself does not impose such restrictions. It can easily be applied to large numbers of fundamental observables and parameters classes, as well as to 3-D heterogeneous earth models.

Comparative analysis of water quality and toxicity assessment methods for urban highway runoff.

PubMed

Chen, Rui-Hong; Li, Fei-Peng; Zhang, Hai-Ping; Jiang, Yue; Mao, Ling-Chen; Wu, Ling-Ling; Chen, Ling

2016-05-15

In this study, comparative analyses of highway runoff samples obtained from seventeen storm events have been conducted between the traditional water quality assessment method and biotoxicity tests, using zebrafish (Danio rerio) embryos and luminous bacteria (Vibrio qinghaiensis. Q67) to provide useful information for ecotoxicity assessment of urban highway runoff. The study results showed that the Nemerow pollution index based on US EPA recommended Criteria Maximum Concentrations (CMC) (as traditional water quality assessment method) had no significant correlation with luminous bacteria acute toxicity test results, while significant correlation has been observed with two indicators of 72 hpf (hours post fertilization) hour hatching rate and 96 hpf abnormality rate from the toxicity test with zebrafish embryos. It is therefore concluded that the level of mixture toxicity of highway runoff could not be adequately measured by the Nemerow assessment method. Moreover, the key pollutants identified from the water quality assessment and from the biotoxicity evaluation were not consistent. For biotoxic effect evaluation of highway runoff, three indexes were found to be sensitive, i.e. 24 hpf lethality and 96 hpf abnormality of zebrafish embryos, as well as the inhibition rate for luminous bacteria Q67. It is therefore recommended that these indexes could be incorporated into the traditional Nemerow method to provide a more reasonable evaluation of the highway runoff quality and ecotoxicity. Copyright © 2016 Elsevier B.V. All rights reserved.

Approaches to Use of Observational Methods of a Study of Parent-Child Interaction.

ERIC Educational Resources Information Center

Baumrind, Diana

The methodology discussed is used in ongoing research to contrast the effectiveness of several patterns of parental authority with the same children at different ages. The first characteristic of these methods is the use of trait and behavior ratings to assess dispositional tendencies. The construct of a dispositional trait is used to account for…

Clowne Science Scheme--A Method Based Course for the Early Years in Secondary Schools

ERIC Educational Resources Information Center

Burden, I. J.; And Others

1975-01-01

Describes a two-year course sequence that is team taught and theme centered. Themes include the earth, the senses, time, and rate of change. The teaching method is the discovery approach and the role of the teacher is outlined. Explains student assessment and outlines problems and observations related to the program. (GS)

Review and Assessment of Personnel Competencies and Job Description Models and Methods

DTIC Science & Technology

2016-04-01

Specifically, the Department of Defense (DoD) defines a competency as “an (observable) measurable pattern of knowledge, abili- ties, skills, and...analyzed how several organizations—selected to represent a breadth of approaches and contexts—use the different forms of competency systems and job...2 B. Employing Competencies....................................................................................3 2. Method and Approach

Analysis of: A Military Leadership Assessment Development Program

DTIC Science & Technology

1990-05-01

assessment pro:’gram. Reliance, however, on these to the enclusion of other research methods such as direct observation, would engender criticism. (15:238...XE A~ICOLLEGE RESEARCH REPORT AD-A241 082 I~I~lhII 111IIJ ldII~l I "~ANALYSIS OF: A MILITARY LEADERSHIP ASSESSMENT DEVELOPMENT PROGRAM COMMANDER...SUBMITTED TO THE FACULTY IN FULFILLMENT OF THE RESEARCH REQU I REMENT Research Advisor: Col. Bryan Strickland MAXWELL AIR FORCE BASE, ALABAMA MAY, 1990

Evaluation of the Clinical LOINC (Logical Observation Identifiers, Names, and Codes) Semantic Structure as a Terminology Model for Standardized Assessment Measures

PubMed Central

Bakken, Suzanne; Cimino, James J.; Haskell, Robert; Kukafka, Rita; Matsumoto, Cindi; Chan, Garrett K.; Huff, Stanley M.

2000-01-01

Objective: The purpose of this study was to test the adequacy of the Clinical LOINC (Logical Observation Identifiers, Names, and Codes) semantic structure as a terminology model for standardized assessment measures. Methods: After extension of the definitions, 1,096 items from 35 standardized assessment instruments were dissected into the elements of the Clinical LOINC semantic structure. An additional coder dissected at least one randomly selected item from each instrument. When multiple scale types occurred in a single instrument, a second coder dissected one randomly selected item representative of each scale type. Results: The results support the adequacy of the Clinical LOINC semantic structure as a terminology model for standardized assessments. Using the revised definitions, the coders were able to dissect into the elements of Clinical LOINC all the standardized assessment items in the sample instruments. Percentage agreement for each element was as follows: component, 100 percent; property, 87.8 percent; timing, 82.9 percent; system/sample, 100 percent; scale, 92.6 percent; and method, 97.6 percent. Discussion: This evaluation was an initial step toward the representation of standardized assessment items in a manner that facilitates data sharing and re-use. Further clarification of the definitions, especially those related to time and property, is required to improve inter-rater reliability and to harmonize the representations with similar items already in LOINC. PMID:11062226

Objective assessment of the aesthetic outcomes of breast cancer treatment: toward automatic localization of fiducial points on digital photographs

NASA Astrophysics Data System (ADS)

Udpa, Nitin; Sampat, Mehul P.; Kim, Min Soon; Reece, Gregory P.; Markey, Mia K.

2007-03-01

The contemporary goals of breast cancer treatment are not limited to cure but include maximizing quality of life. All breast cancer treatment can adversely affect breast appearance. Developing objective, quantifiable methods to assess breast appearance is important to understand the impact of deformity on patient quality of life, guide selection of current treatments, and make rational treatment advances. A few measures of aesthetic properties such as symmetry have been developed. They are computed from the distances between manually identified fiducial points on digital photographs. However, this is time-consuming and subject to intra- and inter-observer variability. The purpose of this study is to investigate methods for automatic localization of fiducial points on anterior-posterior digital photographs taken to document the outcomes of breast reconstruction. Particular emphasis is placed on automatic localization of the nipple complex since the most widely used aesthetic measure, the Breast Retraction Assessment, quantifies the symmetry of nipple locations. The nipple complexes are automatically localized using normalized cross-correlation with a template bank of variants of Gaussian and Laplacian of Gaussian filters. A probability map of likely nipple locations determined from the image database is used to reduce the number of false positive detections from the matched filter operation. The accuracy of the nipple detection was evaluated relative to markings made by three human observers. The impact of using the fiducial point locations as identified by the automatic method, as opposed to the manual method, on the calculation of the Breast Retraction Assessment was also evaluated.

Data collection costs in industrial environments for three occupational posture exposure assessment methods.

PubMed

Trask, Catherine; Mathiassen, Svend Erik; Wahlström, Jens; Heiden, Marina; Rezagholi, Mahmoud

2012-06-27

Documentation of posture measurement costs is rare and cost models that do exist are generally naïve. This paper provides a comprehensive cost model for biomechanical exposure assessment in occupational studies, documents the monetary costs of three exposure assessment methods for different stakeholders in data collection, and uses simulations to evaluate the relative importance of cost components. Trunk and shoulder posture variables were assessed for 27 aircraft baggage handlers for 3 full shifts each using three methods typical to ergonomic studies: self-report via questionnaire, observation via video film, and full-shift inclinometer registration. The cost model accounted for expenses related to meetings to plan the study, administration, recruitment, equipment, training of data collectors, travel, and onsite data collection. Sensitivity analyses were conducted using simulated study parameters and cost components to investigate the impact on total study cost. Inclinometry was the most expensive method (with a total study cost of € 66,657), followed by observation (€ 55,369) and then self report (€ 36,865). The majority of costs (90%) were borne by researchers. Study design parameters such as sample size, measurement scheduling and spacing, concurrent measurements, location and travel, and equipment acquisition were shown to have wide-ranging impacts on costs. This study provided a general cost modeling approach that can facilitate decision making and planning of data collection in future studies, as well as investigation into cost efficiency and cost efficient study design. Empirical cost data from a large field study demonstrated the usefulness of the proposed models.

The Neurologic Assessment in Neuro-Oncology (NANO) scale: a tool to assess neurologic function for integration into the Response Assessment in Neuro-Oncology (RANO) criteria

PubMed Central

DeAngelis, Lisa M.; Brandes, Alba A.; Peereboom, David M.; Galanis, Evanthia; Lin, Nancy U.; Soffietti, Riccardo; Macdonald, David R.; Chamberlain, Marc; Perry, James; Jaeckle, Kurt; Mehta, Minesh; Stupp, Roger; Muzikansky, Alona; Pentsova, Elena; Cloughesy, Timothy; Iwamoto, Fabio M.; Tonn, Joerg-Christian; Vogelbaum, Michael A.; Wen, Patrick Y.; van den Bent, Martin J.; Reardon, David A.

2017-01-01

Abstract Background. The Macdonald criteria and the Response Assessment in Neuro-Oncology (RANO) criteria define radiologic parameters to classify therapeutic outcome among patients with malignant glioma and specify that clinical status must be incorporated and prioritized for overall assessment. But neither provides specific parameters to do so. We hypothesized that a standardized metric to measure neurologic function will permit more effective overall response assessment in neuro-oncology. Methods. An international group of physicians including neurologists, medical oncologists, radiation oncologists, and neurosurgeons with expertise in neuro-oncology drafted the Neurologic Assessment in Neuro-Oncology (NANO) scale as an objective and quantifiable metric of neurologic function evaluable during a routine office examination. The scale was subsequently tested in a multicenter study to determine its overall reliability, inter-observer variability, and feasibility. Results. The NANO scale is a quantifiable evaluation of 9 relevant neurologic domains based on direct observation and testing conducted during routine office visits. The score defines overall response criteria. A prospective, multinational study noted a >90% inter-observer agreement rate with kappa statistic ranging from 0.35 to 0.83 (fair to almost perfect agreement), and a median assessment time of 4 minutes (interquartile range, 3–5). Conclusion. The NANO scale provides an objective clinician-reported outcome of neurologic function with high inter-observer agreement. It is designed to combine with radiographic assessment to provide an overall assessment of outcome for neuro-oncology patients in clinical trials and in daily practice. Furthermore, it complements existing patient-reported outcomes and cognition testing to combine for a global clinical outcome assessment of well-being among brain tumor patients. PMID:28453751

Observable Social Cognition: A Rating Scale (OSCARS): An Interview-Based Assessment for Schizophrenia

PubMed Central

Healey, Kristin M.; Combs, Dennis R.; Gibson, Clare M.; Keefe, Richard S.E.; Roberts, David L.; Penn, David L.

2015-01-01

Introduction Individuals with schizophrenia consistently show impairments in social cognition (SC). SC has become a potential treatment target due to its association with functional outcomes. An alternative method of assessment is to administer an observer-based scale incorporating an informant’s “first hand” impressions in ratings. Methods The present study used the Observable Social Cognition: A Rating Scale (OSCARS) in 62 outpatients and 50 non-psychiatric controls (NPCs) to assess performance in domains of SC (e.g. emotion perception, theory of mind). Results The OSCARS demonstrated sufficient internal consistency and test-retest reliability. Construct validity was assessed through an exploratory factor analysis. Patient OSCARS indices were not significantly correlated with measures of SC with the exception of aggressive attributional style. Individuals with less impairment in SC reacted more aggressively to ambiguous situations. NPC OSCARS were significantly correlated with measures of theory of mind and attributional style. In a combined sample of patients and controls, six of eight items were significantly correlated with the SC task assessing the same domain, providing modest evidence of convergent validity. In patients, the OSCARS was significantly correlated with measures of functional outcome and neurocognition. Lastly, the OSCARS was found to be significantly associated with functional outcome after the influence of objective measures of SC was statistically removed. Conclusions The present study provides preliminary evidence that the OSCARS may be useful for clinicians in collecting data about patients’ potential real-world SC deficits, in turn increasing the degree to which these impairments may be targeted in treatment. PMID:25675960

A robust method to forecast volcanic ash clouds

USGS Publications Warehouse

Denlinger, Roger P.; Pavolonis, Mike; Sieglaff, Justin

2012-01-01

Ash clouds emanating from volcanic eruption columns often form trails of ash extending thousands of kilometers through the Earth's atmosphere, disrupting air traffic and posing a significant hazard to air travel. To mitigate such hazards, the community charged with reducing flight risk must accurately assess risk of ash ingestion for any flight path and provide robust forecasts of volcanic ash dispersal. In response to this need, a number of different transport models have been developed for this purpose and applied to recent eruptions, providing a means to assess uncertainty in forecasts. Here we provide a framework for optimal forecasts and their uncertainties given any model and any observational data. This involves random sampling of the probability distributions of input (source) parameters to a transport model and iteratively running the model with different inputs, each time assessing the predictions that the model makes about ash dispersal by direct comparison with satellite data. The results of these comparisons are embodied in a likelihood function whose maximum corresponds to the minimum misfit between model output and observations. Bayes theorem is then used to determine a normalized posterior probability distribution and from that a forecast of future uncertainty in ash dispersal. The nature of ash clouds in heterogeneous wind fields creates a strong maximum likelihood estimate in which most of the probability is localized to narrow ranges of model source parameters. This property is used here to accelerate probability assessment, producing a method to rapidly generate a prediction of future ash concentrations and their distribution based upon assimilation of satellite data as well as model and data uncertainties. Applying this method to the recent eruption of Eyjafjallajökull in Iceland, we show that the 3 and 6 h forecasts of ash cloud location probability encompassed the location of observed satellite-determined ash cloud loads, providing an efficient means to assess all of the hazards associated with these ash clouds.

Uncertainty estimates of purity measurements based on current information: toward a "live validation" of purity methods.

PubMed

Apostol, Izydor; Kelner, Drew; Jiang, Xinzhao Grace; Huang, Gang; Wypych, Jette; Zhang, Xin; Gastwirt, Jessica; Chen, Kenneth; Fodor, Szilan; Hapuarachchi, Suminda; Meriage, Dave; Ye, Frank; Poppe, Leszek; Szpankowski, Wojciech

2012-12-01

To predict precision and other performance characteristics of chromatographic purity methods, which represent the most widely used form of analysis in the biopharmaceutical industry. We have conducted a comprehensive survey of purity methods, and show that all performance characteristics fall within narrow measurement ranges. This observation was used to develop a model called Uncertainty Based on Current Information (UBCI), which expresses these performance characteristics as a function of the signal and noise levels, hardware specifications, and software settings. We applied the UCBI model to assess the uncertainty of purity measurements, and compared the results to those from conventional qualification. We demonstrated that the UBCI model is suitable to dynamically assess method performance characteristics, based on information extracted from individual chromatograms. The model provides an opportunity for streamlining qualification and validation studies by implementing a "live validation" of test results utilizing UBCI as a concurrent assessment of measurement uncertainty. Therefore, UBCI can potentially mitigate the challenges associated with laborious conventional method validation and facilitates the introduction of more advanced analytical technologies during the method lifecycle.

[Reliability and reproducibility of the Fitzpatrick phototype scale for skin sensitivity to ultraviolet light].

PubMed

Sánchez, Guillermo; Nova, John; Arias, Nilsa; Peña, Bibiana

2008-12-01

The Fitzpatrick phototype scale has been used to determine skin sensitivity to ultraviolet light. The reliability of this scale in estimating sensitivity permits risk evaluation of skin cancer based on phototype. Reliability and changes in intra and inter-observer concordance was determined for the Fitzpatrick phototype scale after the assessment methods for establishing the phototype were standardized. An analytical study of intra and inter-observer concordance was performed. The Fitzpatrick phototype scale was standardized using focus group methodology. To determine intra and inter-observer agreement, the weighted kappa statistical method was applied. The standardization effect was measured using the equal kappa contrast hypothesis and Wald test for dependent measurements. The phototype scale was applied to 155 patients over 15 years of age who were assessed four times by two independent observers. The sample was drawn from patients of the Centro Dermatol6gico Federico Lleras Acosta. During the pre-standardization phase, the baseline and six-week inter-observer weighted kappa were 0.31 and 0.40, respectively. The intra-observer kappa values for observers A and B were 0.47 and 0.51, respectively. After the standardization process, the baseline and six-week inter-observer weighted kappa values were 0.77, and 0.82, respectively. Intra-observer kappa coefficients for observers A and B were 0.78 and 0.82. Statistically significant differences were found between coefficients before and after standardization (p<0.001) in all comparisons. Following a standardization exercise, the Fitzpatrick phototype scale yielded reliable, reproducible and consistent results.

Rapid systematic assessment of the detection and attribution of regional anthropogenic climate change

DOE PAGES

Stone, Daithi A.; Hansen, Gerrit

2015-11-21

Despite being a well-established research field, the detection and attribution of observed climate change to anthropogenic forcing is not yet provided as a climate service. One reason for this is the lack of a methodology for performing tailored detection and attribution assessments on a rapid time scale. Here we develop such an approach, based on the translation of quantitative analysis into the “confidence” language employed in recent Assessment Reports of the Intergovernmental Panel on Climate Change. While its systematic nature necessarily ignores some nuances examined in detailed expert assessments, the approach nevertheless goes beyond most detection and attribution studies inmore » considering contributors to building confidence such as errors in observational data products arising from sparse monitoring networks. When compared against recent expert assessments, the results of this approach closely match those of the existing assessments. Where there are small discrepancies, these variously reflect ambiguities in the details of what is being assessed, reveal nuances or limitations of the expert assessments, or indicate limitations of the accuracy of the sort of systematic approach employed here. Deployment of the method on 116 regional assessments of recent temperature and precipitation changes indicates that existing rules of thumb concerning the detectability of climate change ignore the full range of sources of uncertainty, most particularly the importance of adequate observational monitoring.« less

Attachment in Adults with Intellectual Disabilities: Preliminary Investigation of the Psychometric Properties of the Manchester Attachment Scale-Third Party Observational Measure

ERIC Educational Resources Information Center

Penketh, Victoria; Hare, Dougal Julian; Flood, Andrea; Walker, Samantha

2014-01-01

Background: The Manchester Attachment Scale-Third party observational measure (MAST) was developed to assess secure attachment style for adults with intellectual disabilities. The psychometric properties of the MAST were examined. Materials and Methods: Professional carers (N = 40) completed the MAST and measures related to the construct of…

Comparing methods for measuring peak look duration: are individual differences observed on screen-based tasks also found in more ecologically valid contexts?

PubMed

Wass, Sam V

2014-08-01

Convergent research points to the importance of studying the ontogenesis of sustained attention during the early years of life, but little research hitherto has compared and contrasted different techniques available for measuring sustained attention. Here, we compare methods that have been used to assess one parameter of sustained attention, namely infants' peak look duration to novel stimuli. Our focus was to assess whether individual differences in peak look duration are stable across different measurement techniques. In a single cohort of 42 typically developing 11-month-old infants we assessed peak look duration using six different measurement paradigms (four screen-based, two naturalistic). Zero-order correlations suggested that individual differences in peak look duration were stable across all four screen-based paradigms, but no correlations were found between peak look durations observed on the screen-based and the naturalistic paradigms. A factor analysis conducted on the dependent variable of peak look duration identified two factors. All four screen-based tasks loaded onto the first factor, but the two naturalistic tasks did not relate, and mapped onto a different factor. Our results question how individual differences observed on screen-based tasks manifest in more ecologically valid contexts. Copyright © 2014 The Authors. Published by Elsevier Inc. All rights reserved.

Comparing methods for measuring peak look duration: Are individual differences observed on screen-based tasks also found in more ecologically valid contexts?

PubMed Central

Wass, Sam V.

2014-01-01

Convergent research points to the importance of studying the ontogenesis of sustained attention during the early years of life, but little research hitherto has compared and contrasted different techniques available for measuring sustained attention. Here, we compare methods that have been used to assess one parameter of sustained attention, namely infants’ peak look duration to novel stimuli. Our focus was to assess whether individual differences in peak look duration are stable across different measurement techniques. In a single cohort of 42 typically developing 11-month-old infants we assessed peak look duration using six different measurement paradigms (four screen-based, two naturalistic). Zero-order correlations suggested that individual differences in peak look duration were stable across all four screen-based paradigms, but no correlations were found between peak look durations observed on the screen-based and the naturalistic paradigms. A factor analysis conducted on the dependent variable of peak look duration identified two factors. All four screen-based tasks loaded onto the first factor, but the two naturalistic tasks did not relate, and mapped onto a different factor. Our results question how individual differences observed on screen-based tasks manifest in more ecologically valid contexts. PMID:24905901

Exploration of instruction, assessment, and equity in the middle school science classroom

NASA Astrophysics Data System (ADS)

Szpyrka, Donna A.

2001-07-01

In order to determine equitable practices of middle school science teachers questionnaire responses, classroom observations, teacher interviews, and assessment artifacts were examined to discover relationships between classroom instruction, assessment practices, and equity. Teachers in middle school science classrooms in six different schools completed a National Center for Education Statistics questionnaire, offered assessment artifacts, and participated in interviews. Observers using a classroom observation protocol and an equity profile rated 22 lessons. The study found that a distinction could be made between teachers who were more equitable and those who were less equitable. Careful planning and organization; the incorporation of tasks, roles, and interactions consistent with investigative science; a collaborative approach to learning; and instruction that takes into account what transpired in previous lessons---appear to be characteristics of lesson design of the more equitable teachers. In addition, instructional strategies and activities that addressed access, equity, and diversity as well as, a classroom climate that was respectful of students' contributions were found to a greater extent in the more equitable teachers' classrooms. While all teachers used multiple methods of assessment, the more equitable teachers used assessment differently. They also provided written feedback to students, relied on more than one aspect of student performance for determining grades, and explicated clear and specific assessment practices.

Measurement of ulnar subtrochlear sclerosis using a percentage scale in labrador retrievers with minimal radiographic signs of periarticular osteophytosis.

PubMed

Smith, Thomas J; Fitzpatrick, Noel; Evans, Richard B; Pead, Mathew J

2009-02-01

To report the development of a measurement method for quantifying ulnar subtrochlear sclerosis (STS) in Labrador Retrievers. Prospective blinded study. Radiographs of Labrador Retrievers elbows (n=30) with minimal radiographic signs of periarticular osteophytosis. Measurement of STS as a % of the distance between 2 standardized radiographic landmarks (%STS) was developed. Mediolateral radiographic projections of flexed elbows were collected from 2 cohorts termed diseased (n=15; confirmed disease of the medial coronoid process) and control (n=15; free from clinically evident disease). Five observers blindly assessed each radiograph for radiographic technique, elbow positioning, periarticular osteophytosis, and STS, which, if present, was measured and assigned a %STS score. Intraobserver and interobserver variations in measuring STS and the ability to differentiate study cohorts were assessed using receiver operator curve (ROC) characteristics. A P-value of <.05 was considered significant. Median %STS for diseased elbows was 47% (range, 0-74%) and 0% (range, 0-62%) for control elbows. Correlations were not significantly different between each observer's assessments of %STS, with a median Spearman's P-value of .75 (range, .67-.86). All observers differentiated the 2 cohorts with "fair-good" accuracy, with a median ROC value of 0.81 (range, 0.75-0.88). Measurement of %STS in Labrador Retrievers was repeatable for each observer and repeatable between observers. A method for measuring STS allows comparison of Labrador Retrievers of different sizes, is easy to perform, and could be used to investigate the clinical significance of STS in this breed.

Is computed tomography an accurate and reliable method for measuring total knee arthroplasty component rotation?

PubMed

Figueroa, José; Guarachi, Juan Pablo; Matas, José; Arnander, Magnus; Orrego, Mario

2016-04-01

Computed tomography (CT) is widely used to assess component rotation in patients with poor results after total knee arthroplasty (TKA). The purpose of this study was to simultaneously determine the accuracy and reliability of CT in measuring TKA component rotation. TKA components were implanted in dry-bone models and assigned to two groups. The first group (n = 7) had variable femoral component rotations, and the second group (n = 6) had variable tibial tray rotations. CT images were then used to assess component rotation. Accuracy of CT rotational assessment was determined by mean difference, in degrees, between implanted component rotation and CT-measured rotation. Intraclass correlation coefficient (ICC) was applied to determine intra-observer and inter-observer reliability. Femoral component accuracy showed a mean difference of 2.5° and the tibial tray a mean difference of 3.2°. There was good intra- and inter-observer reliability for both components, with a femoral ICC of 0.8 and 0.76, and tibial ICC of 0.68 and 0.65, respectively. CT rotational assessment accuracy can differ from true component rotation by approximately 3° for each component. It does, however, have good inter- and intra-observer reliability.

Assessment of disinfection of hospital surfaces using different monitoring methods1

PubMed Central

Ferreira, Adriano Menis; de Andrade, Denise; Rigotti, Marcelo Alessandro; de Almeida, Margarete Teresa Gottardo; Guerra, Odanir Garcia; dos Santos, Aires Garcia

2015-01-01

OBJECTIVE: to assess the efficiency of cleaning/disinfection of surfaces of an Intensive Care Unit. METHOD: descriptive-exploratory study with quantitative approach conducted over the course of four weeks. Visual inspection, bioluminescence adenosine triphosphate and microbiological indicators were used to indicate cleanliness/disinfection. Five surfaces (bed rails, bedside tables, infusion pumps, nurses' counter, and medical prescription table) were assessed before and after the use of rubbing alcohol at 70% (w/v), totaling 160 samples for each method. Non-parametric tests were used considering statistically significant differences at p<0.05. RESULTS: after the cleaning/disinfection process, 87.5, 79.4 and 87.5% of the surfaces were considered clean using the visual inspection, bioluminescence adenosine triphosphate and microbiological analyses, respectively. A statistically significant decrease was observed in the disapproval rates after the cleaning process considering the three assessment methods; the visual inspection was the least reliable. CONCLUSION: the cleaning/disinfection method was efficient in reducing microbial load and organic matter of surfaces, however, these findings require further study to clarify aspects related to the efficiency of friction, its frequency, and whether or not there is association with other inputs to achieve improved results of the cleaning/disinfection process. PMID:26312634

Objective assessment of image quality. IV. Application to adaptive optics

PubMed Central

Barrett, Harrison H.; Myers, Kyle J.; Devaney, Nicholas; Dainty, Christopher

2008-01-01

The methodology of objective assessment, which defines image quality in terms of the performance of specific observers on specific tasks of interest, is extended to temporal sequences of images with random point spread functions and applied to adaptive imaging in astronomy. The tasks considered include both detection and estimation, and the observers are the optimal linear discriminant (Hotelling observer) and the optimal linear estimator (Wiener). A general theory of first- and second-order spatiotemporal statistics in adaptive optics is developed. It is shown that the covariance matrix can be rigorously decomposed into three terms representing the effect of measurement noise, random point spread function, and random nature of the astronomical scene. Figures of merit are developed, and computational methods are discussed. PMID:17106464

Extending Value of Information Methods to Include the Co-Net Benefits of Earth Observations

NASA Astrophysics Data System (ADS)

Macauley, M.

2015-12-01

The widening relevance of Earth observations information across the spectrum of natural and environmental resources markedly enhances the value of these observations. An example is observations of forest extent, species composition, health, and change; this information can help in assessing carbon sequestration, biodiversity and habitat, watershed management, fuelwood potential, and other ecosystem services as well as inform the opportunity cost of forest removal for alternative land use such as agriculture, pasture, or development. These "stacked" indicators or co- net benefits add significant value to Earth observations. In part because of reliance on case studies, much previous research about the value of information from Earth observations has assessed individual applications rather than aggregate across applications, thus tending to undervalue the observations. Aggregating across applications is difficult, however, because it requires common units of measurement: controlling for spatial, spectral, and temporal attributes of the observations; and consistent application of value of information techniques. This paper will discuss general principles of co-net benefit aggregation and illustrate its application to attributing value to Earth observations.

The implementation of assessment model based on character building to improve students’ discipline and achievement

NASA Astrophysics Data System (ADS)

Rusijono; Khotimah, K.

2018-01-01

The purpose of this research was to investigate the effect of implementing the assessment model based on character building to improve discipline and student’s achievement. Assessment model based on character building includes three components, which are the behaviour of students, the efforts, and student’s achievement. This assessment model based on the character building is implemented in science philosophy and educational assessment courses, in Graduate Program of Educational Technology Department, Educational Faculty, Universitas Negeri Surabaya. This research used control group pre-test and post-test design. Data collection method used in this research were observation and test. The observation was used to collect the data about the disciplines of the student in the instructional process, while the test was used to collect the data about student’s achievement. Moreover, the study applied t-test to the analysis of data. The result of this research showed that assessment model based on character building improved discipline and student’s achievement.

The analytical and numerical approaches to the theory of the Moon's librations: Modern analysis and results

NASA Astrophysics Data System (ADS)

Petrova, N.; Zagidullin, A.; Nefedyev, Y.; Kosulin, V.; Andreev, A.

2017-11-01

Observing physical librations of celestial bodies and the Moon represents one of the astronomical methods of remotely assessing the internal structure of a celestial body without conducting expensive space experiments. The paper contains a review of recent advances in studying the Moon's structure using various methods of obtaining and applying the lunar physical librations (LPhL) data. In this article LPhL simulation methods of assessing viscoelastic and dissipative properties of the lunar body and lunar core parameters, whose existence has been recently confirmed during the seismic data reprocessing of ;Apollo; space mission, are described. Much attention is paid to physical interpretation of the free librations phenomenon and the methods for its determination. In the paper the practical application of the most accurate analytical LPhL tables (Rambaux and Williams, 2011) is discussed. The tables were built on the basis of complex analytical processing of the residual differences obtained when comparing long-term series of laser observations with the numerical ephemeris DE421. In the paper an efficiency analysis of two approaches to LPhL theory is conducted: the numerical and the analytical ones. It has been shown that in lunar investigation both approaches complement each other in various aspects: the numerical approach provides high accuracy of the theory, which is required for the proper processing of modern observations, the analytical approach allows to comprehend the essence of the phenomena in the lunar rotation, predict and interpret new effects in the observations of lunar body and lunar core parameters.

The development and validation of The Inquiry Science Observation Coding Sheet.

PubMed

Brandon, P R; Taum, A K H; Young, D B; Pottenger, F M

2008-08-01

Evaluation reports increasingly document the degree of program implementation, particularly the extent to which programs adhere to prescribed steps and procedures. Many reports are cursory, however, and few, if any, fully portray the long and winding path taken when developing evaluation instruments, particularly observation instruments. In this article, we describe the development of an observational method for evaluating the degree to which K-12 inquiry science programs are implemented, including the many steps and decisions that occurred during the development, and present evidence for the reliability and validity of the data that we collected with the instrument. The article introduces a method for measuring the adherence of inquiry science implementation and gives evaluators a full picture of what they might expect when developing observation instruments for assessing the degree of program implementation.

Central nervous system antiretroviral efficacy in HIV infection: a qualitative and quantitative review and implications for future research.

PubMed

Cysique, Lucette A; Waters, Edward K; Brew, Bruce J

2011-11-22

There is conflicting information as to whether antiretroviral drugs with better central nervous system (CNS) penetration (neuroHAART) assist in improving neurocognitive function and suppressing cerebrospinal fluid (CSF) HIV RNA. The current review aims to better synthesise existing literature by using an innovative two-phase review approach (qualitative and quantitative) to overcome methodological differences between studies. Sixteen studies, all observational, were identified using a standard citation search. They fulfilled the following inclusion criteria: conducted in the HAART era; sample size > 10; treatment effect involved more than one antiretroviral and none had a retrospective design. The qualitative phase of review of these studies consisted of (i) a blind assessment rating studies on features such as sample size, statistical methods and definitions of neuroHAART, and (ii) a non-blind assessment of the sensitivity of the neuropsychological methods to HIV-associated neurocognitive disorder (HAND). During quantitative evaluation we assessed the statistical power of studies, which achieved a high rating in the qualitative analysis. The objective of the power analysis was to determine the studies ability to assess their proposed research aims. After studies with at least three limitations were excluded in the qualitative phase, six studies remained. All six found a positive effect of neuroHAART on neurocognitive function or CSF HIV suppression. Of these six studies, only two had statistical power of at least 80%. Studies assessed as using more rigorous methods found that neuroHAART was effective in improving neurocognitive function and decreasing CSF viral load, but only two of those studies were adequately statistically powered. Because all of these studies were observational, they represent a less compelling evidence base than randomised control trials for assessing treatment effect. Therefore, large randomised trials are needed to determine the robustness of any neuroHAART effect. However, such trials must be longitudinal, include the full spectrum of HAND, ideally carefully control for co-morbidities, and be based on optimal neuropsychology methods.

Advancing a Model-Validated Statistical Method for Decomposing the Key Oceanic Drivers of Regional Climate: Focus on Northern and Tropical African Climate Variability in the Community Earth System Model (CESM)

DOE Office of Scientific and Technical Information (OSTI.GOV)

Wang, Fuyao; Yu, Yan; Notaro, Michael

This study advances the practicality and stability of the traditional multivariate statistical method, generalized equilibrium feedback assessment (GEFA), for decomposing the key oceanic drivers of regional atmospheric variability, especially when available data records are short. An advanced stepwise GEFA methodology is introduced, in which unimportant forcings within the forcing matrix are eliminated through stepwise selection. Method validation of stepwise GEFA is performed using the CESM, with a focused application to northern and tropical Africa (NTA). First, a statistical assessment of the atmospheric response to each primary oceanic forcing is carried out by applying stepwise GEFA to a fully coupled controlmore » run. Then, a dynamical assessment of the atmospheric response to individual oceanic forcings is performed through ensemble experiments by imposing sea surface temperature anomalies over focal ocean basins. Finally, to quantify the reliability of stepwise GEFA, the statistical assessment is evaluated against the dynamical assessment in terms of four metrics: the percentage of grid cells with consistent response sign, the spatial correlation of atmospheric response patterns, the area-averaged seasonal cycle of response magnitude, and consistency in associated mechanisms between assessments. In CESM, tropical modes, namely El Niño–Southern Oscillation and the tropical Indian Ocean Basin, tropical Indian Ocean dipole, and tropical Atlantic Niño modes, are the dominant oceanic controls of NTA climate. In complementary studies, stepwise GEFA is validated in terms of isolating terrestrial forcings on the atmosphere, and observed oceanic and terrestrial drivers of NTA climate are extracted to establish an observational benchmark for subsequent coupled model evaluation and development of process-based weights for regional climate projections.« less

Advancing a Model-Validated Statistical Method for Decomposing the Key Oceanic Drivers of Regional Climate: Focus on Northern and Tropical African Climate Variability in the Community Earth System Model (CESM)

DOE PAGES

Wang, Fuyao; Yu, Yan; Notaro, Michael; ...

2017-09-27

This study advances the practicality and stability of the traditional multivariate statistical method, generalized equilibrium feedback assessment (GEFA), for decomposing the key oceanic drivers of regional atmospheric variability, especially when available data records are short. An advanced stepwise GEFA methodology is introduced, in which unimportant forcings within the forcing matrix are eliminated through stepwise selection. Method validation of stepwise GEFA is performed using the CESM, with a focused application to northern and tropical Africa (NTA). First, a statistical assessment of the atmospheric response to each primary oceanic forcing is carried out by applying stepwise GEFA to a fully coupled controlmore » run. Then, a dynamical assessment of the atmospheric response to individual oceanic forcings is performed through ensemble experiments by imposing sea surface temperature anomalies over focal ocean basins. Finally, to quantify the reliability of stepwise GEFA, the statistical assessment is evaluated against the dynamical assessment in terms of four metrics: the percentage of grid cells with consistent response sign, the spatial correlation of atmospheric response patterns, the area-averaged seasonal cycle of response magnitude, and consistency in associated mechanisms between assessments. In CESM, tropical modes, namely El Niño–Southern Oscillation and the tropical Indian Ocean Basin, tropical Indian Ocean dipole, and tropical Atlantic Niño modes, are the dominant oceanic controls of NTA climate. In complementary studies, stepwise GEFA is validated in terms of isolating terrestrial forcings on the atmosphere, and observed oceanic and terrestrial drivers of NTA climate are extracted to establish an observational benchmark for subsequent coupled model evaluation and development of process-based weights for regional climate projections.« less

Development of a Method to Observe Preschoolers' Packed Lunches in Early Care and Education Centers.

PubMed

Sweitzer, Sara J; Byrd-Williams, Courtney E; Ranjit, Nalini; Romo-Palafox, Maria Jose; Briley, Margaret E; Roberts-Gray, Cynthia R; Hoelscher, Deanna M

2015-08-01

As early childhood education (ECE) centers become a more common setting for nutrition interventions, a variety of data collection methods are required, based on the center foodservice. ECE centers that require parents to send in meals and/or snacks from home present a unique challenge for accurate nutrition estimation and data collection. We present an observational methodology for recording the contents and temperature of preschool-aged children's lunchboxes and data to support a 2-day vs a 3-day collection period. Lunchbox observers were trained in visual estimation of foods based on Child and Adult Care Food Program and MyPlate servings and household recommended measures. Trainees weighed and measured foods commonly found in preschool-aged children's lunchboxes and practiced recording accurate descriptions and food temperatures. Training included test assessments of whole-grain bread products, mixed dishes such as macaroni and cheese, and a variety of sandwich preparations. Validity of the estimation method was tested by comparing estimated to actual amounts for several distinct food types. Reliability was assessed by computing the intraclass correlation coefficient for each observer as well as an interrater reliability coefficient across observers. To compare 2- and 3-day observations, 2 of the 3 days of observations were randomly selected for each child and analyzed as a separate dataset. Linear model estimated mean and standard error of whole grains, fruits and vegetables, and amounts of energy, carbohydrates, protein, total fat, saturated fat, dietary fiber, thiamin, riboflavin, niacin, vitamins A and C, calcium, iron, sodium, and dietary fiber per lunch were compared across the 2- and 3-day observation datasets. The mean estimated amounts across 11 observers were statistically indistinguishable from the measured portion size for each of the 41 test foods, implying that the visual estimation measurement method was valid: intraobserver intraclass correlation coefficients ranged from 0.951 (95% CI 0.91 to 0.97) to 1.0. Across observers, the interrater reliability correlation coefficient was estimated at 0.979 (95% CI 0.957 to 0.993). Comparison of servings of fruits, vegetables, and whole grains showed no significant differences for serving size or mean energy and nutrient content between 2- and 3-day lunch observations. The methodology is a valid and reliable option for use in research and practice that requires observing and assessing the contents and portion sizes of food items in preschool-aged children's lunchboxes in an ECE setting. The use of visual observation and estimation with Child and Adult Care Food Program and MyPlate serving sizes and household measures over 2 random days of data collection enables food handling to be minimized while obtaining an accurate record of the variety and quantities of foods that young children are exposed to at lunch time. Copyright © 2015 Academy of Nutrition and Dietetics. Published by Elsevier Inc. All rights reserved.

Evaluating the effectiveness of wildlife detection and observation technologies at a solar power tower facility

USGS Publications Warehouse

Diehl, Robert H.; Valdez, Ernest W.; Preston, Todd M.; Wellik, Mike J.; Cryan, Paul

2016-01-01

Solar power towers produce electrical energy from sunlight at an industrial scale. Little is known about the effects of this technology on flying animals and few methods exist for automatically detecting or observing wildlife at solar towers and other tall anthropogenic structures. Smoking objects are sometimes observed co-occurring with reflected, concentrated light (“solar flux”) in the airspace around solar towers, but the identity and origins of such objects can be difficult to determine. In this observational pilot study at the world’s largest solar tower facility, we assessed the efficacy of using radar, surveillance video, and insect trapping to detect and observe animals flying near the towers. During site visits in May and September 2014, we monitored the airspace surrounding towers and observed insects, birds, and bats under a variety of environmental and operational conditions. We detected and broadly differentiated animals or objects moving through the airspace generally using radar and near solar towers using several video imaging methods. Video revealed what appeared to be mostly small insects burning in the solar flux. Also, we occasionally detected birds flying in the solar flux but could not accurately identify birds to species or the types of insects and small objects composing the vast majority of smoking targets. Insect trapping on the ground was somewhat effective at sampling smaller insects around the tower, and presence and abundance of insects in the traps generally trended with radar and video observations. Traps did not tend to sample the larger insects we sometimes observed flying in the solar flux or found dead on the ground beneath the towers. Some of the methods we tested (e.g., video surveillance) could be further assessed and potentially used to automatically detect and observe flying animals in the vicinity of solar towers to advance understanding about their effects on wildlife.

Evaluating the Effectiveness of Wildlife Detection and Observation Technologies at a Solar Power Tower Facility.

PubMed

Diehl, Robert H; Valdez, Ernest W; Preston, Todd M; Wellik, Michael J; Cryan, Paul M

2016-01-01

Solar power towers produce electrical energy from sunlight at an industrial scale. Little is known about the effects of this technology on flying animals and few methods exist for automatically detecting or observing wildlife at solar towers and other tall anthropogenic structures. Smoking objects are sometimes observed co-occurring with reflected, concentrated light ("solar flux") in the airspace around solar towers, but the identity and origins of such objects can be difficult to determine. In this observational pilot study at the world's largest solar tower facility, we assessed the efficacy of using radar, surveillance video, and insect trapping to detect and observe animals flying near the towers. During site visits in May and September 2014, we monitored the airspace surrounding towers and observed insects, birds, and bats under a variety of environmental and operational conditions. We detected and broadly differentiated animals or objects moving through the airspace generally using radar and near solar towers using several video imaging methods. Video revealed what appeared to be mostly small insects burning in the solar flux. Also, we occasionally detected birds flying in the solar flux but could not accurately identify birds to species or the types of insects and small objects composing the vast majority of smoking targets. Insect trapping on the ground was somewhat effective at sampling smaller insects around the tower, and presence and abundance of insects in the traps generally trended with radar and video observations. Traps did not tend to sample the larger insects we sometimes observed flying in the solar flux or found dead on the ground beneath the towers. Some of the methods we tested (e.g., video surveillance) could be further assessed and potentially used to automatically detect and observe flying animals in the vicinity of solar towers to advance understanding about their effects on wildlife.

Evaluating the Effectiveness of Wildlife Detection and Observation Technologies at a Solar Power Tower Facility

PubMed Central

Diehl, Robert H.; Valdez, Ernest W.; Preston, Todd M.; Wellik, Michael J.; Cryan, Paul M.

2016-01-01

Solar power towers produce electrical energy from sunlight at an industrial scale. Little is known about the effects of this technology on flying animals and few methods exist for automatically detecting or observing wildlife at solar towers and other tall anthropogenic structures. Smoking objects are sometimes observed co-occurring with reflected, concentrated light (“solar flux”) in the airspace around solar towers, but the identity and origins of such objects can be difficult to determine. In this observational pilot study at the world’s largest solar tower facility, we assessed the efficacy of using radar, surveillance video, and insect trapping to detect and observe animals flying near the towers. During site visits in May and September 2014, we monitored the airspace surrounding towers and observed insects, birds, and bats under a variety of environmental and operational conditions. We detected and broadly differentiated animals or objects moving through the airspace generally using radar and near solar towers using several video imaging methods. Video revealed what appeared to be mostly small insects burning in the solar flux. Also, we occasionally detected birds flying in the solar flux but could not accurately identify birds to species or the types of insects and small objects composing the vast majority of smoking targets. Insect trapping on the ground was somewhat effective at sampling smaller insects around the tower, and presence and abundance of insects in the traps generally trended with radar and video observations. Traps did not tend to sample the larger insects we sometimes observed flying in the solar flux or found dead on the ground beneath the towers. Some of the methods we tested (e.g., video surveillance) could be further assessed and potentially used to automatically detect and observe flying animals in the vicinity of solar towers to advance understanding about their effects on wildlife. PMID:27462989

A study of pressure-based methodology for resonant flows in non-linear combustion instabilities

NASA Technical Reports Server (NTRS)

Yang, H. Q.; Pindera, M. Z.; Przekwas, A. J.; Tucker, K.

1992-01-01

This paper presents a systematic assessment of a large variety of spatial and temporal differencing schemes on nonstaggered grids by the pressure-based methods for the problems of fast transient flows. The observation from the present study is that for steady state flow problems, pressure-based methods can be very competitive with the density-based methods. For transient flow problems, pressure-based methods utilizing the same differencing scheme are less accurate, even though the wave speeds are correctly predicted.

Human Exposure Assessment for Air Pollution.

PubMed

Han, Bin; Hu, Li-Wen; Bai, Zhipeng

2017-01-01

Assessment of human exposure to air pollution is a fundamental part of the more general process of health risk assessment. The measurement methods for exposure assessment now include personal exposure monitoring, indoor-outdoor sampling, mobile monitoring, and exposure assessment modeling (such as proximity models, interpolation model, air dispersion models, and land-use regression (LUR) models). Among these methods, personal exposure measurement is considered to be the most accurate method of pollutant exposure assessment until now, since it can better quantify observed differences and better reflect exposure among smaller groups of people at ground level. And since the great differences of geographical environment, source distribution, pollution characteristics, economic conditions, and living habits, there is a wide range of differences between indoor, outdoor, and individual air pollution exposure in different regions of China. In general, the indoor particles in most Chinese families comprise infiltrated outdoor particles, particles generated indoors, and a few secondary organic aerosol particles, and in most cases, outdoor particle pollution concentrations are a major contributor to indoor concentrations in China. Furthermore, since the time, energy, and expense are limited, it is difficult to measure the concentration of pollutants for each individual. In recent years, obtaining the concentration of air pollutants by using a variety of exposure assessment models is becoming a main method which could solve the problem of the increasing number of individuals in epidemiology studies.

Residency Programs' Evaluations of the Competencies: Data Provided to the ACGME About Types of Assessments Used by Programs

PubMed Central

Holt, Kathleen D.; Miller, Rebecca S.; Nasca, Thomas J.

2010-01-01

Background In 1999, the Accreditation Council for Graduate Medical Education (ACGME) Outcome Project began to focus on resident performance in the 6 competencies of patient care, medical knowledge, professionalism, practice-based learning and improvement, interpersonal communication skills, and professionalism. Beginning in 2007, the ACGME began collecting information on how programs assess these competencies. This report provides information on the nature and extent of those assessments. Methods Using data collected by the ACGME for site visits, we use descriptive statistics and percentages to describe the number and type of methods and assessors accredited programs (n  =  4417) report using to assess the competencies. Observed differences among specialties, methodologies, and assessors are tested with analysis of variance procedures. Results Almost all (>97%) of programs report assessing all of the competencies and using multiple methods and multiple assessors. Similar assessment methods and evaluator types were consistently used across the 6 competencies. However, there were some differences in the use of patient and family as assessors: Primary care and ambulatory specialties used these to a greater extent than other specialties. Conclusion Residency programs are emphasizing the competencies in their evaluation of residents. Understanding the scope of evaluation methodologies that programs use in resident assessment is important for both the profession and the public, so that together we may monitor continuing improvement in US graduate medical education. PMID:22132294

Validity of an Observation Method for Assessing Pain Behavior in Individuals With Multiple Sclerosis

PubMed Central

Cook, Karon F.; Roddey, Toni S.; Bamer, Alyssa M.; Amtmann, Dagmar; Keefe, Francis J

2012-01-01

Context Pain is a common and complex experience for individuals who live with multiple sclerosis (MS) that interferes with physical, psychological and social function. A valid and reliable tool for quantifying observed pain behaviors in MS is critical to understanding how pain behaviors contribute to pain-related disability in this clinical population. Objectives To evaluate the reliability and validity of a pain behavioral observation protocol in individuals who have MS. Methods Community-dwelling volunteers with multiple sclerosis (N=30), back pain (N=5), or arthritis (N=8) were recruited based on clinician referrals, advertisements, fliers, web postings, and participation in previous research. Participants completed measures of pain severity, pain interference, and self-reported pain behaviors and were videotaped doing typical activities (e.g., walking, sitting). Two coders independently recorded frequencies of pain behaviors by category (e.g., guarding, bracing) and inter-rater reliability statistics were calculated. Naïve observers reviewed videotapes of individuals with MS and rated their pain. Spearman correlations were calculated between pain behavior frequencies and self-reported pain and pain ratings by naïve observers. Results Inter-rater reliability estimates indicated the reliability of pain codes in the MS sample. Kappa coefficients ranged from moderate agreement (sighing = 0.40) to substantial agreement (guarding = 0.83). These values were comparable to those obtained in the combined back pain and arthritis sample. Concurrent validity was supported by correlations with self-reported pain (0.46-0.53) and with self-reports of pain behaviors (0.58). Construct validity was supported by finding of 0.87 correlation between total pain behaviors observed by coders and mean pain ratings by naïve observers. Conclusion Results support use of the pain behavior observation protocol for assessing pain behaviors of individuals with MS. Valid assessments of pain behaviors of individuals with MS in could lead to creative interventions in the management of chronic pain in this population. PMID:23159684

A Novel Eye-Tracking Method to Assess Attention Allocation in Individuals with and without Aphasia Using a Dual-Task Paradigm

PubMed Central

Heuer, Sabine; Hallowell, Brooke

2015-01-01

Numerous authors report that people with aphasia have greater difficulty allocating attention than people without neurological disorders. Studying how attention deficits contribute to language deficits is important. However, existing methods for indexing attention allocation in people with aphasia pose serious methodological challenges. Eye-tracking methods have great potential to address such challenges. We developed and assessed the validity of a new dual-task method incorporating eye tracking to assess attention allocation. Twenty-six adults with aphasia and 33 control participants completed auditory sentence comprehension and visual search tasks. To test whether the new method validly indexes well-documented patterns in attention allocation, demands were manipulated by varying task complexity in single- and dual-task conditions. Differences in attention allocation were indexed via eye-tracking measures. For all participants significant increases in attention allocation demands were observed from single- to dual-task conditions and from simple to complex stimuli. Individuals with aphasia had greater difficulty allocating attention with greater task demands. Relationships between eye-tracking indices of comprehension during single and dual tasks and standardized testing were examined. Results support the validity of the novel eye-tracking method for assessing attention allocation in people with and without aphasia. Clinical and research implications are discussed. PMID:25913549

Assessing Interval Estimation Methods for Hill Model ...

EPA Pesticide Factsheets

The Hill model of concentration-response is ubiquitous in toxicology, perhaps because its parameters directly relate to biologically significant metrics of toxicity such as efficacy and potency. Point estimates of these parameters obtained through least squares regression or maximum likelihood are commonly used in high-throughput risk assessment, but such estimates typically fail to include reliable information concerning confidence in (or precision of) the estimates. To address this issue, we examined methods for assessing uncertainty in Hill model parameter estimates derived from concentration-response data. In particular, using a sample of ToxCast concentration-response data sets, we applied four methods for obtaining interval estimates that are based on asymptotic theory, bootstrapping (two varieties), and Bayesian parameter estimation, and then compared the results. These interval estimation methods generally did not agree, so we devised a simulation study to assess their relative performance. We generated simulated data by constructing four statistical error models capable of producing concentration-response data sets comparable to those observed in ToxCast. We then applied the four interval estimation methods to the simulated data and compared the actual coverage of the interval estimates to the nominal coverage (e.g., 95%) in order to quantify performance of each of the methods in a variety of cases (i.e., different values of the true Hill model paramet

Determining open cluster membership. A Bayesian framework for quantitative member classification

NASA Astrophysics Data System (ADS)

Stott, Jonathan J.

2018-01-01

Aims: My goal is to develop a quantitative algorithm for assessing open cluster membership probabilities. The algorithm is designed to work with single-epoch observations. In its simplest form, only one set of program images and one set of reference images are required. Methods: The algorithm is based on a two-stage joint astrometric and photometric assessment of cluster membership probabilities. The probabilities were computed within a Bayesian framework using any available prior information. Where possible, the algorithm emphasizes simplicity over mathematical sophistication. Results: The algorithm was implemented and tested against three observational fields using published survey data. M 67 and NGC 654 were selected as cluster examples while a third, cluster-free, field was used for the final test data set. The algorithm shows good quantitative agreement with the existing surveys and has a false-positive rate significantly lower than the astrometric or photometric methods used individually.

A statistical, task-based evaluation method for three-dimensional x-ray breast imaging systems using variable-background phantoms

DOE Office of Scientific and Technical Information (OSTI.GOV)

Park, Subok; Jennings, Robert; Liu Haimo

Purpose: For the last few years, development and optimization of three-dimensional (3D) x-ray breast imaging systems, such as digital breast tomosynthesis (DBT) and computed tomography, have drawn much attention from the medical imaging community, either academia or industry. However, there is still much room for understanding how to best optimize and evaluate the devices over a large space of many different system parameters and geometries. Current evaluation methods, which work well for 2D systems, do not incorporate the depth information from the 3D imaging systems. Therefore, it is critical to develop a statistically sound evaluation method to investigate the usefulnessmore » of inclusion of depth and background-variability information into the assessment and optimization of the 3D systems. Methods: In this paper, we present a mathematical framework for a statistical assessment of planar and 3D x-ray breast imaging systems. Our method is based on statistical decision theory, in particular, making use of the ideal linear observer called the Hotelling observer. We also present a physical phantom that consists of spheres of different sizes and materials for producing an ensemble of randomly varying backgrounds to be imaged for a given patient class. Lastly, we demonstrate our evaluation method in comparing laboratory mammography and three-angle DBT systems for signal detection tasks using the phantom's projection data. We compare the variable phantom case to that of a phantom of the same dimensions filled with water, which we call the uniform phantom, based on the performance of the Hotelling observer as a function of signal size and intensity. Results: Detectability trends calculated using the variable and uniform phantom methods are different from each other for both mammography and DBT systems. Conclusions: Our results indicate that measuring the system's detection performance with consideration of background variability may lead to differences in system performance estimates and comparisons. For the assessment of 3D systems, to accurately determine trade offs between image quality and radiation dose, it is critical to incorporate randomness arising from the imaging chain including background variability into system performance calculations.« less

Assessment of survey radiography as a method for diagnosis of congenital cardiac disease in dogs.

PubMed

Lamb, C R; Boswood, A; Volkman, A; Connolly, D J

2001-11-01

In order to assess the diagnostic accuracy of survey radiography for canine congenital cardiac anomalies, thoracic radiographs of 57 dogs with congenital cardiac anomalies, 31 normal dogs and 27 dogs with acquired cardiac disease were mixed, and reviewed by two independent observers, who were blinded to any patient information. The congenital anomalies were aortic stenosis (n=25), pulmonic stenosis (n=10), patent ductus arteriosus (n=9), ventricular septal defect (n=8), tricuspid dysplasia (n=3) and mitral dysplasia (n=2). Both observers were moderately accurate at identifying dogs with cardiac disease. Their ability to distinguish dogs with congenital versus acquired cardiac disease was poorer and this assessment was probably influenced by the recognition of patients that were skeletally immature, which biased observers towards a diagnosis of congenital cardiac anomaly. The diagnosis rate for specific congenital anomalies was also poor (the differential list included a correct diagnosis in only 40 and 37 per cent of cases). Radiographic signs of specific cardiac chamber enlargement or pulmonary vascular abnormalities were recognised by both observers in only 20 per cent of instances in which they might be expected. They were, however, recognised more frequently in dogs with anomalies that imposed a volume load on the heart than in dogs with anomalies that induced a pressure load on the organ. It is concluded that survey radiography is an inaccurate method for diagnosis of canine congenital cardiac anomalies because of the difficulty of recognising radiographic signs, which are not present in many cases.

Tetrazolium Reduction-Malachite Green Method for Assessing the Viability of Filamentous Bacteria in Activated Sludge

PubMed Central

Bitton, Gabriel; Koopman, Ben

1982-01-01

A method was developed to assess the activity of filamentous bacteria in activated sludge. It involves the incubation of activated sludge with 2(p-iodophenyl)-3-(p-nitrophenyl)-5-phenyl tetrazolium chloride followed by staining with malachite green. Both cells and 2(p-iodophenyl)-3-(p-nitrophenyl)-5-phenyl tetrazolium chloride-formazan crystals can be observed in prepared specimens by using bright-field microscopy. This procedure allowed us to distinguish between inactive and actively metabolizing filaments after chlorine application to control the bulking of activated sludge. Images PMID:16345999

Safety assessment for the postictal confusional phase following complex partial seizure.

PubMed

Tucker, C

1985-06-01

Misunderstanding of the postictal confusional state that follows the complex partial seizure has caused emotional and physical harm to patients. Concern about this phenomenon and its effects upon the patient prompted this study to explore, describe, and document one method of intervention to lessen these harmful effects. An evaluative descriptive research design was employed to assess patient safety during and after the postictal confusional phase following a complex partial seizure. A closed-structured questionnaire and participant observation were the methods used to collect data for this study. A Level of Safety Tool was specifically designed for this study.

Does Assessing Suicidality Frequently and Repeatedly Cause Harm? A Randomized Control Study

PubMed Central

Law, Mary Kate; Furr, R. Michael; Arnold, Elizabeth Mayfield; Mneimne, Malek; Jaquett, Caroline; Fleeson, William

2015-01-01

Assessing suicidality is common in mental health practice and is fundamental to suicide research. Although necessary, there is significant concern that such assessments have unintended harmful consequences. Using a longitudinal randomized control design, we evaluated whether repeated and frequent assessments of suicide-related thoughts and behaviors negatively affected individuals, including those at-risk for suicide-related outcomes. Adults (N = 282), including many diagnosed with Borderline Personality Disorder (BPD), were recruited through psychiatric outpatient clinics and from the community at large, and were randomly assigned to assessment groups. A Control Assessment group responded to questions regarding negative psychological experiences several times each day during a 2-week Main Observation phase. During the same observation period, an Intensive Suicide Assessment group responded to the same questions, along with questions regarding suicidal behavior and ideation. Negative psychological outcomes were measured during the Main Observation phase (for BPD symptoms unrelated to suicide and for BPD-relevant emotions) and/or at the end of each week during the Main Observation phase and monthly for 6 months thereafter (for all outcomes, including suicidal ideation and behavior). Results revealed little evidence that intensive suicide assessment triggered negative outcomes, including suicidal ideation or behavior, even among people with BPD. A handful of effects did reach or approach significance, though these were temporary and non-robust. However, given the seriousness of some outcomes, we recommend that researchers or clinicians who implement experience sampling methods including suicide-related items carefully consider the benefits of asking about suicide and to inform participants about possible risks. PMID:25894705

Does assessing suicidality frequently and repeatedly cause harm? A randomized control study.

PubMed

Law, Mary Kate; Furr, R Michael; Arnold, Elizabeth Mayfield; Mneimne, Malek; Jaquett, Caroline; Fleeson, William

2015-12-01

Assessing suicidality is common in mental health practice and is fundamental to suicide research. Although necessary, there is significant concern that such assessments have unintended harmful consequences. Using a longitudinal randomized control design, the authors evaluated whether repeated and frequent assessments of suicide-related thoughts and behaviors negatively affected individuals, including those at-risk for suicide-related outcomes. Adults (N = 282), including many diagnosed with borderline personality disorder (BPD), were recruited through psychiatric outpatient clinics and from the community at large, and were randomly assigned to assessment groups. A control assessment group responded to questions regarding negative psychological experiences several times each day during a 2-week main observation phase. During the same observation period, an intensive suicide assessment group responded to the same questions, along with questions regarding suicidal behavior and ideation. Negative psychological outcomes were measured during the main observation phase (for BPD symptoms unrelated to suicide and for BPD-relevant emotions) and/or at the end of each week during the main observation phase and monthly for 6 months thereafter (for all outcomes, including suicidal ideation and behavior). Results revealed little evidence that intensive suicide assessment triggered negative outcomes, including suicidal ideation or behavior, even among people with BPD. A handful of effects did reach or approach significance, though these were temporary and nonrobust. However, given the seriousness of some outcomes, the authors recommend that researchers or clinicians who implement experience sampling methods including suicide-related items carefully consider the benefits of asking about suicide and to inform participants about possible risks. (c) 2015 APA, all rights reserved).

Gait and Lower Limb Observation of Paediatrics (GALLOP): development of a consensus based paediatric podiatry and physiotherapy standardised recording proforma.

PubMed

Cranage, Simone; Banwell, Helen; Williams, Cylie M

2016-01-01

Paediatric gait and lower limb assessments are frequently undertaken in podiatry and physiotherapy clinical practice and this is a growing area of expertise within Australia. No concise paediatric standardised recording proforma exists to assist clinicians in clinical practice. The aim of this study was to develop a gait and lower limb standardised recording proforma guided by the literature and consensus, for assessment of the paediatric foot and lower limb in children aged 0-18 years. Expert Australian podiatrists and physiotherapists were invited to participate in a three round Delphi survey panel using the online Qualtrics(©) survey platform. The first round of the survey consisted of open-ended questions on paediatric gait and lower limb assessment developed from existing templates and a literature search of standardised lower limb assessment methods. Rounds two and three consisted of statements developed from the first round responses. Questions and statements were included in the final proforma if 70 % or more of the participants indicated consensus or agreement with the assessment method and if there was support within the literature for paediatric age-specific normative data with acceptable reliability of outcome measures. There were 17 of the 21 (81 %) participants who completed three rounds of the survey. Consensus was achieved for 41 statements in Round one, 54 statements achieved agreement in two subsequent rounds. Participants agreed on 95 statements relating to birth history, developmental history, hip measurement, rotation of the lower limb, ankle range of motion, foot posture, balance and gait. Assessments with acceptable validity and reliability were included within the final Gait and Lower Limb Observation of Paediatrics (GALLOP) proforma. The GALLOP proforma is a consensus based, systematic and standardised way to collect information and outcome measures in paediatric lower limb assessment. This standardised recording proforma will assist professions to collect information in a standardised format based on best evidence assessment methods whilst aiding consistency in communication between health professionals.

Treatment Outcome of Reconstruction for Isolated Posterior Cruciate Injury: Subjective and Objective Evaluations.

PubMed

Ochiai, Satoshi; Hagino, Tetsuo; Senga, Shinya; Yamashita, Takashi; Haro, Hirotaka

2018-05-23

There is no consensus regarding the treatment method and outcome of posterior cruciate ligament (PCL) injury. We hypothesized that although the outcome of PCL reconstruction was favorable in terms of knee stability, the outcome was unsatisfactory in terms of patient-based assessments. The purpose of this study is to evaluate the treatment outcomes of knees that underwent reconstruction for PCL injury by subjective and objective assessments, and to analyze the correlation between various assessments. Twenty-three patients who underwent PCL reconstruction were studied. All reconstructions were performed arthroscopically by the single-bundle technique using a hamstring tendon autograft. Patients were evaluated clinically before operation and 24 months after operation using the 36-Item Short Form Health Survey (SF-36) which is a patient-based health assessment survey, Lysholm score, tibial translation ratio, Visual Analogue Scale (VAS) for pain, and range of motion (ROM) in the knee. The correlation of these assessment methods was analyzed. For the SF-36 survey, significant improvement was observed after operation in only 3 of 7 subscales compared with before surgery. Furthermore, the scores reached the national standard scores in only 3 subscales. While the Lysholm score and tibial translation ratio were improved significantly, no significant improvement in the VAS pain score was observed. For ROM assessment, approximately 30% of the patients had flexion restriction after operation, and the degree of restriction correlated positively with the VAS score. The present results indicated that although the outcome of PCL reconstruction was favorable in terms of knee stability and motor function, the outcome was unsatisfactory in terms of patient-based assessments. Since pain associated with flexion restriction appears to be a poor prognostic factor and there is a dissociation between subjective and objective assessments, improvement of the surgical method is necessary. Thieme Medical Publishers 333 Seventh Avenue, New York, NY 10001, USA.

Best method for right atrial volume assessment by two-dimensional echocardiography: validation with magnetic resonance imaging.

PubMed

Ebtia, Mahasti; Murphy, Darra; Gin, Kenneth; Lee, Pui K; Jue, John; Nair, Parvathy; Mayo, John; Barnes, Marion E; Thompson, Darby J S; Tsang, Teresa S M

2015-05-01

Echocardiographic methods for estimating right atrial (RA) volume have not been standardized. Our aim was to evaluate two-dimensional (2D) echocardiographic methods of RA volume assessment, using RA volume by magnetic resonance imaging (MRI) as the reference. Right atrial volume was assessed in 51 patients (mean age 63 ± 14 years, 33 female) who underwent comprehensive 2D echocardiography and cardiac MRI for clinically indicated reasons. Echocardiographic RA volume methods included (1) biplane area length, using four-chamber view twice (biplane 4C-4C); (2) biplane area length, using four-chamber and subcostal views (biplane 4C-subcostal); and (3) single plane Simpson's method of disks (Simpson's). Echocardiographic RA volumes as well as linear RA major and minor dimensions were compared to RA volume by MRI using correlation and Bland-Altman methods, and evaluated for inter-observer reproducibility and accuracy in discriminating RA enlargement. All echocardiography volumetric methods performed well compared to MRI, with Pearson's correlation of 0.98 and concordance correlation ≥0.91 for each. For bias and limits of agreement, biplane 4C-4C (bias -4.81 mL/m(2) , limits of agreement ±9.8 mL/m(2) ) and Simpson's (bias -5.15 mL/m(2) , limits of agreement ±10.1 mL/m(2) ) outperformed biplane 4C-subcostal (bias -8.36 mL/m(2) , limits of agreement ±12.5 mL/m(2) ). Accuracy for discriminating RA enlargement was higher for all volumetric methods than for linear measurements. Inter-observer variability was satisfactory across all methods. Compared to MRI, biplane 4C-4C and single plane Simpson's are highly accurate and reproducible 2D echocardiography methods for estimating RA volume. Linear dimensions are inaccurate and should be abandoned. © 2014, Wiley Periodicals, Inc.

Knowledge-based reconstruction for measurement of right ventricular volumes on cardiovascular magnetic resonance images in a mixed population.

PubMed

Pieterman, Elise D; Budde, Ricardo P J; Robbers-Visser, Daniëlle; van Domburg, Ron T; Helbing, Willem A

2017-09-01

Follow-up of right ventricular performance is important for patients with congenital heart disease. Cardiac magnetic resonance imaging is optimal for this purpose. However, observer-dependency of manual analysis of right ventricular volumes limit its use. Knowledge-based reconstruction is a new semiautomatic analysis tool that uses a database including knowledge of right ventricular shape in various congenital heart diseases. We evaluated whether knowledge-based reconstruction is a good alternative for conventional analysis. To assess the inter- and intra-observer variability and agreement of knowledge-based versus conventional analysis of magnetic resonance right ventricular volumes, analysis was done by two observers in a mixed group of 22 patients with congenital heart disease affecting right ventricular loading conditions (dextro-transposition of the great arteries and right ventricle to pulmonary artery conduit) and a group of 17 healthy children. We used Bland-Altman analysis and coefficient of variation. Comparison between the conventional method and the knowledge-based method showed a systematically higher volume for the latter group. We found an overestimation for end-diastolic volume (bias -40 ± 24 mL, r = .956), end-systolic volume (bias -34 ± 24 mL, r = .943), stroke volume (bias -6 ± 17 mL, r = .735) and an underestimation of ejection fraction (bias 7 ± 7%, r = .671) by knowledge-based reconstruction. The intra-observer variability of knowledge-based reconstruction varied with a coefficient of variation of 9% for end-diastolic volume and 22% for stroke volume. The same trend was noted for inter-observer variability. A systematic difference (overestimation) was noted for right ventricular size as assessed with knowledge-based reconstruction compared with conventional methods for analysis. Observer variability for the new method was comparable to what has been reported for the right ventricle in children and congenital heart disease with conventional analysis. © 2017 Wiley Periodicals, Inc.

Quantitative assessment of Naegleria fowleri and fecal indicator bacteria in brackish water of Lake Pontchartrain, Louisiana.

PubMed

Xue, Jia; Lamar, Frederica G; Zhang, Bowen; Lin, Siyu; Lamori, Jennifer G; Sherchan, Samendra P

2018-05-01

Brackish water samples from Lake Pontchartrain in Louisiana were assessed for the presence of pathogenic amoeba Naegleria fowleri, which causes primary amoebic meningoencephalitis (PAM). In our study, quantitative polymerase chain reaction (qPCR) methods were used to determine N. fowleri, E. coli, and enterococci in water collected from Lake Pontchartrain. N. fowleri target sequence was detected in 35.4% (56/158) of the water samples from ten sites around the lake. Statistically significant positive correlations between N. fowleri concentration and water temperature as well as E. coli (qPCR) were observed. Multiple linear regression (MLR) model shows seasonal factor (summer or winter) has significant effect on the concentration of N. fowleri, E. coli and enterococci (qPCR) concentration. Significant positive relationships between E. coli and enterococci was observed from both qPCR (r=0.25) and culture based method (r=0.54). Meanwhile, significant positive correlation between qPCR and culture based methods for enterococci concentration was observed (r=0.33). In our study, water temperature and E. coli concentration were indicative of N. fowleri concentrations in brackish water environment. Future research is needed to determine whether sediment is a source of N. fowleri found in the water column. Copyright © 2017 Elsevier B.V. All rights reserved.

Prospecting fungal parasites of the potato cyst nematode Globodera pallida using a rapid screening technique.

PubMed

Kooliyottil, Rinu; Dandurand, Louise-Marie; Knudsen, Guy R

2017-05-01

Seven filamentous fungal species were isolated from individual eggs of Globodera pallida cysts collected from infested fields in Shelley Idaho, USA and identified as Chaetomium globosum, Fusarium oxysporum, Fusarium solani, Fusarium tricinctum, Microdochium bolleyi, Purpureocillium lilacinum, and Plectosphaerella cucumerina. Their ability to reduce infection by G. pallida in planta were assessed in simple, reproducible micro-rhizosphere chambers (micro-ROCs). All fungi reduced G. pallida infection in potato, but greatest reduction was observed with C. globosum at an average reduction of 76%. Further non-destructive methods were developed to rapidly assess biological control potential of putative fungal strains by staining the infectious second stage juveniles of G. pallida with the live fluorescent stain PKH26. In comparisons between the standard, invasive acid fuchsin method and use of the live stain PKH26, no significant difference in infection level of G. pallida was observed whether roots were stained with PKH26 or acid fuchsin. For both methods, a similar reduction (77% for acid fuchsin, and 78% for PKH26 stain) in invasion of infectious stage of G. pallida was observed when potato plants were inoculated with C. globosum compared to non-inoculated potato. © 2017 WILEY-VCH Verlag GmbH & Co. KGaA, Weinheim.

Assessing the Implementation Fidelity of a School-Based Teaching Personal and Social Responsibility Program in Physical Education and Other Subject Areas

ERIC Educational Resources Information Center

Escartí, Amparo; Liops-Goig, Ramon; Wright, Paul M.

2018-01-01

Purpose: The Teaching Personal and Social Responsibility (TPSR) model was developed to foster responsibility and teach life skills that transfer to various settings. The purpose of this study was to assess the implementation fidelity of a school-based TPSR program in physical education and other subject areas. Method: Systematic observation was…

Assessing Reliability and Validity of the "GroPromo" Audit Tool for Evaluation of Grocery Store Marketing and Promotional Environments

ERIC Educational Resources Information Center

Kerr, Jacqueline; Sallis, James F.; Bromby, Erica; Glanz, Karen

2012-01-01

Objective: To evaluate reliability and validity of a new tool for assessing the placement and promotional environment in grocery stores. Methods: Trained observers used the "GroPromo" instrument in 40 stores to code the placement of 7 products in 9 locations within a store, along with other promotional characteristics. To test construct validity,…

Automated Detection of Actinic Keratoses in Clinical Photographs

PubMed Central

Hames, Samuel C.; Sinnya, Sudipta; Tan, Jean-Marie; Morze, Conrad; Sahebian, Azadeh; Soyer, H. Peter; Prow, Tarl W.

2015-01-01

Background Clinical diagnosis of actinic keratosis is known to have intra- and inter-observer variability, and there is currently no non-invasive and objective measure to diagnose these lesions. Objective The aim of this pilot study was to determine if automatically detecting and circumscribing actinic keratoses in clinical photographs is feasible. Methods Photographs of the face and dorsal forearms were acquired in 20 volunteers from two groups: the first with at least on actinic keratosis present on the face and each arm, the second with no actinic keratoses. The photographs were automatically analysed using colour space transforms and morphological features to detect erythema. The automated output was compared with a senior consultant dermatologist’s assessment of the photographs, including the intra-observer variability. Performance was assessed by the correlation between total lesions detected by automated method and dermatologist, and whether the individual lesions detected were in the same location as the dermatologist identified lesions. Additionally, the ability to limit false positives was assessed by automatic assessment of the photographs from the no actinic keratosis group in comparison to the high actinic keratosis group. Results The correlation between the automatic and dermatologist counts was 0.62 on the face and 0.51 on the arms, compared to the dermatologist’s intra-observer variation of 0.83 and 0.93 for the same. Sensitivity of automatic detection was 39.5% on the face, 53.1% on the arms. Positive predictive values were 13.9% on the face and 39.8% on the arms. Significantly more lesions (p<0.0001) were detected in the high actinic keratosis group compared to the no actinic keratosis group. Conclusions The proposed method was inferior to assessment by the dermatologist in terms of sensitivity and positive predictive value. However, this pilot study used only a single simple feature and was still able to achieve sensitivity of detection of 53.1% on the arms.This suggests that image analysis is a feasible avenue of investigation for overcoming variability in clinical assessment. Future studies should focus on more sophisticated features to improve sensitivity for actinic keratoses without erythema and limit false positives associated with the anatomical structures on the face. PMID:25615930

Visually scoring hirsutism

PubMed Central

Yildiz, Bulent O.; Bolour, Sheila; Woods, Keslie; Moore, April; Azziz, Ricardo

2010-01-01

BACKGROUND Hirsutism is the presence of excess body or facial terminal (coarse) hair growth in females in a male-like pattern, affects 5–15% of women, and is an important sign of underlying androgen excess. Different methods are available for the assessment of hair growth in women. METHODS We conducted a literature search and analyzed the published studies that reported methods for the assessment of hair growth. We review the basic physiology of hair growth, the development of methods for visually quantifying hair growth, the comparison of these methods with objective measurements of hair growth, how hirsutism may be defined using a visual scoring method, the influence of race and ethnicity on hirsutism, and the impact of hirsutism in diagnosing androgen excess and polycystic ovary syndrome. RESULTS Objective methods for the assessment of hair growth including photographic evaluations and microscopic measurements are available but these techniques have limitations for clinical use, including a significant degree of complexity and a high cost. Alternatively, methods for visually scoring or quantifying the amount of terminal body and facial hair growth have been in use since the early 1920s; these methods are semi-quantitative at best and subject to significant inter-observer variability. The most common visual method of scoring the extent of body and facial terminal hair growth in use today is based on a modification of the method originally described by Ferriman and Gallwey in 1961 (i.e. the mFG method). CONCLUSION Overall, the mFG scoring method is a useful visual instrument for assessing excess terminal hair growth, and the presence of hirsutism, in women. PMID:19567450

Anabolic Androgenic Steroids—Use and Correlates among Gym Users—An Assessment Study Using Questionnaires and Observations at Gyms in the Stockholm Region

PubMed Central

Leifman, Håkan; Rehnman, Charlotta; Sjöblom, Erika; Holgersson, Stefan

2011-01-01

The purpose of this study was to estimate the prevalence of anabolic androgenic steroid (AAS) use and offers to use among gym users in Stockholm County (Sweden), and to conduct a comparison of concordance in estimates of AAS and supplements at gyms between two data collection methods. A questionnaire was distributed to members at 36 training facilities and 1,752 gym users participated in the study. An observation study was conducted as covert participant observations at 64 gyms. According to the questionnaire, 3.9% of men reported life time use of AAS, 1.4% use during the past 12 months and 0.4% AAS use during past 30 days. Not only were there similar patterns found in the two methods, i.e., similar age and gender distributions for AAS use, but analyses of concordance showed that gyms with a higher prevalence of self-reported AAS-use and supplement use (questionnaire) showed a significantly higher proportion of observer-assessed AAS users. Analyses of individual predictors showed that AAS users were almost always young men, regular weight trainers and more often users of drugs and nutritional supplements. The higher prevalence of AAS use among gym users than in the general population makes the former an appropriate target group for AAS prevention. The connection between supplements, drugs and AAS use suggests that effective AAS prevention need to focus on several risk factors for AAS use. The clear resemblance in estimates between the observation and questionnaire data strengthen the credibility of the two methods. PMID:21845151

Anabolic androgenic steroids--use and correlates among gym users--an assessment study using questionnaires and observations at gyms in the Stockholm region.

PubMed

Leifman, Håkan; Rehnman, Charlotta; Sjöblom, Erika; Holgersson, Stefan

2011-07-01

The purpose of this study was to estimate the prevalence of anabolic androgenic steroid (AAS) use and offers to use among gym users in Stockholm County (Sweden), and to conduct a comparison of concordance in estimates of AAS and supplements at gyms between two data collection methods. A questionnaire was distributed to members at 36 training facilities and 1,752 gym users participated in the study. An observation study was conducted as covert participant observations at 64 gyms. According to the questionnaire, 3.9% of men reported life time use of AAS, 1.4% use during the past 12 months and 0.4% AAS use during past 30 days. Not only were there similar patterns found in the two methods, i.e., similar age and gender distributions for AAS use, but analyses of concordance showed that gyms with a higher prevalence of self-reported AAS-use and supplement use (questionnaire) showed a significantly higher proportion of observer-assessed AAS users. Analyses of individual predictors showed that AAS users were almost always young men, regular weight trainers and more often users of drugs and nutritional supplements. The higher prevalence of AAS use among gym users than in the general population makes the former an appropriate target group for AAS prevention. The connection between supplements, drugs and AAS use suggests that effective AAS prevention need to focus on several risk factors for AAS use. The clear resemblance in estimates between the observation and questionnaire data strengthen the credibility of the two methods.

A direct observation method for auditing large urban centers using stratified sampling, mobile GIS technology and virtual environments.

PubMed

Lafontaine, Sean J V; Sawada, M; Kristjansson, Elizabeth

2017-02-16

With the expansion and growth of research on neighbourhood characteristics, there is an increased need for direct observational field audits. Herein, we introduce a novel direct observational audit method and systematic social observation instrument (SSOI) for efficiently assessing neighbourhood aesthetics over large urban areas. Our audit method uses spatial random sampling stratified by residential zoning and incorporates both mobile geographic information systems technology and virtual environments. The reliability of our method was tested in two ways: first, in 15 Ottawa neighbourhoods, we compared results at audited locations over two subsequent years, and second; we audited every residential block (167 blocks) in one neighbourhood and compared the distribution of SSOI aesthetics index scores with results from the randomly audited locations. Finally, we present interrater reliability and consistency results on all observed items. The observed neighbourhood average aesthetics index score estimated from four or five stratified random audit locations is sufficient to characterize the average neighbourhood aesthetics. The SSOI was internally consistent and demonstrated good to excellent interrater reliability. At the neighbourhood level, aesthetics is positively related to SES and physical activity and negatively correlated with BMI. The proposed approach to direct neighbourhood auditing performs sufficiently and has the advantage of financial and temporal efficiency when auditing a large city.

Critical Thinking and Intelligence Analysis

DTIC Science & Technology

2007-03-01

assess such systems – terrorist networks are but one example. Additionally, as sociologist Emile Durkheim observes, the combinations of elements...University Press, 99), 0. Cited hereafter as Jervis, System Effects. Emile Durkheim , The Rules of Sociological Method (Glencoe, IL: Free Press...Puzzles. New York, NY: Main Street, 2005. Durkheim , Emile . The Rules of Sociological Method. Glencoe, IL: Free Press, 1938. Eco, Umberto, and

Do Teachers Make Decisions Like Firefighters? Applying Naturalistic Decision-Making Methods to Teachers' In-Class Decision Making in Mathematics

ERIC Educational Resources Information Center

Jazby, Dan

2014-01-01

Research into human decision making (DM) processes from outside of education paint a different picture of DM than current DM models in education. This pilot study assesses the use of critical decision method (CDM)--developed from observations of firefighters' DM -- in the context of primary mathematics teachers' in-class DM. Preliminary results…

Quality of data in multiethnic health surveys.

PubMed Central

Pasick, R. J.; Stewart, S. L.; Bird, J. A.; D'Onofrio, C. N.

2001-01-01

OBJECTIVE: There has been insufficient research on the influence of ethno-cultural and language differences in public health surveys. Using data from three independent studies, the authors examine methods to assess data quality and to identify causes of problematic survey questions. METHODS: Qualitative and quantitative methods were used in this exploratory study, including secondary analyses of data from three baseline surveys (conducted in English, Spanish, Cantonese, Mandarin, and Vietnamese). Collection of additional data included interviews with investigators and interviewers; observations of item development; focus groups; think-aloud interviews; a test-retest assessment survey; and a pilot test of alternatively worded questions. RESULTS: The authors identify underlying causes for the 12 most problematic variables in three multiethnic surveys and describe them in terms of ethnic differences in reliability, validity, and cognitive processes (interpretation, memory retrieval, judgment formation, and response editing), and differences with regard to cultural appropriateness and translation problems. CONCLUSIONS: Multiple complex elements affect measurement in a multiethnic survey, many of which are neither readily observed nor understood through standard tests of data quality. Multiethnic survey questions are best evaluated using a variety of quantitative and qualitative methods that reveal different types and causes of problems. PMID:11889288

Comparison of the medical students' perceived self-efficacy and the evaluation of the observers and patients.

PubMed

Ammentorp, Jette; Thomsen, Janus Laust; Jarbøl, Dorte Ejg; Holst, René; Øvrehus, Anne Lindebo Holm; Kofoed, Poul-Erik

2013-04-08

The accuracy of self-assessment has been questioned in studies comparing physicians' self-assessments to observed assessments; however, none of these studies used self-efficacy as a method for self-assessment. The aim of the study was to investigate how medical students' perceived self-efficacy of specific communication skills corresponds to the evaluation of simulated patients and observers. All of the medical students who signed up for an Objective Structured Clinical Examination (OSCE) were included. As a part of the OSCE, the student performance in the "parent-physician interaction" was evaluated by a simulated patient and an observer at one of the stations. After the examination the students were asked to assess their self-efficacy according to the same specific communication skills. The Calgary Cambridge Observation Guide formed the basis for the outcome measures used in the questionnaires. A total of 12 items was rated on a Likert scale from 1-5 (strongly disagree to strongly agree). We used extended Rasch models for comparisons between the groups of responses of the questionnaires. Comparisons of groups were conducted on dichotomized responses. Eighty-four students participated in the examination, 87% (73/84) of whom responded to the questionnaire. The response rate for the simulated patients and the observers was 100%. Significantly more items were scored in the highest categories (4 and 5) by the observers and simulated patients compared to the students (observers versus students: -0.23; SE:0.112; p=0.002 and patients versus students:0.177; SE:0.109; p=0.037). When analysing the items individually, a statistically significant difference only existed for two items. This study showed that students scored their communication skills lower compared to observers or simulated patients. The differences were driven by only 2 of 12 items. The results in this study indicate that self-efficacy based on the Calgary Cambridge Observation guide seems to be a reliable tool.

Assessing the Impact of Observations on Numerical Weather Forecasts Using the Adjoint Method

NASA Technical Reports Server (NTRS)

Gelaro, Ronald

2012-01-01

The adjoint of a data assimilation system provides a flexible and efficient tool for estimating observation impacts on short-range weather forecasts. The impacts of any or all observations can be estimated simultaneously based on a single execution of the adjoint system. The results can be easily aggregated according to data type, location, channel, etc., making this technique especially attractive for examining the impacts of new hyper-spectral satellite instruments and for conducting regular, even near-real time, monitoring of the entire observing system. This talk provides a general overview of the adjoint method, including the theoretical basis and practical implementation of the technique. Results are presented from the adjoint-based observation impact monitoring tool in NASA's GEOS-5 global atmospheric data assimilation and forecast system. When performed in conjunction with standard observing system experiments (OSEs), the adjoint results reveal both redundancies and dependencies between observing system impacts as observations are added or removed from the assimilation system. Understanding these dependencies may be important for optimizing the use of the current observational network and defining requirements for future observing systems

Using mixed methods to assess fidelity of delivery and its influencing factors in a complex self-management intervention for people with osteoarthritis and low back pain.

PubMed

Toomey, Elaine; Matthews, James; Hurley, Deirdre A

2017-08-04

Despite an increasing awareness of the importance of fidelity of delivery within complex behaviour change interventions, it is often poorly assessed. This mixed methods study aimed to establish the fidelity of delivery of a complex self-management intervention and explore the reasons for these findings using a convergent/triangulation design. Feasibility trial of the Self-management of Osteoarthritis and Low back pain through Activity and Skills (SOLAS) intervention (ISRCTN49875385), delivered in primary care physiotherapy. 60 SOLAS sessions were delivered across seven sites by nine physiotherapists. Fidelity of delivery of prespecified intervention components was evaluated using (1) audio-recordings (n=60), direct observations (n=24) and self-report checklists (n=60) and (2) individual interviews with physiotherapists (n=9). Quantitatively, fidelity scores were calculated using percentage means and SD of components delivered. Associations between fidelity scores and physiotherapist variables were analysed using Spearman's correlations. Interviews were analysed using thematic analysis to explore potential reasons for fidelity scores. Integration of quantitative and qualitative data occurred at an interpretation level using triangulation. Quantitatively, fidelity scores were high for all assessment methods; with self-report (92.7%) consistently higher than direct observations (82.7%) or audio-recordings (81.7%). There was significant variation between physiotherapists' individual scores (69.8% - 100%). Both qualitative and quantitative data (from physiotherapist variables) found that physiotherapists' knowledge (Spearman's association at p=0.003) and previous experience (p=0.008) were factors that influenced their fidelity. The qualitative data also postulated participant-level (eg, individual needs) and programme-level factors (eg, resources) as additional elements that influenced fidelity. The intervention was delivered with high fidelity. This study contributes to the limited evidence regarding fidelity assessment methods within complex behaviour change interventions. The findings suggest a combination of quantitative methods is suitable for the assessment of fidelity of delivery. A mixed methods approach provided a more insightful understanding of fidelity and its influencing factors. ISRCTN49875385; Pre-results. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Monte Carlo errors with less errors

NASA Astrophysics Data System (ADS)

Wolff, Ulli; Alpha Collaboration

2004-01-01

We explain in detail how to estimate mean values and assess statistical errors for arbitrary functions of elementary observables in Monte Carlo simulations. The method is to estimate and sum the relevant autocorrelation functions, which is argued to produce more certain error estimates than binning techniques and hence to help toward a better exploitation of expensive simulations. An effective integrated autocorrelation time is computed which is suitable to benchmark efficiencies of simulation algorithms with regard to specific observables of interest. A Matlab code is offered for download that implements the method. It can also combine independent runs (replica) allowing to judge their consistency.

CLINICAL AUDIT OF IMAGE QUALITY IN RADIOLOGY USING VISUAL GRADING CHARACTERISTICS ANALYSIS.

PubMed

Tesselaar, Erik; Dahlström, Nils; Sandborg, Michael

2016-06-01

The aim of this work was to assess whether an audit of clinical image quality could be efficiently implemented within a limited time frame using visual grading characteristics (VGC) analysis. Lumbar spine radiography, bedside chest radiography and abdominal CT were selected. For each examination, images were acquired or reconstructed in two ways. Twenty images per examination were assessed by 40 radiology residents using visual grading of image criteria. The results were analysed using VGC. Inter-observer reliability was assessed. The results of the visual grading analysis were consistent with expected outcomes. The inter-observer reliability was moderate to good and correlated with perceived image quality (r(2) = 0.47). The median observation time per image or image series was within 2 min. These results suggest that the use of visual grading of image criteria to assess the quality of radiographs provides a rapid method for performing an image quality audit in a clinical environment. © The Author 2015. Published by Oxford University Press. All rights reserved. For Permissions, please email: journals.permissions@oup.com.

Survey methods for assessing land cover map accuracy

USGS Publications Warehouse

Nusser, S.M.; Klaas, E.E.

2003-01-01

The increasing availability of digital photographic materials has fueled efforts by agencies and organizations to generate land cover maps for states, regions, and the United States as a whole. Regardless of the information sources and classification methods used, land cover maps are subject to numerous sources of error. In order to understand the quality of the information contained in these maps, it is desirable to generate statistically valid estimates of accuracy rates describing misclassification errors. We explored a full sample survey framework for creating accuracy assessment study designs that balance statistical and operational considerations in relation to study objectives for a regional assessment of GAP land cover maps. We focused not only on appropriate sample designs and estimation approaches, but on aspects of the data collection process, such as gaining cooperation of land owners and using pixel clusters as an observation unit. The approach was tested in a pilot study to assess the accuracy of Iowa GAP land cover maps. A stratified two-stage cluster sampling design addressed sample size requirements for land covers and the need for geographic spread while minimizing operational effort. Recruitment methods used for private land owners yielded high response rates, minimizing a source of nonresponse error. Collecting data for a 9-pixel cluster centered on the sampled pixel was simple to implement, and provided better information on rarer vegetation classes as well as substantial gains in precision relative to observing data at a single-pixel.

Developing a regional canopy fuels assessment strategy using multi-scale lidar

USGS Publications Warehouse

Peterson, Birgit E.; Nelson, Kurtis

2011-01-01

Accurate assessments of canopy fuels are needed by fire scientists to understand fire behavior and to predict future fire occurrence. A key descriptor for canopy fuels is canopy bulk density (CBD). CBD is closely linked to the structure of the canopy; therefore, lidar measurements are particularly well suited to assessments of CBD. LANDFIRE scientists are exploring methods to integrate airborne and spaceborne lidar datasets into a national mapping effort. In this study, airborne lidar, spaceborne lidar, and field data are used to map CBD in the Yukon Flats Ecoregion, with the airborne lidar serving as a bridge between the field data and the spaceborne observations. The field-based CBD was positively correlated with airborne lidar observations (R2=0.78). Mapped values of CBD using the airborne lidar dataset were significantly correlated with spaceborne lidar observations when analyzed by forest type (R2=0.62, evergreen and R2=0.71, mixed). Though continued research is necessary to validate these results, they do support the feasibility of airborne and, most importantly, spaceborne lidar data for canopy fuels assessment.

Comparing simple root phenotyping methods on a core set of rice genotypes.

PubMed

Shrestha, R; Al-Shugeairy, Z; Al-Ogaidi, F; Munasinghe, M; Radermacher, M; Vandenhirtz, J; Price, A H

2014-05-01

Interest in belowground plant growth is increasing, especially in relation to arguments that shallow-rooted cultivars are efficient at exploiting soil phosphorus while deep-rooted ones will access water at depth. However, methods for assessing roots in large numbers of plants are diverse and direct comparisons of methods are rare. Three methods for measuring root growth traits were evaluated for utility in discriminating rice cultivars: soil-filled rhizotrons, hydroponics and soil-filled pots whose bottom was sealed with a non-woven fabric (a potential method for assessing root penetration ability). A set of 38 rice genotypes including the OryzaSNP set of 20 cultivars, additional parents of mapping populations and products of marker-assisted selection for root QTLs were assessed. A novel method of image analysis for assessing rooting angles from rhizotron photographs was employed. The non-woven fabric was the easiest yet least discriminatory method, while the rhizotron was highly discriminatory and allowed the most traits to be measured but required more than three times the labour of the other methods. The hydroponics was both easy and discriminatory, allowed temporal measurements, but is most likely to suffer from artefacts. Image analysis of rhizotrons compared favourably to manual methods for discriminating between cultivars. Previous observations that cultivars from the indica subpopulation have shallower rooting angles than aus or japonica cultivars were confirmed in the rhizotrons, and indica and temperate japonicas had lower maximum root lengths in rhizotrons and hydroponics. It is concluded that rhizotrons are the preferred method for root screening, particularly since root angles can be assessed. © 2013 German Botanical Society and The Royal Botanical Society of the Netherlands.

Assessing the performance of sewer rehabilitation on the reduction of infiltration and inflow.

PubMed

Staufer, P; Scheidegger, A; Rieckermann, J

2012-10-15

Inflow and Infiltration (I/I) into sewer systems is generally unwanted, because, among other things, it decreases the performance of wastewater treatment plants and increases combined sewage overflows. As sewer rehabilitation to reduce I/I is very expensive, water managers not only need methods to accurately measure I/I, but also they need sound approaches to assess the actual performance of implemented rehabilitation measures. However, such performance assessment is rarely performed. On the one hand, it is challenging to adequately take into account the variability of influential factors, such as hydro-meteorological conditions. On the other hand, it is currently not clear how experimental data can indeed support robust evidence for reduced I/I. In this paper, we therefore statistically assess the performance of rehabilitation measures to reduce I/I. This is possible by using observations in a suitable reference catchment as a control group and assessing the significance of the observed effect by regression analysis, which is well established in other disciplines. We successfully demonstrate the usefulness of the approach in a case study, where rehabilitation reduced groundwater infiltration by 23.9%. A reduction of stormwater inflow of 35.7%, however, was not statistically significant. Investigations into the experimental design of monitoring campaigns confirmed that the variability of the data as well as the number of observations collected before the rehabilitation impact the detection limit of the effect. This implies that it is difficult to improve the data quality after the rehabilitation has been implemented. Therefore, future practical applications should consider a careful experimental design. Further developments could employ more sophisticated monitoring methods, such as stable environmental isotopes, to directly observe the individual infiltration components. In addition, water managers should develop strategies to effectively communicate statistically not significant I/I reduction ratios to decision makers. Copyright © 2012 Elsevier Ltd. All rights reserved.

Fatigue Damage Assessment Leveraging Nondestructive Evaluation Data

NASA Astrophysics Data System (ADS)

Mazur, K.; Wisner, B.; Kontsos, A.

2018-05-01

Fatigue in materials depends on several microstructural parameters. The length and time scales involved in such processes have been investigated by characterization methods that target microstructural effects or that rely on specimen-level observations. Combinations of in situ and ex situ techniques are also used to correlate microstructural changes to bulk properties. We present herein an effort to directly link local changes with specimen-level fatigue damage assessment. To achieve this goal, grain-scale observations in an aluminum alloy are linked with deformation measurements made by digital image correlation and with acoustic emission monitoring obtained from inside the scanning electron microscope. Damage assessment is attempted using a data-processing framework that involves noise removal, data reduction, and classification. The results demonstrate that nondestructive evaluation combined with small-scale testing can provide a means for fatigue damage assessment applicable to a broad range of materials and testing conditions.

Automated Cognitive Health Assessment Using Smart Home Monitoring of Complex Tasks

PubMed Central

Dawadi, Prafulla N.; Cook, Diane J.; Schmitter-Edgecombe, Maureen

2014-01-01

One of the many services that intelligent systems can provide is the automated assessment of resident well-being. We hypothesize that the functional health of individuals, or ability of individuals to perform activities independently without assistance, can be estimated by tracking their activities using smart home technologies. In this paper, we introduce a machine learning-based method for assessing activity quality in smart homes. To validate our approach we quantify activity quality for 179 volunteer participants who performed a complex, interweaved set of activities in our smart home apartment. We observed a statistically significant correlation (r=0.79) between automated assessment of task quality and direct observation scores. Using machine learning techniques to predict the cognitive health of the participants based on task quality is accomplished with an AUC value of 0.64. We believe that this capability is an important step in understanding everyday functional health of individuals in their home environments. PMID:25530925

Automated Cognitive Health Assessment Using Smart Home Monitoring of Complex Tasks.

PubMed

Dawadi, Prafulla N; Cook, Diane J; Schmitter-Edgecombe, Maureen

2013-11-01

One of the many services that intelligent systems can provide is the automated assessment of resident well-being. We hypothesize that the functional health of individuals, or ability of individuals to perform activities independently without assistance, can be estimated by tracking their activities using smart home technologies. In this paper, we introduce a machine learning-based method for assessing activity quality in smart homes. To validate our approach we quantify activity quality for 179 volunteer participants who performed a complex, interweaved set of activities in our smart home apartment. We observed a statistically significant correlation (r=0.79) between automated assessment of task quality and direct observation scores. Using machine learning techniques to predict the cognitive health of the participants based on task quality is accomplished with an AUC value of 0.64. We believe that this capability is an important step in understanding everyday functional health of individuals in their home environments.

Observational constraints indicate risk of drying in the Amazon basin.

PubMed

Shiogama, Hideo; Emori, Seita; Hanasaki, Naota; Abe, Manabu; Masutomi, Yuji; Takahashi, Kiyoshi; Nozawa, Toru

2011-03-29

Climate warming due to human activities will be accompanied by hydrological cycle changes. Economies, societies and ecosystems in South America are vulnerable to such water resource changes. Hence, water resource impact assessments for South America, and corresponding adaptation and mitigation policies, have attracted increased attention. However, substantial uncertainties remain in the current water resource assessments that are based on multiple coupled Atmosphere Ocean General Circulation models. This uncertainty varies from significant wetting to catastrophic drying. By applying a statistical method, we characterized the uncertainty and identified global-scale metrics for measuring the reliability of water resource assessments in South America. Here, we show that, although the ensemble mean assessment suggested wetting across most of South America, the observational constraints indicate a higher probability of drying in the Amazon basin. Thus, over-reliance on the consensus of models can lead to inappropriate decision making.

[Assessment of competence in pediatric postgraduate education: implementation of a pediatric version of the Mini-Cex].

PubMed

Urman, Gabriela; Folgueral, Silvana; Gasparri, Mercedes; López, Diana; Urman, Jorge; Grosman, Arnoldo; Alves de Lima, Alberto

2011-12-01

Faced with the increased challenge of assessing competences in young doctors, the purpose of the study was to evaluate the implementation of a pediatric version of the Mini-Cex in pediatric trainees as well as the level of satisfaction of teachers and students with the new assessment tool. From July 2007 to August 2009, 54 pediatric trainees were periodically monitored in a variety of clinical settings by 50 teachers. The competences evaluated included medical interviewing, physical examination and counseling skills, humanistic qualities/ professionalism, clinical judgment, organization and overall clinical competence. The feasibility of this study was defined as an average 4 observations per participant, and observations in all clinical rotations. During the study, 388 observations were carried over 54 students (average of 7.18 observations per student); 57% took place in ambulatory settings, 60% were of low complexity and 85% involved healthy children programmed consultations. The ratings for specific competences had little variation; the focus related to the setting. Used in a variety of settings, with different patient problems, the method was well accepted by both students and teachers.

The implementation of portfolio assessment by the educators on the mathematics learning process in senior high school

NASA Astrophysics Data System (ADS)

Lestariani, Ida; Sujadi, Imam; Pramudya, Ikrar

2018-05-01

Portfolio assessment can shows the development of the ability of learners in a period through the work so that can be seen progress monitored learning of each learner. The purpose of research to describe and know the implementation of portfolio assessment on the mathematics learning process with the Senior High school math teacher class X as the subject because of the importance of applying the assessment for the progress of learning outcomes of learners. This research includes descriptive qualitative research type. Techniques of data collecting is done by observation method, interview and documentation. Data collection then validated using triangulation technique that is observation technique, interview and documentation. Data analysis technique is done by data reduction, data presentation and conclusion. The results showed that the steps taken by teachers in applying portfolio assessment obtained focused on learning outcomes. Student learning outcomes include homework and daily tests. Based on the results of research can be concluded that the implementation of portfolio assessment is the form of learning results are scored. Teachers have not yet implemented other portfolio assessment techniques such as student work.

Comparison of three methods to assess individual skeletal maturity.

PubMed

Pasciuti, Enzo; Franchi, Lorenzo; Baccetti, Tiziano; Milani, Silvano; Farronato, Giampietro

2013-09-01

The knowledge of facial growth and development is fundamental to determine the optimal timing for different treatment procedures in the growing patient. To analyze the reproducibility of three methods in assessing individual skeletal maturity, and to evaluate any degree of concordance among them. In all, 100 growing subjects were enrolled to test three methods: the hand-wrist, cervical vertebral maturation (CVM), and medial phalanges of the third finger method (MP3). Four operators determined the skeletal maturity of the subjects to evaluate the reproducibility of each method. After 30 days the operators repeated the analysis to assess the repeatability of each method. Finally, one operator examined all subjects' radiographs to detect any concordance among the three methods. The weighted kappa values for inter-operator variability were 0.94, 0.91, and 0.90, for the WRI, CVM, and MP3 methods, respectively. The weighted kappa values for intra-operator variability were 0.92, 0.91, and 0.92, for the WRI, CVM, and MP3 methods, respectively. The three methods revealed a high degree of repeatability and reproducibility. Complete agreement among the three methods was observed in 70% of the analyzed samples. The CVM method has the advantage of not necessitating an additional radiograph. The MP3 method is a simple and practical alternative as it requires only a standard dental x-ray device.

From observational to analytical morphology of the stratum corneum: progress avoiding hazardous animal and human testings

PubMed Central

Piérard, Gérald E; Courtois, Justine; Ritacco, Caroline; Humbert, Philippe; Fanian, Ferial; Piérard-Franchimont, Claudine

2015-01-01

Background In cosmetic science, noninvasive sampling of the upper part of the stratum corneum is conveniently performed using strippings with adhesive-coated discs (SACD) and cyanoacrylate skin surface strippings (CSSSs). Methods Under controlled conditions, it is possible to scrutinize SACD and CSSS with objectivity using appropriate methods of analytical morphology. These procedures apply to a series of clinical conditions including xerosis grading, comedometry, corneodynamics, corneomelametry, corneosurfametry, corneoxenometry, and dandruff assessment. Results With any of the analytical evaluations, SACD and CSSS provide specific salient information that is useful in the field of cosmetology. In particular, both methods appear valuable and complementary in assessing the human skin compatibility of personal skincare products. Conclusion A set of quantitative analytical methods applicable to the minimally invasive and low-cost SACD and CSSS procedures allow for a sound assessment of cosmetic effects on the stratum corneum. Under regular conditions, both methods are painless and do not induce adverse events. Globally, CSSS appears more precise and informative than the regular SACD stripping. PMID:25767402

Social worker assessment of bad news delivery by emergency medicine residents: a novel direct-observation milestone assessment.

PubMed

Min, Alice Ann; Spear-Ellinwood, Karen; Berman, Melissa; Nisson, Peyton; Rhodes, Suzanne Michelle

2016-09-01

The skill of delivering bad news is difficult to teach and evaluate. Residents may practice in simulated settings; however, this may not translate to confidence or competence during real experiences. We investigated the acceptability and feasibility of social workers as evaluators of residents' delivery of bad news during patient encounters, and assessed the attitudes of both groups regarding this process. From August 2013 to June 2014, emergency medicine residents completed self-assessments after delivering bad news. Social workers completed evaluations after observing these conversations. The Assessment tools were designed by modifying the global Breaking Bad News Assessment Scale. Residents and social workers completed post-study surveys. 37 evaluations were received, 20 completed by social workers and 17 resident self-evaluations. Social workers reported discussing plans with residents prior to conversations 90 % of the time (18/20, 95 % CI 64.5, 97.8). Social workers who had previously observed the resident delivering bad news reported that the resident was more skilled on subsequent encounters 90 % of the time (95 % CI 42.2, 99). Both social workers and residents felt that prior training or experience was important. First-year residents valued advice from social workers less than advice from attending physicians, whereas more experienced residents perceived advice from social workers to be equivalent with that of attending physicians (40 versus 2.9 %, p = 0.002). Social worker assessment of residents' abilities to deliver bad news is feasible and acceptable to both groups. This formalized self-assessment and evaluation process highlights the importance of social workers' involvement in delivery of bad news, and the teaching of this skill. This method may also be used as direct-observation for resident milestone assessment.

Accuracy of quantitative visual soil assessment

NASA Astrophysics Data System (ADS)

van Leeuwen, Maricke; Heuvelink, Gerard; Stoorvogel, Jetse; Wallinga, Jakob; de Boer, Imke; van Dam, Jos; van Essen, Everhard; Moolenaar, Simon; Verhoeven, Frank; Stoof, Cathelijne

2016-04-01

Visual soil assessment (VSA) is a method to assess soil quality visually, when standing in the field. VSA is increasingly used by farmers, farm organisations and companies, because it is rapid and cost-effective, and because looking at soil provides understanding about soil functioning. Often VSA is regarded as subjective, so there is a need to verify VSA. Also, many VSAs have not been fine-tuned for contrasting soil types. This could lead to wrong interpretation of soil quality and soil functioning when contrasting sites are compared to each other. We wanted to assess accuracy of VSA, while taking into account soil type. The first objective was to test whether quantitative visual field observations, which form the basis in many VSAs, could be validated with standardized field or laboratory measurements. The second objective was to assess whether quantitative visual field observations are reproducible, when used by observers with contrasting backgrounds. For the validation study, we made quantitative visual observations at 26 cattle farms. Farms were located at sand, clay and peat soils in the North Friesian Woodlands, the Netherlands. Quantitative visual observations evaluated were grass cover, number of biopores, number of roots, soil colour, soil structure, number of earthworms, number of gley mottles and soil compaction. Linear regression analysis showed that four out of eight quantitative visual observations could be well validated with standardized field or laboratory measurements. The following quantitative visual observations correlated well with standardized field or laboratory measurements: grass cover with classified images of surface cover; number of roots with root dry weight; amount of large structure elements with mean weight diameter; and soil colour with soil organic matter content. Correlation coefficients were greater than 0.3, from which half of the correlations were significant. For the reproducibility study, a group of 9 soil scientists and 7 farmers carried out quantitative visual observations all independently from each other. All observers assessed five sites, having a sand, peat or clay soil. For almost all quantitative visual observations the spread of observed values was low (coefficient of variation < 1.0), except for the number of biopores and gley mottles. Furthermore, farmers' observed mean values were significantly higher than soil scientists' mean values, for soil structure, amount of gley mottles and compaction. This study showed that VSA could be a valuable tool to assess soil quality. Subjectivity, due to the background of the observer, might influence the outcome of visual assessment of some soil properties. In countries where soil analyses can easily be carried out, VSA might be a good replenishment to available soil chemical analyses, and in countries where it is not feasible to carry out soil analyses, VSA might be a good start to assess soil quality.

Comparing different methods for assessing contaminant bioavailability during sediment remediation.

PubMed

Jia, Fang; Liao, Chunyang; Xue, Jiaying; Taylor, Allison; Gan, Jay

2016-12-15

Sediment contamination by persistent organic pollutants from historical episodes is widespread and remediation is often needed to clean up severely contaminated sites. Measuring contaminant bioavailability in a before-and-after manner lends to improved assessment of remediation effectiveness. However, a number of bioavailability measurement methods have been developed, posing a challenge in method selection for practitioners. In this study, three different bioavailability measurement methods, i.e., solid phase microextraction (SPME), Tenax desorption, and isotope dilution method (IDM), were compared in evaluating changes in bioavailability of DDT and its degradates in sediment following simulated remediation treatments. When compared to the unamended sediments, all three methods predicted essentially the same degrees of changes in bioavailability after amendment with activated carbon, charcoal or sand. After normalizing over the unamended control, measurements by different methods were linearly correlated with each other, with slopes close to 1. The same observation was further made with a Superfund site marine sediment. This finding suggests that different methods may be used in evaluating remediation efficiency. However, Tenax desorption or IDM consistently offered better sensitivity than SPME in detecting bioavailability changes. Results from this study highlight the value of considering bioavailability when evaluating remediation effectiveness and provide guidance on the selection of bioavailability measurement methods in such assessments. Copyright © 2016 Elsevier B.V. All rights reserved.

The use of holographic interferometry for measurements of temperature in a rectangular heat pipe. M.S. Thesis

NASA Technical Reports Server (NTRS)

Marn, Jure

1989-01-01

Holographic interferometry is a nonintrusive method and as such possesses considerable advantages such as not disturbing the velocity and temperature field by creating obstacles which would alter the flow field. These optical methods have disadvantages as well. Holography, as one of the interferometry methods, retains the accuracy of older methods, and at the same time eliminates the system error of participating components. The holographic interferometry consists of comparing the objective beam with the reference beam and observing the difference in lengths of optical paths, which can be observed during the propagation of the light through a medium with locally varying refractive index. Thus, change in refractive index can be observed as a family of nonintersecting surfaces in space (wave fronts). The object of the investigation was a rectangular heat pipe. The goal was to measure temperatures in the heat pipe, which yields data for computer code or model assessment. The results were obtained by calculating the temperatures by means of finite fringes.

Doubly labelled water assessment of energy expenditure: principle, practice, and promise.

PubMed

Westerterp, Klaas R

2017-07-01

The doubly labelled water method for the assessment of energy expenditure was first published in 1955, application in humans started in 1982, and it has become the gold standard for human energy requirement under daily living conditions. The method involves enriching the body water of a subject with heavy hydrogen ( 2 H) and heavy oxygen ( 18 O), and then determining the difference in washout kinetics between both isotopes, being a function of carbon dioxide production. In practice, subjects get a measured amount of doubly labelled water ( 2 H 2 18 O) to increase background enrichment of body water for 18 O of 2000 ppm with at least 180 ppm and background enrichment of body water for 2 H of 150 ppm with 120 ppm. Subsequently, the difference between the apparent turnover rates of the hydrogen and oxygen of body water is assessed from blood-, saliva-, or urine samples, collected at the start and end of the observation interval of 1-3 weeks. Samples are analyzed for 18 O and 2 H with isotope ratio mass spectrometry. The doubly labelled water method is the indicated method to measure energy expenditure in any environment, especially with regard to activity energy expenditure, without interference with the behavior of the subjects. Applications include the assessment of energy requirement from total energy expenditure, validation of dietary assessment methods and validation of physical activity assessment methods with doubly labelled water measured energy expenditure as reference, and studies on body mass regulation with energy expenditure as a determinant of energy balance.

Best (but oft-forgotten) practices: propensity score methods in clinical nutrition research.

PubMed

Ali, M Sanni; Groenwold, Rolf Hh; Klungel, Olaf H

2016-08-01

In observational studies, treatment assignment is a nonrandom process and treatment groups may not be comparable in their baseline characteristics, a phenomenon known as confounding. Propensity score (PS) methods can be used to achieve comparability of treated and nontreated groups in terms of their observed covariates and, as such, control for confounding in estimating treatment effects. In this article, we provide a step-by-step guidance on how to use PS methods. For illustrative purposes, we used simulated data based on an observational study of the relation between oral nutritional supplementation and hospital length of stay. We focused on the key aspects of PS analysis, including covariate selection, PS estimation, covariate balance assessment, treatment effect estimation, and reporting. PS matching, stratification, covariate adjustment, and weighting are discussed. R codes and example data are provided to show the different steps in a PS analysis. © 2016 American Society for Nutrition.

A comparative experimental evaluation of uncertainty estimation methods for two-component PIV

NASA Astrophysics Data System (ADS)

Boomsma, Aaron; Bhattacharya, Sayantan; Troolin, Dan; Pothos, Stamatios; Vlachos, Pavlos

2016-09-01

Uncertainty quantification in planar particle image velocimetry (PIV) measurement is critical for proper assessment of the quality and significance of reported results. New uncertainty estimation methods have been recently introduced generating interest about their applicability and utility. The present study compares and contrasts current methods, across two separate experiments and three software packages in order to provide a diversified assessment of the methods. We evaluated the performance of four uncertainty estimation methods, primary peak ratio (PPR), mutual information (MI), image matching (IM) and correlation statistics (CS). The PPR method was implemented and tested in two processing codes, using in-house open source PIV processing software (PRANA, Purdue University) and Insight4G (TSI, Inc.). The MI method was evaluated in PRANA, as was the IM method. The CS method was evaluated using DaVis (LaVision, GmbH). Utilizing two PIV systems for high and low-resolution measurements and a laser doppler velocimetry (LDV) system, data were acquired in a total of three cases: a jet flow and a cylinder in cross flow at two Reynolds numbers. LDV measurements were used to establish a point validation against which the high-resolution PIV measurements were validated. Subsequently, the high-resolution PIV measurements were used as a reference against which the low-resolution PIV data were assessed for error and uncertainty. We compared error and uncertainty distributions, spatially varying RMS error and RMS uncertainty, and standard uncertainty coverages. We observed that qualitatively, each method responded to spatially varying error (i.e. higher error regions resulted in higher uncertainty predictions in that region). However, the PPR and MI methods demonstrated reduced uncertainty dynamic range response. In contrast, the IM and CS methods showed better response, but under-predicted the uncertainty ranges. The standard coverages (68% confidence interval) ranged from approximately 65%-77% for PPR and MI methods, 40%-50% for IM and near 50% for CS. These observations illustrate some of the strengths and weaknesses of the methods considered herein and identify future directions for development and improvement.

Assessing mobile food vendors (a.k.a. street food vendors)—methods, challenges, and lessons learned for future food-environment research

PubMed Central

Lucan, Sean C.; Varona, Monica; Maroko, Andrew R.; Bumol, Joel; Torrens, Luis; Wylie-Rosett, Judith

2013-01-01

OBJECTIVES Mobile food vendors (also known as street food vendors) may be important sources of food, particularly in minority and low-income communities. Unfortunately, there are no good data sources on where, when, or what vendors sell. The lack of a published assessment method may contribute to the relative exclusion of mobile food vendors from existing food-environment research. A goal of this study was to develop, pilot, and troubleshoot a method to assess mobile food vendors. STUDY DESIGN Cross-sectional assessment of mobile food vendors through direct observations and brief interviews. METHODS Using printed maps, investigators canvassed all streets in Bronx County, NY (excluding highways but including entrance and exit ramps) in 2010, looking for mobile food vendors. For each vendor identified, researchers recorded a unique identifier, the vendor’s location, and direct observations. Investigators also recorded vendors answers to where, when, and what they sold. RESULTS Of 372 identified vendors, 38% did not answer brief-interview questions (19% were “in transit”, 15% refused; others were absent from their carts/trucks/stands or with customers). About 7% of vendors who ultimately answered questions were reluctant to engage with researchers. Some vendors expressed concerns about regulatory authority; only 34% of vendors had visible permits or licenses and many vendors had improvised illegitimate-appearing set-ups. The majority of vendors (75% of those responding) felt most comfortable speaking Spanish; 5% preferred other non-English languages. Nearly a third of vendors changed selling locations (streets, neighborhoods, boroughs) day-to-day or even within a given day. There was considerable variability in times (hours, days, months) in which vendors reported doing business; for 86% of vendors, weather was a deciding factor. CONCLUSIONS Mobile food vendors have a variable and fluid presence in an urban environment. Variability in hours and locations, having most comfort with languages other than English, and reluctance to interact with individuals gathering data are principal challenges to assessment. Strategies to address assessment challenges that emerged form this project may help make mobile-vendor assessments more routine in food-environment research. PMID:23891280

Proposal for a new categorization of aseptic processing facilities based on risk assessment scores.

PubMed

Katayama, Hirohito; Toda, Atsushi; Tokunaga, Yuji; Katoh, Shigeo

2008-01-01

Risk assessment of aseptic processing facilities was performed using two published risk assessment tools. Calculated risk scores were compared with experimental test results, including environmental monitoring and media fill run results, in three different types of facilities. The two risk assessment tools used gave a generally similar outcome. However, depending on the tool used, variations were observed in the relative scores between the facilities. For the facility yielding the lowest risk scores, the corresponding experimental test results showed no contamination, indicating that these ordinal testing methods are insufficient to evaluate this kind of facility. A conventional facility having acceptable aseptic processing lines gave relatively high risk scores. The facility showing a rather high risk score demonstrated the usefulness of conventional microbiological test methods. Considering the significant gaps observed in calculated risk scores and in the ordinal microbiological test results between advanced and conventional facilities, we propose a facility categorization based on risk assessment. The most important risk factor in aseptic processing is human intervention. When human intervention is eliminated from the process by advanced hardware design, the aseptic processing facility can be classified into a new risk category that is better suited for assuring sterility based on a new set of criteria rather than on currently used microbiological analysis. To fully benefit from advanced technologies, we propose three risk categories for these aseptic facilities.

Impulsivity-hyperactivity and subtypes of aggression in early childhood: an observational and short-term longitudinal study.

PubMed

Ostrov, Jamie M; Godleski, Stephanie A

2009-08-01

This short-term longitudinal study (N = 112) was conducted to explore the concurrent and prospective associations between teacher-reported impulsive-hyperactive behavior and observed relational and physical aggression during early childhood (M = 45.54 months old, SD = 9.07). Multiple informants and methods including observational methods (i.e., 160 min per child) were used to assess aggression and impulsivity-hyperactivity. All measures were found to be valid and reliable. Prospective hierarchical regression analyses revealed that impulsivity-hyperactivity was associated with increases in observed physical aggression across time, controlling for initial relational aggression and gender. These findings add to the growing developmental psychopathology literature that suggests that distinguishing between subtypes of aggression during early childhood may be important for understanding the course of impulsivity-hyperactivity in young children. Implications for practice are discussed.

Self-report of tobacco use status: comparison of paper-based questionnaire, online questionnaire, and direct face-to-face interview--implications for meaningful use.

PubMed

Steffen, Mark W; Murad, Mohammad Hassan; Hays, J Taylor; Newcomb, Richard D; Molella, Robin G; Cha, Stephen S; Hagen, Philip T

2014-06-01

Identifying tobacco use status is essential to address use and provide resources to help patients quit. Being able to collect this information in an electronic format will become increasingly important, as the Centers for Medicare and Medicaid Services has included the assessment of tobacco use as part of its Stage 1 Meaningful Use criteria. The objective was to compare the accuracy of online vs. paper assessment methods to ascertain cigarette smoking status using a face-to-face structured interview as the gold standard. This was a retrospective analysis of a stratified opportunity sample of consecutive patients, reporting in 2010 for a periodic health evaluation, who completed either a scannable paper-based form or an online questionnaire and underwent a standardized rooming interview. Compared with face-to-face structured interview, the overall observed agreement and kappa coefficient for both methods combined (paper and online) were 97.7% and 0.69 (95% confidence interval (CI) 0.51-0.86) . For the online form they were 97.4% and 0.61 (95% CI 0.33-0.90), and for the paper form they were 97.9% and 0.75 (95% CI 0.54-0.96). There was no statistically significant difference in agreement between the online and paper-based methods (P=0.76) compared with a face-to-face structured interview. Online assessment of tobacco use status is as accurate as a paper questionnaire, and both methods have greater than 97% observed agreement with a face-to-face structured interview. The use of online assessment of tobacco use status has several advantages and more widespread use should be explored.

Assessment of early attrition using an ordinary flatbed scanner.

PubMed

Van't Spijker, Arie; Kreulen, Cees M; Bronkhorst, Ewald M; Creugers, Nico H J

2012-07-01

The aim of this study was to assess a two-dimensional method to monitor occlusal tooth wear quantitatively using a commercially available ordinary flatbed scanner. A flatbed scanner, measuring software and gypsum casts were used. In Part I, two observers (A and B) independently traced scans of marked wear facets of ten sets of casts in two sessions (test and retest). In Part II, three other sets of casts were duplicated and two observers (C and D) marked wear facets and traced the scanned images independently. Intra- and inter-observer agreement was determined comparing measured values (mm(2)) in paired T-tests. Duplicate measurement errors (DME) were calculated. In Part I the test and retest values (10 casts, 218 teeth) of observer A and B did not differ significantly (A: p = 0.289; B: p = 0.666); correlation coefficients were 0.998 (A) and 0.999 (B). "Tracing wear facets" showed a DME of 0.30 mm(2) for observer A and 0.15 mm(2) for observer B. In Part II, assessment of 70 teeth resulted in correlation coefficients of 0.994 for observer C and 0.997 for observer D; no differences between test and retest values were found for C (p = 0.061), although D differed significantly (p = 0.000). The DME for "marking and tracing wear facets" was 0.39 mm(2) (C) and 0.27 mm(2) (D). DME for inter-observer agreement were 0.45 mm(2) (test) and 0.42 mm(2) (re-test). We conclude that marking and tracing of occlusal wear facets to assess occlusal tooth wear quantitatively can be done accurately and reproducibly. Copyright © 2012 Elsevier Ltd. All rights reserved.

Non-invasive diagnosis of hepatitis B virus-related cirrhosis

PubMed Central

Lee, Sangheun; Kim, Do Young

2014-01-01

Chronic hepatitis B (CHB) infection is a major public health problem associated with significant morbidity and mortality worldwide. Twenty-three percent of patients with CHB progress naturally to liver cirrhosis, which was earlier thought to be irreversible. However, it is now known that cirrhosis can in fact be reversed by treatment with oral anti-nucleotide drugs. Thus, early and accurate diagnosis of cirrhosis is important to allow an appropriate treatment strategy to be chosen and to predict the prognosis of patients with CHB. Liver biopsy is the reference standard for assessment of liver fibrosis. However, the method is invasive, and is associated with pain and complications that can be fatal. In addition, intra- and inter-observer variability compromises the accuracy of liver biopsy data. Only small tissue samples are obtained and fibrosis is heterogeneous in such samples. This confounds the two types of observer variability mentioned above. Such limitations have encouraged development of non-invasive methods for assessment of fibrosis. These include measurements of serum biomarkers of fibrosis; and assessment of liver stiffness via transient elastography, acoustic radiation force impulse imaging, real-time elastography, or magnetic resonance elastography. Although significant advances have been made, most work to date has addressed the diagnostic utility of these techniques in the context of cirrhosis caused by chronic hepatitis C infection. In the present review, we examine the advantages afforded by use of non-invasive methods to diagnose cirrhosis in patients with CHB infections and the utility of such methods in clinical practice. PMID:24574713

Inter-observer variability within BI-RADS and RANZCR mammographic density assessment schemes

NASA Astrophysics Data System (ADS)

Damases, Christine N.; Mello-Thoms, Claudia; McEntee, Mark F.

2016-03-01

This study compares variability associated with two visual mammographic density (MD) assessment methods using two separate samples of radiologists. The image test-set comprised of images obtained from 20 women (age 42-89 years). The images were assessed for their MD by twenty American Board of Radiology (ABR) examiners and twenty-six radiologists registered with the Royal Australian and New Zealand College of Radiologists (RANZCR). Images were assessed using the same technology and conditions, however the ABR radiologists used the BI-RADS and the RANZCR radiologists used the RANZCR breast density synoptic. Both scales use a 4-point assessment. The images were then grouped as low- and high-density; low including BIRADS 1 and 2 or RANZCR 1 and 2 and high including BI-RADS 3 and 4 or RANZCR 3 and 4. Four-point BI-RADS and RANZCR showed no or negligible correlation (ρ=-0.029 p<0.859). The average inter-observer agreement on the BI-RADS scale had a Kappa of 0.565; [95% CI = 0.519 - 0.610], and ranged between 0.328-0.669 while the inter-observer agreement using the RANZCR scale had a Kappa of 0.360; [95% CI = 0.308 - 0.412] and a range of 0.078-0.499. Our findings show a wider range of inter-observer variability among RANZCR registered radiologists than the ABR examiners.

Quantile-based Bayesian maximum entropy approach for spatiotemporal modeling of ambient air quality levels.

PubMed

Yu, Hwa-Lung; Wang, Chih-Hsin

2013-02-05

Understanding the daily changes in ambient air quality concentrations is important to the assessing human exposure and environmental health. However, the fine temporal scales (e.g., hourly) involved in this assessment often lead to high variability in air quality concentrations. This is because of the complex short-term physical and chemical mechanisms among the pollutants. Consequently, high heterogeneity is usually present in not only the averaged pollution levels, but also the intraday variance levels of the daily observations of ambient concentration across space and time. This characteristic decreases the estimation performance of common techniques. This study proposes a novel quantile-based Bayesian maximum entropy (QBME) method to account for the nonstationary and nonhomogeneous characteristics of ambient air pollution dynamics. The QBME method characterizes the spatiotemporal dependence among the ambient air quality levels based on their location-specific quantiles and accounts for spatiotemporal variations using a local weighted smoothing technique. The epistemic framework of the QBME method can allow researchers to further consider the uncertainty of space-time observations. This study presents the spatiotemporal modeling of daily CO and PM10 concentrations across Taiwan from 1998 to 2009 using the QBME method. Results show that the QBME method can effectively improve estimation accuracy in terms of lower mean absolute errors and standard deviations over space and time, especially for pollutants with strong nonhomogeneous variances across space. In addition, the epistemic framework can allow researchers to assimilate the site-specific secondary information where the observations are absent because of the common preferential sampling issues of environmental data. The proposed QBME method provides a practical and powerful framework for the spatiotemporal modeling of ambient pollutants.

Association between Insulin Resistance and Cardiovascular Risk Factors in Polycystic Ovary Syndrome Patients.

PubMed

Wanderley, Miriam da Silva; Pereira, Lara Cristina Ribeiro; Santos, Carla Borges; Cunha, Vinícius Santos da; Neves, Mariam Viviane Jovino

2018-04-01

 To analyze the association between the indirect methods of evaluating insulin resistance (IR) and blood pressure, anthropometric and biochemical parameters in a population of polycystic ovary syndrome (PCOS) patients.  Cross-sectional study performed at the Hospital Universitário de Brasília (HUB, in the Portuguese acronym) involving PCOS patients diagnosed from January 2011 to January 2013. Four indirect methods, namely, fasting blood insulin level, fasting glucose/insulin ratio (G/I), homeostatic model-assessment-insulin resistance (HOMA-IR), and the quantitative insulin sensitivity check index (QUICKI), were used to obtain the IR diagnosis. The data were analyzed using the test of proportions, the Chi-square test, and Fisher exact test, when indicated.  Out of the 83 patients assessed, aged 28.79 ± 5.85, IR was found in 51.81-66.2% of them using the G/I ratio and the QUICKI, respectively. The test of proportions did not show a significant difference between the methods analyzed. The proportion of IR diagnoses was statistically higher in obese women than in women with normal body mass index (BMI). We observed a statistically significant association between all the methods for diagnosing IR and BMI, waist circumference (WC) and lipid accumulation product (LAP). With regards to arterial hypertension (AH), we observed a significant association according to three methods, with the exception of the ratio G/I.  Insulin resistance prevalence varied according to the diagnostic method employed, with no statistical difference between them. The proportion of IR diagnoses was statistically higher in obese women than in women with normal BMI. We observed a significant association between IR and WC, BMI, LAP, as well as dyslipidemia and AH in a high proportion of patients. Thieme Revinter Publicações Ltda Rio de Janeiro, Brazil.

Wisdom of crowds for robust gene network inference

PubMed Central

Marbach, Daniel; Costello, James C.; Küffner, Robert; Vega, Nicci; Prill, Robert J.; Camacho, Diogo M.; Allison, Kyle R.; Kellis, Manolis; Collins, James J.; Stolovitzky, Gustavo

2012-01-01

Reconstructing gene regulatory networks from high-throughput data is a long-standing problem. Through the DREAM project (Dialogue on Reverse Engineering Assessment and Methods), we performed a comprehensive blind assessment of over thirty network inference methods on Escherichia coli, Staphylococcus aureus, Saccharomyces cerevisiae, and in silico microarray data. We characterize performance, data requirements, and inherent biases of different inference approaches offering guidelines for both algorithm application and development. We observe that no single inference method performs optimally across all datasets. In contrast, integration of predictions from multiple inference methods shows robust and high performance across diverse datasets. Thereby, we construct high-confidence networks for E. coli and S. aureus, each comprising ~1700 transcriptional interactions at an estimated precision of 50%. We experimentally test 53 novel interactions in E. coli, of which 23 were supported (43%). Our results establish community-based methods as a powerful and robust tool for the inference of transcriptional gene regulatory networks. PMID:22796662

Performance assessment in algebra learning process

NASA Astrophysics Data System (ADS)

Lestariani, Ida; Sujadi, Imam; Pramudya, Ikrar

2017-12-01

The purpose of research to describe the implementation of performance assessment on algebra learning process. The subject in this research is math educator of SMAN 1 Ngawi class X. This research includes descriptive qualitative research type. Techniques of data collecting are done by observation method, interview, and documentation. Data analysis technique is done by data reduction, data presentation, and conclusion. The results showed any indication that the steps taken by the educator in applying the performance assessment are 1) preparing individual worksheets and group worksheets, 2) preparing rubric assessments for independent worksheets and groups and 3) making performance assessments rubric to learners’ performance results with individual or groups task.

Intercomparison, interpretation, and assessment of spring phenology in North America estimated from remote sensing for 1982-2006

USGS Publications Warehouse

White, M.A.; de Beurs, K. M.; Didan, K.; Inouye, D.W.; Richardson, A.D.; Jensen, O.P.; O'Keefe, J.; Zhang, G.; Nemani, R.R.; van, Leeuwen; Brown, Jesslyn F.; de Wit, A.; Schaepman, M.; Lin, X.; Dettinger, M.; Bailey, A.S.; Kimball, J.; Schwartz, M.D.; Baldocchi, D.D.; Lee, J.T.; Lauenroth, W.K.

2009-01-01

Shifts in the timing of spring phenology are a central feature of global change research. Long-term observations of plant phenology have been used to track vegetation responses to climate variability but are often limited to particular species and locations and may not represent synoptic patterns. Satellite remote sensing is instead used for continental to global monitoring. Although numerous methods exist to extract phenological timing, in particular start-of-spring (SOS), from time series of reflectance data, a comprehensive intercomparison and interpretation of SOS methods has not been conducted. Here, we assess 10 SOS methods for North America between 1982 and 2006. The techniques include consistent inputs from the 8 km Global Inventory Modeling and Mapping Studies Advanced Very High Resolution Radiometer NDVIg dataset, independent data for snow cover, soil thaw, lake ice dynamics, spring streamflow timing, over 16 000 individual measurements of ground-based phenology, and two temperature-driven models of spring phenology. Compared with an ensemble of the 10 SOS methods, we found that individual methods differed in average day-of-year estimates by ±60 days and in standard deviation by ±20 days. The ability of the satellite methods to retrieve SOS estimates was highest in northern latitudes and lowest in arid, tropical, and Mediterranean ecoregions. The ordinal rank of SOS methods varied geographically, as did the relationships between SOS estimates and the cryospheric/hydrologic metrics. Compared with ground observations, SOS estimates were more related to the first leaf and first flowers expanding phenological stages. We found no evidence for time trends in spring arrival from ground- or model-based data; using an ensemble estimate from two methods that were more closely related to ground observations than other methods, SOS trends could be detected for only 12% of North America and were divided between trends towards both earlier and later spring.

Postoperative pain assessment using four behavioral scales in Pakistani children undergoing elective surgery

PubMed Central

Shamim, Faisal; Ullah, Hameed; Khan, Fauzia A.

2015-01-01

Background: Several measurement tools have been used for assessment of postoperative pain in pediatric patients. Self-report methods have limitations in younger children and parent, nurse or physician assessment can be used as a surrogate measure. These tools should be tested in different cultures as pain can be influenced by sociocultural factors. The objective was to assess the inter-rater agreement on four different behavioral pain assessment scales in our local population. Materials and Methods: This prospective, descriptive, observational study was conducted in Pakistan. American Society of Anesthesiologists I and II children, 3-7 years of age, undergoing elective surgery were enrolled. Four pain assessment scales were used, Children's Hospital of Eastern Ontario Pain Scale (CHEOPS), Toddler Preschool Postoperative Pain Scale (TPPPS), objective pain scale (OPS), and Face, Legs, Activity, Cry, Consolability (FLACC). After 15 and 60 min of arrival in the postanesthesia care unit (PACU), each child evaluated his/her postoperative pain by self-reporting and was also independently assessed by the PACU nurse, PACU anesthetist and the parent. The sensitivity and specificity of the responses of the four pain assessment scales were compared to the response of the child. Results: At 15 min, sensitivity and specificity were >60% for doctors and nurses on FLACC, OPS, and CHEOPS scales and for FLACC and CHEOPS scale for the parents. Parents showed poor agreement on OPS and TPPS. At 60 min, sensitivity was poor on the OPS scale by all three observers. Nurses showed a lower specificity on FLACC tool. Parents had poor specificity on CHEOPS and rate of false negatives was high with TPPS. Conclusions: We recommend the use of FLACC scale for assessment by parents, nurses, and doctors in Pakistani children aged between 3 and 7. PMID:25829906

Measurement properties of existing clinical assessment methods evaluating scapular positioning and function. A systematic review.

PubMed

Larsen, Camilla Marie; Juul-Kristensen, Birgit; Lund, Hans; Søgaard, Karen

2014-10-01

The aims were to compile a schematic overview of clinical scapular assessment methods and critically appraise the methodological quality of the involved studies. A systematic, computer-assisted literature search using Medline, CINAHL, SportDiscus and EMBASE was performed from inception to October 2013. Reference lists in articles were also screened for publications. From 50 articles, 54 method names were identified and categorized into three groups: (1) Static positioning assessment (n = 19); (2) Semi-dynamic (n = 13); and (3) Dynamic functional assessment (n = 22). Fifteen studies were excluded for evaluation due to no/few clinimetric results, leaving 35 studies for evaluation. Graded according to the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN checklist), the methodological quality in the reliability and validity domains was "fair" (57%) to "poor" (43%), with only one study rated as "good". The reliability domain was most often investigated. Few of the assessment methods in the included studies that had "fair" or "good" measurement property ratings demonstrated acceptable results for both reliability and validity. We found a substantially larger number of clinical scapular assessment methods than previously reported. Using the COSMIN checklist the methodological quality of the included measurement properties in the reliability and validity domains were in general "fair" to "poor". None were examined for all three domains: (1) reliability; (2) validity; and (3) responsiveness. Observational evaluation systems and assessment of scapular upward rotation seem suitably evidence-based for clinical use. Future studies should test and improve the clinimetric properties, and especially diagnostic accuracy and responsiveness, to increase utility for clinical practice.

Deriving Childhood Temperament Measures from Emotion-eliciting Behavioral Episodes: Scale Construction and Initial Validation

PubMed Central

Gagne, Jeffrey R.; Van Hulle, Carol A.; Aksan, Nazan; Essex, Marilyn J.; Goldsmith, H. Hill

2010-01-01

The authors describe the development and initial validation of a home-based version of the Laboratory Temperament Assessment Battery (Lab-TAB), which was designed to assess childhood temperament using a comprehensive series of emotion-eliciting behavioral episodes. This paper provides researchers with general guidelines for assessing specific behaviors using the Lab-TAB and for forming behavioral composites that correspond to commonly researched temperament dimensions. We used mother ratings and independent post-visit observer ratings to provide validity evidence in a community sample of 4.5 year-old children. 12 Lab-TAB behavioral episodes were employed, yielding 24 within-episode temperament components that collapsed into 9 higher-level composites (Anger, Sadness, Fear, Shyness, Positive Expression, Approach, Active Engagement, Persistence, and Inhibitory Control). These dimensions of temperament are similar to those found in questionnaire-based assessments. Correlations among the 9 composites were low to moderate, suggesting relative independence. As expected, agreement between Lab-TAB measures and post-visit observer ratings was stronger than agreement between the Lab-TAB and mother questionnaire. However, for Active Engagement and Shyness, mother ratings did predict child behavior in the Lab-TAB quite well. Findings demonstrate the feasibility of emotion-eliciting temperament assessment methodologies, suggest appropriate methods for data aggregation into trait-level constructs, and set some expectations for associations between Lab-TAB dimensions and the degree of cross-method convergence between the Lab-TAB and other commonly used temperament assessments. PMID:21480723

Evaluation of surgical training in the era of simulation

PubMed Central

Shaharan, Shazrinizam; Neary, Paul

2014-01-01

AIM: To assess where we currently stand in relation to simulator-based training within modern surgical training curricula. METHODS: A systematic literature search was performed in PubMed database using keywords “simulation”, “skills assessment” and “surgery”. The studies retrieved were examined according to the inclusion and exclusion criteria. Time period reviewed was 2000 to 2013. The methodology of skills assessment was examined. RESULTS: Five hundred and fifteen articles focussed upon simulator based skills assessment. Fifty-two articles were identified that dealt with technical skills assessment in general surgery. Five articles assessed open skills, 37 assessed laparoscopic skills, 4 articles assessed both open and laparoscopic skills and 6 assessed endoscopic skills. Only 12 articles were found to be integrating simulators in the surgical training curricula. Observational assessment tools, in the form of Objective Structured Assessment of Technical Skills (OSATS) dominated the literature. CONCLUSION: Observational tools such as OSATS remain the top assessment instrument in surgical training especially in open technical skills. Unlike the aviation industry, simulation based assessment has only now begun to cross the threshold of incorporation into mainstream skills training. Over the next decade we expect the promise of simulator-based training to finally take flight and begin an exciting voyage of discovery for surgical trainees. PMID:25228946

An easy and inexpensive method for quantitative analysis of endothelial damage by using vital dye staining and Adobe Photoshop software.

PubMed

Saad, Hisham A; Terry, Mark A; Shamie, Neda; Chen, Edwin S; Friend, Daniel F; Holiman, Jeffrey D; Stoeger, Christopher

2008-08-01

We developed a simple, practical, and inexpensive technique to analyze areas of endothelial cell loss and/or damage over the entire corneal area after vital dye staining by using a readily available, off-the-shelf, consumer software program, Adobe Photoshop. The purpose of this article is to convey a method of quantifying areas of cell loss and/or damage. Descemet-stripping automated endothelial keratoplasty corneal transplant surgery was performed by using 5 precut corneas on a human cadaver eye. Corneas were removed and stained with trypan blue and alizarin red S and subsequently photographed. Quantitative assessment of endothelial damage was performed by using Adobe Photoshop 7.0 software. The average difference for cell area damage for analyses performed by 1 observer twice was 1.41%. For analyses performed by 2 observers, the average difference was 1.71%. Three masked observers were 100% successful in matching the randomized stained corneas to their randomized processed Adobe images. Vital dye staining of corneal endothelial cells can be combined with Adobe Photoshop software to yield a quantitative assessment of areas of acute endothelial cell loss and/or damage. This described technique holds promise for a more consistent and accurate method to evaluate the surgical trauma to the endothelial cell layer in laboratory models. This method of quantitative analysis can probably be generalized to any area of research that involves areas that are differentiated by color or contrast.

Comparison of automated home-cage monitoring systems: emphasis on feeding behaviour, activity and spatial learning following pharmacological interventions.

PubMed

Robinson, Lianne; Riedel, Gernot

2014-08-30

Different automated systems have been developed to facilitate long-term and continuous assessment of behaviours including locomotor activity, feeding behaviour and circadian activity. This study assessed the effectiveness of three different observation systems as methods for determining strain and pharmacological induced differences in locomotor activity, feeding behaviour and spatial learning. The effect of the CB1 antagonist AM251 on feeding behaviour was determined in the PhenoMaster and PhenoTyper. Next, effects of cholinergic (scopolamine) and glutamatergic (Phenylcyclidine, PCP) receptor antagonism and dopaminergic agonism (apomorphine) on activity were assessed in the PhenoTyper and IntelliCage. Finally, the IntelliCage was utilised to determine differences in activity and spatial learning of C57BL/6 and DBA/2 mouse strains following pharmacological intervention. AM251 induced a suppression of food intake, feeding behaviour and a reduction in body weight in both the PhenoTyper and PhenoMaster. Apomorphine reduced activity in both the PhenoTyper and IntelliCage. Whereas, decreased activity was evident with PCP in the PhenoTyper, but not IntelliCage and Scopolamine induced a trend towards elevated levels of activity in the IntelliCage but not PhenoTyper. Strain differences in activity and spatial learning were also evident, with increased corner visits and drug induced impairments only observed with C57BL/6 mice. The automated home cage observation systems determined similar drug and strain effects on behaviour to those observed using traditional methods. All three observation systems reported drug-induced changes in behaviour however, they differ in their application of spatial learning tasks and utilisation of single versus group housed recordings. Copyright © 2014 Elsevier B.V. All rights reserved.

Initial assessment of image quality for low-dose PET: evaluation of lesion detectability

NASA Astrophysics Data System (ADS)

Schaefferkoetter, Joshua D.; Yan, Jianhua; Townsend, David W.; Conti, Maurizio

2015-07-01

In the context of investigating the potential of low-dose PET imaging for screening applications, we developed methods to assess small lesion detectability as a function of the number of counts in the scan. We present here our methods and preliminary validation using tuberculosis cases. FDG-PET data from seventeen patients presenting diffuse hyper-metabolic lung lesions were selected for the study, to include a wide range of lesion sizes and contrasts. Reduced doses were simulated by randomly discarding events in the PET list mode, and ten realizations at each simulated dose were generated and reconstructed. The data were grouped into 9 categories determined by the number of included true events, from  >40 M to  <250 k counts. The images reconstructed from the original full statistical set were used to identify lung lesions, and each was, at every simulated dose, quantified by 6 parameters: lesion metabolic volume, lesion-to-background contrast, mean lesion tracer uptake, standard deviation of activity measurements (across realizations), lesion signal-to-noise ratio (SNR), and Hotelling observer SNR. Additionally, a lesion-detection task including 550 images was presented to several experienced image readers for qualitative assessment. Human observer performances were ranked using receiver operating characteristic analysis. The observer results were correlated with the lesion image measurements and used to train mathematical observer models. Absolute sensitivities and specificities of the human observers, as well as the area under the ROC curve, showed clustering and performance similarities among images produced from 5 million or greater counts. The results presented here are from a clinically realistic but highly constrained experiment, and more work is needed to validate these findings with a larger patient population.

Initial assessment of image quality for low-dose PET: evaluation of lesion detectability.

PubMed

Schaefferkoetter, Joshua D; Yan, Jianhua; Townsend, David W; Conti, Maurizio

2015-07-21

In the context of investigating the potential of low-dose PET imaging for screening applications, we developed methods to assess small lesion detectability as a function of the number of counts in the scan. We present here our methods and preliminary validation using tuberculosis cases. FDG-PET data from seventeen patients presenting diffuse hyper-metabolic lung lesions were selected for the study, to include a wide range of lesion sizes and contrasts. Reduced doses were simulated by randomly discarding events in the PET list mode, and ten realizations at each simulated dose were generated and reconstructed. The data were grouped into 9 categories determined by the number of included true events, from  >40 M to  <250 k counts. The images reconstructed from the original full statistical set were used to identify lung lesions, and each was, at every simulated dose, quantified by 6 parameters: lesion metabolic volume, lesion-to-background contrast, mean lesion tracer uptake, standard deviation of activity measurements (across realizations), lesion signal-to-noise ratio (SNR), and Hotelling observer SNR. Additionally, a lesion-detection task including 550 images was presented to several experienced image readers for qualitative assessment. Human observer performances were ranked using receiver operating characteristic analysis. The observer results were correlated with the lesion image measurements and used to train mathematical observer models. Absolute sensitivities and specificities of the human observers, as well as the area under the ROC curve, showed clustering and performance similarities among images produced from 5 million or greater counts. The results presented here are from a clinically realistic but highly constrained experiment, and more work is needed to validate these findings with a larger patient population.

SU-F-J-178: A Computer Simulation Model Observer for Task-Based Image Quality Assessment in Radiation Therapy

DOE Office of Scientific and Technical Information (OSTI.GOV)

Dolly, S; Mutic, S; Anastasio, M

Purpose: Traditionally, image quality in radiation therapy is assessed subjectively or by utilizing physically-based metrics. Some model observers exist for task-based medical image quality assessment, but almost exclusively for diagnostic imaging tasks. As opposed to disease diagnosis, the task for image observers in radiation therapy is to utilize the available images to design and deliver a radiation dose which maximizes patient disease control while minimizing normal tissue damage. The purpose of this study was to design and implement a new computer simulation model observer to enable task-based image quality assessment in radiation therapy. Methods: A modular computer simulation framework wasmore » developed to resemble the radiotherapy observer by simulating an end-to-end radiation therapy treatment. Given images and the ground-truth organ boundaries from a numerical phantom as inputs, the framework simulates an external beam radiation therapy treatment and quantifies patient treatment outcomes using the previously defined therapeutic operating characteristic (TOC) curve. As a preliminary demonstration, TOC curves were calculated for various CT acquisition and reconstruction parameters, with the goal of assessing and optimizing simulation CT image quality for radiation therapy. Sources of randomness and bias within the system were analyzed. Results: The relationship between CT imaging dose and patient treatment outcome was objectively quantified in terms of a singular value, the area under the TOC (AUTOC) curve. The AUTOC decreases more rapidly for low-dose imaging protocols. AUTOC variation introduced by the dose optimization algorithm was approximately 0.02%, at the 95% confidence interval. Conclusion: A model observer has been developed and implemented to assess image quality based on radiation therapy treatment efficacy. It enables objective determination of appropriate imaging parameter values (e.g. imaging dose). Framework flexibility allows for incorporation of additional modules to include any aspect of the treatment process, and therefore has great potential for both assessment and optimization within radiation therapy.« less

Benchmarking wastewater treatment plants under an eco-efficiency perspective.

PubMed

Lorenzo-Toja, Yago; Vázquez-Rowe, Ian; Amores, María José; Termes-Rifé, Montserrat; Marín-Navarro, Desirée; Moreira, María Teresa; Feijoo, Gumersindo

2016-10-01

The new ISO 14045 framework is expected to slowly start shifting the definition of eco-efficiency toward a life-cycle perspective, using Life Cycle Assessment (LCA) as the environmental impact assessment method together with a system value assessment method for the economic analysis. In the present study, a set of 22 wastewater treatment plants (WWTPs) in Spain were analyzed on the basis of eco-efficiency criteria, using LCA and Life Cycle Costing (LCC) as a system value assessment method. The study is intended to be useful to decision-makers in the wastewater treatment sector, since the combined method provides an alternative scheme for analyzing the relationship between environmental impacts and costs. Two midpoint impact categories, global warming and eutrophication potential, as well as an endpoint single score indicator were used for the environmental assessment, while LCC was used for value assessment. Results demonstrated that substantial differences can be observed between different WWTPs depending on a wide range of factors such as plant configuration, plant size or even legal discharge limits. Based on these results the benchmarking of wastewater treatment facilities was performed by creating a specific classification and certification scheme. The proposed eco-label for the WWTPs rating is based on the integration of the three environmental indicators and an economic indicator calculated within the study under the eco-efficiency new framework. Copyright © 2016 Elsevier B.V. All rights reserved.

Detection and Assessment of Wood Decay in Glulam Beams Using a Decay Rate Approach: A Review

Treesearch

C. Adam Senalik

2013-01-01

A glulam beam is subjected to X-ray computer tomography and acousto-ultrasonic measurements to detect and assess wood decay. A glulam beam without visible indications of wood decay was taken from field use. A modified impulse-echo technique is employed as an inspection method requiring access to only one side of the beam. It is observed that decay-rate analysis of the...

Multimethod Strategy for Assessing Program Fidelity: The National Evaluation of the Revised G.R.E.A.T. Program

ERIC Educational Resources Information Center

Esbensen, Finn-Aage; Matsuda, Kristy N.; Taylor, Terrance J.; Peterson, Dana

2011-01-01

This study reports the results of the process evaluation component of the Process and Outcome Evaluation of the Gang Resistance Education and Training (G.R.E.A.T.) program. The process evaluation consisted of multiple methods to assess program fidelity: (a) observations of G.R.E.A.T. Officer Trainings (G.O.T); (b) surveys and interviews of…

Comparing Two Approaches for Assessing Observation Impact

NASA Technical Reports Server (NTRS)

Todling, Ricardo

2013-01-01

Langland and Baker introduced an approach to assess the impact of observations on the forecasts. In that approach, a state-space aspect of the forecast is defined and a procedure is derived ultimately relating changes in the aspect with changes in the observing system. Some features of the state-space approach are to be noted: the typical choice of forecast aspect is rather subjective and leads to incomplete assessment of the observing system, it requires availability of a verification state that is in practice correlated with the forecast, and it involves the adjoint operator of the entire data assimilation system and is thus constrained by the validity of this operator. This article revisits the topic of observation impacts from the perspective of estimation theory. An observation-space metric is used to allow inferring observation impact on the forecasts without the limitations just mentioned. Using differences of observation-minus-forecast residuals obtained from consecutive forecasts leads to the following advantages: (i) it suggests a rather natural choice of forecast aspect that directly links to the data assimilation procedure, (ii) it avoids introducing undesirable correlations in the forecast aspect since verification is done against the observations, and (iii) it does not involve linearization and use of adjoints. The observation-space approach has the additional advantage of being nearly cost free and very simple to implement. In its simplest form it reduces to evaluating the statistics of observationminus- background and observation-minus-analysis residuals with traditional methods. Illustrations comparing the approaches are given using the NASA Goddard Earth Observing System.

Factors Influencing Physical Therapists' Use of Standardized Measures of Walking Capacity Poststroke Across the Care Continuum

PubMed Central

Pattison, Kira M.; Brooks, Dina; Cameron, Jill I.

2015-01-01

Background The use of standardized assessment tools is an element of evidence-informed rehabilitation, but physical therapists report administering these tools inconsistently poststroke. An in-depth understanding of physical therapists' approaches to walking assessment is needed to develop strategies to advance assessment practice. Objectives The objective of this study was to explore the methods physical therapists use to evaluate walking poststroke, reasons for selecting these methods, and the use of assessment results in clinical practice. Design A qualitative descriptive study involving semistructured telephone interviews was conducted. Methods Registered physical therapists assessing a minimum of 10 people with stroke per year in Ontario, Canada, were purposively recruited from acute care, rehabilitation, and outpatient settings. Interviews were audiotaped and transcribed verbatim. Transcripts were coded line by line by the interviewer. Credibility was optimized through triangulation of analysts, audit trail, and collection of field notes. Results Study participants worked in acute care (n=8), rehabilitation (n=11), or outpatient (n=9) settings and reported using movement observation and standardized assessment tools to evaluate walking. When selecting methods to evaluate walking, physical therapists described being influenced by a hierarchy of factors. Factors included characteristics of the assessment tool, the therapist, the workplace, and patients, as well as influential individuals or organizations. Familiarity exerted the primary influence on adoption of a tool into a therapist's assessment repertoire, whereas patient factors commonly determined daily use. Participants reported using the results from walking assessments to communicate progress to the patient and health care professionals. Conclusions Multilevel factors influence physical therapists' adoption and daily administration of standardized tools to assess walking. Findings will inform knowledge translation efforts aimed at increasing the standardized assessment of walking poststroke. PMID:25929532

Consistency of extreme flood estimation approaches

NASA Astrophysics Data System (ADS)

Felder, Guido; Paquet, Emmanuel; Penot, David; Zischg, Andreas; Weingartner, Rolf

2017-04-01

Estimations of low-probability flood events are frequently used for the planning of infrastructure as well as for determining the dimensions of flood protection measures. There are several well-established methodical procedures to estimate low-probability floods. However, a global assessment of the consistency of these methods is difficult to achieve, the "true value" of an extreme flood being not observable. Anyway, a detailed comparison performed on a given case study brings useful information about the statistical and hydrological processes involved in different methods. In this study, the following three different approaches for estimating low-probability floods are compared: a purely statistical approach (ordinary extreme value statistics), a statistical approach based on stochastic rainfall-runoff simulation (SCHADEX method), and a deterministic approach (physically based PMF estimation). These methods are tested for two different Swiss catchments. The results and some intermediate variables are used for assessing potential strengths and weaknesses of each method, as well as for evaluating the consistency of these methods.

A distribution method for analysing the baseline of pulsatile endocrine signals as exemplified by 24-hour growth hormone profiles.

PubMed

Matthews, D R; Hindmarsh, P C; Pringle, P J; Brook, C G

1991-09-01

To develop a method for quantifying the distribution of concentrations present in hormone profiles, which would allow an observer-unbiased estimate of the time concentration attribute and to make an assessment of the baseline. The log-transformed concentrations (regardless of their temporal attribute) are sorted and allocated to class intervals. The number of observations in each interval are then determined and expressed as a percentage of the total number of samples drawn in the study period. The data may be displayed as a frequency distribution or as a cumulative distribution. Cumulative distributions may be plotted as sigmoidal ogives or can be transformed into discrete probabilities (linear probits), which are then linear, and amenable to regression analysis. Probability analysis gives estimates of the mean (the value below which 50% of the observed concentrations lie, which we term 'OC50'). 'Baseline' can be defined in terms of percentage occupancy--the 'Observed Concentration for 5%' (which we term 'OC5') which is the threshold at or below which the hormone concentrations are measured 5% of the time. We report the use of applying this method to 24-hour growth hormone (GH) profiles from 63 children, 26 adults and one giant. We demonstrate that GH effects (growth or gigantism) in these groups are more related to the baseline OC5 concentration than peak concentration (OC5 +/- 95% confidence limits: adults 0.05 +/- 0.04, peak-height-velocity pubertal 0.39 +/- 0.22, giant 8.9 mU/l). Pulsatile hormone profiles can be analysed using this method in order to assess baseline and other concentration domains.

Tsunamis: stochastic models of occurrence and generation mechanisms

USGS Publications Warehouse

Geist, Eric L.; Oglesby, David D.

2014-01-01

The devastating consequences of the 2004 Indian Ocean and 2011 Japan tsunamis have led to increased research into many different aspects of the tsunami phenomenon. In this entry, we review research related to the observed complexity and uncertainty associated with tsunami generation, propagation, and occurrence described and analyzed using a variety of stochastic methods. In each case, seismogenic tsunamis are primarily considered. Stochastic models are developed from the physical theories that govern tsunami evolution combined with empirical models fitted to seismic and tsunami observations, as well as tsunami catalogs. These stochastic methods are key to providing probabilistic forecasts and hazard assessments for tsunamis. The stochastic methods described here are similar to those described for earthquakes (Vere-Jones 2013) and volcanoes (Bebbington 2013) in this encyclopedia.

Rolling bearing fault diagnosis and health assessment using EEMD and the adjustment Mahalanobis-Taguchi system

NASA Astrophysics Data System (ADS)

Chen, Junxun; Cheng, Longsheng; Yu, Hui; Hu, Shaolin

2018-01-01