Bringing memory fMRI to the clinic: comparison of seven memory fMRI protocols in temporal lobe epilepsy.

PubMed

Towgood, Karren; Barker, Gareth J; Caceres, Alejandro; Crum, William R; Elwes, Robert D C; Costafreda, Sergi G; Mehta, Mitul A; Morris, Robin G; von Oertzen, Tim J; Richardson, Mark P

2015-04-01

fMRI is increasingly implemented in the clinic to assess memory function. There are multiple approaches to memory fMRI, but limited data on advantages and reliability of different methods. Here, we compared effect size, activation lateralisation, and between-sessions reliability of seven memory fMRI protocols: Hometown Walking (block design), Scene encoding (block design and event-related design), Picture encoding (block and event-related), and Word encoding (block and event-related). All protocols were performed on three occasions in 16 patients with temporal lobe epilepsy (TLE). Group T-maps showed activity bilaterally in medial temporal lobe for all protocols. Using ANOVA, there was an interaction between hemisphere and seizure-onset lateralisation (P = 0.009) and between hemisphere, protocol and seizure-onset lateralisation (P = 0.002), showing that the distribution of memory-related activity between left and right temporal lobes differed between protocols and between patients with left-onset and right-onset seizures. Using voxelwise intraclass Correlation Coefficient, between-sessions reliability was best for Hometown and Scenes (block and event). The between-sessions spatial overlap of activated voxels was also greatest for Hometown and Scenes. Lateralisation of activity between hemispheres was most reliable for Scenes (block and event) and Words (event). Using receiver operating characteristic analysis to explore the ability of each fMRI protocol to classify patients as left-onset or right-onset TLE, only the Words (event) protocol achieved a significantly above-chance classification of patients at all three sessions. We conclude that Words (event) protocol shows the best combination of between-sessions reliability of the distribution of activity between hemispheres and reliable ability to distinguish between left-onset and right-onset patients. © 2015 The Authors Human Brain Mapping Published by Wiley Periodicals, Inc.

Retest reliability of individual alpha ERD topography assessed by human electroencephalography.

PubMed

Vázquez-Marrufo, Manuel; Galvao-Carmona, Alejandro; Benítez Lugo, María Luisa; Ruíz-Peña, Juan Luis; Borges Guerra, Mónica; Izquierdo Ayuso, Guillermo

2017-01-01

Despite the immense literature related to diverse human electroencephalographic (EEG) parameters, very few studies have focused on the reliability of these measures. Some of the most studied components (i.e., P3 or MMN) have received more attention regarding the stability of their main parameters, such as latency, amplitude or topography. However, spectral modulations have not been as extensively evaluated considering that different analysis methods are available. The main aim of the present study is to assess the reliability of the latency, amplitude and topography of event-related desynchronization (ERD) for the alpha band (10-14 Hz) observed in a cognitive task (visual oddball). Topography reliability was analysed at different levels (for the group, within-subjects individually and between-subjects individually). The latency for alpha ERD showed stable behaviour between two sessions, and the amplitude exhibited an increment (more negative) in the second session. Alpha ERD topography exhibited a high correlation score between sessions at the group level (r = 0.903, p<0.001). The mean value for within-subject correlations was 0.750 (with a range from 0.391 to 0.954). Regarding between-subject topography comparisons, some subjects showed a highly specific topography, whereas other subjects showed topographies that were more similar to those of other subjects. ERD was mainly stable between the two sessions with the exception of amplitude, which exhibited an increment in the second session. Topography exhibits excellent reliability at the group level; however, it exhibits highly heterogeneous behaviour at the individual level. Considering that the P3 was previously evaluated for this group of subjects, a direct comparison of the correlation scores was possible, and it showed that the ERD component is less reliable in individual topography than in the ERP component (P3).

Retest reliability of individual alpha ERD topography assessed by human electroencephalography

PubMed Central

Vázquez-Marrufo, Manuel; Benítez Lugo, María Luisa; Ruíz-Peña, Juan Luis; Borges Guerra, Mónica; Izquierdo Ayuso, Guillermo

2017-01-01

Background Despite the immense literature related to diverse human electroencephalographic (EEG) parameters, very few studies have focused on the reliability of these measures. Some of the most studied components (i.e., P3 or MMN) have received more attention regarding the stability of their main parameters, such as latency, amplitude or topography. However, spectral modulations have not been as extensively evaluated considering that different analysis methods are available. The main aim of the present study is to assess the reliability of the latency, amplitude and topography of event-related desynchronization (ERD) for the alpha band (10–14 Hz) observed in a cognitive task (visual oddball). Topography reliability was analysed at different levels (for the group, within-subjects individually and between-subjects individually). Results The latency for alpha ERD showed stable behaviour between two sessions, and the amplitude exhibited an increment (more negative) in the second session. Alpha ERD topography exhibited a high correlation score between sessions at the group level (r = 0.903, p<0.001). The mean value for within-subject correlations was 0.750 (with a range from 0.391 to 0.954). Regarding between-subject topography comparisons, some subjects showed a highly specific topography, whereas other subjects showed topographies that were more similar to those of other subjects. Conclusion ERD was mainly stable between the two sessions with the exception of amplitude, which exhibited an increment in the second session. Topography exhibits excellent reliability at the group level; however, it exhibits highly heterogeneous behaviour at the individual level. Considering that the P3 was previously evaluated for this group of subjects, a direct comparison of the correlation scores was possible, and it showed that the ERD component is less reliable in individual topography than in the ERP component (P3). PMID:29088307

Reliability of segmental accelerations measured using a new wireless gait analysis system.

PubMed

Kavanagh, Justin J; Morrison, Steven; James, Daniel A; Barrett, Rod

2006-01-01

The purpose of this study was to determine the inter- and intra-examiner reliability, and stride-to-stride reliability, of an accelerometer-based gait analysis system which measured 3D accelerations of the upper and lower body during self-selected slow, preferred and fast walking speeds. Eight subjects attended two testing sessions in which accelerometers were attached to the head, neck, lower trunk, and right shank. In the initial testing session, two different examiners attached the accelerometers and performed the same testing procedures. A single examiner repeated the procedure in a subsequent testing session. All data were collected using a new wireless gait analysis system, which features near real-time data transmission via a Bluetooth network. Reliability for each testing condition (4 locations, 3 directions, 3 speeds) was quantified using a waveform similarity statistic known as the coefficient of multiple determination (CMD). CMD's ranged from 0.60 to 0.98 across all test conditions and were not significantly different for inter-examiner (0.86), intra-examiner (0.87), and stride-to-stride reliability (0.86). The highest repeatability for the effect of location, direction and walking speed were for the shank segment (0.94), the vertical direction (0.91) and the fast walking speed (0.91), respectively. Overall, these results indicate that a high degree of waveform repeatability was obtained using a new gait system under test-retest conditions involving single and dual examiners. Furthermore, differences in acceleration waveform repeatability associated with the reapplication of accelerometers were small in relation to normal motor variability.

Test-Retest Reliability of Brain Activation Using the Face-Name Paired-Associates fMRI Task in Patients with Schizophrenia and Healthy Controls

NASA Astrophysics Data System (ADS)

Louis, Chelsey N.

Schizophrenia is a neurological disorder associated with cognitive impairments, and clinical symptoms of hallucinations and delusions. Recent imaging and behavioral studies have repeatedly shown aberrant brain activity in the hippocampal regions in relation to episodic memory impairments associated with schizophrenia. These findings have warranted further research to elucidate the neural processes associated with episodic memory. Therefore, the current study examined activity in a priori brain regions associated with episodic memory using the face-name paired-associates fMRI task to determine whether there was reliable activation patterns observed in healthy subjects and patients with self-reported schizophrenia. This was evaluated by using ROI analysis and whole brain analysis to examine activity between subjects during a session, and by using Pearson's R correlation coefficients to examine test-retest reliability over time. 30 schizophrenic (SZ) patients and 31 healthy control (HC) volunteers underwent a series of assessments including the fMRI behavioral task, face-name paired-associates task. The tests were conducted twice with a 14-day interval for the subjects. The results indicated no reliable brain activation in the hippocampus between scanning sessions for either the SZ or HC groups. However, distinct activation patterns were observed within sessions for both groups. These patterns were observed in the hippocampus, and regions of the frontal lobe and occipital lobe. Future studies should further explore these brain activity patterns across sessions in SZ patients compared to HC subjects to determine whether these patterns are due to pathological mechanisms associated with schizophrenia.

Quantifying frontal plane knee motion during single limb squats: reliability and validity of 2-dimensional measures.

PubMed

Gwynne, Craig R; Curran, Sarah A

2014-12-01

Clinical assessment of lower limb kinematics during dynamic tasks may identify individuals who demonstrate abnormal movement patterns that may lead to etiology of exacerbation of knee conditions such as patellofemoral joint (PFJt) pain. The purpose of this study was to determine the reliability, validity and associated measurement error of a clinically appropriate two-dimensional (2-D) procedure of quantifying frontal plane knee alignment during single limb squats. Nine female and nine male recreationally active subjects with no history of PFJt pain had frontal plane limb alignment assessed using three-dimensional (3-D) motion analysis and digital video cameras (2-D analysis) while performing single limb squats. The association between 2-D and 3-D measures was quantified using Pearson's product correlation coefficients. Intraclass correlation coefficients (ICCs) were determined for within- and between-session reliability of 2-D data and standard error of measurement (SEM) was used to establish measurement error. Frontal plane limb alignment assessed with 2-D analysis demonstrated good correlation compared with 3-D methods (r = 0.64 to 0.78, p < 0.001). Within-session (0.86) and between-session ICCs (0.74) demonstrated good reliability for 2-D measures and SEM scores ranged from 2° to 4°. 2-D measures have good consistency and may provide a valid measure of lower limb alignment when compared to existing 3-D methods. Assessment of lower limb kinematics using 2-D methods may be an accurate and clinically useful alternative to 3-D motion analysis when identifying individuals who demonstrate abnormal movement patterns associated with PFJt pain. 2b.

Reliable identification of deep sulcal pits: the effects of scan session, scanner, and surface extraction tool.

PubMed

Im, Kiho; Lee, Jong-Min; Jeon, Seun; Kim, Jong-Heon; Seo, Sang Won; Na, Duk L; Grant, P Ellen

2013-01-01

Sulcal pit analysis has been providing novel insights into brain function and development. The purpose of this study was to evaluate the reliability of sulcal pit extraction with respect to the effects of scan session, scanner, and surface extraction tool. Five subjects were scanned 4 times at 3 MRI centers and other 5 subjects were scanned 3 times at 2 MRI centers, including 1 test-retest session. Sulcal pits were extracted on the white matter surfaces reconstructed with both Montreal Neurological Institute and Freesurfer pipelines. We estimated similarity of the presence of sulcal pits having a maximum value of 1 and their spatial difference within the same subject. The tests showed high similarity of the sulcal pit presence and low spatial difference. The similarity was more than 0.90 and the spatial difference was less than 1.7 mm in most cases according to different scan sessions or scanners, and more than 0.85 and about 2.0 mm across surface extraction tools. The reliability of sulcal pit extraction was more affected by the image processing-related factors than the scan session or scanner factors. Moreover, the similarity of sulcal pit distribution appeared to be largely influenced by the presence or absence of the sulcal pits on the shallow and small folds. We suggest that our sulcal pit extraction from MRI is highly reliable and could be useful for clinical applications as an imaging biomarker.

Tracking motor units longitudinally across experimental sessions with high‐density surface electromyography

PubMed Central

Martinez‐Valdes, E.; Negro, F.; Laine, C. M.; Falla, D.; Mayer, F.

2017-01-01

Key points Classic motor unit (MU) recording and analysis methods do not allow the same MUs to be tracked across different experimental sessions, and therefore, there is limited experimental evidence on the adjustments in MU properties following training or during the progression of neuromuscular disorders.We propose a new processing method to track the same MUs across experimental sessions (separated by weeks) by using high‐density surface electromyography.The application of the proposed method in two experiments showed that individual MUs can be identified reliably in measurements separated by weeks and that changes in properties of the tracked MUs across experimental sessions can be identified with high sensitivity.These results indicate that the behaviour and properties of the same MUs can be monitored across multiple testing sessions.The proposed method opens new possibilities in the understanding of adjustments in motor unit properties due to training interventions or the progression of pathologies. Abstract A new method is proposed for tracking individual motor units (MUs) across multiple experimental sessions on different days. The technique is based on a novel decomposition approach for high‐density surface electromyography and was tested with two experimental studies for reliability and sensitivity. Experiment I (reliability): ten participants performed isometric knee extensions at 10, 30, 50 and 70% of their maximum voluntary contraction (MVC) force in three sessions, each separated by 1 week. Experiment II (sensitivity): seven participants performed 2 weeks of endurance training (cycling) and were tested pre–post intervention during isometric knee extensions at 10 and 30% MVC. The reliability (Experiment I) and sensitivity (Experiment II) of the measured MU properties were compared for the MUs tracked across sessions, with respect to all MUs identified in each session. In Experiment I, on average 38.3% and 40.1% of the identified MUs could be tracked across two sessions (1 and 2 weeks apart), for the vastus medialis and vastus lateralis, respectively. Moreover, the properties of the tracked MUs were more reliable across sessions than those of the full set of identified MUs (intra‐class correlation coefficients ranged between 0.63—0.99 and 0.39–0.95, respectively). In Experiment II, ∼40% of the MUs could be tracked before and after the training intervention and training‐induced changes in MU conduction velocity had an effect size of 2.1 (tracked MUs) and 1.5 (group of all identified motor units). These results show the possibility of monitoring MU properties longitudinally to document the effect of interventions or the progression of neuromuscular disorders. PMID:28032343

Space Shuttle Propulsion System Reliability

NASA Technical Reports Server (NTRS)

Welzyn, Ken; VanHooser, Katherine; Moore, Dennis; Wood, David

2011-01-01

This session includes the following sessions: (1) External Tank (ET) System Reliability and Lessons, (2) Space Shuttle Main Engine (SSME), Reliability Validated by a Million Seconds of Testing, (3) Reusable Solid Rocket Motor (RSRM) Reliability via Process Control, and (4) Solid Rocket Booster (SRB) Reliability via Acceptance and Testing.

Effect of knee angle on neuromuscular assessment of plantar flexor muscles: A reliability study

PubMed Central

Cornu, Christophe; Jubeau, Marc

2018-01-01

Introduction This study aimed to determine the intra- and inter-session reliability of neuromuscular assessment of plantar flexor (PF) muscles at three knee angles. Methods Twelve young adults were tested for three knee angles (90°, 30° and 0°) and at three time points separated by 1 hour (intra-session) and 7 days (inter-session). Electrical (H reflex, M wave) and mechanical (evoked and maximal voluntary torque, activation level) parameters were measured on the PF muscles. Intraclass correlation coefficients (ICC) and coefficients of variation were calculated to determine intra- and inter-session reliability. Results The mechanical measurements presented excellent (ICC>0.75) intra- and inter-session reliabilities regardless of the knee angle considered. The reliability of electrical measurements was better for the 90° knee angle compared to the 0° and 30° angles. Conclusions Changes in the knee angle may influence the reliability of neuromuscular assessments, which indicates the importance of considering the knee angle to collect consistent outcomes on the PF muscles. PMID:29596480

Accuracy and Feasibility of Video Analysis for Assessing Hamstring Flexibility and Validity of the Sit-and-Reach Test

ERIC Educational Resources Information Center

Mier, Constance M.

2011-01-01

The accuracy of video analysis of the passive straight-leg raise test (PSLR) and the validity of the sit-and-reach test (SR) were tested in 60 men and women. Computer software measured static hip-joint flexion accurately. High within-session reliability of the PSLR was demonstrated (R greater than 0.97). Test-retest (separate days) reliability for…

The association between waiting for psychological therapy and therapy outcomes as measured by the CORE-OM.

PubMed

Beck, Alison; Burdett, Mark; Lewis, Helen

2015-06-01

To investigate the impact of waiting for psychological therapy on client well-being as measured by the Clinical Outcomes in Routine Evaluation-Outcome Measure (CORE-OM) global distress (GD) score. Global distress scores were retrieved for all clients referred for psychological therapy in a secondary care mental health service between November 2006 and May 2013 and who had completed a CORE-OM at assessment and first session. GD scores for a subgroup of 103 clients who had completed a CORE-OM during the last therapy session were also reviewed. The study sample experienced a median wait of 41.14 weeks between assessment and first session. The relationship between wait time from referral acceptance to assessment, and assessment GD score was not significant. During the period between assessment and first session no significant difference in GD score was observed. Nevertheless 29.1% of the sample experienced reliable change; 16.0% of clients reliably improved and 13.1% reliably deteriorated whilst waiting for therapy. Demographic factors were not found to have a significant effect on the change in GD score between assessment and first session. Waiting time was associated with post-therapy outcomes but not to a degree which was meaningful. The majority of individuals (54.4%), regardless of whether they improved or deteriorated whilst waiting for therapy, showed reliable improvement at end of therapy as measured by the CORE-OM. The majority of GD scores remained stable while waiting for therapy; however, 29.1% of secondary care clients experienced either reliable improvement or deterioration. Irrespective of whether they improved, deteriorated or remained unchanged whilst waiting for therapy, most individuals who had a complete end of therapy assessment showed reliable improvements following therapy. There was no significant difference in GD score between assessment and first session recordings. A proportion of clients (29.1%) showed reliable change, either improvement or deterioration, as measured by the GD score while waiting for therapy. Of the individuals with last session CORE-OMs (54.4%) showed significant improvement following therapy regardless of whether or not they experienced change while waiting for therapy. Limitations include: Problems of data quality, the data were from a routine data set and data were lost at each stage of the analysis. A focus on the CORE-OM limits exploration of the subjective experience of waiting for psychotherapy and the impact this has on psychological well-being. © 2014 The British Psychological Society.

Reliability of center of pressure measures within and between sessions in individuals post-stroke and healthy controls.

PubMed

Gray, Vicki L; Ivanova, Tanya D; Garland, S Jayne

2014-01-01

Knowing the reliability of the center of pressure (COP) is important for interpreting balance deficits post-stroke, especially when the balance deficits can necessitate the use of short duration trials. The novel aspect of this reliability study was to examine the center of pressure measures using two adjacent force platforms between and within sessions in stroke and controls. After stroke, it is important to understand the contribution of the paretic and non-paretic leg to the motor control of standing balance. Because there is a considerable body of knowledge on COP reliability on a single platform, we chose to examine reliability using two adjacent platforms which has not been examined previously in stroke. Twenty participants post-stroke and 22 controls performed an arm raise, load drop and quiet stance balance task while standing on two adjacent force platforms, on two separate days. Intraclass correlations coefficient (ICC2,1) and percentage standard error of measurement (SEM%) were calculated for COP velocity, ellipse area, anterior-posterior (AP) displacement, and medial-lateral (ML) displacement. Between sessions, COP velocity was the most reliable with high ICCs and low SEM% across groups and tasks and ellipse area was less reliable with low ICCs across groups and tasks. COP measures were less reliable during the arm raise than load drop post-stroke. Within session reliability was high for COP velocity and ML displacement requiring no more than six trials across tasks. The COP velocity was the most reliable measure with high ICCs between sessions and the high reliability was achieved with fewer trials in both groups in a single session. Copyright © 2014 Elsevier B.V. All rights reserved.

Reliability of TMS metrics in patients with chronic incomplete spinal cord injury.

PubMed

Potter-Baker, K A; Janini, D P; Frost, F S; Chabra, P; Varnerin, N; Cunningham, D A; Sankarasubramanian, V; Plow, E B

2016-11-01

Test-retest reliability analysis in individuals with chronic incomplete spinal cord injury (iSCI). The purpose of this study was to examine the reliability of neurophysiological metrics acquired with transcranial magnetic stimulation (TMS) in individuals with chronic incomplete tetraplegia. Cleveland Clinic Foundation, Cleveland, Ohio, USA. TMS metrics of corticospinal excitability, output, inhibition and motor map distribution were collected in muscles with a higher MRC grade and muscles with a lower MRC grade on the more affected side of the body. Metrics denoting upper limb function were also collected. All metrics were collected at two sessions separated by a minimum of two weeks. Reliability between sessions was determined using Spearman's correlation coefficients and concordance correlation coefficients (CCCs). We found that TMS metrics that were acquired in higher MRC grade muscles were approximately two times more reliable than those collected in lower MRC grade muscles. TMS metrics of motor map output, however, demonstrated poor reliability regardless of muscle choice (P=0.34; CCC=0.51). Correlation analysis indicated that patients with more baseline impairment and/or those in a more chronic phase of iSCI demonstrated greater variability of metrics. In iSCI, reliability of TMS metrics varies depending on the muscle grade of the tested muscle. Variability is also influenced by factors such as baseline motor function and time post SCI. Future studies that use TMS metrics in longitudinal study designs to understand functional recovery should be cautious as choice of muscle and clinical characteristics can influence reliability.

The Multitheoretical List of Therapeutic Interventions - 30 items (MULTI-30).

PubMed

Solomonov, Nili; McCarthy, Kevin S; Gorman, Bernard S; Barber, Jacques P

2018-01-16

To develop a brief version of the Multitheoretical List of Therapeutic Interventions (MULTI-60) in order to decrease completion time burden by approximately half, while maintaining content coverage. Study 1 aimed to select 30 items. Study 2 aimed to examine the reliability and internal consistency of the MULTI-30. Study 3 aimed to validate the MULTI-30 and ensure content coverage. In Study 1, the sample included 186 therapist and 255 patient MULTI ratings, and 164 ratings of sessions coded by trained observers. Internal consistency (Chronbach's alpha and McDonald's omega) was calculated and confirmatory factor analysis was conducted. Psychotherapy experts rated content relevance. Study 2 included a sample of 644 patient and 522 therapist ratings, and 793 codings of psychotherapy sessions. In Study 3, the sample included 33 codings of sessions. A series of regression analyses was conducted to examine replication of previously published findings using the MULTI-30. The MULTI-30 was found valid, reliable, and internally consistent across 2564 ratings examined across the three studies presented. The MULTI-30 a brief and reliable process measure. Future studies are required for further validation.

Test-retest resting-state fMRI in healthy elderly persons with a family history of Alzheimer's disease.

PubMed

Orban, Pierre; Madjar, Cécile; Savard, Mélissa; Dansereau, Christian; Tam, Angela; Das, Samir; Evans, Alan C; Rosa-Neto, Pedro; Breitner, John C S; Bellec, Pierre

2015-01-01

We present a test-retest dataset of resting-state fMRI data obtained in 80 cognitively normal elderly volunteers enrolled in the "Pre-symptomatic Evaluation of Novel or Experimental Treatments for Alzheimer's Disease" (PREVENT-AD) Cohort. Subjects with a family history of Alzheimer's disease in first-degree relatives were recruited as part of an on-going double blind randomized clinical trial of Naproxen or placebo. Two pairs of scans were acquired ~3 months apart, allowing the assessment of both intra- and inter-session reliability, with the possible caveat of treatment effects as a source of inter-session variation. Using the NeuroImaging Analysis Kit (NIAK), we report on the standard quality of co-registration and motion parameters of the data, and assess their validity based on the spatial distribution of seed-based connectivity maps as well as intra- and inter-session reliability metrics in the default-mode network. This resource, released publicly as sample UM1 of the Consortium for Reliability and Reproducibility (CoRR), will benefit future studies focusing on the preclinical period preceding the appearance of dementia in Alzheimer's disease.

Empirical Recommendations for Improving the Stability of the Dot-Probe Task in Clinical Research

PubMed Central

Price, Rebecca B.; Kuckertz, Jennie M.; Siegle, Greg J.; Ladouceur, Cecile D.; Silk, Jennifer S.; Ryan, Neal D.; Dahl, Ronald E.; Amir, Nader

2014-01-01

The dot-probe task has been widely used in research to produce an index of biased attention based on reaction times (RTs). Despite its popularity, very few published studies have examined psychometric properties of the task, including test-retest reliability, and no previous study has examined reliability in clinically anxious samples or systematically explored the effects of task design and analysis decisions on reliability. In the current analysis, we utilized dot-probe data from three studies where attention bias towards threat-related faces was assessed at multiple (≥5) timepoints. Two of the studies were similar (adults with Social Anxiety Disorder, similar design features) while one was much more disparate (pediatric healthy volunteers, distinct task design). We explored the effects of analysis choices (e.g., bias score calculation formula, methods for outlier handling) on reliability and searched for convergence of findings across the three studies. We found that, when considering the three studies concurrently, the most reliable RT bias index utilized data from dot-bottom trials, comparing congruent to incongruent trials, with rescaled outliers, particularly after averaging across more than one assessment point. Although reliability of RT bias indices was moderate to low under most circumstances, within-session variability in bias (attention bias variability; ABV), a recently proposed RT index, was more reliable across sessions. Several eyetracking-based indices of attention bias (available in the pediatric healthy sample only) showed reliability that matched the optimal RT index (ABV). On the basis of these findings, we make specific recommendations to researchers using the dot probe, particularly those wishing to investigate individual differences and/or single-patient applications. PMID:25419646

Reliability of doming and toe flexion testing to quantify foot muscle strength.

PubMed

Ridge, Sarah Trager; Myrer, J William; Olsen, Mark T; Jurgensmeier, Kevin; Johnson, A Wayne

2017-01-01

Quantifying the strength of the intrinsic foot muscles has been a challenge for clinicians and researchers. The reliable measurement of this strength is important in order to assess weakness, which may contribute to a variety of functional issues in the foot and lower leg, including plantar fasciitis and hallux valgus. This study reports 3 novel methods for measuring foot strength - doming (previously unmeasured), hallux flexion, and flexion of the lesser toes. Twenty-one healthy volunteers performed the strength tests during two testing sessions which occurred one to five days apart. Each participant performed each series of strength tests (doming, hallux flexion, and lesser toe flexion) four times during the first testing session (twice with each of two raters) and two times during the second testing session (once with each rater). Intra-class correlation coefficients were calculated to test for reliability for the following comparisons: between raters during the same testing session on the same day (inter-rater, intra-day, intra-session), between raters on different days (inter-rater, inter-day, inter-session), between days for the same rater (intra-rater, inter-day, inter-session), and between sessions on the same day by the same rater (intra-rater, intra-day, inter-session). ICCs showed good to excellent reliability for all tests between days, raters, and sessions. Average doming strength was 99.96 ± 47.04 N. Average hallux flexion strength was 65.66 ± 24.5 N. Average lateral toe flexion was 50.96 ± 22.54 N. These simple tests using relatively low cost equipment can be used for research or clinical purposes. If repeated testing will be conducted on the same participant, it is suggested that the same researcher or clinician perform the testing each time for optimal reliability.

Relative and absolute test-retest reliabilities of pressure pain threshold in patients with knee osteoarthritis.

PubMed

Srimurugan Pratheep, Neeraja; Madeleine, Pascal; Arendt-Nielsen, Lars

2018-04-25

Pressure pain threshold (PPT) and PPT maps are commonly used to quantify and visualize mechanical pain sensitivity. Although PPT's have frequently been reported from patients with knee osteoarthritis (KOA), the absolute and relative reliability of PPT assessments remain to be determined. Thus, the purpose of this study was to evaluate the test-retest relative and absolute reliability of PPT in KOA. For that purpose, intra- and interclass correlation coefficient (ICC) as well as the standard error of measurement (SEM) and the minimal detectable change (MDC) values within eight anatomical locations covering the most painful knee of KOA patients was measured. Twenty KOA patients participated in two sessions with a period of 2 weeks±3 days apart. PPT's were assessed over eight anatomical locations covering the knee and two remote locations over tibialis anterior and brachioradialis. The patients rated their maximum pain intensity during the past 24 h and prior to the recordings on a visual analog scale (VAS), and completed The Western Ontario and McMaster Universities Osteoarthritis Index (WOMAC) and PainDetect surveys. The ICC, SEM and MDC between the sessions were assessed. The ICC for the individual variability was expressed with coefficient of variance (CV). Bland-Altman plots were used to assess potential bias in the dataset. The ICC ranged from 0.85 to 0.96 for all the anatomical locations which is considered "almost perfect". CV was lowest in session 1 and ranged from 44.2 to 57.6%. SEM for comparison ranged between 34 and 71 kPa and MDC ranged between 93 and 197 kPa with a mean PPT ranged from 273.5 to 367.7 kPa in session 1 and 268.1-331.3 kPa in session 2. The analysis of Bland-Altman plot showed no systematic bias. PPT maps showed that the patients had lower thresholds in session 2, but no significant difference was observed for the comparison between the sessions for PPT or VAS. No correlations were seen between PainDetect and PPT and PainDetect and WOMAC. Almost perfect relative and absolute reliabilities were found for the assessment of PPT's for KOA patients. The present investigation implicates that PPT's is reliable for assessing pain sensitivity and sensitization in KOA patients.

Test-retest reliability of eye tracking in the visual world paradigm for the study of real-time spoken word recognition.

PubMed

Farris-Trimble, Ashley; McMurray, Bob

2013-08-01

Researchers have begun to use eye tracking in the visual world paradigm (VWP) to study clinical differences in language processing, but the reliability of such laboratory tests has rarely been assessed. In this article, the authors assess test-retest reliability of the VWP for spoken word recognition. Methods Participants performed an auditory VWP task in repeated sessions and a visual-only VWP task in a third session. The authors performed correlation and regression analyses on several parameters to determine which reflect reliable behavior and which are predictive of behavior in later sessions. Results showed that the fixation parameters most closely related to timing and degree of fixations were moderately-to-strongly correlated across days, whereas the parameters related to rate of increase or decrease of fixations to particular items were less strongly correlated. Moreover, when including factors derived from the visual-only task, the performance of the regression model was at least moderately correlated with Day 2 performance on all parameters ( R > .30). The VWP is stable enough (with some caveats) to serve as an individual measure. These findings suggest guidelines for future use of the paradigm and for areas of improvement in both methodology and analysis.

The development and validation of a custom built device for assessing frontal knee joint laxity.

PubMed

Ismail, Shiek Abdullah; Simic, Milena; Clarke, Jillian L; Lopes, Thiago Jambo Alves; Pappas, Evangelos

2017-12-01

This study reports the development and validation of a quantitative technique of assessing frontal knee joint laxity through a custom built device named KLICP. The objectives of this study were to determine: (i) the intra- and inter-rater reliability and (ii) the validity of the device when compared to real time ultrasound. Twenty-five participants had their frontal knee joint laxity assessed by the KLICP, by manual varus/valgus tests and by ultrasound. Two raters independently assessed laxity manually by three repeated measurements, repeated at least 48h later. Results were validated by comparing them to the medial and lateral joint space opening measured by the ultrasound. Intraclass correlation coefficients and standard error of measurement reliability were calculated. Pearson's correlation coefficients were calculated to determine the correlation between the KLICP and the joint space. Intra-rater reliability (intra-session) for each rater was good on both sessions (0.91-0.98), intra-rater reliability (inter-sessions) was moderate to good (0.62-0.87), and inter-rater reliability (intra-session) was good (0.75-0.80). There is low agreement for intra-rater (inter-session) and for inter-rater (intra-session) reliability. The KLICP measurement has a significant positive fair to moderate correlation to the ultrasound measurement at the left (r: 0.61, p: 0.01) and right (r: 0.48, p: 0.02) knee in the valgus direction and at the left (r: 0.51, p: 0.01) and right (r: 0.39, p: 0.05) knee in the varus direction. There is low agreement between the KLICP and the RTU. Reliability and agreement was good only when measured for intra-rater, within session. Copyright © 2017 Elsevier B.V. All rights reserved.

The reliability and stability of visual working memory capacity.

PubMed

Xu, Z; Adam, K C S; Fang, X; Vogel, E K

2018-04-01

Because of the central role of working memory capacity in cognition, many studies have used short measures of working memory capacity to examine its relationship to other domains. Here, we measured the reliability and stability of visual working memory capacity, measured using a single-probe change detection task. In Experiment 1, the participants (N = 135) completed a large number of trials of a change detection task (540 in total, 180 each of set sizes 4, 6, and 8). With large numbers of both trials and participants, reliability estimates were high (α > .9). We then used an iterative down-sampling procedure to create a look-up table for expected reliability in experiments with small sample sizes. In Experiment 2, the participants (N = 79) completed 31 sessions of single-probe change detection. The first 30 sessions took place over 30 consecutive days, and the last session took place 30 days later. This unprecedented number of sessions allowed us to examine the effects of practice on stability and internal reliability. Even after much practice, individual differences were stable over time (average between-session r = .76).

Advancing methods for reliably assessing motivational interviewing fidelity using the Motivational Interviewing Skills Code

PubMed Central

Lord, Sarah Peregrine; Can, Doğan; Yi, Michael; Marin, Rebeca; Dunn, Christopher W.; Imel, Zac E.; Georgiou, Panayiotis; Narayanan, Shrikanth; Steyvers, Mark; Atkins, David C.

2014-01-01

The current paper presents novel methods for collecting MISC data and accurately assessing reliability of behavior codes at the level of the utterance. The MISC 2.1 was used to rate MI interviews from five randomized trials targeting alcohol and drug use. Sessions were coded at the utterance-level. Utterance-based coding reliability was estimated using three methods and compared to traditional reliability estimates of session tallies. Session-level reliability was generally higher compared to reliability using utterance-based codes, suggesting that typical methods for MISC reliability may be biased. These novel methods in MI fidelity data collection and reliability assessment provided rich data for therapist feedback and further analyses. Beyond implications for fidelity coding, utterance-level coding schemes may elucidate important elements in the counselor-client interaction that could inform theories of change and the practice of MI. PMID:25242192

Advancing methods for reliably assessing motivational interviewing fidelity using the motivational interviewing skills code.

PubMed

Lord, Sarah Peregrine; Can, Doğan; Yi, Michael; Marin, Rebeca; Dunn, Christopher W; Imel, Zac E; Georgiou, Panayiotis; Narayanan, Shrikanth; Steyvers, Mark; Atkins, David C

2015-02-01

The current paper presents novel methods for collecting MISC data and accurately assessing reliability of behavior codes at the level of the utterance. The MISC 2.1 was used to rate MI interviews from five randomized trials targeting alcohol and drug use. Sessions were coded at the utterance-level. Utterance-based coding reliability was estimated using three methods and compared to traditional reliability estimates of session tallies. Session-level reliability was generally higher compared to reliability using utterance-based codes, suggesting that typical methods for MISC reliability may be biased. These novel methods in MI fidelity data collection and reliability assessment provided rich data for therapist feedback and further analyses. Beyond implications for fidelity coding, utterance-level coding schemes may elucidate important elements in the counselor-client interaction that could inform theories of change and the practice of MI. Copyright © 2015 Elsevier Inc. All rights reserved.

Isokinetic Strength and Endurance Tests used Pre- and Post-Spaceflight: Test-Retest Reliability

NASA Technical Reports Server (NTRS)

Laughlin, Mitzi S.; Lee, Stuart M. C.; Loehr, James A.; Amonette, William E.

2009-01-01

To assess changes in muscular strength and endurance after microgravity exposure, NASA measures isokinetic strength and endurance across multiple sessions before and after long-duration space flight. Accurate interpretation of pre- and post-flight measures depends upon the reliability of each measure. The purpose of this study was to evaluate the test-retest reliability of the NASA International Space Station (ISS) isokinetic protocol. Twenty-four healthy subjects (12 M/12 F, 32.0 +/- 5.6 years) volunteered to participate. Isokinetic knee, ankle, and trunk flexion and extension strength as well as endurance of the knee flexors and extensors were measured using a Cybex NORM isokinetic dynamometer. The first weekly session was considered a familiarization session. Data were collected and analyzed for weeks 2-4. Repeated measures analysis of variance (alpha=0.05) was used to identify weekly differences in isokinetic measures. Test-retest reliability was evaluated by intraclass correlation coefficients (ICC) (3,1). No significant differences were found between weeks in any of the strength measures and the reliability of the strength measures were all considered excellent (ICC greater than 0.9), except for concentric ankle dorsi-flexion (ICC=0.67). Although a significant difference was noted in weekly endurance measures of knee extension (p less than 0.01), the reliability of endurance measure by week were considered excellent for knee flexion (ICC=0.97) and knee extension (ICC=0.96). Except for concentric ankle dorsi-flexion, the isokinetic strength and endurance measures are highly reliable when following the NASA ISS protocol. This protocol should allow accurate interpretation isokinetic data even with a small number of crew members.

Does gymnastics practice improve vertical jump reliability from the age of 8 to 10 years?

PubMed

Marina, Michel; Torrado, Priscila

2013-01-01

The objective of this study was to confirm whether gymnastics practice from a young age can induce greater vertical jump reliability. Fifty young female gymnasts (8.84 ± 0.62 years) and 42 females in the control group (8.58 ± 0.92 years) performed the following jump tests on a contact mat: squat jump, countermovement jump, countermovement jump with arm swing and drop jump from heights of 40 and 60 cm. The two testing sessions had three trials each and were separated by one week. A 2 (groups) × 2 (sessions) × 3 (trials) repeated measures analysis of variance (ANOVA) and a test-retest correlation analysis were used to study the reliability. There was no systematic source of error in either group for non-plyometric jumps such as squat jump, countermovement jump, and countermovement jump with arm swing. A significant group per trial interaction revealed a learning effect in gymnasts' drop jumps from 40 cm height. Additionally, the test-retest correlation analysis and the higher minimum detectable error suggest that the quick drop jump technique was not fully consolidated in either group. At an introductory level of gymnastics and between the ages of 8-10 years, the condition of being a gymnast did not lead to conclusively higher reliability, aside from better overall vertical jump performance.

When Does Premature Treatment Termination Occur? Examining Session-by-Session Dropout Among Clients with Gambling Disorder.

PubMed

Pfund, Rory A; Peter, Samuel C; Whelan, James P; Meyers, Andrew W

2018-06-01

Premature termination challenges the successful outcomes of psychological treatments for gambling disorder. To date, research has primarily identified clients who are at particular risk for dropping out of treatment. A smaller but growing body of literature has investigated when dropout occurs. Typically, those studies have not considered improvement in psychological distress within their operationalizations of dropout and therefore may have misrepresented when dropout occurs. The current study examined when dropout occurs using an operationalization based on the criteria of attaining reliable change in a naturalistic sample of clients with gambling disorder, and the classification rates yielded from that operationalization were compared to the rates from a more common operationalization. Participants (n = 334) were clients meeting diagnostic criteria for gambling disorder at an outpatient private practice who completed a measure of psychological distress at baseline and prior to each subsequent treatment session. A survival analysis was conducted to determine temporal patterns of treatment dropout (i.e., clients who discontinued treatment before realizing reliable changes in psychological distress) and completion (i.e., clients who discontinued treatment after realizing reliable changes in distress) at each treatment session. Forty-nine percent of clients were classified as dropouts, and the majority of those clients did so in the first few sessions. The more common operationalization of dropout classified clients as dropouts when they had improved in their distress and clients as completers when they had not improved in their distress. Discussion centers on the implications of dropout occurring at various stages of treatment and future directions.

Reliability of a novel serious game using dual-task gait profiles to early characterize aMCI

PubMed Central

Tarnanas, Ioannis; Papagiannopoulos, Sotirios; Kazis, Dimitris; Wiederhold, Mark; Widerhold, Brenda; Tsolaki, Magda

2015-01-01

Background: As the population of older adults is growing, the interest in a simple way to detect characterize amnestic mild cognitive impairment (aMCI), a prodromal stage of Alzheimer’s disease (AD), is becoming increasingly important. Serious game (SG) -based cognitive and motor performance profiles while performing everyday activities and dual-task walking (DTW) “motor signatures” are two very promising markers that can be detected in predementia states. We aim to compare the consistency, or conformity, of measurements made by a custom SG with DTW (NAV), a SG without DTW (DOT), neuropsychological measures and genotyping as markers for early detection of aMCI. Methods: The study population included three groups: early AD (n = 86), aMCI (n = 65), and healthy control subjects (n = 76), who completed the custom SG tasks in three separate sessions over a 3-month period. Outcome measures were neuropsychological data across-domain and within-domain intra-individual variability (IIV) and DOT and NAV latency-based and accuracy-based IIV. IIV reflects a transient, within-person change in behavioral performance, either during different cognitive domains (across-domain) or within the same domain (within-domain). Test–retest reliability of the DOT and NAV markers were assessed using an intraclass correlation (ICC) analysis. Results: Results indicated that performance data, such as the NAV latency-based and accuracy-based IIV, during the task displayed greater reliability across sessions compared to DOT. During the NAV task-engagement, the executive function, planning, and motor performance profiles exhibited moderate to good reliability (ICC = 0.6–0.8), while during DOT, executive function and spatial memory accuracy profiles exhibited fair to moderate reliability (ICC = 0.3–0.6). Additionally, reliability across tasks was more stable when three sessions were used in the ICC calculation relative to two sessions. Discussion: Our findings suggest that “motor signature” data during the NAV tasks were a more reliable marker for early diagnosis of aMCI than DOT. This result accentuates the importance of utilizing motor performance data as a metric for aMCI populations where memory decline is often the behavioral outcome of interest. In conclusion, custom SG with DTW performance data provide an ecological and reliable approach for cognitive assessment across multiple sessions and thus can be used as a useful tool for tracking longitudinal change in observational and interventional studies on aMCI. PMID:25954193

Inter-vender and test-retest reliabilities of resting-state functional magnetic resonance imaging: Implications for multi-center imaging studies.

PubMed

An, Hyeong Su; Moon, Won-Jin; Ryu, Jae-Kyun; Park, Ju Yeon; Yun, Won Sung; Choi, Jin Woo; Jahng, Geon-Ho; Park, Jang-Yeon

2017-12-01

This prospective multi-center study aimed to evaluate the inter-vendor and test-retest reliabilities of resting-state functional magnetic resonance imaging (RS-fMRI) by assessing the temporal signal-to-noise ratio (tSNR) and functional connectivity. Study included 10 healthy subjects and each subject was scanned using three 3T MR scanners (GE Signa HDxt, Siemens Skyra, and Philips Achieva) in two sessions. The tSNR was calculated from the time course data. Inter-vendor and test-retest reliabilities were assessed with intra-class correlation coefficients (ICCs) derived from variant component analysis. Independent component analysis was performed to identify the connectivity of the default-mode network (DMN). In result, the tSNR for the DMN was not significantly different among the GE, Philips, and Siemens scanners (P=0.638). In terms of vendor differences, the inter-vendor reliability was good (ICC=0.774). Regarding the test-retest reliability, the GE scanner showed excellent correlation (ICC=0.961), while the Philips (ICC=0.671) and Siemens (ICC=0.726) scanners showed relatively good correlation. The DMN pattern of the subjects between the two sessions for each scanner and between three scanners showed the identical patterns of functional connectivity. The inter-vendor and test-retest reliabilities of RS-fMRI using different 3T MR scanners are good. Thus, we suggest that RS-fMRI could be used in multicenter imaging studies as a reliable imaging marker. Copyright © 2017 Elsevier Inc. All rights reserved.

Knee extension and stiffness in osteoarthritic and normal knees: a videofluoroscopic analysis of the effect of a single session of manual therapy.

PubMed

Taylor, Alden L; Wilken, Jason M; Deyle, Gail D; Gill, Norman W

2014-04-01

Descriptive biomechanical study using an experimental repeated-measures design. To quantify the response of participants with and without knee osteoarthritis (OA) to a single session of manual physical therapy. The intervention consisted primarily of joint mobilization techniques, supplemented by exercises, aiming to improve knee extension. While manual therapy benefits patients with knee OA, there is limited research quantifying the effects of a manual therapy treatment session on either motion or stiffness of osteoarthritic and normal knees. Methods The study included 5 participants with knee OA and 5 age-, gender-, and body mass index-matched healthy volunteers. Knee extension motion and stiffness were measured with videofluoroscopy before and after a 30-minute manual therapy treatment session. Analysis of variance and intraclass correlation coefficients were used to analyze the data. Participants with knee OA had restricted knee extension range of motion at baseline, in contrast to the participants with normal knees, who had full knee extension. After the therapy session, there was a significant increase in knee motion in participants with knee OA (P = .004) but not in those with normal knees (P = .201). For stiffness data, there was no main effect for time (P = .903) or load (P = .274), but there was a main effect of group (P = .012), with the participants with healthy knees having greater stiffness than those with knee OA. Reliability, using intraclass correlation coefficient model 3,3, for knee angle measurements between imaging sessions for all loading conditions was 0.99. Reliability (intraclass correlation coefficient model 3,1) for intraimage measurements was 0.97. End-range knee extension stiffness was greater in the participants with normal knees than those with knee OA. The combination of lesser stiffness and lack of motion in those with knee OA, which may indicate the potential for improvement, may explain why increased knee extension angle was observed following a single session of manual therapy in the participants with knee OA but not in those with normal knees. Videofluoroscopy of the knee appears reliable and relevant for future studies attempting to quantify the underlying mechanisms of manual therapy. J Orthop Sports Phys Ther 2014;44(4):273-282. Epub 25 February 2014. doi:10.2519/jospt.2014.4710.

Reliability of the Kinetics of British Army Foot Drill in Untrained Personnel.

PubMed

Rawcliffe, Alex J; Simpson, Richard J; Graham, Scott M; Psycharakis, Stelios G; Moir, Gavin L; Connaboy, Chris

2017-02-01

Rawcliffe, AJ, Simpson, RJ, Graham, SM, Psycharakis, SG, Moir, GL, and Connaboy, C. Reliability of the kinetics of British Army foot drill in untrained personnel. J Strength Cond Res 31(2): 435-444, 2017-The purpose of this study was to quantify the reliability of kinetic variables of British Army foot drill performance within untrained civilians and report the magnitude of vertical ground reaction force (vGRF) and vertical rate of force development (RFD) of foot drills. Fifteen recreational active males performed 3 testing sessions across a 1-week period, with each session separated by 24 hours. Within each testing session participants (mean ± SD; age 22.4 ± 1.7 years; height 177 ± 5.6 cm; weight 83 ± 8.7 kg) completed 10 trials of stand-at-attention (SaA), stand-at-ease (SaE), Halt, quick-march (QM) and a normal walking gait, with vGRF and vertical RFD measured on a force plate. Between-session and within-session reliability was calculated as systematic bias, coefficient of variation calculated from the typical error (CVte%), and intraclass correlation coefficient (ICC). Significant (p ≤ 0.05) between-session differences were found for the vGRF SaA and SaE, and vertical RFD SaA and SaE conditions. Significant (p ≤ 0.05) within-session differences were found for the vGRF SaA and SaE conditions. A mean vGRF CVte% ≤10% was observed across all foot drills. However, the mean vertical RFD CVte% observed was ≥10% (excluding SaE) across all foot drills. The ICC analyses indicated that the vGRF Halt, QM, SaA, and Walk condition achieved moderate to large levels of test-retest reliability, with only SaE failing to achieve an ICC value ≥0.75. The vertical RFD QM, SaE, and Walk condition achieved moderate levels of test-retest reliability, with Halt and SaA failing to achieve an ICC value ≥0.75. It was determined that a single familiarization session and using the mean of 8 trials of vGRF are required to achieve acceptable levels of reliability.

The Music Therapy Session Assessment Scale (MT-SAS): Validation of a new tool for music therapy process evaluation.

PubMed

Raglio, Alfredo; Gnesi, Marco; Monti, Maria Cristina; Oasi, Osmano; Gianotti, Marta; Attardo, Lapo; Gontero, Giulia; Morotti, Lara; Boffelli, Sara; Imbriani, Chiara; Montomoli, Cristina; Imbriani, Marcello

2017-11-01

Music therapy (MT) interventions are aimed at creating and developing a relationship between patient and therapist. However, there is a lack of validated observational instruments to consistently evaluate the MT process. The purpose of this study was the validation of Music Therapy Session Assessment Scale (MT-SAS), designed to assess the relationship between therapist and patient during active MT sessions. Videotapes of a single 30-min session per patient were considered. A pilot study on the videotapes of 10 patients was carried out to help refine the items, define the scoring system and improve inter-rater reliability among the five raters. Then, a validation study on 100 patients with different clinical conditions was carried out. The Italian MT-SAS was used throughout the process, although we also provide an English translation. The final scale consisted of 7 binary items accounting for eye contact, countenance, and nonverbal and sound-music communication. In the pilot study, raters were found to share an acceptable level of agreement in their assessments. Explorative factorial analysis disclosed a single homogeneous factor including 6 items (thus supporting an ordinal total score), with only the item about eye contact being unrelated to the others. Moreover, the existence of 2 different archetypal profiles of attuned and disattuned behaviours was highlighted through multiple correspondence analysis. As suggested by the consistent results of 2 different analyses, MT-SAS is a reliable tool that globally evaluates sonorous-musical and nonverbal behaviours related to emotional attunement and empathetic relationship between patient and therapist during active MT sessions. Copyright © 2017 John Wiley & Sons, Ltd.

Test-Retest Reliability of Measures Commonly Used to Measure Striatal Dysfunction across Multiple Testing Sessions: A Longitudinal Study.

PubMed

Palmer, Clare E; Langbehn, Douglas; Tabrizi, Sarah J; Papoutsi, Marina

2017-01-01

Cognitive impairment is common amongst many neurodegenerative movement disorders such as Huntington's disease (HD) and Parkinson's disease (PD) across multiple domains. There are many tasks available to assess different aspects of this dysfunction, however, it is imperative that these show high test-retest reliability if they are to be used to track disease progression or response to treatment in patient populations. Moreover, in order to ensure effects of practice across testing sessions are not misconstrued as clinical improvement in clinical trials, tasks which are particularly vulnerable to practice effects need to be highlighted. In this study we evaluated test-retest reliability in mean performance across three testing sessions of four tasks that are commonly used to measure cognitive dysfunction associated with striatal impairment: a combined Simon Stop-Signal Task; a modified emotion recognition task; a circle tracing task; and the trail making task. Practice effects were seen between sessions 1 and 2 across all tasks for the majority of dependent variables, particularly reaction time variables; some, but not all, diminished in the third session. Good test-retest reliability across all sessions was seen for the emotion recognition, circle tracing, and trail making test. The Simon interference effect and stop-signal reaction time (SSRT) from the combined-Simon-Stop-Signal task showed moderate test-retest reliability, however, the combined SSRT interference effect showed poor test-retest reliability. Our results emphasize the need to use control groups when tracking clinical progression or use pre-baseline training on tasks susceptible to practice effects.

Developing a taxonomy of coordination behaviours in nuclear power plant control rooms during emergencies.

PubMed

Wang, Dunxing; Gao, Qin; Li, Zhizhong; Song, Fei; Ma, Liang

2017-12-01

This study aims to develop a taxonomy of coordination behaviours during emergencies in nuclear power plants (NPPs). We summarised basic coordination behaviours from literature in aviation, health care and nuclear field and identified coordination behaviours specific to the nuclear domain by interviewing and surveying control crew operators. The established taxonomy includes 7 workflow stages and 24 basic coordination behaviours. To evaluate the reliability and feasibility of the taxonomy, we analysed 12 videos of operators' training sessions by coding coordination behaviours with the taxonomy and the inter-rater reliability was acceptable. Further analysis of the frequency, the duration and the direction of the coordination behaviours revealed four coordination problems. This taxonomy provides a foundation of systematic observation of coordination behaviours among NPP crews, advances researchers' understanding of the coordination mechanism during emergencies in NPPs and facilitate the possibility to deepen the understanding of the relationships between coordination behaviours and team performance. Practitioner Summary: A taxonomy of coordination behaviours during emergencies in nuclear power plants was developed. Reliability and feasibility of the taxonomy was verified through the analysis of 12 training sessions. The taxonomy can serve as an observation system for analysis of coordination behaviours and help to identify coordination problems of control crews.

Reliability of a Novel CBCT-Based 3D Classification System for Maxillary Canine Impactions in Orthodontics: The KPG Index

PubMed Central

Visconti, Luca; Martin, Conchita

2013-01-01

The aim of this study was to evaluate both intra- and interoperator reliability of a radiological three-dimensional classification system (KPG index) for the assessment of degree of difficulty for orthodontic treatment of maxillary canine impactions. Cone beam computed tomography (CBCT) scans of fifty impacted canines, obtained using three different scanners (NewTom, Kodak, and Planmeca), were classified using the KPG index by three independent orthodontists. Measurements were repeated one month later. Based on these two sessions, several recommendations on KPG Index scoring were elaborated. After a joint calibration session, these recommendations were explained to nine orthodontists and the two measurement sessions were repeated. There was a moderate intrarater agreement in the precalibration measurement sessions. After the calibration session, both intra- and interrater agreement were almost perfect. Indexes assessed with Kodak Dental Imaging 3D module software showed a better reliability in z-axis values, whereas indexes assessed with Planmeca Romexis software showed a better reliability in x- and y-axis values. No differences were found between the CBCT scanners used. Taken together, these findings indicate that the application of the instructions elaborated during this study improved KPG index reliability, which was nevertheless variously influenced by the use of different software for images evaluation. PMID:24235889

Influence of previous experience on resistance training on reliability of one-repetition maximum test.

PubMed

Ritti-Dias, Raphael Mendes; Avelar, Ademar; Salvador, Emanuel Péricles; Cyrino, Edilson Serpeloni

2011-05-01

The 1-repetition maximum test (1RM) has been widely used to assess maximal strength. However, to improve accuracy in assessing maximal strength, several sessions of the 1RM test are recommended. The aim of this study was to analyze the influence of previous resistance training experience on the reliability of 1RM test. Thirty men were assigned to the following 2 groups according to their previous resistance training experience: no previous resistance training experience (NOEXP) and more than 24 months of resistance training experience (EXP). All subjects performed the 1RM tests in bench press and squat in 4 sessions on distinct days. There was a significant session × group effect in bench press (F = 3.09; p < 0.03) and squat (F = 2.76; p < 0.05) showing that only the NOEXP increased maximal strength between the sessions. Significant increases (p < 0.05) in maximal strength occurred in the NOEXP between session 1 and the other sessions in bench press (session 1 vs. 2 = +3.8%; session 1 vs. 3 = +7.4%; session 1 vs. 4 = +10.1%), and squat (session 1 vs. 2 = +7.6%; session 1 vs. 3 = +10.1%; session 1 vs. 4 = +11.2%). Moreover, in bench press, maximal strength in sessions 3 and 4 were significantly higher than in session 2. The results of the present study suggest that the reliability of the 1RM test is influenced by the subject's previous experience in resistance training. Subjects without experience in resistance training require more practice and familiarization and show greater increases in maximal strength between sessions than subjects with previous experience in resistance training.

The Healthy Brain Network Serial Scanning Initiative: a resource for evaluating inter-individual differences and their reliabilities across scan conditions and sessions

PubMed Central

O’Connor, David; Potler, Natan Vega; Kovacs, Meagan; Xu, Ting; Ai, Lei; Pellman, John; Vanderwal, Tamara; Parra, Lucas C.; Cohen, Samantha; Ghosh, Satrajit; Escalera, Jasmine; Grant-Villegas, Natalie; Osman, Yael; Bui, Anastasia; Craddock, R. Cameron

2017-01-01

Abstract Background: Although typically measured during the resting state, a growing literature is illustrating the ability to map intrinsic connectivity with functional MRI during task and naturalistic viewing conditions. These paradigms are drawing excitement due to their greater tolerability in clinical and developing populations and because they enable a wider range of analyses (e.g., inter-subject correlations). To be clinically useful, the test-retest reliability of connectivity measured during these paradigms needs to be established. This resource provides data for evaluating test-retest reliability for full-brain connectivity patterns detected during each of four scan conditions that differ with respect to level of engagement (rest, abstract animations, movie clips, flanker task). Data are provided for 13 participants, each scanned in 12 sessions with 10 minutes for each scan of the four conditions. Diffusion kurtosis imaging data was also obtained at each session. Findings: Technical validation and demonstrative reliability analyses were carried out at the connection-level using the Intraclass Correlation Coefficient and at network-level representations of the data using the Image Intraclass Correlation Coefficient. Variation in intrinsic functional connectivity across sessions was generally found to be greater than that attributable to scan condition. Between-condition reliability was generally high, particularly for the frontoparietal and default networks. Between-session reliabilities obtained separately for the different scan conditions were comparable, though notably lower than between-condition reliabilities. Conclusions: This resource provides a test-bed for quantifying the reliability of connectivity indices across subjects, conditions and time. The resource can be used to compare and optimize different frameworks for measuring connectivity and data collection parameters such as scan length. Additionally, investigators can explore the unique perspectives of the brain's functional architecture offered by each of the scan conditions. PMID:28369458

The reliability and validity study of the Kinesthetic and Visual Imagery Questionnaire in individuals with Multiple Sclerosis

PubMed Central

Tabrizi, Yousef Moghadas; Zangiabadi, Nasser; Mazhari, Shahrzad; Zolala, Farzaneh

2013-01-01

Objective Motor imagery (MI) has been recently considered as an adjunct to physical rehabilitation in patients with multiple sclerosis (MS). It is necessary to assess MI abilities and benefits in patients with MS by using a reliable tool. The Kinesthetic and Visual Imagery Questionnaire (KVIQ) was recently developed to assess MI ability in patients with stroke and other disabilities. Considering the different underlying pathologies, the present study aimed to examine the validity and reliability of the KVIQ in MS patients. Method Fifteen MS patients were assessed using the KVIQ in 2 sessions (5-14days apart) by the same examiner. In the second session, the participants also completed a revised MI questionnaire (MIQ-R) as the gold standard. Intra-class correlation coefficients (ICCs) were measured to determine test-retest reliability. Spearman's correlation analysis was performed to assess concurrent validity with the MIQ-R. Furthermore, the internal consistency (Cronbach's alpha) and factorial structure of the KVIQ were studied. Results The test-retest reliability for the KVIQ was good (ICCs: total KVIQ=0.89, visual KVIQ=0.85, and kinesthetic KVIQ=0.93), and the concurrent validity between the KVIQ and MIQ-R was good (r=0.79). The KVIQ had good internal consistency, with high Cronbach's alpha (alpha=0.84). Factorial analysis showed the bi-factorial structure of the KVIQ, which was explained by visual=57.6% and kinesthetic=32.4%. Conclusions The results of the present study revealed that the KVIQ is a valid and reliable tool for assessing MI in MS patients. PMID:24271091

The reliability and validity study of the Kinesthetic and Visual Imagery Questionnaire in individuals with multiple sclerosis.

PubMed

Tabrizi, Yousef Moghadas; Zangiabadi, Nasser; Mazhari, Shahrzad; Zolala, Farzaneh

2013-01-01

Motor imagery (MI) has been recently considered as an adjunct to physical rehabilitation in patients with multiple sclerosis (MS). It is necessary to assess MI abilities and benefits in patients with MS by using a reliable tool. The Kinesthetic and Visual Imagery Questionnaire (KVIQ) was recently developed to assess MI ability in patients with stroke and other disabilities. Considering the different underlying pathologies, the present study aimed to examine the validity and reliability of the KVIQ in MS patients. Fifteen MS patients were assessed using the KVIQ in 2 sessions (5-14 days apart) by the same examiner. In the second session, the participants also completed a revised MI questionnaire (MIQ-R) as the gold standard. Intra-class correlation coefficients (ICCs) were measured to determine test-retest reliability. Spearman's correlation analysis was performed to assess concurrent validity with the MIQ-R. Furthermore, the internal consistency (Cronbach's alpha) and factorial structure of the KVIQ were studied. The test-retest reliability for the KVIQ was good (ICCs: total KVIQ=0.89, visual KVIQ=0.85, and kinesthetic KVIQ=0.93), and the concurrent validity between the KVIQ and MIQ-R was good (r=0.79). The KVIQ had good internal consistency, with high Cronbach's alpha (alpha=0.84). Factorial analysis showed the bi-factorial structure of the KVIQ, which was explained by visual=57.6% and kinesthetic=32.4%. The results of the present study revealed that the KVIQ is a valid and reliable tool for assessing MI in MS patients.

A novel magnet based 3D printed marker wand as basis for repeated in-shoe multi segment foot analysis: a proof of concept.

PubMed

Eerdekens, Maarten; Staes, Filip; Pilkington, Thomas; Deschamps, Kevin

2017-01-01

Application of in-shoe multi-segment foot kinematic analyses currently faces a number of challenges, including: (i) the difficulty to apply regular markers onto the skin, (ii) the necessity for an adequate shoe which fits various foot morphologies and (iii) the need for adequate repeatability throughout a repeated measure condition. The aim of this study therefore was to design novel magnet based 3D printed markers for repeated in-shoe measurements while using accordingly adapted modified shoes for a specific multi-segment foot model. Multi-segment foot kinematics of ten participants were recorded and kinematics of hindfoot, midfoot and forefoot were calculated. Dynamic trials were conducted to check for intra and inter-session repeatability when combining novel markers and modified shoes in a repeated measures design. Intraclass correlation coefficients were calculated to determine reliability. Both repeatability and reliability were proven to be good to excellent with maximum joint angle deviations of 1.11° for intra-session variability and 1.29° for same-day inter-session variability respectively and ICC values of >0.91. The novel markers can be reliably used in future research settings using in-shoe multi-segment foot kinematic analyses with multiple shod conditions.

Test-retest reliability of diffusion tensor imaging of the liver at 3.0 T.

PubMed

Girometti, Rossano; Maieron, Marta; Lissandrello, Giovanni; Bazzocchi, Massimo; Zuiani, Chiara

2015-06-01

This study was done to evaluate test-retest reliability of liver diffusion tensor imaging (LDTI). Ten healthy volunteers (median age 23 years) underwent two LDTI scans on a 3.0 T magnet during two imaging sessions separated by 2 weeks (session-1/-2, respectively). Fifteen gradient directions and b values of 0-1,000 s/mm(2) were used. Two radiologists in consensus assessed liver apparent diffusion coefficient (ADC) and fraction of anisotropy (FA) values on ADC and FA maps at four reference levels, namely: right upper level (RUL), right lower level (RLL), left upper level (LUL) and left lower level (LLL). We then assessed (a) whether ADC and FA values overlapped when measured on different levels within the same imaging session or between different imaging sessions; (b) the degree of variability on an intra-session and inter-session basis, respectively, using the coefficient of variation (CV). In sessions 1 and 2, the ADC/FA values were significantly larger in the left liver lobe (LUL/LLL) compared to right liver lobe (RUL/RLL) (p < 0.05/6). Intra-session CVs were 9.51 % (session 1) and 9.73 % (session 2) for ADC, and 12.93 % (session 1) and 11.82 % (session 2) for FA, respectively. When comparing RUL, RLL, LUL and LLL on an inter-session basis, CVs were 6.52, 8.20, 6.52 and 11.06 % for ADC, and 15.42, 15.80, 15.42 and 6.80 % for FA, respectively. LDTI provides consistent and repeatable measurements. However, since larger left lobe ADC/FA values can be attributed to artefacts, right lobe values should be considered the most reliable measurements of water diffusivity within the liver.

Reliability of the Superimposed-Burst Technique in Patients With Patellofemoral Pain: A Technical Report.

PubMed

Norte, Grant E; Frye, Jamie L; Hart, Joseph M

2015-11-01

The superimposed-burst (SIB) technique is commonly used to quantify central activation failure after knee-joint injury, but its reliability has not been established in pathologic cohorts. To assess within-session and between-sessions reliability of the SIB technique in patients with patellofemoral pain. Descriptive laboratory study. University laboratory. A total of 10 patients with self-reported patellofemoral pain (1 man, 9 women; age = 24.1 ± 3.8 years, height = 167.8 ± 15.2 cm, mass = 71.6 ± 17.5 kg) and 10 healthy control participants (3 men, 7 women; age = 27.4 ± 5.0 years, height = 173.5 ± 9.9 cm, mass = 78.2 ± 16.5 kg) volunteered. Participants were assessed at 6 intervals spanning 21 days. Intraclass correlation coefficients (ICCs [3,3]) were used to assess reliability. Quadriceps central activation ratio, knee-extension maximal voluntary isometric contraction force, and SIB force. The quadriceps central activation ratio was highly reliable within session (ICC [3,3] = 0.97) and between sessions through day 21 (ICC [3,3] = 0.90-0.95). Acceptable reliability of knee extension (ICC [3,3] = 0.75-0.91) and SIB force (ICC [3,3] = 0.77-0.89) was observed through day 21. The SIB technique was reliable for clinical research up to 21 days in patients with patellofemoral pain.

Effects of extended lay-off periods on performance and operator trust under adaptable automation.

PubMed

Chavaillaz, Alain; Wastell, David; Sauer, Jürgen

2016-03-01

Little is known about the long-term effects of system reliability when operators do not use a system during an extended lay-off period. To examine threats to skill maintenance, 28 participants operated twice a simulation of a complex process control system for 2.5 h, with an 8-month retention interval between sessions. Operators were provided with an adaptable support system, which operated at one of the following reliability levels: 60%, 80% or 100%. Results showed that performance, workload, and trust remained stable at the second testing session, but operators lost self-confidence in their system management abilities. Finally, the effects of system reliability observed at the first testing session were largely found again at the second session. The findings overall suggest that adaptable automation may be a promising means to support operators in maintaining their performance at the second testing session. Copyright © 2015 Elsevier Ltd and The Ergonomics Society. All rights reserved.

Within-Session Stability of Short-Term Heart Rate Variability Measurement

PubMed Central

2016-01-01

Abstract The primary aim of this study was to assess the retest stability of the short-term heart rate variability (HRV) measurement performed within one session and without the use of any intervention. Additionally, a precise investigation of the possible impact of intrinsic biological variation on HRV reliability was also performed. First, a single test-retest HRV measurement was conducted with 20-30 min apart from one another. Second, the HRV measurement was repeated in ten non-interrupted consecutive intervals. The lowest typical error (CV = 21.1%) was found for the square root of the mean squared differences of successive RR intervals (rMSSD) and the highest for the low frequency power (PLF) (CV = 93.9%). The standardized changes in the mean were trivial to small. The correlation analysis revealed the highest level for ln rMSSD (ICC = 0.87), while ln PLF represented the worst case (ICC = 0.59). The reliability indices for ln rMSSD in 10 consecutive intervals improved (CV = 9.9%; trivial standardized changes in the mean; ICC = 0.96). In conclusion, major differences were found in the reliability level between the HRV indices. The rMSSD demonstrated the highest reliability level. No substantial influence of intrinsic biological variation on the HRV reliability was observed. PMID:28149345

Inertial Measurement Units for Clinical Movement Analysis: Reliability and Concurrent Validity

PubMed Central

Nicholas, Kevin; Sparkes, Valerie; Sheeran, Liba; Davies, Jennifer L

2018-01-01

The aim of this study was to investigate the reliability and concurrent validity of a commercially available Xsens MVN BIOMECH inertial-sensor-based motion capture system during clinically relevant functional activities. A clinician with no prior experience of motion capture technologies and an experienced clinical movement scientist each assessed 26 healthy participants within each of two sessions using a camera-based motion capture system and the MVN BIOMECH system. Participants performed overground walking, squatting, and jumping. Sessions were separated by 4 ± 3 days. Reliability was evaluated using intraclass correlation coefficient and standard error of measurement, and validity was evaluated using the coefficient of multiple correlation and the linear fit method. Day-to-day reliability was generally fair-to-excellent in all three planes for hip, knee, and ankle joint angles in all three tasks. Within-day (between-rater) reliability was fair-to-excellent in all three planes during walking and squatting, and poor-to-high during jumping. Validity was excellent in the sagittal plane for hip, knee, and ankle joint angles in all three tasks and acceptable in frontal and transverse planes in squat and jump activity across joints. Our results suggest that the MVN BIOMECH system can be used by a clinician to quantify lower-limb joint angles in clinically relevant movements. PMID:29495600

Reliability and Minimum Detectable Change of the Gait Deviation Index (GDI) in post-stroke patients.

PubMed

Correa, Katren Pedroso; Devetak, Gisele Francini; Martello, Suzane Ketlyn; de Almeida, Juliana Carla; Pauleto, Ana Carolina; Manffra, Elisangela Ferretti

2017-03-01

The Gait Deviation Index (GDI) is a summary measure that provides a global picture of gait kinematic data. Since the ability to walk is critical for post-stroke patients, the aim of this study was to determine the reliability and Minimum Detectable Change (MDC) of the GDI in this patient population. Twenty post-stroke patients (11 males, 9 females; mean age, 55.2±9.9years) participated in this study. Patients presented with either right- (n=14) or left-sided (n=6) hemiparesis. Kinematic gait data were collected in two sessions (test and retest) that were 2 to 7days apart. GDI values in the first and second sessions were, respectively, 59.0±8.1 and 60.2±9.4 for the paretic limb and 53.3±8.3 and 53.4±8.3 for the non-paretic limb. The reliability in each session was determined by the intra-class correlation coefficient (ICC) of three strides and, in the test session, their values were 0.91 and 0.97 for the paretic and non-paretic limbs, respectively. Between-session reliability and MDC were determined using the average GDI of three strides from each session. For the paretic limb, between-session ICC, standard error of measurement (SEM), and MDC were 0.84, 3.4 and 9.4, respectively. Non paretic lower limb exhibited between-session ICC, standard error of measurement (SEM), and MDC of 0.89, 2.7 and 7.5, respectively. These MDC values indicate that very large changes in GDI are required to identify gait improvement. Therefore, the clinical usefulness of GDI with stroke patients is questionable. Copyright © 2017 Elsevier B.V. All rights reserved.

Reliability of the Adult Myopathy Assessment Tool in Individuals with Myositis

PubMed Central

Harris-Love, Michael O.; Joe, Galen; Davenport, Todd E.; Koziol, Deloris; Rose, Kristen Abbett; Shrader, Joseph A.; Vasconcelos, Olavo M.; McElroy, Beverly; Dalakas, Marinos C.

2015-01-01

Objective The Adult Myopathy Assessment Tool (AMAT) is a 13-item performance-based battery developed to assess functional status and muscle endurance. The purpose of this study was to determine the intrarater and interrater reliability of the AMAT in adults with myosits. Methods Nineteen raters (13 physical therapists and 6 physicians) scored videotaped recordings of patients with myositis performing the AMAT for a total of 114 tests and 1,482 item observations per session. Raters rescored the AMAT test and item observations during a follow up session (19 ±6 days between scoring sessions). All raters completed a single, self-directed, electronic training module prior to the initial scoring session. Results Intrarater and interrater reliability correlation coefficients were .94 or greater for the AMAT Functional Subscale, Endurance Subscale, and Total score (all p < 0.02 for Ho:ρ ≤ 0.75). All AMAT items had satisfactory intrarater agreement (Kappa statistics with Fleiss-Cohen weights, Kw = .57-1.00). Interrater agreement was acceptable for each AMAT item (K = .56-.89) except the sit up (K = .16). The standard error of measurement and 95% confidence interval range for the AMAT Total scores did not exceed 2 points across all observations (AMAT Total score range = 0-45). Conclusions The AMAT is a reliable, domain-specific assessment of functional status and muscle endurance for adult subjects with myositis. Results of this study suggest that physicians and physical therapists may reliably score the AMAT following a single training session. The AMAT Functional Subscale, Endurance Subscale, and Total score exhibit interrater and intrarater reliability suitable for clinical and research use. PMID:25201624

Body mass changes during training in elite rugby union: Is a single test of hydration indices reliable?

PubMed

Black, Katherine Elizabeth; Black, Alistair David; Baker, Dane; Fairbairn, Kirsty

2018-05-28

There is limited research studying fluid and electrolyte balance in rugby union players, and a paucity of information regarding the test-retest reliability. This study describes the fluid balance of elite rugby union players across multiple squads and the reliability of fluid balance measures between two equivalent training sessions. Sixty-one elite rugby players completed a single fluid balance testing session during a game simulation training session. A subsample of 21 players completed a second fluid balance testing session during an equivalent training session. Players were weighed in minimal clothing before and after each training session. Each player was provided with their own drinks which were weighed before and after each training session. More players gained body weight (9 (14.8%)) during training than lost greater than 2% of their initial body mass (1 (1.6%)). Pre-training body mass and rate of fluid loss were significantly associated (r = 0.318, p = .013). There was a significant correlation between rate of fluid loss in sessions 1 (1.74 ± 0.32 L h -1 ) and 2 (1.10 ± 0.31 L. h -1 ), (r = 0.470, p = .032). This could be useful for nutritionists working with rugby squads to identify players with high sweat losses.

Within- and between-session reliability of the maximal voluntary knee extension torque and activation.

PubMed

Park, Jihong; Hopkins, J Ty

2013-01-01

A ratio between the torque generated by maximal voluntary isometric contraction (MVIC) and exogenous electrical stimulus, central activation ratio (CAR), has been widely used to assess quadriceps function. To date, no data exist regarding between-session reliability of this measurement. Thirteen neurologically sound volunteers underwent three testing sessions (three trials per session) with 48 hours between-session. Subjects performed MVICs of the quadriceps with the knee locked at 90° flexion and the hip at 85°. Once the MVIC reached a plateau, an electrical stimulation from superimposed burst technique (SIB: 125 V with peak output current 450 mA) was manually delivered and transmitted directly to the quadriceps via stimulating electrodes. CAR was calculated by using the following equation: CAR = MVIC torque/MVIC + SIB torque. Intraclass correlation coefficients (ICC) were calculated within- (ICC((2,1))) and between-session (ICC((2,k))) for MVIC torques and CAR values. Our data show that quadriceps MVIC and CAR are very reliable both within- (ICC((2,1)) = 0.99 for MVIC; 0.94 for CAR) and between-measurement sessions (ICC((2,k)) = 0.92 for MVIC; 0.86 for CAR) in healthy young adults. For clinical research, more data of the patients with pathological conditions are required to ensure reproducibility of calculation of CAR.

Cluster-based upper body marker models for three-dimensional kinematic analysis: Comparison with an anatomical model and reliability analysis.

PubMed

Boser, Quinn A; Valevicius, Aïda M; Lavoie, Ewen B; Chapman, Craig S; Pilarski, Patrick M; Hebert, Jacqueline S; Vette, Albert H

2018-04-27

Quantifying angular joint kinematics of the upper body is a useful method for assessing upper limb function. Joint angles are commonly obtained via motion capture, tracking markers placed on anatomical landmarks. This method is associated with limitations including administrative burden, soft tissue artifacts, and intra- and inter-tester variability. An alternative method involves the tracking of rigid marker clusters affixed to body segments, calibrated relative to anatomical landmarks or known joint angles. The accuracy and reliability of applying this cluster method to the upper body has, however, not been comprehensively explored. Our objective was to compare three different upper body cluster models with an anatomical model, with respect to joint angles and reliability. Non-disabled participants performed two standardized functional upper limb tasks with anatomical and cluster markers applied concurrently. Joint angle curves obtained via the marker clusters with three different calibration methods were compared to those from an anatomical model, and between-session reliability was assessed for all models. The cluster models produced joint angle curves which were comparable to and highly correlated with those from the anatomical model, but exhibited notable offsets and differences in sensitivity for some degrees of freedom. Between-session reliability was comparable between all models, and good for most degrees of freedom. Overall, the cluster models produced reliable joint angles that, however, cannot be used interchangeably with anatomical model outputs to calculate kinematic metrics. Cluster models appear to be an adequate, and possibly advantageous alternative to anatomical models when the objective is to assess trends in movement behavior. Copyright © 2018 Elsevier Ltd. All rights reserved.

Test-Retest Reliability of Respiratory Resistance Measured with the Airflow Perturbation Device

ERIC Educational Resources Information Center

Gallena, Sally K.; Solomon, Nancy Pearl; Johnson, Arthur T.; Vossoughi, Jafar; Tian, Wei

2014-01-01

Purpose: In this study, the authors aimed to determine reliability of the airflow perturbation device (APD) to measure respiratory resistance within and across sessions during resting tidal (RTB) and postexercise breathing in healthy athletes, and during RTB across trials within a session in athletes with paradoxical vocal fold motion (PVFM)…

The Healthy Brain Network Serial Scanning Initiative: a resource for evaluating inter-individual differences and their reliabilities across scan conditions and sessions.

PubMed

O'Connor, David; Potler, Natan Vega; Kovacs, Meagan; Xu, Ting; Ai, Lei; Pellman, John; Vanderwal, Tamara; Parra, Lucas C; Cohen, Samantha; Ghosh, Satrajit; Escalera, Jasmine; Grant-Villegas, Natalie; Osman, Yael; Bui, Anastasia; Craddock, R Cameron; Milham, Michael P

2017-02-01

Although typically measured during the resting state, a growing literature is illustrating the ability to map intrinsic connectivity with functional MRI during task and naturalistic viewing conditions. These paradigms are drawing excitement due to their greater tolerability in clinical and developing populations and because they enable a wider range of analyses (e.g., inter-subject correlations). To be clinically useful, the test-retest reliability of connectivity measured during these paradigms needs to be established. This resource provides data for evaluating test-retest reliability for full-brain connectivity patterns detected during each of four scan conditions that differ with respect to level of engagement (rest, abstract animations, movie clips, flanker task). Data are provided for 13 participants, each scanned in 12 sessions with 10 minutes for each scan of the four conditions. Diffusion kurtosis imaging data was also obtained at each session. Technical validation and demonstrative reliability analyses were carried out at the connection-level using the Intraclass Correlation Coefficient and at network-level representations of the data using the Image Intraclass Correlation Coefficient. Variation in intrinsic functional connectivity across sessions was generally found to be greater than that attributable to scan condition. Between-condition reliability was generally high, particularly for the frontoparietal and default networks. Between-session reliabilities obtained separately for the different scan conditions were comparable, though notably lower than between-condition reliabilities. This resource provides a test-bed for quantifying the reliability of connectivity indices across subjects, conditions and time. The resource can be used to compare and optimize different frameworks for measuring connectivity and data collection parameters such as scan length. Additionally, investigators can explore the unique perspectives of the brain's functional architecture offered by each of the scan conditions. © The Author 2017. Published by Oxford University Press.

Interrater and Intrarater Reliability of the Tuck Jump Assessment by Health Professionals of Varied Educational Backgrounds

PubMed Central

Dudley, Lisa A.; Smith, Craig A.; Olson, Brandon K.; Chimera, Nicole J.

2013-01-01

Objective. The Tuck Jump Assessment (TJA), a clinical plyometric assessment, identifies 10 jumping and landing technique flaws. The study objective was to investigate TJA interrater and intrarater reliability with raters of different educational and clinical backgrounds. Methods. 40 participants were video recorded performing the TJA using published protocol and instructions. Five raters of varied educational and clinical backgrounds scored the TJA. Each score of the 10 technique flaws was summed for the total TJA score. Approximately one month later, 3 raters scored the videos again. Intraclass correlation coefficients determined interrater (5 and 3 raters for first and second session, resp.) and intrarater (3 raters) reliability. Results. Interrater reliability with 5 raters was poor (ICC = 0.47; 95% confidence intervals (CI) 0.33–0.62). Interrater reliability between 3 raters who completed 2 scoring sessions improved from 0.52 (95% CI 0.35–0.68) for session one to 0.69 (95% CI 0.55–0.81) for session two. Intrarater reliability was poor to moderate, ranging from 0.44 (95% CI 0.22–0.68) to 0.72 (95% CI 0.55–0.84). Conclusion. Published protocol and training of raters were insufficient to allow consistent TJA scoring. There may be a learned effect with the TJA since interrater reliability improved with repetition. TJA instructions and training should be modified and enhanced before clinical implementation. PMID:26464881

Reliable and fast volumetry of the lumbar spinal cord using cord image analyser (Cordial).

PubMed

Tsagkas, Charidimos; Altermatt, Anna; Bonati, Ulrike; Pezold, Simon; Reinhard, Julia; Amann, Michael; Cattin, Philippe; Wuerfel, Jens; Fischer, Dirk; Parmar, Katrin; Fischmann, Arne

2018-04-30

To validate the precision and accuracy of the semi-automated cord image analyser (Cordial) for lumbar spinal cord (SC) volumetry in 3D T1w MRI data of healthy controls (HC). 40 3D T1w images of 10 HC (w/m: 6/4; age range: 18-41 years) were acquired at one 3T-scanner in two MRI sessions (time interval 14.9±6.1 days). Each subject was scanned twice per session, allowing determination of test-retest reliability both in back-to-back (intra-session) and scan-rescan images (inter-session). Cordial was applied for lumbar cord segmentation twice per image by two raters, allowing for assessment of intra- and inter-rater reliability, and compared to a manual gold standard. While manually segmented volumes were larger (mean: 2028±245 mm 3 vs. Cordial: 1636±300 mm 3 , p<0.001), accuracy assessments between manually and semi-automatically segmented images showed a mean Dice-coefficient of 0.88±0.05. Calculation of within-subject coefficients of variation (COV) demonstrated high intra-session (1.22-1.86%), inter-session (1.26-1.84%), as well as intra-rater (1.73-1.83%) reproducibility. No significant difference was shown between intra- and inter-session reproducibility or between intra-rater reliabilities. Although inter-rater reproducibility (COV: 2.87%) was slightly lower compared to all other reproducibility measures, between rater consistency was very strong (intraclass correlation coefficient: 0.974). While under-estimating the lumbar SCV, Cordial still provides excellent inter- and intra-session reproducibility showing high potential for application in longitudinal trials. • Lumbar spinal cord segmentation using the semi-automated cord image analyser (Cordial) is feasible. • Lumbar spinal cord is 40-mm cord segment 60 mm above conus medullaris. • Cordial provides excellent inter- and intra-session reproducibility in lumbar spinal cord region. • Cordial shows high potential for application in longitudinal trials.

Sensory analysis of lipstick.

PubMed

Yap, K C S; Aminah, A

2011-06-01

Sensory analysis of lipstick product by trained panellists started with recruiting female panels who are lipstick users, in good health condition and willing to be a part of sensory members. This group of people was further scrutinized with duo-trio method using commercial lipstick samples that are commonly used among them. About 40% of the 15 panels recruited were unable to differentiate the lipstick samples they usually use better than chance. The balance of nine panels that were corrected at least with 65% across all trials in panels screening process was formed a working group to develop sensory languages as a means of describing product similarities and differences and a scoring system. Five sessions with each session took about 90 min were carried out using 10 types of lipsticks with different waxes mixture ratio in the formulation together with six commercial lipsticks that are the most common to the panels. First session was focus on listing out the panels' perception towards the characteristic of the lipstick samples after normal application on their lips. Second session was focus on the refining and categorizing the responses gathered from the first session and translated into sensory attributes with its definition. Third session was focus on the scoring system. Fourth and fifth sessions were repetition of the third session to ensure consistency. In a collective effort of the panels, sensory attributes developed for lipstick were Spreadability, Off flavour, Hardness, Smoothness, Moist, Not messy, Glossy and Greasy. Analysis of variance was able to provide ample evidence on gauging the panel performance. A proper panels selecting and training was able to produce a reliable and sensitive trained panel for evaluating the product based on the procedures being trained. © 2011 The Authors. ICS © 2011 Society of Cosmetic Scientists and the Société Française de Cosmétologie.

Reliability of bounce drop jump parameters within elite male rugby players.

PubMed

Costley, Lisa; Wallace, Eric; Johnston, Michael; Kennedy, Rodney

2017-07-25

The aims of the study were to investigate the number of familiarisation sessions required to establish reliability of the bounce drop jump (BDJ) and subsequent reliability once familiarisation is achieved. Seventeen trained male athletes completed 4 BDJs in 4 separate testing sessions. Force-time data from a 20 cm BDJ was obtained using two force plates (ensuring ground contact < 250 ms). Subjects were instructed to 'jump for maximal height and minimal contact time' while the best and average of four jumps were compared. A series of performance variables were assessed in both eccentric and concentric phases including jump height, contact time, flight time, reactive strength index (RSI), peak power, rate of force development (RFD) and actual dropping height (ADH). Reliability was assessed using the intraclass correlation coefficient (ICC) and coefficient of variation (CV) while familiarisation was assessed using a repeated measures analysis of variance (ANOVA). The majority of DJ parameters exhibited excellent reliability with no systematic bias evident, while the average of 4 trials provided greater reliability. With the exception of vertical stiffness (CV: 12.0 %) and RFD (CV: 16.2 %) all variables demonstrated low within subject variation (CV range: 3.1 - 8.9 %). Relative reliability was very poor for ADH, with heights ranging from 14.87 - 29.85 cm. High levels of reliability can be obtained from the BDJ with the exception of vertical stiffness and RFD, however, extreme caution must be taken when comparing DJ results between individuals and squads due to large discrepancies between actual drop height and platform height.

A Multirater Instrument for the Assessment of Simulated Pediatric Crises

PubMed Central

Calhoun, Aaron W; Boone, Megan; Miller, Karen H; Taulbee, Rebecca L; Montgomery, Vicki L; Boland, Kimberly

2011-01-01

Background Few validated instruments exist to measure pediatric code team skills. The goal of this study was to develop an instrument for the assessment of resuscitation competency and self-appraisal using multirater and gap analysis methodologies. Methods Multirater assessment with gap analysis is a robust methodology that enables the measurement of self-appraisal as well as competency, offering faculty the ability to provide enhanced feedback. The Team Performance during Simulated Crises Instrument (TPDSCI) was grounded in the Accreditation Council for Graduate Medical Education competencies. The instrument contains 5 competencies, each assessed by a series of descriptive rubrics. It was piloted during a series of simulation-based interdisciplinary pediatric crisis resource management education sessions. Course faculty assessed participants, who also did self-assessments. Internal consistency and interrater reliability were analyzed using Cronbach α and intraclass correlation (ICC) statistics. Gap analysis results were examined descriptively. Results Cronbach α for the instrument was between 0.72 and 0.69. The overall ICC was 0.82. ICC values for the medical knowledge, clinical skills, communication skills, and systems-based practice were between 0.87 and 0.72. The ICC for the professionalism domain was 0.22. Further examination of the professionalism competency revealed a positive skew, 43 simulated sessions (98%) had significant gaps for at least one of the competencies, 38 sessions (86%) had gaps indicating self-overappraisal, and 15 sessions (34%) had gaps indicating self-underappraisal. Conclusions The TPDSCI possesses good measures of internal consistency and interrater reliability with respect to medical knowledge, clinical skills, communication skills, systems-based practice, and overall competence in the context of simulated interdisciplinary pediatric medical crises. Professionalism remains difficult to assess. These results provide an encouraging first step toward instrument validation. Gap analysis reveals disparities between faculty and self-assessments that indicate inadequate participant self-reflection. Identifying self-overappraisal can facilitate focused interventions. PMID:22379528

Coder Drift: A Reliability Problem for Teacher Observations.

ERIC Educational Resources Information Center

Marston, Paul T.; And Others

The results of two experiments support the hypothesis of "coder drift" which is defined as change that takes place while trained coders are using a system for a number of classroom observation sessions. The coding system used was a modification of the low-inference Flanders System of Interaction Analysis which calls for assigning…

Short- and long-term reliability of language fMRI.

PubMed

Nettekoven, Charlotte; Reck, Nicola; Goldbrunner, Roland; Grefkes, Christian; Weiß Lucas, Carolin

2018-08-01

When using functional magnetic resonance imaging (fMRI) for mapping important language functions, a high test-retest reliability is mandatory, both in basic scientific research and for clinical applications. We, therefore, systematically tested the short- and long-term reliability of fMRI in a group of healthy subjects using a picture naming task and a sparse-sampling fMRI protocol. We hypothesized that test-retest reliability might be higher for (i) speech-related motor areas than for other language areas and for (ii) the short as compared to the long intersession interval. 16 right-handed subjects (mean age: 29 years) participated in three sessions separated by 2-6 (session 1 and 2, short-term) and 21-34 days (session 1 and 3, long-term). Subjects were asked to perform the same overt picture naming task in each fMRI session (50 black-white images per session). Reliability was tested using the following measures: (i) Euclidean distances (ED) between local activation maxima and Centers of Gravity (CoGs), (ii) overlap volumes and (iii) voxel-wise intraclass correlation coefficients (ICCs). Analyses were performed for three regions of interest which were chosen based on whole-brain group data: primary motor cortex (M1), superior temporal gyrus (STG) and inferior frontal gyrus (IFG). Our results revealed that the activation centers were highly reliable, independent of the time interval, ROI or hemisphere with significantly smaller ED for the local activation maxima (6.45 ± 1.36 mm) as compared to the CoGs (8.03 ± 2.01 mm). In contrast, the extent of activation revealed rather low reliability values with overlaps ranging from 24% (IFG) to 56% (STG). Here, the left hemisphere showed significantly higher overlap volumes than the right hemisphere. Although mean ICCs ranged between poor (ICC<0.5) and moderate (ICC 0.5-0.74) reliability, highly reliable voxels (ICC>0.75) were found for all ROIs. Voxel-wise reliability of the different ROIs was influenced by the intersession interval. Taken together, we could show that, despite of considerable ROI-dependent variations of the extent of activation over time, highly reliable centers of activation can be identified using an overt picture naming paradigm. Copyright © 2018 Elsevier Inc. All rights reserved.

Content Coding of Psychotherapy Transcripts Using Labeled Topic Models.

PubMed

Gaut, Garren; Steyvers, Mark; Imel, Zac E; Atkins, David C; Smyth, Padhraic

2017-03-01

Psychotherapy represents a broad class of medical interventions received by millions of patients each year. Unlike most medical treatments, its primary mechanisms are linguistic; i.e., the treatment relies directly on a conversation between a patient and provider. However, the evaluation of patient-provider conversation suffers from critical shortcomings, including intensive labor requirements, coder error, nonstandardized coding systems, and inability to scale up to larger data sets. To overcome these shortcomings, psychotherapy analysis needs a reliable and scalable method for summarizing the content of treatment encounters. We used a publicly available psychotherapy corpus from Alexander Street press comprising a large collection of transcripts of patient-provider conversations to compare coding performance for two machine learning methods. We used the labeled latent Dirichlet allocation (L-LDA) model to learn associations between text and codes, to predict codes in psychotherapy sessions, and to localize specific passages of within-session text representative of a session code. We compared the L-LDA model to a baseline lasso regression model using predictive accuracy and model generalizability (measured by calculating the area under the curve (AUC) from the receiver operating characteristic curve). The L-LDA model outperforms the lasso logistic regression model at predicting session-level codes with average AUC scores of 0.79, and 0.70, respectively. For fine-grained level coding, L-LDA and logistic regression are able to identify specific talk-turns representative of symptom codes. However, model performance for talk-turn identification is not yet as reliable as human coders. We conclude that the L-LDA model has the potential to be an objective, scalable method for accurate automated coding of psychotherapy sessions that perform better than comparable discriminative methods at session-level coding and can also predict fine-grained codes.

Content Coding of Psychotherapy Transcripts Using Labeled Topic Models

PubMed Central

Gaut, Garren; Steyvers, Mark; Imel, Zac E; Atkins, David C; Smyth, Padhraic

2016-01-01

Psychotherapy represents a broad class of medical interventions received by millions of patients each year. Unlike most medical treatments, its primary mechanisms are linguistic; i.e., the treatment relies directly on a conversation between a patient and provider. However, the evaluation of patient-provider conversation suffers from critical shortcomings, including intensive labor requirements, coder error, non-standardized coding systems, and inability to scale up to larger data sets. To overcome these shortcomings, psychotherapy analysis needs a reliable and scalable method for summarizing the content of treatment encounters. We used a publicly-available psychotherapy corpus from Alexander Street press comprising a large collection of transcripts of patient-provider conversations to compare coding performance for two machine learning methods. We used the Labeled Latent Dirichlet Allocation (L-LDA) model to learn associations between text and codes, to predict codes in psychotherapy sessions, and to localize specific passages of within-session text representative of a session code. We compared the L-LDA model to a baseline lasso regression model using predictive accuracy and model generalizability (measured by calculating the area under the curve (AUC) from the receiver operating characteristic (ROC) curve). The L-LDA model outperforms the lasso logistic regression model at predicting session-level codes with average AUC scores of .79, and .70, respectively. For fine-grained level coding, L-LDA and logistic regression are able to identify specific talk-turns representative of symptom codes. However, model performance for talk-turn identification is not yet as reliable as human coders. We conclude that the L-LDA model has the potential to be an objective, scaleable method for accurate automated coding of psychotherapy sessions that performs better than comparable discriminative methods at session-level coding and can also predict fine-grained codes. PMID:26625437

The reliability of a maximal isometric hip strength and simultaneous surface EMG screening protocol in elite, junior rugby league athletes.

PubMed

Charlton, Paula C; Mentiplay, Benjamin F; Grimaldi, Alison; Pua, Yong-Hao; Clark, Ross A

2017-02-01

Firstly to describe the reliability of assessing maximal isometric strength of the hip abductor and adductor musculature using a hand held dynamometry (HHD) protocol with simultaneous wireless surface electromyographic (sEMG) evaluation of the gluteus medius (GM) and adductor longus (AL). Secondly, to describe the correlation between isometric strength recorded with the HHD protocol and a laboratory standard isokinetic device. Reliability and correlational study. A sample of 24 elite, male, junior, rugby league athletes, age 16-20 years participated in repeated HHD and isometric Kin-Com (KC) strength testing with simultaneous sEMG assessment, on average (range) 6 (5-7) days apart by a single assessor. Strength tests included; unilateral hip abduction (ABD) and adduction (ADD) and bilateral ADD assessed with squeeze (SQ) tests in 0 and 45° of hip flexion. HHD demonstrated good to excellent inter-session reliability for all outcome measures (ICC (2,1) =0.76-0.91) and good to excellent association with the laboratory reference KC (ICC (2,1) =0.80-0.88). Whilst intra-session, inter-trial reliability of EMG activation and co-activation outcome measures ranged from moderate to excellent (ICC (2,1) =0.70-0.94), inter-session reliability was poor (all ICC (2,1) <0.50). Isometric strength testing of the hip ABD and ADD musculature using HHD may be measured reliably in elite, junior rugby league athletes. Due to the poor inter-session reliability of sEMG measures, it is not recommended for athlete screening purposes if using the techniques implemented in this study. Copyright © 2016 Sports Medicine Australia. Published by Elsevier Ltd. All rights reserved.

Interrater and intrarater reliability in the measurement of ankle joint dorsiflexion is independent of examiner experience and technique used.

PubMed

Kim, Paul Jeong; Peace, Ruth; Mieras, Jamie; Thoms, Tanya; Freeman, Denise; Page, Jeffrey

2011-01-01

Goniometric measurement is currently being used as a diagnostic and outcomes assessment tool for ankle joint dorsiflexion. Despite its common use, its interrater and intrarater reliability has been questioned. This is a prospective study examining whether the experience of the examiner or the technique used affects the interrater and intrarater reliability for measuring ankle joint dorsiflexion. Fourteen asymptomatic individuals (8 male and 6 female) with a mean age of 28.2 years (range, 23-52) were enrolled into this study. The years of clinical experience of the five examiners averaged 10.4 years (range, 0-26). Four examiners used a modified Root, Weed and Orien method of measuring ankle joint dorsiflexion. The fifth examiner utilized a nonstandardized technique. A standard goniometer was used for bilateral measurements of ankle joint dorsiflexion with the knee extended and flexed. All five examiners repeated each measurement three times during each of the three sessions, with each session spaced at least 1 week apart. The interclass correlation coefficient reveals a moderate intrarater and poor interrater reliability in ankle joint dorsiflexion measurements using a standard goniometer. More importantly, further analysis indicates that the use of a standardized technique for measurement of ankle joint dorsiflexion or years of clinical experience does not increase the intrarater or interrater reliability. The utility of the goniometric measurement of ankle joint dorsiflexion may be limited.

Reliability of Strength Testing using the Advanced Resistive Exercise Device and Free Weights

NASA Technical Reports Server (NTRS)

English, Kirk L.; Loehr, James A.; Laughlin, Mitzi A.; Lee, Stuart M. C.; Hagan, R. Donald

2008-01-01

The Advanced Resistive Exercise Device (ARED) was developed for use on the International Space Station as a countermeasure against muscle atrophy and decreased strength. This investigation examined the reliability of one-repetition maximum (1RM) strength testing using ARED and traditional free weight (FW) exercise. Methods: Six males (180.8 +/- 4.3 cm, 83.6 +/- 6.4 kg, 36 +/- 8 y, mean +/- SD) who had not engaged in resistive exercise for at least six months volunteered to participate in this project. Subjects completed four 1RM testing sessions each for FW and ARED (eight total sessions) using a balanced, randomized, crossover design. All testing using one device was completed before progressing to the other. During each session, 1RM was measured for the squat, heel raise, and deadlift exercises. Generalizability (G) and intraclass correlation coefficients (ICC) were calculated for each exercise on each device and were used to predict the number of sessions needed to obtain a reliable 1RM measurement (G . 0.90). Interclass reliability coefficients and Pearson's correlation coefficients (R) also were calculated for the highest 1RM value (1RM9sub peak)) obtained for each exercise on each device to quantify 1RM relationships between devices.

Inter- and intra-operator reliability and repeatability of shear wave elastography in the liver: a study in healthy volunteers.

PubMed

Hudson, John M; Milot, Laurent; Parry, Craig; Williams, Ross; Burns, Peter N

2013-06-01

This study assessed the reproducibility of shear wave elastography (SWE) in the liver of healthy volunteers. Intra- and inter-operator reliability and repeatability were quantified in three different liver segments in a sample of 15 subjects, scanned during four independent sessions (two scans on day 1, two scans 1 wk later) by two operators. A total of 1440 measurements were made. Reproducibility was assessed using the intra-class correlation coefficient (ICC) and a repeated measures analysis of variance. The shear wave speed was measured and used to estimate Young's modulus using the Supersonics Imagine Aixplorer. The median Young's modulus measured through the inter-costal space was 5.55 ± 0.74 kPa. The intra-operator reliability was better for same-day evaluations (ICC = 0.91) than the inter-operator reliability (ICC = 0.78). Intra-observer agreement decreased when scans were repeated on a different day. Inter-session repeatability was between 3.3% and 9.9% for intra-day repeated scans, compared with to 6.5%-12% for inter-day repeated scans. No significant difference was observed in subjects with a body mass index greater or less than 25 kg/m(2). Copyright © 2013 World Federation for Ultrasound in Medicine & Biology. Published by Elsevier Inc. All rights reserved.

The comparative effectiveness and efficiency of cognitive behaviour therapy and generic counselling in the treatment of depression: evidence from the 2nd UK National Audit of psychological therapies.

PubMed

Pybis, Jo; Saxon, David; Hill, Andy; Barkham, Michael

2017-06-09

Cognitive Behaviour Therapy (CBT) is the front-line psychological intervention for step 3 within UK psychological therapy services. Counselling is recommended only when other interventions have failed and its effectiveness has been questioned. A secondary data analysis was conducted of data collected from 33,243 patients across 103 Improving Access to Psychological Therapies (IAPT) services as part of the second round of the National Audit of Psychological Therapies (NAPT). Initial analysis considered levels of pre-post therapy effect sizes (ESs) and reliable improvement (RI) and reliable and clinically significant improvement (RCSI). Multilevel modelling was used to model predictors of outcome, namely patient pre-post change on PHQ-9 scores at last therapy session. Counselling received more referrals from patients experiencing moderate to severe depression than CBT. For patients scoring above the clinical cut-off on the PHQ-9 at intake, the pre-post ES (95% CI) for CBT was 1.59 (1.58, 1.62) with 46.6% making RCSI criteria and for counselling the pre-post ES was 1.55 (1.52, 1.59) with 44.3% of patients meeting RCSI criteria. Multilevel modelling revealed a significant site effect of 1.8%, while therapy type was not a predictor of outcome. A significant interaction was found between the number of sessions attended and therapy type, with patients attending fewer sessions on average for counselling [M = 7.5 (5.54) sessions and a median (IQR) of 6 (3-10)] than CBT [M = 8.9 (6.34) sessions and a median (IQR) of 7 (4-12)]. Only where patients had 18 or 20 sessions was CBT significantly more effective than counselling, with recovery rates (95% CIs) of 62.2% (57.1, 66.9) and 62.4% (56.5, 68.0) respectively, compared with 44.4% (32.7, 56.6) and 42.6% (30.0, 55.9) for counselling. Counselling was significantly more effective at two sessions with a recovery rate of 34.9% (31.9, 37.9) compared with 22.2% (20.5, 24.0) for CBT. Outcomes for counselling and CBT in the treatment of depression were comparable. Research efforts should focus on factors other than therapy type that may influence outcomes, namely the inherent variability between services, and adopt multilevel modelling as the given analytic approach in order to capture the naturally nested nature of the implementation and delivery of psychological therapies. It is of concern that half of all patients, regardless of type of intervention, did not show reliable improvement.

Analysing change in music therapy interactions of children with communication difficulties

PubMed Central

2016-01-01

Music therapy has been found to improve communicative behaviours and joint attention in children with autism, but it is unclear what in the music therapy sessions drives those changes. We developed an annotation protocol and tools to accumulate large datasets of music therapy, for analysis of interaction dynamics. Analysis of video recordings of improvisational music therapy sessions focused on simple, unambiguous individual and shared behaviours: movement and facing behaviours, rhythmic activity and musical structures and the relationships between them. To test the feasibility of the protocol, early and late sessions of five client–therapist pairs were annotated and analysed to track changes in behaviours. To assess the reliability and validity of the protocol, inter-rater reliability of the annotation tiers was calculated, and the therapists provided feedback about the relevance of the analyses and results. This small-scale study suggests that there are both similarities and differences in the profiles of client–therapist sessions. For example, all therapists faced the clients most of the time, while the clients did not face back so often. Conversely, only two pairs had an increase in regular pulse from early to late sessions. More broadly, similarity across pairs at a general level is complemented by variation in the details. This perhaps goes some way to reconciling client- and context-specificity on one hand and generalizability on the other. Behavioural characteristics seem to influence each other. For instance, shared rhythmic pulse alternated with mutual facing and the occurrence of shared pulse was found to relate to the musical structure. These observations point towards a framework for looking at change in music therapy that focuses on networks of variables or broader categories. The results suggest that even when starting with simple behaviours, we can trace aspects of interaction and change in music therapy, which are seen as relevant by therapists. PMID:27069051

Analysing change in music therapy interactions of children with communication difficulties.

PubMed

Spiro, Neta; Himberg, Tommi

2016-05-05

Music therapy has been found to improve communicative behaviours and joint attention in children with autism, but it is unclear what in the music therapy sessions drives those changes. We developed an annotation protocol and tools to accumulate large datasets of music therapy, for analysis of interaction dynamics. Analysis of video recordings of improvisational music therapy sessions focused on simple, unambiguous individual and shared behaviours: movement and facing behaviours, rhythmic activity and musical structures and the relationships between them. To test the feasibility of the protocol, early and late sessions of five client-therapist pairs were annotated and analysed to track changes in behaviours. To assess the reliability and validity of the protocol, inter-rater reliability of the annotation tiers was calculated, and the therapists provided feedback about the relevance of the analyses and results. This small-scale study suggests that there are both similarities and differences in the profiles of client-therapist sessions. For example, all therapists faced the clients most of the time, while the clients did not face back so often. Conversely, only two pairs had an increase in regular pulse from early to late sessions. More broadly, similarity across pairs at a general level is complemented by variation in the details. This perhaps goes some way to reconciling client- and context-specificity on one hand and generalizability on the other. Behavioural characteristics seem to influence each other. For instance, shared rhythmic pulse alternated with mutual facing and the occurrence of shared pulse was found to relate to the musical structure. These observations point towards a framework for looking at change in music therapy that focuses on networks of variables or broader categories. The results suggest that even when starting with simple behaviours, we can trace aspects of interaction and change in music therapy, which are seen as relevant by therapists. © 2016 The Authors.

Test-retest reliability of cognitive EEG

NASA Technical Reports Server (NTRS)

McEvoy, L. K.; Smith, M. E.; Gevins, A.

2000-01-01

OBJECTIVE: Task-related EEG is sensitive to changes in cognitive state produced by increased task difficulty and by transient impairment. If task-related EEG has high test-retest reliability, it could be used as part of a clinical test to assess changes in cognitive function. The aim of this study was to determine the reliability of the EEG recorded during the performance of a working memory (WM) task and a psychomotor vigilance task (PVT). METHODS: EEG was recorded while subjects rested quietly and while they performed the tasks. Within session (test-retest interval of approximately 1 h) and between session (test-retest interval of approximately 7 days) reliability was calculated for four EEG components: frontal midline theta at Fz, posterior theta at Pz, and slow and fast alpha at Pz. RESULTS: Task-related EEG was highly reliable within and between sessions (r0.9 for all components in WM task, and r0.8 for all components in the PVT). Resting EEG also showed high reliability, although the magnitude of the correlation was somewhat smaller than that of the task-related EEG (r0.7 for all 4 components). CONCLUSIONS: These results suggest that under appropriate conditions, task-related EEG has sufficient retest reliability for use in assessing clinical changes in cognitive status.

Intersession reliability of self-selected and narrow stance balance testing in older adults.

PubMed

Riemann, Bryan L; Piersol, Kelsey

2017-10-01

Despite the common practice of using force platforms to assess balance of older adults, few investigations have examined the reliability of postural screening tests in this population. We sought to determine the test-retest reliability of self-selected and narrow stance balance testing with eyes open and eyes closed in healthy older adults. Thirty older adults (>65 years) completed 45 s trials of eyes open and eyes closed stability tests using self-selected and narrow stances on two separate days (1.9 ± .7 days). Average medial-lateral center of pressure velocity was computed. The ICC results ranged from .74 to .86, and no significant systematic changes (P < .05) occurred between the testing sessions for any of the tests. The standard error of measurement ranged from 15.9 to 23.6%. Reliability estimates were similar between the two stances and visual conditions assessed. Slightly higher coefficients were identified for the self-selected stances compared to the narrow stances under both visual conditions; however, there were negligible differences between the sessions. The within subject session-to-session variability provides a basis for further research to consider differences between fallers and non-fallers. Reliability for eyes open and closed balance testing using self-selected and narrow stances in older adults was established which should provide a foundation for the development of fall risk screening tests.

Reliability of a standardized test in Swedish for evaluation of reading performance in healthy eyes. Interchart and test-retest analyses.

PubMed

Thaung, Jörgen; Olseke, Kjell; Ahl, Johan; Sjöstrand, Johan

2014-09-01

The purpose of our study was to establish a practical and quick test for assessing reading performance and to statistically analyse interchart and test-retest reliability of a new standardized Swedish reading chart system consisting of three charts constructed according to the principles available in the literature. Twenty-four subjects with healthy eyes, mean age 65 ± 10 years, were tested binocularly and the reading performance evaluated as reading acuity, critical print size and maximum reading speed. The test charts all consist of 12 short text sentences with a print size ranging from 0.9 to -0.2 logMAR in approximate steps of 0.1 logMAR. Two testing sessions, in two different groups (C1 and C2), were under strict control of luminance and lighting environment. Reading performance tests with chart T1, T2 and T3 were used for evaluation of interchart reliability and test data from a second session 1 month or more apart for the test-retest analysis. The testing of reading performance in adult observers with short sentences of continuous text was quick and practical. The agreement between the tests obtained with the three different test charts was high both within the same test session and at retest. This new Swedish variant of a standardized reading system based on short sentences and logarithmic progression of print size provides reliable measurements of reading performance and preliminary norms in an age group around 65 years. The reading test with three independent reading charts can be useful for clinical studies of reading ability before and after treatment. © 2013 Acta Ophthalmologica Scandinavica Foundation. Published by John Wiley & Sons Ltd.

Test-retest reliability and sensitivity of the 20-meter walk test among patients with knee osteoarthritis.

PubMed

Motyl, Jillian M; Driban, Jeffrey B; McAdams, Erica; Price, Lori Lyn; McAlindon, Timothy E

2013-05-10

The 20-meter walk test is a physical function measure commonly used in clinical research studies and rehabilitation clinics to measure gait speed and monitor changes in patients' physical function over time. Unfortunately, the reliability and sensitivity of this walk test are not well defined and, therefore, limit our ability to evaluate real changes in gait speed not attributable to normal variability. The aim of this study was to assess the test-restest reliability and sensitivity of the 20-meter walk test, at a self-selected pace, among patients with mild to moderate knee osteoarthritis (OA) and to suggest a standardized protocol for future test administration. This was a measurement reliability study. Fifteen consecutive people enrolled in a randomized-controlled trial of intra-articular corticosteroid injections for knee OA participated in this study. All participants completed 4 trials on 2 separate days, 7 to 21 days apart (8 trials total). Each day was divided into 2 sessions, which each involved 2 walking trials. We compared walk times between trials with Wilcoxon signed-rank tests. Similar analyses compared average walk times between sessions. To confirm these analyses, we also calculated Spearman correlation coefficients to assess the relationship between sessions. Finally, smallest detectable differences (SDD) were calculated to estimate the sensitivity of the 20-meter walk test. Wilcoxon signed-rank tests between trials within the same session demonstrated that trials in session 1 were significantly different and in the subsequent 3 sessions, the median differences between trials were not significantly different. Therefore, the first session of each day was considered a practice session, and the SDD between the second session of each day were calculated. SDD was -1.59 seconds (walking slower) and 0.15 seconds (walking faster). Practice trials and a standardized protocol should be used in administration of the 20-meter walk test. Changes in walk time between -1.59 seconds (walking slower) and 0.15 seconds (walking faster) should be considered within the range of normal variability of 20-meter walking speed. The primary limitation of our study was a small sample size, which may influence the generalizability of our findings.

Educational Data Mining and Problem-Based Learning

ERIC Educational Resources Information Center

Walldén, Sari; Mäkinen, Erkki

2014-01-01

This paper considers the use of log data provided by learning management systems when studying whether students obey the problem-based learning (PBL) method. Log analysis turns out to be a valuable tool in measuring the use of the learning material of interest. It gives reliable figures concerning not only the number of use sessions but also the…

Reliability assessment of ballistic jump squats and bench throws.

PubMed

Alemany, Joseph A; Pandorf, Clay E; Montain, Scott J; Castellani, John W; Tuckow, Alexander P; Nindl, Bradley C

2005-02-01

The purpose of this investigation was to determine the test-retest reliability and coefficient of variation of 2 novel physical performance tests. Ten healthy men (22.0 +/- 3.0 years, 87.0 +/- 8.0 kg, 20.0 +/- 5.0% body fat) performed 30 continuous and dynamic jump squats (JS) and bench throws (BT) on 4 separate occasions. The movements were performed under loaded conditions utilizing 30% of subject's predetermined 1 repetition maximum in the back squat and bench press. Mean power (MP; W), peak power (PP; W), mean velocity (MV; m.s(-1)), peak velocity (PV; m.s(-1)), and total work (TW; J) were assessed using a ballistic measurement system (Innervations Inc., Muncie, IN). Data were analyzed using repeated measures analysis of variance with Duncan's post hoc test when mean differences were p < or = 0.05. Intraclass correlation coefficient (ICC) and within-subject coefficient of variation (CV%) were also calculated. All values are presented as mean +/- SE. BT variables were statistically similar across the 4 sessions: MP (350.0 +/- 13.9 W), PP (431.4 +/- 18.5 W) MV (1.6 +/- 0.03 m.s(-1)), PV (2.0 +/- 0.03 m.s(-1)), and TW (199.1 +/- 7.2 J). For JS, session 3 PP (1,669.8 +/- 111.2 W) was significantly greater vs. sessions 1, 2, and 4 (1,601.2 +/- 58.4 W). Session 4 MP (1,403.2 +/- 88.6 W) and MV (1.9 +/- 0.1 m.s(-1)) for JS were significantly lower during sessions 1, 2, and 3 (MP: 1,479.4.5 +/- 44.8 W, MV: 2.0 +/- 0.05 m.s(-1)). TW (834.7 +/- 24.3 J) and PV (2.2 +/- 0.04 m.s(-1)) were statistically similar during all sessions for JS. The CVs ranged from 3.0 to 7.6% for the BT and 3.2 to 5.7% for the JS. ICCs for MP, PP, MV, PV, and TW were 0.92, 0.95, 0.94, 0.91, and 0.95, respectively, during BT. ICCs during JS for MP, PP, MV, PV, and TW were 0.96, 0.98, 0.94, 0.94, and 0.89, respectively. The results of the current study support the use of a 30 continuous and dynamic BT protocol as a reliable upper-body physical performance test, which can be administered with minimal practice. Slightly greater variability for JS was observed, although the test had high reliability.

Developing the Coach Analysis and Intervention System (CAIS): establishing validity and reliability of a computerised systematic observation instrument.

PubMed

Cushion, Christopher; Harvey, Stephen; Muir, Bob; Nelson, Lee

2012-01-01

We outline the evolution of a computerised systematic observation tool and describe the process for establishing the validity and reliability of this new instrument. The Coach Analysis and Interventions System (CAIS) has 23 primary behaviours related to physical behaviour, feedback/reinforcement, instruction, verbal/non-verbal, questioning and management. The instrument also analyses secondary coach behaviour related to performance states, recipient, timing, content and questioning/silence. The CAIS is a multi-dimensional and multi-level mechanism able to provide detailed and contextualised data about specific coaching behaviours occurring in complex and nuanced coaching interventions and environments that can be applied to both practice sessions and competition.

The use of adaptable automation: Effects of extended skill lay-off and changes in system reliability.

PubMed

Sauer, Juergen; Chavaillaz, Alain

2017-01-01

This experiment aimed to examine how skill lay-off and system reliability would affect operator behaviour in a simulated work environment under wide-range and large-choice adaptable automation comprising six different levels. Twenty-four participants were tested twice during a 2-hr testing session, with the second session taking place 8 months after the first. In the middle of the second testing session, system reliability changed. The results showed that after the retention interval trust increased and self-confidence decreased. Complacency was unaffected by the lay-off period. Diagnostic speed slowed down after the retention interval but diagnostic accuracy was maintained. No difference between experimental conditions was found for automation management behaviour (i.e. level of automation chosen and frequency of switching between levels). There were few effects of system reliability. Overall, the findings showed that subjective measures were more sensitive to the impact of skill lay-off than objective behavioural measures. Copyright © 2016 Elsevier Ltd. All rights reserved.

Movement-related beta oscillations show high intra-individual reliability.

PubMed

Espenhahn, Svenja; de Berker, Archy O; van Wijk, Bernadette C M; Rossiter, Holly E; Ward, Nick S

2017-02-15

Oscillatory activity in the beta frequency range (15-30Hz) recorded from human sensorimotor cortex is of increasing interest as a putative biomarker of motor system function and dysfunction. Despite its increasing use in basic and clinical research, surprisingly little is known about the test-retest reliability of spectral power and peak frequency measures of beta oscillatory signals from sensorimotor cortex. Establishing that these beta measures are stable over time in healthy populations is a necessary precursor to their use in the clinic. Here, we used scalp electroencephalography (EEG) to evaluate intra-individual reliability of beta-band oscillations over six sessions, focusing on changes in beta activity during movement (Movement-Related Beta Desynchronization, MRBD) and after movement termination (Post-Movement Beta Rebound, PMBR). Subjects performed visually-cued unimanual wrist flexion and extension. We assessed Intraclass Correlation Coefficients (ICC) and between-session correlations for spectral power and peak frequency measures of movement-related and resting beta activity. Movement-related and resting beta power from both sensorimotor cortices was highly reliable across sessions. Resting beta power yielded highest reliability (average ICC=0.903), followed by MRBD (average ICC=0.886) and PMBR (average ICC=0.663). Notably, peak frequency measures yielded lower ICC values compared to the assessment of spectral power, particularly for movement-related beta activity (ICC=0.386-0.402). Our data highlight that power measures of movement-related beta oscillations are highly reliable, while corresponding peak frequency measures show greater intra-individual variability across sessions. Importantly, our finding that beta power estimates show high intra-individual reliability over time serves to validate the notion that these measures reflect meaningful individual differences that can be utilised in basic research and clinical studies. Copyright © 2016 The Authors. Published by Elsevier Inc. All rights reserved.

Examiner Training and Reliability in Two Randomized Clinical Trials of Adult Dental Caries

PubMed Central

Banting, David W.; Amaechi, Bennett T.; Bader, James D.; Blanchard, Peter; Gilbert, Gregg H.; Gullion, Christina M.; Holland, Jan Carlton; Makhija, Sonia K.; Papas, Athena; Ritter, André V.; Singh, Mabi L.; Vollmer, William M.

2013-01-01

Objectives This report describes the training of dental examiners participating in two dental caries clinical trials and reports the inter- and intra- examiner reliability scores from the initial standardization sessions. Methods Study examiners were trained to use a modified ICDAS-II system to detect the visual signs of non-cavitated and cavitated dental caries in adult subjects. Dental caries was classified as no caries (S), non-cavitated caries (D1), enamel caries (D2) and dentine caries (D3). Three standardization sessions involving 60 subjects and 3604 tooth surface calls were used to calculate several measures of examiner reliability. Results The prevalence of dental caries observed in the standardization sessions ranged from 1.4% to 13.5% of the coronal tooth surfaces examined. Overall agreement between pairs of examiners ranged from 0.88 to 0.99. An intra-class coefficient threshold of 0.60 was surpassed for all but one examiner. Inter-examiner unweighted kappa values were low (0.23– 0.35) but weighted kappas and the ratio of observed to maximum kappas were more encouraging (0.42– 0.83). The highest kappa values occurred for the S/D1 vs. D2/D3 two-level classification of dental caries, for which seven of the eight examiners achieved observed to maximum kappa values over 0.90.Intra-examiner reliability was notably higher than inter-examiner reliability for all measures and dental caries classification systems employed. Conclusion The methods and results for the initial examiner training and standardization sessions for two large clinical trials are reported. Recommendations for others planning examiner training and standardization sessions are offered. PMID:22320292

Examiner training and reliability in two randomized clinical trials of adult dental caries.

PubMed

Banting, David W; Amaechi, Bennett T; Bader, James D; Blanchard, Peter; Gilbert, Gregg H; Gullion, Christina M; Holland, Jan Carlton; Makhija, Sonia K; Papas, Athena; Ritter, André V; Singh, Mabi L; Vollmer, William M

2011-01-01

This report describes the training of dental examiners participating in two dental caries clinical trials and reports the inter- and intra-examiner reliability scores from the initial standardization sessions. Study examiners were trained to use a modified International Caries Detection and Assessment System II system to detect the visual signs of non-cavitated and cavitated dental caries in adult subjects. Dental caries was classified as no caries (S), non-cavitated caries (D1), enamel caries (D2), and dentine caries (D3). Three standardization sessions involving 60 subjects and 3,604 tooth surface calls were used to calculate several measures of examiner reliability. The prevalence of dental caries observed in the standardization sessions ranged from 1.4 percent to 13.5 percent of the coronal tooth surfaces examined. Overall agreement between pairs of examiners ranged from 0.88 to 0.99. An intra-class coefficient threshold of 0.60 was surpassed for all but one examiner. Inter-examiner unweighted kappa values were low (0.23-0.35), but weighted kappas and the ratio of observed to maximum kappas were more encouraging (0.42-0.83). The highest kappa values occurred for the S/D1 versus D2/D3 two-level classification of dental caries, for which seven of the eight examiners achieved observed to maximum kappa values over 0.90. Intra-examiner reliability was notably higher than inter-examiner reliability for all measures and dental caries classifications employed. The methods and results for the initial examiner training and standardization sessions for two large clinical trials are reported. Recommendations for others planning examiner training and standardization sessions are offered. © 2011 American Association of Public Health Dentistry.

Test-retest reliability of high angular resolution diffusion imaging acquisition within medial temporal lobe connections assessed via tract based spatial statistics, probabilistic tractography and a novel graph theory metric.

PubMed

Kuhn, T; Gullett, J M; Nguyen, P; Boutzoukas, A E; Ford, A; Colon-Perez, L M; Triplett, W; Carney, P R; Mareci, T H; Price, C C; Bauer, R M

2016-06-01

This study examined the reliability of high angular resolution diffusion tensor imaging (HARDI) data collected on a single individual across several sessions using the same scanner. HARDI data was acquired for one healthy adult male at the same time of day on ten separate days across a one-month period. Environmental factors (e.g. temperature) were controlled across scanning sessions. Tract Based Spatial Statistics (TBSS) was used to assess session-to-session variability in measures of diffusion, fractional anisotropy (FA) and mean diffusivity (MD). To address reliability within specific structures of the medial temporal lobe (MTL; the focus of an ongoing investigation), probabilistic tractography segmented the Entorhinal cortex (ERc) based on connections with Hippocampus (HC), Perirhinal (PRc) and Parahippocampal (PHc) cortices. Streamline tractography generated edge weight (EW) metrics for the aforementioned ERc connections and, as comparison regions, connections between left and right rostral and caudal anterior cingulate cortex (ACC). Coefficients of variation (CoV) were derived for the surface area and volumes of these ERc connectivity-defined regions (CDR) and for EW across all ten scans, expecting that scan-to-scan reliability would yield low CoVs. TBSS revealed no significant variation in FA or MD across scanning sessions. Probabilistic tractography successfully reproduced histologically-verified adjacent medial temporal lobe circuits. Tractography-derived metrics displayed larger ranges of scanner-to-scanner variability. Connections involving HC displayed greater variability than metrics of connection between other investigated regions. By confirming the test retest reliability of HARDI data acquisition, support for the validity of significant results derived from diffusion data can be obtained.

Assessing treatment integrity in cognitive-behavioral therapy: comparing session segments with entire sessions.

PubMed

Weck, Florian; Grikscheit, Florian; Höfling, Volkmar; Stangier, Ulrich

2014-07-01

The evaluation of treatment integrity (therapist adherence and competence) is a necessary condition to ensure the internal and external validity of psychotherapy research. However, the evaluation process is associated with high costs, because therapy sessions must be rated by experienced clinicians. It is debatable whether rating session segments is an adequate alternative to rating entire sessions. Four judges evaluated treatment integrity (i.e., therapist adherence and competence) in 84 randomly selected videotapes of cognitive-behavioral therapy for major depressive disorder, social anxiety disorder, and hypochondriasis (from three different treatment outcome studies). In each case, two judges provided ratings based on entire therapy sessions and two on session segments only (i.e., the middle third of the entire sessions). Interrater reliability of adherence and competence evaluations proved satisfactory for ratings based on segments and the level of reliability did not differ from ratings based on entire sessions. Ratings of treatment integrity that were based on entire sessions and session segments were strongly correlated (r=.62 for adherence and r=.73 for competence). The relationship between treatment integrity and outcome was comparable for ratings based on session segments and those based on entire sessions. However, significant relationships between therapist competence and therapy outcome were only found in the treatment of social anxiety disorder. Ratings based on segments proved to be adequate for the evaluation of treatment integrity. The findings demonstrate that session segments are an adequate and cost-effective alternative to entire sessions for the evaluation of therapist adherence and competence. Copyright © 2014. Published by Elsevier Ltd.

Reliability of performance velocity for jump squats under feedback and nonfeedback conditions.

PubMed

Randell, Aaron D; Cronin, John B; Keogh, Justin Wl; Gill, Nicholas D; Pedersen, Murray C

2011-12-01

Randell, AD, Cronin, JB, Keogh, JWL, Gill, ND, and Pedersen, MC. Reliability of performance velocity for jump squats under feedback and nonfeedback conditions. J Strength Cond Res 25(12): 3514-3518, 2011-Advancements in the monitoring of kinematic and kinetic variables during resistance training have resulted in the ability to continuously monitor performance and provide feedback during training. If equipment and software can provide reliable instantaneous feedback related to the variable of interest during training, it is thought that this may result in goal-oriented movement tasks that increase the likelihood of transference to on-field performance or at the very least improve the mechanical variable of interest. The purpose of this study was to determine the reliability of performance velocity for jump squats under feedback and nonfeedback conditions over 3 consecutive training sessions. Twenty subjects were randomly allocated to a feedback or nonfeedback group, and each group performed a total of 3 "jump squat" training sessions with the velocity of each repetition measured using a linear position transducer. There was less change in mean velocities between sessions 1-2 and sessions 2-3 (0.07 and 0.02 vs. 0.13 and -0.04 m·s), less random variation (TE = 0.06 and 0.06 vs. 0.10 and 0.07 m·s) and greater consistency (intraclass correlation coefficient = 0.83 and 0.87 vs. 0.53 and 0.74) between sessions for the feedback condition as compared to the nonfeedback condition. It was concluded that there is approximately a 50-50 probability that the provision of feedback was beneficial to the performance in the squat jump over multiple sessions. It is suggested that this has the potential for increasing transference to on-field performance or at the very least improving the mechanical variable of interest.

Inter-rater reliability of kinesthetic measurements with the KINARM robotic exoskeleton.

PubMed

Semrau, Jennifer A; Herter, Troy M; Scott, Stephen H; Dukelow, Sean P

2017-05-22

Kinesthesia (sense of limb movement) has been extremely difficult to measure objectively, especially in individuals who have survived a stroke. The development of valid and reliable measurements for proprioception is important to developing a better understanding of proprioceptive impairments after stroke and their impact on the ability to perform daily activities. We recently developed a robotic task to evaluate kinesthetic deficits after stroke and found that the majority (~60%) of stroke survivors exhibit significant deficits in kinesthesia within the first 10 days post-stroke. Here we aim to determine the inter-rater reliability of this robotic kinesthetic matching task. Twenty-five neurologically intact control subjects and 15 individuals with first-time stroke were evaluated on a robotic kinesthetic matching task (KIN). Subjects sat in a robotic exoskeleton with their arms supported against gravity. In the KIN task, the robot moved the subjects' stroke-affected arm at a preset speed, direction and distance. As soon as subjects felt the robot begin to move their affected arm, they matched the robot movement with the unaffected arm. Subjects were tested in two sessions on the KIN task: initial session and then a second session (within an average of 18.2 ± 13.8 h of the initial session for stroke subjects), which were supervised by different technicians. The task was performed both with and without the use of vision in both sessions. We evaluated intra-class correlations of spatial and temporal parameters derived from the KIN task to determine the reliability of the robotic task. We evaluated 8 spatial and temporal parameters that quantify kinesthetic behavior. We found that the parameters exhibited moderate to high intra-class correlations between the initial and retest conditions (Range, r-value = [0.53-0.97]). The robotic KIN task exhibited good inter-rater reliability. This validates the KIN task as a reliable, objective method for quantifying kinesthesia after stroke.

Effects of a common transcranial direct current stimulation (tDCS) protocol on motor evoked potentials found to be highly variable within individuals over 9 testing sessions.

PubMed

Horvath, Jared Cooney; Vogrin, Simon J; Carter, Olivia; Cook, Mark J; Forte, Jason D

2016-09-01

Transcranial direct current stimulation (tDCS) uses a weak electric current to modulate neuronal activity. A neurophysiologic outcome measure to demonstrate reliable tDCS modulation at the group level is transcranial magnetic stimulation engendered motor evoked potentials (MEPs). Here, we conduct a study testing the reliability of individual MEP response patterns following a common tDCS protocol. Fourteen participants (7m/7f) each underwent nine randomized sessions of 1 mA, 10 min tDCS (3 anode; 3 cathode; 3 sham) delivered using an M1/orbito-frontal electrode montage (sessions separated by an average of ~5.5 days). Fifteen MEPs were obtained prior to, immediately following and in 5 min intervals for 30 min following tDCS. TMS was delivered at 130 % resting motor threshold using neuronavigation to ensure consistent coil localization. A number of non-experimental variables were collected during each session. At the individual level, considerable variability was seen among different testing sessions. No participant demonstrated an excitatory response ≥20 % to all three anodal sessions, and no participant demonstrated an inhibitory response ≥20 % to all three cathodal sessions. Intra-class correlation revealed poor anodal and cathodal test-retest reliability [anode: ICC(2,1) = 0.062; cathode: ICC(2,1) = 0.055] and moderate sham test-retest reliability [ICC(2,1) = 0.433]. Results also revealed no significant effect of tDCS at the group level. Using this common protocol, we found the effects of tDCS on MEP amplitudes to be highly variable at the individual level. In addition, no significant effects of tDCS on MEP amplitude were found at the group level. Future studies should consider utilizing a more strict experimental protocol to potentially account for intra-individual response variations.

Interhemispheric Inhibition Measurement Reliability in Stroke: A Pilot Study

PubMed Central

Cassidy, Jessica M.; Chu, Haitao; Chen, Mo; Kimberley, Teresa J.; Carey, James R.

2016-01-01

Objective Reliable transcranial magnetic stimulation (TMS) measures for probing corticomotor excitability are important when assessing the physiological effects of non-invasive brain stimulation. The primary objective of this study was to examine test-retest reliability of an interhemispheric inhibition (IHI) index measurement in stroke. Materials and Methods Ten subjects with chronic stroke (≥ 6 months) completed two IHI testing sessions per week for three weeks (six testing sessions total). A single investigator measured IHI in the contra- to-ipsilesional primary motor cortex direction and in the opposite direction using bilateral paired-pulse TMS. Weekly sessions were separated by 24 hours with a 1-week washout period separating testing weeks. To determine if motor-evoked potential (MEP) quantification method affected measurement reliability, IHI indices computed from both MEP amplitude and area responses were found. Reliability was assessed with two-way, mixed intraclass correlation coefficients (ICC(3,k)). Standard error of measurement and minimal detectable difference statistics were also determined. Results With the exception of the initial testing week, IHI indices measured in the contra-to-ipsilesional hemisphere direction demonstrated moderate to excellent reliability (ICC = 0.725 – 0.913). Ipsi-to-contralesional IHI indices depicted poor or invalid reliability estimates throughout the three-week testing duration (ICC= −1.153 – 0.105). The overlap of ICC 95% confidence intervals suggested that IHI indices using MEP amplitude vs. area measures did not differ with respect to reliability. Conclusions IHI indices demonstrated varying magnitudes of reliability irrespective of MEP quantification method. Several strategies for improving IHI index measurement reliability are discussed. PMID:27333364

Web-based training and interrater reliability testing for scoring the Hamilton Depression Rating Scale.

PubMed

Rosen, Jules; Mulsant, Benoit H; Marino, Patricia; Groening, Christopher; Young, Robert C; Fox, Debra

2008-10-30

Despite the importance of establishing shared scoring conventions and assessing interrater reliability in clinical trials in psychiatry, these elements are often overlooked. Obstacles to rater training and reliability testing include logistic difficulties in providing live training sessions, or mailing videotapes of patients to multiple sites and collecting the data for analysis. To address some of these obstacles, a web-based interactive video system was developed. It uses actors of diverse ages, gender and race to train raters how to score the Hamilton Depression Rating Scale and to assess interrater reliability. This system was tested with a group of experienced and novice raters within a single site. It was subsequently used to train raters of a federally funded multi-center clinical trial on scoring conventions and to test their interrater reliability. The advantages and limitations of using interactive video technology to improve the quality of clinical trials are discussed.

Reliability analysis in the Office of Safety, Environmental, and Mission Assurance (OSEMA)

NASA Astrophysics Data System (ADS)

Kauffmann, Paul J.

1994-12-01

The technical personnel in the SEMA office are working to provide the highest degree of value-added activities to their support of the NASA Langley Research Center mission. Management perceives that reliability analysis tools and an understanding of a comprehensive systems approach to reliability will be a foundation of this change process. Since the office is involved in a broad range of activities supporting space mission projects and operating activities (such as wind tunnels and facilities), it was not clear what reliability tools the office should be familiar with and how these tools could serve as a flexible knowledge base for organizational growth. Interviews and discussions with the office personnel (both technicians and engineers) revealed that job responsibilities ranged from incoming inspection to component or system analysis to safety and risk. It was apparent that a broad base in applied probability and reliability along with tools for practical application was required by the office. A series of ten class sessions with a duration of two hours each was organized and scheduled. Hand-out materials were developed and practical examples based on the type of work performed by the office personnel were included. Topics covered were: Reliability Systems - a broad system oriented approach to reliability; Probability Distributions - discrete and continuous distributions; Sampling and Confidence Intervals - random sampling and sampling plans; Data Analysis and Estimation - Model selection and parameter estimates; and Reliability Tools - block diagrams, fault trees, event trees, FMEA. In the future, this information will be used to review and assess existing equipment and processes from a reliability system perspective. An analysis of incoming materials sampling plans was also completed. This study looked at the issues associated with Mil Std 105 and changes for a zero defect acceptance sampling plan.

Reliability analysis in the Office of Safety, Environmental, and Mission Assurance (OSEMA)

NASA Technical Reports Server (NTRS)

Kauffmann, Paul J.

1994-01-01

The technical personnel in the SEMA office are working to provide the highest degree of value-added activities to their support of the NASA Langley Research Center mission. Management perceives that reliability analysis tools and an understanding of a comprehensive systems approach to reliability will be a foundation of this change process. Since the office is involved in a broad range of activities supporting space mission projects and operating activities (such as wind tunnels and facilities), it was not clear what reliability tools the office should be familiar with and how these tools could serve as a flexible knowledge base for organizational growth. Interviews and discussions with the office personnel (both technicians and engineers) revealed that job responsibilities ranged from incoming inspection to component or system analysis to safety and risk. It was apparent that a broad base in applied probability and reliability along with tools for practical application was required by the office. A series of ten class sessions with a duration of two hours each was organized and scheduled. Hand-out materials were developed and practical examples based on the type of work performed by the office personnel were included. Topics covered were: Reliability Systems - a broad system oriented approach to reliability; Probability Distributions - discrete and continuous distributions; Sampling and Confidence Intervals - random sampling and sampling plans; Data Analysis and Estimation - Model selection and parameter estimates; and Reliability Tools - block diagrams, fault trees, event trees, FMEA. In the future, this information will be used to review and assess existing equipment and processes from a reliability system perspective. An analysis of incoming materials sampling plans was also completed. This study looked at the issues associated with Mil Std 105 and changes for a zero defect acceptance sampling plan.

Test-retest reliability and stability of N400 effects in a word-pair semantic priming paradigm.

PubMed

Kiang, Michael; Patriciu, Iulia; Roy, Carolyn; Christensen, Bruce K; Zipursky, Robert B

2013-04-01

Elicited by any meaningful stimulus, the N400 event-related potential (ERP) component is reduced when the stimulus is related to a preceding one. This N400 semantic priming effect has been used to probe abnormal semantic relationship processing in clinical disorders, and suggested as a possible biomarker for treatment studies. Validating N400 semantic priming effects as a clinical biomarker requires characterizing their test-retest reliability. We assessed test-retest reliability of N400 semantic priming in 16 healthy adults who viewed the same related and unrelated prime-target word pairs in two sessions one week apart. As expected, N400 amplitudes were smaller for related versus unrelated targets across sessions. N400 priming effects (amplitude differences between unrelated and related targets) were highly correlated across sessions (r=0.85, P<0.0001), but smaller in the second session due to larger N400s to related targets. N400 priming effects have high reliability over a one-week interval. They may decrease with repeat testing, possibly because of motivational changes. Use of N400 priming effects in treatment studies should account for possible magnitude decreases with repeat testing. Further research is needed to delineate N400 priming effects' test-retest reliability and stability in different age and clinical groups, and with different stimulus types. Copyright © 2012 International Federation of Clinical Neurophysiology. Published by Elsevier Ireland Ltd. All rights reserved.

Test-retest reliability of a new device for assessing ankle joint threshold to detect passive movement in healthy adults.

PubMed

Sun, Wei; Song, Qipeng; Yu, Bing; Zhang, Cui; Mao, Dewei

2015-01-01

This study aimed to evaluate the test-retest reliability of a new device for assessing ankle joint kinesthesia. This device could measure the passive motion threshold of four ankle joint movements, namely plantarflexion, dorsiflexion, inversion and eversion. A total of 21 healthy adults, including 13 males and 8 females, participated in the study. Each participant completed two sessions on two separate days with 1-week interval. The sessions were administered by the same experimenter in the same laboratory. At least 12 trials (three successful trials in each of the four directions) were performed in each session. The mean values in each direction were calculated and analysed. The ICC values of test-retest reliability ranged from 0.737 (dorsiflexion) to 0.935 (eversion), whereas the SEM values ranged from 0.21° (plantarflexion) to 0.52° (inversion). The Bland-Altman plots showed that the reliability of plantarflexion-dorsiflexion was better than that of inversion-eversion. The results evaluated the reliability of the new device as fair to excellent. The new device for assessing kinesthesia could be used to examine the ankle joint kinesthesia.

Using video-annotation software to identify interactions in group therapies for schizophrenia: assessing reliability and associations with outcomes.

PubMed

Orfanos, Stavros; Akther, Syeda Ferhana; Abdul-Basit, Muhammad; McCabe, Rosemarie; Priebe, Stefan

2017-02-10

Research has shown that interactions in group therapies for people with schizophrenia are associated with a reduction in negative symptoms. However, it is unclear which specific interactions in groups are linked with these improvements. The aims of this exploratory study were to i) develop and test the reliability of using video-annotation software to measure interactions in group therapies in schizophrenia and ii) explore the relationship between interactions in group therapies for schizophrenia with clinically relevant changes in negative symptoms. Video-annotation software was used to annotate interactions from participants selected across nine video-recorded out-patient therapy groups (N = 81). Using the Individual Group Member Interpersonal Process Scale, interactions were coded from participants who demonstrated either a clinically significant improvement (N = 9) or no change (N = 8) in negative symptoms at the end of therapy. Interactions were measured from the first and last sessions of attendance (>25 h of therapy). Inter-rater reliability between two independent raters was measured. Binary logistic regression analysis was used to explore the association between the frequency of interactive behaviors and changes in negative symptoms, assessed using the Positive and Negative Syndrome Scale. Of the 1275 statements that were annotated using ELAN, 1191 (93%) had sufficient audio and visual quality to be coded using the Individual Group Member Interpersonal Process Scale. Rater-agreement was high across all interaction categories (>95% average agreement). A higher frequency of self-initiated statements measured in the first session was associated with improvements in negative symptoms. The frequency of questions and giving advice measured in the first session of attendance was associated with improvements in negative symptoms; although this was only a trend. Video-annotation software can be used to reliably identify interactive behaviors in groups for schizophrenia. The results suggest that proactive communicative gestures, as assessed by the video-analysis, predict outcomes. Future research should use this novel method in larger and clinically different samples to explore which aspects of therapy facilitate such proactive communication early on in therapy.

Reliability of pelvic floor measurements on three- and four-dimensional ultrasound during and after first pregnancy: implications for training.

PubMed

van Veelen, G A; Schweitzer, K J; van der Vaart, C H

2013-11-01

To evaluate the reliability of measurements of the levator hiatus and levator-urethra gap (LUG) using three/four-dimensional (3D/4D) transperineal ultrasound in women during their first pregnancy and 6 months postpartum, and to assess the learning process for these measurements. An inexperienced observer was taught to perform measurements of the levator hiatus and LUG by an experienced observer. After training, 3D/4D ultrasound volume datasets of 40 women in the first trimester were analyzed by these two observers. Another training session then took place and both observers repeated the analyses of the same volume datasets. Finally, analyses of 40 volume datasets of the women 6 months postpartum were performed by both observers. Intra- and interobserver reliability were determined by intraclass correlation coefficients (ICC) with 95% CIs. For levator hiatal measurements, in the women during their first pregnancy the interobserver reliability was substantial to almost perfect after both the first and second training session (ICC, 0.62-0.83 and 0.71-0.89, respectively, for anteroposterior diameter, transverse diameter and area at rest, on contraction and on Valsalva) and the intraobserver reliability was substantial to almost perfect for both observers. For these measurements performed once the women had delivered, interobserver reliability was moderate to almost perfect. For LUG measurements performed during pregnancy, interobserver reliability was slight to moderate after the first training session (ICC, 0.14-0.54), but improved after the second training session (ICC, 0.38-0.71), and intraobserver reliability was moderate to substantial for the experienced observer and slight to moderate for the inexperienced observer. For these measurements performed when the women had delivered, interobserver reliability was fair to moderate. The levator hiatus and LUG can be measured reliably using 3D/4D ultrasound in primigravid and primiparous women. The technique to measure dimensions of the levator hiatus requires limited teaching, but LUG measurements are more difficult and require more extensive training. Copyright © 2013 ISUOG. Published by John Wiley & Sons Ltd.

Six of one, half a dozen of the other: A measure of multidisciplinary inter/intra-rater reliability of the society for fetal urology and urinary tract dilation grading systems for hydronephrosis.

PubMed

Rickard, Mandy; Easterbrook, Bethany; Kim, Soojin; Farrokhyar, Forough; Stein, Nina; Arora, Steven; Belostotsky, Vladamir; DeMaria, Jorge; Lorenzo, Armando J; Braga, Luis H

2017-02-01

The urinary tract dilation (UTD) classification system was introduced to standardize terminology in the reporting of hydronephrosis (HN), and bridge a gap between pre- and postnatal classification such as the Society for Fetal Urology (SFU) grading system. Herein we compare the intra/inter-rater reliability of both grading systems. SFU (I-IV) and UTD (I-III) grades were independently assigned by 13 raters (9 pediatric urology staff, 2 nephrologists, 2 radiologists), twice, 3 weeks apart, to 50 sagittal postnatal ultrasonographic views of hydronephrotic kidneys. Data regarding ureteral measurements and bladder abnormalities were included to allow proper UTD categorization. Ten images were repeated to assess intra-rater reliability. Krippendorff's alpha coefficient was used to measure overall and by grade intra/inter-rater reliability. Reliability between specialties and training levels were also analyzed. Overall inter-rater reliability was slightly higher for SFU (α = 0.842, 95% CI 0.812-0.879, in session 1; and α = 0.808, 95% CI 0.775-0.839, in session 2) than for UTD (α = 0.774, 95% CI 0.715-0.827, in session 1; and α = 0.679, 95% CI 0.605-0.750, in session 2). Reliability for intermediate grades (SFU II/III and UTD 2) of HN was poor regardless of the system. Reliabilities for SFU and UTD classifications among Urology, Nephrology, and Radiology, as well as between training levels were not significantly different. Despite the introduction of HN grading systems to standardize the interpretation and reporting of renal ultrasound in infants with HN, none have been proven superior in allowing clinicians to distinguish between "moderate" grades. While this study demonstrated high reliability in distinguishing between "mild" (SFU I/II and UTD 1) and "severe" (SFU IV and UTD 3) grades of HN, the overall reliability between specialties was poor. This is in keeping with a previous report of modest inter-rater reliability of the SFU system. This drawback is likely explained by the subjective interpretation required to assign grades, which can be impacted by experience, image quality, and scanning technique. As shown in the figure, which demonstrates SFU II (a) and SFU III (b), as assigned by a radiologist, it is possible to make an argument that either of these images can be classified into both categories that were observed during the grading sessions of this study. Although both systems have acceptable reliability, the SFU grading system showed higher overall intra/inter-rater reliability regardless of rater specialty than the UTD classification. Inter-rater reliability for SFU grades II/III and UTD 2 was low, highlighting the limitations of both classifications in regards to properly segregating moderate HN grades. Copyright © 2016 Journal of Pediatric Urology Company. Published by Elsevier Ltd. All rights reserved.

The prone bridge test: Performance, validity, and reliability among older and younger adults.

PubMed

Bohannon, Richard W; Steffl, Michal; Glenney, Susan S; Green, Michelle; Cashwell, Leah; Prajerova, Kveta; Bunn, Jennifer

2018-04-01

The prone bridge maneuver, or plank, has been viewed as a potential alternative to curl-ups for assessing trunk muscle performance. The purpose of this study was to assess prone bridge test performance, validity, and reliability among younger and older adults. Sixty younger (20-35 years old) and 60 older (60-79 years old) participants completed this study. Groups were evenly divided by sex. Participants completed surveys regarding physical activity and abdominal exercise participation. Height, weight, body mass index (BMI), and waist circumference were measured. On two occasions, 5-9 days apart, participants held a prone bridge until volitional exhaustion or until repeated technique failure. Validity was examined using data from the first session: convergent validity by calculating correlations between survey responses, anthropometrics, and prone bridge time, known groups validity by using an ANOVA comparing bridge times of younger and older adults and of men and women. Test-retest reliability was examined by using a paired t-test to compare prone bridge times for Session1 and Session 2. Furthermore, an intraclass correlation coefficient (ICC) was used to characterize relative reliability and minimal detectable change (MDC 95% ) was used to describe absolute reliability. The mean prone bridge time was 145.3 ± 71.5 s, and was positively correlated with physical activity participation (p ≤ 0.001) and negatively correlated with BMI and waist circumference (p ≤ 0.003). Younger participants had significantly longer plank times than older participants (p = 0.003). The ICC between testing sessions was 0.915. The prone bridge test is a valid and reliable measure for evaluating abdominal performance in both younger and older adults. Copyright © 2017 Elsevier Ltd. All rights reserved.

Assessment of the impact of the scanner-related factors on brain morphometry analysis with Brainvisa

PubMed Central

2011-01-01

Background Brain morphometry is extensively used in cross-sectional studies. However, the difference in the estimated values of the morphometric measures between patients and healthy subjects may be small and hence overshadowed by the scanner-related variability, especially with multicentre and longitudinal studies. It is important therefore to investigate the variability and reliability of morphometric measurements between different scanners and different sessions of the same scanner. Methods We assessed the variability and reliability for the grey matter, white matter, cerebrospinal fluid and cerebral hemisphere volumes as well as the global sulcal index, sulcal surface and mean geodesic depth using Brainvisa. We used datasets obtained across multiple MR scanners at 1.5 T and 3 T from the same groups of 13 and 11 healthy volunteers, respectively. For each morphometric measure, we conducted ANOVA analysis and verified whether the estimated values were significantly different across different scanners or different sessions of the same scanner. The between-centre and between-visit reliabilities were estimated from their contribution to the total variance, using a random-effects ANOVA model. To estimate the main processes responsible for low reliability, the results of brain segmentation were compared to those obtained using FAST within FSL. Results In a considerable number of cases, the main effects of both centre and visit factors were found to be significant. Moreover, both between-centre and between-visit reliabilities ranged from poor to excellent for most morphometric measures. A comparison between segmentation using Brainvisa and FAST revealed that FAST improved the reliabilities for most cases, suggesting that morphometry could benefit from improving the bias correction. However, the results were still significantly different across different scanners or different visits. Conclusions Our results confirm that for morphometry analysis with the current version of Brainvisa using data from multicentre or longitudinal studies, the scanner-related variability must be taken into account and where possible should be corrected for. We also suggest providing some flexibility to Brainvisa for a step-by-step analysis of the robustness of this package in terms of reproducibility of the results by allowing the bias corrected images to be imported from other packages and bias correction step be skipped, for example. PMID:22189342

Determining Criteria to Predict Repeatability of Performance in Older Adults: Using Coefficients of Variation for Strength and Functional Measures.

PubMed

Raj, Isaac Selva; Bird, Stephen R; Westfold, Ben A; Shield, Anthony J

2017-01-01

Reliable measures of muscle strength and functional capacity in older adults are essential. The aim of this study was to determine whether coefficients of variation (CVs) of individuals obtained at the first session can infer repeatability of performance in a subsequent session. Forty-eight healthy older adults (mean age 68.6 ± 6.1 years; age range 60-80 years) completed two assessment sessions, and on each occasion undertook: dynamometry for isometric and isokinetic quadriceps strength, 6 meter fast walk (6MFWT), timed up and go (TUG), stair climb and descent, and vertical jump. Significant linear relationships were observed between CVs in session 1 and the percentage difference between sessions 1 and 2 for torque at 60, 120, 240 and 360°/s, 6MFWT, TUG, stair climb, and stair descent. The results of this study could be used to establish criteria for determining an acceptably reliable performance in strength and functional tests.

Session-RPE for quantifying load of different youth taekwondo training sessions.

PubMed

Lupo, Corrado; Capranica, Laura; Cortis, Cristina; Guidotti, Flavia; Bianco, Antonino; Tessitore, Antonio

2017-03-01

The session rating of perceived exertion (session-RPE) proved to be a valuable method to quantify the internal training load (ITL) in taekwondo. However, no study validated this method in youth taekwondo athletes performing different training sessions. Thus this study aimed at evaluating the reliability of the session-RPE to monitor the ITL of prepubescent taekwondo athletes during pre-competitive (PC) and competitive (C) training sessions. Five female (age: 12.0±0.7 y; height: 1.54±0.08 m; body mass: 48.8±7.3 kg) and four male (age: 12.0±0.8 yrs; height: 1.55±0.07 m; body mass: 47.3±5.3 kg) taekwondo athletes were monitored during 100 individual sessions (PC: N.=33; C: N.=67). The Edwards' HR method was used as reference measure of ITL; the CR-10 RPE scale was administered at 1- and 30-minutes from the end of each session. No difference for gender emerged. The ITLs of C (Edwards: 228±40 arbitrary units, AU) resulted higher than that of PC (192±26 AU; P=0.04). Although all training typologies and data collections achieved significant correlations between Edwards' and session-RPE methods, a large relationship (r =0.71, P<0.001) emerged only for PC sessions evaluated at 30 minutes of the recovery phases. Findings support coaches of prepubescent taekwondo athletes to successfully use session-RPE to monitor the ITL of different training typologies. However, PC training evaluated at 30 minutes of the recovery phase represents the best condition for a highly reliable ITL perception.

NREL to Host Ninth Annual PV Reliability Workshop | News | NREL

Science.gov Websites

share research leading to more durable and reliable PV modules, thus reducing the cost of solar to Host Ninth Annual PV Reliability Workshop NREL to Host Ninth Annual PV Reliability Workshop their results during a poster session at the 2017 PV Reliability Workshop. 4 people consult two

Working session 5: Operational aspects and risk analysis

DOE Office of Scientific and Technical Information (OSTI.GOV)

Cizelj, L.; Donoghue, J.

1997-02-01

A general observation is that both operational aspects and risk analysis cannot be adequately discussed without information presented in other sessions. Some overlap of conclusions and recommendations is therefore to be expected. Further, it was assumed that recommendations concerning improvements in some related topics were generated by other sessions and are not repeated here. These include: (1) Knowledge on degradation mechanisms (initiation, progression, and failure). (2) Modeling of degradation (initiation, progression, and failure). (3) Capabilities of NDE methods. (4) Preventive maintenance and repair. One should note here, however, that all of these directly affect both operational and risk aspects ofmore » affected plants. A list of conclusions and recommendations is based on available presentations and discussions addressing risk and operational experience. The authors aimed at reaching as broad a consensus as possible. It should be noted here that there is no strict delineation between operational and safety aspects of degradation of steam generator tubes. This is caused by different risk perceptions in different countries/societies. The conclusions and recommendations were divided into four broad groups: human reliability; leakage monitoring; risk impact; and consequence assessment.« less

Cognitive Changes, Critical Sessions, and Sudden Gains in Cognitive-Behavioral Therapy for Depression

ERIC Educational Resources Information Center

Tang, Tony Z.; DeRubeis, Robert J.; Beberman, Rachel; Pham, Thu

2005-01-01

Using an independent cognitive-behavioral therapy (CBT) data set, the authors replicated T. Z. Tang and R. J. DeRubeis' (1999) discovery of sudden gains--sudden and large decreases in depression severity in a single between-session interval. By incorporating therapy session transcripts, the authors of this study improved the reliability of the…

Ultrasonographic measurements of lower trapezius muscle thickness at rest and during isometric contraction: a reliability study.

PubMed

Talbott, Nancy R; Witt, Dexter W

2014-07-01

The purpose of this study was to determine the intra-rater reliability and inter-rater reliability of ultrasound imaging (USI) thickness measurements of the lower trapezius (LT) at rest and during active contractions when the transverse process and the lamina were used as reference sites for the measurement process. Twenty healthy individuals between the ages of 22 and 32 years volunteered. With the subject prone and the shoulder in 145° of abduction, images of the LT were taken bilaterally by one examiner as the subject: (1) rested; (2) actively held the test position; and (3) actively held the test position while holding a weight. Ten subjects returned and testing was repeated by the same examiner and by a second examiner. LT thickness measurements were recorded at the level of the transverse process and at the level of the lamina. Intra-class correlation coefficients (ICC) for within session intra-rater reliability (ICC3,3) ranged from 0.951 to 0.986 for both measurement sites while between session intra-rater reliability (ICC3,2) ranged from 0.935 to 0.962. Within session inter-rater reliability (ICC2,2) ranged from 0.934 to 0.973. USI can be used to reliably measure LT thickness at rest, during active contraction and during active contraction when holding a weight. The described protocol can be utilized during shoulder examinations to provide an additional assessment tool for monitoring changes in LT thickness.

A method for assessing fidelity of delivery of telephone behavioral support for smoking cessation.

PubMed

Lorencatto, Fabiana; West, Robert; Bruguera, Carla; Michie, Susan

2014-06-01

Behavioral support for smoking cessation is delivered through different modalities, often guided by treatment manuals. Recently developed methods for assessing fidelity of delivery have shown that face-to-face behavioral support is often not delivered as specified in the service treatment manual. This study aimed to extend this method to evaluate fidelity of telephone-delivered behavioral support. A treatment manual and transcripts of 75 audio-recorded behavioral support sessions were obtained from the United Kingdom's national Quitline service and coded into component behavior change techniques (BCTs) using a taxonomy of 45 smoking cessation BCTs. Interrater reliability was assessed using percentage agreement. Fidelity was assessed by comparing the number of BCTs identified in the manual with those delivered in telephone sessions by 4 counselors. Fidelity was assessed according to session type, duration, counselor, and BCT. Differences between self-reported and actual BCT use were examined. Average coding reliability was high (81%). On average, 41.8% of manual-specified BCTs were delivered per session (SD = 16.2), with fidelity varying by counselor from 32% to 49%. Fidelity was highest in pre-quit sessions (46%) and for BCT "give options for additional support" (95%). Fidelity was lowest for quit-day sessions (35%) and BCT "set graded tasks" (0%). Session duration was positively correlated with fidelity (r = .585; p < .01). Significantly fewer BCTs were used than were reported as being used, t(15) = -5.52, p < .001. The content of telephone-delivered behavioral support can be reliably coded in terms of BCTs. This can be used to assess fidelity to treatment manuals and to in turn identify training needs. The observed low fidelity underlines the need to establish routine procedures for monitoring delivery of behavioral support. PsycINFO Database Record (c) 2014 APA, all rights reserved.

Development and Psychometric Validation of the EDE-QS, a 12 Item Short Form of the Eating Disorder Examination Questionnaire (EDE-Q)

PubMed Central

Gideon, Nicole; Hawkes, Nick; Mond, Jonathan; Saunders, Rob; Tchanturia, Kate; Serpell, Lucy

2016-01-01

Objective The aim of this study was to develop and validate a short form of the Eating Disorder Examination Questionnaire (EDE-Q) for routine, including session by session, outcome assessment. Method The current, 28-item version (6.0) of the EDE-Q was completed by 489 individuals aged 18–72 with various eating disorders recruited from three UK specialist eating disorder services. Rasch analysis was carried out on factors identified by means of principal component analysis, which in combination with expert ratings informed the development of an EDE-Q short form. The shortened questionnaire’s reliability, validity and sensitivity was assessed based on online data collected from students of a UK university and volunteers with a history of eating disorders recruited from a national eating disorders charity aged 18–74 (N = 559). Results A 12-item short form, the Eating Disorder Examination Questionnaire Short (EDE-QS) was derived. The new measure showed high internal consistency (Cronbach’s α = .913) and temporal stability (ICC = .93; p < .001). It was highly correlated with the original EDE-Q (r = .91 for people without ED; r = .82 for people with ED) and other measures of eating disorder and comorbid psychopathology. It was sufficiently sensitive to distinguish between people with and without eating disorders. Discussion The EDE-QS is a brief, reliable and valid measure of eating disorder symptom severity that performs similarly to the EDE-Q and that lends itself for the use of sessional outcome monitoring in treatment and research. PMID:27138364

Low-Frequency Fluctuations of the Resting Brain: High Magnitude Does Not Equal High Reliability

PubMed Central

Jia, Wenbin; Liao, Wei; Li, Xun; Huang, Huiyuan; Yuan, Jianhua; Zang, Yu-Feng; Zhang, Han

2015-01-01

The amplitude of low-frequency fluctuation (ALFF) measures low-frequency oscillations of the blood-oxygen-level-dependent signal, characterizing local spontaneous activity during the resting state. ALFF is a commonly used measure for resting-state functional magnetic resonance imaging (rs-fMRI) in numerous basic and clinical neuroscience studies. Using a test-retest rs-fMRI dataset consisting of 21 healthy subjects and three repetitive scans, we found that several key brain regions with high ALFF intensities (or magnitude) had poor reliability. Such regions included the posterior cingulate cortex, the medial prefrontal cortex in the default mode network, parts of the right and left thalami, and the primary visual and motor cortices. The above finding was robust with regard to different sample sizes (number of subjects), different scanning parameters (repetition time) and variations of test-retest intervals (i.e., intra-scan, intra-session, and inter-session reliability), as well as with different scanners. Moreover, the qualitative, map-wise results were validated further with a region-of-interest-based quantitative analysis using “canonical” coordinates as reported previously. Therefore, we suggest that the reliability assessments be incorporated in future ALFF studies, especially for the brain regions with a large ALFF magnitude as listed in our paper. Splitting single data into several segments and assessing within-scan “test-retest” reliability is an acceptable alternative if no “real” test-retest datasets are available. Such evaluations might become more necessary if the data are collected with clinical scanners whose performance is not as good as those that are used for scientific research purposes and are better maintained because the lower signal-to-noise ratio may further dampen ALFF reliability. PMID:26053265

Reliability of measuring half-cycle cervical range of motion may be increased using a spirit level for calibration.

PubMed

Wilke, Jan; Niederer, Daniel; Vogt, Lutz; Banzer, Winfried

2018-02-01

Assessments of range of motion (ROM) represent an essential part of clinical diagnostics. Ultrasonic movement analyses have been demonstrated to provide reliable results when analyzing complete amplitudes (e.g., flexion-extension). However, due to subjective determination of the starting position, the assessment of half-cycle movements (e.g, flexion only) is less reproducible. The present study aimed to examine the reliability of measuring half-cycle cervical ROM using a spirit level for calibration. 20 healthy subjects (30 ± 12yrs, 7♂, 13♀) participated in the randomized, controlled, cross-over trial. In two testing sessions with one week of wash-out in between, cervical ROM was measured by means of an ultrasonic 3D movement analysis system using a test-retest design (baseline and 5 min post baseline). The sessions differed with reference to the mask carrying the ultrasound markers. It was removed during the 5 min break (mask off) or not (mask on). To determine the resting position, a bull's eye spirit level was used in each measurement. With ICC values of 0.90-0.98 (mask on, p < 0.001) and 0.90 to 0.97 (mask off, p < 0.001), both examined conditions demonstrated excellent test-retest reliability for separating the cycles regarding all movement planes. Cervical ROM during half-cycle movements can be assessed with excellent reliability using a spirit level. In contrast to subjective determination of the starting position, analyzing complete movement planes does not increase reliability. Using a defined and objective zero positioning allows the evaluation of repositioning tasks. Copyright © 2017 Elsevier Ltd. All rights reserved.

Vestibular Assessments in Children With Global Developmental Delay: An Exploratory Study.

PubMed

Dannenbaum, Elizabeth; Horne, Victoria; Malik, Farwa; Villeneuve, Myriam; Salvo, Lora; Chilingaryan, Gevorg; Lamontagne, Anouk

2016-01-01

To compare results of 3 clinical vestibular tests between children with global developmental delay (GDD) and children with typical development (TD) and investigate the test-retest reliability. Twenty children with GDD (aged 4.1-12.1 years) and 11 age-matched controls with TD participated. Participants with GDD underwent 2 sessions of testing. Each session consisted of the Clinical Test of Sensory Interaction and Balance (CTSIB), Dynamic Visual Acuity (DVA) test, and the modified Emory Clinical Vestibular Chair Test (m-ECVCT). Up to 33% of the children with GDD had abnormal DVA scores. m-ECVCT results of children with GDD demonstrated larger variance than children with TD. The CTSIB score was significantly reduced in the group with GDD. The test-retest reliability varied, with good reliability for the m-ECVCT and CTSIB, and fair reliability for the DVA. Findings suggest vestibular involvement in children in GDD. The clinical tests demonstrated moderate test-retest reliability.

Reliability of measures of transient evoked otoacoustic emissions with contralateral suppression.

PubMed

Stuart, Andrew; Cobb, Kensi M

2015-01-01

The reliability of measures of transient evoked otoacoustic emissions (TEOAEs) with contralateral suppression was examined. The effect of test session (i.e., initial test; retest without probe removal; retest with probe removal; and retest 1-2 days post initial test), gender, and ear was examined in 14 young adult females and 14 young adult males. TEOAEs were obtained bilaterally with 60 dB peSPL linear click stimuli with and without a contralateral 65 dB SPL broadband noise suppressor. Absolute TEOAE suppression and a normalized index of TEOAE suppression (i.e., percentage of suppression) were examined. Reliability of these measures was assessed with repeated measures linear mixed model analysis of variance, a coefficient of reliability, and Bland-Altman analyses. There were no statistically significant (p>0.05) main effects of test, gender, and ear or interactions for both absolute dB and % TEOAE suppression values. Cronbach's α were greater than 0.90 across the four tests for both TEOAE measures. Mean test differences or bias (i.e., between the initial and subsequent tests) for absolute and % TEOAE suppression ranged from -0.05 to 0.11 dB and -1.5% to 1.1%, respectively. There was no proportional/systematic bias with the mean differences of the first and subsequent measurements. Data herein were consistent with the view that bilateral TEOAE suppression measures are reliable across test sessions of 1-2 days among females and males and may provide a method to monitor medial olivocochlear efferent reflex status over time. Copyright © 2015 Elsevier Inc. All rights reserved.

Avionics Reliability, Its Techniques and Related Disciplines.

DTIC Science & Technology

1979-10-01

USAF F-16s. C.J.P.Haynes, UK You said that if one of the 5 nations consumes more than its fair share of the combined spares pool then the item manager ... MANAGEMENT OF THE AVIONIC SYSTEM OF A MILITARY STRIKE AIRCRAFT by A.P.White and J.D.Pavier 29 SESSION IV - SOFTWARE RELIABILITY’ INTRODUCTION TO...ASPECT by D.J.Harris 37 SESSION V - AVIONICS LOGISTICS SUPPORT ASPECTS INTEGRATED LOGISTICS SUPPORT ADDS ANOTHER DIMENSION TO MATRIX MANAGEMENT by

Reliability Analysis of Traditional and Ballistic Bench Press Exercises at Different Loads.

PubMed

García-Ramos, Amador; Padial, Paulino; García-Ramos, Miguel; Conde-Pipó, Javier; Argüelles-Cienfuegos, Javier; Štirn, Igor; Feriche, Belén

2015-09-29

The purpose of this study was to determine test-retest reliability for peak barbell velocity (Vpeak) during the bench press (BP) and bench press throw (BPT) exercises for loads corresponding to 20-70% of one-repetition maximum (1RM). Thirty physically active collegiate men conducted four evaluations after a preliminary BP 1RM determination (1RM·bw-1 = 1.02 ± 0.16 kg·kg-1). In counterbalanced order, participants performed two sessions of the BP in one week and two sessions of the BPT in another week. Recovery time between sessions within the same week was 48 hours and recovery time between sessions of different weeks was 120 hours. On each day of evaluation the individual load-velocity relationship at each tenth percentile (20-70% of 1RM) in a Smith machine for the BP or BPT was determined. Participants performed three attempts per load, but only the best repetition (highest Vpeak), registered by a linear position transducer, was analysed. The BPT resulted in a significantly lower coefficient of variation (CV) for the whole load-velocity relationship, compared to the BP (2.48% vs. 3.22%; p = 0.040). Test-retest intraclass correlation coefficients (ICCs) ranged from r = 0.94-0.85 for the BPT and r = 0.91-0.71 for the BP (p < 0.001). The reduction in the biological within-subject variation in BPT exercise could be promoted by the braking phase that obligatorily occurs during a BP executed with light or moderate loads. Therefore, we recommend the BPT exercise for a most accurate assessment of upper-body velocity.

Reverse lactate threshold: a novel single-session approach to reliable high-resolution estimation of the anaerobic threshold.

PubMed

Dotan, Raffy

2012-06-01

The multisession maximal lactate steady-state (MLSS) test is the gold standard for anaerobic threshold (AnT) estimation. However, it is highly impractical, requires high fitness level, and suffers additional shortcomings. Existing single-session AnT-estimating tests are of compromised validity, reliability, and resolution. The presented reverse lactate threshold test (RLT) is a single-session, AnT-estimating test, aimed at avoiding the pitfalls of existing tests. It is based on the novel concept of identifying blood lactate's maximal appearance-disappearance equilibrium by approaching the AnT from higher, rather than from lower exercise intensities. Rowing, cycling, and running case data (4 recreational and competitive athletes, male and female, aged 17-39 y) are presented. Subjects performed the RLT test and, on a separate session, a single 30-min MLSS-type verification test at the RLT-determined intensity. The RLT and its MLSS verification exhibited exceptional agreement at 0.5% discrepancy or better. The RLT's training sensitivity was demonstrated by a case of 2.5-mo training regimen following which the RLT's 15-W improvement was fully MLSS-verified. The RLT's test-retest reliability was examined in 10 trained and untrained subjects. Test 2 differed from test 1 by only 0.3% with an intraclass correlation of 0.997. The data suggest RLT to accurately and reliably estimate AnT (as represented by MLSS verification) with high resolution and in distinctly different sports and to be sensitive to training adaptations. Compared with MLSS, the single-session RLT is highly practical and its lower fitness requirements make it applicable to athletes and untrained individuals alike. Further research is needed to establish RLT's validity and accuracy in larger samples.

Reliability of length measurements collected by community nurses and health volunteers in rural growth monitoring and promotion services.

PubMed

Laar, Matilda E; Marquis, Grace S; Lartey, Anna; Gray-Donald, Katherine

2018-02-17

Length measurements are important in growth, monitoring and promotion (GMP) for the surveillance of a child's weight-for-length and length-for-age. These two indices provide an indication of a child's risk of becoming wasted or stunted, and are more informative about a child's growth than the widely used weight-for-age index (underweight). Although the introduction of length measurements in GMP is recommended by the World Health Organization, concerns about the reliability of length measurements collected in rural outreach settings have been expressed by stakeholders. Our aim was to describe the reliability and challenges associated with community health personnel measuring length for rural outreach GMP activities. Two reliability studies (A and B), using 10 children less than 24 months each, were conducted in the GMP services of a rural district in Ghana. Fifteen nurses and 15 health volunteers (HV) with no prior experience in length measurements were trained. Intra- and inter-observer technical error of measurement (TEM), average bias from expert anthropometrist, and coefficient of reliability (R) of length measurements were assessed and compared across sessions. Observations and interviews were used to understand the ability and experiences of health personnel with measuring length at outreach GMP. Inter-observer TEM was larger than intra-observer TEM for both nurses and HV at both sessions and was unacceptably (compared to error standards) high in both groups at both time points. Average biases from expert's measurements were within acceptable limits, however, both groups tended to underestimate length measurements. The R for lengths collected by nurses (92.3%) was higher at session B compared to that of HV (87.5%). Length measurements taken by nurses and HV, and those taken by an experienced anthropometrist at GMP sessions were of moderate agreement (kappa = 0.53, p < 0.0001). The reliability of length measurements improved after two refresher trainings for nurses but not for HV. In addition, length measurements taken during GMP sessions may be susceptible to errors due to overburdened health personnel and crowded GMP clinics. There is need for both pre- and in-service training of nurses and HV on length measurements and procedures to improve reliability of length measurements.

[Systematic umbilical cord blood analysis at birth: feasibility and reliability in a French labour ward].

PubMed

Ernst, D; Clerc, J; Decullier, E; Gavanier, G; Dupuis, O

2012-10-01

At birth, evaluation of neonatal well-being is crucial. It is though important to perform umbilical cord blood gas analysis, and then to analyze the samples. We wanted to establish the feasibility and reliability of systematic umbilical cord blood sampling in a French labour ward. Study of systematic umbilical cord blood gas analysis was realized retrospectively from 1000 consecutive deliveries. We first established the feasibility of the samples. Feasibility was defined by the ratio of complete cord acid-base data on the number of deliveries from alive newborns. Afterwards, we established the reliability on the remaining cord samples. Reliability was the ratio of samples that fulfilled quality criteria defined by Westgate et al. and revised by Kro et al., on the number of complete samples from alive newborns. At last, we looked for factors that would influence these results. The systematic umbilical cord blood sample feasibility reached 91.6%, and the reliability reached 80.7%. About the delivery mode, 38.6% of emergency caesarians (IC 95% [30.8-46.3]; P<0.0001) led to non-valid samples, when only 11.3% of programmed caesarians (IC 95% [4.3-18.2]; P<0.0001) led to non-valid samples. Umbilical cord blood analysis were significantly less validated during emergency caesarians. Realization of systematic cord blood gas analysis was followed by 8.4% of incomplete samples, and by 19.3% that were uninterpretable. Training sessions should be organized to improve the feasibility and reliability, especially during emergency caesarians. Copyright © 2012 Elsevier Masson SAS. All rights reserved.

Increasing the reliability of the fluid/crystallized difference score from the Kaufman Adolescent and Adult Intelligence Test with reliable component analysis.

PubMed

Caruso, J C

2001-06-01

The unreliability of difference scores is a well documented phenomenon in the social sciences and has led researchers and practitioners to interpret differences cautiously, if at all. In the case of the Kaufman Adult and Adolescent Intelligence Test (KAIT), the unreliability of the difference between the Fluid IQ and the Crystallized IQ is due to the high correlation between the two scales. The consequences of the lack of precision with which differences are identified are wide confidence intervals and unpowerful significance tests (i.e., large differences are required to be declared statistically significant). Reliable component analysis (RCA) was performed on the subtests of the KAIT in order to address these problems. RCA is a new data reduction technique that results in uncorrelated component scores with maximum proportions of reliable variance. Results indicate that the scores defined by RCA have discriminant and convergent validity (with respect to the equally weighted scores) and that differences between the scores, derived from a single testing session, were more reliable than differences derived from equal weighting for each age group (11-14 years, 15-34 years, 35-85+ years). This reliability advantage results in narrower confidence intervals around difference scores and smaller differences required for statistical significance.

Developing empowering health counseling measurement. Preliminary results.

PubMed

Kettunen, Tarja; Liimatainen, Leena; Villberg, Jari; Perko, Ulla

2006-12-01

This article describes the derivation of an instrument (Empowering Speech Practices Scale) for assessing the empowerment of dyadic counseling, the evaluation of the validity and reliability of the ESPS and the results acquired with the instrument from hospital counseling. ESPS was constructed on the basis of empowerment theory and foregoing conversation analytic research. Nurses and patients assessed the same counseling session by way of parallel statements. Structure and reliability of the scale were evaluated with Cronbach alpha, percentage of agreement, factor analysis and logistic regression analysis. According to these preliminary results, ESPS described the realization of empowerment, directing attention to patient participation. By means of the scale, we assessed 127 counseling sessions and found evidence of the realization of empowering counseling. According to the results, nurses were the most successful in constructing a positive emotional atmosphere and in giving information. We found evidence that nurses need to improve the active mutuality of the counseling relationship by asking for patients' opinions and views, by facilitating the patients' assessment of their personal health and their participation in decision-making and coming up with options for their individual treatment. The developed scale can be utilized, in addition to assessing the quality in hospital care, for improving nursing education programs. Further study is needed to evaluate the usability of the scale and to examine its stability and validity.

Inter-session reliability and sex-related differences in hamstrings total reaction time, pre-motor time and motor time during eccentric isokinetic contractions in recreational athlete.

PubMed

Ayala, Francisco; De Ste Croix, Mark; Sainz de Baranda, Pilar; Santonja, Fernando

2014-04-01

The purposes were twofold: (a) to ascertain the inter-session reliability of hamstrings total reaction time, pre-motor time and motor time; and (b) to examine sex-related differences in the hamstrings reaction times profile. Twenty-four men and 24 women completed the study. Biceps femoris and semitendinosus total reaction time, pre-motor time and motor time measured during eccentric isokinetic contractions were recorded on three different occasions. Inter-session reliability was examined through typical percentage error (CVTE), percentage change in the mean (CM) and intraclass correlations (ICC). For both biceps femoris and semitendinosus, total reaction time, pre-motor time and motor time measures demonstrated moderate inter-session reliability (CVTE<10%; CM<3%; ICC>0.7). The results also indicated that, although not statistically significant, women reported consistently longer hamstrings total reaction time (23.5ms), pre-motor time (12.7ms) and motor time (7.5ms) values than men. Therefore, an observed change larger than 5%, 9% and 8% for total reaction time, pre-motor time and motor time respectively from baseline scores after performing a training program would indicate that a real change was likely. Furthermore, while not statistically significant, sex differences were noted in the hamstrings reaction time profile which may play a role in the greater incidence of ACL injuries in women. Copyright © 2013 Elsevier Ltd. All rights reserved.

Psychophysical scaling of circular vection (CV) produced by optokinetic (OKN) motion: individual differences and effects of practice.

PubMed

Kennedy, R S; Hettinger, L J; Harm, D L; Ordy, J M; Dunlap, W P

1996-01-01

Vection (V) refers to the compelling visual illusion of self-motion experienced by stationary individuals when viewing moving visual surrounds. The phenomenon is of theoretical interest because of its relevance for understanding the neural basis of ordinary self-motion perception, and of practical importance because it is the experience that makes simulation, virtual reality displays, and entertainment devices more vicarious. This experiment was performed to address whether an optokinetically induced vection illusion exhibits monotonic and stable psychometric properties and whether individuals differ reliably in these (V) perceptions. Subjects were exposed to varying velocities of the circular vection (CV) display in an optokinetic (OKN) drum 2 meters in diameter in 5 one-hour daily sessions extending over a 1 week period. For grouped data, psychophysical scalings of velocity estimates showed that exponents in a Stevens' type power function were essentially linear (slope = 0.95) and largely stable over sessions. Latencies were slightly longer for the slowest and fastest induction stimuli, and the trend over sessions for average latency was longer as a function of practice implying time course adaptation effects. Test-retest reliabilities for individual slope and intercept measures were moderately strong (r = 0.45) and showed no evidence of superdiagonal form. This implies stability of the individual circularvection (CV) sensitivities. Because the individual CV scores were stable, reliabilities were improved by averaging 4 sessions in order to provide a stronger retest reliability (r = 0.80). Individual latency responses were highly reliable (r = 0.80). Mean CV latency and motion sickness symptoms were greater in males than in females. These individual differences in CV could be predictive of other outcomes, such as susceptibility to disorientation or motion sickness, and for CNS localization of visual-vestibular interactions in the experience of self-motion.

The impact of intrinsic motivation on session attendance and reliable cognitive improvement in cognitive remediation in schizophrenia.

PubMed

Bryce, S D; Lee, S J; Ponsford, J L; Lawrence, R J; Tan, E J; Rossell, S L

2018-06-20

Cognitive remediation (CR) is considered a potentially effective method of improving cognitive function in people with schizophrenia. Few studies, however, have explored the role of intrinsic motivation on treatment utilization or training outcomes in CR in this population. This study explored the impact of task-specific intrinsic motivation on attendance and reliable cognitive improvement in a controlled trial comparing CR with a computer game (CG) playing control. Forty-nine participants with schizophrenia or schizoaffective disorder, allocated to 10 weeks of group-based CR (n = 25) or CG control (n = 24), provided complete outcome data at baseline. Forty-three participants completed their assigned intervention. Cognition, psychopathology and intrinsic motivation were measured at baseline and end-treatment. Regression analyses explored the relative contribution of baseline motivation and other clinical factors to session attendance as well as the association of baseline and change in intrinsic motivation with the odds of reliable cognitive improvement (calculated using reliable change indices). Baseline reports of perceived program value were the only significant multivariable predictor of session attendance when including global cognition and psychiatric symptomatology. The odds of reliable cognitive improvement significantly increased with greater improvements in program interest and value from baseline to end-treatment. Motivational changes over time were highly variable between participants. Task-specific intrinsic motivation in schizophrenia may represent an important patient-related factor that contributes to session attendance and cognitive improvements in CR. Regular evaluation and enhancement of intrinsic motivation in cognitively enhancing interventions may optimize treatment engagement and the likelihood of meaningful training outcomes. Copyright © 2018 Elsevier B.V. All rights reserved.

A new music therapy engagement scale for persons with dementia.

PubMed

Tan, Jane; Wee, Shiou-Liang; Yeo, Pei Shi; Choo, Juliet; Ritholz, Michele; Yap, Philip

2018-05-25

ABSTRACTObjectives:To develop and validate a new scale to assess music therapy engagement in persons with dementia (PWDs). A draft scale was derived from literature review and >2 years of qualitative recording of PWDs during music therapy. Content validity was attained through iterative consultations, trial sessions, and revisions. The final five-item Music Therapy Engagement scale for Dementia (MTED) assessed music and non-music related elements. Internal consistency and inter-rater reliability were assessed over 120 music therapy sessions. MTED was validated with the Greater Cincinnati Chapter Well-being Observation Tool, Holden Communication Scale, and Participant Engagement Observation Checklist - Music Sessions. A total of 62 PWDs (83.2 ± 7.7 years, modified version of the mini-mental state examination = 13.2/30 ± 4.1) in an acute hospital dementia unit were involved. The mean MTED score was 13.02/30 ± 4.27; internal consistency (Cronbach's α = 0.87) and inter-rater reliability (intra-class correlation = 0.96) were good. Principal component analysis revealed a one-factor structure with Eigen value > 1 (3.27), which explained 65.4% of the variance. MTED demonstrated good construct validity. The MTED total score correlated strongly with the combined items comprising Pleasure, Interest, Sadness, and Sustained attention of the Greater Cincinnati Chapter Well-being Observation Tool (rs = 0.88, p < 0.001). MTED is a clinically appropriate and psychometrically valid scale to evaluate music therapy engagement in PWDs.

Unobtrusive ambulatory EEG using a smartphone and flexible printed electrodes around the ear

PubMed Central

Debener, Stefan; Emkes, Reiner; De Vos, Maarten; Bleichner, Martin

2015-01-01

This study presents first evidence that reliable EEG data can be recorded with a new cEEGrid electrode array, which consists of ten electrodes printed on flexible sheet and arranged in a c-shape to fit around the ear. Ten participants wore two cEEGrid systems for at least seven hours. Using a smartphone for stimulus delivery and signal acquisition, resting EEG and auditory oddball data were collected in the morning and in the afternoon six to seven hours apart. Analysis of resting EEG data confirmed well-known spectral differences between eyes open and eyes closed conditions. The ERP results confirmed the predicted condition effects with significantly larger P300 amplitudes for target compared to standard tones, and a high test-retest reliability of the P300 amplitude (r > = .74). Moreover, a linear classifier trained on data from the morning session revealed similar performance in classification accuracy for the morning and the afternoon sessions (both > 70%). These findings demonstrate the feasibility of concealed and comfortable brain activity acquisition over many hours. PMID:26572314

Reliability analysis of the AOSpine thoracolumbar spine injury classification system by a worldwide group of naïve spinal surgeons.

PubMed

Kepler, Christopher K; Vaccaro, Alexander R; Koerner, John D; Dvorak, Marcel F; Kandziora, Frank; Rajasekaran, Shanmuganathan; Aarabi, Bizhan; Vialle, Luiz R; Fehlings, Michael G; Schroeder, Gregory D; Reinhold, Maximilian; Schnake, Klaus John; Bellabarba, Carlo; Cumhur Öner, F

2016-04-01

The aims of this study were (1) to demonstrate the AOSpine thoracolumbar spine injury classification system can be reliably applied by an international group of surgeons and (2) to delineate those injury types which are difficult for spine surgeons to classify reliably. A previously described classification system of thoracolumbar injuries which consists of a morphologic classification of the fracture, a grading system for the neurologic status and relevant patient-specific modifiers was applied to 25 cases by 100 spinal surgeons from across the world twice independently, in grading sessions 1 month apart. The results were analyzed for classification reliability using the Kappa coefficient (κ). The overall Kappa coefficient for all cases was 0.56, which represents moderate reliability. Kappa values describing interobserver agreement were 0.80 for type A injuries, 0.68 for type B injuries and 0.72 for type C injuries, all representing substantial reliability. The lowest level of agreement for specific subtypes was for fracture subtype A4 (Kappa = 0.19). Intraobserver analysis demonstrated overall average Kappa statistic for subtype grading of 0.68 also representing substantial reproducibility. In a worldwide sample of spinal surgeons without previous exposure to the recently described AOSpine Thoracolumbar Spine Injury Classification System, we demonstrated moderate interobserver and substantial intraobserver reliability. These results suggest that most spine surgeons can reliably apply this system to spine trauma patients as or more reliably than previously described systems.

Analysis of PubMed User Sessions Using a Full-Day PubMed Query Log: A Comparison of Experienced and Nonexperienced PubMed Users

PubMed Central

2015-01-01

Background PubMed is the largest biomedical bibliographic information source on the Internet. PubMed has been considered one of the most important and reliable sources of up-to-date health care evidence. Previous studies examined the effects of domain expertise/knowledge on search performance using PubMed. However, very little is known about PubMed users’ knowledge of information retrieval (IR) functions and their usage in query formulation. Objective The purpose of this study was to shed light on how experienced/nonexperienced PubMed users perform their search queries by analyzing a full-day query log. Our hypotheses were that (1) experienced PubMed users who use system functions quickly retrieve relevant documents and (2) nonexperienced PubMed users who do not use them have longer search sessions than experienced users. Methods To test these hypotheses, we analyzed PubMed query log data containing nearly 3 million queries. User sessions were divided into two categories: experienced and nonexperienced. We compared experienced and nonexperienced users per number of sessions, and experienced and nonexperienced user sessions per session length, with a focus on how fast they completed their sessions. Results To test our hypotheses, we measured how successful information retrieval was (at retrieving relevant documents), represented as the decrease rates of experienced and nonexperienced users from a session length of 1 to 2, 3, 4, and 5. The decrease rate (from a session length of 1 to 2) of the experienced users was significantly larger than that of the nonexperienced groups. Conclusions Experienced PubMed users retrieve relevant documents more quickly than nonexperienced PubMed users in terms of session length. PMID:26139516

The Effects of a Peer-Delivered Social Skills Intervention for Adults with Comorbid Down Syndrome and Autism Spectrum Disorder.

PubMed

Davis, Matthew A Cody; Spriggs, Amy; Rodgers, Alexis; Campbell, Jonathan

2018-06-01

Deficits in social skills are often exhibited in individuals with comorbid Down syndrome (DS) and autism spectrum disorder (ASD), and there is a paucity of research to help guide intervention for this population. In the present study, a multiple probe study across behaviors, replicated across participants, assessed the effectiveness of peer-delivered simultaneous prompting in teaching socials skills to adults with DS-ASD using visual analysis techniques and Tau-U statistics to measure effect. Peer-mediators with DS and intellectual disability (ID) delivered simultaneous prompting sessions reliably (i.e., > 80% reliability) to teach social skills to adults with ID and a dual-diagnoses of DS-ASD with small (Tau Weighted  = .55, 90% CI [.29, .82]) to medium effects (Tau Weighted  = .75, 90% CI [.44, 1]). Statistical and visual analysis findings suggest a promising social skills intervention for individuals with DS-ASD as well as reliable delivery of simultaneous prompting procedures by individuals with DS.

Contingency interaction analysis in psychotherapy.

PubMed

Canfield, M L; Walker, W R; Brown, L G

1991-02-01

This article introduces (a) a computerized coding procedure that rates words and utterances in terms of emotion, cognition, and contract and (b) a contingency method of analyzing verbal interactions. Using transcripts of sessions conducted by 3 master therapists with 1 client, the rating procedure and contingency correlation analyses supported the study's hypotheses. Therapists' utterances were characterized by significantly different amounts of emotion, cognition, and contracts, indicating that communication styles varied in the relative emphasis placed on these attributes. Differences suggest that the therapists responded differently to emotional, cognitive, and contract utterances and that the client's responses were different across the 3 therapist interviews. Split halves of the interviews within therapists and within client sessions were not different, providing further evidence of reliability of the coding and contingency procedures.

Assessing fidelity of delivery of smoking cessation behavioural support in practice.

PubMed

Lorencatto, Fabiana; West, Robert; Christopherson, Charlotte; Michie, Susan

2013-04-04

Effectiveness of evidence-based behaviour change interventions is likely to be undermined by failure to deliver interventions as planned. Behavioural support for smoking cessation can be a highly cost-effective, life-saving intervention. However, in practice, outcomes are highly variable. Part of this may be due to variability in fidelity of intervention implementation. To date, there have been no published studies on this. The present study aimed to: evaluate a method for assessing fidelity of behavioural support; assess fidelity of delivery in two English Stop-Smoking Services; and compare the extent of fidelity according to session types, duration, individual practitioners, and component behaviour change techniques (BCTs). Treatment manuals and transcripts of 34 audio-recorded behavioural support sessions were obtained from two Stop-Smoking Services and coded into component BCTs using a taxonomy of 43 BCTs. Inter-rater reliability was assessed using percentage agreement. Fidelity was assessed by examining the proportion of BCTs specified in the manuals that were delivered in individual sessions. This was assessed by session type (i.e., pre-quit, quit, post-quit), duration, individual practitioner, and BCT. Inter-coder reliability was high (87.1%). On average, 66% of manual-specified BCTs were delivered per session (SD 15.3, range: 35% to 90%). In Service 1, average fidelity was highest for post-quit sessions (69%) and lowest for pre-quit (58%). In Service 2, fidelity was highest for quit-day (81%) and lowest for post-quit sessions (56%). Session duration was not significantly correlated with fidelity. Individual practitioner fidelity ranged from 55% to 78%. Individual manual-specified BCTs were delivered on average 63% of the time (SD 28.5, range: 0 to 100%). The extent to which smoking cessation behavioural support is delivered as specified in treatment manuals can be reliably assessed using transcripts of audiotaped sessions. This allows the investigation of the implementation of evidence-based practice in relation to smoking cessation, a first step in designing interventions to improve it. There are grounds for believing that fidelity in the English Stop-Smoking Services may be low and that routine monitoring is warranted.

Influences on the Test-Retest Reliability of Functional Connectivity MRI and its Relationship with Behavioral Utility.

PubMed

Noble, Stephanie; Spann, Marisa N; Tokoglu, Fuyuze; Shen, Xilin; Constable, R Todd; Scheinost, Dustin

2017-11-01

Best practices are currently being developed for the acquisition and processing of resting-state magnetic resonance imaging data used to estimate brain functional organization-or "functional connectivity." Standards have been proposed based on test-retest reliability, but open questions remain. These include how amount of data per subject influences whole-brain reliability, the influence of increasing runs versus sessions, the spatial distribution of reliability, the reliability of multivariate methods, and, crucially, how reliability maps onto prediction of behavior. We collected a dataset of 12 extensively sampled individuals (144 min data each across 2 identically configured scanners) to assess test-retest reliability of whole-brain connectivity within the generalizability theory framework. We used Human Connectome Project data to replicate these analyses and relate reliability to behavioral prediction. Overall, the historical 5-min scan produced poor reliability averaged across connections. Increasing the number of sessions was more beneficial than increasing runs. Reliability was lowest for subcortical connections and highest for within-network cortical connections. Multivariate reliability was greater than univariate. Finally, reliability could not be used to improve prediction; these findings are among the first to underscore this distinction for functional connectivity. A comprehensive understanding of test-retest reliability, including its limitations, supports the development of best practices in the field. © The Author 2017. Published by Oxford University Press.

Intra- and interrater reliability of the 'lumbar-locked thoracic rotation test' in competitive swimmers ages 10 through 18 years.

PubMed

Feijen, Stef; Kuppens, Kevin; Tate, Angela; Baert, Isabel; Struyf, Thomas; Struyf, Filip

2018-04-17

Measuring thoracic spine mobility can be of interest to competitive swimmers as it has been associated with shoulder girdle function and scapular position in subjects with and without shoulder pain. At present, no reliability data of thoracic spine mobility measurements are available in the swimming population. This study aims to evaluate the within-session intra- and interrater reliability of the "lumbar-locked rotation test" for thoracic spine rotation in competitive swimmers aged 10 to 18 years. This reliability study is part of a larger prospective cohort study investigating potential risk factors for the development of shoulder pain in competitive swimmers. Within-session, intra- and inter-rater reliability. Competitive swimming clubs in Belgium. 21 competitive swimmers. Intra- and inter-rater reliability of the lumbar-locked thoracic rotation test. Intraclass correlation coefficients (ICCs) ranged from 0.91 (95% CI 0.78 to 0.96) to 0.96 (0.89-0.98) for intra-rater reliability. Results for inter-rater reliability ranged from 0.89 (0.72-0.95) to 0.86 (0.65-0.94) respectively for right and left thoracic rotation. Results suggest good to excellent reliability of the lumbar-locked thoracic rotation test, indicating this test can be used reliably in clinical practice. Copyright © 2018 Elsevier Ltd. All rights reserved.

They saw a movie: long-term memory for an extended audiovisual narrative.

PubMed

Furman, Orit; Dorfman, Nimrod; Hasson, Uri; Davachi, Lila; Dudai, Yadin

2007-06-01

We measured long-term memory for a narrative film. During the study session, participants watched a 27-min movie episode, without instructions to remember it. During the test session, administered at a delay ranging from 3 h to 9 mo after the study session, long-term memory for the movie was probed using a computerized questionnaire that assessed cued recall, recognition, and metamemory of movie events sampled approximately 20 sec apart. The performance of each group of participants was measured at a single time point only. The participants remembered many events in the movie even months after watching it. Analysis of performance, using multiple measures, indicates differences between recent (weeks) and remote (months) memory. While high-confidence recognition performance was a reliable index of memory throughout the measured time span, cued recall accuracy was higher for relatively recent information. Analysis of different content elements in the movie revealed differential memory performance profiles according to time since encoding. We also used the data to propose lower limits on the capacity of long-term memory. This experimental paradigm is useful not only for the analysis of behavioral performance that results from encoding episodes in a continuous real-life-like situation, but is also suitable for studying brain substrates and processes of real-life memory using functional brain imaging.

They saw a movie: Long-term memory for an extended audiovisual narrative

PubMed Central

Furman, Orit; Dorfman, Nimrod; Hasson, Uri; Davachi, Lila; Dudai, Yadin

2007-01-01

We measured long-term memory for a narrative film. During the study session, participants watched a 27-min movie episode, without instructions to remember it. During the test session, administered at a delay ranging from 3 h to 9 mo after the study session, long-term memory for the movie was probed using a computerized questionnaire that assessed cued recall, recognition, and metamemory of movie events sampled ∼20 sec apart. The performance of each group of participants was measured at a single time point only. The participants remembered many events in the movie even months after watching it. Analysis of performance, using multiple measures, indicates differences between recent (weeks) and remote (months) memory. While high-confidence recognition performance was a reliable index of memory throughout the measured time span, cued recall accuracy was higher for relatively recent information. Analysis of different content elements in the movie revealed differential memory performance profiles according to time since encoding. We also used the data to propose lower limits on the capacity of long-term memory. This experimental paradigm is useful not only for the analysis of behavioral performance that results from encoding episodes in a continuous real-life-like situation, but is also suitable for studying brain substrates and processes of real-life memory using functional brain imaging. PMID:17562897

Simultaneous measurements of kinematics and fMRI: compatibility assessment and case report on recovery evaluation of one stroke patient.

PubMed

Casellato, Claudia; Ferrante, Simona; Gandolla, Marta; Volonterio, Nicola; Ferrigno, Giancarlo; Baselli, Giuseppe; Frattini, Tiziano; Martegani, Alberto; Molteni, Franco; Pedrocchi, Alessandra

2010-09-23

Correlating the features of the actual executed movement with the associated cortical activations can enhance the reliability of the functional Magnetic Resonance Imaging (fMRI) data interpretation. This is crucial for longitudinal evaluation of motor recovery in neurological patients and for investigating detailed mutual interactions between activation maps and movement parameters.Therefore, we have explored a new set-up combining fMRI with an optoelectronic motion capture system, which provides a multi-parameter quantification of the performed motor task. The cameras of the motion system were mounted inside the MR room and passive markers were placed on the subject skin, without any risk or encumbrance. The versatile set-up allows 3-dimensional multi-segment acquisitions including recording of possible mirror movements, and it guarantees a high inter-sessions repeatability.We demonstrated the integrated set-up reliability through compatibility tests. Then, an fMRI block-design protocol combined with kinematic recordings was tested on a healthy volunteer performing finger tapping and ankle dorsal- plantar-flexion. A preliminary assessment of clinical applicability and perspectives was carried out by pre- and post rehabilitation acquisitions on a hemiparetic patient performing ankle dorsal- plantar-flexion. For all sessions, the proposed method integrating kinematic data into the model design was compared with the standard analysis. Phantom acquisitions demonstrated the not-compromised image quality. Healthy subject sessions showed the protocols feasibility and the model reliability with the kinematic regressor. The patient results showed that brain activation maps were more consistent when the images analysis included in the regression model, besides the stimuli, the kinematic regressor quantifying the actual executed movement (movement timing and amplitude), proving a significant model improvement. Moreover, concerning motor recovery evaluation, after one rehabilitation month, a greater cortical area was activated during exercise, in contrast to the usual focalization associated with functional recovery. Indeed, the availability of kinematics data allows to correlate this wider area with a higher frequency and a larger amplitude of movement. The kinematic acquisitions resulted to be reliable and versatile to enrich the fMRI images information and therefore the evaluation of motor recovery in neurological patients where large differences between required and performed motion can be expected.

Simultaneous measurements of kinematics and fMRI: compatibility assessment and case report on recovery evaluation of one stroke patient

PubMed Central

2010-01-01

Background Correlating the features of the actual executed movement with the associated cortical activations can enhance the reliability of the functional Magnetic Resonance Imaging (fMRI) data interpretation. This is crucial for longitudinal evaluation of motor recovery in neurological patients and for investigating detailed mutual interactions between activation maps and movement parameters. Therefore, we have explored a new set-up combining fMRI with an optoelectronic motion capture system, which provides a multi-parameter quantification of the performed motor task. Methods The cameras of the motion system were mounted inside the MR room and passive markers were placed on the subject skin, without any risk or encumbrance. The versatile set-up allows 3-dimensional multi-segment acquisitions including recording of possible mirror movements, and it guarantees a high inter-sessions repeatability. We demonstrated the integrated set-up reliability through compatibility tests. Then, an fMRI block-design protocol combined with kinematic recordings was tested on a healthy volunteer performing finger tapping and ankle dorsal- plantar-flexion. A preliminary assessment of clinical applicability and perspectives was carried out by pre- and post rehabilitation acquisitions on a hemiparetic patient performing ankle dorsal- plantar-flexion. For all sessions, the proposed method integrating kinematic data into the model design was compared with the standard analysis. Results Phantom acquisitions demonstrated the not-compromised image quality. Healthy subject sessions showed the protocols feasibility and the model reliability with the kinematic regressor. The patient results showed that brain activation maps were more consistent when the images analysis included in the regression model, besides the stimuli, the kinematic regressor quantifying the actual executed movement (movement timing and amplitude), proving a significant model improvement. Moreover, concerning motor recovery evaluation, after one rehabilitation month, a greater cortical area was activated during exercise, in contrast to the usual focalization associated with functional recovery. Indeed, the availability of kinematics data allows to correlate this wider area with a higher frequency and a larger amplitude of movement. Conclusions The kinematic acquisitions resulted to be reliable and versatile to enrich the fMRI images information and therefore the evaluation of motor recovery in neurological patients where large differences between required and performed motion can be expected. PMID:20863391

Nasalance measures in Cantonese-speaking women.

PubMed

Whitehill, T L

2001-03-01

To establish and evaluate stimulus materials for nasalance measurement in Cantonese speakers, to provide normative data for Cantonese-speaking women, and to evaluate session-to-session reliability of nasalance measures. One hundred forty-one Cantonese-speaking women with normal resonance who were students in the Department of Speech and Hearing Sciences, University of Hong Kong. Participants read aloud four speech stimuli: oral sentences, nasal sentences, an oral paragraph (similar to the Zoo Passage), and an oral-nasal paragraph (similar to the Rainbow Passage). Data were collected and analyzed using the Kay Nasometer 6200. Data collection was repeated for a subgroup of speakers (n = 28) on a separate day. Nasalance materials were evaluated by using statistical tests of difference and correlation. Group mean (standard deviation) nasalance scores for oral sentences, nasal sentences, oral paragraph, and oral-nasal paragraph were 16.79 (5.99), 55.67 (7.38), 13.68 (7.16), and 35.46 (6.22), respectively. There was a significant difference in mean nasalance scores for oral versus nasal materials. Correlations between stimuli were as expected, ranging from 0.43 to 0.91. Session-to-session reliability was within 5 points for over 95% of speakers for the oral stimuli but for less than 76% of speakers for the nasal and oral-nasal stimuli. Standard nasalance materials have been developed for Cantonese, and normative data have been established for Cantonese women. Evaluation of materials indicated acceptable differentiation between oral and nasal materials. Two stimuli (nasal sentences and oral paragraph) are recommended for future use. Comparison with findings from other languages showed similarities in scores; possible language-specific differences are discussed. Session-to-session reliability was poorer for nasal than oral stimuli.

Demonstrating Test-Retest Reliability of Electrophysiological Measures for Healthy Adults in a Multisite Study of Biomarkers of Antidepressant Treatment Response

PubMed Central

Tenke, Craig E.; Kayser, Jürgen; Pechtel, Pia; Webb, Christian A.; Dillon, Daniel G.; Goer, Franziska; Murray, Laura; Deldin, Patricia; Kurian, Benji T.; McGrath, Patrick J.; Parsey, Ramin; Trivedi, Madhukar; Fava, Maurizio; Weissman, Myrna M.; McInnis, Melvin; Abraham, Karen; Alvarenga, Jorge; Alschuler, Daniel M.; Cooper, Crystal; Pizzagalli, Diego A.; Bruder, Gerard E.

2016-01-01

Growing evidence suggests that loudness dependency of auditory evoked potentials (LDAEP) and resting EEG alpha and theta may be biological markers for predicting response to antidepressants. In spite of this promise, little is known about the joint reliability of these markers, and thus their clinical applicability. New, standardized procedures were developed to improve the compatibility of data acquired with different EEG platforms, and used to examine test-retest reliability for the three electrophysiological measures selected for a multisite project—Establishing Moderators and Biosignatures of Antidepressant Response for Clinical Care (EMBARC). Thirty nine healthy controls across four clinical research sites were tested in two sessions separated by about one week. Resting EEG (eyes-open and eyes-closed conditions) was recorded and LDAEP measured using binaural tones (1000 Hz, 40 ms) at five intensities (60–100 dB SPL). Principal components analysis (PCA) of current source density (CSD) waveforms reduced volume conduction and provided reference-free measures of resting EEG alpha and N1 dipole activity to tones from auditory cortex. Low Resolution Electromagnetic Tomography (LORETA) extracted resting theta current density measures corresponding to rostral anterior cingulate (rACC), which has been implicated in treatment response. There were no significant differences in posterior alpha, N1 dipole or rACC theta across sessions. Test-retest reliability was .84 for alpha, .87 for N1 dipole, and .70 for theta rACC current density. The demonstration of good-to-excellent reliability for these measures provides a template for future EEG/ERP studies from multiple testing sites, and an important step for evaluating them as biomarkers for predicting treatment response. PMID:28000259

Demonstrating test-retest reliability of electrophysiological measures for healthy adults in a multisite study of biomarkers of antidepressant treatment response.

PubMed

Tenke, Craig E; Kayser, Jürgen; Pechtel, Pia; Webb, Christian A; Dillon, Daniel G; Goer, Franziska; Murray, Laura; Deldin, Patricia; Kurian, Benji T; McGrath, Patrick J; Parsey, Ramin; Trivedi, Madhukar; Fava, Maurizio; Weissman, Myrna M; McInnis, Melvin; Abraham, Karen; E Alvarenga, Jorge; Alschuler, Daniel M; Cooper, Crystal; Pizzagalli, Diego A; Bruder, Gerard E

2017-01-01

Growing evidence suggests that loudness dependency of auditory evoked potentials (LDAEP) and resting EEG alpha and theta may be biological markers for predicting response to antidepressants. In spite of this promise, little is known about the joint reliability of these markers, and thus their clinical applicability. New standardized procedures were developed to improve the compatibility of data acquired with different EEG platforms, and used to examine test-retest reliability for the three electrophysiological measures selected for a multisite project-Establishing Moderators and Biosignatures of Antidepressant Response for Clinical Care (EMBARC). Thirty-nine healthy controls across four clinical research sites were tested in two sessions separated by about 1 week. Resting EEG (eyes-open and eyes-closed conditions) was recorded and LDAEP measured using binaural tones (1000 Hz, 40 ms) at five intensities (60-100 dB SPL). Principal components analysis of current source density waveforms reduced volume conduction and provided reference-free measures of resting EEG alpha and N1 dipole activity to tones from auditory cortex. Low-resolution electromagnetic tomography (LORETA) extracted resting theta current density measures corresponding to rostral anterior cingulate (rACC), which has been implicated in treatment response. There were no significant differences in posterior alpha, N1 dipole, or rACC theta across sessions. Test-retest reliability was .84 for alpha, .87 for N1 dipole, and .70 for theta rACC current density. The demonstration of good-to-excellent reliability for these measures provides a template for future EEG/ERP studies from multiple testing sites, and an important step for evaluating them as biomarkers for predicting treatment response. © 2016 Society for Psychophysiological Research.

Reliability of the sliding scale for collecting affective responses to words.

PubMed

Imbault, C; Shore, D; Kuperman, V

2018-01-25

Warriner, Shore, Schmidt, Imbault, and Kuperman, Canadian Journal of Experimental Psychology, 71; 71-88 (2017) have recently proposed a slider task in which participants move a manikin on a computer screen toward or further away from a word, and the distance (in pixels) is a measure of the word's valence. Warriner, Shore, Schmidt, Imbault, and Kuperman, Canadian Journal of Experimental Psychology, 71; 71-88 (2017) showed this task to be more valid than the widely used rating task, but they did not examine the reliability of the new methodology. In this study we investigated multiple aspects of this task's reliability. In Experiment 1 (Exps. 1.1-1.6), we showed that the sliding scale has high split-half reliability (r = .868 to .931). In Experiment 2, we also showed that the slider task elicits consistent repeated responses both within a single session (Exp. 2: r = .804) and across two sessions separated by one week (Exp. 3: r = .754). Overall, the slider task, in addition to having high validity, is highly reliable.

Reliability Analysis of Traditional and Ballistic Bench Press Exercises at Different Loads

PubMed Central

García-Ramos, Amador; Padial, Paulino; García-Ramos, Miguel; Conde-Pipó, Javier; Argüelles-Cienfuegos, Javier; Štirn, Igor; Feriche, Belén

2015-01-01

The purpose of this study was to determine test–retest reliability for peak barbell velocity (Vpeak) during the bench press (BP) and bench press throw (BPT) exercises for loads corresponding to 20–70% of one-repetition maximum (1RM). Thirty physically active collegiate men conducted four evaluations after a preliminary BP 1RM determination (1RM·bw-1 = 1.02 ± 0.16 kg·kg-1). In counterbalanced order, participants performed two sessions of the BP in one week and two sessions of the BPT in another week. Recovery time between sessions within the same week was 48 hours and recovery time between sessions of different weeks was 120 hours. On each day of evaluation the individual load-velocity relationship at each tenth percentile (20–70% of 1RM) in a Smith machine for the BP or BPT was determined. Participants performed three attempts per load, but only the best repetition (highest Vpeak), registered by a linear position transducer, was analysed. The BPT resulted in a significantly lower coefficient of variation (CV) for the whole load–velocity relationship, compared to the BP (2.48% vs. 3.22%; p = 0.040). Test–retest intraclass correlation coefficients (ICCs) ranged from r = 0.94–0.85 for the BPT and r = 0.91–0.71 for the BP (p < 0.001). The reduction in the biological within-subject variation in BPT exercise could be promoted by the braking phase that obligatorily occurs during a BP executed with light or moderate loads. Therefore, we recommend the BPT exercise for a most accurate assessment of upper-body velocity. PMID:26557190

Subjective evaluation of experimental dyspnoea – Effects of isocapnia and repeated exposure

PubMed Central

Hayen, Anja; Herigstad, Mari; Wiech, Katja; Pattinson, Kyle T.S.

2015-01-01

Resistive respiratory loading is an established stimulus for the induction of experimental dyspnoea. In comparison to unloaded breathing, resistive loaded breathing alters end-tidal CO2 (PETCO2), which has independent physiological effects (e.g. upon cerebral blood flow). We investigated the subjective effects of resistive loaded breathing with stabilized PETCO2 (isocapnia) during manual control of inspired gases on varying baseline levels of mild hypercapnia (increased PETCO2). Furthermore, to investigate whether perceptual habituation to dyspnoea stimuli occurs, the study was repeated over four experimental sessions. Isocapnic hypercapnia did not affect dyspnoea unpleasantness during resistive loading. A post hoc analysis revealed a small increase of respiratory unpleasantness during unloaded breathing at +0.6 kPa, the level that reliably induced isocapnia. We did not observe perceptual habituation over the four sessions. We conclude that isocapnic respiratory loading allows stable induction of respiratory unpleasantness, making it a good stimulus for multi-session studies of dyspnoea. PMID:25578628

Gait Deviation Index, Gait Profile Score and Gait Variable Score in children with spastic cerebral palsy: Intra-rater reliability and agreement across two repeated sessions.

PubMed

Rasmussen, Helle Mätzke; Nielsen, Dennis Brandborg; Pedersen, Niels Wisbech; Overgaard, Søren; Holsgaard-Larsen, Anders

2015-07-01

The Gait Deviation Index (GDI) and Gait Profile Score (GPS) are the most used summary measures of gait in children with cerebral palsy (CP). However, the reliability and agreement of these indices have not been investigated, limiting their clinimetric quality for research and clinical practice. The aim of this study was to investigate the intra-rater reliability and agreement of summary measures of gait (GDI; GPS; and the Gait Variable Score (GVS) derived from the GPS). The intra-rater reliability and agreement were investigated across two repeated sessions in 18 children aged 5-12 years diagnosed with spastic CP. No systematic bias was observed between the sessions and no heteroscedasticity was observed in Bland-Altman plots. For the GDI and GPS, excellent reliability with intraclass correlation coefficient (ICC) values of 0.8-0.9 was found, while the GVS was found to have fair to good reliability with ICCs of 0.4-0.7. The agreement for the GDI and the logarithmically transformed GPS, in terms of the standard error of measurement as a percentage of the grand mean (SEM%) varied from 4.1 to 6.7%, whilst the smallest detectable change in percent (SDC%) ranged from 11.3 to 18.5%. For the logarithmically transformed GVS, we found a fair to large variation in SEM% from 7 to 29% and in SDC% from 18 to 81%. The GDI and GPS demonstrated excellent reliability and acceptable agreement proving that they can both be used in research and clinical practice. However, the observed large variability for some of the GVS requires cautious consideration when selecting outcome measures. Copyright © 2015 Elsevier B.V. All rights reserved.

Reliability of dynamometric passive properties of the pelvic floor muscles in postmenopausal women with stress urinary incontinence.

PubMed

Morin, Mélanie; Gravel, Denis; Bourbonnais, Daniel; Dumoulin, Chantale; Ouellet, Stéphane

2008-01-01

The passive properties of the pelvic floor muscles (PFM) might play a role in stress urinary incontinence (SUI) pathophysiology. To investigate the test-retest reliability of the dynamometric passive properties of the PFM in postmenopausal SUI women. Thirty-two SUI postmenopausal women were convened to two sessions 2 weeks apart. In each session, the measurements were repeated twice. The pelvic floor musculature was evaluated in four different conditions: (1) forces recorded at minimal aperture (initial passive resistance); (2) passive resistance at maximal aperture; (3) five lengthening and shortening cycles (Forces and passive elastic stiffness (PES) were evaluated at different vaginal apertures. Hysteresis was also calculated.); (4) Percentage of passive resistance loss after 1 min of sustained stretching was computed. The generalizability theory was used to calculate two reliability estimates, the dependability indices (Phi) and the standard error of measurement (SEM), for one session involving one measurement or the mean of two measurements. Overall, the reliability of the passive properties was good with indices of dependability of 0.75-0.93. The SEMs for forces and PES were 0.24-0.67 N and 0.03-0.10 N/mm, respectively, for mean, maximal and 20-mm apertures, representing an error between 13% and 23%. Passive forces at minimal aperture showed lower reliability (Phi = 0.51-0.57) compared with other vaginal openings. The aperture at a common force of 0.5 N was the only parameter demonstrating a poor reliability (Phi = 0.35). This new approach for assessing PFM passive properties showed enough reliability for highly recommending its inclusion in the PFM assessment of SUI postmenopausal women. (c) 2008 Wiley-Liss, Inc.

Reliability of power and velocity variables collected during the traditional and ballistic bench press exercise.

PubMed

García-Ramos, Amador; Haff, G Gregory; Padial, Paulino; Feriche, Belén

2018-03-01

This study aimed to examine the reliability of different power and velocity variables during the Smith machine bench press (BP) and bench press throw (BPT) exercises. Twenty-two healthy men conducted four testing sessions after a preliminary BP one-repetition maximum (1RM) test. In a counterbalanced order, participants performed two sessions of BP in one week and two sessions of BPT in another week. Mean propulsive power, peak power, mean propulsive velocity, and peak velocity at each tenth percentile (20-70% of 1RM) were recorded by a linear transducer. The within-participants coefficient of variation (CV) was higher for the load-power relationship compared to the load-velocity relationship in both the BP (5.3% vs. 4.1%; CV ratio = 1.29) and BPT (4.7% vs. 3.4%; CV ratio = 1.38). Mean propulsive variables showed lower reliability than peak variables in both the BP (5.4% vs. 4.0%, CV ratio = 1.35) and BPT (4.8% vs. 3.3%, CV ratio = 1.45). All variables were deemed reliable, with the peak velocity demonstrating the lowest within-participants CV. Based upon these findings, the peak velocity should be chosen for the accurate assessment of BP and BPT performance.

Measurement of impulsive choice in rats: Same and alternate form test-retest reliability and temporal tracking

PubMed Central

Peterson, Jennifer R.; Hill, Catherine C.; Kirkpatrick, Kimberly

2016-01-01

Impulsive choice is typically measured by presenting smaller-sooner (SS) versus larger-later (LL) rewards, with biases towards the SS indicating impulsivity. The current study tested rats on different impulsive choice procedures with LL delay manipulations to assess same-form and alternate-form test-retest reliability. In the systematic-GE procedure (Green & Estle, 2003), the LL delay increased after several sessions of training; in the systematic-ER procedure (Evenden & Ryan, 1996), the delay increased within each session; and in the adjusting-M procedure (Mazur, 1987), the delay changed after each block of trials within a session based on each rat’s choices in the previous block. In addition to measuring choice behavior, we also assessed temporal tracking of the LL delays using the median times of responding during LL trials. The two systematic procedures yielded similar results in both choice and temporal tracking measures following extensive training, whereas the adjusting procedure resulted in relatively more impulsive choices and poorer temporal tracking. Overall, the three procedures produced acceptable same form test-retest reliability over time, but the adjusting procedure did not show significant alternate form test-retest reliability with the other two procedures. The results suggest that systematic procedures may supply better measurements of impulsive choice in rats. PMID:25490901

The reliability of an instrumented start block analysis system.

PubMed

Tor, Elaine; Pease, David L; Ball, Kevin A

2015-02-01

The swimming start is highly influential to overall competition performance. Therefore, it is paramount to develop reliable methods to perform accurate biomechanical analysis of start performance for training and research. The Wetplate Analysis System is a custom-made force plate system developed by the Australian Institute of Sport--Aquatic Testing, Training and Research Unit (AIS ATTRU). This sophisticated system combines both force data and 2D digitization to measure a number of kinetic and kinematic parameter values in an attempt to evaluate start performance. Fourteen elite swimmers performed two maximal effort dives (performance was defined as time from start signal to 15 m) over two separate testing sessions. Intraclass correlation coefficients (ICC) were used to determine each parameter's reliability. The kinetic parameters all had ICC greater than 0.9 except the time of peak vertical force (0.742). This may have been due to variations in movement initiation after the starting signal between trials. The kinematic and time parameters also had ICC greater than 0.9 apart from for the time of maximum depth (0.719). This parameter was lower due to the swimmers varying their depth between trials. Based on the high ICC scores for all parameters, the Wetplate Analysis System is suitable for biomechanical analysis of swimming starts.

Typology of Couples Entering Alcohol Behavioral Couple Therapy: An Empirical Approach and Test of Predictive Validity on Treatment Response

PubMed Central

Ladd, Benjamin O.; McCrady, Barbara S.

2016-01-01

The current study aimed to examine whether classification of couples in which one partner has an alcohol problem is similar to that reported in the general couples literature. Typologies of couples seeking Alcohol Behavioral Couple Therapy (ABCT) were developed via hierarchical cluster analysis using behavioral codes of couple interactions during their first ABCT session. Four couples types based on in-session behavior were established reliably, labeled Avoider, Validator, Hostile, and Ambivalent-Detached. These couple types resembled couples types found in previous research. Couple type was associated with baseline relationship satisfaction, but not alcohol use. Results suggest heterogeneity in couples with alcohol problems presenting to treatment; further study is needed to investigate the function of alcohol within these different types. PMID:25808432

Temporal reliability of ultra-high field resting-state MRI for single-subject sensorimotor and language mapping.

PubMed

Branco, Paulo; Seixas, Daniela; Castro, São Luís

2018-03-01

Resting-state fMRI is a well-suited technique to map functional networks in the brain because unlike task-based approaches it requires little collaboration from subjects. This is especially relevant in clinical settings where a number of subjects cannot comply with task demands. Previous studies using conventional scanner fields have shown that resting-state fMRI is able to map functional networks in single subjects, albeit with moderate temporal reliability. Ultra-high resolution (7T) imaging provides higher signal-to-noise ratio and better spatial resolution and is thus well suited to assess the temporal reliability of mapping results, and to determine if resting-state fMRI can be applied in clinical decision making including preoperative planning. We used resting-state fMRI at ultra-high resolution to examine whether the sensorimotor and language networks are reliable over time - same session and one week after. Resting-state networks were identified for all subjects and sessions with good accuracy. Both networks were well delimited within classical regions of interest. Mapping was temporally reliable at short and medium time-scales as demonstrated by high values of overlap in the same session and one week after for both networks. Results were stable independently of data quality metrics and physiological variables. Taken together, these findings provide strong support for the suitability of ultra-high field resting-state fMRI mapping at the single-subject level. Copyright © 2016 The Authors. Published by Elsevier Inc. All rights reserved.

A new iPhone application for measuring active craniocervical range of motion in patients with non-specific neck pain: a reliability and validity study.

PubMed

Pourahmadi, Mohammad Reza; Bagheri, Rasool; Taghipour, Morteza; Takamjani, Ismail Ebrahimi; Sarrafzadeh, Javad; Mohseni-Bandpei, Mohammad Ali

2018-03-01

Measurement of cervical spine range of motion (ROM) is often considered to be an essential component of cervical spine physiotherapy assessment. This study aimed to investigate the reliability and validity of an iPhone application (app) (Goniometer Pro) for measuring active craniocervical ROM (ACCROM) in patients with non-specific neck pain. A cross-sectional study was conducted at the musculoskeletal biomechanics laboratory located at Iran University of Medical Sciences. Forty non-specific neck pain patients participated in this study. The outcome measure was the ACCROM, including flexion, extension, lateral flexion, and rotation. Following the recruitment process, ACCROM was measured using a universal goniometer (UG) and iPhone 7 app. Two blinded examiners each used the UG and iPhone to measure ACCROM in the following sequences: flexion, extension, lateral flexion, and rotation. The second (2 hours later) and third (48 hours later) sessions were carried out in the same manner as the first session. Intraclass correlation coefficient (ICC) models were used to determine the intra-rater and inter-rater reliability. The Pearson correlation coefficients were used to establish concurrent validity of the iPhone app. Minimum detectable change at the 95% confidence level (MDC 95 ) was also computed. Good intra-rater and inter-rater reliability was demonstrated for the goniometer with ICC values of ≥0.66 and ≥0.70 and the iPhone app with ICC values of ≥0.62 and ≥0.65, respectively. The MDC 95 ranged from 2.21° to 12.50° for the intra-rater analysis and from 3.40° to 12.61° for the inter-rater analysis. The concurrent validity between the two instruments was high, with r valuesof ≥0.63. The magnitude of the differences between the UG and iPhone app values (effect sizes) was small, with Cohen d values of ≤0.17. The iPhone app possesses good reliability and high validity. It seems that this app can be used for measuring ACCROM. Copyright © 2017 Elsevier Inc. All rights reserved.

Reliability and Validity Assessment of a Linear Position Transducer

PubMed Central

Garnacho-Castaño, Manuel V.; López-Lastra, Silvia; Maté-Muñoz, José L.

2015-01-01

The objectives of the study were to determine the validity and reliability of peak velocity (PV), average velocity (AV), peak power (PP) and average power (AP) measurements were made using a linear position transducer. Validity was assessed by comparing measurements simultaneously obtained using the Tendo Weightlifting Analyzer Systemi and T-Force Dynamic Measurement Systemr (Ergotech, Murcia, Spain) during two resistance exercises, bench press (BP) and full back squat (BS), performed by 71 trained male subjects. For the reliability study, a further 32 men completed both lifts using the Tendo Weightlifting Analyzer Systemz in two identical testing sessions one week apart (session 1 vs. session 2). Intraclass correlation coefficients (ICCs) indicating the validity of the Tendo Weightlifting Analyzer Systemi were high, with values ranging from 0.853 to 0.989. Systematic biases and random errors were low to moderate for almost all variables, being higher in the case of PP (bias ±157.56 W; error ±131.84 W). Proportional biases were identified for almost all variables. Test-retest reliability was strong with ICCs ranging from 0.922 to 0.988. Reliability results also showed minimal systematic biases and random errors, which were only significant for PP (bias -19.19 W; error ±67.57 W). Only PV recorded in the BS showed no significant proportional bias. The Tendo Weightlifting Analyzer Systemi emerged as a reliable system for measuring movement velocity and estimating power in resistance exercises. The low biases and random errors observed here (mainly AV, AP) make this device a useful tool for monitoring resistance training. Key points This study determined the validity and reliability of peak velocity, average velocity, peak power and average power measurements made using a linear position transducer The Tendo Weight-lifting Analyzer Systemi emerged as a reliable system for measuring movement velocity and power. PMID:25729300

Recoding low-level simulator data into a record of meaningful task performance: the integrated task modeling environment (ITME).

PubMed

King, Robert; Parker, Simon; Mouzakis, Kon; Fletcher, Winston; Fitzgerald, Patrick

2007-11-01

The Integrated Task Modeling Environment (ITME) is a user-friendly software tool that has been developed to automatically recode low-level data into an empirical record of meaningful task performance. The present research investigated and validated the performance of the ITME software package by conducting complex simulation missions and comparing the task analyses produced by ITME with taskanalyses produced by experienced video analysts. A very high interrater reliability (> or = .94) existed between experienced video analysts and the ITME for the task analyses produced for each mission. The mean session time:analysis time ratio was 1:24 using video analysis techniques and 1:5 using the ITME. It was concluded that the ITME produced task analyses that were as reliable as those produced by experienced video analysts, and significantly reduced the time cost associated with these analyses.

Sleep-monitoring, experiment M133. [electronic recording system for automatic analysis of human sleep patterns

NASA Technical Reports Server (NTRS)

Frost, J. D., Jr.; Salamy, J. G.

1973-01-01

The Skylab sleep-monitoring experiment simulated the timelines and environment expected during a 56-day Skylab mission. Two crewmembers utilized the data acquisition and analysis hardware, and their sleep characteristics were studied in an online fashion during a number of all night recording sessions. Comparison of the results of online automatic analysis with those of postmission visual data analysis was favorable, confirming the feasibility of obtaining reliable objective information concerning sleep characteristics during the Skylab missions. One crewmember exhibited definite changes in certain sleep characteristics (e.g., increased sleep latency, increased time Awake during first third of night, and decreased total sleep time) during the mission.

Evaluation of the numeric rating scale for perception of effort during isometric elbow flexion exercise.

PubMed

Lampropoulou, Sofia; Nowicky, Alexander V

2012-03-01

The aim of the study was to examine the reliability and validity of the numerical rating scale (0-10 NRS) for rating perception of effort during isometric elbow flexion in healthy people. 33 individuals (32 ± 8 years) participated in the study. Three re-test measurements within one session and three weekly sessions were undertaken to determine the reliability of the scale. The sensitivity of the scale following 10 min isometric fatiguing exercise of the elbow flexors as well as the correlation of the effort with the electromyographic (EMG) activity of the flexor muscles were tested. Perception of effort was tested during isometric elbow flexion at 10, 30, 50, 70, 90, and 100% MVC. The 0-10 NRS demonstrated an excellent test-retest reliability [intra class correlation (ICC) = 0.99 between measurements taken within a session and 0.96 between 3 consecutive weekly sessions]. Exploratory curve fitting for the relationship between effort ratings and voluntary force, and underlying EMG showed that both are best described by power functions (y = ax ( b )). There were also strong correlations (range 0.89-0.95) between effort ratings and EMG recordings of all flexor muscles supporting the concurrent criterion validity of the measure. The 0-10 NRS was sensitive enough to detect changes in the perceived effort following fatigue and significantly increased at the level of voluntary contraction used in its assessment (p < 0.001). These findings suggest the 0-10 NRS is a valid and reliable scale for rating perception of effort in healthy individuals. Future research should seek to establish the validity of the 0-10 NRS in clinical settings.

A rater training protocol to assess team performance.

PubMed

Eppich, Walter; Nannicelli, Anna P; Seivert, Nicholas P; Sohn, Min-Woong; Rozenfeld, Ranna; Woods, Donna M; Holl, Jane L

2015-01-01

Simulation-based methodologies are increasingly used to assess teamwork and communication skills and provide team training. Formative feedback regarding team performance is an essential component. While effective use of simulation for assessment or training requires accurate rating of team performance, examples of rater-training programs in health care are scarce. We describe our rater training program and report interrater reliability during phases of training and independent rating. We selected an assessment tool shown to yield valid and reliable results and developed a rater training protocol with an accompanying rater training handbook. The rater training program was modeled after previously described high-stakes assessments in the setting of 3 facilitated training sessions. Adjacent agreement was used to measure interrater reliability between raters. Nine raters with a background in health care and/or patient safety evaluated team performance of 42 in-situ simulations using post-hoc video review. Adjacent agreement increased from the second training session (83.6%) to the third training session (85.6%) when evaluating the same video segments. Adjacent agreement for the rating of overall team performance was 78.3%, which was added for the third training session. Adjacent agreement was 97% 4 weeks posttraining and 90.6% at the end of independent rating of all simulation videos. Rater training is an important element in team performance assessment, and providing examples of rater training programs is essential. Articulating key rating anchors promotes adequate interrater reliability. In addition, using adjacent agreement as a measure allows differentiation between high- and low-performing teams on video review. © 2015 The Alliance for Continuing Education in the Health Professions, the Society for Academic Continuing Medical Education, and the Council on Continuing Medical Education, Association for Hospital Medical Education.

Measuring reliable change in cognition using the Edinburgh Cognitive and Behavioural ALS Screen (ECAS).

PubMed

Crockford, Christopher; Newton, Judith; Lonergan, Katie; Madden, Caoifa; Mays, Iain; O'Sullivan, Meabhdh; Costello, Emmet; Pinto-Grau, Marta; Vajda, Alice; Heverin, Mark; Pender, Niall; Al-Chalabi, Ammar; Hardiman, Orla; Abrahams, Sharon

2018-02-01

Cognitive impairment affects approximately 50% of people with amyotrophic lateral sclerosis (ALS). Research has indicated that impairment may worsen with disease progression. The Edinburgh Cognitive and Behavioural ALS Screen (ECAS) was designed to measure neuropsychological functioning in ALS, with its alternate forms (ECAS-A, B, and C) allowing for serial assessment over time. The aim of the present study was to establish reliable change scores for the alternate forms of the ECAS, and to explore practice effects and test-retest reliability of the ECAS's alternate forms. Eighty healthy participants were recruited, with 57 completing two and 51 completing three assessments. Participants were administered alternate versions of the ECAS serially (A-B-C) at four-month intervals. Intra-class correlation analysis was employed to explore test-retest reliability, while analysis of variance was used to examine the presence of practice effects. Reliable change indices (RCI) and regression-based methods were utilized to establish change scores for the ECAS alternate forms. Test-retest reliability was excellent for ALS Specific, ALS Non-Specific, and ECAS Total scores of the combined ECAS A, B, and C (all > .90). No significant practice effects were observed over the three testing sessions. RCI and regression-based methods produced similar change scores. The alternate forms of the ECAS possess excellent test-retest reliability in a healthy control sample, with no significant practice effects. The use of conservative RCI scores is recommended. Therefore, a change of ≥8, ≥4, and ≥9 for ALS Specific, ALS Non-Specific, and ECAS Total score is required for reliable change.

Measurement and Reliability of Response Inhibition

PubMed Central

Congdon, Eliza; Mumford, Jeanette A.; Cohen, Jessica R.; Galvan, Adriana; Canli, Turhan; Poldrack, Russell A.

2012-01-01

Response inhibition plays a critical role in adaptive functioning and can be assessed with the Stop-signal task, which requires participants to suppress prepotent motor responses. Evidence suggests that this ability to inhibit a prepotent motor response (reflected as Stop-signal reaction time (SSRT)) is a quantitative and heritable measure of interindividual variation in brain function. Although attention has been given to the optimal method of SSRT estimation, and initial evidence exists in support of its reliability, there is still variability in how Stop-signal task data are treated across samples. In order to examine this issue, we pooled data across three separate studies and examined the influence of multiple SSRT calculation methods and outlier calling on reliability (using Intra-class correlation). Our results suggest that an approach which uses the average of all available sessions, all trials of each session, and excludes outliers based on predetermined lenient criteria yields reliable SSRT estimates, while not excluding too many participants. Our findings further support the reliability of SSRT, which is commonly used as an index of inhibitory control, and provide support for its continued use as a neurocognitive phenotype. PMID:22363308

A test-retest dataset for assessing long-term reliability of brain morphology and resting-state brain activity.

PubMed

Huang, Lijie; Huang, Taicheng; Zhen, Zonglei; Liu, Jia

2016-03-15

We present a test-retest dataset for evaluation of long-term reliability of measures from structural and resting-state functional magnetic resonance imaging (sMRI and rfMRI) scans. The repeated scan dataset was collected from 61 healthy adults in two sessions using highly similar imaging parameters at an interval of 103-189 days. However, as the imaging parameters were not completely identical, the reliability estimated from this dataset shall reflect the lower bounds of the true reliability of sMRI/rfMRI measures. Furthermore, in conjunction with other test-retest datasets, our dataset may help explore the impact of different imaging parameters on reliability of sMRI/rfMRI measures, which is especially critical for assessing datasets collected from multiple centers. In addition, intelligence quotient (IQ) was measured for each participant using Raven's Advanced Progressive Matrices. The data can thus be used for purposes other than assessing reliability of sMRI/rfMRI alone. For example, data from each single session could be used to associate structural and functional measures of the brain with the IQ metrics to explore brain-IQ association.

Reliability Correction for Functional Connectivity: Theory and Implementation

PubMed Central

Mueller, Sophia; Wang, Danhong; Fox, Michael D.; Pan, Ruiqi; Lu, Jie; Li, Kuncheng; Sun, Wei; Buckner, Randy L.; Liu, Hesheng

2016-01-01

Network properties can be estimated using functional connectivity MRI (fcMRI). However, regional variation of the fMRI signal causes systematic biases in network estimates including correlation attenuation in regions of low measurement reliability. Here we computed the spatial distribution of fcMRI reliability using longitudinal fcMRI datasets and demonstrated how pre-estimated reliability maps can correct for correlation attenuation. As a test case of reliability-based attenuation correction we estimated properties of the default network, where reliability was significantly lower than average in the medial temporal lobe and higher in the posterior medial cortex, heterogeneity that impacts estimation of the network. Accounting for this bias using attenuation correction revealed that the medial temporal lobe’s contribution to the default network is typically underestimated. To render this approach useful to a greater number of datasets, we demonstrate that test-retest reliability maps derived from repeated runs within a single scanning session can be used as a surrogate for multi-session reliability mapping. Using data segments with different scan lengths between 1 and 30 min, we found that test-retest reliability of connectivity estimates increases with scan length while the spatial distribution of reliability is relatively stable even at short scan lengths. Finally, analyses of tertiary data revealed that reliability distribution is influenced by age, neuropsychiatric status and scanner type, suggesting that reliability correction may be especially important when studying between-group differences. Collectively, these results illustrate that reliability-based attenuation correction is an easily implemented strategy that mitigates certain features of fMRI signal nonuniformity. PMID:26493163

Reliability and Validity of a New Test of Change-of-Direction Speed for Field-Based Sports: the Change-of-Direction and Acceleration Test (CODAT).

PubMed

Lockie, Robert G; Schultz, Adrian B; Callaghan, Samuel J; Jeffriess, Matthew D; Berry, Simon P

2013-01-01

Field sport coaches must use reliable and valid tests to assess change-of-direction speed in their athletes. Few tests feature linear sprinting with acute change- of-direction maneuvers. The Change-of-Direction and Acceleration Test (CODAT) was designed to assess field sport change-of-direction speed, and includes a linear 5-meter (m) sprint, 45° and 90° cuts, 3- m sprints to the left and right, and a linear 10-m sprint. This study analyzed the reliability and validity of this test, through comparisons to 20-m sprint (0-5, 0-10, 0-20 m intervals) and Illinois agility run (IAR) performance. Eighteen Australian footballers (age = 23.83 ± 7.04 yrs; height = 1.79 ± 0.06 m; mass = 85.36 ± 13.21 kg) were recruited. Following familiarization, subjects completed the 20-m sprint, CODAT, and IAR in 2 sessions, 48 hours apart. Intra-class correlation coefficients (ICC) assessed relative reliability. Absolute reliability was analyzed through paired samples t-tests (p ≤ 0.05) determining between-session differences. Typical error (TE), coefficient of variation (CV), and differences between the TE and smallest worthwhile change (SWC), also assessed absolute reliability and test usefulness. For the validity analysis, Pearson's correlations (p ≤ 0.05) analyzed between-test relationships. Results showed no between-session differences for any test (p = 0.19-0.86). CODAT time averaged ~6 s, and the ICC and CV equaled 0.84 and 3.0%, respectively. The homogeneous sample of Australian footballers meant that the CODAT's TE (0.19 s) exceeded the usual 0.2 x standard deviation (SD) SWC (0.10 s). However, the CODAT is capable of detecting moderate performance changes (SWC calculated as 0.5 x SD = 0.25 s). There was a near perfect correlation between the CODAT and IAR (r = 0.92), and very large correlations with the 20-m sprint (r = 0.75-0.76), suggesting that the CODAT was a valid change-of-direction speed test. Due to movement specificity, the CODAT has value for field sport assessment. Key pointsThe change-of-direction and acceleration test (CODAT) was designed specifically for field sport athletes from specific speed research, and data derived from time-motion analyses of sports such as rugby union, soccer, and Australian football. The CODAT features a linear 5-meter (m) sprint, 45° and 90° cuts and 3-m sprints to the left and right, and a linear 10-m sprint.The CODAT was found to be a reliable change-of-direction speed assessment when considering intra-class correlations between two testing sessions, and the coefficient of variation between trials. A homogeneous sample of Australian footballers resulted in absolute reliability limitations when considering differences between the typical error and smallest worthwhile change. However, the CODAT will detect moderate (0.5 times the test's standard deviation) changes in performance.The CODAT correlated with the Illinois agility run, highlighting that it does assess change-of-direction speed. There were also significant relationships with short sprint performance (i.e. 0-5 m and 0-10 m), demonstrating that linear acceleration is assessed within the CODAT, without the extended duration and therefore metabolic limitations of the IAR. Indeed, the average duration of the test (~6 seconds) is field sport-specific. Therefore, the CODAT could be used as an assessment of change-of-direction speed in field sport athletes.

On the invariance of EEG-based signatures of individuality with application in biometric identification.

PubMed

Yunqi Wang; Najafizadeh, Laleh

2016-08-01

One of the main challenges in EEG-based biometric systems is to extract reliable signatures of individuality from recorded EEG data that are also invariant against time. In this paper, we investigate the invariability of features that are extracted based on the spatial distribution of the spectral power of EEG data corresponding to 2-second eyes-closed resting-state (ECRS) recording, in different scenarios. Eyes-closed resting-state EEG signals in 4 healthy adults are recorded in two different sessions with an interval of at least one week between sessions. The performance in terms of correct recognition rate (CRR) is examined when the training and testing datasets are chosen from the same recording session, and when the training and testing datasets are chosen from different sessions. It is shown that an CRR of 92% can be achieved based on the proposed features when the training and testing datasets are taken from different sessions. To reduce the number of recording channels, principal component analysis (PCA) is also employed to identify channels that carry the most discriminatory information across individuals. High CRR is obtained based on the data from channels mostly covering the occipital region. The results suggest that features based on the spatial distribution of the spectral power of the short-time (e.g. 2 seconds) ECRS recordings can have great potentials in EEG-based biometric identification systems.

Design and validation of an automated hydrostatic weighing system.

PubMed

McClenaghan, B A; Rocchio, L

1986-08-01

The purpose of this study was to design and evaluate the validity of an automated technique to assess body density using a computerized hydrostatic weighing system. An existing hydrostatic tank was modified and interfaced with a microcomputer equipped with an analog-to-digital converter. Software was designed to input variables, control the collection of data, calculate selected measurements, and provide a summary of the results of each session. Validity of the data obtained utilizing the automated hydrostatic weighing system was estimated by: evaluating the reliability of the transducer/computer interface to measure objects of known underwater weight; comparing the data against a criterion measure; and determining inter-session subject reliability. Values obtained from the automated system were found to be highly correlated with known underwater weights (r = 0.99, SEE = 0.0060 kg). Data concurrently obtained utilizing the automated system and a manual chart recorder were also found to be highly correlated (r = 0.99, SEE = 0.0606 kg). Inter-session subject reliability was determined utilizing data collected on subjects (N = 16) tested on two occasions approximately 24 h apart. Correlations revealed high relationships between measures of underwater weight (r = 0.99, SEE = 0.1399 kg) and body density (r = 0.98, SEE = 0.00244 g X cm-1). Results indicate that a computerized hydrostatic weighing system is a valid and reliable method for determining underwater weight.

Operator adaptation to changes in system reliability under adaptable automation.

PubMed

Chavaillaz, Alain; Sauer, Juergen

2017-09-01

This experiment examined how operators coped with a change in system reliability between training and testing. Forty participants were trained for 3 h on a complex process control simulation modelling six levels of automation (LOA). In training, participants either experienced a high- (100%) or low-reliability system (50%). The impact of training experience on operator behaviour was examined during a 2.5 h testing session, in which participants either experienced a high- (100%) or low-reliability system (60%). The results showed that most operators did not often switch between LOA. Most chose an LOA that relieved them of most tasks but maintained their decision authority. Training experience did not have a strong impact on the outcome measures (e.g. performance, complacency). Low system reliability led to decreased performance and self-confidence. Furthermore, complacency was observed under high system reliability. Overall, the findings suggest benefits of adaptable automation because it accommodates different operator preferences for LOA. Practitioner Summary: The present research shows that operators can adapt to changes in system reliability between training and testing sessions. Furthermore, it provides evidence that each operator has his/her preferred automation level. Since this preference varies strongly between operators, adaptable automation seems to be suitable to accommodate these large differences.

Microprocessor Seminar, phase 2

NASA Technical Reports Server (NTRS)

Scott, W. R.

1977-01-01

Workshop sessions and papers were devoted to various aspects of microprocessor and large scale integrated circuit technology. Presentations were made on advanced LSI developments for high reliability military and NASA applications. Microprocessor testing techniques were discussed, and test data were presented. High reliability procurement specifications were also discussed.

Systemic Exercise-Induced Hypoalgesia Following Isometric Exercise Reduces Conditioned Pain Modulation.

PubMed

Alsouhibani, Ali; Vaegter, Henrik Bjarke; Hoeger Bement, Marie

2018-04-03

Physically active individuals show greater conditioned pain modulation (CPM) compared with less active individuals. Understanding the effects of acute exercise on CPM may allow for a more targeted use of exercise in the management of pain. This study investigated the effects of acute isometric exercise on CPM. In addition, the between-session and within-session reliability of CPM was investigated. Experimental, randomized crossover study. Laboratory at Marquette University. Thirty healthy adults (19.3±1.5 years, 15 males). Subjects underwent CPM testing before and after isometric exercise (knee extension, 30% maximum voluntary contraction for three minutes) and quiet rest in two separate experimental sessions. Pressure pain thresholds (PPTs) at the quadriceps and upper trapezius muscles were assessed before, during, and after ice water immersions. PPTs increased during ice water immersion (i.e., CPM), and quadriceps PPT increased after exercise (P < 0.05). CPM decreased similarly following exercise and quiet rest (P > 0.05). CPM within-session reliability was fair to good (intraclass correlation coefficient [ICC] = 0.43-0.70), and the between-session reliability was poor (ICC = 0.20-0.35). Due to the variability in the systemic exercise-induced hypoalgesia (EIH) response, participants were divided into systemic EIH responders (N = 9) and nonresponders (N = 21). EIH responders experienced attenuated CPM following exercise (P = 0.03), whereas the nonresponders showed no significant change (P > 0.05). Isometric exercise decreased CPM in individuals who reported systemic EIH, suggesting activation of shared mechanisms between CPM and systemic EIH responses. These results may improve the understanding of increased pain after exercise in patients with chronic pain and potentially attenuated CPM.

Reliability and validity of a treatment fidelity assessment for motivational interviewing targeting sexual risk behaviors in people living with HIV/AIDS.

PubMed

Seng, Elizabeth K; Lovejoy, Travis I

2013-12-01

This study psychometrically evaluates the Motivational Interviewing Treatment Integrity Code (MITI) to assess fidelity to motivational interviewing to reduce sexual risk behaviors in people living with HIV/AIDS. 74 sessions from a pilot randomized controlled trial of motivational interviewing to reduce sexual risk behaviors in people living with HIV were coded with the MITI. Participants reported sexual behavior at baseline, 3-month, and 6-months. Regarding reliability, excellent inter-rater reliability was achieved for measures of behavior frequency across the 12 sessions coded by both coders; global scales demonstrated poor intraclass correlations, but adequate percent agreement. Regarding validity, principle components analyses indicated that a two-factor model accounted for an adequate amount of variance in the data. These factors were associated with decreases in sexual risk behaviors after treatment. The MITI is a reliable and valid measurement of treatment fidelity for motivational interviewing targeting sexual risk behaviors in people living with HIV/AIDS.

Development and validation of the ASPIRE-VA coaching fidelity checklist (ACFC): a tool to help ensure delivery of high-quality weight management interventions.

PubMed

Damschroder, Laura J; Goodrich, David E; Kim, Hyungjin Myra; Holleman, Robert; Gillon, Leah; Kirsh, Susan; Richardson, Caroline R; Lutes, Lesley D

2016-09-01

Practical and valid instruments are needed to assess fidelity of coaching for weight loss. The purpose of this study was to develop and validate the ASPIRE Coaching Fidelity Checklist (ACFC). Classical test theory guided ACFC development. Principal component analyses were used to determine item groupings. Psychometric properties, internal consistency, and inter-rater reliability were evaluated for each subscale. Criterion validity was tested by predicting weight loss as a function of coaching fidelity. The final 19-item ACFC consists of two domains (session process and session structure) and five subscales (sets goals and monitor progress, assess and personalize self-regulatory content, manages the session, creates a supportive and empathetic climate, and stays on track). Four of five subscales showed high internal consistency (Cronbach alphas > 0.70) for group-based coaching; only two of five subscales had high internal reliability for phone-based coaching. All five sub-scales were positively and significantly associated with weight loss for group- but not for phone-based coaching. The ACFC is a reliable and valid instrument that can be used to assess fidelity and guide skill-building for weight management interventionists.

Test-retest reliability of effective connectivity in the face perception network.

PubMed

Frässle, Stefan; Paulus, Frieder Michel; Krach, Sören; Jansen, Andreas

2016-02-01

Computational approaches have great potential for moving neuroscience toward mechanistic models of the functional integration among brain regions. Dynamic causal modeling (DCM) offers a promising framework for inferring the effective connectivity among brain regions and thus unraveling the neural mechanisms of both normal cognitive function and psychiatric disorders. While the benefit of such approaches depends heavily on their reliability, systematic analyses of the within-subject stability are rare. Here, we present a thorough investigation of the test-retest reliability of an fMRI paradigm for DCM analysis dedicated to unraveling intra- and interhemispheric integration among the core regions of the face perception network. First, we examined the reliability of face-specific BOLD activity in 25 healthy volunteers, who performed a face perception paradigm in two separate sessions. We found good to excellent reliability of BOLD activity within the DCM-relevant regions. Second, we assessed the stability of effective connectivity among these regions by analyzing the reliability of Bayesian model selection and model parameter estimation in DCM. Reliability was excellent for the negative free energy and good for model parameter estimation, when restricting the analysis to parameters with substantial effect sizes. Third, even when the experiment was shortened, reliability of BOLD activity and DCM results dropped only slightly as a function of the length of the experiment. This suggests that the face perception paradigm presented here provides reliable estimates for both conventional activation and effective connectivity measures. We conclude this paper with an outlook on potential clinical applications of the paradigm for studying psychiatric disorders. Hum Brain Mapp 37:730-744, 2016. © 2015 Wiley Periodicals, Inc. © 2015 Wiley Periodicals, Inc.

Assessment of Lower Limb Muscle Strength and Power Using Hand-Held and Fixed Dynamometry: A Reliability and Validity Study

PubMed Central

Perraton, Luke G.; Bower, Kelly J.; Adair, Brooke; Pua, Yong-Hao; Williams, Gavin P.; McGaw, Rebekah

2015-01-01

Introduction Hand-held dynamometry (HHD) has never previously been used to examine isometric muscle power. Rate of force development (RFD) is often used for muscle power assessment, however no consensus currently exists on the most appropriate method of calculation. The aim of this study was to examine the reliability of different algorithms for RFD calculation and to examine the intra-rater, inter-rater, and inter-device reliability of HHD as well as the concurrent validity of HHD for the assessment of isometric lower limb muscle strength and power. Methods 30 healthy young adults (age: 23±5yrs, male: 15) were assessed on two sessions. Isometric muscle strength and power were measured using peak force and RFD respectively using two HHDs (Lafayette Model-01165 and Hoggan microFET2) and a criterion-reference KinCom dynamometer. Statistical analysis of reliability and validity comprised intraclass correlation coefficients (ICC), Pearson correlations, concordance correlations, standard error of measurement, and minimal detectable change. Results Comparison of RFD methods revealed that a peak 200ms moving window algorithm provided optimal reliability results. Intra-rater, inter-rater, and inter-device reliability analysis of peak force and RFD revealed mostly good to excellent reliability (coefficients ≥ 0.70) for all muscle groups. Concurrent validity analysis showed moderate to excellent relationships between HHD and fixed dynamometry for the hip and knee (ICCs ≥ 0.70) for both peak force and RFD, with mostly poor to good results shown for the ankle muscles (ICCs = 0.31–0.79). Conclusions Hand-held dynamometry has good to excellent reliability and validity for most measures of isometric lower limb strength and power in a healthy population, particularly for proximal muscle groups. To aid implementation we have created freely available software to extract these variables from data stored on the Lafayette device. Future research should examine the reliability and validity of these variables in clinical populations. PMID:26509265

Typology of Couples Entering Alcohol Behavioral Couple Therapy: An Empirical Approach and Test of Predictive Validity on Treatment Response.

PubMed

Ladd, Benjamin O; McCrady, Barbara S

2016-01-01

This study aimed to examine whether classification of couples in which one partner has an alcohol problem is similar to that reported in the general couples literature. Typologies of couples seeking alcohol behavioral couple therapy (ABCT) were developed via hierarchical cluster analysis using behavioral codes of couple interactions during their first ABCT session. Four couples types based on in-session behavior were established reliably, labeled avoider, validator, hostile, and ambivalent-detached. These couple types resembled couples types found in previous research. Couple type was associated with baseline relationship satisfaction, but not alcohol use. Results suggest heterogeneity in couples with alcohol problems presenting to treatment; further study is needed to investigate the function of alcohol within these different types. © 2015 American Association for Marriage and Family Therapy.

Three-dimensional assessment of squats and drop jumps using the Microsoft Xbox One Kinect: Reliability and validity.

PubMed

Mentiplay, Benjamin F; Hasanki, Ksaniel; Perraton, Luke G; Pua, Yong-Hao; Charlton, Paula C; Clark, Ross A

2018-03-01

The Microsoft Xbox One Kinect™ (Kinect V2) contains a depth camera that can be used to manually identify anatomical landmark positions in three-dimensions independent of the standard skeletal tracking, and therefore has potential for low-cost, time-efficient three-dimensional movement analysis (3DMA). This study examined inter-session reliability and concurrent validity of the Kinect V2 for the assessment of coronal and sagittal plane kinematics for the trunk, hip and knee during single leg squats (SLS) and drop vertical jumps (DVJ). Thirty young, healthy participants (age = 23 ± 5yrs, male/female = 15/15) performed a SLS and DVJ protocol that was recorded concurrently by the Kinect V2 and 3DMA during two sessions, one week apart. The Kinect V2 demonstrated good to excellent reliability for all SLS and DVJ variables (ICC ≥ 0.73). Concurrent validity ranged from poor to excellent (ICC = 0.02 to 0.98) during the SLS task, although trunk, hip and knee flexion and two-dimensional measures of knee abduction and frontal plane projection angle all demonstrated good to excellent validity (ICC ≥ 0.80). Concurrent validity for the DVJ task was typically worse, with only two variables exceeding ICC = 0.75 (trunk and hip flexion). These findings indicate that the Kinect V2 may have potential for large-scale screening for ACL injury risk, however future prospective research is required.

Inter-Rater and Test-Retest (Between-Sessions) Reliability of the 4-Skills Scan for Dutch Elementary School Children

ERIC Educational Resources Information Center

van Kernebeek, Willem G.; de Schipper, Antoine W.; Savelsbergh, Geert J. P.; Toussaint, Huub M.

2018-01-01

In The Netherlands, the 4-Skills Scan is an instrument for physical education teachers to assess gross motor skills of elementary school children. Little is known about its reliability. Therefore, in this study the test-retest and inter-rater reliability was determined. Respectively, 624 and 557 Dutch 6- to 12-year-old children were analyzed for…

Reliability of the Q Force; a mobile instrument for measuring isometric quadriceps muscle strength.

PubMed

Douma, K W; Regterschot, G R H; Krijnen, W P; Slager, G E C; van der Schans, C P; Zijlstra, W

2016-01-01

The ability to generate muscle strength is a pre-requisite for all human movement. Decreased quadriceps muscle strength is frequently observed in older adults and is associated with a decreased performance and activity limitations. To quantify the quadriceps muscle strength and to monitor changes over time, instruments and procedures with a sufficient reliability are needed. The Q Force is an innovative mobile muscle strength measurement instrument suitable to measure in various degrees of extension. Measurements between 110 and 130° extension present the highest values and the most significant increase after training. The objective of this study is to determine the test-retest reliability of muscle strength measurements by the Q Force in older adults in 110° extension. Forty-one healthy older adults, 13 males and 28 females were included in the study. Mean (SD) age was 81.9 (4.89) years. Isometric muscle strength of the Quadriceps muscle was assessed with the Q Force at 110° of knee extension. Participants were measured at two sessions with a three to eight day interval between sessions. To determine relative reliability, the intraclass correlation coefficient (ICC) was calculated. To determine absolute reliability, Bland and Altman Limits of Agreement (LOA) were calculated and t-tests were performed. Relative reliability of the Q Force is good to excellent as all ICC coefficients are higher than 0.75. Generally a large 95 % LOA, reflecting only moderate absolute reliability, is found as exemplified for the peak torque left leg of -18.6 N to 33.8 N and the right leg of -9.2 N to 26.4 N was between 15.7 and 23.6 Newton representing 25.2 % to 39.9 % of the size of the mean. Small systematic differences in mean were found between measurement session 1 and 2. The present study shows that the Q Force has excellent relative test-retest reliability, but limited absolute test-retest reliability. Since the Q Force is relatively cheap and mobile it is suitable for application in various clinical settings, however, its capability to detect changes in muscle force over time is limited but comparable to existing instruments.

Outcome Rating Scale and Session Rating Scale in Psychological Practice: Clinical Utility of Ultra-Brief Measures

ERIC Educational Resources Information Center

Campbell, Alistair; Hemsley, Samantha

2009-01-01

The validity and reliability of the Outcome Rating Scale (ORS) and the Session Rating Scale (SRS) were evaluated against existing longer measures, including the Outcome Questionnaire-45, Working Alliance Inventory, Depression Anxiety Stress Scale-21, Quality of Life Scale, Rosenberg Self-Esteem Scale and General Self-efficacy Scale. The measures…

Portuguese community pharmacists' attitudes to and knowledge of antibiotic misuse: questionnaire development and reliability.

PubMed

Roque, Fátima; Soares, Sara; Breitenfeld, Luiza; Gonzalez-Gonzalez, Cristian; Figueiras, Adolfo; Herdeiro, Maria Teresa

2014-01-01

To develop and evaluate the reliability of a self-administered questionnaire designed to assess the attitudes and knowledge of community pharmacists in Portugal about microbial resistance and the antibiotic dispensing process. This study was divided into the following three stages: (1) design of the questionnaire, which included a literature review and a qualitative study with focus-group sessions; (2) assessment of face and content validity, using a panel of experts and a pre-test of community pharmacists; and, (3) pilot study and reliability analysis, which included a test-retest study covering fifty practising pharmacists based at community pharmacies in five districts situated in Northern Portugal. Questionnaire reproducibility was quantified using the intraclass correlation coefficient (ICC; 95% confidence interval) computed by means of one-way analysis of variance (ANOVA). Internal consistency was evaluated using Cronbach's alpha. The correlation coefficients were fair to good (ICC>0.4) for all statements (scale-items) regarding knowledge of and attitudes to antibiotic resistance, and ranged from fair to good to excellent for statements about situations in which pharmacists acknowledged that antibiotics were sometimes dispensed without a medical prescription (ICC>0.8). Cronbach's alpha for this section was 0.716. The questionnaire designed in this study is valid and reliable in terms of content validity, face validity and reproducibility.

A tonic heat test stimulus yields a larger and more reliable conditioned pain modulation effect compared to a phasic heat test stimulus

PubMed Central

Lie, Marie Udnesseter; Matre, Dagfinn; Hansson, Per; Stubhaug, Audun; Zwart, John-Anker; Nilsen, Kristian Bernhard

2017-01-01

Abstract Introduction: The interest in conditioned pain modulation (CPM) as a clinical tool for measuring endogenously induced analgesia is increasing. There is, however, large variation in the CPM methodology, hindering comparison of results across studies. Research comparing different CPM protocols is needed in order to obtain a standardized test paradigm. Objectives: The aim of the study was to assess whether a protocol with phasic heat stimuli as test-stimulus is preferable to a protocol with tonic heat stimulus as test-stimulus. Methods: In this experimental crossover study, we compared 2 CPM protocols with different test-stimulus; one with tonic test-stimulus (constant heat stimulus of 120-second duration) and one with phasic test-stimuli (3 heat stimulations of 5 seconds duration separated by 10 seconds). Conditioning stimulus was a 7°C water bath in parallel with the test-stimulus. Twenty-four healthy volunteers were assessed on 2 occasions with minimum 1 week apart. Differences in the magnitude and test–retest reliability of the CPM effect in the 2 protocols were investigated with repeated-measures analysis of variance and by relative and absolute reliability indices. Results: The protocol with tonic test-stimulus induced a significantly larger CPM effect compared to the protocol with phasic test-stimuli (P < 0.001). Fair and good relative reliability was found with the phasic and tonic test-stimuli, respectively. Absolute reliability indices showed large intraindividual variability from session to session in both protocols. Conclusion: The present study shows that a CPM protocol with a tonic test-stimulus is preferable to a protocol with phasic test-stimuli. However, we emphasize that one should be cautious to use the CPM effect as biomarker or in clinical decision making on an individual level due to large intraindividual variability. PMID:29392240

Decision Support Methods and Tools

NASA Technical Reports Server (NTRS)

Green, Lawrence L.; Alexandrov, Natalia M.; Brown, Sherilyn A.; Cerro, Jeffrey A.; Gumbert, Clyde r.; Sorokach, Michael R.; Burg, Cecile M.

2006-01-01

This paper is one of a set of papers, developed simultaneously and presented within a single conference session, that are intended to highlight systems analysis and design capabilities within the Systems Analysis and Concepts Directorate (SACD) of the National Aeronautics and Space Administration (NASA) Langley Research Center (LaRC). This paper focuses on the specific capabilities of uncertainty/risk analysis, quantification, propagation, decomposition, and management, robust/reliability design methods, and extensions of these capabilities into decision analysis methods within SACD. These disciplines are discussed together herein under the name of Decision Support Methods and Tools. Several examples are discussed which highlight the application of these methods within current or recent aerospace research at the NASA LaRC. Where applicable, commercially available, or government developed software tools are also discussed

Reliability and validity of the Korean version of the community balance and mobility scale in patients with hemiplegia after stroke

PubMed Central

Lee, Kyoung-bo; Lee, Paul; Yoo, Sang-won; Kim, Young-dong

2016-01-01

[Purpose] The aim of this study was to translate and adapt the Community Balance and Mobility Scale (CB&M) into Korean (K-CB&M) and to verify the reliability and validity of scores obtained with Korean patients. [Subjects and Methods] A total of 16 subjects were recruited from St. Vincent’s Hospital in South Korea. At each testing session, subjects completed the K-CB&M, Berg balance scale (BBS), timed up and go test (TUG), and functional reaching test. All tests were administered by a physical therapist, and subjects completed the tests in an identical standardized order during all testing sessions. [Results] The inter- and intra-rater reliability coefficients were high for most subscores, while moderate inter-rater reliability was observed for the items “walking and looking” and “walk, look, and carry”, and moderate intra-rater reliability was observed for “forward to backward walking”. There was a positive correlation between the K-CB&M and BBS and a negative correlation between the K-CB&M and TUG in the convergent validity assessments. [Conclusion] The reliability and validity of the K-CB&M was high, suggesting that clinical practitioners treating Korean patients with hemiplegia can use this material for assessing static and dynamic balance. PMID:27630420

Functional magnetic resonance imaging of awake monkeys: some approaches for improving imaging quality

PubMed Central

Chen, Gang; Wang, Feng; Dillenburger, Barbara C.; Friedman, Robert M.; Chen, Li M.; Gore, John C.; Avison, Malcolm J.; Roe, Anna W.

2011-01-01

Functional magnetic resonance imaging (fMRI), at high magnetic field strength can suffer from serious degradation of image quality because of motion and physiological noise, as well as spatial distortions and signal losses due to susceptibility effects. Overcoming such limitations is essential for sensitive detection and reliable interpretation of fMRI data. These issues are particularly problematic in studies of awake animals. As part of our initial efforts to study functional brain activations in awake, behaving monkeys using fMRI at 4.7T, we have developed acquisition and analysis procedures to improve image quality with encouraging results. We evaluated the influence of two main variables on image quality. First, we show how important the level of behavioral training is for obtaining good data stability and high temporal signal-to-noise ratios. In initial sessions, our typical scan session lasted 1.5 hours, partitioned into short (<10 minutes) runs. During reward periods and breaks between runs, the monkey exhibited movements resulting in considerable image misregistrations. After a few months of extensive behavioral training, we were able to increase the length of individual runs and the total length of each session. The monkey learned to wait until the end of a block for fluid reward, resulting in longer periods of continuous acquisition. Each additional 60 training sessions extended the duration of each session by 60 minutes, culminating, after about 140 training sessions, in sessions that last about four hours. As a result, the average translational movement decreased from over 500 μm to less than 80 μm, a displacement close to that observed in anesthetized monkeys scanned in a 7 T horizontal scanner. Another major source of distortion at high fields arises from susceptibility variations. To reduce such artifacts, we used segmented gradient-echo echo-planar imaging (EPI) sequences. Increasing the number of segments significantly decreased susceptibility artifacts and image distortion. Comparisons of images from functional runs using four segments with those using a single-shot EPI sequence revealed a roughly two-fold improvement in functional signal-to-noise-ratio and 50% decrease in distortion. These methods enabled reliable detection of neural activation and permitted blood-oxygenation-level-dependent (BOLD) based mapping of early visual areas in monkeys using a volume coil. In summary, both extensive behavioral training of monkeys and application of segmented gradient-echo EPI sequence improved signal-to-noise and image quality. Understanding the effects these factors have is important for the application of high field imaging methods to the detection of sub-millimeter functional structures in the awake monkey brain. PMID:22055855

A bottom-up approach to assess verbal therapeutic techniques. Development of the Psychodynamic Interventions List (PIL)

PubMed Central

Gumz, Antje; Neubauer, Karolin; Horstkotte, Julia Katharina; Geyer, Michael; Löwe, Bernd; Murray, Alexandra M.; Kästner, Denise

2017-01-01

Objective Knowing which specific verbal techniques “good” therapists use in their daily work is important for training and evaluation purposes. In order to systematize what is being practiced in the field, our aim was to empirically identify verbal techniques applied in psychodynamic sessions and to differentiate them according to their basic semantic features using a bottom-up, qualitative approach. Method Mixed-Method-Design: In a comprehensive qualitative study, types of techniques were identified at the level of utterances based on transcribed psychodynamic therapy sessions using Qualitative Content Analysis (4211 utterances). The definitions of the identified categories were successively refined and modified until saturation was achieved. In a subsequent quantitative study, inter-rater reliability was assessed both at the level of utterances (n = 8717) and at the session level (n = 38). The convergent validity of the categories was investigated by analyzing associations with the Interpretive and Supportive Technique Scale (ISTS). Results The inductive approach resulted in a classification system with 37 categories (Psychodynamic Interventions List, PIL). According to their semantic content, the categories can be allocated to three dimensions: form (24 categories), thematic content (9) and temporal focus (4). Most categories showed good or excellent inter-rater reliability and expected associations with the ISTS were predominantly confirmed. The rare use of the residual category “Other” suggests that the identified categories might comprehensively describe the breadth of applied techniques. Conclusions The atheoretical orientation and the clear focus on overt linguistic features should enable the PIL to be used without intensive training or prior theoretical knowledge. The PIL can be used to investigate the links between verbal techniques derived from practice and micro-outcomes (at the session level) as well as the overall therapeutic outcomes. This approach might enable us to determine to what extent the outcome of therapy is due to unintended or non-theoretically relevant techniques. PMID:28837582

Reliability and Normative Data for the Dynamic Visual Acuity Test for Vestibular Screening.

PubMed

Riska, Kristal M; Hall, Courtney D

2016-06-01

The purpose of this study was to determine reliability of computerized dynamic visual acuity (DVA) testing and to determine reference values for younger and older adults. A primary function of the vestibular system is to maintain gaze stability during head motion. The DVA test quantifies gaze stabilization with the head moving versus stationary. Commercially available computerized systems allow clinicians to incorporate DVA into their assessment; however, information regarding reliability and normative values of these systems is sparse. Forty-six healthy adults, grouped by age, with normal vestibular function were recruited. Each participant completed computerized DVA testing including static visual acuity, minimum perception time, and DVA using the NeuroCom inVision System. Testing was performed by two examiners in the same session and then repeated at a follow-up session 3 to 14 days later. Intraclass correlation coefficients (ICCs) were used to determine inter-rater and test-retest reliability. ICCs for inter-rater reliability ranged from 0.323 to 0.937 and from 0.434 to 0.909 for horizontal and vertical head movements, respectively. ICCs for test-retest reliability ranged from 0.154 to 0.856 and from 0.377 to 0.9062 for horizontal and vertical head movements, respectively. Overall, raw scores (left/right DVA and up/down DVA) were more reliable than DVA loss scores. Reliability of a commercially available DVA system has poor-to-fair reliability for DVA loss scores. The use of a convergence paradigm and not incorporating the forced choice paradigm may contribute to poor reliability.

Improving fMRI reliability in presurgical mapping for brain tumours.

PubMed

Stevens, M Tynan R; Clarke, David B; Stroink, Gerhard; Beyea, Steven D; D'Arcy, Ryan Cn

2016-03-01

Functional MRI (fMRI) is becoming increasingly integrated into clinical practice for presurgical mapping. Current efforts are focused on validating data quality, with reliability being a major factor. In this paper, we demonstrate the utility of a recently developed approach that uses receiver operating characteristic-reliability (ROC-r) to: (1) identify reliable versus unreliable data sets; (2) automatically select processing options to enhance data quality; and (3) automatically select individualised thresholds for activation maps. Presurgical fMRI was conducted in 16 patients undergoing surgical treatment for brain tumours. Within-session test-retest fMRI was conducted, and ROC-reliability of the patient group was compared to a previous healthy control cohort. Individually optimised preprocessing pipelines were determined to improve reliability. Spatial correspondence was assessed by comparing the fMRI results to intraoperative cortical stimulation mapping, in terms of the distance to the nearest active fMRI voxel. The average ROC-r reliability for the patients was 0.58±0.03, as compared to 0.72±0.02 in healthy controls. For the patient group, this increased significantly to 0.65±0.02 by adopting optimised preprocessing pipelines. Co-localisation of the fMRI maps with cortical stimulation was significantly better for more reliable versus less reliable data sets (8.3±0.9 vs 29±3 mm, respectively). We demonstrated ROC-r analysis for identifying reliable fMRI data sets, choosing optimal postprocessing pipelines, and selecting patient-specific thresholds. Data sets with higher reliability also showed closer spatial correspondence to cortical stimulation. ROC-r can thus identify poor fMRI data at time of scanning, allowing for repeat scans when necessary. ROC-r analysis provides optimised and automated fMRI processing for improved presurgical mapping. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/

The Work Endurance Recovery Method for Quantifying Training Loads in Judo.

PubMed

Morales, Jose; Franchini, Emerson; Garcia-Massó, Xavier; Solana-Tramunt, Mónica; Buscà, Bernat; González, Luis-Millán

2016-10-01

To adapt the work endurance recovery (WER) method based on randori maximal time to exhaustion (RMTE) for combat situations in judo. Eleven international-standard judo athletes (7 men and 4 women; mean age 20.73 ± 2.49 y, height 1.72 ± 0.11 m, body mass 67.36 ± 10.67 kg) were recruited to take part in the study. All participants performed a maximal incremental test (MIT), a Wingate test (WIN), a Special Judo Fitness Test (SJFT), and 2 RMTE tests. They then took part in a session at an international training camp in Barcelona, Spain, in which 4 methods of load quantification were implemented: the WER method, the Stagno method, the Lucia method, and the session rating of perceived exertion (RPE session ). RMTE demonstrated a very high test-retest reliability (intraclass correlation coefficient = .91), and correlations of the performance tests ranged from moderate to high: RMTE and MIT (r = .66), RMTE and WIN variables (r = .38-.53), RMTE and SJFT variables (r = .74-.77). The correlation between the WER method, which considers time to exhaustion, and the other systems for quantifying training load was high: WER and RPE session (r = .87), WER and Stagno (r = .77), WER and Lucia (r = .73). A comparative repeated-measures analysis of variance of the normalized values of the quantification did not yield statistically significant differences. The WER method using RMTE is highly adaptable to quantify randori judo sessions and enables one to plan a priori individualized training loads.

Modelling job support, job fit, job role and job satisfaction for school of nursing sessional academic staff.

PubMed

Cowin, Leanne S; Moroney, Robyn

2018-01-01

Sessional academic staff are an important part of nursing education. Increases in casualisation of the academic workforce continue and satisfaction with the job role is an important bench mark for quality curricula delivery and influences recruitment and retention. This study examined relations between four job constructs - organisation fit, organisation support, staff role and job satisfaction for Sessional Academic Staff at a School of Nursing by creating two path analysis models. A cross-sectional correlational survey design was utilised. Participants who were currently working as sessional or casual teaching staff members were invited to complete an online anonymous survey. The data represents a convenience sample of Sessional Academic Staff in 2016 at a large school of Nursing and Midwifery in Australia. After psychometric evaluation of each of the job construct measures in this study we utilised Structural Equation Modelling to better understand the relations of the variables. The measures used in this study were found to be both valid and reliable for this sample. Job support and job fit are positively linked to job satisfaction. Although the hypothesised model did not meet model fit standards, a new 'nested' model made substantive sense. This small study explored a new scale for measuring academic job role, and demonstrated how it promotes the constructs of job fit and job supports. All four job constructs are important in providing job satisfaction - an outcome that in turn supports staffing stability, retention, and motivation.

Test-Retest Reliability of a Serious Game for Delirium Screening in the Emergency Department.

PubMed

Tong, Tiffany; Chignell, Mark; Tierney, Mary C; Lee, Jacques S

2016-01-01

Introduction: Cognitive screening in settings such as emergency departments (ED) is frequently carried out using paper-and-pencil tests that require administration by trained staff. These assessments often compete with other clinical duties and thus may not be routinely administered in these busy settings. Literature has shown that the presence of cognitive impairments such as dementia and delirium are often missed in older ED patients. Failure to recognize delirium can have devastating consequences including increased mortality (Kakuma et al., 2003). Given the demands on emergency staff, an automated cognitive test to screen for delirium onset could be a valuable tool to support delirium prevention and management. In earlier research we examined the concurrent validity of a serious game, and carried out an initial assessment of its potential as a delirium screening tool (Tong et al., 2016). In this paper, we examine the test-retest reliability of the game, as it is an important criterion in a cognitive test for detecting risk of delirium onset. Objective: To demonstrate the test-retest reliability of the screening tool over time in a clinical sample of older emergency patients. A secondary objective is to assess whether there are practice effects that might make game performance unstable over repeated presentations. Materials and Methods: Adults over the age of 70 were recruited from a hospital ED. Each patient played our serious game in an initial session soon after they arrived in the ED, and in follow up sessions conducted at 8-h intervals (for each participant there were up to five follow up sessions, depending on how long the person stayed in the ED). Results: A total of 114 adults (61 females, 53 males) between the ages of 70 and 104 years ( M = 81 years, SD = 7) participated in our study after screening out delirious patients. We observed a test-retest reliability of the serious game (as assessed by correlation r -values) between 0.5 and 0.8 across adjacent sessions. Conclusion: The game-based assessment for cognitive screening has relatively strong test-retest reliability and little evidence of practice effects among elderly emergency patients, and may be a useful supplement to existing cognitive assessment methods.

Test-retest reliability of the prefrontal response to affective pictures based on functional near-infrared spectroscopy

NASA Astrophysics Data System (ADS)

Huang, Yuxia; Mao, Mengchai; Zhang, Zong; Zhou, Hui; Zhao, Yang; Duan, Lian; Kreplin, Ute; Xiao, Xiang; Zhu, Chaozhe

2017-01-01

Functional near-infrared spectroscopy (fNIRS) is being increasingly applied to affective and social neuroscience research; however, the reliability of this method is still unclear. This study aimed to evaluate the test-retest reliability of the fNIRS-based prefrontal response to emotional stimuli. Twenty-six participants viewed unpleasant and neutral pictures, and were simultaneously scanned by fNIRS in two sessions three weeks apart. The reproducibility of the prefrontal activation map was evaluated at three spatial scales (mapwise, clusterwise, and channelwise) at both the group and individual levels. The influence of the time interval was also explored and comparisons were made between longer (intersession) and shorter (intrasession) time intervals. The reliabilities of the activation map at the group level for the mapwise (up to 0.88, the highest value appeared in the intersession assessment) and clusterwise scales (up to 0.91, the highest appeared in the intrasession assessment) were acceptable, indicating that fNIRS may be a reliable tool for emotion studies, especially for a group analysis and under larger spatial scales. However, it should be noted that the individual-level and the channelwise fNIRS prefrontal responses were not sufficiently stable. Future studies should investigate which factors influence reliability, as well as the validity of fNIRS used in emotion studies.

Regional reliability of quantitative signal targeting with alternating radiofrequency (STAR) labeling of arterial regions (QUASAR).

PubMed

Tatewaki, Yasuko; Higano, Shuichi; Taki, Yasuyuki; Thyreau, Benjamin; Murata, Takaki; Mugikura, Shunji; Ito, Daisuke; Takase, Kei; Takahashi, Shoki

2014-01-01

Quantitative signal targeting with alternating radiofrequency labeling of arterial regions (QUASAR) is a recent spin labeling technique that could improve the reliability of brain perfusion measurements. Although it is considered reliable for measuring gray matter as a whole, it has never been evaluated regionally. Here we assessed this regional reliability. Using a 3-Tesla Philips Achieva whole-body system, we scanned four times 10 healthy volunteers, in two sessions 2 weeks apart, to obtain QUASAR images. We computed perfusion images and ran a voxel-based analysis within all brain structures. We also calculated mean regional cerebral blood flow (rCBF) within regions of interest configured for each arterial territory distribution. The mean CBF over whole gray matter was 37.74 with intraclass correlation coefficient (ICC) of .70. In white matter, it was 13.94 with an ICC of .30. Voxel-wise ICC and coefficient-of-variation maps showed relatively lower reliability in watershed areas and white matter especially in deeper white matter. The absolute mean rCBF values were consistent with the ones reported from PET, as was the relatively low variability in different feeding arteries. Thus, QUASAR reliability for regional perfusion is high within gray matter, but uncertain within white matter. © 2014 The Authors. Journal of Neuroimaging published by the American Society of Neuroimaging.

Regional Reliability of Quantitative Signal Targeting with Alternating Radiofrequency (STAR) Labeling of Arterial Regions (QUASAR)

PubMed Central

Tatewaki, Yasuko; Higano, Shuichi; Taki, Yasuyuki; Thyreau, Benjamin; Murata, Takaki; Mugikura, Shunji; Ito, Daisuke; Takase, Kei; Takahashi, Shoki

2014-01-01

BACKGROUND AND PURPOSE Quantitative signal targeting with alternating radiofrequency labeling of arterial regions (QUASAR) is a recent spin labeling technique that could improve the reliability of brain perfusion measurements. Although it is considered reliable for measuring gray matter as a whole, it has never been evaluated regionally. Here we assessed this regional reliability. METHODS Using a 3-Tesla Philips Achieva whole-body system, we scanned four times 10 healthy volunteers, in two sessions 2 weeks apart, to obtain QUASAR images. We computed perfusion images and ran a voxel-based analysis within all brain structures. We also calculated mean regional cerebral blood flow (rCBF) within regions of interest configured for each arterial territory distribution. RESULTS The mean CBF over whole gray matter was 37.74 with intraclass correlation coefficient (ICC) of .70. In white matter, it was 13.94 with an ICC of .30. Voxel-wise ICC and coefficient-of-variation maps showed relatively lower reliability in watershed areas and white matter especially in deeper white matter. The absolute mean rCBF values were consistent with the ones reported from PET, as was the relatively low variability in different feeding arteries. CONCLUSIONS Thus, QUASAR reliability for regional perfusion is high within gray matter, but uncertain within white matter. PMID:25370338

Reliability of intra-oral quantitative sensory testing (QST) in patients with atypical odontalgia and healthy controls - a multicentre study.

PubMed

Baad-Hansen, L; Pigg, M; Yang, G; List, T; Svensson, P; Drangsholt, M

2015-02-01

The reliability of comprehensive intra-oral quantitative sensory testing (QST) protocol has not been examined systematically in patients with chronic oro-facial pain. The aim of the present multicentre study was to examine test-retest and interexaminer reliability of intra-oral QST measures in terms of absolute values and z-scores as well as within-session coefficients of variation (CV) values in patients with atypical odontalgia (AO) and healthy pain-free controls. Forty-five patients with AO and 68 healthy controls were subjected to bilateral intra-oral gingival QST and unilateral extratrigeminal QST (thenar) on three occasions (twice on 1 day by two different examiners and once approximately 1 week later by one of the examiners). Intra-class correlation coefficients and kappa values for interexaminer and test-retest reliability were computed. Most of the standardised intra-oral QST measures showed fair to excellent interexaminer (9-12 of 13 measures) and test-retest (7-11 of 13 measures) reliability. Furthermore, no robust differences in reliability measures or within-session variability (CV) were detected between patients with AO and the healthy reference group. These reliability results in chronic orofacial pain patients support earlier suggestions based on data from healthy subjects that intra-oral QST is sufficiently reliable for use as a part of a comprehensive evaluation of patients with somatosensory disturbances or neuropathic pain in the trigeminal region. © 2014 John Wiley & Sons Ltd.

Effectiveness of Visual Methods in Information Procedures for Stem Cell Recipients and Donors

PubMed Central

Sarıtürk, Çağla; Gereklioğlu, Çiğdem; Korur, Aslı; Asma, Süheyl; Yeral, Mahmut; Solmaz, Soner; Büyükkurt, Nurhilal; Tepebaşı, Songül; Kozanoğlu, İlknur; Boğa, Can; Özdoğu, Hakan

2017-01-01

Objective: Obtaining informed consent from hematopoietic stem cell recipients and donors is a critical step in the transplantation process. Anxiety may affect their understanding of the provided information. However, use of audiovisual methods may facilitate understanding. In this prospective randomized study, we investigated the effectiveness of using an audiovisual method of providing information to patients and donors in combination with the standard model. Materials and Methods: A 10-min informational animation was prepared for this purpose. In total, 82 participants were randomly assigned to two groups: group 1 received the additional audiovisual information and group 2 received standard information. A 20-item questionnaire was administered to participants at the end of the informational session. Results: A reliability test and factor analysis showed that the questionnaire was reliable and valid. For all participants, the mean overall satisfaction score was 184.8±19.8 (maximum possible score of 200). However, for satisfaction with information about written informed consent, group 1 scored significantly higher than group 2 (p=0.039). Satisfaction level was not affected by age, education level, or differences between the physicians conducting the informative session. Conclusion: This study shows that using audiovisual tools may contribute to a better understanding of the informed consent procedure and potential risks of stem cell transplantation. PMID:27476890

Analysis of skin conductance response during evaluation of preferences for cosmetic products

PubMed Central

Ohira, Hideki; Hirao, Naoyasu

2015-01-01

We analyzed skin conductance response (SCR) as a psychophysiological index to evaluate affective aspects of consumer preferences for cosmetic products. To examine the test-retest reliability of association between preferences and SCR, we asked 33 female volunteers to complete two experimental sessions approximately 1 year apart. The participants indicated their preferences in a typical paired comparison task by choosing the better option from a combination of two products among four products. We measured anticipatory SCR prior to expressions of the preferences. We found that the mean amplitude of the SCR elicited by the preferred products was significantly larger than that elicited by the non-preferred products. The participants' preferences and corresponding SCR patterns were well preserved at the second session 1 year later. Our results supported cumulating findings that SCR is a useful index of consumer preferences that has future potential, both in laboratory and marketing settings. PMID:25709593

Generalizability and Decision Studies to Inform Observational and Experimental Research in Classroom Settings

ERIC Educational Resources Information Center

Bottema-Beutel, Kristen; Lloyd, Blair; Carter, Erik W.; Asmus, Jennifer M.

2014-01-01

Attaining reliable estimates of observational measures can be challenging in school and classroom settings, as behavior can be influenced by multiple contextual factors. Generalizability (G) studies can enable researchers to estimate the reliability of observational data, and decision (D) studies can inform how many observation sessions are…

Reliability of Grading High School Work in English

ERIC Educational Resources Information Center

Brimi, Hunter M.

2011-01-01

This research replicates the work of Starch and Elliot (1912) by examining the reliability of the grading by English teachers in a single school district. Ninety high school teachers graded the same student paper following professional development sessions in which they were trained to use NWREL's "6+1 Traits of Writing." These participants had…

Reliability and validity of a treatment adherence measure for child psychiatric rehabilitation.

PubMed

Williams, Nathaniel J; Green, Philip

2012-09-01

Treatment adherence, defined as the degree to which practitioners implemented prescribed program principles and activities and avoided proscribed activities, has been an area of growing interest in mental health services for children with severe emotional and behavioral disorders. This study evaluated the reliability and validity of a treatment adherence measure for child psychiatric rehabilitation (CPSR). Parents of children receiving CPSR (n = 79) or psychotherapy (n = 27) completed the Children's Psychosocial Rehabilitation Treatment Adherence Measure (CTAM) and a measure of 2-week session impact. Psychiatric rehabilitation (PSR) supervisors identified PSR practitioners with reputations for high or low adherence to the model. The CTAM's discriminant validity was assessed by using known-groups procedures and predictive validity by examining its relationship to 2-week session impact. The CTAM demonstrated excellent internal consistency (α = .92), discriminant validity (p = .002, d = .72; p = .021, d = .59), and predictive validity (B = 2.24, SE = .31, p < .001), accounting for 28% of the child-level variance in 2-week session impact. Findings suggest the CTAM is a reliable and valid measure of treatment adherence for CPSR programs with a skill-teaching focus. Providers and agencies should take steps to enhance treatment adherence because it may be an important predictor of children's short-term response to CPSR. (PsycINFO Database Record (c) 2012 APA, all rights reserved).

Comparison of Critical Power and W' Derived From 2 or 3 Maximal Tests.

PubMed

Simpson, Len Parker; Kordi, Mehdi

2017-07-01

Typically, accessing the asymptote (critical power; CP) and curvature constant (W') parameters of the hyperbolic power-duration relationship requires multiple constant-power exhaustive-exercise trials spread over several visits. However, more recently single-visit protocols and personal power meters have been used. This study investigated the practicality of using a 2-trial, single-visit protocol in providing reliable CP and W' estimates. Eight trained cyclists underwent 3- and 12-min maximal-exercise trials in a single session to derive (2-trial) CP and W' estimates. On a separate occasion a 5-min trial was performed, providing a 3rd trial to calculate (3-trial) CP and W'. There were no differences in CP (283 ± 66 vs 282 ± 65 W) or W' (18.72 ± 6.21 vs 18.27 ± 6.29 kJ) obtained from either the 2-trial or 3-trial method, respectively. After 2 familiarization sessions (completing a 3- and a 12-min trial on both occasions), both CP and W' remained reliable over additional separate measurements. The current study demonstrates that after 2 familiarization sessions, reliable CP and W' parameters can be obtained from trained cyclists using only 2 maximal-exercise trials. These results offer practitioners a practical, time-efficient solution for incorporating power-duration testing into applied athlete support.

Reliable assessment of general surgeons' non-technical skills based on video-recordings of patient simulated scenarios.

PubMed

Spanager, Lene; Beier-Holgersen, Randi; Dieckmann, Peter; Konge, Lars; Rosenberg, Jacob; Oestergaard, Doris

2013-11-01

Nontechnical skills are essential for safe and efficient surgery. The aim of this study was to evaluate the reliability of an assessment tool for surgeons' nontechnical skills, Non-Technical Skills for Surgeons dk (NOTSSdk), and the effect of rater training. A 1-day course was conducted for 15 general surgeons in which they rated surgeons' nontechnical skills in 9 video recordings of scenarios simulating real intraoperative situations. Data were gathered from 2 sessions separated by a 4-hour training session. Interrater reliability was high for both pretraining ratings (Cronbach's α = .97) and posttraining ratings (Cronbach's α = .98). There was no statistically significant development in assessment skills. The D study showed that 2 untrained raters or 1 trained rater was needed to obtain generalizability coefficients >.80. The high pretraining interrater reliability indicates that videos were easy to rate and Non-Technical Skills for Surgeons dk easy to use. This implies that Non-Technical Skills for Surgeons dk (NOTSSdk) could be an important tool in surgical training, potentially improving safety and quality for surgical patients. Copyright © 2013 Elsevier Inc. All rights reserved.

Validity and reliability of the session-RPE method for quantifying training load in karate athletes.

PubMed

Tabben, M; Tourny, C; Haddad, M; Chaabane, H; Chamari, K; Coquart, J B

2015-04-24

To test the construct validity and reliability of the session rating of perceived exertion (sRPE) method by examining the relationship between RPE and physiological parameters (heart rate: HR and blood lactate concentration: [La --] ) and the correlations between sRPE and two HR--based methods for quantifying internal training load (Banister's method and Edwards's method) during karate training camp. Eighteen elite karate athletes: ten men (age: 24.2 ± 2.3 y, body mass: 71.2 ± 9.0 kg, body fat: 8.2 ± 1.3% and height: 178 ± 7 cm) and eight women (age: 22.6 ± 1.2 y, body mass: 59.8 ± 8.4 kg, body fat: 20.2 ± 4.4%, height: 169 ± 4 cm) were included in the study. During training camp, subjects participated in eight karate--training sessions including three training modes (4 tactical--technical, 2 technical--development, and 2 randori training), during which RPE, HR, and [La -- ] were recorded. Significant correlations were found between RPE and physiological parameters (percentage of maximal HR: r = 0.75, 95% CI = 0.64--0.86; [La --] : r = 0.62, 95% CI = 0.49--0.75; P < 0.001). Moreover, individual sRPE was significantly correlated with two HR--based methods for quantifying internal training load ( r = 0.65--0.95; P < 0.001). The sRPE method showed the high reliability of the same intensity across training sessions (Cronbach's α = 0.81, 95% CI = 0.61--0.92). This study demonstrates that the sRPE method is valid for quantifying internal training load and intensity in karate.

Assessing physician leadership styles: application of the situational leadership model to transitions in patient acuity.

PubMed

Skog, Alexander; Peyre, Sarah E; Pozner, Charles N; Thorndike, Mary; Hicks, Gloria; Dellaripa, Paul F

2012-01-01

The situational leadership model suggests that an effective leader adapts leadership style depending on the followers' level of competency. We assessed the applicability and reliability of the situational leadership model when observing residents in simulated hospital floor-based scenarios. Resident teams engaged in clinical simulated scenarios. Video recordings were divided into clips based on Emergency Severity Index v4 acuity scores. Situational leadership styles were identified in clips by two physicians. Interrater reliability was determined through descriptive statistical data analysis. There were 114 participants recorded in 20 sessions, and 109 clips were reviewed and scored. There was a high level of interrater reliability (weighted kappa r = .81) supporting situational leadership model's applicability to medical teams. A suggestive correlation was found between frequency of changes in leadership style and the ability to effectively lead a medical team. The situational leadership model represents a unique tool to assess medical leadership performance in the context of acuity changes.

Intra and inter-session reliability of rapid Transcranial Magnetic Stimulation stimulus-response curves of tibialis anterior muscle in healthy older adults.

PubMed

Peri, Elisabetta; Ambrosini, Emilia; Colombo, Vera Maria; van de Ruit, Mark; Grey, Michael J; Monticone, Marco; Ferriero, Giorgio; Pedrocchi, Alessandra; Ferrigno, Giancarlo; Ferrante, Simona

2017-01-01

The clinical use of Transcranial Magnetic Stimulation (TMS) as a technique to assess corticospinal excitability is limited by the time for data acquisition and the measurement variability. This study aimed at evaluating the reliability of Stimulus-Response (SR) curves acquired with a recently proposed rapid protocol on tibialis anterior muscle of healthy older adults. Twenty-four neurologically-intact adults (age:55-75 years) were recruited for this test-retest study. During each session, six SR curves, 3 at rest and 3 during isometric muscle contractions at 5% of maximum voluntary contraction (MVC), were acquired. Motor Evoked Potentials (MEPs) were normalized to the maximum peripherally evoked response; the coil position and orientation were monitored with an optical tracking system. Intra- and inter-session reliability of motor threshold (MT), area under the curve (AURC), MEPmax, stimulation intensity at which the MEP is mid-way between MEPmax and MEPmin (I50), slope in I50, MEP latency, and silent period (SP) were assessed in terms of Standard Error of Measurement (SEM), relative SEM, Minimum Detectable Change (MDC), and Intraclass Correlation Coefficient (ICC). The relative SEM was ≤10% for MT, I50, latency and SP both at rest and 5%MVC, while it ranged between 11% and 37% for AURC, MEPmax, and slope. MDC values were overall quite large; e.g., MT required a change of 12%MSO at rest and 10%MSO at 5%MVC to be considered a real change. Inter-sessions ICC were >0.6 for all measures but slope at rest and MEPmax and latency at 5%MVC. Measures derived from SR curves acquired in <4 minutes are affected by similar measurement errors to those found with long-lasting protocols, suggesting that the rapid method is at least as reliable as the traditional methods. As specifically designed to include older adults, this study provides normative data for future studies involving older neurological patients (e.g. stroke survivors).

The validity and reliability of a customized rigid supportive harness during Smith machine back squat exercise.

PubMed

Scott, Brendan R; Dascombe, Ben J; Delaney, Jace A; Elsworthy, Nathan; Lockie, Robert G; Sculley, Dean V; Slattery, Katie M

2014-03-01

Although the back squat exercise is commonly prescribed to both athletic and clinical populations, individuals with restricted glenohumeral mobility may be unable to safely support the bar on the upper trapezius using their hands. The aims of this study were to investigate the validity and reliability of a back squat variation using a rigid supportive harness that does not require unrestricted glenohumeral mobility for quantifying 1 repetition maximum (1RM). Thirteen young men (age = 25.3 ± 4.5 years, height = 179.2 ± 6.9 cm, and body mass = 86.6 ± 12.0 kg) with at least 2 years resistance training experience volunteered to participate in the study. Subjects reported to the lab on 3 occasions, each separated by 1 week. During testing sessions, subjects were assessed for 1RM using the traditional back squat (session 1) and harness back squat (HBS; sessions 2 and 3) exercises. Mean 1RM for the traditional back squat, and 2 testing sessions of the HBS (HBS1 and HBS2) were 148.4 ± 25.0 kg, 152.5 ± 25.7 kg, and 150.4 ± 22.6 kg, respectively. Back squat and mean HBS 1RM scores were very strongly correlated (r = 0.96; p < 0.001). There were no significant differences in 1RM scores between the 3 trials. The test-retest 1RM scores with the HBS demonstrated high reliability, with an intraclass correlation coefficient of 0.98 (95% confidence interval [CI] = 0.93-0.99), and a coefficient of variation of 2.6% (95% CI = 1.9-4.3). Taken together, these data suggest that the HBS exercise is a valid and reliable method for assessing 1RM in young men with previous resistance training experience and may be useful for individuals with restricted glenohumeral mobility.

Descriptive analysis of the verbal behavior of a therapist: a known-group validity analysis of the putative behavioral functions involved in clinical interaction.

PubMed

Virues-Ortega, Javier; Montaño-Fidalgo, Montserrat; Froján-Parga, María Xesús; Calero-Elvira, Ana

2011-12-01

This study analyzes the interobserver agreement and hypothesis-based known-group validity of the Therapist's Verbal Behavior Category System (SISC-INTER). The SISC-INTER is a behavioral observation protocol comprised of a set of verbal categories representing putative behavioral functions of the in-session verbal behavior of a therapist (e.g., discriminative, reinforcing, punishing, and motivational operations). The complete therapeutic process of a clinical case of an individual with marital problems was recorded (10 sessions, 8 hours), and data were arranged in a temporal sequence using 10-min periods. Hypotheses based on the expected performance of the putative behavioral functions portrayed by the SISC-INTER codes across prevalent clinical activities (i.e., assessing, explaining, Socratic method, providing clinical guidance) were tested using autoregressive integrated moving average (ARIMA) models. Known-group validity analyses provided support to all hypotheses. The SISC-INTER may be a useful tool to describe therapist-client interaction in operant terms. The utility of reliable and valid protocols for the descriptive analysis of clinical practice in terms of verbal behavior is discussed. Copyright © 2011. Published by Elsevier Ltd.

Twenty-fifth water reactor safety information meeting: Proceedings. Volume 2: Human reliability analysis and human performance evaluation; Technical issues related to rulemakings; Risk-informed, performance-based initiatives; High burn-up fuel research

DOE Office of Scientific and Technical Information (OSTI.GOV)

Monteleone, S.

1998-03-01

This three-volume report contains papers presented at the conference. The papers are printed in the order of their presentation in each session and describe progress and results of programs in nuclear safety research conducted in this country and abroad. Foreign participation in the meeting included papers presented by researchers from France, Japan, Norway, and Russia. The titles of the papers and the names of the authors have been updated and may differ from those that appeared in the final program of the meeting. This volume contains the following: (1) human reliability analysis and human performance evaluation; (2) technical issues relatedmore » to rulemakings; (3) risk-informed, performance-based initiatives; and (4) high burn-up fuel research. Selected papers have been indexed separately for inclusion in the Energy Science and Technology Database.« less

Session-RPE for quantifying the load of different youth basketball training sessions.

PubMed

Lupo, C; Tessitore, A; Gasperi, L; Gomez, Mar

2017-03-01

The aim of the study was to evaluate youth basketball training, verifying the reliability of the session-RPE method in relation to session duration (< and ≥ 80 minutes) and workout typology (reduced and high warm-up, conditioning, technical, tactical, game portions within a single session) categories. Six male youth basketball players (age, 16.5±0.5 years; height, 195.5±6.75 cm; body mass, 93.9±10.9 kg; and body mass index, 23.6±2.8 kg.m -2 ) were monitored (HR, type and duration of workouts) during 15 (66 individual) training sessions (80±26 minutes). Edwards' HR method was used as a reference measure of internal training load (ITL); the CR-10 RPE scale was administered 30 minutes after the end of each session. The results obtained showed that all comparisons between different session durations and workout portions revealed effects in term of Edwards' ITLs except for warm-up portions. Moderate to strong relationships between Edwards' and session- RPE methods emerged for all sessions (r = .85, P < .001), player's sessions (r range = .79 - .95, P < .001), session durations (< 80 minutes: r = .67, P < .001; ≥ 80 minutes: r = .75, P < .001), and workout portions (r range = .78 - .89, P range = .002 - < .001). The findings indicated that coaches of youth basketball players can successfully use session-RPE to monitor the ITL, regardless of session durations and workout portions.

Sensitivity Analysis in Engineering

NASA Technical Reports Server (NTRS)

Adelman, Howard M. (Compiler); Haftka, Raphael T. (Compiler)

1987-01-01

The symposium proceedings presented focused primarily on sensitivity analysis of structural response. However, the first session, entitled, General and Multidisciplinary Sensitivity, focused on areas such as physics, chemistry, controls, and aerodynamics. The other four sessions were concerned with the sensitivity of structural systems modeled by finite elements. Session 2 dealt with Static Sensitivity Analysis and Applications; Session 3 with Eigenproblem Sensitivity Methods; Session 4 with Transient Sensitivity Analysis; and Session 5 with Shape Sensitivity Analysis.

Multivariate pattern analysis for MEG: A comparison of dissimilarity measures.

PubMed

Guggenmos, Matthias; Sterzer, Philipp; Cichy, Radoslaw Martin

2018-06-01

Multivariate pattern analysis (MVPA) methods such as decoding and representational similarity analysis (RSA) are growing rapidly in popularity for the analysis of magnetoencephalography (MEG) data. However, little is known about the relative performance and characteristics of the specific dissimilarity measures used to describe differences between evoked activation patterns. Here we used a multisession MEG data set to qualitatively characterize a range of dissimilarity measures and to quantitatively compare them with respect to decoding accuracy (for decoding) and between-session reliability of representational dissimilarity matrices (for RSA). We tested dissimilarity measures from a range of classifiers (Linear Discriminant Analysis - LDA, Support Vector Machine - SVM, Weighted Robust Distance - WeiRD, Gaussian Naïve Bayes - GNB) and distances (Euclidean distance, Pearson correlation). In addition, we evaluated three key processing choices: 1) preprocessing (noise normalisation, removal of the pattern mean), 2) weighting decoding accuracies by decision values, and 3) computing distances in three different partitioning schemes (non-cross-validated, cross-validated, within-class-corrected). Four main conclusions emerged from our results. First, appropriate multivariate noise normalization substantially improved decoding accuracies and the reliability of dissimilarity measures. Second, LDA, SVM and WeiRD yielded high peak decoding accuracies and nearly identical time courses. Third, while using decoding accuracies for RSA was markedly less reliable than continuous distances, this disadvantage was ameliorated by decision-value-weighting of decoding accuracies. Fourth, the cross-validated Euclidean distance provided unbiased distance estimates and highly replicable representational dissimilarity matrices. Overall, we strongly advise the use of multivariate noise normalisation as a general preprocessing step, recommend LDA, SVM and WeiRD as classifiers for decoding and highlight the cross-validated Euclidean distance as a reliable and unbiased default choice for RSA. Copyright © 2018 Elsevier Inc. All rights reserved.

Preschool visual acuity screening tests.

PubMed Central

Friendly, D S

1978-01-01

The purpose of the study was to evaluate the relative merits of two screening tests used for visual acuity assessment of preschool children. The tests that were compared were the Good-Lite Company versions of the E-Test and of the STYCAR (Screening Test for Young Children and Retardates). The former is the most popular method for evaluating central acuity in young children in this nation; the STYCAR is a relatively new letter-matching-test developed in England, where it is widely employed. The E-Test poses left-right orientation problems which are eliminated by the symmetrical letters H, T, O and V utilized in the Letter-Matching-Test. Both visual acuity tests were administered on two separate occasions by personnel from the Prevention of Blindness Society of Metropolitan Washington to 633 preschool children in Washington, D.C. By random selection, 150 of the children received the E-Test at both sessions, 162 children received the Letter-Matching-Test at both sessions, 160 chilt athe the second session, and 161 children received the Letter-Matching-Test at the first session and the E-Test at the second session. The author medically examined the eyes of 408 of the 633 children without knowledge of which test had been initially administered. Statistical analysis of the data obtained from the study indicated that the Letter-Matching-Test was significantly better in terms of testability rates, group and individual instruction time, and performance time. The E-Test was more reliable in terms of test-retest acuity scores and was also more valid in terms of agreement between pass-fail results obtained at the first screening session and two levels of pass-fail refraction criteria. Images FIGURE 4 FIGURE 5 FIGURE 7 A FIGURE 7 B FIGURE 9 A FIGURE 9 B PMID:754379

Validation of Fourier analysis of videokeratographic data.

PubMed

Sideroudi, Haris; Labiris, Georgios; Ditzel, Fienke; Tsaragli, Efi; Georgatzoglou, Kimonas; Siganos, Haralampos; Kozobolis, Vassilios

2017-06-15

The aim was to assess the repeatability of Fourier transfom analysis of videokeratographic data using Pentacam in normal (CG), keratoconic (KC) and post-CXL (CXL) corneas. This was a prospective, clinic-based, observational study. One randomly selected eye from all study participants was included in the analysis: 62 normal eyes (CG group), 33 keratoconus eyes (KC group), while 34 eyes, which had already received CXL treatment, formed the CXL group. Fourier analysis of keratometric data were obtained using Pentacam, by two different operators within each of two sessions. Precision, repeatability and Intraclass Correlation Coefficient (ICC), were calculated for evaluating intrassesion and intersession repeatability for the following parameters: Spherical Component (SphRmin, SphEcc), Maximum Decentration (Max Dec), Regular Astigmatism, and Irregularitiy (Irr). Bland-Altman analysis was used for assessing interobserver repeatability. All parameters were presented to be repeatable, reliable and reproductible in all groups. Best intrasession and intersession repeatability and reliability were detected for parameters SphRmin, SphEcc and Max Dec parameters for both operators using ICC (intrasession: ICC > 98%, intersession: ICC > 94.7%) and within subject standard deviation. Best precision and lowest range of agreement was found for the SphRmin parameter (CG: 0.05, KC: 0.16, and CXL: 0.2) in all groups, while the lowest repeatability, reliability and reproducibility was detected for the Irr parameter. The Pentacam system provides accurate measurements of Fourier tranform keratometric data. A single Pentacam scan will be sufficient for most clinical applications.

Reliability of the Motor Learning Strategy Rating Instrument for Children and Youth with Acquired Brain Injury

ERIC Educational Resources Information Center

Kamath, Trishna; Pfeifer, Megan; Banerjee-Guenette, Priyanka; Hunter, Theresa; Ito, Julia; Salbach, Nancy M.; Wright, Virginia; Levac, Danielle

2012-01-01

Purpose: To evaluate reliability and feasibility of the Motor Learning Strategy Rating Instrument (MLSRI) in children with acquired brain injury (ABI). The MLSRI quantifies the extent to which motor learning strategies (MLS) are used within physiotherapy (PT) interventions. Methods: PT sessions conducted by ABI team physiotherapists with a…

Influences of Response Rate and Distribution on the Calculation of Interobserver Reliability Scores

ERIC Educational Resources Information Center

Rolider, Natalie U.; Iwata, Brian A.; Bullock, Christopher E.

2012-01-01

We examined the effects of several variations in response rate on the calculation of total, interval, exact-agreement, and proportional reliability indices. Trained observers recorded computer-generated data that appeared on a computer screen. In Study 1, target responses occurred at low, moderate, and high rates during separate sessions so that…

Low-Budget Instrumentation of a Conventional Leg Press to Measure Reliable Isometric-Strength Capacity.

PubMed

Baur, Heiner; Groppa, Alessia Severina; Limacher, Regula; Radlinger, Lorenz

2016-02-02

Maximum strength and rate of force development (RFD) are 2 important strength characteristics for everyday tasks and athletic performance. Measurements of both parameters must be reliable. Expensive isokinetic devices with isometric modes are often used. The possibility of cost-effective measurements in a practical setting would facilitate quality control. The purpose of this study was to assess the reliability of measurements of maximum isometric strength (Fmax) and RFD on a conventional leg press. Sixteen subjects (23 ± 2 y, 1.68 ± 0.05 m, 59 ± 5 kg) were tested twice within 1 session. After warm-up, subjects performed 2 times 5 trials eliciting maximum voluntary isometric contractions on an instrumented leg press (1- and 2-legged randomized). Fmax (N) and RFD (N/s) were extracted from force-time curves. Reliability was determined for Fmax and RFD by calculating the intraclass correlation coefficient (ICC), the test-retest variability (TRV), and the bias and limits of agreement. Reliability measures revealed good to excellent ICCs of .80-.93. TRV showed mean differences between measurement sessions of 0.4-6.9%. The systematic error was low compared with the absolute mean values (Fmax 5-6%, RFD 1-4%). The implementation of a force transducer into a conventional leg press provides a viable procedure to assess Fmax and RFD. Both performance parameters can be assessed with good to excellent reliability allowing quality control of interventions.

Agreement between the spatio-temporal gait parameters from treadmill-based photoelectric cell and the instrumented treadmill system in healthy young adults and stroke patients.

PubMed

Lee, Myungmo; Song, Changho; Lee, Kyoungjin; Shin, Doochul; Shin, Seungho

2014-07-14

Treadmill gait analysis was more advantageous than over-ground walking because it allowed continuous measurements of the gait parameters. The purpose of this study was to investigate the concurrent validity and the test-retest reliability of the OPTOGait photoelectric cell system against the treadmill-based gait analysis system by assessing spatio-temporal gait parameters. Twenty-six stroke patients and 18 healthy adults were asked to walk on the treadmill at their preferred speed. The concurrent validity was assessed by comparing data obtained from the 2 systems, and the test-retest reliability was determined by comparing data obtained from the 1st and the 2nd session of the OPTOGait system. The concurrent validity, identified by the intra-class correlation coefficients (ICC [2, 1]), coefficients of variation (CVME), and 95% limits of agreement (LOA) for the spatial-temporal gait parameters, were excellent but the temporal parameters expressed as a percentage of the gait cycle were poor. The test-retest reliability of the OPTOGait System, identified by ICC (3, 1), CVME, 95% LOA, standard error of measurement (SEM), and minimum detectable change (MDC95%) for the spatio-temporal gait parameters, was high. These findings indicated that the treadmill-based OPTOGait System had strong concurrent validity and test-retest reliability. This portable system could be useful for clinical assessments.

Intra-session test-retest reliability of magnitude and structure of center of pressure from the Nintendo Wii Balance Board™ for a visually impaired and normally sighted population

PubMed Central

Jeter, Pamela E.; Wang, Jiangxia; Gu, Jialiang; Barry, Michael P.; Roach, Crystal; Corson, Marilyn; Yang, Liancheng; Dagnelie, Gislin

2014-01-01

Individuals with visual impairment (VI) have irreparable damage to one of the input streams contributing to postural stability. Here, we evaluated the intra-session test-retest reliability of the Wii Balance Board (WBB) for measuring Center of Pressure (COP) magnitude and structure, i.e. approximate entropy (ApEn) in fourteen legally blind participants and 21 participants with corrected-to-normal vision. Participants completed a validated balance protocol which included four sensory conditions: double-leg standing on a firm surface with eyes open (EO-firm); a firm surface with eyes closed (EC-firm); a foam surface with EO (EO-foam); and a foam surface with EC (EC-foam). Participants performed the full balance protocol twice during the session, separated by a period of 15 minutes, to determine the intraclass correlation coefficient (ICC). Absolute reliability was determined by the standard of measurement (SEM). The minimal difference (MD) was estimated to determine clinical significance for future studies. COP measures were derived from data sent by the WBB to a laptop via Bluetooth. COP scores increased with the difficulty of sensory condition indicating WBB sensitivity (all p < 0.01). ICCs in the VI group ranged from 0.73 to 0.95, indicating high to very high correlations, and the normal group showed moderate to very high ICCs (0.62–0.94). The SEM was comparable between groups regardless of between-subject variability. The reliability of the WBB makes it practical to screen for balance impairment among VI persons. PMID:25555361

Validity and Reliability of the Persian Version of Baecke Habitual Physical Activity Questionnaire in Healthy Subjects.

PubMed

Sadeghisani, Meissam; Dehghan Manshadi, Farideh; Azimi, Hadi; Montazeri, Ali

2016-09-01

Baecke Habitual Physical Activity Questionnaire (BHPAQ) has widely been employed in clinical and laboratorial studies as a tool for measuring subjects' physical activities. But, the reliability and validity of this questionnaire have not been investigated among Persian speakers. Therefore, the aim of the current study was examining the reliability and validity of the Persian version of the BHPAQ in healthy Persian adults. After following the process of forward-backward translation, 32 subjects were invited to fill out the Persian version of the questionnaire in two independent sessions (3 - 7 days after the first session) in order to determine the reliability index. Also, the validity of the questionnaire was assessed through concurrent validity by 126 subjects (66 males and 60 females) answering both the Baecke and the International Physical Activity Questionnaire (IPAQ). An acceptable level of intraclass correlation coefficient (ICC of work score = 0.95, sport score = 0.93, and leisure score = 0.77) was achieved for the Persian Baecke questionnaire. Correlations between Persian Baecke and IPAQ with and without the score for sitting position were found to be 0.19 and 0.36, respectively. The Persian version of the BHPAQ is a reliable and valid instrument that can be used to measure the level of habitual functional activities in Persian-speaking subjects.

Within-session decrement of the emission of licking bursts following reward devaluation in rats licking for sucrose

PubMed Central

Galistu, Adriana

2017-01-01

We previously observed that dopamine D2-like receptor blockade in rats licking for sucrose produced a within-session decrement of the emission of licking bursts similar to the effect of either reward devaluation, or neuroleptics, on operant responding for different rewards, which, accordingly, we interpreted as an extinction-like effect. This implies that exposing animals to reward devaluation would result in a drop of burst number taking place only after the contact with the devalued reward. To test this prediction, we compared the difference in the within-session time course of burst number in response to high (10%) versus low (2%) concentration sucrose solutions, either in a condition of reward devaluation (exposure to 2% after daily 10%), or in a condition which does not involve changes in the reward value (two groups of subjects each repeatedly exposed to only one of the two concentrations). Reward devaluation resulted in a within-session decrement of the burst number, with the response rate dropping only after the contact with the devalued reward, as predicted. This response pattern was reliably observed only in subjects at their first devaluation experience. In contrast, exposure of separate groups of animals to the two different concentrations yielded lower levels of burst number in the low concentration group apparent since the beginning of the session, as previously observed with dopamine D1-like receptor blockade. These results show that the analysis of burst number, but not of burst size, reveals a specific activation pattern in response to reward devaluation, which differs from the pattern observed comparing the response to two different sucrose concentrations in separate groups of subjects, i.e. in a condition not involving reward devaluation. Finally, the characterisation of the experimental measures of the analysis of licking microstructure in behaviourally (and psychologically) meaningful functional terms, might be relevant for the investigation of the mechanisms underlying behavioural activation and the related evaluation processes. PMID:28493981

Reproducibility of Brain Morphometry from Short-Term Repeat Clinical MRI Examinations: A Retrospective Study

PubMed Central

Liu, Hon-Man; Chen, Shan-Kai; Chen, Ya-Fang; Lee, Chung-Wei; Yeh, Lee-Ren

2016-01-01

Purpose To assess the inter session reproducibility of automatic segmented MRI-derived measures by FreeSurfer in a group of subjects with normal-appearing MR images. Materials and Methods After retrospectively reviewing a brain MRI database from our institute consisting of 14,758 adults, those subjects who had repeat scans and had no history of neurodegenerative disorders were selected for morphometry analysis using FreeSurfer. A total of 34 subjects were grouped by MRI scanner model. After automatic segmentation using FreeSurfer, label-wise comparison (involving area, thickness, and volume) was performed on all segmented results. An intraclass correlation coefficient was used to estimate the agreement between sessions. Wilcoxon signed rank test was used to assess the population mean rank differences across sessions. Mean-difference analysis was used to evaluate the difference intervals across scanners. Absolute percent difference was used to estimate the reproducibility errors across the MRI models. Kruskal-Wallis test was used to determine the across-scanner effect. Results The agreement in segmentation results for area, volume, and thickness measurements of all segmented anatomical labels was generally higher in Signa Excite and Verio models when compared with Sonata and TrioTim models. There were significant rank differences found across sessions in some labels of different measures. Smaller difference intervals in global volume measurements were noted on images acquired by Signa Excite and Verio models. For some brain regions, significant MRI model effects were observed on certain segmentation results. Conclusions Short-term scan-rescan reliability of automatic brain MRI morphometry is feasible in the clinical setting. However, since repeatability of software performance is contingent on the reproducibility of the scanner performance, the scanner performance must be calibrated before conducting such studies or before using such software for retrospective reviewing. PMID:26812647

A rating instrument for fear of hospitalisation.

PubMed

Jankovic, Slobodan M; Antonijevic, Gordana V; Vasic, Ivana R; Zivkovic-Radojevic, Marija N; Mirkovic, Snjezana N; Nikolic, Bosko V; Opancina, Valentina D; Putnik, Srdjan S; Radoicic, Ljiljana R; Raspopovic, Katarina M; Stanojevic, Dragan R; Teofilov, Sladjana D; Tomasevic, Katarina V; Radonjic, Vesela

2018-04-01

To develop and validate a reliable instrument that can measure fear of hospitalisation experienced by outpatients. After having a diagnosis established, some patients experience sense of fear, unpleasantness and embarrassment due to the possibility to be admitted to a hospital. Currently, there is no available instrument for measuring fear of hospitalisation. Cross-sectional study for assessing reliability and validity of a questionnaire. The questionnaire with 17 items and answers according to the Likert scale was developed during two brainstorming sessions of the research team. Its reliability, validity and temporal stability were tested on the sample of 330 outpatients. The study was multicentric, involving patients from seven cities and three countries. Fear of hospitalisation scale showed satisfactory reliability, when rated both by the investigators (Cronbach's alpha .799) and by the patients themselves (Cronbach's alpha .760). It is temporally stable, and both divergent and convergent validity tests had good results. Factorial analysis revealed three domains: fear of being injured, trust to medical staff and fear of losing privacy or autonomy. This study developed new reliable and valid instrument for measuring fear of hospitalisation. Identification of patients with high level of fear of hospitalisation by this instrument should help clinicians to administer measures which may decrease fear and prevent avoidance of healthcare utilisation. © 2018 John Wiley & Sons Ltd.

The validation of a swimming turn wall-contact-time measurement system: a touchpad application reliability study.

PubMed

Brackley, Victoria; Ball, Kevin; Tor, Elaine

2018-05-12

The effectiveness of the swimming turn is highly influential to overall performance in competitive swimming. The push-off or wall contact, within the turn phase, is directly involved in determining the speed the swimmer leaves the wall. Therefore, it is paramount to develop reliable methods to measure the wall-contact-time during the turn phase for training and research purposes. The aim of this study was to determine the concurrent validity and reliability of the Pool Pad App to measure wall-contact-time during the freestyle and backstroke tumble turn. The wall-contact-times of nine elite and sub-elite participants were recorded during their regular training sessions. Concurrent validity statistics included the standardised typical error estimate, linear analysis and effect sizes while the intraclass correlating coefficient (ICC) was used for the reliability statistics. The standardised typical error estimate resulted in a moderate Cohen's d effect size with an R 2 value of 0.80 and the ICC between the Pool Pad and 2D video footage was 0.89. Despite these measurement differences, the results from this concurrent validity and reliability analyses demonstrated that the Pool Pad is suitable for measuring wall-contact-time during the freestyle and backstroke tumble turn within a training environment.

Reliability of sagittal plane hip, knee, and ankle joint angles from a single frame of video data using the GAITRite camera system.

PubMed

Ross, Sandy A; Rice, Clinton; Von Behren, Kristyn; Meyer, April; Alexander, Rachel; Murfin, Scott

2015-01-01

The purpose of this study was to establish intra-rater, intra-session, and inter-rater, reliability of sagittal plane hip, knee, and ankle angles with and without reflective markers using the GAITRite walkway and single video camera between student physical therapists and an experienced physical therapist. This study included thirty-two healthy participants age 20-59, stratified by age and gender. Participants performed three successful walks with and without markers applied to anatomical landmarks. GAITRite software was used to digitize sagittal hip, knee, and ankle angles at two phases of gait: (1) initial contact; and (2) mid-stance. Intra-rater reliability was more consistent for the experienced physical therapist, regardless of joint or phase of gait. Intra-session reliability was variable, the experienced physical therapist showed moderate to high reliability (intra-class correlation coefficient (ICC) = 0.50-0.89) and the student physical therapist showed very poor to high reliability (ICC = 0.07-0.85). Inter-rater reliability was highest during mid-stance at the knee with markers (ICC = 0.86) and lowest during mid-stance at the hip without markers (ICC = 0.25). Reliability of a single camera system, especially at the knee joint shows promise. Depending on the specific type of reliability, error can be attributed to the testers (e.g. lack of digitization practice and marker placement), participants (e.g. loose fitting clothing) and camera systems (e.g. frame rate and resolution). However, until the camera technology can be upgraded to a higher frame rate and resolution, and the software can be linked to the GAITRite walkway, the clinical utility for pre/post measures is limited.

Response variability of different anodal transcranial direct current stimulation intensities across multiple sessions.

PubMed

Ammann, Claudia; Lindquist, Martin A; Celnik, Pablo A

It is well known that transcranial direct current stimulation (tDCS) is capable of modulating corticomotor excitability. However, a source of growing concern has been the observed inter- and intra-individual variability of tDCS-responses. Recent studies have assessed whether individuals respond in a predictable manner across repeated sessions of anodal tDCS (atDCS). The findings of these investigations have been inconsistent, and their methods have some limitations (i.e. lack of sham condition or testing only one tDCS intensity). To study inter- and intra-individual variability of atDCS effects at two different intensities on primary motor cortex (M1) excitability. Twelve subjects participated in a crossover study testing 7-min atDCS over M1 in three separate conditions (2 mA, 1 mA, sham) each repeated three times separated by 48 h. Motor evoked potentials were recorded before and after stimulation (up to 30min). Time of testing was maintained consistent within participants. To estimate the reliability of tDCS effects across sessions, we calculated the Intra-class Correlation Coefficient (ICC). AtDCS at 2 mA, but not 1 mA, significantly increased cortical excitability at the group level in all sessions. The overall ICC revealed fair to high reliability of tDCS effects for multiple sessions. Given that the distribution of responses showed important variability in the sham condition, we established a Sham Variability-Based Threshold to classify responses and to track individual changes across sessions. Using this threshold an intra-individual consistent response pattern was then observed only for the 2 mA condition. 2 mA anodal tDCS results in consistent intra- and inter-individual increases of M1 excitability. Copyright © 2017 Elsevier Inc. All rights reserved.

1. On note taking.

PubMed

Plaut, Alfred B J

2005-02-01

In this paper the author explores the theoretical and technical issues relating to taking notes of analytic sessions, using an introspective approach. The paper discusses the lack of a consistent approach to note taking amongst analysts and sets out to demonstrate that systematic note taking can be helpful to the analyst. The author describes his discovery that an initial phase where as much data was recorded as possible did not prove to be reliably helpful in clinical work and initially actively interfered with recall in subsequent sessions. The impact of the nature of the analytic session itself and the focus of the analyst's interest on recall is discussed. The author then describes how he modified his note taking technique to classify information from sessions into four categories which enabled the analyst to select which information to record in notes. The characteristics of memory and its constructive nature are discussed in relation to the problems that arise in making accurate notes of analytic sessions.

The reliability of the Adelaide in-shoe foot model.

PubMed

Bishop, Chris; Hillier, Susan; Thewlis, Dominic

2017-07-01

Understanding the biomechanics of the foot is essential for many areas of research and clinical practice such as orthotic interventions and footwear development. Despite the widespread attention paid to the biomechanics of the foot during gait, what largely remains unknown is how the foot moves inside the shoe. This study investigated the reliability of the Adelaide In-Shoe Foot Model, which was designed to quantify in-shoe foot kinematics and kinetics during walking. Intra-rater reliability was assessed in 30 participants over five walking trials whilst wearing shoes during two data collection sessions, separated by one week. Sufficient reliability for use was interpreted as a coefficient of multiple correlation and intra-class correlation coefficient of >0.61. Inter-rater reliability was investigated separately in a second sample of 10 adults by two researchers with experience in applying markers for the purpose of motion analysis. The results indicated good consistency in waveform estimation for most kinematic and kinetic data, as well as good inter-and intra-rater reliability. The exception is the peak medial ground reaction force, the minimum abduction angle and the peak abduction/adduction external hindfoot joint moments which resulted in less than acceptable repeatability. Based on our results, the Adelaide in-shoe foot model can be used with confidence for 24 commonly measured biomechanical variables during shod walking. Copyright © 2017 Elsevier B.V. All rights reserved.

Repeated Measurement of the Components of Attention with Young Children Using the Attention Network Test: Stability, Isolability, Robustness, and Reliability

ERIC Educational Resources Information Center

Ishigami, Yoko; Klein, Raymond M.

2015-01-01

The current study examined the robustness, stability, reliability, and isolability of the attention network scores (alerting, orienting, and executive control) when young children experienced repeated administrations of the child version of the Attention Network Test (ANT; Rueda et al., 2004). Ten test sessions of the ANT were administered to 12…

Test-Retest Reliability of a Serious Game for Delirium Screening in the Emergency Department

PubMed Central

Tong, Tiffany; Chignell, Mark; Tierney, Mary C.; Lee, Jacques S.

2016-01-01

Introduction: Cognitive screening in settings such as emergency departments (ED) is frequently carried out using paper-and-pencil tests that require administration by trained staff. These assessments often compete with other clinical duties and thus may not be routinely administered in these busy settings. Literature has shown that the presence of cognitive impairments such as dementia and delirium are often missed in older ED patients. Failure to recognize delirium can have devastating consequences including increased mortality (Kakuma et al., 2003). Given the demands on emergency staff, an automated cognitive test to screen for delirium onset could be a valuable tool to support delirium prevention and management. In earlier research we examined the concurrent validity of a serious game, and carried out an initial assessment of its potential as a delirium screening tool (Tong et al., 2016). In this paper, we examine the test-retest reliability of the game, as it is an important criterion in a cognitive test for detecting risk of delirium onset. Objective: To demonstrate the test-retest reliability of the screening tool over time in a clinical sample of older emergency patients. A secondary objective is to assess whether there are practice effects that might make game performance unstable over repeated presentations. Materials and Methods: Adults over the age of 70 were recruited from a hospital ED. Each patient played our serious game in an initial session soon after they arrived in the ED, and in follow up sessions conducted at 8-h intervals (for each participant there were up to five follow up sessions, depending on how long the person stayed in the ED). Results: A total of 114 adults (61 females, 53 males) between the ages of 70 and 104 years (M = 81 years, SD = 7) participated in our study after screening out delirious patients. We observed a test-retest reliability of the serious game (as assessed by correlation r-values) between 0.5 and 0.8 across adjacent sessions. Conclusion: The game-based assessment for cognitive screening has relatively strong test-retest reliability and little evidence of practice effects among elderly emergency patients, and may be a useful supplement to existing cognitive assessment methods. PMID:27872590

Parent-child interaction in motor speech therapy.

PubMed

Namasivayam, Aravind Kumar; Jethava, Vibhuti; Pukonen, Margit; Huynh, Anna; Goshulak, Debra; Kroll, Robert; van Lieshout, Pascal

2018-01-01

This study measures the reliability and sensitivity of a modified Parent-Child Interaction Observation scale (PCIOs) used to monitor the quality of parent-child interaction. The scale is part of a home-training program employed with direct motor speech intervention for children with speech sound disorders. Eighty-four preschool age children with speech sound disorders were provided either high- (2×/week/10 weeks) or low-intensity (1×/week/10 weeks) motor speech intervention. Clinicians completed the PCIOs at the beginning, middle, and end of treatment. Inter-rater reliability (Kappa scores) was determined by an independent speech-language pathologist who assessed videotaped sessions at the midpoint of the treatment block. Intervention sensitivity of the scale was evaluated using a Friedman test for each item and then followed up with Wilcoxon pairwise comparisons where appropriate. We obtained fair-to-good inter-rater reliability (Kappa = 0.33-0.64) for the PCIOs using only video-based scoring. Child-related items were more strongly influenced by differences in treatment intensity than parent-related items, where a greater number of sessions positively influenced parent learning of treatment skills and child behaviors. The adapted PCIOs is reliable and sensitive to monitor the quality of parent-child interactions in a 10-week block of motor speech intervention with adjunct home therapy. Implications for rehabilitation Parent-centered therapy is considered a cost effective method of speech and language service delivery. However, parent-centered models may be difficult to implement for treatments such as developmental motor speech interventions that require a high degree of skill and training. For children with speech sound disorders and motor speech difficulties, a translated and adapted version of the parent-child observation scale was found to be sufficiently reliable and sensitive to assess changes in the quality of the parent-child interactions during intervention. In developmental motor speech interventions, high-intensity treatment (2×/week/10 weeks) facilitates greater changes in the parent-child interactions than low intensity treatment (1×/week/10 weeks). On one hand, parents may need to attend more than five sessions with the clinician to learn how to observe and address their child's speech difficulties. On the other hand, children with speech sound disorders may need more than 10 sessions to adapt to structured play settings even when activities and therapy materials are age-appropriate.

A Comparison of Reliability Measures for Continuous and Discontinuous Recording Methods: Inflated Agreement Scores with Partial Interval Recording and Momentary Time Sampling for Duration Events

ERIC Educational Resources Information Center

Rapp, John T.; Carroll, Regina A.; Stangeland, Lindsay; Swanson, Greg; Higgins, William J.

2011-01-01

The authors evaluated the extent to which interobserver agreement (IOA) scores, using the block-by-block method for events scored with continuous duration recording (CDR), were higher when the data from the same sessions were converted to discontinuous methods. Sessions with IOA scores of 89% or less with CDR were rescored using 10-s partial…

Test-retest reliability of functional connectivity networks during naturalistic fMRI paradigms.

PubMed

Wang, Jiahui; Ren, Yudan; Hu, Xintao; Nguyen, Vinh Thai; Guo, Lei; Han, Junwei; Guo, Christine Cong

2017-04-01

Functional connectivity analysis has become a powerful tool for probing the human brain function and its breakdown in neuropsychiatry disorders. So far, most studies adopted resting-state paradigm to examine functional connectivity networks in the brain, thanks to its low demand and high tolerance that are essential for clinical studies. However, the test-retest reliability of resting-state connectivity measures is moderate, potentially due to its low behavioral constraint. On the other hand, naturalistic neuroimaging paradigms, an emerging approach for cognitive neuroscience with high ecological validity, could potentially improve the reliability of functional connectivity measures. To test this hypothesis, we characterized the test-retest reliability of functional connectivity measures during a natural viewing condition, and benchmarked it against resting-state connectivity measures acquired within the same functional magnetic resonance imaging (fMRI) session. We found that the reliability of connectivity and graph theoretical measures of brain networks is significantly improved during natural viewing conditions over resting-state conditions, with an average increase of almost 50% across various connectivity measures. Not only sensory networks for audio-visual processing become more reliable, higher order brain networks, such as default mode and attention networks, but also appear to show higher reliability during natural viewing. Our results support the use of natural viewing paradigms in estimating functional connectivity of brain networks, and have important implications for clinical application of fMRI. Hum Brain Mapp 38:2226-2241, 2017. © 2017 Wiley Periodicals, Inc. © 2017 Wiley Periodicals, Inc.

Caffeine's Influence on Nicotine's Effects in Nonsmokers

PubMed Central

Blank, Melissa D.; Kleykamp, Bethea A.; Jennings, Janine M.; Eissenberg, Thomas

2011-01-01

Objective To determine if nicotine's effects are influenced by caffeine in nonsmoking, moderate-caffeine consuming individuals (N=20). Methods The first 3 sessions included one of 3 randomly ordered, double-blind caffeine doses (0, 75, or 150 mg, oral [po]) and 2 single-blind nicotine gum doses (2 and 4 mg) in ascending order. The fourth session (single blind) repeated the 0 mg caffeine condition. Results Nicotine increased heart rate and subjective ratings indicative of aversive effects, and decreased reaction times. These effects were independent of caffeine dose and reliable across sessions. Conclusions In nonsmokers, nicotine effects are not influenced by moderate caffeine doses. PMID:17555378

Reliability of functional and predictive methods to estimate the hip joint centre in human motion analysis in healthy adults.

PubMed

Kainz, Hans; Hajek, Martin; Modenese, Luca; Saxby, David J; Lloyd, David G; Carty, Christopher P

2017-03-01

In human motion analysis predictive or functional methods are used to estimate the location of the hip joint centre (HJC). It has been shown that the Harrington regression equations (HRE) and geometric sphere fit (GSF) method are the most accurate predictive and functional methods, respectively. To date, the comparative reliability of both approaches has not been assessed. The aims of this study were to (1) compare the reliability of the HRE and the GSF methods, (2) analyse the impact of the number of thigh markers used in the GSF method on the reliability, (3) evaluate how alterations to the movements that comprise the functional trials impact HJC estimations using the GSF method, and (4) assess the influence of the initial guess in the GSF method on the HJC estimation. Fourteen healthy adults were tested on two occasions using a three-dimensional motion capturing system. Skin surface marker positions were acquired while participants performed quite stance, perturbed and non-perturbed functional trials, and walking trials. Results showed that the HRE were more reliable in locating the HJC than the GSF method. However, comparison of inter-session hip kinematics during gait did not show any significant difference between the approaches. Different initial guesses in the GSF method did not result in significant differences in the final HJC location. The GSF method was sensitive to the functional trial performance and therefore it is important to standardize the functional trial performance to ensure a repeatable estimate of the HJC when using the GSF method. Copyright © 2017 Elsevier B.V. All rights reserved.

Validity and reliability of an instrumented leg-extension machine for measuring isometric muscle strength of the knee extensors.

PubMed

Ruschel, Caroline; Haupenthal, Alessandro; Jacomel, Gabriel Fernandes; Fontana, Heiliane de Brito; Santos, Daniela Pacheco dos; Scoz, Robson Dias; Roesler, Helio

2015-05-20

Isometric muscle strength of knee extensors has been assessed for estimating performance, evaluating progress during physical training, and investigating the relationship between isometric and dynamic/functional performance. To assess the validity and reliability of an adapted leg-extension machine for measuring isometric knee extensor force. Validity (concurrent approach) and reliability (test and test-retest approach) study. University laboratory. 70 healthy men and women aged between 20 and 30 y (39 in the validity study and 31 in the reliability study). Intraclass correlation coefficient (ICC) values calculated for the maximum voluntary isometric torque of knee extensors at 30°, 60°, and 90°, measured with the prototype and with an isokinetic dynamometer (ICC2,1, validity study) and measured with the prototype in test and retest sessions, scheduled from 48 h to 72 h apart (ICC1,1, reliability study). In the validity analysis, the prototype showed good agreement for measurements at 30° (ICC2,1 = .75, SEM = 18.2 Nm) and excellent agreement for measurements at 60° (ICC2,1 = .93, SEM = 9.6 Nm) and at 90° (ICC2,1 = .94, SEM = 8.9 Nm). Regarding the reliability analysis, between-days' ICC1,1 were good to excellent, ranging from .88 to .93. Standard error of measurement and minimal detectable difference based on test-retest ranged from 11.7 Nm to 18.1 Nm and 32.5 Nm to 50.1 Nm, respectively, for the 3 analyzed knee angles. The analysis of validity and repeatability of the prototype for measuring isometric muscle strength has shown to be good or excellent, depending on the knee joint angle analyzed. The new instrument, which presents a relative low cost and easiness of transportation when compared with an isokinetic dynamometer, is valid and provides consistent data concerning isometric strength of knee extensors and, for this reason, can be used for practical, clinical, and research purposes.

Psychometric Properties of the System for Coding Couples’ Interactions in Therapy - Alcohol

PubMed Central

Owens, Mandy D.; McCrady, Barbara S.; Borders, Adrienne Z.; Brovko, Julie M.; Pearson, Matthew R.

2014-01-01

Few systems are available for coding in-session behaviors for couples in therapy. Alcohol Behavior Couples Therapy (ABCT) is an empirically supported treatment, but little is known about its mechanisms of behavior change. In the current study, an adapted version of the Motivational Interviewing for Significant Others coding system was developed into the System for Coding Couples’ Interactions in Therapy – Alcohol (SCCIT-A), which was used to code couples’ interactions and behaviors during ABCT. Results showed good inter-rater reliability of the SCCIT-A and provided evidence that the SCCIT-A may be a promising measure for understanding couples in therapy. A three factor model of the SCCIT-A was examined (Positive, Negative, and Change Talk/Counter-Change Talk) using a confirmatory factor analysis, but model fit was poor. Due to poor model fit, ratios were computed for Positive/Negative ratings and for Change Talk/Counter-Change Talk codes based on previous research in the couples and Motivational Interviewing literature. Post-hoc analyses examined correlations between specific SCCIT-A codes and baseline characteristics and indicated some concurrent validity. Correlations were run between ratios and baseline characteristics; ratios may be an alternative to using the factors from the SCCIT-A. Reliability and validity analyses suggest that the SCCIT-A has the potential to be a useful measure for coding in-session behaviors of both partners in couples therapy and could be used to identify mechanisms of behavior change for ABCT. Additional research is needed to improve the reliability of some codes and to further develop the SCCIT-A and other measures of couples’ interactions in therapy. PMID:25528049

Reliability of the hand held dynamometer in measuring muscle strength in people with interstitial lung disease.

PubMed

Dowman, Leona; McDonald, Christine F; Hill, Catherine J; Lee, Annemarie; Barker, Kathryn; Boote, Claire; Glaspole, Ian; Goh, Nicole; Southcott, Annemarie; Burge, Angela; Ndongo, Rebecca; Martin, Alicia; Holland, Anne E

2016-09-01

To evaluate the inter-rater and intra-rater reliability of the hand held dynamometer in measuring muscle strength in people with interstitial lung disease (ILD). Test retest reliability of hand-held dynamometry for elbow flexor and knee extensor strength between two independent raters and two testing sessions. Physiotherapy department within a tertiary hospital. Thirty participants with ILD of varying aetiology were included. Twenty participants completed the inter-rater reliability protocol (10 idiopathic pulmonary fibrosis, mean (SD) age 73 (10) years, 11 male) and 21 participants completed the intra-rater reliability protocol (10 idiopathic pulmonary fibrosis, mean age 71 (10) years, 11 male). Mean muscle strength (kg). Agreement between the two raters and testing sessions was analyzed using Bland-Altman plots and reliability was estimated using intraclass correlation coefficients (ICC). For elbow flexor strength there was a mean difference between raters of -0.6kg (limits of agreement (LOA) -5.6 to 4.4kg) and within raters of -0.3kg (LOA -2.8 to 2.3kg). The ICCs were 0.95 and 0.98, respectively. For knee extensor strength there was a mean difference between raters of -1.5kg (LOA -6.9 to 3.9kg) and within raters of -0.7kg (LOA -3.9 to 2.4kg). The ICCs were 0.95 and 0.97, respectively. Hand-held dynamometry is reliable in measuring elbow flexor and knee extensor strength in people with ILD. Copyright © 2015 Chartered Society of Physiotherapy. Published by Elsevier Ltd. All rights reserved.

Intra-session test-retest reliability of magnitude and structure of center of pressure from the Nintendo Wii Balance Board™ for a visually impaired and normally sighted population.

PubMed

Jeter, Pamela E; Wang, Jiangxia; Gu, Jialiang; Barry, Michael P; Roach, Crystal; Corson, Marilyn; Yang, Lindsay; Dagnelie, Gislin

2015-02-01

Individuals with visual impairment (VI) have irreparable damage to one of the input streams contributing to postural stability. Here, we evaluated the intra-session test-retest reliability of the Wii Balance Board (WBB) for measuring Center of Pressure (COP) magnitude and structure, i.e. approximate entropy (ApEn) in fourteen legally blind participants and 21 participants with corrected-to-normal vision. Participants completed a validated balance protocol which included four sensory conditions: double-leg standing on a firm surface with eyes open (EO-firm); a firm surface with eyes closed (EC-firm); a foam surface with EO (EO-foam); and a foam surface with EC (EC-foam). Participants performed the full balance protocol twice during the session, separated by a period of 15min, to determine the intraclass correlation coefficient (ICC). Absolute reliability was determined by the standard error of measurement (SEM). The minimal difference (MD) was estimated to determine clinical significance for future studies. COP measures were derived from data sent by the WBB to a laptop via Bluetooth. COP scores increased with the difficulty of sensory condition indicating WBB sensitivity (all p<0.01). ICCs in the VI group ranged from 0.73 to 0.95, indicating high to very high correlations, and the normal group showed moderate to very high ICCs (0.62-0.94). The SEM was comparable between groups regardless of between-subject variability. The reliability of the WBB makes it practical to screen for balance impairment among VI persons. Copyright © 2014 Elsevier B.V. All rights reserved.

Assessing Muscle-Strength Asymmetry via a Unilateral-Stance Isometric Midthigh Pull.

PubMed

Dos'Santos, Thomas; Thomas, Christopher; Jones, Paul A; Comfort, Paul

2017-04-01

To investigate the within-session reliability of bilateral- and unilateral-stance isometric midthigh-pull (IMTP) force-time characteristics including peak force (PF), relative PF, and impulse at time bands (0-100, 0-200, 0-250, and 0-300 milliseconds) and to compare isometric force-time characteristics between right and left and dominant (D) and nondominant (ND) limbs. Professional male rugby league and multisport male college athletes (N = 54; age, 23.4 ± 4.2 y; height, 1.80 ± 0.05 m; mass, 88.9 ± 12.9 kg) performed 3 bilateral IMTP trials and 6 unilateral-stance IMTP trials (3 per leg) on a force plate sampling at 600 Hz. Intraclass correlation coefficients (ICCs) and coefficients of variation (CVs) demonstrated high within-session reliability for bilateral and unilateral IMTP PF (ICC = .94, CV = 4.7-5.5%). Lower reliability measures and greater variability were observed for bilateral and unilateral IMTP impulse at time bands (ICC = .81-.88, CV = 7.7-11.8%). Paired-sample t tests and Cohen d effect sizes revealed no significant differences for all isometric force-time characteristics between right and left limbs in male college athletes (P >.05, d ≤ 0.32) and professional rugby league players (P > .05, d ≤ 0.11); however, significant differences were found between D and ND limbs in male college athletes (P < .001, d = 0.43-0.91) and professional rugby league players (P < .001, d = 0.27-0.46). This study demonstrated high within-session reliability for unilateral-stance IMTP PF, revealing significant differences in isometric force-time characteristics between D and ND limbs in male athletes.

The first signs of prospective memory.

PubMed

Ślusarczyk, Elżbieta; Niedźwieńska, Agnieszka; Białecka-Pikul, Marta

2018-06-05

We conducted a study to examine the impact of motivation and length of delay on performance on prospective memory (PM) tasks in 2-year of children. A total of 158 children aged exactly 24 months were asked to perform a naturalistic PM task. Length of delay (10 min; 35 min) and motivation (high; very high) were between-subjects factors. Two thirds of children had to be excluded from the analysis because of poor retrospective memory for the PM task instructions which were no longer remembered at the end of the session. For the children who did remember the instructions, both motivation and delay had significant effects on PM. Also, their PM performance was reliably above zero, even after the long delay. The findings indicate that when children as young as 24 months are able to remember the PM task instructions they can reliably succeed in PM tasks that are intrinsically motivating for them.

Test-Retest Reliability of fMRI Brain Activity during Memory Encoding

PubMed Central

Brandt, David J.; Sommer, Jens; Krach, Sören; Bedenbender, Johannes; Kircher, Tilo; Paulus, Frieder M.; Jansen, Andreas

2013-01-01

The mechanisms underlying hemispheric specialization of memory are not completely understood. Functional magnetic resonance imaging (fMRI) can be used to develop and test models of hemispheric specialization. In particular for memory tasks however, the interpretation of fMRI results is often hampered by the low reliability of the data. In the present study we therefore analyzed the test-retest reliability of fMRI brain activation related to an implicit memory encoding task, with a particular focus on brain activity of the medial temporal lobe (MTL). Fifteen healthy subjects were scanned with fMRI on two sessions (average retest interval 35 days) using a commonly applied novelty encoding paradigm contrasting known and unknown stimuli. To assess brain lateralization, we used three different stimuli classes that differed in their verbalizability (words, scenes, fractals). Test-retest reliability of fMRI brain activation was assessed by an intraclass-correlation coefficient (ICC), describing the stability of inter-individual differences in the brain activation magnitude over time. We found as expected a left-lateralized brain activation network for the words paradigm, a bilateral network for the scenes paradigm, and predominantly right-hemispheric brain activation for the fractals paradigm. Although these networks were consistently activated in both sessions on the group level, across-subject reliabilities were only poor to fair (ICCs ≤ 0.45). Overall, the highest ICC values were obtained for the scenes paradigm, but only in strongly activated brain regions. In particular the reliability of brain activity of the MTL was poor for all paradigms. In conclusion, for novelty encoding paradigms the interpretation of fMRI results on a single subject level is hampered by its low reliability. More studies are needed to optimize the retest reliability of fMRI activation for memory tasks. PMID:24367338

Test-retest reliability of resting-state magnetoencephalography power in sensor and source space.

PubMed

Martín-Buro, María Carmen; Garcés, Pilar; Maestú, Fernando

2016-01-01

Several studies have reported changes in spontaneous brain rhythms that could be used as clinical biomarkers or in the evaluation of neuropsychological and drug treatments in longitudinal studies using magnetoencephalography (MEG). There is an increasing necessity to use these measures in early diagnosis and pathology progression; however, there is a lack of studies addressing how reliable they are. Here, we provide the first test-retest reliability estimate of MEG power in resting-state at sensor and source space. In this study, we recorded 3 sessions of resting-state MEG activity from 24 healthy subjects with an interval of a week between each session. Power values were estimated at sensor and source space with beamforming for classical frequency bands: delta (2-4 Hz), theta (4-8 Hz), alpha (8-13 Hz), low beta (13-20 Hz), high beta (20-30 Hz), and gamma (30-45 Hz). Then, test-retest reliability was evaluated using the intraclass correlation coefficient (ICC). We also evaluated the relation between source power and the within-subject variability. In general, ICC of theta, alpha, and low beta power was fairly high (ICC > 0.6) while in delta and gamma power was lower. In source space, fronto-posterior alpha, frontal beta, and medial temporal theta showed the most reliable profiles. Signal-to-noise ratio could be partially responsible for reliability as low signal intensity resulted in high within-subject variability, but also the inherent nature of some brain rhythms in resting-state might be driving these reliability patterns. In conclusion, our results described the reliability of MEG power estimates in each frequency band, which could be considered in disease characterization or clinical trials. © 2015 Wiley Periodicals, Inc.

Intra and inter-session reliability of rapid Transcranial Magnetic Stimulation stimulus-response curves of tibialis anterior muscle in healthy older adults

PubMed Central

Colombo, Vera Maria; van de Ruit, Mark; Grey, Michael J.; Monticone, Marco; Ferriero, Giorgio; Pedrocchi, Alessandra; Ferrigno, Giancarlo; Ferrante, Simona

2017-01-01

Objective The clinical use of Transcranial Magnetic Stimulation (TMS) as a technique to assess corticospinal excitability is limited by the time for data acquisition and the measurement variability. This study aimed at evaluating the reliability of Stimulus-Response (SR) curves acquired with a recently proposed rapid protocol on tibialis anterior muscle of healthy older adults. Methods Twenty-four neurologically-intact adults (age:55–75 years) were recruited for this test-retest study. During each session, six SR curves, 3 at rest and 3 during isometric muscle contractions at 5% of maximum voluntary contraction (MVC), were acquired. Motor Evoked Potentials (MEPs) were normalized to the maximum peripherally evoked response; the coil position and orientation were monitored with an optical tracking system. Intra- and inter-session reliability of motor threshold (MT), area under the curve (AURC), MEPmax, stimulation intensity at which the MEP is mid-way between MEPmax and MEPmin (I50), slope in I50, MEP latency, and silent period (SP) were assessed in terms of Standard Error of Measurement (SEM), relative SEM, Minimum Detectable Change (MDC), and Intraclass Correlation Coefficient (ICC). Results The relative SEM was ≤10% for MT, I50, latency and SP both at rest and 5%MVC, while it ranged between 11% and 37% for AURC, MEPmax, and slope. MDC values were overall quite large; e.g., MT required a change of 12%MSO at rest and 10%MSO at 5%MVC to be considered a real change. Inter-sessions ICC were >0.6 for all measures but slope at rest and MEPmax and latency at 5%MVC. Conclusions Measures derived from SR curves acquired in <4 minutes are affected by similar measurement errors to those found with long-lasting protocols, suggesting that the rapid method is at least as reliable as the traditional methods. As specifically designed to include older adults, this study provides normative data for future studies involving older neurological patients (e.g. stroke survivors). PMID:28910370

Consistency in compensatory eating responses following acute exercise in inactive, overweight and obese women.

PubMed

Unick, Jessica L; O'Leary, Kevin C; Dorfman, Leah; Thomas, J Graham; Strohacker, Kelley; Wing, Rena R

2015-04-14

It is often assumed that some individuals reliably increase energy intake (EI) post-exercise ('compensators') and some do not ('non-compensators'), leading researchers to examine the characteristics that distinguish these two groups. However, it is unclear whether EI post-exercise is stable over time. The present study examined whether compensatory eating responses to a single exercise bout are consistent within individuals across three pairs of trials. Physically inactive, overweight/obese women (n 28, BMI 30·3 (SD 2·9) kg/m²) participated in three pairs of testing sessions, with each pair consisting of an exercise (30 min of moderate-intensity walking) and resting testing day. EI was measured using a buffet meal 1 h post-exercise/rest. For each pair, the difference in EI (EIdiff = EIex - EIrest) was calculated, where EIex is the EI of the exercise session and EIrest is the EI of the resting session, and women were classified as a 'compensator' (EIex > EIrest) or 'non-compensator' (EIex ≤ EIrest). The average EI on exercise days (3328·0 (SD 1686·2) kJ) was similar to those on resting days (3269·4 (SD 1582·4) kJ) (P= 0·67). Although EI was reliable within individuals across the three resting days (intraclass correlation coefficient (ICC) 0·75, 95 % CI 0·60, 0·87; P< 0·001) and three exercise days (ICC 0·83, 95 % CI 0·70, 0·91; P< 0·001), the ICC for EIdiff across the three pairs of trials was low (ICC 0·20, 95 % CI -0·02, 0·45; P= 0·04), suggesting that compensatory eating post-exercise is not a stable construct. Moreover, the classification of 'compensators'/'non-compensators' was not reliable (κ = -0·048; P= 0·66). The results were unaltered when 'relative' EI was used, which considers the energy expenditure of the exercise/resting sessions. Acute compensatory EI following an exercise bout is not reliable in overweight women. Seeking to understand what distinguishes 'compensators' from 'non-compensators' based on a single eating episode post-exercise is not justified.

Planning for an Aging America: The Void in Reliable Data. Hearing before the Select Committee on Aging. House of Representatives, One Hundredth Congress, First Session (October 20, 1987).

ERIC Educational Resources Information Center

Congress of the U.S., Washington, DC. House Select Committee on Aging.

This document contains testimonies and prepared statements from the Congressional hearing called to examine the difficulties associated with the lack of reliable demographic data for use in planning appropriate assistance to "special populations" of older Americans, including minorities, persons with disabilities, the rural elderly,…

Reliability and concurrent validity of a new iPhone® goniometric application for measuring active wrist range of motion: a cross-sectional study in asymptomatic subjects.

PubMed

Pourahmadi, Mohammad Reza; Ebrahimi Takamjani, Ismail; Sarrafzadeh, Javad; Bahramian, Mehrdad; Mohseni-Bandpei, Mohammad Ali; Rajabzadeh, Fatemeh; Taghipour, Morteza

2017-03-01

Measurement of wrist range of motion (ROM) is often considered to be an essential component of wrist physical examination. The measurement can be carried out through various instruments such as goniometers and inclinometers. Recent smartphones have been equipped with accelerometers and magnetometers, which, through specific software applications (apps) can be used for goniometric functions. This study, for the first time, aimed to evaluate the reliability and concurrent validity of a new smartphone goniometric app (Goniometer Pro©) for measuring active wrist ROM. In all, 120 wrists of 70 asymptomatic adults (38 men and 32 women; aged 18-40 years) were assessed in a physiotherapy clinic located at the School of Rehabilitation Sciences, Iran University of Medical Science and Health Services, Tehran, Iran. Following the recruitment process, active wrist ROM was measured using a universal goniometer and iPhone ® 5 app. Two blinded examiners each utilized the universal goniometer and iPhone ® to measure active wrist ROM using a volar/dorsal alignment technique in the following sequences: flexion, extension, radial deviation, and ulnar deviation. The second (2 h later) and third (48 h later) sessions were carried out in the same manner as the first session. All the measurements were conducted three times and the mean value of three repetitions for each measurement was used for analysis. Intraclass correlation coefficient (ICC) models (3, k) and (2, k) were used to determine the intra-rater and inter-rater reliability, respectively. The Pearson correlation coefficients were used to establish concurrent validity of the iPhone ® app. Good to excellent intra-rater and inter-rater reliability was demonstrated for the goniometer with ICC values of ≥ 0.82 and ≥ 0.73 and the iPhone ® app with ICC values of ≥ 0.83 and ≥ 0.79, respectively. Minimum detectable change at the 95% confidence level (MDC 95 ) was computed as 1.96 × standard error of measurement × √2. The MDC 95 ranged from 1.66° to 5.35° for the intra-rater analysis and from 1.97° to 6.15° for the inter-rater analysis. The concurrent validity between the two instruments was high, with r values of ≥ 0.80. From the results of this cross-sectional study, it can be concluded that the iPhone ® app possesses good to excellent intra-rater and inter-rater reliability and concurrent validity. It seems that this app can be used for the measurement of wrist ROM. However, further research is needed to evaluate symptomatic subjects using this app. © 2016 Anatomical Society.

Critical appraisal of fundamental items in approved clinical trial research proposals in Mashhad University of Medical Sciences

PubMed Central

Shakeri, Mohammad-Taghi; Taghipour, Ali; Sadeghi, Masoumeh; Nezami, Hossein; Amirabadizadeh, Ali-Reza; Bonakchi, Hossein

2017-01-01

Background: Writing, designing, and conducting a clinical trial research proposal has an important role in achieving valid and reliable findings. Thus, this study aimed at critically appraising fundamental information in approved clinical trial research proposals in Mashhad University of Medical Sciences (MUMS) from 2008 to 2014. Methods: This cross-sectional study was conducted on all 935 approved clinical trial research proposals in MUMS from 2008 to 2014. A valid and reliable as well as comprehensive, simple, and usable checklist in sessions with biostatisticians and methodologists, consisting of 11 main items as research tool, were used. Agreement rate between the reviewers of the proposals, who were responsible for data collection, was assessed during 3 sessions, and Kappa statistics was calculated at the last session as 97%. Results: More than 60% of the research proposals had a methodologist consultant, moreover, type of study or study design had been specified in almost all of them (98%). Appropriateness of study aims with hypotheses was not observed in a significant number of research proposals (585 proposals, 62.6%). The required sample size for 66.8% of the approved proposals was based on a sample size formula; however, in 25% of the proposals, sample size formula was not in accordance with the study design. Data collection tool was not selected appropriately in 55.2% of the approved research proposals. Type and method of randomization were unknown in 21% of the proposals and dealing with missing data had not been described in most of them (98%). Inclusion and exclusion criteria were (92%) fully and adequately explained. Moreover, 44% and 31% of the research proposals were moderate and weak in rank, respectively, with respect to the correctness of the statistical analysis methods. Conclusion: Findings of the present study revealed that a large portion of the approved proposals were highly biased or ambiguous with respect to randomization, blinding, dealing with missing data, data collection tool, sampling methods, and statistical analysis. Thus, it is essential to consult and collaborate with a methodologist in all parts of a proposal to control the possible and specific biases in clinical trials. PMID:29445703

Critical appraisal of fundamental items in approved clinical trial research proposals in Mashhad University of Medical Sciences.

PubMed

Shakeri, Mohammad-Taghi; Taghipour, Ali; Sadeghi, Masoumeh; Nezami, Hossein; Amirabadizadeh, Ali-Reza; Bonakchi, Hossein

2017-01-01

Background: Writing, designing, and conducting a clinical trial research proposal has an important role in achieving valid and reliable findings. Thus, this study aimed at critically appraising fundamental information in approved clinical trial research proposals in Mashhad University of Medical Sciences (MUMS) from 2008 to 2014. Methods: This cross-sectional study was conducted on all 935 approved clinical trial research proposals in MUMS from 2008 to 2014. A valid and reliable as well as comprehensive, simple, and usable checklist in sessions with biostatisticians and methodologists, consisting of 11 main items as research tool, were used. Agreement rate between the reviewers of the proposals, who were responsible for data collection, was assessed during 3 sessions, and Kappa statistics was calculated at the last session as 97%. Results: More than 60% of the research proposals had a methodologist consultant, moreover, type of study or study design had been specified in almost all of them (98%). Appropriateness of study aims with hypotheses was not observed in a significant number of research proposals (585 proposals, 62.6%). The required sample size for 66.8% of the approved proposals was based on a sample size formula; however, in 25% of the proposals, sample size formula was not in accordance with the study design. Data collection tool was not selected appropriately in 55.2% of the approved research proposals. Type and method of randomization were unknown in 21% of the proposals and dealing with missing data had not been described in most of them (98%). Inclusion and exclusion criteria were (92%) fully and adequately explained. Moreover, 44% and 31% of the research proposals were moderate and weak in rank, respectively, with respect to the correctness of the statistical analysis methods. Conclusion: Findings of the present study revealed that a large portion of the approved proposals were highly biased or ambiguous with respect to randomization, blinding, dealing with missing data, data collection tool, sampling methods, and statistical analysis. Thus, it is essential to consult and collaborate with a methodologist in all parts of a proposal to control the possible and specific biases in clinical trials.

Evaluation of Pharmacy and Therapeutic (P&T) Committee member knowledge, attitudes and ability regarding the use of comparative effectiveness research (CER) in health care decision-making.

PubMed

Tang, D H; Warholak, T L; Hines, L E; Hurwitz, J; Brown, M; Taylor, A M; Brixner, D; Malone, D C

2014-01-01

Comparative effectiveness research (CER) is a constellation of research methods designed to improve health care decision making. Educational programs that improve health care decision makers' CER knowledge and awareness may ultimately lead to more cost-effective use of health care resources. This study was conducted to evaluate changes in CER knowledge, attitudes, and ability among Pharmacy and Therapeutics (P&T) Committee members and support staff after attending a tailored educational program. Physicians and pharmacists from two professional societies and the Indian Health Service who participated in the P&T process were invited via email to participate in this study. Participants completed a questionnaire, designed specifically for this study, prior to and following the 4-hour live, educational program on CER to determine the impact on their related knowledge, attitudes, and ability to use CER in decision-making. Rasch analysis was used to assess validity and reliability of subsections of the questionnaire and regression analysis was used to assess programmatic impact on CER knowledge, attitude, and ability. One hundred and forty of the 199 participants completed both the pre- and post-CER session questionnaires (response rate = 70.4%). Most participants (>75%) correctly answered eight of the ten knowledge items after attending the educational session. More than 60% of the respondents had a positive attitude toward CER both before and after the program. Compared to baseline (pretest), participants reported significant improvements in their perceived ability to use CER after attending the session in these areas: using CER reviews, knowledge of CER methods, identifying problems with randomized controlled trials, identifying threats to validity, understanding of evidence synthesis approaches, and evaluating the quality of CER (all P values < 0.001). The questionnaire demonstrated acceptable reliability and validity evidence (limited evidence of construct under-representation and construct irrelevant variance). The CER educational program was effective in increasing participants' CER knowledge and self-perceived ability to evaluate relevant evidence. Improving knowledge and awareness of CER and its applicability is a critical first step in improving its use in health care decision making. Copyright © 2014 Elsevier Inc. All rights reserved.

Pinch aperture proprioception: reliability and feasibility study

PubMed Central

Yahya, Abdalghani; von Behren, Timothy; Levine, Shira; dos Santos, Marcio

2018-01-01

[Purpose] To establish the reliability and feasibility of a novel pinch aperture device to measure proprioceptive joint position sense. [Subjects and Methods] Reliability of the pinch aperture device was assessed in 21 healthy subjects. Following familiarization with a 15° target position of the index finger and thumb, subjects performed 5 trials in which they attempted to actively reproduce the target position without visual feedback. This procedure was repeated at a testing session on a separate date, and the between-session intraclass correlation coefficient (ICC) was calculated. In addition, extensor tendon vibration was applied to 19 healthy subjects, and paired t-tests were conducted to compare performance under vibration and no-vibration conditions. Pinch aperture proprioception was also assessed in two individuals with known diabetic neuropathy. [Results] The pinch aperture device demonstrated excellent reliability in healthy subjects (ICC 0.88, 95% confidence interval 0.70–0.95). Tendon vibration disrupted pinch aperture proprioception, causing subjects to undershoot the target position (18.1 ± 2.6° vs. 14.8° ± 0.76, p<0.001). This tendency to undershoot the target position was also noted in individuals with diabetic neuropathy. [Conclusion] This study describes a reliable, feasible, and functional means of measuring finger proprioception. Further research should investigate the assessment and implications of pinch aperture proprioception in neurological and orthopedic populations. PMID:29765192

Quantitative analysis of the difference between an intact complete discoid lateral meniscus and a torn complete discoid meniscus on MR imaging: a feasibility study for a new classification.

PubMed

Lee, Mi Hee; Choi, Sang-Hee; Woo, Sook Young

2010-12-01

To determine the quantitative difference between an intact complete discoid lateral meniscus (CDLM) and a torn CDLM on MR imaging. Between May 2005 to November 2009, 137 patients with a CDLM (107 intact CDLM and 30 torn CDLM) and 92 patients with a normal meniscus were included in this study. The evaluated parameters were the height of the posterior horn of the lateral and medial menisci on the sagittal images and their ratio as assessed by two observers twice at an interval of 1 month. Each parameter was analyzed based on the Kruskal Wallis test, and the analysis using the mixed model. Intraclass correlation coefficient (ICC) was used to determine the interobserver reliabilities at session 2. The mean heights of the posterior horn of the lateral and medial menisci on the sagittal images for an intact CDLM, a torn CLDM, and a normal meniscus were 6.5, 7.3, 5.7 and 6.6, 6.4, 6.7 mm at session 1, respectively. The mean heights of the posterior horn of the lateral and medial menisci on the sagittal images for an intact CDLM, a torn CDLM, and a normal meniscus for both observers were 6.5, 7.2, 5.7 and 6.6, 6.3, 6.8 mm at session 2, respectively. The ratio of the height of the lateral to the height of the medial meniscus for an intact CDLM at both sessions for both observers was 1.0. The ratios were 1.2 and 0.8 for a torn CDLM and for a normal meniscus, respectively, at both sessions for observer 1. The ratios were 1.2 and 0.9 for a torn CDLM and for a normal meniscus, respectively, at session 2 for observer 2. The heights of the posterior horn of the lateral meniscus on the sagittal images and the ratios of the heights of the lateral to the medial menisci in all three groups were statistically significantly different for both sessions (p < 0.0001). The interobserver ICCs for each parameter of both an intact CDLM and a torn CDLM at session 2 showed high correlations (p < 0.0001). The height of the lateral meniscus and the ratio of the height of the lateral to the height of the medial meniscus for a torn CDLM were significantly higher than those for an intact CDLM.

Development of a quantitative tool to assess the content of physical therapy for infants.

PubMed

Blauw-Hospers, Cornill H; Dirks, Tineke; Hulshof, Lily J; Hadders-Algra, Mijna

2010-01-01

The study aim was to describe and quantify physical therapy interventions for infants at high risk for developmental disorders. An observation protocol was developed based on knowledge about infant physical therapy and analysis of directly observable physiotherapeutic (PT) actions. The protocol's psychometric quality was assessed. Videos of 42 infant physical therapy sessions at 4 or 6 months of corrected age were analyzed. The observation protocol classified PT actions into 8 mutually exclusive categories. Virtually all PT actions during treatment could be classified. Inter- and intrarater agreements were satisfactory (intraclass correlations, 0.68-1.00). Approximately 40% of treatment time was spent challenging the infant to produce motor behavior by themselves, whereas approximately 30% of time facilitation techniques were applied. Tradition-based sessions could be differentiated from function-oriented ones. It is possible to document PT actions during physical therapy treatment of infants at high risk for cerebral palsy in a systematic, standardized, and reliable way.

The Persian developmental sentence scoring as a clinical measure of morphosyntax in children.

PubMed

Jalilevand, Nahid; Kamali, Mohammad; Modarresi, Yahya; Kazemi, Yalda

2016-01-01

Background: Developmental Sentence Scoring (DSS) was developed as a numerical measurement and a clinical method based on the morphosyntactic acquisition in the English language. The aim of this study was to develop a new numerical tool similar to DSS to assess the morphosyntactic abilities in Persian-speaking children. Methods: In this cross-sectional and comparative study, the language samples of 115 typically developing Persian-speaking children aged 30 - 65 months were audio recorded during the free play and picture description sessions. The Persian Developmental Sentence Score (PDSS) and the Mean Length of Utterance (MLU) were calculated. Pearson correlation and one - way Analysis of variance (ANOVA) were used for data analysis. Results: The correlation between PDSS and MLU in morphemes (convergent validity) was significant with a correlation coefficient of 0.97 (p< 0.001). The value Cronbach's Alpha (α= 0.79) in the grammatical categories and the split-half coefficient (0.86) indicated acceptable internal consistency reliability. Conclusion: The PDSS could be used as a reliable numerical measurement to estimate the syntactic development in Persian-speaking children.

The Persian developmental sentence scoring as a clinical measure of morphosyntax in children

PubMed Central

Jalilevand, Nahid; Kamali, Mohammad; Modarresi, Yahya; Kazemi, Yalda

2016-01-01

Background: Developmental Sentence Scoring (DSS) was developed as a numerical measurement and a clinical method based on the morphosyntactic acquisition in the English language. The aim of this study was to develop a new numerical tool similar to DSS to assess the morphosyntactic abilities in Persian-speaking children. Methods: In this cross-sectional and comparative study, the language samples of 115 typically developing Persian-speaking children aged 30 - 65 months were audio recorded during the free play and picture description sessions. The Persian Developmental Sentence Score (PDSS) and the Mean Length of Utterance (MLU) were calculated. Pearson correlation and one – way Analysis of variance (ANOVA) were used for data analysis. Results: The correlation between PDSS and MLU in morphemes (convergent validity) was significant with a correlation coefficient of 0.97 (p< 0.001). The value Cronbach's Alpha (α= 0.79) in the grammatical categories and the split-half coefficient (0.86) indicated acceptable internal consistency reliability. Conclusion: The PDSS could be used as a reliable numerical measurement to estimate the syntactic development in Persian-speaking children. PMID:28210600

Variability of strength measurement in postmenopausal women who are overweight or obese: a Monet study.

PubMed

St-Onge, Maxime; Mathieu, Marie-Eve; Tousignant, Benoit; Faraj, May; Lavoie, Jean-Marc

2009-12-01

The main objective of this study was to establish whether a stable measurement of strength could be obtained without prior exercise familiarization in postmenopausal women who were overweight or obese. A second objective was to evaluate the influence of physical activity on the variability of strength measurement. Thirty postmenopausal women (age: 57.9 yr; SD: 5 yr; body mass index: 31.0 kg/m2; SD: 4 kg/m2) underwent 3 strength testing sessions (48 hr apart) each including 3 exercises (leg press, chest press, and lat pull down). Energy expenditure was measured before the strength testing week with the doubly labelled water method over a 10-day period. Resting metabolic rate was measured by indirect calorimetry. Physical activity energy expenditure was calculated as follows: total energy expenditure x 0.9, minus the resting metabolic rate. Repeated analysis of variance and paired t-test were used to assess the difference and the reliability of the testing sequence. Results from leg press and chest press exercises indicated no significant difference among the 3 testing sessions. The lat pull down exercise was associated with a significant systematic bias between sessions 1 and 2 (mean difference: 1.4 kg; SD: 3 kg; 95% confidence intervals; 0.2-2.7 kg), but the difference disappeared at the third testing session (mean difference: 0.7 kg; SD: 3 kg; 95% confidence intervals; 0.5-2 kg). Physical activity did not influence the variability of the strength results. Overall, our results showed that a relatively stable strength measurement can be obtained within a maximum of 3 testing sessions without prior familiarization. In addition, physical activity did not influence strength testing in postmenopausal women who were overweight or obese.

Psychometric properties of the Peer Proficiency Assessment (PEPA): a tool for evaluation of undergraduate peer counselors' motivational interviewing fidelity.

PubMed

Mastroleo, Nadine R; Mallett, Kimberly A; Turrisi, Rob; Ray, Anne E

2009-09-01

Despite the expanding use of undergraduate student peer counseling interventions aimed at reducing college student drinking, few programs evaluate peer counselors' competency to conduct these interventions. The present research describes the development and psychometric assessments of the Peer Proficiency Assessment (PEPA), a new tool for examining Motivational Interviewing adherence in undergraduate student peer delivered interventions. Twenty peer delivered sessions were evaluated by master and undergraduate student coders using a cross-validation design to examine peer based alcohol intervention sessions. Assessments revealed high inter-rater reliability between student and master coders and good correlations between previously established fidelity tools. Findings lend support for the use of the PEPA to examine peer counselor competency. The PEPA, training for use, inter-rater reliability information, construct and predictive validity, and tool usefulness are described.

An intensive time-series evaluation of the effectiveness of cognitive behaviour therapy for hoarding disorder: a 2-year prospective study.

PubMed

Pollock, Lisa; Kellett, Stephen; Totterdell, Peter

2014-01-01

To intensively evaluate the effectiveness of cognitive-behavioural therapy (CBT) for Hoarding Disorder. An ABC with extended follow-up N=1 single-case experimental design (SCED) measured discard incidence/frequency/volume and associated cognitions, behaviours and emotions in a 644-day time series. Following a 4-week baseline (A), CBT was initially delivered via out-patient sessions (B) and then out-patient sessions plus domiciliary visits (C). Total treatment duration was 45 sessions (65 weeks) and follow-up was 4 sessions over 23 weeks. There was a significant increase in frequency and volume of discard, with a reliable and clinically significant reduction in hoarding. The addition of domiciliary visits did not significantly improve discard ability. The clinical utility of domiciliary visits whilst treating of hoarding is discussed and study limitations noted.

Multi-site randomized trial of behavioral interventions for women with co-occurring PTSD and substance use disorders

PubMed Central

Hien, Denise A.; Wells, Elizabeth A.; Jiang, Huiping; Suarez-Morales, Lourdes; Campbell, Aimee N. C.; Cohen, Lisa R.; Miele, Gloria M.; Killeen, Therese; Brigham, Gregory S.; Zhang, Yulei; Hansen, Cheri; Hodgkins, Candace; Hatch-Maillette, Mary; Brown, Chanda; Kulaga, Agatha; Kristman-Valente, Allison; Chu, Melissa; Sage, Robert; Robinson, James A.; Liu, David; Nunes, Edward V.

2009-01-01

We compared the effectiveness of Seeking Safety (SS), an integrated cognitive behavioral treatment for substance use disorder (SUD) and post-traumatic stress disorder (PTSD), to an active comparison health education group (Women’s Health Education [WHE]) within NIDA’s Clinical Trials Network. We randomized 353 women to receive 12 sessions of SS (M = 6.2 sessions) or WHE (M = 6.0 sessions) with follow-up assessment at post-treatment and 3-, 6-, and 12-months post-treatment. Primary outcomes were the Clinician Administered PTSD Scale (CAPS) and PTSD Symptom Scale-Self Report (PSS-SR), and substance use (self-reported abstinence in the prior 7 days and days per week of any substance use). Intention-to-treat analysis showed large, clinically significant reductions in CAPS and PSS-SR symptoms (d = 1.94 and 1.12, respectively), but no reliable difference between conditions. Substance use outcomes were not significantly different over time between the two treatments and at follow-up showed no significant change from baseline, when 46% of participants were abstinent. Study results do not favor SS over WHE as an adjunct to SUD treatment for women with PTSD and reflect considerable opportunity to improve clinical outcomes in community-based treatments for these co-occurring conditions. PMID:19634955

Killer whale caller localization using a hydrophone array in an oceanarium pool

NASA Astrophysics Data System (ADS)

Bowles, Ann E.; Greenlaw, Charles F.; McGehee, Duncan E.; van Holliday, D.

2004-05-01

A system to localize calling killer whales was designed around a ten-hydrophone array in a pool at SeaWorld San Diego. The array consisted of nine ITC 8212 and one ITC 6050H hydrophones mounted in recessed 30×30 cm2 niches. Eight of the hydrophones were connected to a Compaq Armada E500 laptop computer through a National Instruments DAQ 6024E PCMCIA A/D data acquisition card and a BNC-2120 signal conditioner. The system was calibrated with a 139-dB, 4.5-kHz pinger. Acoustic data were collected during four 48-72 h recording sessions, simultaneously with video recorded from a four-camera array. Calling whales were localized by one of two methods, (1) at the hydrophone reporting the highest sound exposure level and (2) using custom-designed 3-D localization software based on time-of-arrival (ORCA). Complex reverberations in the niches and pool made locations based on time of arrival difficult to collect. Based on preliminary analysis of data from four sessions (400+ calls/session), the hydrophone reporting the highest level reliably attributed callers 51%-100% of the time. This represents a substantial improvement over attribution rates of 5%-15% obtained with single hydrophone recordings. [Funding provided by Hubbs-SeaWorld Research Institute and the Hubbs Society.

Development of a morphology-based modeling technique for tracking solid-body displacements: examining the reliability of a potential MRI-only approach for joint kinematics assessment.

PubMed

Mahato, Niladri K; Montuelle, Stephane; Cotton, John; Williams, Susan; Thomas, James; Clark, Brian

2016-05-18

Single or biplanar video radiography and Roentgen stereophotogrammetry (RSA) techniques used for the assessment of in-vivo joint kinematics involves application of ionizing radiation, which is a limitation for clinical research involving human subjects. To overcome this limitation, our long-term goal is to develop a magnetic resonance imaging (MRI)-only, three dimensional (3-D) modeling technique that permits dynamic imaging of joint motion in humans. Here, we present our initial findings, as well as reliability data, for an MRI-only protocol and modeling technique. We developed a morphology-based motion-analysis technique that uses MRI of custom-built solid-body objects to animate and quantify experimental displacements between them. The technique involved four major steps. First, the imaging volume was calibrated using a custom-built grid. Second, 3-D models were segmented from axial scans of two custom-built solid-body cubes. Third, these cubes were positioned at pre-determined relative displacements (translation and rotation) in the magnetic resonance coil and scanned with a T1 and a fast contrast-enhanced pulse sequences. The digital imaging and communications in medicine (DICOM) images were then processed for animation. The fourth step involved importing these processed images into an animation software, where they were displayed as background scenes. In the same step, 3-D models of the cubes were imported into the animation software, where the user manipulated the models to match their outlines in the scene (rotoscoping) and registered the models into an anatomical joint system. Measurements of displacements obtained from two different rotoscoping sessions were tested for reliability using coefficient of variations (CV), intraclass correlation coefficients (ICC), Bland-Altman plots, and Limits of Agreement analyses. Between-session reliability was high for both the T1 and the contrast-enhanced sequences. Specifically, the average CVs for translation were 4.31 % and 5.26 % for the two pulse sequences, respectively, while the ICCs were 0.99 for both. For rotation measures, the CVs were 3.19 % and 2.44 % for the two pulse sequences with the ICCs being 0.98 and 0.97, respectively. A novel biplanar imaging approach also yielded high reliability with mean CVs of 2.66 % and 3.39 % for translation in the x- and z-planes, respectively, and ICCs of 0.97 in both planes. This work provides basic proof-of-concept for a reliable marker-less non-ionizing-radiation-based quasi-dynamic motion quantification technique that can potentially be developed into a tool for real-time joint kinematics analysis.

Cost and logistics for implementing the American College of Surgeons objective structured clinical examination.

PubMed

Sudan, Ranjan; Clark, Philip; Henry, Brandon

2015-01-01

The American College of Surgeons has developed a reliable and valid OSCE (objective structured clinical examination) to assess the clinical skills of incoming postgraduate year 1 surgery residents, but the cost and logistics of implementation have not been described. Fixed costs included staff time, medical supplies, facility fee, standardized patient (SP) training time, and one OSCE session. Variable costs were incurred for additional OSCE sessions. Costs per resident were calculated and modeled for increasing the number of test takers. American College of Surgeons OSCE materials and examination facilities were free. Fixed costs included training 11 SPs for 4 hours ($1,540), moulage and simulation material ($469), and administrative effort for 44 hours ($2,200). Variable cost for each session was $1,540 (SP time). Total cost for the first session was $6,649 ($664/resident), decreased to $324/resident for 3 sessions, and projected to further decline to $239/resident for 6 sessions. The cost decreased as the number of residents tested increased. To manage costs, testing more trainees by regional collaboration is recommended. Copyright © 2015 Elsevier Inc. All rights reserved.

Proceedings of the 1999 Oil and Gas Conference: Technology Options for Producer Survival

DOE Office of Scientific and Technical Information (OSTI.GOV)

None available

2000-04-12

The 1999 Oil & Gas Conference was cosponsored by the U.S. Department of Energy (DOE), Office of Fossil Energy, Federal Energy Technology Center (FETC) and National Petroleum Technology Office (NPTO) on June 28 to 30 in Dallas, Texas. The Oil & Gas Conference theme, Technology Options for Producer Survival, reflects the need for development and implementation of new technologies to ensure an affordable, reliable energy future. The conference was attended by nearly 250 representatives from industry, academia, national laboratories, DOE, and other Government agencies. Three preconference workshops (Downhole Separation Technologies: Is it Applicable for Your Operations, Exploring and developing Naturallymore » Fractured Low-Permeability Gas Reservoirs from the Rocky Mountains to the Austin Chalk, and Software Program Applications) were held. The conference agenda included an opening plenary session, three platform sessions (Sessions 2 and 3 were split into 2 concurrent topics), and a poster presentation reception. The platform session topics were Converting Your Resources Into Reserves (Sessions 1 and 2A), Clarifying Your Subsurface Vision (Session 2B), and High Performance, Cost Effective Drilling, Completion, Stimulation Technologies (Session 3B). In total, there were 5 opening speakers, 30 presenters, and 16 poster presentations.« less

Investigating univariate temporal patterns for intrinsic connectivity networks based on complexity and low-frequency oscillation: a test-retest reliability study.

PubMed

Wang, X; Jiao, Y; Tang, T; Wang, H; Lu, Z

2013-12-19

Intrinsic connectivity networks (ICNs) are composed of spatial components and time courses. The spatial components of ICNs were discovered with moderate-to-high reliability. So far as we know, few studies focused on the reliability of the temporal patterns for ICNs based their individual time courses. The goals of this study were twofold: to investigate the test-retest reliability of temporal patterns for ICNs, and to analyze these informative univariate metrics. Additionally, a correlation analysis was performed to enhance interpretability. Our study included three datasets: (a) short- and long-term scans, (b) multi-band echo-planar imaging (mEPI), and (c) eyes open or closed. Using dual regression, we obtained the time courses of ICNs for each subject. To produce temporal patterns for ICNs, we applied two categories of univariate metrics: network-wise complexity and network-wise low-frequency oscillation. Furthermore, we validated the test-retest reliability for each metric. The network-wise temporal patterns for most ICNs (especially for default mode network, DMN) exhibited moderate-to-high reliability and reproducibility under different scan conditions. Network-wise complexity for DMN exhibited fair reliability (ICC<0.5) based on eyes-closed sessions. Specially, our results supported that mEPI could be a useful method with high reliability and reproducibility. In addition, these temporal patterns were with physiological meanings, and certain temporal patterns were correlated to the node strength of the corresponding ICN. Overall, network-wise temporal patterns of ICNs were reliable and informative and could be complementary to spatial patterns of ICNs for further study. Copyright © 2013 IBRO. Published by Elsevier Ltd. All rights reserved.

INFLUENCES OF RESPONSE RATE AND DISTRIBUTION ON THE CALCULATION OF INTEROBSERVER RELIABILITY SCORES

PubMed Central

Rolider, Natalie U.; Iwata, Brian A.; Bullock, Christopher E.

2012-01-01

We examined the effects of several variations in response rate on the calculation of total, interval, exact-agreement, and proportional reliability indices. Trained observers recorded computer-generated data that appeared on a computer screen. In Study 1, target responses occurred at low, moderate, and high rates during separate sessions so that reliability results based on the four calculations could be compared across a range of values. Total reliability was uniformly high, interval reliability was spuriously high for high-rate responding, proportional reliability was somewhat lower for high-rate responding, and exact-agreement reliability was the lowest of the measures, especially for high-rate responding. In Study 2, we examined the separate effects of response rate per se, bursting, and end-of-interval responding. Response rate and bursting had little effect on reliability scores; however, the distribution of some responses at the end of intervals decreased interval reliability somewhat, proportional reliability noticeably, and exact-agreement reliability markedly. PMID:23322930

Automation-induced monitoring inefficiency: role of display location.

PubMed

Singh, I L; Molloy, R; Parasuraman, R

1997-01-01

Operators can be poor monitors of automation if they are engaged concurrently in other tasks. However, in previous studies of this phenomenon the automated task was always presented in the periphery, away from the primary manual tasks that were centrally displayed. In this study we examined whether centrally locating an automated task would boost monitoring performance during a flight-simulation task consisting of system monitoring, tracking and fuel resource management sub-tasks. Twelve nonpilot subjects were required to perform the tracking and fuel management tasks manually while watching the automated system monitoring task for occasional failures. The automation reliability was constant at 87.5% for six subjects and variable (alternating between 87.5% and 56.25%) for the other six subjects. Each subject completed four 30 min sessions over a period of 2 days. In each automation reliability condition the automation routine was disabled for the last 20 min of the fourth session in order to simulate catastrophic automation failure (0 % reliability). Monitoring for automation failure was inefficient when automation reliability was constant but not when it varied over time, replicating previous results. Furthermore, there was no evidence of resource or speed accuracy trade-off between tasks. Thus, automation-induced failures of monitoring cannot be prevented by centrally locating the automated task.

Automation-induced monitoring inefficiency: role of display location

NASA Technical Reports Server (NTRS)

Singh, I. L.; Molloy, R.; Parasuraman, R.

1997-01-01

Operators can be poor monitors of automation if they are engaged concurrently in other tasks. However, in previous studies of this phenomenon the automated task was always presented in the periphery, away from the primary manual tasks that were centrally displayed. In this study we examined whether centrally locating an automated task would boost monitoring performance during a flight-simulation task consisting of system monitoring, tracking and fuel resource management sub-tasks. Twelve nonpilot subjects were required to perform the tracking and fuel management tasks manually while watching the automated system monitoring task for occasional failures. The automation reliability was constant at 87.5% for six subjects and variable (alternating between 87.5% and 56.25%) for the other six subjects. Each subject completed four 30 min sessions over a period of 2 days. In each automation reliability condition the automation routine was disabled for the last 20 min of the fourth session in order to simulate catastrophic automation failure (0 % reliability). Monitoring for automation failure was inefficient when automation reliability was constant but not when it varied over time, replicating previous results. Furthermore, there was no evidence of resource or speed accuracy trade-off between tasks. Thus, automation-induced failures of monitoring cannot be prevented by centrally locating the automated task.

Ball-Sport Endurance and Sprint Test (BEAST90): validity and reliability of a 90-minute soccer performance test.

PubMed

Williams, Jeremy D; Abt, Grant; Kilding, Andrew E

2010-12-01

The aim of this study was to determine the validity and reliability of a 90-minute soccer performance test: Ball-sport Endurance and Sprint Test (BEAST90). Fifteen healthy male amateur soccer players participated and attended 5 testing sessions over a 10-day period to perform physiologic and soccer-specific assessments. This included familiarization sessions and 2 full trials of the BEAST90, separated by 7 days. The total 90-minute distance, mean percent peak heart rate (HRpeak), and estimated percent peak oxygen uptake of the BEAST90 were 8,097 ± 458 m, 85 ± 5% and 82 ± 14%, respectively. Measures obtained from trial 1 and trial 2 were not significantly different (p > 0.05). Reliability of measures over 90 minutes ranged from 0.9-25.5% (% typical error). The BEAST90 protocol replicated soccer match play in terms of time, movement patterns, physical demands (volume and intensity), distances, and mean and HRpeak values, as well as having an aerobic load similar to that observed during a soccer match. Reproducibility of key physical measures during the BEAST90 were mostly high, suggesting good reliability. The BEAST90 could be used in studies that wish to determine the effects of training or nutritional interventions on prolonged intermittent physical performance.

Reliability of near-infrared spectroscopy for measuring biceps brachii oxygenation during sustained and repeated isometric contractions.

PubMed

Muthalib, Makii; Millet, Guillaume Y; Quaresima, Valentina; Nosaka, Kazunori

2010-01-01

We examine the test-retest reliability of biceps brachii tissue oxygenation index (TOI) parameters measured by near-infrared spectroscopy during a 10-s sustained and a 30-repeated (1-s contraction, 1-s relaxation) isometric contraction task at 30% of maximal voluntary contraction (30% MVC) and maximal (100% MVC) intensities. Eight healthy men (23 to 33 yr) were tested on three sessions separated by 3 h and 24 h, and the within-subject reliability of torque and each TOI parameter were determined by Bland-Altman+/-2 SD limits of agreement plots and coefficient of variation (CV). No significant (P>0.05) differences between the three sessions were found for mean values of torque and TOI parameters during the sustained and repeated tasks at both contraction intensities. All TOI parameters were within+/-2 SD limits of agreement. The CVs for torque integral were similar between the sustained and repeated task at both intensities (4 to 7%); however, the CVs for TOI parameters during the sustained and repeated task were lower for 100% MVC (7 to 11%) than for 30% MVC (22 to 36%). It is concluded that the reliability of the biceps brachii NIRS parameters during both sustained and repeated isometric contraction tasks is acceptable.

The Development of the Cleft Aesthetic Rating Scale: A New Rating Scale for the Assessment of Nasolabial Appearance in Complete Unilateral Cleft Lip and Palate Patients.

PubMed

Mosmuller, David G M; Mennes, Lisette M; Prahl, Charlotte; Kramer, Gem J C; Disse, Melissa A; van Couwelaar, Gijs M; Niessen, Frank B; Griot, J P W Don

2017-09-01

  The development of the Cleft Aesthetic Rating Scale, a simple and reliable photographic reference scale for the assessment of nasolabial appearance in complete unilateral cleft lip and palate patients.   A blind retrospective analysis of photographs of cleft lip and palate patients was performed with this new rating scale.   VU Medical Center Amsterdam and the Academic Center for Dentistry of Amsterdam.   Complete unilateral cleft lip and palate patients at the age of 6 years.   Photographs that showed the highest interobserver agreement in earlier assessments were selected for the photographic reference scale. Rules were attached to the rating scale to provide a guideline for the assessment and improve interobserver reliability. Cropped photographs revealing only the nasolabial area were assessed by six observers using this new Cleft Aesthetic Rating Scale in two different sessions.   Photographs of 62 children (6 years of age, 44 boys and 18 girls) were assessed. The interobserver reliability for the nose and lip together was 0.62, obtained with the intraclass correlation coefficient. To measure the internal consistency, a Cronbach alpha of .91 was calculated. The estimated reliability for three observers was .84, obtained with the Spearman Brown formula.   A new, easy to use, and reliable scoring system with a photographic reference scale is presented in this study.

Reproducibility of skeletal muscle vasodilatation responses to Stroop mental challenge over repeated sessions.

PubMed

Hamer, Mark; Boutcher, Yati N; Park, Young; Boutcher, Stephen H

2006-08-01

Skeletal muscle blood flow responses to stress have implications for psychobiological disease pathways. An important assumption underlying psychophysiological studies relating stress reactivity with disease risk is that individuals are characterized by stable response profiles that can be reliably assessed using acute psychophysiological stress testing. We examined the reproducibility of forearm vasodilatation, blood pressure, and cardiac responses to a 2 min Stroop mental challenge over two repeated stress sessions that were on average 3.6 months apart. Participants were 21 healthy men and women (aged 21.8+/-3.7 years). Vasodilatation, blood pressure and heart rate responses displayed no habituation between sessions, although there was significantly greater cardiac parasympathetic involvement during the second testing session. Significant test-retest correlations between the sessions were observed for both forearm blood flow and heart rate reactivity. These findings demonstrate skeletal muscle vasodilatation responses to repeated stress are robust, so may be a useful psychophysiological indicator in studies of stress reactivity and disease risk.

Feasibility and reliability of using an exoskeleton to emulate muscle contractures during walking.

PubMed

Attias, M; Bonnefoy-Mazure, A; De Coulon, G; Cheze, L; Armand, S

2016-10-01

Contracture is a permanent shortening of the muscle-tendon-ligament complex that limits joint mobility. Contracture is involved in many diseases (cerebral palsy, stroke, etc.) and can impair walking and other activities of daily living. The purpose of this study was to quantify the reliability of an exoskeleton designed to emulate lower limb muscle contractures unilaterally and bilaterally during walking. An exoskeleton was built according to the following design criteria: adjustable to different morphologies; respect of the principal lines of muscular actions; placement of reflective markers on anatomical landmarks; and the ability to replicate the contractures of eight muscles of the lower limb unilaterally and bilaterally (psoas, rectus femoris, hamstring, hip adductors, gastrocnemius, soleus, tibialis posterior, and peroneus). Sixteen combinations of contractures were emulated on the unilateral and bilateral muscles of nine healthy participants. Two sessions of gait analysis were performed at weekly intervals to assess the reliability of the emulated contractures. Discrete variables were extracted from the kinematics to analyse the reliability. The exoskeleton did not affect normal walking when contractures were not emulated. Kinematic reliability varied from poor to excellent depending on the targeted muscle. Reliability was good for the bilateral and unilateral gastrocnemius, soleus, and tibialis posterior as well as the bilateral hamstring and unilateral hip adductors. The exoskeleton can be used to replicate contracture on healthy participants. The exoskeleton will allow us to differentiate primary and compensatory effects of muscle contractures on gait kinematics. Copyright © 2016 Elsevier B.V. All rights reserved.

Generalizability and decision studies to inform observational and experimental research in classroom settings.

PubMed

Bottema-Beutel, Kristen; Lloyd, Blair; Carter, Erik W; Asmus, Jennifer M

2014-11-01

Attaining reliable estimates of observational measures can be challenging in school and classroom settings, as behavior can be influenced by multiple contextual factors. Generalizability (G) studies can enable researchers to estimate the reliability of observational data, and decision (D) studies can inform how many observation sessions are necessary to achieve a criterion level of reliability. We conducted G and D studies using observational data from a randomized control trial focusing on social and academic participation of students with severe disabilities in inclusive secondary classrooms. Results highlight the importance of anchoring observational decisions to reliability estimates from existing or pilot data sets. We outline steps for conducting G and D studies and address options when reliability estimates are lower than desired.

An Experimental Study of Procedures to Enhance Ratings of Fidelity to an Evidence-Based Family Intervention.

PubMed

Smith, Justin D; Dishion, Thomas J; Brown, Kimbree; Ramos, Karina; Knoble, Naomi B; Shaw, Daniel S; Wilson, Melvin N

2016-01-01

The valid and reliable assessment of fidelity is critical at all stages of intervention research and is particularly germane to interpreting the results of efficacy and implementation trials. Ratings of protocol adherence typically are reliable, but ratings of therapist competence are plagued by low reliability. Because family context and case conceptualization guide the therapist's delivery of interventions, the reliability of fidelity ratings might be improved if the coder is privy to client context in the form of an ecological assessment. We conducted a randomized experiment to test this hypothesis. A subsample of 46 families with 5-year-old children from a multisite randomized trial who participated in the feedback session of the Family Check-Up (FCU) intervention were selected. We randomly assigned FCU feedback sessions to be rated for fidelity to the protocol using the COACH rating system either after the coder reviewed the results of a recent ecological assessment or had not. Inter-rater reliability estimates of fidelity ratings were meaningfully higher for the assessment information condition compared to the no-information condition. Importantly, the reliability of the COACH mean score was found to be statistically significantly higher in the information condition. These findings suggest that the reliability of observational ratings of fidelity, particularly when the competence or quality of delivery is considered, could be improved by providing assessment data to the coders. Our findings might be most applicable to assessment-driven interventions, where assessment data explicitly guides therapist's selection of intervention strategies tailored to the family's context and needs, but they could also apply to other intervention programs and observational coding of context-dependent therapy processes, such as the working alliance.

An Experimental Study of Procedures to Enhance Ratings of Fidelity to an Evidence-Based Family Intervention

PubMed Central

Smith, Justin D.; Dishion, Thomas J.; Brown, Kimbree; Ramos, Karina; Knoble, Naomi B.; Shaw, Daniel S.; Wilson, Melvin N.

2015-01-01

The valid and reliable assessment of fidelity is critical at all stages of intervention research and is particularly germane to interpreting the results of efficacy and implementation trials. Ratings of protocol adherence typically are reliable, but ratings of therapist competence are plagued by low reliability. Because family context and case conceptualization guide the therapist's delivery of interventions, the reliability of fidelity ratings might be improved if the coder is privy to client context in the form of an ecological assessment. We conducted a randomized experiment to test this hypothesis. A subsample of 46 families with 5-year-old children from a multisite randomized trial who participated in the feedback session of the Family Check-Up (FCU) intervention were selected. We randomly assigned FCU feedback sessions to be rated for fidelity to the protocol using the COACH rating system either after the coder reviewed the results of a recent ecological assessment or had not. Inter-rater reliability estimates of fidelity ratings were meaningfully higher for the assessment information condition compared to the no-information condition. Importantly, the reliability of the COACH mean score was found to be statistically significantly higher in the information condition. These findings suggest that the reliability of observational ratings of fidelity, particularly when the competence or quality of delivery is considered, could be improved by providing assessment data to the coders. Our findings might be most applicable to assessment-driven interventions, where assessment data explicitly guides therapist's selection of intervention strategies tailored to the family's context and needs, but they could also apply to other intervention programs and observational coding of context-dependent therapy processes, such as the working alliance. PMID:26271300

Reliability of new software in measuring cervical multifidus diameters and shoulder muscle strength in a synchronized way; an ultrasonographic study

PubMed Central

Rahnama, Leila; Rezasoltani, Asghar; Khalkhali-Zavieh, Minoo; Rahnama, Behnam; Noori-Kochi, Farhang

2015-01-01

OBJECTIVES: This study was conducted with the purpose of evaluating the inter-session reliability of new software to measure the diameters of the cervical multifidus muscle (CMM), both at rest and during isometric contractions of the shoulder abductors in subjects with neck pain and in healthy individuals. METHOD: In the present study, the reliability of measuring the diameters of the CMM with the Sonosynch software was evaluated by using 24 participants, including 12 subjects with chronic neck pain and 12 healthy individuals. The anterior-posterior diameter (APD) and the lateral diameter (LD) of the CMM were measured in a resting state and then repeated during isometric contraction of the shoulder abductors. Measurements were taken on separate occasions 3 to 7 days apart in order to determine inter-session reliability. Intraclass correlation coefficient (ICC), standard error of measurement (SEM), and smallest detectable difference (SDD) were used to evaluate the relative and absolute reliability, respectively. RESULTS: The Sonosynch software has shown to be highly reliable in measuring the diameters of the CMM both in healthy subjects and in those with neck pain. The ICCs 95% CI for APD ranged from 0.84 to 0.94 in subjects with neck pain and from 0.86 to 0.94 in healthy subjects. For LD, the ICC 95% CI ranged from 0.64 to 0.95 in subjects with neck pain and from 0.82 to 0.92 in healthy subjects. CONCLUSIONS: Ultrasonographic measurement of the diameters of the CMM using Sonosynch has proved to be reliable especially for APD in healthy subjects as well as subjects with neck pain. PMID:26443975

Intrarater reliability of goniometry and hand-held dynamometry for shoulder and elbow examinations in female team handball athletes and asymptomatic volunteers.

PubMed

Fieseler, Georg; Molitor, Thomas; Irlenbusch, Lars; Delank, Karl-Stefan; Laudner, Kevin G; Hermassi, Souhail; Schwesig, Rene

2015-12-01

To evaluate the intrarater reliability for examining active range of motion (ROM) and isometric strength of the shoulder and elbow among asymptomatic female team handball athletes and a control group using a manual goniometer and hand-held dynamometry (HHD). 22 female team handball athletes (age: 21.0 ± 3.7 years) and 25 volunteers (13 female, 12 male, age: 21.9 ± 1.24 years) participated to determine bilateral ROM for shoulder rotation and elbow flexion/extension, as well as isometric shoulder rotation and elbow flexion/extension strength. Subjects were assessed on two separate test sessions with 7 days between sessions. Relative (intraclass correlation coefficients (ICC) and standard error of measurement (SEM) reliability were calculated. Reliability for ROM and strength were good to excellent for both shoulders and groups (athletes: ICC = 0.94-0.97, SEM 1.07°-4.76 N, controls: ICC = 0.96-1.00, SEM = 0.00 N-4.48 N). Elbow measurements for both groups also showed good-to-excellent reliability (athletes: ICC = 0.79-0.97, SEM = 0.98°-5.94 N, controls: ICC = 0.87-1.00, SEM = 0.00 N-5.43 N). It is important to be able to reliably reproduce active ROM and isometric strength evaluations. Using a standardized testing position, goniometry and HHD are reliable instruments in the assessment of shoulder and elbow joint performance testing. We showed good-to-excellent reproducible results for male and female control subjects and female handball athletes, although the single parameters in ROM and strength were different for each group and between the shoulders and elbows.

Reliability of a quantitative clinical posture assessment tool among persons with idiopathic scoliosis.

PubMed

Fortin, Carole; Feldman, Debbie Ehrmann; Cheriet, Farida; Gravel, Denis; Gauthier, Frédérique; Labelle, Hubert

2012-03-01

To determine overall, test-retest and inter-rater reliability of posture indices among persons with idiopathic scoliosis. A reliability study using two raters and two test sessions. Tertiary care paediatric centre. Seventy participants aged between 10 and 20 years with different types of idiopathic scoliosis (Cobb angle 15 to 60°) were recruited from the scoliosis clinic. Based on the XY co-ordinates of natural reference points (e.g., eyes) as well as markers placed on several anatomical landmarks, 32 angular and linear posture indices taken from digital photographs in the standing position were calculated from a specially developed software program. Generalisability theory served to estimate the reliability and standard error of measurement (SEM) for the overall, test-retest and inter-rater designs. Bland and Altman's method was also used to document agreement between sessions and raters. In the random design, dependability coefficients demonstrated a moderate level of reliability for six posture indices (ϕ=0.51 to 0.72) and a good level of reliability for 26 posture indices out of 32 (ϕ≥0.79). Error attributable to marker placement was negligible for most indices. Limits of agreement and SEM values were larger for shoulder protraction, trunk list, Q angle, cervical lordosis and scoliosis angles. The most reproducible indices were waist angles and knee valgus and varus. Posture can be assessed in a global fashion from photographs in persons with idiopathic scoliosis. Despite the good reliability of marker placement, other studies are needed to minimise measurement errors in order to provide a suitable tool for monitoring change in posture over time. Copyright © 2011 Chartered Society of Physiotherapy. Published by Elsevier Ltd. All rights reserved.

Regular Formal Evaluation Sessions are Effective as Frame-of-Reference Training for Faculty Evaluators of Clerkship Medical Students.

PubMed

Hemmer, Paul A; Dadekian, Gregory A; Terndrup, Christopher; Pangaro, Louis N; Weisbrod, Allison B; Corriere, Mark D; Rodriguez, Rechell; Short, Patricia; Kelly, William F

2015-09-01

Face-to-face formal evaluation sessions between clerkship directors and faculty can facilitate the collection of trainee performance data and provide frame-of-reference training for faculty. We hypothesized that ambulatory faculty who attended evaluation sessions at least once in an academic year (attendees) would use the Reporter-Interpreter-Manager/Educator (RIME) terminology more appropriately than faculty who did not attend evaluation sessions (non-attendees). Investigators conducted a retrospective cohort study using the narrative assessments of ambulatory internal medicine clerkship students during the 2008-2009 academic year. The study included assessments of 49 clerkship medical students, which comprised 293 individual teacher narratives. Single-teacher written and transcribed verbal comments about student performance were masked and reviewed by a panel of experts who, by consensus, (1) determined whether RIME was used, (2) counted the number of RIME utterances, and (3) assigned a grade based on the comments. Analysis included descriptive statistics and Pearson correlation coefficients. The authors reviewed 293 individual teacher narratives regarding the performance of 49 students. Attendees explicitly used RIME more frequently than non-attendees (69.8 vs. 40.4 %; p < 0.0001). Grades recommended by attendees correlated more strongly with grades assigned by experts than grades recommended by non-attendees (r = 0.72; 95 % CI (0.65, 0.78) vs. 0.47; 95 % CI (0.26, 0.64); p = 0.005). Grade recommendations from individual attendees and non-attendees each correlated significantly with overall student clerkship clinical performance [r = 0.63; 95 % CI (0.54, 0.71) vs. 0.52 (0.36, 0.66), respectively], although the difference between the groups was not statistically significant (p = 0.21). On an ambulatory clerkship, teachers who attended evaluation sessions used RIME terminology more frequently and provided more accurate grade recommendations than teachers who did not attend. Formal evaluation sessions may provide frame-of-reference training for the RIME framework, a method that improves the validity and reliability of workplace assessment.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Berry, Max; Lystig, Ted; Beard, Jonathan

Purpose. To compare the learning of endovascular interventional skills by training on pig models versus virtual reality simulators. Methods. Twelve endovascular novices participated in a study consisting of a pig laboratory (P-Lab) and a virtual reality laboratory (VR-Lab). Subjects were stratified by experience and randomized into four training groups. Following 1 hr of didactic instruction, all attempted an iliac artery stenosis (IAS) revascularization in both laboratories. Onsite proctors evaluated performances using task-specific checklists and global rating scales, yielding a Total Score. Participants completed two training sessions of 3 hr each, using their group's assigned method (P-Lab x 2, P-Lab +more » VR-Lab, VR-Lab + P-Lab, or VR-Lab x 2) and were re-evaluated in both laboratories. A panel of two highly experienced interventional radiologists performed assessments from video recordings. ANCOVA analysis of Total Score against years of surgical, interventional radiology (IR) experience and cumulative number of P-Lab or VR-Lab sessions was conducted. Inter-rater reliability (IRR) was determined by comparing proctored scores with the video assessors in only the VR-Lab. Results. VR-Lab sessions improved the VR-Lab Total Score ({beta} 3.029, p = 0.0015) and P-Lab Total Score ({beta} = 1.814, p = 0.0452). P-Lab sessions increased the P-Lab Total Score ({beta} = 4.074, p < 0.0001) but had no effect on the VR-Lab Total Score. In the general statistical model, both P-Lab sessions ({beta} = 2.552, p = 0.0010) and VR-Lab sessions ({beta} 2.435, p = 0.0032) significantly improved Total Score. Neither previous surgical experience nor IR experience predicted Total Score. VR-Lab scores were consistently higher than the P-Lab scores ({delta} = 6.659, p < 0.0001). VR-Lab IRR was substantial (r = 0.649, p < 0.0008). Conclusions. Endovascular skills learned in the virtual environment may be transferable to the real catheterization laboratory as modeled in the P-Lab.« less

Development and Validation of a Photonumeric Scale for Assessment of Chin Retrusion.

PubMed

Sykes, Jonathan M; Carruthers, Alastair; Hardas, Bhushan; Murphy, Diane K; Jones, Derek; Carruthers, Jean; Donofrio, Lisa; Creutz, Lela; Marx, Ann; Dill, Sara

2016-10-01

A validated scale is needed for objective and reproducible comparisons of chin appearance before and after chin augmentation in practice and clinical studies. To describe the development and validation of the 5-point photonumeric Allergan Chin Retrusion Scale. The Allergan Chin Retrusion Scale was developed to include an assessment guide, verbal descriptors, morphed images, and real subject images for each scale grade. The clinical significance of a 1-point score difference was evaluated in a review of multiple image pairs representing varying differences in severity. Interrater and intrarater reliability was evaluated in a live-subject validation study (N = 298) completed during 2 sessions occurring 3 weeks apart. A difference of ≥1 point on the scale was shown to reflect a clinically meaningful difference (mean [95% confidence interval] absolute score difference, 1.07 [0.94-1.20] for clinically different image pairs and 0.51 [0.39-0.63] for not clinically different pairs). Intrarater agreement between the 2 live-subject validation sessions was substantial (mean weighted kappa = 0.79). Interrater agreement was substantial during the second rating session (0.68, primary end point). The Allergan Chin Retrusion Scale is a validated and reliable scale for physician rating of severity of chin retrusion.

Development of a New VLBI Data Analysis Software

NASA Technical Reports Server (NTRS)

Bolotin, Sergei; Gipson, John M.; MacMillan, Daniel S.

2010-01-01

We present an overview of a new VLBI analysis software under development at NASA GSFC. The new software will replace CALC/SOLVE and many related utility programs. It will have the capabilities of the current system as well as incorporate new models and data analysis techniques. In this paper we give a conceptual overview of the new software. We formulate the main goals of the software. The software should be flexible and modular to implement models and estimation techniques that currently exist or will appear in future. On the other hand it should be reliable and possess production quality for processing standard VLBI sessions. Also, it needs to be capable of processing observations from a fully deployed network of VLBI2010 stations in a reasonable time. We describe the software development process and outline the software architecture.

Enhancing recovery rates: lessons from year one of IAPT.

PubMed

Gyani, Alex; Shafran, Roz; Layard, Richard; Clark, David M

2013-09-01

The English Improving Access to Psychological Therapies (IAPT) initiative aims to make evidence-based psychological therapies for depression and anxiety disorder more widely available in the National Health Service (NHS). 32 IAPT services based on a stepped care model were established in the first year of the programme. We report on the reliable recovery rates achieved by patients treated in the services and identify predictors of recovery at patient level, service level, and as a function of compliance with National Institute of Health and Care Excellence (NICE) Treatment Guidelines. Data from 19,395 patients who were clinical cases at intake, attended at least two sessions, had at least two outcomes scores and had completed their treatment during the period were analysed. Outcome was assessed with the patient health questionnaire depression scale (PHQ-9) and the anxiety scale (GAD-7). Data completeness was high for a routine cohort study. Over 91% of treated patients had paired (pre-post) outcome scores. Overall, 40.3% of patients were reliably recovered at post-treatment, 63.7% showed reliable improvement and 6.6% showed reliable deterioration. Most patients received treatments that were recommended by NICE. When a treatment not recommended by NICE was provided, recovery rates were reduced. Service characteristics that predicted higher reliable recovery rates were: high average number of therapy sessions; higher step-up rates among individuals who started with low intensity treatment; larger services; and a larger proportion of experienced staff. Compliance with the IAPT clinical model is associated with enhanced rates of reliable recovery. Copyright © 2013 The Authors. Published by Elsevier Ltd.. All rights reserved.

Test-retest reliability of jump execution variables using mechanography: a comparison of jump protocols.

PubMed

Fitzgerald, John S; Johnson, LuAnn; Tomkinson, Grant; Stein, Jesse; Roemmich, James N

2018-05-01

Mechanography during the vertical jump may enhance screening and determining mechanistic causes underlying physical performance changes. Utility of jump mechanography for evaluation is limited by scant test-retest reliability data on force-time variables. This study examined the test-retest reliability of eight jump execution variables assessed from mechanography. Thirty-two women (mean±SD: age 20.8 ± 1.3 yr) and 16 men (age 22.1 ± 1.9 yr) attended a familiarization session and two testing sessions, all one week apart. Participants performed two variations of the squat jump with squat depth self-selected and controlled using a goniometer to 80º knee flexion. Test-retest reliability was quantified as the systematic error (using effect size between jumps), random error (using coefficients of variation), and test-retest correlations (using intra-class correlation coefficients). Overall, jump execution variables demonstrated acceptable reliability, evidenced by small systematic errors (mean±95%CI: 0.2 ± 0.07), moderate random errors (mean±95%CI: 17.8 ± 3.7%), and very strong test-retest correlations (range: 0.73-0.97). Differences in random errors between controlled and self-selected protocols were negligible (mean±95%CI: 1.3 ± 2.3%). Jump execution variables demonstrated acceptable reliability, with no meaningful differences between the controlled and self-selected jump protocols. To simplify testing, a self-selected jump protocol can be used to assess force-time variables with negligible impact on measurement error.

Accuracy and Reliability of Marker-Based Approaches to Scale the Pelvis, Thigh, and Shank Segments in Musculoskeletal Models.

PubMed

Kainz, Hans; Hoang, Hoa X; Stockton, Chris; Boyd, Roslyn R; Lloyd, David G; Carty, Christopher P

2017-10-01

Gait analysis together with musculoskeletal modeling is widely used for research. In the absence of medical images, surface marker locations are used to scale a generic model to the individual's anthropometry. Studies evaluating the accuracy and reliability of different scaling approaches in a pediatric and/or clinical population have not yet been conducted and, therefore, formed the aim of this study. Magnetic resonance images (MRI) and motion capture data were collected from 12 participants with cerebral palsy and 6 typically developed participants. Accuracy was assessed by comparing the scaled model's segment measures to the corresponding MRI measures, whereas reliability was assessed by comparing the model's segments scaled with the experimental marker locations from the first and second motion capture session. The inclusion of joint centers into the scaling process significantly increased the accuracy of thigh and shank segment length estimates compared to scaling with markers alone. Pelvis scaling approaches which included the pelvis depth measure led to the highest errors compared to the MRI measures. Reliability was similar between scaling approaches with mean ICC of 0.97. The pelvis should be scaled using pelvic width and height and the thigh and shank segment should be scaled using the proximal and distal joint centers.

Intrarater test-retest reliability of static and dynamic stability indexes measurement using the Biodex Stability System during unilateral stance.

PubMed

Arifin, Nooranida; Abu Osman, Noor Azuan; Wan Abas, Wan Abu Bakar

2014-04-01

The measurements of postural balance often involve measurement error, which affects the analysis and interpretation of the outcomes. In most of the existing clinical rehabilitation research, the ability to produce reliable measures is a prerequisite for an accurate assessment of an intervention after a period of time. Although clinical balance assessment has been performed in previous study, none has determined the intrarater test-retest reliability of static and dynamic stability indexes during dominant single stance. In this study, one rater examined 20 healthy university students (female=12, male=8) in two sessions separated by 7 day intervals. Three stability indexes--the overall stability index (OSI), anterior/posterior stability index (APSI), and medial/ lateral stability index (MLSI) in static and dynamic conditions--were measured during single dominant stance. Intraclass correlation coefficient (ICC), standard error measurement (SEM) and 95% confidence interval (95% CI) were calculated. Test-retest ICCs for OSI, APSI, and MLSI were 0.85, 0.78, and 0.84 during static condition and were 0.77, 0.77, and 0.65 during dynamic condition, respectively. We concluded that the postural stability assessment using Biodex stability system demonstrates good-to-excellent test-retest reliability over a 1 week time interval.

COVD-QOL questionnaire: An adaptation for school vision screening using Rasch analysis

PubMed Central

Abu Bakar, Nurul Farhana; Ai Hong, Chen; Pik Pin, Goh

2012-01-01

Purpose To adapt the College of Optometrist in Vision Development (COVD-QOL) questionnaire as a vision screening tool for primary school children. Methods An interview session was conducted with children, teachers or guardians regarding visual symptoms of 88 children (45 from special education classes and 43 from mainstream classes) in government primary schools. Data was assessed for response categories, fit items (infit/outfit: 0.6–1.4) and separation reliability (item/person: 0.80). The COVD-QOL questionnaire results were compared with vision assessment in identifying three categories of vision disorders: reduce visual acuity, accommodative response anomaly and convergence insufficiency. Analysis on the screening performance using the simplified version of the questionnaire was evaluated based on receiver-operating characteristic analysis for detection of any type of target conditions for both types of classes. Predictive validity analysis was used a Spearman rank correlation (>0.3). Results Two of the response categories were underutilized and therefore collapsed to the adjacent category and items were reduced to 14. Item separation reliability for the simplified version of the questionnaire was acceptable (0.86) but the person separation reliability was inadequate for special education classes (0.79) similar to mainstream classes (0.78). The discriminant cut-off score of 9 (mainstream classes) and 3 (special education classes) from the 14 items provided sensitivity and specificity of (65% and 54%) and (78% and 80%) with Spearman rank correlation of 0.16 and 0.40 respectively. Conclusion The simplified version of COVD-QOL questionnaire (14-items) performs adequately among children in special education classes suggesting its suitability as a vision screening tool.

The effectiveness of session rating of perceived exertion to monitor resistance training load in acute burns patients.

PubMed

Grisbrook, Tiffany L; Gittings, Paul M; Wood, Fiona M; Edgar, Dale W

2017-02-01

Session-rating of perceived exertion (RPE) is a method frequently utilised in exercise and sports science to quantify training load of an entire aerobic exercise session. It has also been demonstrated that session-RPE is a valid and reliable method to quantify training load during resistance exercise, in healthy and athletic populations. This study aimed to investigate the effectiveness of session-RPE as a method to quantify exercise intensity during resistance training in patients with acute burns. Twenty burns patients (mean age=31.65 (±10.09) years), with a mean TBSA of 16.4% (range=6-40%) were recruited for this study. Patients were randomly allocated to the resistance training (n=10) or control group (n=10). All patients completed a four week resistance training programme. Training load (session-RPE×session duration), resistance training session-volume and pre-exercise pain were recorded for each exercise session. The influence of; age, gender, %TBSA, exercise group (resistance training vs. control), pre-exercise pain, resistance training history and session-volume on training load were analysed using a multilevel mixed-effects linear regression. Session-volume did not influence training load in the final regression model, however training load was significantly greater in the resistance training group, compared with the control group (p<0.001). Pre-exercise pain significantly influenced training load, where increasing pain was associated with a higher session-RPE (p=0.004). Further research is indicated to determine the exact relationship between pain, resistance training history, exercise intensity and session-RPE and training load before it can be used as a method to monitor and prescribe resistance training load in acute burns patients. Copyright © 2016 Elsevier Ltd and ISBI. All rights reserved.

Couple Treatment for Alcohol Use Disorder and Posttraumatic Stress Disorder: Pilot Results From U.S. Military Veterans and Their Partners.

PubMed

Schumm, Jeremiah A; Monson, Candice M; O'Farrell, Timothy J; Gustin, Nancy G; Chard, Kathleen M

2015-06-01

We studied 13 U.S. male military veterans and their female partners who consented to participate in an uncontrolled trial of couple treatment for alcohol use disorder and posttraumatic stress disorder (CTAP). CTAP is a 15-session, manualized therapy, integrating behavioral couples therapy for alcohol use disorder (AUD) with cognitive-behavioral conjoint therapy for posttraumatic stress disorder (PTSD). Due to ineligibility (n = 1) and attrition (n = 3), 9 couples completed the study, and 7 completed 12 or more sessions. There were 8 veterans who showed clinically reliable pre- to posttreatment reduction of PTSD outcomes. There were also significant group-level reductions in clinician-, veteran-, and partner-rated PTSD symptoms (d = 0.94 to 1.71). Most veterans showed clinically reliable reductions in percentage days of heavy drinking. Group-level reduction in veterans' percentage days of heavy drinking was significant (d = 1.01). There were 4 veterans and 3 partners with clinically reliable reductions in depression, and group-level change was significant for veterans (d = 0.93) and partners (d = 1.06). On relationship satisfaction, 3 veterans and 4 partners had reliable improvements, and 2 veterans and 1 partner had reliable deterioration. Group-level findings were nonsignificant for veteran relationship satisfaction (d = 0.26) and for partners (d = 0.52). These findings indicate that CTAP may be a promising intervention for individuals with comorbid PTSD and AUD who have relationship partners. Copyright © 2015 Wiley Periodicals, Inc., A Wiley Company.

Proceedings of the Third NRC/ASME Symposium on Valve and Pump Testing. Session 1A--Session 2C: Volume 1

DOE Office of Scientific and Technical Information (OSTI.GOV)

Not Available

1994-07-01

The 1994 Symposium on Valve and Pump Testing, jointly sponsored by the Board of Nuclear Codes and Standards of the American Society of Mechanical Engineers and by the Nuclear Regulatory Commission, provides a forum for the discussion of current programs and methods for inservice testing and motor-operated valve testing at nuclear power plants. The symposium also provides an opportunity to discuss the need to improve that testing in order to help ensure the reliable performance of pumps and valves. The participation of industry representatives, regulators, and consultants results in the discussion of a broad spectrum of ideas and perspectives regardingmore » the improvement of inservice testing of pumps and valves at nuclear power plants. This document, Volume 1, covers sessions 1A through session 2C. The individual papers have been cataloged separately.« less

The effects of single-session music therapy interventions on the observed and self-reported levels of pain control, physical comfort, and relaxation of hospice patients.

PubMed

Krout, R E

2001-01-01

This article describes the process and results of a three-month music therapy clinical effectiveness study conducted with terminally ill patients. The purpose of this study was to quantify and evaluate the effectiveness of single-session music therapy interventions with hospice patients in three patient problem areas: pain control; physical comfort; and relaxation. Data from a total of 90 sessions conducted with a total of 80 subjects served by Hospice of Palm Beach County, Florida, were included in the study. Music therapy services were provided by five board-certified music therapists and one music therapist eligible for board certification. The subjects in this study were receiving regularly scheduled music therapy services from the hospice organization. The study used both behavioral observation and subject's self-reporting as methods of data reporting and recording. Subjects were observed for, or self-reported, their levels of pain control, physical comfort, and relaxation, both before and after each music therapy session. The subjects were served in the environments where music therapy services would normally be delivered (i.e., home, hospital, nursing home, or inpatient acute-care unit of the hospice organization). Music therapy services included live active and passive music-based experiences. These were designed to build and to establish rapport with patient or family, to facilitate family interaction and patient control, to provide support and comfort, to facilitate relaxation, to enable reminiscence and life review, to provide a frame-work for spiritual exploration and validation, and to encourage the identification and expression of feelings of anticipatory mourning and grief. A total of six hypotheses stated that there would be significant pre- to postsession differences in each of the three variables: pain control, physical comfort, and relaxation, as measured during two different session and data collection scenarios. These scenarios included the independent observation and recording of the three subject variables and the subject's self-report of each variable. Reliability correlation coefficients were calculated for each of the different session and data-collection scenarios to help assess the correlation between primary and reliability observers. Pearson product moment correlations indicated reliability agreement coefficients of r = .85 and r = .90. One-tailed t-tests were performed on the collected data for subject pain control, physical comfort, and relaxation. Results of the t-tests were significant at the p < or = .001 (for observed pain control, physical comfort, and relaxation) and p < or = 005 (for self-reported pain control, physical comfort, and relaxation) levels. These results suggest that single-session music therapy interventions appear to be effective in increasing subject pain control, physical comfort, and relaxation during both data collection scenarios. Based on the results of these tests of the analyzed data, the hypotheses were all accepted. Tables illustrate pre- to post-session changes in levels of all three variables from both session and data-collection scenarios. Copies of the data-collection forms are also included in the Appendix. The discussion section addresses limitations of this study and suggestions for future studies.

Measuring homework completion in behavioral activation.

PubMed

Busch, Andrew M; Uebelacker, Lisa A; Kalibatseva, Zornitsa; Miller, Ivan W

2010-07-01

The aim of this study was to develop and validate an observer-based coding system for the characterization and completion of homework assignments during Behavioral Activation (BA). Existing measures of homework completion are generally unsophisticated, and there is no current measure of homework completion designed to capture the particularities of BA. The tested scale sought to capture the type of assignment, realm of functioning targeted, extent of completion, and assignment difficulty. Homework assignments were drawn from 12 (mean age = 48, 83% female) clients in two trials of a 10-session BA manual targeting treatment-resistant depression in primary care. The two coders demonstrated acceptable or better reliability on most codes, and unreliable codes were dropped from the proposed scale. In addition, correlations between homework completion and outcome were strong, providing some support for construct validity. Ultimately, this line of research aims to develop a user-friendly, reliable measure of BA homework completion that can be completed by a therapist during session.

Photovoltaic Performance and Reliability Workshop summary

NASA Astrophysics Data System (ADS)

Kroposki, Benjamin

1997-02-01

The objective of the Photovoltaic Performance and Reliability Workshop was to provide a forum where the entire photovoltaic (PV) community (manufacturers, researchers, system designers, and customers) could get together and discuss technical issues relating to PV. The workshop included presentations from twenty-five speakers and had more than one hundred attendees. This workshop also included several open sessions in which the audience and speakers could discuss technical subjects in depth. Several major topics were discussed including: PV characterization and measurements, service lifetimes for PV devices, degradation and failure mechanisms for PV devices, standardization of testing procedures, AC module performance and reliability testing, inverter performance and reliability testing, standardization of utility interconnect requirements, experience from field deployed systems, and system certification.

Quantitative Review Finds No Evidence of Cognitive Effects in Healthy Populations From Single-session Transcranial Direct Current Stimulation (tDCS).

PubMed

Horvath, Jared Cooney; Forte, Jason D; Carter, Olivia

2015-01-01

Over the last 15-years, transcranial direct current stimulation (tDCS), a relatively novel form of neuromodulation, has seen a surge of popularity in both clinical and academic settings. Despite numerous claims suggesting that a single session of tDCS can modulate cognition in healthy adult populations (especially working memory and language production), the paradigms utilized and results reported in the literature are extremely variable. To address this, we conduct the largest quantitative review of the cognitive data to date. Single-session tDCS data in healthy adults (18-50) from every cognitive outcome measure reported by at least two different research groups in the literature was collected. Outcome measures were divided into 4 broad categories: executive function, language, memory, and miscellaneous. To account for the paradigmatic variability in the literature, we undertook a three-tier analysis system; each with less-stringent inclusion criteria than the prior. Standard mean difference values with 95% CIs were generated for included studies and pooled for each analysis. Of the 59 analyses conducted, tDCS was found to not have a significant effect on any - regardless of inclusion laxity. This includes no effect on any working memory outcome or language production task. Our quantitative review does not support the idea that tDCS generates a reliable effect on cognition in healthy adults. Reasons for and limitations of this finding are discussed. This work raises important questions regarding the efficacy of tDCS, state-dependency effects, and future directions for this tool in cognitive research. Copyright © 2015 Elsevier Inc. All rights reserved.

The reliability and utility of spirometry performed on people with asthma in community pharmacies.

PubMed

Lei Burton, Deborah; LeMay, Kate S; Saini, Bandana; Smith, Lorraine; Bosnic-Anticevich, Sinthia; Southwell, Phillipa; Cooke, Julie; Emmerton, Lynne; Stewart, Kay; Krass, Ines; Reddel, Helen; Armour, Carol

2015-01-01

To investigate the reliability and the utility of spirometry generated by community pharmacists participating in two large asthma intervention trials of 892 people. The Pharmacy Asthma Care Program (PACP) and the Pharmacy Asthma Management Service (PAMS) involved up to four visits to the pharmacy over 6 months for counseling and goal setting. Pharmacists performed spirometry according to ATS/ERS guidelines to inform management. The proportion of A-E, F quality tests, as per EasyOne QC grades, were recorded. Lung function results between visits and for participants referred/not referred to their general practitioner on the basis of spirometry were compared. Complete data from 2593 spirometry sessions were recorded, 68.5% of spirometry sessions achieved three acceptable tests with between-test repeatability of 150 ml or less (A or B quality), 96% of spirometry sessions included at least one test that met ATS/ERS acceptability criteria. About 39.1% of participants had FEV1/FVC values below the lower limit of normal (LNN), indicating a respiratory obstruction. As a result of the service, there was a significant increase in FEV1 and FEV1/FVC and asthma control. Lung function values were significantly poorer for participants referred to their general practitioner, compared with those not referred, on the basis of spirometry. Community pharmacists are able to reliably achieve spirometry results meeting ATS/ERS guidelines in people with asthma. Significant improvements in airway obstruction were demonstrated with the pharmacy services. Pharmacists interpreted lung function results to identify airway obstruction for referral, making this a useful technique for review of people with asthma in the community.

Spatially Regularized Machine Learning for Task and Resting-state fMRI

PubMed Central

Song, Xiaomu; Panych, Lawrence P.; Chen, Nan-kuei

2015-01-01

Background Reliable mapping of brain function across sessions and/or subjects in task- and resting-state has been a critical challenge for quantitative fMRI studies although it has been intensively addressed in the past decades. New Method A spatially regularized support vector machine (SVM) technique was developed for the reliable brain mapping in task- and resting-state. Unlike most existing SVM-based brain mapping techniques, which implement supervised classifications of specific brain functional states or disorders, the proposed method performs a semi-supervised classification for the general brain function mapping where spatial correlation of fMRI is integrated into the SVM learning. The method can adapt to intra- and inter-subject variations induced by fMRI nonstationarity, and identify a true boundary between active and inactive voxels, or between functionally connected and unconnected voxels in a feature space. Results The method was evaluated using synthetic and experimental data at the individual and group level. Multiple features were evaluated in terms of their contributions to the spatially regularized SVM learning. Reliable mapping results in both task- and resting-state were obtained from individual subjects and at the group level. Comparison with Existing Methods A comparison study was performed with independent component analysis, general linear model, and correlation analysis methods. Experimental results indicate that the proposed method can provide a better or comparable mapping performance at the individual and group level. Conclusions The proposed method can provide accurate and reliable mapping of brain function in task- and resting-state, and is applicable to a variety of quantitative fMRI studies. PMID:26470627

Telehealth language assessments using consumer grade equipment in rural and urban settings: Feasible, reliable and well tolerated.

PubMed

Sutherland, Rebecca; Trembath, David; Hodge, Antoinette; Drevensek, Suzi; Lee, Sabrena; Silove, Natalie; Roberts, Jacqueline

2017-01-01

Introduction Telehealth can be an effective way to provide speech pathology intervention to children with speech and language impairments. However, the provision of reliable and feasible standardised language assessments via telehealth to establish children's needs for intervention and to monitor progress has not yet been well established. Further, there is limited information about children's reactions to telehealth. This study aimed to examine the reliability and feasibility of conducting standardised language assessment with school-aged children with known or suspected language impairment via a telehealth application using consumer grade computer equipment within a public school setting. Method Twenty-three children (aged 8-12 years) participated. Each child was assessed using a standardised language assessment comprising six subtests. Two subtests were administered by a speech pathologist face-to-face (local clinician) and four subtests were administered via telehealth. All subtests were completed within a single visit to the clinic service, with a break between the face to face and telehealth sessions. The face-to-face clinician completed behaviour observation checklists in the telehealth and face to face conditions and provided feedback on the audio and video quality of the application from the child's point of view. Parent feedback about their child's experience was elicited via survey. Results There was strong inter-rater reliability in the telehealth and face-to-face conditions (correlation coefficients ranged from r = 0.96-1.0 across the subtests) and good agreement on all measures. Similar levels of attention, distractibility and anxiety were observed in the two conditions. Clinicians rated only one session of 23 as having poor audio quality and no sessions were rated as having poor visual quality. Parent and child reactions to the use of telehealth were largely positive and supportive of using telehealth to assess rural children. Discussion The findings support the use of telehealth in the language assessment of school-aged children using a web application and commercially available computer equipment. This reliable and innovative service delivery model has the potential to be used by speech pathologists to provide assessments to children in remote communities.

Validity and Reliability of the 30-s Continuous Jump for Anaerobic Power and Capacity Assessment in Combat Sport

PubMed Central

Čular, Drazen; Ivančev, Vladimir; Zagatto, Alessandro M.; Milić, Mirjana; Beslija, Tea; Sellami, Maha; Padulo, Johnny

2018-01-01

Cycling test such Wingate anaerobic test (WAnT) is used to measure anaerobic power (AP), but not anaerobic capacity (AC, i.e., the metabolic energy demand). However, in sports that do not involve cycling movements (Karate), the continuous jump for 30 s (vertical jumps for 30 s) has been extensively used to measure anaerobic performance in all young athletes. Limited information’s are available concerning its validity and reliability especially in children. As such, the current study aimed to test validity and reliability of a continuous jumps test (the CJ30s), using WAnT as a reference. Thirteen female Karate kids (age: 11.07 ± 1.32 years; mass: 41.76 ± 15.32 kg; height: 152 ± 11.52 cm; training experience: 4.38 ± 2.14 years) were tested on three separate sessions. The first and second sessions were used to assess the reliability using Intra-class correlation coefficient (ICC) of CJ30s, whereas on the third session WAnT was administered. Following CJ30s and WAnT, we assessed AP (1/CJ30s, as jump height [JH], fatigue index [FI], and blood lactate [BL]; 2/WAnT, as mechanical power [P], FI, and BL) and AC as the excess post-exercise oxygen consumption (EPOC). Large/highly significant correlations were found between CJ30s and WAnT EPOCs (r = 0.730, P = 0.003), and BLs (r = 0.713, P = 0.009). Moderate/significant correlations were found between CJ30s and WAnT FIs (r = 0.640, P = 0.014), CJ30s first four jumps mean JH and WAnT peak P (r = 0.572, P = 0.032), and CJ30s mean JH and WAnT mean P (r = 0.589, P = 0.021). CJ30s showed excellent and moderate reliability (ICC) for AP (maximal JH 0.884, mean JH 0.742, FI 0.657, BL 0.653) and AC (EPOC 0.788), respectively. Correlations observed especially in terms of AC between CJ30s and WAnT provide evidence that former may adequately assess anaerobic performance for the young combat athlete. CJ30 is a reliable test and allow an easy assessment of AP and AC in karate children. PMID:29867580

THE DYNAMIC LEAP AND BALANCE TEST (DLBT): A TEST-RETEST RELIABILITY STUDY

PubMed Central

Newman, Thomas M.; Smith, Brent I.; John Miller, Sayers

2017-01-01

Background There is a need for new clinical assessment tools to test dynamic balance during typical functional movements. Common methods for assessing dynamic balance, such as the Star Excursion Balance Test, which requires controlled movement of body segments over an unchanged base of support, may not be an adequate measure for testing typical functional movements that involve controlled movement of body segments along with a change in base of support. Purpose/hypothesis The purpose of this study was to determine the reliability of the Dynamic Leap and Balance Test (DLBT) by assessing its test-retest reliability. It was hypothesized that there would be no statistically significant differences between testing days in time taken to complete the test. Study Design Reliability study Methods Thirty healthy college aged individuals participated in this study. Participants performed a series of leaps in a prescribed sequence, unique to the DLBT test. Time required by the participants to complete the 20-leap task was the dependent variable. Subjects leaped back and forth from peripheral to central targets alternating weight bearing from one leg to the other. Participants landed on the central target with the tested limb and were required to stabilize for two seconds before leaping to the next target. Stability was based upon qualitative measures similar to Balance Error Scoring System. Each assessment was comprised of three trials and performed on two days with a separation of at least six days. Results Two-way mixed ANOVA was used to analyze the differences in time to complete the sequence between the three trial averages of the two testing sessions. Intraclass Correlation Coefficient (ICC3,1) was used to establish between session test-retest reliability of the test trial averages. Significance was set a priori at p ≤ 0.05. No significant differences (p > 0.05) were detected between the two testing sessions. The ICC was 0.93 with a 95% confidence interval from 0.84 to 0.96. Conclusion This test is a cost-effective, easy to administer and clinically relevant novel measure for assessing dynamic balance that has excellent test-retest reliability. Clinical relevance As a new measure of dynamic balance, the DLBT has the potential to be a cost-effective, challenging and functional tool for clinicians. Level of Evidence 2b PMID:28900556

Cross-cultural validation of the Persian version of the Functional Independence Measure for patients with stroke.

PubMed

Naghdi, Soofia; Ansari, Noureddin Nakhostin; Raji, Parvin; Shamili, Aryan; Amini, Malek; Hasson, Scott

2016-01-01

To translate and cross-culturally adapt the Functional Independence Measure (FIM) into the Persian language and to test the reliability and validity of the Persian FIM (PFIM) in patients with stroke. In this cross-sectional study carried out in an outpatient stroke rehabilitation center, 40 patients with stroke (mean age 60 years) were participated. A standard forward-backward translation method and expert panel validation was followed to develop the PFIM. Two experienced occupational therapists (OTs) assessed the patients independently in all items of the PFIM in a single session for inter-rater reliability. One of the OTs reassessed the patients after 1 week for intra-rater reliability. There were no floor or ceiling effects for the PFIM. Excellent inter-rater and intra-rater reliability was noted for the PFIM total score, motor and cognitive subscales (ICC(agreement)0.88-0.98). According to the Bland-Altman agreement analysis, there was no systematic bias between raters and within raters. The internal consistency of the PFIM was with Cronbach's alpha from 0.70 to 0.96. The principal component analysis with varimax rotation indicated a three-factor structure: (1) self-care and mobility; (2) sphincter control and (3) cognitive that jointly accounted for 74.8% of the total variance. Construct validity was supported by a significant Pearson correlation between the PFIM and the Persian Barthel Index (r = 0.95; p < 0.001). The PFIM is a highly reliable and valid instrument for measuring functional status of Persian patients with stroke. The Functional Independence Measure (FIM) is an outcome measure for disability based on the International Classification of Functioning, Disability and Health (ICF). The FIM was cross-culturally adapted and validated into Persian language. The Persian version of the FIM (PFIM) is reliable and valid for assessing functional status of patients with stroke. The PFIM can be used in Persian speaking countries to assess the limitations in activities of daily living of patients with stroke.

Using Tri-Axial Accelerometry in Daily Elite Swim Training Practice.

PubMed

Ganzevles, Sander; Vullings, Rik; Beek, Peter Jan; Daanen, Hein; Truijens, Martin

2017-04-29

Background : Coaches in elite swimming carefully design the training programs of their swimmers and are keen on achieving strict adherence to those programs by their athletes. At present, coaches usually monitor the compliance of their swimmers to the training program with a stopwatch. However, this measurement clearly limits the monitoring possibilities and is subject to human error. Therefore, the present study was designed to examine the reliability and practical usefulness of tri-axial accelerometers for monitoring lap time, stroke count and stroke rate in swimming. Methods : In the first part of the study, a 1200 m warm-up swimming routine was measured in 13 elite swimmers using tri-axial accelerometers and synchronized video recordings. Reliability was determined using the typical error of measurement (TEM) as well as a Bland-Altman analysis. In the second part, training compliance both within and between carefully prescribed training sessions was assessed in four swimmers in order to determine the practical usefulness of the adopted accelerometric approach. In these sessions, targets were set for lap time and stroke count by the coach. Results : The results indicated high reliability for lap time (TEM = 0.26 s, bias = 0.74 [0.56 0.91] with limits of agreement (LoA) from -1.20 [-1.50 -0.90] to 2.70 [2.40 3.00]), stroke count (TEM 0.73 strokes, bias = 0.46 [0.32 0.60] with LoA from -1.70 [-1.94 -1.46] to 2.60 [2.36 2.84]) and stroke rate (TEM 0.72 str∙min -1 , bias = -0.13 [-0.20 -0.06] with LoA from -2.20 [-2.32 -2.08] to 1.90 [1.78 2.02]), while the results for the monitoring of training compliance demonstrated the practical usefulness of our approach in daily swimming training. Conclusions : The daily training of elite swimmers can be accurately and reliably monitored using tri-axial accelerometers. They provide the coach with more useful information to guide and control the training process than hand-clocked times.

Using Tri-Axial Accelerometry in Daily Elite Swim Training Practice

PubMed Central

Ganzevles, Sander; Vullings, Rik; Beek, Peter Jan; Daanen, Hein; Truijens, Martin

2017-01-01

Background: Coaches in elite swimming carefully design the training programs of their swimmers and are keen on achieving strict adherence to those programs by their athletes. At present, coaches usually monitor the compliance of their swimmers to the training program with a stopwatch. However, this measurement clearly limits the monitoring possibilities and is subject to human error. Therefore, the present study was designed to examine the reliability and practical usefulness of tri-axial accelerometers for monitoring lap time, stroke count and stroke rate in swimming. Methods: In the first part of the study, a 1200 m warm-up swimming routine was measured in 13 elite swimmers using tri-axial accelerometers and synchronized video recordings. Reliability was determined using the typical error of measurement (TEM) as well as a Bland-Altman analysis. In the second part, training compliance both within and between carefully prescribed training sessions was assessed in four swimmers in order to determine the practical usefulness of the adopted accelerometric approach. In these sessions, targets were set for lap time and stroke count by the coach. Results: The results indicated high reliability for lap time (TEM = 0.26 s, bias = 0.74 [0.56 0.91] with limits of agreement (LoA) from −1.20 [−1.50 −0.90] to 2.70 [2.40 3.00]), stroke count (TEM 0.73 strokes, bias = 0.46 [0.32 0.60] with LoA from −1.70 [−1.94 −1.46] to 2.60 [2.36 2.84]) and stroke rate (TEM 0.72 str∙min−1, bias = −0.13 [−0.20 −0.06] with LoA from −2.20 [−2.32 −2.08] to 1.90 [1.78 2.02]), while the results for the monitoring of training compliance demonstrated the practical usefulness of our approach in daily swimming training. Conclusions: The daily training of elite swimmers can be accurately and reliably monitored using tri-axial accelerometers. They provide the coach with more useful information to guide and control the training process than hand-clocked times. PMID:28468255

[Stereovideographic evaluation of the postural geometry of healthy and scoliotic patients].

PubMed

De la Huerta, F; Leroux, M A; Zabjek, K F; Coillard, C; Rivard, C H

1998-01-01

Idiopathic scoliosis principally characterised by a deformation of the vertebral column can also be associated to postural abnormalities. The validity and reliability of current quantitative postural evaluations has not been thoroughly documented, frequently limited by a two dimensional view of the patient, and do not include the whole posture of the patient. The purpose of this study is to 1) quantify within and between-session reliability of a stereovideographic Postural Geometry (PG) evaluation and 2) to investigate the sensitivity of this technique for the postural evaluation of scoliosis patients. The PG of 14 control subjects and 9 untreated scoliosis patients were evaluated with 5 repeat trials, on two occasions. Postural geometry parameters that describe the position and orientation of the pelvis, trunk, scapular girdle and head were calculated based on the 3-dimensional co-ordinates of anatomical landmarks. The mean between and within-session variability across all parameters were 12.5 mm, 2.8 degrees and 5.4 mm and 1.4 degrees respectively. The patient group was heterogeneous with some noted pathological characteristics. This global stereovideographic postural geometry evaluation appears to demonstrate sufficient reliability and sensitivity to follow-up on the posture of scoliosis patients.

Whole Arm Water Displacement Volumetry Is a Reliable and Sensitive Measure: A Pilot to Assess Acute Postburn Volume Change.

PubMed

Edgar, Dale W; Briffa, N Kathy; Wood, Fiona M

Water displacement volumetry (WDV) is a reliable method for measurement of wrist and hand volume in lymphedema patients. However, within session WDV reliability for the whole upper limb (UL) lacks comprehensive investigation, particularly in acute edema populations. This study aimed to confirm the reliability and investigate the impact of time between repeated trials on the sensitivity of WDV as a measure of whole UL volume change in an uninjured cohort and a burn injured pilot group. Within session, duplicate measures of whole UL WDV were recorded in two groups of noninjured volunteers and a group of burn patients. Each noninjured group differed only in the time between WDV repeats. The reliability trials were performed <10 minutes apart (T10) and 20 to 30 minutes apart (T20). The time between repetitions for burn patients was 20 to 30 minutes, based on the results of the noninjured participant trials. All trial groups demonstrated excellent correlation between trials (ICCT10 = 0.999, ICCT20 = 0.997). The minimum detectable difference calculated for WDV when measuring whole UL volume change of >50 ml for noninjured and >100 ml for burn patients. Despite this, a systematic bias was demonstrated between the T10 group means. The T20 group trials did not indicate such error on statistical testing (P = .297). The study confirms that WDV measurement of whole ULs is reliable and sensitive, if used at least 20 minutes apart. However, a significant and clinically relevant subject-by-method interaction was demonstrated. Researchers and clinicians are reminded to be aware of the performance of the technique when designing investigations in patient populations.

Validity and reliability of Optojump photoelectric cells for estimating vertical jump height.

PubMed

Glatthorn, Julia F; Gouge, Sylvain; Nussbaumer, Silvio; Stauffacher, Simone; Impellizzeri, Franco M; Maffiuletti, Nicola A

2011-02-01

Vertical jump is one of the most prevalent acts performed in several sport activities. It is therefore important to ensure that the measurements of vertical jump height made as a part of research or athlete support work have adequate validity and reliability. The aim of this study was to evaluate concurrent validity and reliability of the Optojump photocell system (Microgate, Bolzano, Italy) with force plate measurements for estimating vertical jump height. Twenty subjects were asked to perform maximal squat jumps and countermovement jumps, and flight time-derived jump heights obtained by the force plate were compared with those provided by Optojump, to examine its concurrent (criterion-related) validity (study 1). Twenty other subjects completed the same jump series on 2 different occasions (separated by 1 week), and jump heights of session 1 were compared with session 2, to investigate test-retest reliability of the Optojump system (study 2). Intraclass correlation coefficients (ICCs) for validity were very high (0.997-0.998), even if a systematic difference was consistently observed between force plate and Optojump (-1.06 cm; p < 0.001). Test-retest reliability of the Optojump system was excellent, with ICCs ranging from 0.982 to 0.989, low coefficients of variation (2.7%), and low random errors (±2.81 cm). The Optojump photocell system demonstrated strong concurrent validity and excellent test-retest reliability for the estimation of vertical jump height. We propose the following equation that allows force plate and Optojump results to be used interchangeably: force plate jump height (cm) = 1.02 × Optojump jump height + 0.29. In conclusion, the use of Optojump photoelectric cells is legitimate for field-based assessments of vertical jump height.

Validity and reliability of the session-RPE method for quantifying training in Australian football: a comparison of the CR10 and CR100 scales.

PubMed

Scott, Tannath J; Black, Cameron R; Quinn, John; Coutts, Aaron J

2013-01-01

The purpose of this study was to examine and compare the criterion validity and test-retest reliability of the CR10 and CR100 rating of perceived exertion (RPE) scales for team sport athletes that undertake high-intensity, intermittent exercise. Twenty-one male Australian football (AF) players (age: 19.0 ± 1.8 years, body mass: 83.92 ± 7.88 kg) participated the first part (part A) of this study, which examined the construct validity of the session-RPE (sRPE) method for quantifying training load in AF. Ten male athletes (age: 16.1 ± 0.5 years) participated in the second part of the study (part B), which compared the test-retest reliability of the CR10 and CR100 RPE scales. In part A, the validity of the sRPE method was assessed by examining the relationships between sRPE, and objective measures of internal (i.e., heart rate) and external training load (i.e., distance traveled), collected from AF training sessions. Part B of the study assessed the reliability of sRPE through examining the test-retest reliability of sRPE during 3 different intensities of controlled intermittent running (10, 11.5, and 13 km·h(-1)). Results from part A demonstrated strong correlations for CR10- and CR100-derived sRPE with measures of internal training load (Banisters TRIMP and Edwards TRIMP) (CR10: r = 0.83 and 0.83, and CR100: r = 0.80 and 0.81, p < 0.05). Correlations between sRPE and external training load (distance, higher speed running and player load) for both the CR10 (r = 0.81, 0.71, and 0.83) and CR100 (r = 0.78, 0.69, and 0.80) were significant (p < 0.05). Results from part B demonstrated poor reliability for both the CR10 (31.9% CV) and CR100 (38.6% CV) RPE scales after short bouts of intermittent running. Collectively, these results suggest both CR10- and CR100-derived sRPE methods have good construct validity for assessing training load in AF. The poor levels of reliability revealed under field testing indicate that the sRPE method may not be sensible to detecting small changes in exercise intensity during brief intermittent running bouts. Despite this limitation, the sRPE remains a valid method to quantify training loads in high-intensity, intermittent team sport.

LOFT Debriefings: An Analysis of Instructor Techniques and Crew Participation

NASA Technical Reports Server (NTRS)

Dismukes, R. Key; Jobe, Kimberly K.; McDonnell, Lori K.

1997-01-01

This study analyzes techniques instructors use to facilitate crew analysis and evaluation of their Line-Oriented Flight Training (LOFT) performance. A rating instrument called the Debriefing Assessment Battery (DAB) was developed which enables raters to reliably assess instructor facilitation techniques and characterize crew participation. Thirty-six debriefing sessions conducted at five U.S. airlines were analyzed to determine the nature of instructor facilitation and crew participation. Ratings obtained using the DAB corresponded closely with descriptive measures of instructor and crew performance. The data provide empirical evidence that facilitation can be an effective tool for increasing the depth of crew participation and self-analysis of CRM performance. Instructor facilitation skill varied dramatically, suggesting a need for more concrete hands-on training in facilitation techniques. Crews were responsive but fell short of actively leading their own debriefings. Ways to improve debriefing effectiveness are suggested.

Teleconsultation in school settings: linking classroom teachers and behavior analysts through web-based technology.

PubMed

Frieder, Jessica E; Peterson, Stephanie M; Woodward, Judy; Crane, Jaelee; Garner, Marlane

2009-01-01

This paper describes a technically driven, collaborative approach to assessing the function of problem behavior using web-based technology. A case example is provided to illustrate the process used in this pilot project. A school team conducted a functional analysis with a child who demonstrated challenging behaviors in a preschool setting. Behavior analysts at a university setting provided the school team with initial workshop trainings, on-site visits, e-mail and phone communication, as well as live web-based feedback on functional analysis sessions. The school personnel implemented the functional analysis with high fidelity and scored the data reliably. Outcomes of the project suggest that there is great potential for collaboration via the use of web-based technologies for ongoing assessment and development of effective interventions. However, an empirical evaluation of this model should be conducted before wide-scale adoption is recommended.

Adherence Rating Scale for Cognitive Processing Therapy - Cognitive Only: Analysis of Psychometric Properties.

PubMed

Dittmann, Clara; Müller-Engelmann, Meike; Resick, Patricia A; Gutermann, Jana; Stangier, Ulrich; Priebe, Kathlen; Fydrich, Thomas; Ludäscher, Petra; Herzog, Julia; Steil, Regina

2017-11-01

The assessment of therapeutic adherence is essential for accurately interpreting treatment outcomes in psychotherapy research. However, such assessments are often neglected. To fill this gap, we aimed to develop and test a scale that assessed therapeutic adherence to Cognitive Processing Therapy - Cognitive Only (CPT), which was adapted for a treatment study targeting patients with post-traumatic stress disorder and co-occurring borderline personality symptoms. Two independent, trained raters assessed 30 randomly selected treatment sessions involving seven therapists and eight patients who were treated in a multicentre randomized controlled trial. The inter-rater reliability for all items and the total score yielded good to excellent results (intraclass correlation coefficient [ICC] = 0.70 to 1.00). Cronbach's α was .56 for the adherence scale. Regarding content validity, three experts confirmed the relevance and appropriateness of each item. The adherence rating scale for the adapted version of CPT is a reliable instrument that can be helpful for interpreting treatment effects, analysing possible relationships between therapeutic adherence and treatment outcomes and teaching therapeutic skills.

Reliability of fitness tests using methods and time periods common in sport and occupational management.

PubMed

Burnstein, Bryan D; Steele, Russell J; Shrier, Ian

2011-01-01

Fitness testing is used frequently in many areas of physical activity, but the reliability of these measurements under real-world, practical conditions is unknown. To evaluate the reliability of specific fitness tests using the methods and time periods used in the context of real-world sport and occupational management. Cohort study. Eighteen different Cirque du Soleil shows. Cirque du Soleil physical performers who completed 4 consecutive tests (6-month intervals) and were free of injury or illness at each session (n = 238 of 701 physical performers). Performers completed 6 fitness tests on each assessment date: dynamic balance, Harvard step test, handgrip, vertical jump, pull-ups, and 60-second jump test. We calculated the intraclass coefficient (ICC) and limits of agreement between baseline and each time point and the ICC over all 4 time points combined. Reliability was acceptable (ICC > 0.6) over an 18-month time period for all pairwise comparisons and all time points together for the handgrip, vertical jump, and pull-up assessments. The Harvard step test and 60-second jump test had poor reliability (ICC < 0.6) between baseline and other time points. When we excluded the baseline data and calculated the ICC for 6-month, 12-month, and 18-month time points, both the Harvard step test and 60-second jump test demonstrated acceptable reliability. Dynamic balance was unreliable in all contexts. Limit-of-agreement analysis demonstrated considerable intraindividual variability for some tests and a learning effect by administrators on others. Five of the 6 tests in this battery had acceptable reliability over an 18-month time frame, but the values for certain individuals may vary considerably from time to time for some tests. Specific tests may require a learning period for administrators.

Methods to Improve Reliability of Video Recorded Behavioral Data

PubMed Central

Haidet, Kim Kopenhaver; Tate, Judith; Divirgilio-Thomas, Dana; Kolanowski, Ann; Happ, Mary Beth

2009-01-01

Behavioral observation is a fundamental component of nursing practice and a primary source of clinical research data. The use of video technology in behavioral research offers important advantages to nurse scientists in assessing complex behaviors and relationships between behaviors. The appeal of using this method should be balanced, however, by an informed approach to reliability issues. In this paper, we focus on factors that influence reliability, such as the use of sensitizing sessions to minimize participant reactivity and the importance of training protocols for video coders. In addition, we discuss data quality, the selection and use of observational tools, calculating reliability coefficients, and coding considerations for special populations based on our collective experiences across three different populations and settings. PMID:19434651

Development and Validation of a Photonumeric Scale for Evaluation of Volume Deficit of the Hand

PubMed Central

Donofrio, Lisa; Hardas, Bhushan; Murphy, Diane K.; Carruthers, Jean; Carruthers, Alastair; Sykes, Jonathan M.; Creutz, Lela; Marx, Ann; Dill, Sara

2016-01-01

BACKGROUND A validated scale is needed for objective and reproducible comparisons of hand appearance before and after treatment in practice and clinical studies. OBJECTIVE To describe the development and validation of the 5-point photonumeric Allergan Hand Volume Deficit Scale. METHODS The scale was developed to include an assessment guide, verbal descriptors, morphed images, and real-subject images for each grade. The clinical significance of a 1-point score difference was evaluated in a review of image pairs representing varying differences in severity. Interrater and intrarater reliability was evaluated in a live-subject validation study (N = 296) completed during 2 sessions occurring 3 weeks apart. RESULTS A score difference of ≥1 point was shown to reflect a clinically significant difference (mean [95% confidence interval] absolute score difference, 1.12 [0.99–1.26] for clinically different image pairs and 0.45 [0.33–0.57] for not clinically different pairs). Intrarater agreement between the 2 validation sessions was almost perfect (mean weighted kappa = 0.83). Interrater agreement was almost perfect during the second session (0.82, primary end point). CONCLUSION The Allergan Hand Volume Deficit Scale is a validated and reliable scale for physician rating of hand volume deficit. PMID:27661741

Development and Validation of a Photonumeric Scale for Evaluation of Facial Skin Texture

PubMed Central

Carruthers, Alastair; Hardas, Bhushan; Murphy, Diane K.; Carruthers, Jean; Jones, Derek; Sykes, Jonathan M.; Creutz, Lela; Marx, Ann; Dill, Sara

2016-01-01

BACKGROUND A validated scale is needed for objective and reproducible comparisons of facial skin roughness before and after aesthetic treatment in practice and in clinical studies. OBJECTIVE To describe the development and validation of the 5-point photonumeric Allergan Skin Roughness Scale. METHODS The scale was developed to include an assessment guide, verbal descriptors, morphed images, and real subject images for each grade. The clinical significance of a 1-point score difference was evaluated in a review of image pairs representing varying differences in severity. Interrater and intrarater reliability was evaluated in a live-subject validation study (N = 290) completed during 2 sessions occurring 3 weeks apart. RESULTS A score difference of ≥1 point was shown to reflect a clinically meaningful difference (mean [95% confidence interval] absolute score difference 1.09 [0.96–1.23] for clinically different image pairs and 0.53 [0.38–0.67] for not clinically different pairs). Intrarater agreement between the 2 validation sessions was almost perfect (weighted kappa = 0.83). Interrater agreement was almost perfect during the second rating session (0.81, primary end point). CONCLUSION The Allergan Skin Roughness Scale is a validated and reliable scale for physician rating of midface skin roughness. PMID:27661744

Development and Validation of a Photonumeric Scale for Evaluation of Volume Deficit of the Temple

PubMed Central

Jones, Derek; Hardas, Bhushan; Murphy, Diane K.; Donofrio, Lisa; Sykes, Jonathan M.; Carruthers, Alastair; Creutz, Lela; Marx, Ann; Dill, Sara

2016-01-01

BACKGROUND A validated scale is needed for objective and reproducible comparisons of temple appearance before and after aesthetic treatment in practice and clinical studies. OBJECTIVE To describe the development and validation of the 5-point photonumeric Allergan Temple Hollowing Scale. METHODS The scale was developed to include an assessment guide, verbal descriptors, morphed images, and real subject images for each grade. The clinical significance of a 1-point score difference was evaluated in a review of image pairs representing varying differences in severity. Interrater and intrarater reliability was evaluated in a live-subject validation study (N = 298) completed during 2 sessions occurring 3 weeks apart. RESULTS A score difference of ≥1 point was shown to reflect a clinically significant difference (mean [95% confidence interval] absolute score difference, 1.1 [0.94–1.26] for clinically different image pairs and 0.67 [0.51–0.83] for not clinically different pairs). Intrarater agreement between the 2 validation sessions was almost perfect (mean weighted kappa = 0.86). Interrater agreement was almost perfect during the second session (0.81, primary endpoint). CONCLUSION The Allergan Temple Hollowing Scale is a validated and reliable scale for physician rating of temple volume deficit. PMID:27661742

Wear-Out Sensitivity Analysis Project Abstract

NASA Technical Reports Server (NTRS)

Harris, Adam

2015-01-01

During the course of the Summer 2015 internship session, I worked in the Reliability and Maintainability group of the ISS Safety and Mission Assurance department. My project was a statistical analysis of how sensitive ORU's (Orbital Replacement Units) are to a reliability parameter called the wear-out characteristic. The intended goal of this was to determine a worst case scenario of how many spares would be needed if multiple systems started exhibiting wear-out characteristics simultaneously. The goal was also to determine which parts would be most likely to do so. In order to do this, my duties were to take historical data of operational times and failure times of these ORU's and use them to build predictive models of failure using probability distribution functions, mainly the Weibull distribution. Then, I ran Monte Carlo Simulations to see how an entire population of these components would perform. From here, my final duty was to vary the wear-out characteristic from the intrinsic value, to extremely high wear-out values and determine how much the probability of sufficiency of the population would shift. This was done for around 30 different ORU populations on board the ISS.

Measuring cognitive change with ImPACT: the aggregate baseline approach.

PubMed

Bruce, Jared M; Echemendia, Ruben J; Meeuwisse, Willem; Hutchison, Michael G; Aubry, Mark; Comper, Paul

2017-11-01

The Immediate Post-Concussion Assessment and Cognitive Test (ImPACT) is commonly used to assess baseline and post-injury cognition among athletes in North America. Despite this, several studies have questioned the reliability of ImPACT when given at intervals employed in clinical practice. Poor test-retest reliability reduces test sensitivity to cognitive decline, increasing the likelihood that concussed athletes will be returned to play prematurely. We recently showed that the reliability of ImPACT can be increased when using a new composite structure and the aggregate of two baselines to predict subsequent performance. The purpose of the present study was to confirm our previous findings and determine whether the addition of a third baseline would further increase the test-retest reliability of ImPACT. Data from 97 English speaking professional hockey players who had received at least 4 ImPACT baseline evaluations were extracted from a National Hockey League Concussion Program database. Linear regression was used to determine whether each of the first three testing sessions accounted for unique variance in the fourth testing session. Results confirmed that the aggregate baseline approach improves the psychometric properties of ImPACT, with most indices demonstrating adequate or better test-retest reliability for clinical use. The aggregate baseline approach provides a modest clinical benefit when recent baselines are available - and a more substantial benefit when compared to approaches that obtain baseline measures only once during the course of a multi-year playing career. Pending confirmation in diverse samples, neuropsychologists are encouraged to use the aggregate baseline approach to best quantify cognitive change following sports concussion.

Measuring adherence and competence of dynamic therapists in the treatment of cocaine dependence

PubMed Central

Barber, Jacques P.; Krakauer, Ilana; Calvo, Naomi; Badgio, Peter C.; Faude, Jeffrey

1997-01-01

This article presents the development of a new 82-item rating scale of therapist adherence and competence for supportive-expressive (SE) dynamic psychotherapy for the treatment of cocaine dependence. Sixty- four items are rated for adherence, appropriateness, and quality of prescribed interventions. As part of the pilot/training phase of the National Institute on Drug Abuse Collaborative Cocaine Treatment Study, two independent expert judges rated 32 audiotapes of SE therapy sessions with cocaine-dependent patients, 10 tapes of cognitive therapy (CT) sessions, and 10 tapes of individual drug counseling (IDC) sessions. Reliability was acceptable for adherence but poor for quality and appropriateness. SE therapists used more expressive (interpretative) techniques than did either CT therapists or IDC counselors, and they used more supportive techniques than did IDC counselors. PMID:9058557

Measuring cannabis consumption: Psychometric properties of the Daily Sessions, Frequency, Age of Onset, and Quantity of Cannabis Use Inventory (DFAQ-CU).

PubMed

Cuttler, Carrie; Spradlin, Alexander

2017-01-01

We created the Daily Sessions, Frequency, Age of Onset, and Quantity of Cannabis Use Inventory (DFAQ-CU) because the current lack of psychometrically sound inventories for measuring these dimensions of cannabis use has impeded research on the effects of cannabis in humans. A sample of 2,062 cannabis users completed the DFAQ-CU and was used to assess the DFAQ-CU's factor structure and reliability. To assess validity, a subsample of 645 participants completed additional measures of cannabis dependence and problems (Marijuana Smoking History Questionnaire [MSHQ], Timeline Followback [TLFB], Cannabis Abuse Screening Test [CAST], Cannabis Use Disorders Identification Test Revised [CUDIT-R], Cannabis Use Problems Identification Test [CUPIT], and Alcohol Use Disorder Identification Test [AUDIT]). A six-factor structure was revealed, with factors measuring: daily sessions, frequency, age of onset, marijuana quantity, cannabis concentrate quantity, and edibles quantity. The factors were reliable, with Cronbach's alpha coefficients ranging from .69 (daily sessions) to .95 (frequency). Results further provided evidence for the factors' convergent (MSHQ, TLFB), predictive (CAST, CUDIT-R, CUPIT), and discriminant validity (AUDIT). The DFAQ-CU is the first psychometrically sound inventory for measuring frequency, age of onset, and quantity of cannabis use. It contains pictures of marijuana to facilitate the measurement of quantity of marijuana used, as well as questions to assess the use of different forms of cannabis (e.g., concentrates, edibles), methods of administering cannabis (e.g., joints, hand pipes, vaporizers), and typical THC levels. As such, the DFAQ-CU should help facilitate research on frequency, quantity, and age of onset of cannabis use.

Inter- and Intra-individual Variability in Response to Transcranial Direct Current Stimulation (tDCS) at Varying Current Intensities.

PubMed

Chew, Taariq; Ho, Kerrie-Anne; Loo, Colleen K

2015-01-01

Translation of transcranial direct current stimulation (tDCS) from research to clinical practice is hindered by a lack of consensus on optimal stimulation parameters, significant inter-individual variability in response, and in sufficient intra-individual reliability data. Inter-individual differences in response to anodal tDCS at a range of current intensities were explored. Intra-individual reliability in response to anodal tDCS across two identical sessions was also investigated. Twenty-nine subjects participated in a crossover study. Anodal-tDCS using four different current intensities (0.2, 0.5, 1 and 2 mA), with an anode size of 16 cm2, was tested. The 0.5 mA condition was repeated to assess intra-individual variability. TMS was used to elicit 40 motor-evoked potentials (MEPs) before 10 min of tDCS, and 20 MEPs at four time-points over 30 min following tDCS. ANOVA revealed no main effect of TIME for all conditions except the first 0.5 mA condition, and no differences in response between the four current intensities. Cluster analysis identified two clusters for the 0.2 and 2 mA conditions only. Frequency distributions based on individual subject responses (excitatory, inhibitory or no response) to each condition indicate possible differential responses between individuals to different current intensities. Test-retest reliability was negligible (ICC(2,1) = -0.50). Significant inter-individual variability in response to tDCS across a range of current intensities was found. 2 mA and 0.2 mA tDCS were most effective at inducing a distinct response. Significant intra-individual variability in response to tDCS was also found. This has implications for interpreting results of single-session tDCS experiments. Crown Copyright © 2015. Published by Elsevier Inc. All rights reserved.

Proceedings of the Conference on the Design of Experiments in Army Research Development and Testing (34th) Held in Las Cruces, New Mexico on 19-21 October 1988

DTIC Science & Technology

1989-07-01

Webb and Linda L.C. Moss.............,,...,....., 27 COMPARISON OF RELIABILITY CONFIDENCE INTERVALS Paul H . Thrasher. ......... . 0 1...Webb and Linda L.C. Moss, U.S. Army Ballistic Research Laboratory COMPARISON OF RELIABILITY CONFIDENCE INTERVALS Paul H. Thrasher, White Sands Missile...RELEVANT Paul H. Thrasher, White Sands Missile Range 0930 - 1000 BREAK 1000 - 1130 GENERAL SESSION III Chairperson: Douglas B. Tang, Valter Reed Army

The efficiency of simultaneous binaural ocular vestibular evoked myogenic potentials: a comparative study with monaural acoustic stimulation in healthy subjects.

PubMed

Kim, Min-Beom; Ban, Jae Ho

2012-12-01

To evaluate the test-retest reliability and convenience of simultaneous binaural acoustic-evoked ocular vestibular evoked myogenic potentials (oVEMP). Thirteen healthy subjects with no history of ear diseases participated in this study. All subjects underwent oVEMP test with both separated monaural acoustic stimulation and simultaneous binaural acoustic stimulation. For evaluating test-retest reliability, three repetitive sessions were performed in each ear for calculating the intraclass correlation coefficient (ICC) for both monaural and binaural tests. We analyzed data from the biphasic n1-p1 complex, such as latency of peak, inter-peak amplitude, and asymmetric ratio of amplitude in both ears. Finally, we checked the total time required to complete each test for evaluating test convenience. No significant difference was observed in amplitude and asymmetric ratio in comparison between monaural and binaural oVEMP. However, latency was slightly delayed in binaural oVEMP. In test-retest reliability analysis, binaural oVEMP showed excellent ICC values ranging from 0.68 to 0.98 in latency, asymmetric ratio, and inter-peak amplitude. Additionally, the test time was shorter in binaural than monaural oVEMP. oVEMP elicited from binaural acoustic stimulation yields similar satisfactory results as monaural stimulation. Further, excellent test-retest reliability and shorter test time were achieved in binaural than in monaural oVEMP.

Applications of Microcomputers in Patient Care

PubMed Central

Eden, Henry S.

1979-01-01

This paper serves as an introduction to two sessions on microcomputer applications in patient care. It describes several advantages offered by microcomputers in the design of medical devices--flexibility, reliability, smallness, and low power consumption. It concludes by discussing eight categories of microcomputer application.

Reliability of Autism-Tics, AD/HD, and other Comorbidities (A-TAC) inventory in a test-retest design.

PubMed

Larson, Tomas; Kerekes, Nóra; Selinus, Eva Norén; Lichtenstein, Paul; Gumpert, Clara Hellner; Anckarsäter, Henrik; Nilsson, Thomas; Lundström, Sebastian

2014-02-01

The Autism-Tics, AD/HD, and other Comorbidities (A-TAC) inventory is used in epidemiological research to assess neurodevelopmental problems and coexisting conditions. Although the A-TAC has been applied in various populations, data on retest reliability are limited. The objective of the present study was to present additional reliability data. The A-TAC was administered by lay assessors and was completed on two occasions by parents of 400 individual twins, with an average interval of 70 days between test sessions. Intra- and inter-rater reliability were analysed with intraclass correlations and Cohen's kappa. A-TAC showed excellent test-retest intraclass correlations for both autism spectrum disorder and attention deficit hyperactivity disorder (each at .84). Most modules in the A-TAC had intra- and inter-rater reliability intraclass correlation coefficients of > or = .60. Cohen's kappa indi- cated acceptable reliability. The current study provides statistical evidence that the A-TAC yields good test-retest reliability in a population-based cohort of children.

Reliability and Validity of the Inline Skating Skill Test.

PubMed

Radman, Ivan; Ruzic, Lana; Padovan, Viktoria; Cigrovski, Vjekoslav; Podnar, Hrvoje

2016-09-01

This study aimed to examine the reliability and validity of the inline skating skill test. Based on previous skating experience forty-two skaters (26 female and 16 male) were randomized into two groups (competitive level vs. recreational level). They performed the test four times, with a recovery time of 45 minutes between sessions. Prior to testing, the participants rated their skating skill using a scale from 1 to 10. The protocol included performance time measurement through a course, combining different skating techniques. Trivial changes in performance time between the repeated sessions were determined in both competitive females/males and recreational females/males (-1.7% [95% CI: -5.8-2.6%] - 2.2% [95% CI: 0.0-4.5%]). In all four subgroups, the skill test had a low mean within-individual variation (1.6% [95% CI: 1.2-2.4%] - 2.7% [95% CI: 2.1-4.0%]) and high mean inter-session correlation (ICC = 0.97 [95% CI: 0.92-0.99] - 0.99 [95% CI: 0.98-1.00]). The comparison of detected typical errors and smallest worthwhile changes (calculated as standard deviations × 0.2) revealed that the skill test was able to track changes in skaters' performances. Competitive-level skaters needed shorter time (24.4-26.4%, all p < 0.01) to complete the test in comparison to recreational-level skaters. Moreover, moderate correlation (ρ = 0.80-0.82; all p < 0.01) was observed between the participant's self-rating and achieved performance times. In conclusion, the proposed test is a reliable and valid method to evaluate inline skating skills in amateur competitive and recreational level skaters. Further studies are needed to evaluate the reproducibility of this skill test in different populations including elite inline skaters.

The mouth care item of the MOBID pain scale: secondary analyses of unique video uptakes by dental professionals.

PubMed

Toxopeus, Anne H; Husebo, Bettina S; Strand, Liv Inger; Delwel, Suzanne; van Wijk, Arjen J; Scherder, Erik J A; Lobbezoo, Frank

2016-03-01

The Mobilization-Observation-Behaviour-Intensity-Dementia (MOBID) Pain Scale has been developed for the assessment of pain in elderly individuals with severe dementia. From the initial draft of the MOBID, the teeth/mouth care item was removed due to its low correlation with the total score. However, the observation of this item was done by non-dental professionals only. The aim was to revisit the unique teeth/mouth care video uptake fragments with a group of experienced elderly care dentists, as to establish the reliability of this item. Using the Orofacial MOBID Pain Scale, 11 fragments were assessed by 12 specialists during two sessions with a 4-week interval. The specialists scored whether or not they observed orofacial pain/discomfort-related behaviours (pain noises, facial expressions and/or defence) and/or dementia-related behaviours (anxiety, aggression and/or confusion). The threshold for agreement in scoring was arbitrarily set at 66.6%. As a next step, reliability was quantified using Cohen's kappa. For only two video fragments, substantial agreement was obtained during both sessions, while for three fragments, the agreement was substantial during one session only. In addition, only three observers were able to provide consistent scores. For two of those, the various kappa values could be qualified as moderate to good. Notably, all consistent scores pertained to dementia-related behaviours; not to orofacial pain/disability-related behaviours. Teeth/mouth care, as displayed on video uptakes, cannot be interpreted reliably by experienced elderly care dentists in terms of orofacial pain/discomfort-related behaviour or dementia-related behaviour with the Orofacial MOBID Pain Scale. © 2014 John Wiley & Sons A/S and The Gerodontology Association. Published by John Wiley & Sons Ltd.

Validity and reliability of Nintendo Wii Fit balance scores.

PubMed

Wikstrom, Erik A

2012-01-01

Interactive gaming systems have the potential to help rehabilitate patients with musculoskeletal conditions. The Nintendo Wii Balance Board, which is part of the Wii Fit game, could be an effective tool to monitor progress during rehabilitation because the board and game can provide objective measures of balance. However, the validity and reliability of Wii Fit balance scores remain unknown. To determine the concurrent validity of balance scores produced by the Wii Fit game and the intrasession and intersession reliability of Wii Fit balance scores. Descriptive laboratory study. Sports medicine research laboratory. Forty-five recreationally active participants (age = 27.0 ± 9.8 years, height = 170.9 ± 9.2 cm, mass = 72.4 ± 11.8 kg) with a heterogeneous history of lower extremity injury. Participants completed a single-limb-stance task on a force plate and the Star Excursion Balance Test (SEBT) during the first test session. Twelve Wii Fit balance activities were completed during 2 test sessions separated by 1 week. Postural sway in the anteroposterior (AP) and mediolateral (ML) directions and the AP, ML, and resultant center-of-pressure (COP) excursions were calculated from the single-limb stance. The normalized reach distance was recorded for the anterior, posteromedial, and posterolateral directions of the SEBT. Wii Fit balance scores that the game software generated also were recorded. All 96 of the calculated correlation coefficients among Wii Fit activity outcomes and established balance outcomes were interpreted as poor (r < 0.50). Intrasession reliability for Wii Fit balance activity scores ranged from good (intraclass correlation coefficient [ICC] = 0.80) to poor (ICC = 0.39), with 8 activities having poor intrasession reliability. Similarly, 11 of the 12 Wii Fit balance activity scores demonstrated poor intersession reliability, with scores ranging from fair (ICC = 0.74) to poor (ICC = 0.29). Wii Fit balance activity scores had poor concurrent validity relative to COP outcomes and SEBT reach distances. In addition, the included Wii Fit balance activity scores generally had poor intrasession and intersession reliability.

The Development and Validation of the Memory Support Rating Scale (MSRS)

PubMed Central

Lee, Jason Y.; Worrell, Frank C.; Harvey, Allison G.

2015-01-01

Patient memory for treatment information is poor, and worse memory for treatment information is associated with poorer clinical outcomes. Memory support techniques have been harnessed to improve patient memory for treatment. However, a measure of memory support used by treatment providers during sessions has yet to be established. The present study reports on the development and psychometric properties of the Memory Support Rating Scale (MSRS) – an observer-rated scale designed to measure memory support. Forty-two adults with major depressive disorder (MDD) were randomized to either cognitive therapy plus memory support (CS+MS; n = 22) or cognitive therapy as-usual (CT-as-usual; n = 20). At post-treatment, patients freely recalled treatment points via the Patient Recall Task. Sessions (n = 171) were coded for memory support using the MSRS, 65% of which were also assessed for the quality of cognitive therapy via the Cognitive Therapy Rating Scale (CTRS). A unidimensional scale composed of 8 items was developed using exploratory factor analysis, though a larger sample is needed to further assess the factor structure of MSRS scores. High inter-rater and test-retest reliabilities of MSRS scores were observed across seven MSRS coders. MSRS scores were higher in the CT+MS condition compared to CT-as-usual, demonstrating group differentiation ability. MSRS scores were positively associated with Patient Recall Task scores but not associated with CTRS scores, demonstrating convergent and discriminant validity, respectively. Results indicate that the MSRS yields reliable and valid scores for measuring treatment providers’ use of memory support while delivering cognitive therapy. PMID:26389597

My Therapist is a Student? The Impact of Therapist Experience and Client Severity on Cognitive Behavioural Therapy Outcomes for People with Anxiety Disorders.

PubMed

Mason, Liam; Grey, Nick; Veale, David

2016-03-01

Allocation of trainee therapist cases is often performed based on intuition and clinical circumstances, with lack of empirical evidence on the role of severity of presenting problem. This has the potential to be anxiety-provoking for supervisors, trainees and service users themselves. To determine how therapist experience interacts with symptom severity in predicting client outcomes. An intention-to-treat analysis of annual outcome data for primary and secondary care clients seen by a specialist anxiety disorders service. 196 clients were stratified into mild, moderate and baseline severe symptoms of anxiety (GAD-7) and depression (PHQ-9). We measured percentage change on these measures, as well as number of sessions and therapy dropout. We also examined rates of reliable and clinically significant change on disorder-specific measures. We hypothesized that qualified therapists would achieve better outcomes than trainees, particularly for severe presentations. Overall, outcomes were comparable between trainee and qualified therapists on all measures, and trainees additionally utilized fewer therapy sessions. There was however an interaction between anxiety severity (GAD-7) and therapist group, such that severely anxious clients achieved greater symptom improvement with qualified as compared to trainee therapists. Further, for trainee but not qualified therapists, baseline anxiety was negatively associated with rate of reliable and clinically significant change on disorder-specific measures. These findings indicate generally favourable outcomes for trainee therapists delivering manualized treatments for anxiety disorders. They additionally suggest that trainee therapists may benefit from additional support when working with clients that present with severe anxiety.

The development and validation of the Memory Support Rating Scale.

PubMed

Lee, Jason Y; Worrell, Frank C; Harvey, Allison G

2016-06-01

Patient memory for treatment information is poor, and worse memory for treatment information is associated with poorer clinical outcomes. Memory support techniques have been harnessed to improve patient memory for treatment. However, a measure of memory support used by treatment providers during sessions has yet to be established. The present study reports on the development and psychometric properties of the Memory Support Rating Scale (MSRS)-an observer-rated scale designed to measure memory support. Adults with major depressive disorder (MDD; N = 42) were randomized to either cognitive therapy plus memory support (CT + MS; n = 22) or cognitive therapy as-usual (CT-as-usual; n = 20). At posttreatment, patients freely recalled treatment points via the patient recall task. Sessions (n = 171) were coded for memory support using the MSRS, 65% of which were also assessed for the quality of cognitive therapy via the Cognitive Therapy Rating Scale (CTRS). A unidimensional scale composed of 8 items was developed using exploratory factor analysis, though a larger sample is needed to further assess the factor structure of MSRS scores. High interrater and test-retest reliabilities of MSRS scores were observed across 7 MSRS coders. MSRS scores were higher in the CT + MS condition compared with CT-as-usual, demonstrating group differentiation ability. MSRS scores were positively associated with patient recall task scores but not associated with CTRS scores, demonstrating convergent and discriminant validity, respectively. Results indicate that the MSRS yields reliable and valid scores for measuring treatment providers' use of memory support while delivering cognitive therapy. (PsycINFO Database Record (c) 2016 APA, all rights reserved).

IVS Working Group 2 for Product Specification and Observing Programs

NASA Astrophysics Data System (ADS)

Schuh, H.; Charlot, P.; Hase, H.; Himwich, E.; Kingham, K.; Klatt, C.; Ma, C.; Malkin, Z.; Niell, A.; Nothnagel, A.; Schluter, W.; Takashima, K.; Vandenberg, N.

2002-03-01

After the scientific rationale is given in the introduction the Terms of Reference and the proceeding of IVS Working Group 2 are presented. Then the present status and future goals of all international activities within IVS are described. In particular the current products of IVS are described in terms of accuracy, reliability, frequency of observing sessions, temporal resolution of the parameters estimated by VLBI data analysis, time delay from observing to product, i.e. time which has passed after the end of the last session included in the VLBI solution till availability of the final products and frequency of solution (in the case of "global solutions";, when all existing or a high number of VLBI sessions are used to determine so-called global parameters). All IVS products and their potential users are covered in the report. This includes the Earth orientation parameters (EOP), the reference frames (TRF and CRF), geodynamical and geophysical parameters and physical parameters. Measures which should be taken within IVS to meet the goals defined in the first steps are presented. As most of the measures are related to the observing programs, these are the main focus for improving the current status of IVS products. The report shows that due to various requirements of the different users of IVS products the following aspects must be accomplished: - significant improvement of the accuracy of VLBI products, - shorter time delay from observation to availability of results, - almost continuous temporal coverage by VLBI sessions. A first scenario of the IVS observing program for 2002 and 2003 considers an increase of observing time by about 30%-40% and includes sessions carried out by S2 and K4 technology. The midterm observing program for the next 4-5 years seems to be rather ambitious. However, it appears feasible if all efforts are concentrated and the necessary resources are made available. From: Bidzina Kapanadze (Ilia State Iniversity) Address: bidzina_kapanadze@iliauni.edu.ge Database: ast

Treatment of primary hyperhidrosis with tap water iontophoresis in paediatric patients: a retrospective analysis.

PubMed

Dogruk Kacar, Seval; Ozuguz, Pinar; Eroglu, Selma; Polat, Serap; Karaca, Semsettin

2014-12-01

Primary hyperhidrosis is an under-recognized condition in children and adolescents. Iontophoresis is the second line of treatment for palmoplantar hyperhidrosis following topical treatment. The studies evaluating the efficacy of iontophoresis in children are limited. We aimed to investigate the efficacy and reliability of tap water iontophoresis in children with primary hyperhidrosis. Twenty-one patients aged under 18 years, who received iontophoresis for primary palmoplantar hyperhidrosis, were included in the study. In our clinic, tap water iontophoresis was administered at regular intervals, starting with five times per week and decreased to once a week on fifth week. Then maintenance sessions once a week for 6 weeks are recommended. The presence of excessive sweating was scored by visual analogue scale (VAS): "0" as continuation of excessive sweating and "10" as the absence of excessive sweating. The demographic and clinical data were collected from files. Also, patients fulfilled a questionnaire for efficacy on follow-up visit. Nineteen patients completed the whole 21 sessions. The mean VAS score was 5.89 ± 1.49 at the end of the 15th session and 6.36 ± 2.06 at the end of the treatment. Side effects were well tolerated. Only seven patients were still free of excessive sweating on third months after treatment. The mean satisfaction score was 4.95 ± 2.38, as measured by VAS where 0 indicated dissatisfaction and 10 indicated high satisfaction. Tap water iontophoresis is an effective method of treatment for primary palmoplantar and axillary hyperhidrosis in paediatric patients. But there are still unanswered questions about the mechanism of action, ideal session intervals and protocols for maximum efficacy.

Development and Initial Psychometrics of Counseling Supervisor's Behavior Questionnaire

ERIC Educational Resources Information Center

Lee, Ahram; Park, Eun Hye; Byeon, Eunji; Lee, Sang Min

2016-01-01

This study describes the development and psychometric properties of the Counseling Supervisor's Behavior Questionnaire, designed to assess the specific behaviors of supervisors, which can be observed by supervisees during supervision sessions. Factor structure, construct and concurrent validity, and internal consistency reliability of the…

Agreement and Reliability of Tinnitus Loudness Matching and Pitch Likeness Rating

PubMed Central

Hoare, Derek J.; Edmondson-Jones, Mark; Gander, Phillip E.; Hall, Deborah A.

2014-01-01

The ability to reproducibly match tinnitus loudness and pitch is important to research and clinical management. Here we examine agreement and reliability of tinnitus loudness matching and pitch likeness ratings when using a computer-based method to measure the tinnitus spectrum and estimate a dominant tinnitus pitch, using tonal or narrowband sounds. Group level data indicated a significant effect of time between test session 1 and 2 for loudness matching, likely procedural or perceptual learning, which needs to be accounted in study design. Pitch likeness rating across multiple frequencies appeared inherently more variable and with no systematic effect of time. Dominant pitch estimates reached a level of clinical acceptability when sessions were spaced two weeks apart. However when dominant tinnitus pitch assessments were separated by three months, acceptable agreement was achieved only for group mean data, not for individual estimates. This has implications for prescription of some sound-based interventions that rely on accurate measures of individual dominant tinnitus pitch. PMID:25478690

Psychometrics of the Personal Questionnaire: A client-generated outcome measure.

PubMed

Elliott, Robert; Wagner, John; Sales, Célia M D; Rodgers, Brian; Alves, Paula; Café, Maria J

2016-03-01

We present a range of evidence for the reliability and validity of data generated by the Personal Questionnaire (PQ), a client-generated individualized outcome measure, using 5 data sets from 3 countries. Overall pretherapy mean internal consistency (alpha) across clients was .80, and within-client alphas averaged .77; clients typically had 1 or 2 items that did not vary with the other items. Analyses of temporal structure indicated high levels of between-clients variance (58%), moderate pretherapy test-retest correlation (r = .57), and high session-to-session Lag-1 autocorrelation (.82). Scores on the PQ provided clear evidence of convergence with a range of outcome measures (within-client r = .41). Mean pre-post effects were large (d = 1.25). The results support a revised caseness cutoff of 3.25 and a reliable change index interval of 1.67. We conclude that PQ data meet criteria for evidence-based, norm-referenced measurement of client psychological distress for supporting psychotherapy practice and research. (c) 2016 APA, all rights reserved).

Psychometric properties of the postpartum depression screening scale beyond the postpartum period.

PubMed

Vogeli, Jo M; Hooker, Stephanie A; Everhart, Kevin D; Kaplan, Peter S

2018-04-01

Accurate postpartum depression screening measures are needed to identify mothers with depressive symptoms both in the postpartum period and beyond. Because it had not been tested beyond the immediate postpartum period, the reliability and validity of the Postpartum Depression Screening Scale (PDSS) and its sensitivity, specificity, and predictive value for diagnoses of major depressive disorder (MDD) were assessed in a diverse community sample of 238 mothers of 4- to 15-month-old infants. Mothers (N = 238; M age = 30.2, SD = 5.3) attended a lab session and completed the PDSS, the Beck Depression Inventory-II (BDI-II), and a structured clinical interview (SCID) to diagnose MDD. The reliability, validity, specificity, sensitivity, and predictive value of the PDSS to identify maternal depression were assessed. Confirmatory factor analysis supported the construct validity of five but not seven content subscales. The PDSS total and subscale scores demonstrated acceptable to high reliability (α = 0.68-0.95). Discriminant function analysis showed the scale correctly provided diagnostic classification at a rate higher than chance alone. Sensitivity and specificity for major depressive disorder (MDD) diagnosis were good and comparable to those of the BDI-II. Even in mothers who were somewhat more diverse and had older infants than those in the original normative study, the PDSS appears to be a psychometrically sound screener for identifying depressed mothers in the 15 months after childbirth. © 2018 Wiley Periodicals, Inc.

Assessing the quality of democratic deliberation: A case study of public deliberation on the ethics of surrogate consent for research

PubMed Central

De Vries, Raymond; Stanczyk, Aimee; Wall, Ian F.; Uhlmann, Rebecca; Damschroder, Laura J; Kim, Scott Y

2010-01-01

“Deliberative democracy” is an increasingly popular method for soliciting public input on health care policies. There are a number of ways of organizing deliberative democracy (DD) sessions, but they generally involve gathering a group of citizens, supplying them with information relevant to the policy in question, giving them time to interact with each other and with experts in the policy area, and collecting their informed and considered opinions. As the method has become more widely used, some have questioned the quality of the public input it generates. Although theorists of DD agree that “good” input – i.e., input that is the product of careful and thorough reflection – is an essential aspect of useful and effective deliberation, few have actually measured the quality of deliberative sessions. As part of a DD project organized to help guide policies on the morally complex question of allowing surrogate permission to enroll persons with dementia in medical research, we developed and tested measures of “quality of deliberation.” After a brief discussion of the substantive results of our research – survey data from participants in the DD sessions and control groups showed a significant change in participants' attitudes toward surrogate consent – we examine the process by which this change occurred, describing and assessing the characteristics of our DD sessions. We use both quantitative and qualitative data from our DD sessions, conducted in southeastern Michigan, United States, to examine four dimensions of the quality of deliberation: 1) equal participation by all members of the session, 2) respect for the opinions of others, 3) a willingness to adopt a societal perspective on the issue in question (rather than a focus on what is best for participants as individuals), and 4) reasoned justification of one's positions. We demonstrate that DD can be reliably used to elicit opinions of the public and show how analysis of the quality of deliberations can offer insight into the ways opinions about ethical dilemmas are formed and changed. PMID:20378225

Assessing the quality of democratic deliberation: a case study of public deliberation on the ethics of surrogate consent for research.

PubMed

De Vries, Raymond; Stanczyk, Aimee; Wall, Ian F; Uhlmann, Rebecca; Damschroder, Laura J; Kim, Scott Y

2010-06-01

"Deliberative democracy" is an increasingly popular method for soliciting public input on health care policies. There are a number of ways of organizing deliberative democracy (DD) sessions, but they generally involve gathering a group of citizens, supplying them with information relevant to the policy in question, giving them time to interact with each other and with experts in the policy area, and collecting their informed and considered opinions. As the method has become more widely used, some have questioned the quality of the public input it generates. Although theorists of DD agree that "good" input - i.e., input that is the product of careful and thorough reflection - is an essential aspect of useful and effective deliberation, few have actually measured the quality of deliberative sessions. As part of a DD project organized to help guide policies on the morally complex question of allowing surrogate permission to enroll persons with dementia in medical research, we developed and tested measures of "quality of deliberation." After a brief discussion of the substantive results of our research - survey data from participants in the DD sessions and control groups showed a significant change in participants' attitudes toward surrogate consent - we examine the process by which this change occurred, describing and assessing the characteristics of our DD sessions. We use both quantitative and qualitative data from our DD sessions, conducted in southeastern Michigan, United States, to examine four dimensions of the quality of deliberation: 1) equal participation by all members of the session, 2) respect for the opinions of others, 3) a willingness to adopt a societal perspective on the issue in question (rather than a focus on what is best for participants as individuals), and 4) reasoned justification of one's positions. We demonstrate that DD can be reliably used to elicit opinions of the public and show how analysis of the quality of deliberations can offer insight into the ways opinions about ethical dilemmas are formed and changed. Copyright 2010 Elsevier Ltd. All rights reserved.

Comparison of different passive knee extension torque-angle assessments.

PubMed

Freitas, Sandro R; Vaz, João R; Bruno, Paula M; Valamatos, Maria J; Mil-Homens, Pedro

2013-11-01

Previous studies have used isokinetic dynamometry to assess joint torques and angles during passive extension of the knee, often without reporting upon methodological errors and reliability outcomes. In addition, the reliability of the techniques used to measure passive knee extension torque-angle and the extent to which reliability may be affected by the position of the subjects is also unclear. Therefore, we conducted an analysis of the intra- and inter-session reliability of two methods of assessing passive knee extension: (A) a 2D kinematic analysis coupled to a custom-made device that enabled the direct measurement of resistance to stretch and (B) an isokinetic dynamometer used in two testing positions (with the non-tested thigh either flexed at 45° or in the neutral position). The intra-class correlation coefficients (ICCs) of torque, the slope of the torque-angle curve, and the parameters of the mathematical model that were fit to the torque-angle data for the above conditions were measured in sixteen healthy male subjects (age: 21.4 ± 2.1 yr; BMI: 22.6 ± 3.3 kg m(-2); tibial length: 37.4 ± 3.4 cm). The results found were: (1) methods A and B led to distinctly different torque-angle responses; (2) passive torque-angle relationship and stretch tolerance were influenced by the position of the non-tested thigh; and (3) ICCs obtained for torque were higher than for the slope and for the mathematical parameters that were fit to the torque-angle curve. In conclusion, the measurement method that is used and the positioning of subjects can influence the passive knee extension torque-angle outcome.

Reliability and Repetition Effect of the Center of Pressure and Kinematics Parameters That Characterize Trunk Postural Control During Unstable Sitting Test.

PubMed

Barbado, David; Moreside, Janice; Vera-Garcia, Francisco J

2017-03-01

Although unstable seat methodology has been used to assess trunk postural control, the reliability of the variables that characterize it remains unclear. To analyze reliability and learning effect of center of pressure (COP) and kinematic parameters that characterize trunk postural control performance in unstable seating. The relationships between kinematic and COP parameters also were explored. Test-retest reliability design. Biomechanics laboratory setting. Twenty-three healthy male subjects. Participants volunteered to perform 3 sessions at 1-week intervals, each consisting of five 70-second balancing trials. A force platform and a motion capture system were used to measure COP and pelvis, thorax, and spine displacements. Reliability was assessed through standard error of measurement (SEM) and intraclass correlation coefficients (ICC 2,1 ) using 3 methods: (1) comparing the last trial score of each day; (2) comparing the best trial score of each day; and (3) calculating the average of the three last trial scores of each day. Standard deviation and mean velocity were calculated to assess balance performance. Although analyses of variance showed some differences in balance performance between days, these differences were not significant between days 2 and 3. Best result and average methods showed the greatest reliability. Mean velocity of the COP showed high reliability (0.71 < ICC < 0.86; 10.3 < SEM < 13.0), whereas standard deviation only showed a low to moderate reliability (0.37 < ICC < 0.61; 14.5 < SEM < 23.0). Regarding the kinematic variables, only pelvis displacement mean velocity achieved a high reliability using the average method (0.62 < ICC < 0.83; 18.8 < SEM < 23.1). Correlations between COP and kinematics were high only for mean velocity (0.45

Bridging the gap?

PubMed

del Rio, C; Soto-Ramirez, L E

1998-09-01

At the 12th World AIDS Conference in Geneva many sessions discussed the reality that although AIDS treatment has made major advances, it remains financially out of reach for most of the world's population. Since the Vancouver conference, an additional 10 million people have become infected with HIV. A chart shows the prevalence of AIDS by continent. While many believe a reliable and affordable vaccine is the answer, none of the vaccines under development appear very effective. Other sessions at the conference discussed preventing perinatal transmission, the status of highly active antiretroviral therapy research, viral resistance, and results of studies on tuberculosis, STDs, and other opportunistic infections.

Computer-automated tinnitus assessment: noise-band matching, maskability, and residual inhibition.

PubMed

Henry, James A; Roberts, Larry E; Ellingson, Roger M; Thielman, Emily J

2013-06-01

Psychoacoustic measures of tinnitus typically include loudness and pitch match, minimum masking level (MML), and residual inhibition (RI). We previously developed and documented a computer-automated tinnitus evaluation system (TES) capable of subject-guided loudness and pitch matching. The TES was further developed to conduct computer-aided, subject-guided testing for noise-band matching (NBM), MML, and RI. The purpose of the present study was to document the capability of the upgraded TES to obtain measures of NBM, MML, and RI, and to determine the test-retest reliability of the responses obtained. Three subject-guided, computer-automated testing protocols were developed to conduct NBM. For MML and RI testing, a 2-12 kHz band of noise was used. All testing was repeated during a second session. Subjects meeting study criteria were selected from those who had previously been tested for loudness and pitch matching in our laboratory. A total of 21 subjects completed testing, including seven females and 14 males. The upgraded TES was found to be fairly time efficient. Subjects were generally reliable, both within and between sessions, with respect to the type of stimulus they chose as the best match to their tinnitus. Matching to bandwidth was more variable between measurements, with greater consistency seen for subjects reporting tonal tinnitus or wide-band noisy tinnitus than intermediate types. Between-session repeated MMLs were within 10 dB of each other for all but three of the subjects. Subjects who experienced RI during Session 1 tended to be those who experienced it during Session 2. This study may represent the first time that NBM, MML, and RI audiometric testing results have been obtained entirely through a self-contained, computer-automated system designed specifically for use in the clinic. Future plans include refinements to achieve greater testing efficiency. American Academy of Audiology.

Reliability of the Load-Velocity Relationship Obtained Through Linear and Polynomial Regression Models to Predict the One-Repetition Maximum Load.

PubMed

Pestaña-Melero, Francisco Luis; Haff, G Gregory; Rojas, Francisco Javier; Pérez-Castilla, Alejandro; García-Ramos, Amador

2017-12-18

This study aimed to compare the between-session reliability of the load-velocity relationship between (1) linear vs. polynomial regression models, (2) concentric-only vs. eccentric-concentric bench press variants, as well as (3) the within-participants vs. the between-participants variability of the velocity attained at each percentage of the one-repetition maximum (%1RM). The load-velocity relationship of 30 men (age: 21.2±3.8 y; height: 1.78±0.07 m, body mass: 72.3±7.3 kg; bench press 1RM: 78.8±13.2 kg) were evaluated by means of linear and polynomial regression models in the concentric-only and eccentric-concentric bench press variants in a Smith Machine. Two sessions were performed with each bench press variant. The main findings were: (1) first-order-polynomials (CV: 4.39%-4.70%) provided the load-velocity relationship with higher reliability than second-order-polynomials (CV: 4.68%-5.04%); (2) the reliability of the load-velocity relationship did not differ between the concentric-only and eccentric-concentric bench press variants; (3) the within-participants variability of the velocity attained at each %1RM was markedly lower than the between-participants variability. Taken together, these results highlight that, regardless of the bench press variant considered, the individual determination of the load-velocity relationship by a linear regression model could be recommended to monitor and prescribe the relative load in the Smith machine bench press exercise.

Reliability of quadriceps surface electromyography measurements is improved by two vs. single site recordings.

PubMed

Balshaw, T G; Fry, A; Maden-Wilkinson, T M; Kong, P W; Folland, J P

2017-06-01

The reliability of surface electromyography (sEMG) is typically modest even with rigorous methods, and therefore further improvements in sEMG reliability are desirable. This study compared the between-session reliability (both within participant absolute reliability and between-participant relative reliability) of sEMG amplitude from single vs. average of two distinct recording sites, for individual muscle (IM) and whole quadriceps (WQ) measures during voluntary and evoked contractions. Healthy males (n = 20) performed unilateral isometric knee extension contractions: voluntary maximum and submaximum (60%), as well as evoked twitch contractions on two separate days. sEMG was recorded from two distinct sites on each superficial quadriceps muscle. Averaging two recording sites vs. using single site measures improved reliability for IM and WQ measurements during voluntary (16-26% reduction in within-participant coefficient of variation, CV W ) and evoked contractions (40-56% reduction in CV W ). For sEMG measurements from large muscles, averaging the recording of two distinct sites is recommended as it improves within-participant reliability. This improved sensitivity has application to clinical and research measurement of sEMG amplitude.

Mental imagery boosts music compositional creativity.

PubMed

Wong, Sarah Shi Hui; Lim, Stephen Wee Hun

2017-01-01

We empirically investigated the effect of mental imagery on young children's music compositional creativity. Children aged 5 to 8 years participated in two music composition sessions. In the control session, participants based their composition on a motif that they had created using a sequence of letter names. In the mental imagery session, participants were given a picture of an animal and instructed to imagine the animal's sounds and movements, before incorporating what they had imagined into their composition. Six expert judges independently rated all music compositions on creativity based on subjective criteria (consensual assessment). Reliability analyses indicated that the expert judges demonstrated a high level of agreement in their ratings. The mental imagery compositions received significantly higher creativity ratings by the expert judges than did the control compositions. These results provide evidence for the effectiveness of mental imagery in enhancing young children's music compositional creativity.

Feasibility and reliability of a virtual reality oculus platform to measure sensory integration for postural control in young adults.

PubMed

Lubetzky, Anat V; Kary, Erinn E; Harel, Daphna; Hujsak, Bryan; Perlin, Ken

2018-01-24

Using Unity for the Oculus Development-Kit 2, we have developed an affordable, portable virtual reality platform that targets the visuomotor domain, a missing link in current clinical assessments of postural control. Here, we describe the design and technical development as well as report its feasibility with regards to cybersickness and test-retest reliability in healthy young adults. Our virtual reality paradigm includes two functional scenes ('City' and 'Park') and four moving dots scenes. Twenty-one healthy young adults were tested twice, one to two weeks apart. They completed a simulator sickness questionnaire several times per session. Their postural sway response was recorded from a forceplate underneath their feet while standing on the floor, stability trainers, or a Both Sides Up (BOSU) ball. Sample entropy, postural displacement, velocity, and excursion were calculated and compared between sessions given the visual and surface conditions. Participants reported slight-to-moderate transient side effects. Intra-Class Correlation values mostly ranged from 0.5 to 0.7 for displacement and velocity, were above 0.5 (stability trainer conditions) and above 0.4 (floor mediolateral conditions) for sample entropy, and minimal for excursion. Our novel portable VR platform was found to be feasible and reliable in healthy young adults.

Development of the Therapist Empathy Scale.

PubMed

Decker, Suzanne E; Nich, Charla; Carroll, Kathleen M; Martino, Steve

2014-05-01

Few measures exist to examine therapist empathy as it occurs in session. A 9-item observer rating scale, called the Therapist Empathy Scale (TES), was developed based on Watson's (1999) work to assess affective, cognitive, attitudinal, and attunement aspects of therapist empathy. The aim of this study was to evaluate the inter-rater reliability, internal consistency, and construct and criterion validity of the TES. Raters evaluated therapist empathy in 315 client sessions conducted by 91 therapists, using data from a multi-site therapist training trial (Martino et al., 2010) in Motivational Interviewing (MI). Inter-rater reliability (ICC = .87 to .91) and internal consistency (Cronbach's alpha = .94) were high. Confirmatory factor analyses indicated some support for single-factor fit. Convergent validity was supported by correlations between TES scores and MI fundamental adherence (r range .50 to .67) and competence scores (r range .56 to .69). Discriminant validity was indicated by negative or nonsignificant correlations between TES and MI-inconsistent behavior (r range .05 to -.33). The TES demonstrates excellent inter-rater reliability and internal consistency. RESULTS indicate some support for a single-factor solution and convergent and discriminant validity. Future studies should examine the use of the TES to evaluate therapist empathy in different psychotherapy approaches and to determine the impact of therapist empathy on client outcome.

Does Changing Examiner Stations During UK Postgraduate Surgery Objective Structured Clinical Examinations Influence Examination Reliability and Candidates' Scores?

PubMed

Brennan, Peter A; Croke, David T; Reed, Malcolm; Smith, Lee; Munro, Euan; Foulkes, John; Arnett, Richard

2016-01-01

Objective structured clinical examinations (OSCE) are widely used for summative assessment in surgery. Despite standardizing these as much as possible, variation, including examiner scoring, can occur which may affect reliability. In study of a high-stakes UK postgraduate surgical OSCE, we investigated whether examiners changing stations once during a long examining day affected marking, reliability, and overall candidates' scores compared with examiners who examined the same scenario all day. An observational study of 18,262 examiner-candidate interactions from the UK Membership of the Royal College of Surgeons examination was carried at 3 Surgical Colleges across the United Kingdom. Scores between examiners were compared using analysis of variance. Examination reliability was assessed with Cronbach's alpha, and the comparative distribution of total candidates' scores for each day was evaluated using t-tests of unit-weighted z scores. A significant difference was found in absolute scores differences awarded in the morning and afternoon sessions between examiners who changed stations at lunchtime and those who did not (p < 0.001). No significant differences were found for the main effects of either broad content area (p = 0.290) or station content area (p = 0.450). The reliability of each day was not affected by examiner switching (p = 0.280). Overall, no difference was found in z-score distribution of total candidate scores and categories of examiner switching. This large study has found that although the range of marks awarded varied when examiners change OSCE stations, examination reliability and the likely candidate outcome were not affected. These results may have implications for examination design and examiner experience in surgical OSCEs and beyond. Copyright © 2016 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

Geneva cocktail for cytochrome p450 and P-glycoprotein activity assessment using dried blood spots.

PubMed

Bosilkovska, M; Samer, C F; Déglon, J; Rebsamen, M; Staub, C; Dayer, P; Walder, B; Desmeules, J A; Daali, Y

2014-09-01

The suitability of the capillary dried blood spot (DBS) sampling method was assessed for simultaneous phenotyping of cytochrome P450 (CYP) enzymes and P-glycoprotein (P-gp) using a cocktail approach. Ten volunteers received an oral cocktail capsule containing low doses of the probes bupropion (CYP2B6), flurbiprofen (CYP2C9), omeprazole (CYP2C19), dextromethorphan (CYP2D6), midazolam (CYP3A), and fexofenadine (P-gp) with coffee/Coke (CYP1A2) on four occasions. They received the cocktail alone (session 1), and with the CYP inhibitors fluvoxamine and voriconazole (session 2) and quinidine (session 3). In session 4, subjects received the cocktail after a 7-day pretreatment with the inducer rifampicin. The concentrations of probes/metabolites were determined in DBS and plasma using a single liquid chromatography-tandem mass spectrometry method. The pharmacokinetic profiles of the drugs were comparable in DBS and plasma. Important modulation of CYP and P-gp activities was observed in the presence of inhibitors and the inducer. Minimally invasive one- and three-point (at 2, 3, and 6 h) DBS-sampling methods were found to reliably reflect CYP and P-gp activities at each session.

Geneva Cocktail for Cytochrome P450 and P-Glycoprotein Activity Assessment Using Dried Blood Spots

PubMed Central

Bosilkovska, M; Samer, C F; Déglon, J; Rebsamen, M; Staub, C; Dayer, P; Walder, B; Desmeules, J A; Daali, Y

2014-01-01

The suitability of the capillary dried blood spot (DBS) sampling method was assessed for simultaneous phenotyping of cytochrome P450 (CYP) enzymes and P-glycoprotein (P-gp) using a cocktail approach. Ten volunteers received an oral cocktail capsule containing low doses of the probes bupropion (CYP2B6), flurbiprofen (CYP2C9), omeprazole (CYP2C19), dextromethorphan (CYP2D6), midazolam (CYP3A), and fexofenadine (P-gp) with coffee/Coke (CYP1A2) on four occasions. They received the cocktail alone (session 1), and with the CYP inhibitors fluvoxamine and voriconazole (session 2) and quinidine (session 3). In session 4, subjects received the cocktail after a 7-day pretreatment with the inducer rifampicin. The concentrations of probes/metabolites were determined in DBS and plasma using a single liquid chromatography–tandem mass spectrometry method. The pharmacokinetic profiles of the drugs were comparable in DBS and plasma. Important modulation of CYP and P-gp activities was observed in the presence of inhibitors and the inducer. Minimally invasive one- and three-point (at 2, 3, and 6 h) DBS-sampling methods were found to reliably reflect CYP and P-gp activities at each session. PMID:24722393

Multisite Reliability of MR-Based Functional Connectivity

PubMed Central

Noble, Stephanie; Scheinost, Dustin; Finn, Emily S.; Shen, Xilin; Papademetris, Xenophon; McEwen, Sarah C.; Bearden, Carrie E.; Addington, Jean; Goodyear, Bradley; Cadenhead, Kristin S.; Mirzakhanian, Heline; Cornblatt, Barbara A.; Olvet, Doreen M.; Mathalon, Daniel H.; McGlashan, Thomas H.; Perkins, Diana O.; Belger, Aysenil; Seidman, Larry J.; Thermenos, Heidi; Tsuang, Ming T.; van Erp, Theo G.M.; Walker, Elaine F.; Hamann, Stephan; Woods, Scott W.; Cannon, Tyrone D.; Constable, R. Todd

2016-01-01

Recent years have witnessed an increasing number of multisite MRI functional connectivity (fcMRI) studies. While multisite studies are an efficient way to speed up data collection and increase sample sizes, especially for rare clinical populations, any effects of site or MRI scanner could ultimately limit power and weaken results. Little data exists on the stability of functional connectivity measurements across sites and sessions. In this study, we assess the influence of site and session on resting state functional connectivity measurements in a healthy cohort of traveling subjects (8 subjects scanned twice at each of 8 sites) scanned as part of the North American Prodrome Longitudinal Study (NAPLS). Reliability was investigated in three types of connectivity analyses: (1) seed-based connectivity with posterior cingulate cortex (PCC), right motor cortex (RMC), and left thalamus (LT) as seeds; (2) the intrinsic connectivity distribution (ICD), a voxel-wise connectivity measure; and (3) matrix connectivity, a whole-brain, atlas-based approach assessing connectivity between nodes. Contributions to variability in connectivity due to subject, site, and day-of-scan were quantified and used to assess between-session (test-retest) reliability in accordance with Generalizability Theory. Overall, no major site, scanner manufacturer, or day-of-scan effects were found for the univariate connectivity analyses; instead, subject effects dominated relative to the other measured factors. However, summaries of voxel-wise connectivity were found to be sensitive to site and scanner manufacturer effects. For all connectivity measures, although subject variance was three times the site variance, the residual represented 60–80% of the variance, indicating that connectivity differed greatly from scan to scan independent of any of the measured factors (i.e., subject, site, and day-of-scan). Thus, for a single 5 min scan, reliability across connectivity measures was poor (ICC=0.07–0.17), but increases with increasing scan duration (ICC=0.21–0.36 at 25 min). The limited effects of site and scanner manufacturer support the use of multisite studies, such as NAPLS, as a viable means of collecting data on rare populations and increasing power in univariate functional connectivity studies. However, the results indicate that aggregation of fcMRI data across longer scan durations is necessary to increase the reliability of connectivity estimates at the single-subject level. PMID:27746386

Reliability and Validity of the Inline Skating Skill Test

PubMed Central

Radman, Ivan; Ruzic, Lana; Padovan, Viktoria; Cigrovski, Vjekoslav; Podnar, Hrvoje

2016-01-01

This study aimed to examine the reliability and validity of the inline skating skill test. Based on previous skating experience forty-two skaters (26 female and 16 male) were randomized into two groups (competitive level vs. recreational level). They performed the test four times, with a recovery time of 45 minutes between sessions. Prior to testing, the participants rated their skating skill using a scale from 1 to 10. The protocol included performance time measurement through a course, combining different skating techniques. Trivial changes in performance time between the repeated sessions were determined in both competitive females/males and recreational females/males (-1.7% [95% CI: -5.8–2.6%] – 2.2% [95% CI: 0.0–4.5%]). In all four subgroups, the skill test had a low mean within-individual variation (1.6% [95% CI: 1.2–2.4%] – 2.7% [95% CI: 2.1–4.0%]) and high mean inter-session correlation (ICC = 0.97 [95% CI: 0.92–0.99] – 0.99 [95% CI: 0.98–1.00]). The comparison of detected typical errors and smallest worthwhile changes (calculated as standard deviations × 0.2) revealed that the skill test was able to track changes in skaters’ performances. Competitive-level skaters needed shorter time (24.4–26.4%, all p < 0.01) to complete the test in comparison to recreational-level skaters. Moreover, moderate correlation (ρ = 0.80–0.82; all p < 0.01) was observed between the participant’s self-rating and achieved performance times. In conclusion, the proposed test is a reliable and valid method to evaluate inline skating skills in amateur competitive and recreational level skaters. Further studies are needed to evaluate the reproducibility of this skill test in different populations including elite inline skaters. Key points Study evaluated the reliability and construct validity of a newly developed inline skating skill test. Evaluated test is a first protocol designed to assess specific inline skating skill. Two groups of amateur skaters with different skating proficiency repeated the skill test in four separate occasions. The results suggest that evaluated test is reliable and valid to evaluate inline skating skill in amateur skaters. PMID:27803616

Reliability of the Achilles tendon tap reflex evoked during stance using a pendulum hammer.

PubMed

Mildren, Robyn L; Zaback, Martin; Adkin, Allan L; Frank, James S; Bent, Leah R

2016-01-01

The tendon tap reflex (T-reflex) is often evoked in relaxed muscles to assess spinal reflex circuitry. Factors contributing to reflex excitability are modulated to accommodate specific postural demands. Thus, there is a need to be able to assess this reflex in a state where spinal reflex circuitry is engaged in maintaining posture. The aim of this study was to determine whether a pendulum hammer could provide controlled stimuli to the Achilles tendon and evoke reliable muscle responses during normal stance. A second aim was to establish appropriate stimulus parameters for experimental use. Fifteen healthy young adults stood on a forceplate while taps were applied to the Achilles tendon under conditions in which postural sway was constrained (by providing centre of pressure feedback) or unconstrained (no feedback) from an invariant release angle (50°). Twelve participants repeated this testing approximately six months later. Within one experimental session, tap force and T-reflex amplitude were found to be reliable regardless of whether postural sway was constrained (tap force ICC=0.982; T-reflex ICC=0.979) or unconstrained (tap force ICC=0.968; T-reflex ICC=0.964). T-reflex amplitude was also reliable between experimental sessions (constrained ICC=0.894; unconstrained ICC=0.890). When a T-reflex recruitment curve was constructed, optimal mid-range responses were observed using a 50° release angle. These results demonstrate that reliable Achilles T-reflexes can be evoked in standing participants without the need to constrain posture. The pendulum hammer provides a simple method to allow researchers and clinicians to gather information about reflex circuitry in a state where it is involved in postural control. Copyright © 2015 Elsevier B.V. All rights reserved.

Interrater Reliability of the Power Mobility Road Test in the Virtual Reality-Based Simulator-2.

PubMed

Kamaraj, Deepan C; Dicianno, Brad E; Mahajan, Harshal P; Buhari, Alhaji M; Cooper, Rory A

2016-07-01

To assess interrater reliability of the Power Mobility Road Test (PMRT) when administered through the Virtual Reality-based SIMulator-version 2 (VRSIM-2). Within-subjects repeated-measures design. Participants interacted with VRSIM-2 through 2 display options (desktop monitor vs immersive virtual reality screens) using 2 control interfaces (roller system vs conventional movement-sensing joystick), providing 4 different driving scenarios (driving conditions 1-4). Participants performed 3 virtual driving sessions for each of the 2 display screens and 1 session through a real-world driving course (driving condition 5). The virtual PMRT was conducted in a simulated indoor office space, and an equivalent course was charted in an open space for the real-world assessment. After every change in driving condition, participants completed a self-reported workload assessment questionnaire, the Task Load Index, developed by the National Aeronautics and Space Administration. A convenience sample of electric-powered wheelchair (EPW) athletes (N=21) recruited at the 31st National Veterans Wheelchair Games. Not applicable. Total composite PMRT score. The PMRT had high interrater reliability (intraclass correlation coefficient [ICC]>.75) between the 2 raters in all 5 driving conditions. Post hoc analyses revealed that the reliability analyses had >80% power to detect high ICCs in driving conditions 1 and 4. The PMRT has high interrater reliability in conditions 1 and 4 and could be used to assess EPW driving performance virtually in VRSIM-2. However, further psychometric assessment is necessary to assess the feasibility of administering the PMRT using the different interfaces of VRSIM-2. Copyright © 2016 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.

Test-retest reliability of cardinal plane isokinetic hip torque and EMG.

PubMed

Claiborne, Tina L; Timmons, Mark K; Pincivero, Danny M

2009-10-01

The objective of the present study was to establish test-retest reliability of isokinetic hip torque and prime mover electromyogram (EMG) through the three cardinal planes of motion. Thirteen healthy young adults participated in two experimental sessions, separated by approximately one week. During each session, isokinetic hip torque was evaluated on the Biodex Isokinetic Dynamometer at a velocity of 60 deg/s. Subjects performed three maximal-effort concentric and eccentric contractions, separately, for right and left hip abduction/adduction, flexion/extension, and internal/external rotation. Surface EMGs were sampled from the gluteus maximus, gluteus medius, adductor, medial and lateral hamstring, and rectus femoris muscles during all contractions. Intraclass correlation coefficients (ICC - 2,1) and standard errors of measurement (SEM) were calculated for peak torque for each movement direction and contraction mode, while ICCs were only computed for the EMG data. Motions that demonstrated high torque reliability included concentric hip abduction (right and left), flexion (right and left), extension (right) and internal rotation (right and left), and eccentric hip abduction (left), adduction (left), flexion (right), and extension (right and left) (ICC range=0.81-0.91). Motions with moderate torque reliability included concentric hip adduction (right), extension (left), internal rotation (left), and external rotation (right), and eccentric hip abduction and adduction (right), flexion (left), internal rotation (right and left), and external rotation (right and left) (ICC range=0.49-0.79). The majority of the EMG sampled muscles (n=12 and n=11 for concentric and eccentric contractions, respectively) demonstrated high reliability (ICC=0.81-0.95). Instances of low, or unacceptable, EMG reliability values occurred for the medial hamstring muscle of the left leg (both contraction modes) and the adductor muscle of the right leg during eccentric internal rotation. The major finding revealed high and moderate levels of between-day reliability of isokinetic hip peak torque and prime mover EMG. It is recommended that the day-to-day variability estimates concomitant with acceptable levels of reliability be considered when attempting to objectify intervention effects on hip muscle performance.

Cervical motion assessment using virtual reality.

PubMed

Sarig-Bahat, Hilla; Weiss, Patrice L; Laufer, Yocheved

2009-05-01

Repeated measures of cervical motion in asymptomatic subjects. To introduce a virtual reality (VR)-based assessment of cervical range of motion (ROM); to establish inter and intratester reliability of the VR-based assessment in comparison with conventional assessment in asymptomatic individuals; and to evaluate the effect of a single VR session on cervical ROM. Cervical ROM and clinical issues related to neck pain is frequently studied. A wide variety of methods is available for evaluation of cervical motion. To date, most methods rely on voluntary responses to an assessor's instructions. However, in day-to-day life, head movement is generally an involuntary response to multiple stimuli. Therefore, there is a need for a more functional assessment method, using sensory stimuli to elicit spontaneous neck motion. VR attributes may provide a methodology for achieving this goal. A novel method was developed for cervical motion assessment utilizing an electromagnetic tracking system and a VR game scenario displayed via a head mounted device. Thirty asymptomatic participants were assessed by both conventional and VR-based methods. Inter and intratester repeatability analyses were performed. The effect of a single VR session on ROM was evaluated. Both assessments showed non-biased results between tests and between testers (P > 0.1). Full-cycle repeatability coefficients ranged between 15.0 degrees and 29.2 degrees with smaller values for rotation and for the VR assessment. A single VR session significantly increased ROM, with largest effect found in the rotation direction. Inter and intratester reliability was supported for both the VR-based and the conventional methods. Results suggest better repeatability for the VR method, with rotation being more precise than flexion/extension. A single VR session was found to be effective in increasing cervical motion, possibly due to its motivating effect.

The role of cognitive biases in short-term psychodynamic psychotherapy.

PubMed

Kramer, Ueli; Ortega, Diana; Ambresin, Gilles; Despland, Jean-Nicolas; de Roten, Yves

2018-06-01

The concept of biased thinking - or cognitive biases - is relevant to psychotherapy research and clinical conceptualization, beyond cognitive theories. The present naturalistic study aimed to examine the changes in biased thinking over the course of a short-term dynamic psychotherapy (STDP) and to discover potential links between these changes and symptomatic improvement. This study focuses on 32 self-referred patients consulting for Adjustment Disorder according to DSM-IV-TR. The therapists were experienced psychodynamically oriented psychiatrists and psychotherapists. Coding of cognitive biases (using the Cognitive Errors Rating Scale; CERS) was made by external raters based on transcripts of interviews of psychotherapy; the reliability of these ratings on a randomly chosen 24% of all sessions was established. Based on the Symptom Check List SCL-90-R given before and after, the Reliable Change Index (RCI) was used. The assessment of cognitive errors was done at three time points: early (session 4-7), mid-treatment (session 12-17), and close to the end (after session 20) of the treatment. The results showed that the total frequency of cognitive biases was stable over time (p = .20), which was true both for positive and for negative cognitive biases. In exploring the three main subscales of the CERS, we found a decrease in selective abstraction (p = .02) and an increase in personalization (p = .05). A significant link between RCI scores (outcome) and frequency of positive cognitive biases was found, suggesting that biases towards the positive might have a protective function in psychotherapy. Therapists may be attentive to changes in biased thinking across short-term dynamic psychotherapy for adjustment disorder. Therapists may foster the emergence of positive cognitive biases at mid-treatment for adjustment disorder. © 2017 The British Psychological Society.

Measuring cannabis consumption: Psychometric properties of the Daily Sessions, Frequency, Age of Onset, and Quantity of Cannabis Use Inventory (DFAQ-CU)

PubMed Central

Spradlin, Alexander

2017-01-01

Objective We created the Daily Sessions, Frequency, Age of Onset, and Quantity of Cannabis Use Inventory (DFAQ-CU) because the current lack of psychometrically sound inventories for measuring these dimensions of cannabis use has impeded research on the effects of cannabis in humans. Method A sample of 2,062 cannabis users completed the DFAQ-CU and was used to assess the DFAQ-CU’s factor structure and reliability. To assess validity, a subsample of 645 participants completed additional measures of cannabis dependence and problems (Marijuana Smoking History Questionnaire [MSHQ], Timeline Followback [TLFB], Cannabis Abuse Screening Test [CAST], Cannabis Use Disorders Identification Test Revised [CUDIT-R], Cannabis Use Problems Identification Test [CUPIT], and Alcohol Use Disorder Identification Test [AUDIT]). Results A six-factor structure was revealed, with factors measuring: daily sessions, frequency, age of onset, marijuana quantity, cannabis concentrate quantity, and edibles quantity. The factors were reliable, with Cronbach’s alpha coefficients ranging from .69 (daily sessions) to .95 (frequency). Results further provided evidence for the factors’ convergent (MSHQ, TLFB), predictive (CAST, CUDIT-R, CUPIT), and discriminant validity (AUDIT). Conclusions The DFAQ-CU is the first psychometrically sound inventory for measuring frequency, age of onset, and quantity of cannabis use. It contains pictures of marijuana to facilitate the measurement of quantity of marijuana used, as well as questions to assess the use of different forms of cannabis (e.g., concentrates, edibles), methods of administering cannabis (e.g., joints, hand pipes, vaporizers), and typical THC levels. As such, the DFAQ-CU should help facilitate research on frequency, quantity, and age of onset of cannabis use. PMID:28552942

Enhancing treatment fidelity in psychotherapy research: novel approach to measure the components of cognitive behavioural therapy for relapse prevention in first-episode psychosis.

PubMed

Alvarez-Jimenez, Mario; Wade, Darryl; Cotton, Sue; Gee, Donna; Pearce, Tracey; Crisp, Kingsley; McGorry, Patrick D; Gleeson, John F

2008-12-01

Establishing treatment fidelity is one of the most important aspects of psychotherapy research. Treatment fidelity refers to the methodological strategies used to examine and enhance the reliability and validity of psychotherapy. This study sought to develop and evaluate a measure specifically designed to assess fidelity to the different therapeutic components (i.e. therapy phases) of the individual intervention of a psychotherapy clinical trial (the EPISODE II trial). A representative sample of sessions stratified by therapy phase was assessed using a specifically developed fidelity measure (Relapse Prevention Therapy-Fidelity Scale, RPT-FS). Each RPT-FS subscale was designed to include a different component/phase of therapy and its major therapeutic ingredients. The measure was found to be reliable and had good internal consistency. The RPT-FS discriminated, almost perfectly, between therapy phases. The analysis of the therapeutic strategies implemented during the intervention indicated that treatment fidelity was good throughout therapy phases. While therapists primarily engaged in interventions from the appropriate therapeutic phase, flexibility in therapy was evident. This study described the development of a brief, reliable and internally consistent measure to determine both treatment fidelity and the therapy components implemented throughout the intervention. This methodology can be potentially useful to determine those components related to therapeutic change.

Does the Timing of Measurement Alter Session-RPE in Boxers?

PubMed

Uchida, Marco C; Teixeira, Luis F M; Godoi, Vladmir J; Marchetti, Paulo H; Conte, Marcelo; Coutts, Aaron J; Bacurau, Reury F P

2014-01-01

The purpose of this study was to compare the influence of measuring the overall session rating of perceived exertion (session-RPE) at 10 vs. 30 minutes following exercise. Eight boxers completed three different standardized training sessions of different intensities (easy, moderate and hard) in a matchedpairs, randomized research design. Exercise intensity was assessed during each bout by measuring heart rate, blood lactate concentration and session-RPE. To assess the effect of measurement timing on session-RPE, RPE data were collected either 10 or 30 minutes post-exercise. There was no significant effect of measurement time on session-RPE values following easy (10 minutes: session-RPE = 1.3 ± 1.0 Arbitrary Unit (AU), %Heart Rate Reserve (HRR) = 49.5 ± 11.1, and ∆Blood lactate = -2.3 ± 16.3%; 30 minutes: session-RPE = 1.7 ± 1.0 AU, %HRR = 51.3 ± 10.8, and ∆Blood lactate = 0.7 ± 25.2%), moderate (10 minutes: session-RPE = 2.7 ± 1.6 AU, %HRR = 67.2 ± 10.8, and ∆Blood lactate = 2.2 ± 19%; 30 minutes: session-RPE = 2.5 ± 0.9 AU, %HRR = 67.2 ± 5.9, and ∆Blood lactate = 24.5 ± 17.1%) and hard (10 minutes: session-RPE = 5.7 ± 1.0 AU, %HRR = 88.1 ± 6.3, and ∆Blood lactate = 146.3 ± 87.9%; 30 minutes: session-RPE = 5.8 ± 1.9 AU, %HRR> = 83.3 ± 8.0, and ∆Blood lactate = 91.6 ± 39%) sessions. In conclusion, our findings suggest that session-RPE can be used in boxing training routines across a range of intensities and accurate measurements can be determined as early as 10 minutes after exercise. Key PointsIt is difficult to quantify and monitoring the external training load in martial arts (e.g. Aikido, Kung Fu, Judo) and physical combat sports (e.g. Boxing, Muay Thai), session RPE method appears to be a reliable method to quantifying training load in those sports.For many athletes it is impractical to wait 30 minutes after training session to provide a session-RPE. The present findings show that collecting ses-sion-RPE measures at 10 min following exercise ses-sions of various intensities (i.e. easy, moderate, and hard) provide similar values as if taken 30 min fol-lowing the session.Our data have significant practical benefit and fur-ther support the practical usefulness of session-RPE for measuring internal training load in sport.

Reliability and validity of an iPhone(®) application for the measurement of lumbar spine flexion and extension range of motion.

PubMed

Pourahmadi, Mohammad Reza; Taghipour, Morteza; Jannati, Elham; Mohseni-Bandpei, Mohammad Ali; Ebrahimi Takamjani, Ismail; Rajabzadeh, Fatemeh

2016-01-01

Measurement of lumbar spine range of motion (ROM) is often considered to be an essential component of lumbar spine physiotherapy and orthopedic assessment. The measurement can be carried out through various instruments such as inclinometers, goniometers, and etc. Recent smartphones have been equipped with accelerometers and magnetometers, which, through specific software applications (apps) can be used for inclinometric functions. The main purpose was to investigate the reliability and validity of an iPhone(®) app (TiltMeter(©) -advanced level and inclinometer) for measuring standing lumbar spine flexion-extension ROM in asymptomatic subjects. A cross-sectional study was carried out. This study was conducted in a physiotherapy clinic located at School of Rehabilitation Sciences, Iran University of Medical Science and Health Services, Tehran, Iran. A convenience sample of 30 asymptomatic adults (15 males; 15 females; age range = 18-55 years) was recruited between August 2015 and December 2015. Following a 2-minute warm-up, the subjects were asked to stand in a relaxed position and their skin was marked at the T12-L1 and S1-S2 spinal levels. From this position, they were asked to perform maximum lumbar flexion followed by maximum lumbar extension with their knees straight. Two blinded raters each used an inclinometer and the iPhone (®) app to measure lumbar spine flexion-extension ROM. A third rater read the measured angles. To calculate total lumbar spine flexion-extension ROM, the measurement from S1-S2 was subtracted from T12-L1. The second (2 hours later) and third (48 hours later) sessions were carried out in the same manner as the first session. All of the measurements were conducted 3 times and the mean value of 3 repetitions for each measurement was used for analysis. Intraclass correlation coefficient (ICC) models (3, k) and (2, k) were used to determine the intra-rater and inter-rater reliability, respectively. The Pearson correlation coefficients were used to establish concurrent validity of the iPhone(®) app. Furthermore, minimum detectable change at the 95% confidence level (MDC95) was computed as 1.96 × standard error of measurement × [Formula: see text]. Good to excellent intra-rater and inter-rater reliability were demonstrated for both the gravity-based inclinometer with ICC values of ≥0.84 and ≥0.77 and the iPhone(®) app with ICC values of ≥0.85 and ≥0.85, respectively. The MDC95 ranged from 5.82°to 8.18°for the intra-rater analysis and from 7.38°to 8.66° for the inter-rater analysis. The concurrent validity for flexion and extension between the 2 instruments was 0.85 and 0.91, respectively. The iPhone(®)app possesses good to excellent intra-rater and inter-rater reliability and concurrent validity. It seems that the iPhone(®) app can be used for the measurement of lumbar spine flexion-extension ROM. IIb.

The Nature of Pre-service Science Teachers' Argumentation in Inquiry-oriented Laboratory Context

NASA Astrophysics Data System (ADS)

Ozdem, Yasemin; Ertepinar, Hamide; Cakiroglu, Jale; Erduran, Sibel

2013-10-01

The aim of this study was to investigate the kinds of argumentation schemes generated by pre-service elementary science teachers (PSTs) as they perform inquiry-oriented laboratory tasks, and to explore how argumentation schemes vary by task as well as by experimentation and discussion sessions. The model of argumentative and scientific inquiry was used as a design framework in the present study. According to the model, the inquiry of scientific topics was employed by groups of participants through experimentation and critical discussion sessions. The participants of the study were 35 PSTs, who teach middle school science to sixth through eighth grade students after graduation. The data were collected through video- and audio-recordings of the discussions made by PSTs in six inquiry-oriented laboratory sessions. For the analysis of data, pre-determined argumentation schemes by Walton were employed. The results illustrated that PSTs applied varied premises rather than only observations or reliable sources to ground their claims or to argue for a case or an action. It is also worthy of notice that the construction and evaluation of scientific knowledge claims resulted in different numbers and kinds of arguments. Results of this study suggest that designing inquiry-oriented laboratory environments, which are enriched with critical discussion, provides discourse opportunities that can support argumentation. Moreover, PSTs can be encouraged to support and promote argumentation in their future science classrooms if they engage in argumentation integrated instructional strategies.

Automated Portable Test System (APTS) - A performance envelope assessment tool

NASA Technical Reports Server (NTRS)

Kennedy, R. S.; Dunlap, W. P.; Jones, M. B.; Wilkes, R. L.; Bittner, A. C., Jr.

1985-01-01

The reliability and stability of microcomputer-based psychological tests are evaluated. The hardware, test programs, and system control of the Automated Portable Test System, which assesses human performance and subjective status, are described. Subjects were administered 11 pen-and-pencil and microcomputer-based tests for 10 sessions. The data reveal that nine of the 10 tests stabilized by the third administration; inertial correlations were high and consistent. It is noted that the microcomputer-based tests display good psychometric properties in terms of differential stability and reliability.

Impact of personality psychopathology on outcome in short-term cognitive-behavioral therapy for Axis I disorders.

PubMed

Bédard, Mathieu; Russell, Jennifer J; Myhr, Gail

2015-12-15

Cognitive behavioral therapy (CBT) is efficacious for many Axis I disorders, though its effectiveness in the real world, for patients with Axis II comorbidity is less well known. This study examines the effectiveness of CBT for Axis I disorders in three groups of patients: those with personality disorders, those with personality disorder traits and those with no Axis II pathology. Consecutive referrals of patients with non-psychotic Axis I disorders were assessed for short-term CBT in a University Teaching Unit. While the acceptance rate was lower for individuals with personality disorders, there were no group differences in dropout rates. Of those who completed therapy (mean number of sessions=17.8, SD=11.2), those in the Personality Disorders group (n=45) had 4 sessions more on average than the Personality Disorder Traits group (n=42) or the No Axis II Group (n=266). All 3 groups were equally successful, whether the outcome was therapist opinion of success, the clinical global impression, or the reliable change index based on patient-reported symptom change. Intent to treat analysis results paralleled those of the completer analysis. Our findings indicate that the presence of a personality disorder does not negatively impact therapy adherence or success in short-term CBT for an Axis I disorder. Copyright © 2015 Elsevier Ireland Ltd. All rights reserved.

The Eating and Exercise Behavior Questionnaire: A Validity Assessment.

ERIC Educational Resources Information Center

Brandon, Jeffrey E.; And Others

1988-01-01

Three studies assessing the Eating and Exercise Behavior Questionnaire indicated that it is reliable and useful in studying the eating patterns of the obese, differences in behavioral cue responses to eating, and multiple and single session weight loss training effectiveness.The research utility of the instrument is discussed. (CB)

A Methodological Report: Adapting the 505 Change-of-Direction Speed Test Specific to American Football.

PubMed

Lockie, Robert G; Farzad, Jalilvand; Orjalo, Ashley J; Giuliano, Dominic V; Moreno, Matthew R; Wright, Glenn A

2017-02-01

Lockie, RG, Jalilvand, F, Orjalo, AJ, Giuliano, DV, Moreno, MR, and Wright, GA. A methodological report: Adapting the 505 change-of-direction speed test specific to American football. J Strength Cond Res 31(2): 539-547, 2017-The 505 involves a 10-m sprint past a timing gate, followed by a 180° change-of-direction (COD) performed over 5 m. This methodological report investigated an adapted 505 (A505) designed to be football-specific by changing the distances to 10 and 5 yd. Twenty-five high school football players (6 linemen [LM]; 8 quarterbacks, running backs, and linebackers [QB/RB/LB]; 11 receivers and defensive backs [R/DB]) completed the A505 and 40-yd sprint. The difference between A505 and 0 to 10-yd time determined the COD deficit for each leg. In a follow-up session, 10 subjects completed the A505 again and 10 subjects completed the 505. Reliability was analyzed by t-tests to determine between-session differences, typical error (TE), and coefficient of variation. Test usefulness was examined via TE and smallest worthwhile change (SWC) differences. Pearson's correlations calculated relationships between the A505 and 505, and A505 and COD deficit with the 40-yd sprint. A 1-way analysis of variance (p ≤ 0.05) derived between-position differences in the A505 and COD deficit. There were no between-session differences for the A505 (p = 0.45-0.76; intraclass correlation coefficient = 0.84-0.95; TE = 2.03-4.13%). Additionally, the A505 was capable of detecting moderate performance changes (SWC0.5 > TE). The A505 correlated with the 505 and 40-yard sprint (r = 0.58-0.92), suggesting the modified version assessed similar qualities. Receivers and defensive backs were faster than LM in the A505 for both legs, and right-leg COD deficit. Quarterbacks, running backs, and linebackers were faster than LM in the right-leg A505. The A505 is reliable, can detect moderate performance changes, and can discriminate between football position groups.

Test-retest reliability of retinal oxygen saturation measurement.

PubMed

O'Connell, Rachael A; Anderson, Andrew J; Hosking, Sarah L; Batcha, Abrez H; Bui, Bang V

2014-06-01

To determine intrasession and intersession repeatability of retinal vessel oxygen saturation from the Oxymap Retinal Oximeter using a whole image-based analysis technique and so determine optimal analysis parameters to reduce variability. Ten fundus oximetry images were acquired through dilated pupils from 18 healthy participants (aged 22 to 38) using the Oxymap Retinal Oximeter T1. A further 10 images were obtained 1 to 2 weeks later from each individual. Analysis was undertaken for subsets of images to determine the number of images needed to return a stable coefficient of variation (CoV). Intrasession and intersession variability were quantified by evaluating the CoV and establishing the 95% limits of agreement using Bland and Altman analysis. Retinal oxygenation was derived from the distribution of oxygenation values from all vessels of a given width in an image or set of images, as described by Paul et al. in 2013. Grouped in 10-μm-wide bins, oxygen saturation varied significantly for both arteries and veins (p < 0.01). Between 110 and 150 μm, arteries had the least variability between individuals, with average CoVs less than 5% whose confidence intervals did not overlap with the greater than 10% average CoVs for veins across the same range. Bland and Altman analysis showed that there was no bias within or between recording sessions and that the 95% limits of agreement were generally lower in arteries. Retinal vessel oxygen saturation measurements show variability within and between clinical sessions when the whole image is used, which we believe more accurately reflects the true variability in Oxymap images than previous studies on select image segments. Averaging data from vessels 100 to 150 μm in width may help to minimize such variability.

Reproducibility of EEG-fMRI results in a patient with fixation-off sensitivity.

PubMed

Formaggio, Emanuela; Storti, Silvia Francesca; Galazzo, Ilaria Boscolo; Bongiovanni, Luigi Giuseppe; Cerini, Roberto; Fiaschi, Antonio; Manganotti, Paolo

2014-07-01

Blood oxygenation level-dependent (BOLD) activation associated with interictal epileptiform discharges in a patient with fixation-off sensitivity (FOS) was studied using a combined electroencephalography-functional magnetic resonance imaging (EEG-fMRI) technique. An automatic approach for combined EEG-fMRI analysis and a subject-specific hemodynamic response function was used to improve general linear model analysis of the fMRI data. The EEG showed the typical features of FOS, with continuous epileptiform discharges during elimination of central vision by eye opening and closing and fixation; modification of this pattern was clearly visible and recognizable. During all 3 recording sessions EEG-fMRI activations indicated a BOLD signal decrease related to epileptiform activity in the parietal areas. This study can further our understanding of this EEG phenomenon and can provide some insight into the reliability of the EEG-fMRI technique in localizing the irritative zone.

Validity and Reliability of a Wearable Inertial Sensor to Measure Velocity and Power in the Back Squat and Bench Press.

PubMed

Orange, Samuel T; Metcalfe, James W; Liefeith, Andreas; Marshall, Phil; Madden, Leigh A; Fewster, Connor R; Vince, Rebecca V

2018-05-08

Orange, ST, Metcalfe, JW, Liefeith, A, Marshall, P, Madden, LA, Fewster, CR, and Vince, RV. Validity and reliability of a wearable inertial sensor to measure velocity and power in the back squat and bench press. J Strength Cond Res XX(X): 000-000, 2018-This study examined the validity and reliability of a wearable inertial sensor to measure velocity and power in the free-weight back squat and bench press. Twenty-nine youth rugby league players (18 ± 1 years) completed 2 test-retest sessions for the back squat followed by 2 test-retest sessions for the bench press. Repetitions were performed at 20, 40, 60, 80, and 90% of 1 repetition maximum (1RM) with mean velocity, peak velocity, mean power (MP), and peak power (PP) simultaneously measured using an inertial sensor (PUSH) and a linear position transducer (GymAware PowerTool). The PUSH demonstrated good validity (Pearson's product-moment correlation coefficient [r]) and reliability (intraclass correlation coefficient [ICC]) only for measurements of MP (r = 0.91; ICC = 0.83) and PP (r = 0.90; ICC = 0.80) at 20% of 1RM in the back squat. However, it may be more appropriate for athletes to jump off the ground with this load to optimize power output. Further research should therefore evaluate the usability of inertial sensors in the jump squat exercise. In the bench press, good validity and reliability were evident only for the measurement of MP at 40% of 1RM (r = 0.89; ICC = 0.83). The PUSH was unable to provide a valid and reliable estimate of any other criterion variable in either exercise. Practitioners must be cognizant of the measurement error when using inertial sensor technology to quantify velocity and power during resistance training, particularly with loads other than 20% of 1RM in the back squat and 40% of 1RM in the bench press.

Transient-evoked and distortion product otoacoustic emissions: A short-term test-retest reliability study.

PubMed

Keppler, Hannah; Dhooge, Ingeborg; Maes, Leen; D'haenens, Wendy; Bockstael, Annelies; Philips, Birgit; Swinnen, Freya; Vinck, Bart

2010-02-01

Knowledge regarding the variability of transient-evoked otoacoustic emissions (TEOAEs) and distortion product otoacoustic emissions (DPOAEs) is essential in clinical settings and improves their utility in monitoring hearing status over time. In the current study, TEOAEs and DPOAEs were measured with commercially available OAE-equipment in 56 normally-hearing ears during three sessions. Reliability was analysed for the retest measurement without probe-refitting, the immediate retest measurement with probe-refitting, and retest measurements after one hour and one week. The highest reliability was obtained in the retest measurement without probe-refitting, and decreased with increasing time-interval between measurements. For TEOAEs, the lowest reliability was seen at half-octave frequency bands 1.0 and 1.4 kHz; whereas for DPOAEs half-octave frequency band 8.0 kHz had also poor reliability. Higher primary tone level combination for DPOAEs yielded to a better reliability of DPOAE amplitudes. External environmental noise seemed to be the dominating noise source in normal-hearing subjects, decreasing the reliability of emission amplitudes especially in the low-frequency region.

High-Bandwidth Tactical-Network Data Analysis in a High-Performance-Computing (HPC) Environment: Voice Call Analysis

DTIC Science & Technology

2015-09-01

Gateway 2 4. Voice Packet Flow: SIP , Session Description Protocol (SDP), and RTP 3 5. Voice Data Analysis 5 6. Call Analysis 6 7. Call Metrics 6...analysis processing is designed for a general VoIP system architecture based on Session Initiation Protocol ( SIP ) for negotiating call sessions and...employs Skinny Client Control Protocol for network communication between the phone and the local CallManager (e.g., for each dialed digit), SIP

Acoustic stapedial reflexes in healthy neonates: normative data and test-retest reliability.

PubMed

Kei, Joseph

2012-01-01

The acoustic stapedial reflex (ASR) test provides useful information about the function of the auditory system. While it is frequently used with adults and children in a clinical setting, its use with young infants is limited. Presently, there are few data for neonates and inadequate research into the test-retest reliability of the ASR test. This study aimed to establish normative data and evaluate the test-retest reliability of the ASR test in healthy neonates. A cross-sectional experimental design was used to establish ASR normative data and assess the test-retest reliability of ASR thresholds obtained from healthy neonates. Sixty-eight full-term neonates with mean chronological age of 2.5 days (SD = 1.8 day), who passed the automated auditory brainstem response, transient evoked otoacoustic emission, and high frequency (1 kHz) tympanometry (HFT) tests. One randomly selected ear from each neonate was tested using TEOAE (transient evoked otoacoustic emission), HFT, and ASR tests using a 1 kHz probe tone. ASR thresholds were elicited by presenting pure tones of 0.5, 2, and 4 kHz and broadband noise (BBN) separately to the test ear in an ipsilateral stimulation mode. The ASR procedure was repeated to acquire retest data within the same testing session. Descriptive statistics, χ2, and analysis of variance with repeated measures tests were used to analyze ASR data. All neonates exhibited ASR when stimulated by tonal stimuli or BBN. The mean ASRTs (acoustic stapedial reflex thresholds) for the 0.5, 2, and 4 kHz tones were 81.6 ± 7.9, 71.3 ± 7.9, and 65.4 ± 8.7 dB HL, respectively. The mean ASRT for the BBN was estimated to be smaller than 57.2 dB HL, given the limitation of the equipment. The 95th percentiles of the ASRT were 95, 85, 80, and 75 dB HL for the 0.5, 2, and 4 kHz and BBN, respectively. The test-retest reliability of the ASR test for all stimuli was high, with no significant difference in mean ASRTs across the test and retest conditions. Test-retest differences were within 10 dB for more than 91% of ASRT data across all stimuli. There was a slight trend of ASRTs being more repeatable in the medium ASRT range than in the higher or lower range. This study demonstrated that ASRTs obtained from healthy neonates were highly repeatable across test and retest sessions. Given the availability of normative data and the high test-retest reliability, the ASR test will be useful as a diagnostic tool in a battery of tests to evaluate the auditory function of neonates. American Academy of Audiology.

Test-Retest Reliability of Graph Metrics in Functional Brain Networks: A Resting-State fNIRS Study

PubMed Central

Niu, Haijing; Li, Zhen; Liao, Xuhong; Wang, Jinhui; Zhao, Tengda; Shu, Ni; Zhao, Xiaohu; He, Yong

2013-01-01

Recent research has demonstrated the feasibility of combining functional near-infrared spectroscopy (fNIRS) and graph theory approaches to explore the topological attributes of human brain networks. However, the test-retest (TRT) reliability of the application of graph metrics to these networks remains to be elucidated. Here, we used resting-state fNIRS and a graph-theoretical approach to systematically address TRT reliability as it applies to various features of human brain networks, including functional connectivity, global network metrics and regional nodal centrality metrics. Eighteen subjects participated in two resting-state fNIRS scan sessions held ∼20 min apart. Functional brain networks were constructed for each subject by computing temporal correlations on three types of hemoglobin concentration information (HbO, HbR, and HbT). This was followed by a graph-theoretical analysis, and then an intraclass correlation coefficient (ICC) was further applied to quantify the TRT reliability of each network metric. We observed that a large proportion of resting-state functional connections (∼90%) exhibited good reliability (0.6< ICC <0.74). For global and nodal measures, reliability was generally threshold-sensitive and varied among both network metrics and hemoglobin concentration signals. Specifically, the majority of global metrics exhibited fair to excellent reliability, with notably higher ICC values for the clustering coefficient (HbO: 0.76; HbR: 0.78; HbT: 0.53) and global efficiency (HbO: 0.76; HbR: 0.70; HbT: 0.78). Similarly, both nodal degree and efficiency measures also showed fair to excellent reliability across nodes (degree: 0.52∼0.84; efficiency: 0.50∼0.84); reliability was concordant across HbO, HbR and HbT and was significantly higher than that of nodal betweenness (0.28∼0.68). Together, our results suggest that most graph-theoretical network metrics derived from fNIRS are TRT reliable and can be used effectively for brain network research. This study also provides important guidance on the choice of network metrics of interest for future applied research in developmental and clinical neuroscience. PMID:24039763

Mental imagery boosts music compositional creativity

PubMed Central

Lim, Stephen Wee Hun

2017-01-01

We empirically investigated the effect of mental imagery on young children’s music compositional creativity. Children aged 5 to 8 years participated in two music composition sessions. In the control session, participants based their composition on a motif that they had created using a sequence of letter names. In the mental imagery session, participants were given a picture of an animal and instructed to imagine the animal’s sounds and movements, before incorporating what they had imagined into their composition. Six expert judges independently rated all music compositions on creativity based on subjective criteria (consensual assessment). Reliability analyses indicated that the expert judges demonstrated a high level of agreement in their ratings. The mental imagery compositions received significantly higher creativity ratings by the expert judges than did the control compositions. These results provide evidence for the effectiveness of mental imagery in enhancing young children’s music compositional creativity. PMID:28296965

Competence and Adherence Scale for Cognitive Behavioral Therapy (CAS-CBT) for anxiety disorders in youth: Psychometric properties.

PubMed

Bjaastad, Jon Fauskanger; Haugland, Bente Storm Mowatt; Fjermestad, Krister W; Torsheim, Torbjørn; Havik, Odd E; Heiervang, Einar R; Öst, Lars-Göran

2016-08-01

The aim of the present study was to evaluate the psychometric properties of the Competence and Adherence Scale for Cognitive Behavioral Therapy (CAS-CBT). The CAS-CBT is an 11-item scale developed to measure adherence and competence in cognitive-behavioral therapy (CBT) for anxiety disorders in youth. A total of 181 videotapes from the treatment sessions in a randomized controlled effectiveness trial (Wergeland et al., 2014) comprising youth (N = 182, M age = 11.5 years, SD = 2.1, range 8-15 years, 53% girls, 90.7% Caucasian) with mixed anxiety disorders were assessed with the CAS-CBT to investigate interitem correlations, internal consistency, and factor structure. Internal consistency was good (Cronbach's alpha = .87). Factor analysis suggested a 2-factor solution with Factor 1 representing CBT structure and session goals (explaining 46.9% of the variance) and Factor 2 representing process and relational skills (explaining 19.7% of the variance). The sum-score for adherence and competence was strongly intercorrelated, r = .79, p < .001. Novice raters (graduate psychology students) obtained satisfactory accuracy (ICC > .40, n = 10 videotapes) and also good to excellent interrater reliability when compared to expert raters (ICC = .83 for adherence and .64 for competence, n = 26 videotapes). High rater stability was also found (n = 15 videotapes). The findings suggest that the CAS-CBT is a reliable measure of adherence and competence in manualized CBT for anxiety disorders in youth. Further research is needed to investigate the validity of the scale and psychometric properties when used with other treatment programs, disorders and treatment formats. (PsycINFO Database Record (c) 2016 APA, all rights reserved).

Virtual Reality as a Tool for Evaluation of Repetitive Rhythmic Movements in the Elderly and Parkinson's Disease Patients

PubMed Central

Arias, Pablo; Robles-García, Verónica; Sanmartín, Gabriel; Flores, Julian; Cudeiro, Javier

2012-01-01

This work presents an immersive Virtual Reality (VR) system to evaluate, and potentially treat, the alterations in rhythmic hand movements seen in Parkinson's disease (PD) and the elderly (EC), by comparison with healthy young controls (YC). The system integrates the subjects into a VR environment by means of a Head Mounted Display, such that subjects perceive themselves in a virtual world consisting of a table within a room. In this experiment, subjects are presented in 1st person perspective, so that the avatar reproduces finger tapping movements performed by the subjects. The task, known as the finger tapping test (FT), was performed by all three subject groups, PD, EC and YC. FT was carried out by each subject on two different days (sessions), one week apart. In each FT session all subjects performed FT in the real world (FTREAL) and in the VR (FTVR); each mode was repeated three times in randomized order. During FT both the tapping frequency and the coefficient of variation of inter-tap interval were registered. FTVR was a valid test to detect differences in rhythm formation between the three groups. Intra-class correlation coefficients (ICC) and mean difference between days for FTVR (for each group) showed reliable results. Finally, the analysis of ICC and mean difference between FTVR vs FTREAL, for each variable and group, also showed high reliability. This shows that FT evaluation in VR environments is valid as real world alternative, as VR evaluation did not distort movement execution and detects alteration in rhythm formation. These results support the use of VR as a promising tool to study alterations and the control of movement in different subject groups in unusual environments, such as during fMRI or other imaging studies. PMID:22279559

The intra-individual reproducibility of flash-evoked potentials in a sample of children.

PubMed

Schellberg, D; Gasser, T; Köhler, W

1987-07-01

Visual evoked potentials (VEPs) to flash stimuli were recorded twice from 26 children aged 10-13 years, with an intersession interval of about 10 months. Test-retest reliability was poor for recordings taken from scalp locations overlying non-specific cortex and somewhat better for specific cortex. The size of consistency coefficients (i.e. correlations within session) showed that noise and artefacts were not the decisive factors which lower reliability. A comparison with retest correlations of broad band parameters of the EEG at rest for the same sample showed, to our surprise, smaller retest reliability for VEP parameters. Variability of the VEP in children over time seems to be a substantial as its well-known inter-individual variability.

Reliability and accuracy of a goniometer mobile device application for video measurement of the functional movement screen deep squat test.

PubMed

Krause, David A; Boyd, Michael S; Hager, Allison N; Smoyer, Eric C; Thompson, Anthony T; Hollman, John H

2015-02-01

The squat is a fundamental movement of many athletic and daily activities. Methods to clinically assess the squat maneuver range from simple observation to the use of sophisticated equipment. The purpose of this study was to examine the reliability of Coach's Eye (TechSmith Corp), a 2-dimensional (2D) motion analysis mobile device application (app), for assessing maximal sagittal plane hip, knee, and ankle motion during a functional movement screen deep squat, and to compare range of motion values generated by it to those from a Vicon (Vicon Motion Systems Ltd) 3-dimensional (3D) motion analysis system. Twenty-six healthy subjects performed three functional movement screen deep squats recorded simultaneously by both the app (on an iPad [Apple Inc]) and the 3D motion analysis system. Joint angle data were calculated with Vicon Nexus software (Vicon Motion Systems Ltd). The app video was analyzed frame by frame to determine, and freeze on the screen, the deepest position of the squat. With a capacitive stylus reference lines were then drawn on the iPad screen to determine joint angles. Procedures were repeated with approximately 48 hours between sessions. Test-retest intrarater reliability (ICC3,1) for the app at the hip, knee, and ankle was 0.98, 0.98, and 0.79, respectively. Minimum detectable change was hip 6°, knee 6°, and ankle 7°. Hip joint angles measured with the 2D app exceeded measurements obtained with the 3D motion analysis system by approximately 40°. Differences at the knee and ankle were of lower magnitude, with mean differences of 5° and 3°, respectively. Bland-Altman analysis demonstrated a systematic bias in the hip range-of-motion measurement. No such bias was demonstrated at the knee or ankle. The 2D app demonstrated excellent reliability and appeared to be a responsive means to assess for clinical change, with minimum detectable change values ranging from 6° to 7°. These results also suggest that the 2D app may be used as an alternative to a sophisticated 3D motion analysis system for assessing sagittal plane knee and ankle motion; however, it does not appear to be a comparable alternative for assessing hip motion. 3.

Development of a Computer-Based Format for the Alcohol, Smoking, and Substance Involvement Screening Test (ASSIST) With University Students.

PubMed

Christoff, Adriana Oliveira; Barreto, Heloisa Gomm Arruda; Boerngen-Lacerda, Roseli

2016-07-28

The Alcohol, Smoking, and Substance Involvement Screening Test (ASSIST) is a reliable and valid tool for the early detection of harmful and hazardous drug use in primary care settings when administered by interview in the general population. In university students, substance use is high, so a reliable and feasible screening instrument is needed. To compare the computer-based ASSIST (ASSISTc) with the interview format (ASSISTi). A convenience sample with counterbalanced design was used alternating between the ASSISTi and ASSISTc with 15-day interval. Although this is not a traditional test-retest reliability study, the same statistical analysis was used: intraclass correlations (ICC), kappa (κ), and Cronbach's alpha (α) to compare the two formats. A satisfaction questionnaire was applied immediately after the second session. Both formats were completed by the students (n = 809) over 15 days. The scores of involvement with all substances and with tobacco, alcohol, cannabis, and cocaine obtained with the two formats demonstrated excellent ICC (> .77). The level of agreement was considered substantial for tobacco (κ = .69) and cannabis (κ = .70) and moderate for alcohol (κ = .58). The consistency of the ASSISTc was considered satisfactory (α: .85 for tobacco, .73 for alcohol, and .87 for cannabis). The analysis of satisfaction and feasibility showed that the ASSISTi was easier to understand, but the two formats were considered similar when considering acceptability, ease of responding, and degree of intimidation. The two formats are acceptable, the scores are comparable, and they can be used interchangeably.

Validity and Reliability of a Digital Inclinometer to Assess Knee Joint Position Sense in a Closed Kinetic Chain.

PubMed

Romero-Franco, Natalia; Montaño-Munuera, Juan Antonio; Jiménez-Reyes, Pedro

2017-01-01

Knee joint position sense (JPS) is a key parameter for optimum performance in many sports but is frequently negatively affected by injuries and/or fatigue during training sessions. Although evaluation of JPS may provide key information to reduce the risk of injury, it often requires expensive and/or complex tools that make monitoring proprioceptive deterioration difficult. To analyze the validity and reliability of a digital inclinometer to measure knee JPS in a closed kinetic chain (CKC). The validity and intertester and intratester reliability of a digital inclinometer for measuring knee JPS were assessed. Biomechanics laboratory. 10 athletes (5 men and 5 women; 26.2 ± 1.3 y, 71.7 ± 12.4 kg; 1.75 ± 0.09 m; 23.5 ± 3.9 kg/m 2 ). Knee JPS was measured in a CKC. Absolute angular error (AAE) of knee JPS in a CKC. Intraclass correlation coefficient (ICC) and standard error of the mean (SEM) were calculated to determine the validity and reliability of the inclinometer. Data showed that the inclinometer had a high level of validity compared with an isokinetic dynamometer (ICC = 1.0, SEM = 1.39, p < 0.001), and there was very good intra- and inter-tester reliability for reading the inclinometer (ICC = 1.0, SEM = 0.85, p < 0.001). Compared with AutoCAD video analysis, inclinometer validity was very high (ICC = 0.980, SEM = 3.46, p < 0.001) for measuring AAE during knee JPS in a CKC. In addition, the intertester reliability of the inclinometer for obtaining AAE was very high (ICC = .994, SEM = 1.67, p < 0.001). The inclinometer provides a valid and reliable method for assessing knee JPS in a CKC. Health and sports professionals could take advantage of this tool to monitor proprioceptive deterioration in athletes.

Reliability of Wearable Inertial Measurement Units to Measure Physical Activity in Team Handball.

PubMed

Luteberget, Live S; Holme, Benjamin R; Spencer, Matt

2018-04-01

To assess the reliability and sensitivity of commercially available inertial measurement units to measure physical activity in team handball. Twenty-two handball players were instrumented with 2 inertial measurement units (OptimEye S5; Catapult Sports, Melbourne, Australia) taped together. They participated in either a laboratory assessment (n = 10) consisting of 7 team handball-specific tasks or field assessment (n = 12) conducted in 12 training sessions. Variables, including PlayerLoad™ and inertial movement analysis (IMA) magnitude and counts, were extracted from the manufacturers' software. IMA counts were divided into intensity bands of low (1.5-2.5 m·s -1 ), medium (2.5-3.5 m·s -1 ), high (>3.5 m·s -1 ), medium/high (>2.5 m·s -1 ), and total (>1.5 m·s -1 ). Reliability between devices and sensitivity was established using coefficient of variation (CV) and smallest worthwhile difference (SWD). Laboratory assessment: IMA magnitude showed a good reliability (CV = 3.1%) in well-controlled tasks. CV increased (4.4-6.7%) in more-complex tasks. Field assessment: Total IMA counts (CV = 1.8% and SWD = 2.5%), PlayerLoad (CV = 0.9% and SWD = 2.1%), and their associated variables (CV = 0.4-1.7%) showed a good reliability, well below the SWD. However, the CV of IMA increased when categorized into intensity bands (2.9-5.6%). The reliability of IMA counts was good when data were displayed as total, high, or medium/high counts. A good reliability for PlayerLoad and associated variables was evident. The CV of the previously mentioned variables was well below the SWD, suggesting that OptimEye's inertial measurement unit and its software are sensitive for use in team handball.

Reliability of Fitness Tests Using Methods and Time Periods Common in Sport and Occupational Management

PubMed Central

Burnstein, Bryan D.; Steele, Russell J.; Shrier, Ian

2011-01-01

Context: Fitness testing is used frequently in many areas of physical activity, but the reliability of these measurements under real-world, practical conditions is unknown. Objective: To evaluate the reliability of specific fitness tests using the methods and time periods used in the context of real-world sport and occupational management. Design: Cohort study. Setting: Eighteen different Cirque du Soleil shows. Patients or Other Participants: Cirque du Soleil physical performers who completed 4 consecutive tests (6-month intervals) and were free of injury or illness at each session (n = 238 of 701 physical performers). Intervention(s): Performers completed 6 fitness tests on each assessment date: dynamic balance, Harvard step test, handgrip, vertical jump, pull-ups, and 60-second jump test. Main Outcome Measure(s): We calculated the intraclass coefficient (ICC) and limits of agreement between baseline and each time point and the ICC over all 4 time points combined. Results: Reliability was acceptable (ICC > 0.6) over an 18-month time period for all pairwise comparisons and all time points together for the handgrip, vertical jump, and pull-up assessments. The Harvard step test and 60-second jump test had poor reliability (ICC < 0.6) between baseline and other time points. When we excluded the baseline data and calculated the ICC for 6-month, 12-month, and 18-month time points, both the Harvard step test and 60-second jump test demonstrated acceptable reliability. Dynamic balance was unreliable in all contexts. Limit-of-agreement analysis demonstrated considerable intraindividual variability for some tests and a learning effect by administrators on others. Conclusions: Five of the 6 tests in this battery had acceptable reliability over an 18-month time frame, but the values for certain individuals may vary considerably from time to time for some tests. Specific tests may require a learning period for administrators. PMID:22488138

A feasibility study of a new computerised cognitive remediation for young adults with schizophrenia

PubMed Central

Cellard, Caroline; Reeder, Clare; Paradis-Giroux, Andrée-Anne; Roy, Marc-André; Gilbert, Elsa; Ivers, Hans; Bouchard, Roch-Hugo; Maziade, Michel; Wykes, Til

2016-01-01

Cognitive remediation therapy is effective for improving cognition, symptoms and social functioning in individuals with schizophrenia; however, the impact on visual episodic memory remains unclear. The objectives of this feasibility study were: (1) to explore whether or not CIRCuiTS—a new computerised cognitive remediation therapy programme developed in England—improves visual episodic memory and other cognitive domains in young adults with early course schizophrenia; and (2) to evaluate acceptability of the CIRCuiTS programme in French-Canadians. Three participants with visual episodic memory impairments at baseline were recruited from clinical settings in Canada, and consented to participate. Neuropsychological, clinical and social functioning was evaluated at baseline and post-treatment. Intervention involved 40 sessions of cognitive remediation. First, the reliable change index (RCI) revealed that each participant demonstrated significant post-therapy change in episodic memory and in other cognitive domains. The response profile was characterised by the use of organisational strategies. Second, the treatment was considered acceptable to participants in terms of session frequency (number of sessions per week), intensity (hours per week; total hours), and number of missed sessions and total completed sessions. This preliminary study yielded encouraging data demonstrating the feasibility of the CIRCuiTS programme in French-Canadian young adults with schizophrenia. PMID:25753694

Prediction of School Performance from the Minnesota Child Development Inventory: Implications for Preschool Screening.

ERIC Educational Resources Information Center

Colligan, Robert C.

Almost all preschool screening programs depend entirely on information and observations obtained during a brief evaluative session with the child. However, the logistics involved in managing large numbers of parents and children, the use of volunteers having varying degrees of sophistication or competency in assessment, the reliability and…

On Information Retrieval (IR) Systems: Revisiting Their Development, Evaluation Methodologies, and Assumptions (SIGs LAN, ED).

ERIC Educational Resources Information Center

Stirling, Keith

2000-01-01

Describes a session on information retrieval systems that planned to discuss relevance measures with Web-based information retrieval; retrieval system performance and evaluation; probabilistic independence of index terms; vector-based models; metalanguages and digital objects; how users assess the reliability, timeliness and bias of information;…

Development and Preliminary Evaluation of a FAP Protocol: Brief Relationship Enhancement

ERIC Educational Resources Information Center

Holman, Gareth; Kohlenberg, Robert J.; Tsai, Mavis

2012-01-01

The purpose of this study was to develop a brief Functional Analytic Psychotherapy (FAP) protocol that will facilitate reliable implementation of FAP interventions, thus supporting research on FAP process and outcome. The treatment was a four-session individual therapy for clients who were interested in improving their relationship with their…

Evaluation of Clinical Reasoning in Basic Emergencies Using a Script Concordance Test

PubMed Central

Charlin, Bernard; Vanpee, Dominique

2010-01-01

Objectives To develop and assess the reliability of a script concordance test (SCT) to evaluate pharmacy students' clinical reasoning when facing basic emergency situations. Design A first aid course was designed that consisted of 8 weekly instructional sessions (4 on internal medicine, including life threatening situations; 2 on pediatrics; and 2 on trauma) in which the instructor presented case studies in a small-group format. In the first and final sessions of the course, a practice SCT was administered to familiarize students with the test format. Assessment A 66-question SCT examination was administered to the 68 third-year pharmacy students enrolled in the first aid course. The students' mean score was 68.5% ± 9.8% and panel members' mean score was 86.5% ± 4.2%. Twenty students were selected randomly to complete a course survey and 85% indicated they were satisfied with using the SCT. Conclusions A first aid SCT was found to be both a practical and reliable testing instrument for assessing the clinical reasoning of pharmacy students in basic emergency situations. PMID:21436943

Content Analysis of 32 Years of American Counseling Association Convention Programs

ERIC Educational Resources Information Center

Helwig, Andrew A.; Schmidt, Lisa L. L.

2011-01-01

A content analysis of American Counseling Association convention sessions offered from 1977 to 2008 was conducted. The intent was to identify changes and trends in the counseling profession. Content of more than 15,000 sessions, including educational programs, keynote presentations, and training sessions, was assigned to 1 of 86 categories. A…

Five Decades of ALER Conference Session Presentations, 1960-2010

ERIC Educational Resources Information Center

Still, Kristine Lynn; Gordon, Jaclyn Prizant

2011-01-01

The purpose of this study was to conduct a quantitative content analysis of the conference session programs from the Association of Literacy Educators and Researchers (ALER) annual meetings across five decades spanning from 1960 through 2010. The data cycled through an analysis during four separate phases. In total, 4,605 conference sessions were…

Force-Velocity Relationship of Upper Body Muscles: Traditional Versus Ballistic Bench Press.

PubMed

García-Ramos, Amador; Jaric, Slobodan; Padial, Paulino; Feriche, Belén

2016-04-01

This study aimed to (1) evaluate the linearity of the force-velocity relationship, as well as the reliability of maximum force (F0), maximum velocity (V0), slope (a), and maximum power (P0); (2) compare these parameters between the traditional and ballistic bench press (BP); and (3) determine the correlation of F0 with the directly measured BP 1-repetition maximum (1RM). Thirty-two men randomly performed 2 sessions of traditional BP and 2 sessions of ballistic BP during 2 consecutive weeks. Both the maximum and mean values of force and velocity were recorded when loaded by 20-70% of 1RM. All force-velocity relationships were strongly linear (r > .99). While F0 and P0 were highly reliable (ICC: 0.91-0.96, CV: 3.8-5.1%), lower reliability was observed for V0 and a (ICC: 0.49-0.81, CV: 6.6-11.8%). Trivial differences between exercises were found for F0 (ES: < 0.2), however the a was higher for the traditional BP (ES: 0.68-0.94), and V0 (ES: 1.04-1.48) and P0 (ES: 0.65-0.72) for the ballistic BP. The F0 strongly correlated with BP 1RM (r: 0.915-0.938). The force-velocity relationship is useful to assess the upper body maximal capabilities to generate force, velocity, and power.

The reliability of isoinertial force-velocity-power profiling and maximal strength assessment in youth.

PubMed

Meylan, César M P; Cronin, John B; Oliver, Jon L; Hughes, Michael M G; Jidovtseff, Boris; Pinder, Shane

2015-03-01

The purpose of this study was to quantify the inter-session reliability of force-velocity-power profiling and estimated maximal strength in youth. Thirty-six males (11-15 years old) performed a ballistic supine leg press test at five randomized loads (80%, 100%, 120%, 140%, and 160% body mass) on three separate occasions. Peak and mean force, power, velocity, and peak displacement were collected with a linear position transducer attached to the weight stack. Mean values at each load were used to calculate different regression lines and estimate maximal strength, force, velocity, and power. All variables were found reliable (change in the mean [CIM] = - 1 to 14%; coefficient of variation [CV] = 3-18%; intraclass correlation coefficient [ICC] = 0.74-0.99), but were likely to benefit from a familiarization, apart from the unreliable maximal force/velocity ratio (CIM = 0-3%; CV = 23-25%; ICC = 0.35-0.54) and load at maximal power (CIM = - 1 to 2%; CV = 10-13%; ICC = 0.26-0.61). Isoinertial force-velocity-power profiling and maximal strength in youth can be assessed after a familiarization session. Such profiling may provide valuable insight into neuromuscular capabilities during growth and maturation and may be used to monitor specific training adaptations.

Reliability and Usefulness of Linear Sprint Testing in Adolescent Rugby Union and League Players.

PubMed

Darrall-Jones, Joshua D; Jones, Ben; Roe, Gregory; Till, Kevin

2016-05-01

The purpose of this study was to evaluate (a) whether there were differences in sprint times at 5, 10, 20, 30, and 40 m between rugby union and rugby league players, (b) determine the reliability and usefulness of linear sprint testing in adolescent rugby players. Data were collected on 28 rugby union and league academy players over 2 testing sessions, with 3-day rest between sessions. Rugby league players were faster at 5 m than rugby union players, with further difference unclear. Sprint time at 10, 20, 30, and 40 m was all reliable (coefficient of variation [CV] = 3.1, 1.8, 2.0, and 1.3%) but greater than the smallest worthwhile change (SWC [0.2 × between-subject SD]), rating the test as marginal for usefulness. Although the test was incapable of detecting the SWC, we recommend that practitioners and researchers use Hopkins' proposed method; whereby plotting the change score of the individual at each split (±typical error [TE] expressed as a CV) against the SWC and visually inspecting whether the TE crosses into the SWC are capable of identifying whether a change is both real (greater than the noise of the test, i.e., >TE) and of practical significance (>SWC). Researchers and practitioners can use the TE and SWC from this study to assess changes in performance of adolescent rugby players when using single beam timing gates.

Two baselines are better than one: Improving the reliability of computerized testing in sports neuropsychology.

PubMed

Bruce, Jared; Echemendia, Ruben; Tangeman, Lindy; Meeuwisse, Willem; Comper, Paul; Hutchison, Michael; Aubry, Mark

2016-01-01

Computerized neuropsychological tests are frequently used to assist in return-to-play decisions following sports concussion. However, due to concerns about test reliability, the Centers for Disease Control and Prevention recommends yearly baseline testing. The standard practice that has developed in baseline/postinjury comparisons is to examine the difference between the most recent baseline test and postconcussion performance. Drawing from classical test theory, the present study investigated whether temporal stability could be improved by taking an alternate approach that uses the aggregate of 2 baselines to more accurately estimate baseline cognitive ability. One hundred fifteen English-speaking professional hockey players with 3 consecutive Immediate Postconcussion Assessment and Testing (ImPACT) baseline tests were extracted from a clinical program evaluation database overseen by the National Hockey League and National Hockey League Players' Association. The temporal stability of ImPACT composite scores was significantly increased by aggregating test performance during Sessions 1 and 2 to predict performance during Session 3. Using this approach, the 2-factor Memory (r = .72) and Speed (r = .79) composites of ImPACT showed acceptable long-term reliability. Using the aggregate of 2 baseline scores significantly improves temporal stability and allows for more accurate predictions of cognitive change following concussion. Clinicians are encouraged to estimate baseline abilities by taking into account all of an athlete's previous baseline scores.

How stable is activation in the amygdala and prefrontal cortex in adolescence? A study of emotional face processing across three measurements.

PubMed

van den Bulk, Bianca G; Koolschijn, P Cédric M P; Meens, Paul H F; van Lang, Natasja D J; van der Wee, Nic J A; Rombouts, Serge A R B; Vermeiren, Robert R J M; Crone, Eveline A

2013-04-01

Prior developmental functional magnetic resonance imaging (fMRI) studies have demonstrated elevated activation patterns in the amygdala and prefrontal cortex (PFC) in response to viewing emotional faces. As adolescence is a time of substantial variability in mood and emotional responsiveness, the stability of activation patterns could be fluctuating over time. In the current study, 27 healthy adolescents (age: 12-19 years) were scanned three times over a period of six months (mean test-retest interval of three months; final samples N=27, N=22, N=18). At each session, participants performed the same emotional faces task. At first measurement the presentation of emotional faces resulted in heightened activation in bilateral amygdala, bilateral lateral PFC and visual areas including the fusiform face area. Average activation did not differ across test-sessions over time, indicating that at the group level activation patterns in this network do not vary significantly over time. However, using the Intraclass Correlation Coefficient (ICC), fMRI reliability demonstrated only fair reliability for PFC (ICC=0.41-0.59) and poor reliability for the amygdala (ICC<0.4). These findings suggest substantial variability of brain activity over time and may have implications for studies investigating the influence of treatment effects on changes in neural levels in adolescents with psychiatric disorders. Copyright © 2012 Elsevier Ltd. All rights reserved.

Report for 2011 from the Bordeaux IVS Analysis Center

NASA Technical Reports Server (NTRS)

Charlot, Patrick; Bellanger, Antoine; Bourda, Geraldine; Collioud, Arnaud; Baudry, Alain

2012-01-01

This report summarizes the activities of the Bordeaux IVS Analysis Center during the year 2011. The work focused on (i) regular analysis of the IVS-R1 and IVS-R4 sessions with the GINS software package; (ii) systematic VLBI imaging of the RDV sessions and calculation of the corresponding source structure index and compactness values; (iii) imaging of the sources observed during the 2009 International Year of Astronomy IVS observing session; and (iv) continuation of our VLBI observational program to identify optically-bright radio sources suitable for the link with the future Gaia frame. Also of importance is the enhancement of the IVS LiveWeb site which now comprises all IVS sessions back to 2003, allowing one to search past observations for session-specific information (e.g. sources or stations).

[Training, the key to improving eHealth literacy of upper secondary school students].

PubMed

Hernández-Rabanal, Carme; Vall, Aurora; Boter, Clara

To explore whether training on strategies to identify and assess health-related information online has a positive impact on students' perception of their own eHealth literacy. The validated eHealth Literacy Scale (eHEALS) was administered to a sample of upper secondary school students, aged 15-18. One week later, they attended a training session on how to search and identify reliable health-related information and resources online. The eHEALS was administered again at the end of this session. Information about gender and school year was collected in both sessions. Perceived eHealth literacy was assessed by comparing the scores obtained before and after the session. Bivariate and multiple linear regressions were completed. Of the 298 students enrolled in upper secondary school (Bachillerato), 285 were included in the study. Approximately 52.28% (149) were female, and 47.72% (136) were male. The mean eHEALS score before the session was 24.19 (range: 8-40), and was 28.54 after it. The training was associated with higher perceived eHealth literacy scores (p <0,0001). Health literacy was positively associated with the usefulness and importance students give the Internet. Attendance at a training session on strategies to identify and assess health-related resources online is associated with higher levels of perceived eHealth literacy. Implementing specific training sessions on eHealth literacy in upper secondary school is a promising approach for enhancing students' eHealth literacy. Copyright © 2017 SESPAS. Publicado por Elsevier España, S.L.U. All rights reserved.

Psychometric Properties of a Standardized Observation Protocol to Quantify Pediatric Physical Therapy Actions.

PubMed

Sonderer, Patrizia; Akhbari Ziegler, Schirin; Gressbach Oertle, Barbara; Meichtry, André; Hadders-Algra, Mijna

2017-07-01

Pediatric physical therapy (PPT) is characterized by heterogeneity. This blurs the evaluation of effective components of PPT. The Groningen Observation Protocol (GOP) was developed to quantify contents of PPT. This study assesses the reliability and completeness of the GOP. Sixty infant PPT sessions were video-taped. Two random samples of 10 videos were used to determine interrater and intrarater reliability using interclass correlation coefficients (ICCs) with 95% confidence intervals. Completeness of GOP 2.0 was based on 60 videos. Interrater reliability of quantifying PPT actions was excellent (ICC, 0.75-1.0) in 71% and sufficient to good (ICC, 0.4-0.74) in 24% of PPT actions. Intrarater reliability was excellent in 94% and sufficient to good in 6% of PPT actions. Completeness was good for greater than 90% of PPT actions. GOP 2.0 has good reliability and completeness. After appropriate training, it is a useful tool to quantify PPT for children with developmental disorders.

System reliability, performance and trust in adaptable automation.

PubMed

Chavaillaz, Alain; Wastell, David; Sauer, Jürgen

2016-01-01

The present study examined the effects of reduced system reliability on operator performance and automation management in an adaptable automation environment. 39 operators were randomly assigned to one of three experimental groups: low (60%), medium (80%), and high (100%) reliability of automation support. The support system provided five incremental levels of automation which operators could freely select according to their needs. After 3 h of training on a simulated process control task (AutoCAMS) in which the automation worked infallibly, operator performance and automation management were measured during a 2.5-h testing session. Trust and workload were also assessed through questionnaires. Results showed that although reduced system reliability resulted in lower levels of trust towards automation, there were no corresponding differences in the operators' reliance on automation. While operators showed overall a noteworthy ability to cope with automation failure, there were, however, decrements in diagnostic speed and prospective memory with lower reliability. Copyright © 2015. Published by Elsevier Ltd.

Reliability of adherence and competence assessment in cognitive behavioral therapy: influence of clinical experience.

PubMed

Weck, Florian; Hilling, Christine; Schermelleh-Engel, Karin; Rudari, Visar; Stangier, Ulrich

2011-04-01

The use of highly experienced expert judges was suggested for the assessment of therapists' adherence and competence. However, such an approach implies high costs. It can be questioned whether only experts are able to evaluate therapists' adherence and competence reliably. To test this, 4 judges evaluated therapist adherence and competence in 30 randomly selected videotapes of cognitive therapy sessions for depression. In that, 2 judges exhibited high clinical experience (experts), whereas 2 judges did not (novices). We could demonstrate that novices evaluated an aggregated adherence and competence measure with high reliability. However, several adherence and competence aspects were not assessed with satisfactory reliability by novices. Although adherence ratings of experts and novices showed high concordance, the concordance of competence ratings was only moderate. Results revealed that therapists' adherence could be evaluated satisfactorily by trained novices with some restrictions, but not their competence.

Quantifying the test-retest reliability of cerebral blood flow measurements in a clinical model of on-going post-surgical pain: A study using pseudo-continuous arterial spin labelling.

PubMed

Hodkinson, Duncan J; Krause, Kristina; Khawaja, Nadine; Renton, Tara F; Huggins, John P; Vennart, William; Thacker, Michael A; Mehta, Mitul A; Zelaya, Fernando O; Williams, Steven C R; Howard, Matthew A

2013-01-01

Arterial spin labelling (ASL) is increasingly being applied to study the cerebral response to pain in both experimental human models and patients with persistent pain. Despite its advantages, scanning time and reliability remain important issues in the clinical applicability of ASL. Here we present the test-retest analysis of concurrent pseudo-continuous ASL (pCASL) and visual analogue scale (VAS), in a clinical model of on-going pain following third molar extraction (TME). Using ICC performance measures, we were able to quantify the reliability of the post-surgical pain state and ΔCBF (change in CBF), both at the group and individual case level. Within-subject, the inter- and intra-session reliability of the post-surgical pain state was ranked good-to-excellent (ICC > 0.6) across both pCASL and VAS modalities. The parameter ΔCBF (change in CBF between pre- and post-surgical states) performed reliably (ICC > 0.4), provided that a single baseline condition (or the mean of more than one baseline) was used for subtraction. Between-subjects, the pCASL measurements in the post-surgical pain state and ΔCBF were both characterised as reliable (ICC > 0.4). However, the subjective VAS pain ratings demonstrated a significant contribution of pain state variability, which suggests diminished utility for interindividual comparisons. These analyses indicate that the pCASL imaging technique has considerable potential for the comparison of within- and between-subjects differences associated with pain-induced state changes and baseline differences in regional CBF. They also suggest that differences in baseline perfusion and functional lateralisation characteristics may play an important role in the overall reliability of the estimated changes in CBF. Repeated measures designs have the important advantage that they provide good reliability for comparing condition effects because all sources of variability between subjects are excluded from the experimental error. The ability to elicit reliable neural correlates of on-going pain using quantitative perfusion imaging may help support the conclusions derived from subjective self-report.

Stimulus and optode placement effects on functional near-infrared spectroscopy of visual cortex

PubMed Central

Kashou, Nasser H.; Giacherio, Brenna M.

2016-01-01

Abstract. Functional near-infrared spectroscopy has yet to be implemented as a stand-alone technique within an ophthalmology clinical setting, despite its promising advantages. The present study aims to further investigate reliability of visual cortical signals. This was achieved by: (1) assessing the effects of optode placements using the 10–20 International System of Electrode Placement consisting of 28 channels, (2) determining effects of stimulus size on response, and (3) evaluating response variability as a result of cap placement across three sessions. Ten participants with mean age 23.8±4.8 years (five male) and varying types of hair color and thickness were recruited. Visual stimuli of black-and-white checkerboards, reversing at a frequency of 7.5 Hz were presented. Visual angles of individual checker squares included 1 deg, 2 deg, 5 deg, 9 deg, and 18 deg. The number of channels that showed response was analyzed for each participant, stimulus size, and session. 1-deg stimulus showed the greatest activation. One of three data collection sessions for each participant gave different results (p<0.05). Hair color and thickness each had an effect upon the overall HbO (p<0.05), while only color had a significant effect for HbD (p<0.05). A reliable level of robustness and consistency is still required for clinical implementation and assessment of visual dysfunction. PMID:27335887

The development and validation of a test of science critical thinking for fifth graders.

PubMed

Mapeala, Ruslan; Siew, Nyet Moi

2015-01-01

The paper described the development and validation of the Test of Science Critical Thinking (TSCT) to measure the three critical thinking skill constructs: comparing and contrasting, sequencing, and identifying cause and effect. The initial TSCT consisted of 55 multiple choice test items, each of which required participants to select a correct response and a correct choice of critical thinking used for their response. Data were obtained from a purposive sampling of 30 fifth graders in a pilot study carried out in a primary school in Sabah, Malaysia. Students underwent the sessions of teaching and learning activities for 9 weeks using the Thinking Maps-aided Problem-Based Learning Module before they answered the TSCT test. Analyses were conducted to check on difficulty index (p) and discrimination index (d), internal consistency reliability, content validity, and face validity. Analysis of the test-retest reliability data was conducted separately for a group of fifth graders with similar ability. Findings of the pilot study showed that out of initial 55 administered items, only 30 items with relatively good difficulty index (p) ranged from 0.40 to 0.60 and with good discrimination index (d) ranged within 0.20-1.00 were selected. The Kuder-Richardson reliability value was found to be appropriate and relatively high with 0.70, 0.73 and 0.92 for identifying cause and effect, sequencing, and comparing and contrasting respectively. The content validity index obtained from three expert judgments equalled or exceeded 0.95. In addition, test-retest reliability showed good, statistically significant correlations ([Formula: see text]). From the above results, the selected 30-item TSCT was found to have sufficient reliability and validity and would therefore represent a useful tool for measuring critical thinking ability among fifth graders in primary science.

Assessment of lumbosacral kyphosis in spondylolisthesis: a computer-assisted reliability study of six measurement techniques

PubMed Central

Glavas, Panagiotis; Mac-Thiong, Jean-Marc; Parent, Stefan; de Guise, Jacques A.

2008-01-01

Although recognized as an important aspect in the management of spondylolisthesis, there is no consensus on the most reliable and optimal measure of lumbosacral kyphosis (LSK). Using a custom computer software, four raters evaluated 60 standing lateral radiographs of the lumbosacral spine during two sessions at a 1-week interval. The sample size consisted of 20 normal, 20 low and 20 high grade spondylolisthetic subjects. Six parameters were included for analysis: Boxall’s slip angle, Dubousset’s lumbosacral angle (LSA), the Spinal Deformity Study Group’s (SDSG) LSA, dysplastic SDSG LSA, sagittal rotation (SR), kyphotic Cobb angle (k-Cobb). Intra- and inter-rater reliability for all parameters was assessed using intra-class correlation coefficients (ICC). Correlations between parameters and slip percentage were evaluated with Pearson coefficients. The intra-rater ICC’s for all the parameters ranged between 0.81 and 0.97 and the inter-rater ICC’s were between 0.74 and 0.98. All parameters except sagittal rotation showed a medium to large correlation with slip percentage. Dubousset’s LSA and the k-Cobb showed the largest correlations (r = −0.78 and r = −0.50, respectively). SR was associated with the weakest correlation (r = −0.10). All other parameters had medium correlations with percent slip (r = 0.31–0.43). All measurement techniques provided excellent inter- and intra-rater reliability. Dubousset’s LSA showed the strongest correlation with slip grade. This parameter can be used in the clinical setting with PACS software capabilities to assess LSK. A computer-assisted technique is recommended in order to increase the reliability of the measurement of LSK in spondylolisthesis. PMID:19015898

Within- and between-session replicability of cognitive brain processes: An MEG study with an N-back task.

PubMed

Ahonen, L; Huotilainen, M; Brattico, E

2016-05-01

In the vast majority of electrophysiological studies on cognition, participants are only measured once during a single experimental session. The dearth of studies on test-retest reliability in magnetoencephalography (MEG) within and across experimental sessions is a preventing factor for longitudinal designs, imaging genetics studies, and clinical applications. From the recorded signals, it is not straightforward to draw robust and steady indices of brain activity that could directly be used in exploring behavioral effects or genetic associations. To study the variations in markers associated with cognitive functions, we extracted three event-related field (ERF) features from time-locked global field power (GFP) epochs using MEG while participants were performing a numerical N-back task in four consecutive measurements conducted during two different days separated by two weeks. We demonstrate that the latency of the M170, a neural correlate associated with cognitive functions such as working memory, was a stable parameter and did not show significant variations over time. In addition, the M170 peak amplitude and the mean amplitude of late positive component (LPP) also expressed moderate-to-strong reliability across multiple measures over time over many sensor spaces and between participants. The M170 amplitude varied more significantly between the measurements in some conditions but showed consistency over the participants over time. In addition we demonstrated significant correlation with the M170 and LPP parameters and cognitive load. The results are in line with the literature showing less within-subject fluctuation for the latency parameters and more consistency in between-subject comparisons for amplitude based features. The within-subject consistency was apparent also with longer delays between the measurements. We suggest that with a few limitations the ERF features show sufficient reliability and stability for longitudinal research designs and clinical applications for cognitive functions in single as well as cross-subject designs. Copyright © 2016 Elsevier Inc. All rights reserved.

A ground-based comparison of the Muscle Atrophy Research and Exercise System (MARES) and a commercially available isokinetic dynamometer

NASA Astrophysics Data System (ADS)

English, Kirk L.; Hackney, Kyle J.; De Witt, John K.; Ploutz-Snyder, Robert J.; Goetchius, Elizabeth L.; Ploutz-Snyder, Lori L.

2013-11-01

IntroductionInternational Space Station (ISS) crewmembers perform muscle strength and endurance testing pre- and postflight to assess the physiologic adaptations associated with long-duration exposure to microgravity. However, a reliable and standardized method to document strength changes in-flight has not been established. To address this issue, a proprietary dynamometer, the Muscle Atrophy Research and Exercise System (MARES) has been developed and flown aboard the ISS. The aims of this ground-based investigation were to: (1) evaluate the test-retest reliability of MARES and (2) determine its agreement with a commercially available isokinetic dynamometer previously used for pre- and postflight medical testing. MethodsSix males (179.5±4.7 cm; 82.0±8.7 kg; 31.3±4.0 yr) and four females (163.2±7.3 cm; 63.2±1.9 kg; 32.3±6.8 yr) completed two testing sessions on a HUMAC NORM isokinetic dynamometer (NORM) and two sessions on MARES using a randomized, counterbalanced, cross-over design. Peak torque values at 60° and 180° s-1 were calculated from five maximal repetitions of knee extension (KE) and knee flexion (KF) for each session. Total work at 180° s-1 was determined from the area under the torque versus displacement curve during 20 maximal repetitions of KE and KF. ResultsIntraclass correlation coefficients were relatively high for both devices (0.90-0.99). Only one dependent measure, KE peak torque at 60° s-1 exhibited good concordance between devices (ρ=0.92) and a small average difference (0.9±17.3 N m). ConclusionMARES demonstrated acceptable test-retest reliability and thus should serve as a good tool to monitor in-flight strength changes. However, due to poor agreement with NORM, it is not advisable to compare absolute values obtained on these devices.

Multisite longitudinal reliability of tract-based spatial statistics in diffusion tensor imaging of healthy elderly subjects.

PubMed

Jovicich, Jorge; Marizzoni, Moira; Bosch, Beatriz; Bartrés-Faz, David; Arnold, Jennifer; Benninghoff, Jens; Wiltfang, Jens; Roccatagliata, Luca; Picco, Agnese; Nobili, Flavio; Blin, Oliver; Bombois, Stephanie; Lopes, Renaud; Bordet, Régis; Chanoine, Valérie; Ranjeva, Jean-Philippe; Didic, Mira; Gros-Dagnac, Hélène; Payoux, Pierre; Zoccatelli, Giada; Alessandrini, Franco; Beltramello, Alberto; Bargalló, Núria; Ferretti, Antonio; Caulo, Massimo; Aiello, Marco; Ragucci, Monica; Soricelli, Andrea; Salvadori, Nicola; Tarducci, Roberto; Floridi, Piero; Tsolaki, Magda; Constantinidis, Manos; Drevelegas, Antonios; Rossini, Paolo Maria; Marra, Camillo; Otto, Josephin; Reiss-Zimmermann, Martin; Hoffmann, Karl-Titus; Galluzzi, Samantha; Frisoni, Giovanni B

2014-11-01

Large-scale longitudinal neuroimaging studies with diffusion imaging techniques are necessary to test and validate models of white matter neurophysiological processes that change in time, both in healthy and diseased brains. The predictive power of such longitudinal models will always be limited by the reproducibility of repeated measures acquired during different sessions. At present, there is limited quantitative knowledge about the across-session reproducibility of standard diffusion metrics in 3T multi-centric studies on subjects in stable conditions, in particular when using tract based spatial statistics and with elderly people. In this study we implemented a multi-site brain diffusion protocol in 10 clinical 3T MRI sites distributed across 4 countries in Europe (Italy, Germany, France and Greece) using vendor provided sequences from Siemens (Allegra, Trio Tim, Verio, Skyra, Biograph mMR), Philips (Achieva) and GE (HDxt) scanners. We acquired DTI data (2 × 2 × 2 mm(3), b = 700 s/mm(2), 5 b0 and 30 diffusion weighted volumes) of a group of healthy stable elderly subjects (5 subjects per site) in two separate sessions at least a week apart. For each subject and session four scalar diffusion metrics were considered: fractional anisotropy (FA), mean diffusivity (MD), radial diffusivity (RD) and axial (AD) diffusivity. The diffusion metrics from multiple subjects and sessions at each site were aligned to their common white matter skeleton using tract-based spatial statistics. The reproducibility at each MRI site was examined by looking at group averages of absolute changes relative to the mean (%) on various parameters: i) reproducibility of the signal-to-noise ratio (SNR) of the b0 images in centrum semiovale, ii) full brain test-retest differences of the diffusion metric maps on the white matter skeleton, iii) reproducibility of the diffusion metrics on atlas-based white matter ROIs on the white matter skeleton. Despite the differences of MRI scanner configurations across sites (vendors, models, RF coils and acquisition sequences) we found good and consistent test-retest reproducibility. White matter b0 SNR reproducibility was on average 7 ± 1% with no significant MRI site effects. Whole brain analysis resulted in no significant test-retest differences at any of the sites with any of the DTI metrics. The atlas-based ROI analysis showed that the mean reproducibility errors largely remained in the 2-4% range for FA and AD and 2-6% for MD and RD, averaged across ROIs. Our results show reproducibility values comparable to those reported in studies using a smaller number of MRI scanners, slightly different DTI protocols and mostly younger populations. We therefore show that the acquisition and analysis protocols used are appropriate for multi-site experimental scenarios. Copyright © 2014 Elsevier Inc. All rights reserved.

Cost and threshold analysis of an HIV/STI/hepatitis prevention intervention for young men leaving prison: Project START.

PubMed

Johnson, A P; Macgowan, R J; Eldridge, G D; Morrow, K M; Sosman, J; Zack, B; Margolis, A

2013-10-01

The objectives of this study were to: (a) estimate the costs of providing a single-session HIV prevention intervention and a multi-session intervention, and (b) estimate the number of HIV transmissions that would need to be prevented for the intervention to be cost-saving or cost-effective (threshold analysis). Project START was evaluated with 522 young men aged 18-29 years released from eight prisons located in California, Mississippi, Rhode Island, and Wisconsin. Cost data were collected prospectively. Costs per participant were $689 for the single-session comparison intervention, and ranged from $1,823 to 1,836 for the Project START multi-session intervention. From the incremental threshold analysis, the multi-session intervention would be cost-effective if it prevented one HIV transmission for every 753 participants compared to the single-session intervention. Costs are comparable with other HIV prevention programs. Program managers can use these data to gauge costs of initiating these HIV prevention programs in correctional facilities.

Neurofeedback training aimed to improve focused attention and alertness in children with ADHD: a study of relative power of EEG rhythms using custom-made software application.

PubMed

Hillard, Brent; El-Baz, Ayman S; Sears, Lonnie; Tasman, Allan; Sokhadze, Estate M

2013-07-01

Neurofeedback is a nonpharmacological treatment for attention-deficit hyperactivity disorder (ADHD). We propose that operant conditioning of electroencephalogram (EEG) in neurofeedback training aimed to mitigate inattention and low arousal in ADHD, will be accompanied by changes in EEG bands' relative power. Patients were 18 children diagnosed with ADHD. The neurofeedback protocol ("Focus/Alertness" by Peak Achievement Trainer) has a focused attention and alertness training mode. The neurofeedback protocol provides one for Focus and one for Alertness. This does not allow for collecting information regarding changes in specific EEG bands (delta, theta, alpha, low and high beta, and gamma) power within the 2 to 45 Hz range. Quantitative EEG analysis was completed on each of twelve 25-minute-long sessions using a custom-made MatLab application to determine the relative power of each of the aforementioned EEG bands throughout each session, and from the first session to the last session. Additional statistical analysis determined significant changes in relative power within sessions (from minute 1 to minute 25) and between sessions (from session 1 to session 12). Analysis was of relative power of theta, alpha, low and high beta, theta/alpha, theta/beta, and theta/low beta and theta/high beta ratios. Additional secondary measures of patients' post-neurofeedback outcomes were assessed, using an audiovisual selective attention test (IVA + Plus) and behavioral evaluation scores from the Aberrant Behavior Checklist. Analysis of data computed in the MatLab application, determined that theta/low beta and theta/alpha ratios decreased significantly from session 1 to session 12, and from minute 1 to minute 25 within sessions. The findings regarding EEG changes resulting from brain wave self-regulation training, along with behavioral evaluations, will help elucidate neural mechanisms of neurofeedback aimed to improve focused attention and alertness in ADHD.

Efficacy, safety and outcome of frameless image-guided robotic radiosurgery for brain metastases after whole brain radiotherapy.

PubMed

Lohkamp, Laura-Nanna; Vajkoczy, Peter; Budach, Volker; Kufeld, Markus

2018-05-01

Estimating efficacy, safety and outcome of frameless image-guided robotic radiosurgery for the treatment of recurrent brain metastases after whole brain radiotherapy (WBRT). We performed a retrospective single-center analysis including patients with recurrent brain metastases after WBRT, who have been treated with single session radiosurgery, using the CyberKnife® Radiosurgery System (CKRS) (Accuray Inc., CA) between 2011 and 2016. The primary end point was local tumor control, whereas secondary end points were distant tumor control, treatment-related toxicity and overall survival. 36 patients with 140 recurrent brain metastases underwent 46 single session CKRS treatments. Twenty one patients had multiple brain metastases (58%). The mean interval between WBRT and CKRS accounted for 2 years (range 0.2-7 years). The median number of treated metastases per treatment session was five (range 1-12) with a tumor volume of 1.26 ccm (mean) and a median tumor dose of 18 Gy prescribed to the 70% isodose line. Two patients experienced local tumor recurrence within the 1st year after treatment and 13 patients (36%) developed novel brain metastases. Nine of these patients underwent additional one to three CKRS treatments. Eight patients (22.2%) showed treatment-related radiation reactions on MRI, three with clinical symptoms. Median overall survival was 19 months after CKRS. The actuarial 1-year local control rate was 94.2%. CKRS has proven to be locally effective and safe due to high local tumor control rates and low toxicity. Thus CKRS offers a reliable salvage treatment option for recurrent brain metastases after WBRT.

Modification of persistent responses in medial prefrontal cortex during learning in trace eyeblink conditioning

PubMed Central

2014-01-01

Persistent spiking in response to a discrete stimulus is considered to reflect the active maintenance of a memory for that stimulus until a behavioral response is made. This response pattern has been reported in learning paradigms that impose a temporal gap between stimulus presentation and behavioral response, including trace eyeblink conditioning. However, it is unknown whether persistent responses are acquired as a function of learning or simply represent an already existing category of response type. This fundamental question was addressed by recording single-unit activity in the medial prefrontal cortex (mPFC) of rabbits during the initial learning phase of trace eyeblink conditioning. Persistent responses to the tone conditioned stimulus were observed in the mPFC during the very first training sessions. Further analysis revealed that most cells with persistent responses showed this pattern during the very first training trial, before animals had experienced paired training. However, persistent cells showed reliable decreases in response magnitude over the first training session, which were not observed on the second day of training or for sessions in which learning criterion was met. This modification of response magnitude was specific to persistent responses and was not observed for cells showing phasic tone-evoked responses. The data suggest that persistent responses to discrete stimuli do not require learning but that the ongoing robustness of such responses over the course of training is modified as a result of experience. Putative mechanisms for this modification are discussed, including changes in cellular or network properties, neuromodulatory tone, and/or the synaptic efficacy of tone-associated inputs. PMID:25080570

The development of a change model of "exits" during cognitive analytic therapy for the treatment of depression.

PubMed

Sandhu, Sundeep Kaur; Kellett, Stephen; Hardy, Gillian

2017-11-01

"Exits" in cognitive analytic therapy (CAT) are methods that change unhelpful patterns or roles during the final "revision" phase of the therapy. How exits are conceived and achieved is currently poorly understood. This study focussed on the revision stage to explore and define how change is accomplished in CAT. Qualitative content analysis studied transcripts of sessions 6 and 7 of a protocol delivered 8-session CAT treatment for depression. Eight participants met the study inclusion criteria, and therefore, 16 sessions were analysed. The exit model developed contained 3 distinct (but interacting) phases: (a) developing an observing self via therapist input or client self-reflection, (b) breaking out of old patterns by creating new roles and procedures, and (c) utilisation of a range of methods to support and maintain change. Levels of interrater reliability for the exit categories that formed the model were good. The revision stage of CAT emerged as a complex and dynamic process involving 3 interacting stages. Further research is recommended to understand how exits relate to durability of change and whether change processes differ according to presenting problem. Exit work in cognitive analytic therapy is a dynamic process that requires progression through stages of insight, active change, and consolidation. Development of an "observing self" is an important foundation stone for change, and cognitive analytic therapists need to work within the client's zone of proximal development. A number of aspects appear important in facilitating change, such as attending to the process and feelings generated by change talk. Copyright © 2017 John Wiley & Sons, Ltd.

The kinematics of upper extremity reaching: a reliability study on people with and without shoulder impingement syndrome

PubMed Central

2010-01-01

Background Tasks chosen to evaluate motor performance should reflect the movement deficits characteristic of the target population and present an appropriate challenge for the patients who would be evaluated. A reaching task that evaluates impairment characteristics of people with shoulder impingement syndrome (SIS) was developed to evaluate the motor performance of this population. The objectives of this study were to characterize the reproducibility of this reaching task in people with and without SIS and to evaluate the impact of the number of trials on reproducibility. Methods Thirty subjects with SIS and twenty healthy subjects participated in the first measurement session to evaluate intrasession reliability. Ten healthy subjects were retested within 2 to 7 days to assess intersession reliability. At each measurement session, upper extremity kinematic patterns were evaluated during a reaching task. Ten trials were recorded. Thereafter, the upper extremity position at the end of reaching and total joint excursion that occurred during reaching were calculated. Intraclass correlation coefficient (ICC) and minimal detectable change (MDC) were used to estimate intra and intersession reliability. Results Intrasession reliability for total joint excursion was good to very good when based on the first two trials (0.770.92). As for end-reach position, intrasession reliability was very good when using either the first two, first five or last five trials (ICC>0.82). Globally, MDC were smaller for the last five trials. Intersession reliability of total joint excursion and position at the end of reaching was good to very good when using the mean of the first two or five trials (0.690.82). For most joints, MDC were smaller when using all ten trials. Conclusions The reaching task proposed to evaluate the upper limb motor performance was found reliable in people with and without SIS. Furthermore, the minimal difference necessary to infer a meaningful change in motor performance was determined, indicating that relatively small changes in task performance can be interpreted as a change in motor performance. PMID:20331889

Measurement of Transference Interpretations

PubMed Central

Bøgwald, Kjell-Petter; Høglend, Per; Sørbye, Øystein

1999-01-01

The authors present a cost-efficient process rating scale for detailed measurement of how much transference interpretations and related therapist interventions are used in brief dynamic psychotherapy. Theoretical and methodological considerations on how to operationalize and quantify such therapeutic interventions are discussed. The scale had highly satisfactory interrater reliability for three raters, who rated 60 whole sessions from an ongoing randomized study of two manualized forms of brief dynamic psychotherapy. In one treatment group, moderate emphasis on transference analysis was intended. In the other, minor or no use of the studied component was intended. The two treatment groups differed significantly in the use of transference interpretations and related interventions. There was no significant difference in therapists' general therapeutic skill or use of supportive interventions. The treatment differentiation was consistent with the manuals. PMID:10523429

Early response in cognitive-behavior therapy for syndromes of medically unexplained symptoms.

PubMed

Kleinstäuber, Maria; Lambert, Michael J; Hiller, Wolfgang

2017-05-25

Early dramatic treatment response suggests a subset of patients who respond to treatment before most of it has been offered. These early responders tend to be over represented among those who are well at termination and at follow-up. Early response patterns in psychotherapy have been investigated only for a few of mental disorders so far. The main aim of the current study was to examine early response after five therapy-preparing sessions of a cognitive behavior therapy (CBT) for syndromes of medically unexplained symptoms (MUS). In the context of a randomized, waiting-list controlled trial 48 patients who suffered from ≥3 MUS over ≥6 months received 5 therapy-preparing sessions and 20 sessions of CBT for somatoform disorders. They completed self-report scales of somatic symptom severity (SOMS-7 T), depression (BDI-II), anxiety (BSI), illness anxiety and behavior (IAS) at pre-treatment, after 5 therapy-preparing sessions (FU-5P) and at therapy termination (FU-20 T). The current analyses are based on data from the treatment arm only. Repeated measure ANOVAs revealed a significant decrease of depression (d = 0.34), anxiety (d = 0.60), illness anxiety (d = 0.38) and illness behavior (d = 0.42), but no change of somatic symptom severity (d = -0.03) between pre-treatment and FU-5P. Hierarchical linear multiple regression analyses showed that symptom improvements between pre-treatment and FU-5P predict a better outcome at therapy termination for depression and illness anxiety, after controlling for pre-treatment scores. Mixed-effect ANOVAs revealed significant group*time interaction effects indicating differences in the course of symptom improvement over the therapy between patients who fulfilled a reliable change (i.e., early response) during the 5 therapy-preparing sessions and patients who did not reach an early reliable change. Demographic or clinical variables at pre-treatment were not significantly correlated with differential scores between pre-treatment and FU-5P (-.23 ≤ r ≤ .23). Due to several limitations (e.g., small sample size, lack of a control group) the results of this study have to be interpreted cautiously. Our findings show that reliable changes in regard to affective-cognitive and behavioral variables can take place very early in CBT of patients with distressing MUS. These early changes seem to be predictive of the outcome at therapy termination. Future studies are needed in order to replicate our results, and to identify mechanisms of these early response patterns in somatoform patients. ISRCTN. ISRCTN17188363 . Registered retrospectively on 29 March 2007.

Performance in normal subjects on a novel battery of driving-related sensory-motor and cognitive tests.

PubMed

Innes, Carrie R H; Jones, Richard D; Anderson, Tim J; Hollobon, Susan G; Dalrymple-Alford, John C

2009-05-01

Currently, there is no international standard for the assessment of fitness to drive for cognitively or physically impaired persons. A computerized battery of driving-related sensory-motor and cognitive tests (SMCTests) has been developed, comprising tests of visuoperception, visuomotor ability, complex attention, visual search, decision making, impulse control, planning, and divided attention. Construct validity analysis was conducted in 60 normal, healthy subjects and showed that, overall, the novel cognitive tests assessed cognitive functions similar to a set of standard neuropsychological tests. The novel tests were found to have greater perceived face validity for predicting on-road driving ability than was found in the equivalent standard tests. Test-retest stability and reliability of SMCTests measures, as well as correlations between SMCTests and on-road driving, were determined in a subset of 12 subjects. The majority of test measures were stable and reliable across two sessions, and significant correlations were found between on-road driving scores and measures from ballistic movement, footbrake reaction, hand-control reaction, and complex attention. The substantial face validity, construct validity, stability, and reliability of SMCTests, together with the battery's level of correlation with on-road driving in normal subjects, strengthen our confidence in the ability of SMCTests to detect and identify sensory-motor and cognitive deficits related to unsafe driving and increased risk of accidents.

Re-designing scanning to reduce learning demands: the performance of typically developing 2-year-olds.

PubMed

McCarthy, John; Light, Janice; Drager, Kathryn; McNaughton, David; Grodzicki, Laura; Jones, Jonathan; Panek, Elizabeth; Parkin, Elizabeth

2006-12-01

Children with severe motor impairments who cannot use direct selection are typically introduced to scanning as a means of accessing assistive technology. Unfortunately, it is difficult for young children to learn to scan because the design of current scanning techniques does not always make explicit the offer of items from the selection array; furthermore, it does not provide explicit feedback after activation of the switch to select the target item. In the current study, scanning was redesigned to reduce learning demands by making both the offer of items and the feedback upon selection more explicit through the use of animation realized through HTML and speech output with appropriate intonation. Twenty typically developing 2-year-olds without disabilities were randomly assigned to use either traditional scanning or enhanced scanning to select target items from an array of three items. The 2-year-olds did not learn to use traditional scanning across three sessions. Their performance in Session 3 did not differ from that in Session 1; they did not exceed chance levels of accuracy in either session (mean accuracy of 20% for Sessions 1 and 3). In contrast, the children in the enhanced scanning condition demonstrated improvements in accuracy across the three 10-20-min sessions (mean accuracies of 22 and 48% for Sessions 1 and 3, respectively). There were no reliable differences between the children's performances with the two scanning techniques for Session 1; however, by Session 3, the children were more than twice as accurate using the enhanced scanning technique compared to the traditional design. Results suggest that by redesigning scanning, we may be able to reduce some of the learning demands and thereby reduce some of the instructional time required for children to attain mastery. Clinical implications, limitations, and directions for future research and development are discussed.

Reliability and validity of an iPhone® application for the measurement of lumbar spine flexion and extension range of motion

PubMed Central

Pourahmadi, Mohammad Reza; Jannati, Elham; Mohseni-Bandpei, Mohammad Ali; Ebrahimi Takamjani, Ismail; Rajabzadeh, Fatemeh

2016-01-01

Background Measurement of lumbar spine range of motion (ROM) is often considered to be an essential component of lumbar spine physiotherapy and orthopedic assessment. The measurement can be carried out through various instruments such as inclinometers, goniometers, and etc. Recent smartphones have been equipped with accelerometers and magnetometers, which, through specific software applications (apps) can be used for inclinometric functions. Purpose The main purpose was to investigate the reliability and validity of an iPhone® app (TiltMeter© -advanced level and inclinometer) for measuring standing lumbar spine flexion–extension ROM in asymptomatic subjects. Design A cross-sectional study was carried out. Setting This study was conducted in a physiotherapy clinic located at School of Rehabilitation Sciences, Iran University of Medical Science and Health Services, Tehran, Iran. Subjects A convenience sample of 30 asymptomatic adults (15 males; 15 females; age range = 18–55 years) was recruited between August 2015 and December 2015. Methods Following a 2–minute warm-up, the subjects were asked to stand in a relaxed position and their skin was marked at the T12–L1 and S1–S2 spinal levels. From this position, they were asked to perform maximum lumbar flexion followed by maximum lumbar extension with their knees straight. Two blinded raters each used an inclinometer and the iPhone ® app to measure lumbar spine flexion–extension ROM. A third rater read the measured angles. To calculate total lumbar spine flexion–extension ROM, the measurement from S1–S2 was subtracted from T12–L1. The second (2 hours later) and third (48 hours later) sessions were carried out in the same manner as the first session. All of the measurements were conducted 3 times and the mean value of 3 repetitions for each measurement was used for analysis. Intraclass correlation coefficient (ICC) models (3, k) and (2, k) were used to determine the intra-rater and inter-rater reliability, respectively. The Pearson correlation coefficients were used to establish concurrent validity of the iPhone® app. Furthermore, minimum detectable change at the 95% confidence level (MDC95) was computed as 1.96 × standard error of measurement × \\documentclass[12pt]{minimal} \\usepackage{amsmath} \\usepackage{wasysym} \\usepackage{amsfonts} \\usepackage{amssymb} \\usepackage{amsbsy} \\usepackage{upgreek} \\usepackage{mathrsfs} \\setlength{\\oddsidemargin}{-69pt} \\begin{document} }{}$\\sqrt{2}$\\end{document}2. Results Good to excellent intra-rater and inter-rater reliability were demonstrated for both the gravity-based inclinometer with ICC values of ≥0.84 and ≥0.77 and the iPhone® app with ICC values of ≥0.85 and ≥0.85, respectively. The MDC95 ranged from 5.82°to 8.18°for the intra-rater analysis and from 7.38°to 8.66° for the inter-rater analysis. The concurrent validity for flexion and extension between the 2 instruments was 0.85 and 0.91, respectively. Conclusions The iPhone®app possesses good to excellent intra-rater and inter-rater reliability and concurrent validity. It seems that the iPhone® app can be used for the measurement of lumbar spine flexion–extension ROM. Level of evidence IIb. PMID:27635328

Establishing a Practical Treadmill Sprint as an Alternative to the Wingate Anaerobic Test

ERIC Educational Resources Information Center

McKie, Greg L.; Islam, Hashim; Townsend, Logan K.; Howe, Greg J.; Hazell, Tom J.

2018-01-01

This study examined the validity and reliability of a 30-second running sprint test using two non-motorized treadmills compared to the established Wingate Anaerobic Test. Twenty-four participants completed three sessions in a randomized order on a: (1) manual mode treadmill (Woodway); (2) specialized interval training treadmill (HiTrainer); and…

An Assessment of the HIV Prevention Needs of Young Minority Women

ERIC Educational Resources Information Center

Crosby, Richard A.; Salazar, Laura F.; Geter, Angelica

2017-01-01

This study tested the reliability of nine scales assessing psychosocial mediators of HIV-risk and protective behaviors of young minority women in New York City. Sixty-nine age-eligible women were approached during clinical sessions, 90% (n = 62) agreed to participate, and 83% (n = 57) completed a web-based survey. With one exception, scale…

An Operationally Simple Sonogashira Reaction for an Undergraduate Organic Chemistry Laboratory Class

ERIC Educational Resources Information Center

Cranwell, Philippa B.; Peterson, Alexander M.; Littlefield, Benjamin T. R.; Russell, Andrew T.

2015-01-01

An operationally simple, reliable, and cheap Sonogashira reaction suitable for an undergraduate laboratory class that can be completed within a day-long (8 h) laboratory session has been developed. Cross-coupling is carried out between 2-methyl-3-butyn-2-ol and various aryl iodides using catalytic amounts of bis(triphenylphosphine)palladium(II)…

Technical realization of a sensorized neonatal intubation skill trainer for operators' retraining and a pilot study for its validation.

PubMed

Panizza, Davide; Scaramuzzo, Rosa T; Moscuzza, Francesca; Vannozzi, Ilaria; Ciantelli, Massimiliano; Gentile, Marzia; Baldoli, Ilaria; Tognarelli, Selene; Boldrini, Antonio; Cuttano, Armando

2018-01-04

In neonatal endotracheal intubation, excessive pressure on soft tissues during laryngoscopy can determine permanent injury. Low-fidelity skill trainers do not give valid feedback about this issue. This study describes the technical realization and validation of an active neonatal intubation skill trainer providing objective feedback. We studied expert health professionals' performances in neonatal intubation, underlining chance for procedure retraining. We identified the most critical points in epiglottis and dental arches and fixed commercial force sensors on chosen points on a ©Laerdal Neonatal Intubation Trainer. Our skill trainer was set up as a grade 3 on Cormack and Lehane's scale, i.e. a model of difficult intubation. An associated software provided real time sound feedback if pressure during laryngoscopy exceeded an established threshold. Pressure data were recorded in a database, for subsequent analysis with non-parametric statistical tests. We organized our study in two intubation sessions (5 attempts each one) for everyone of our participants, held 24 h apart. Between the two sessions, a debriefing phase took place. In addition, we gave our participants two interview, one at the beginning and one at the end of the study, to get information about our subjects and to have feedback about our design. We obtained statistical significant differences between consecutive attempts, with evidence of learning trends. Pressure on critical points was significantly lower during the second session (p < 0.0001). Epiglottis' sensor was the most stressed (p < 0.000001). We found a significant correlation between time spent for each attempt and pressures applied to the airways in the two sessions, more significant in the second one (shorter attempts with less pressure, r s  = 0.603). Our skill trainer represents a reliable model of difficult intubation. Our results show its potential to optimize procedures related to the control of trauma risk and to improve personnel retraining.

The Alexander Technique and musicians: a systematic review of controlled trials.

PubMed

Klein, Sabine D; Bayard, Claudine; Wolf, Ursula

2014-10-24

Musculoskeletal disorders, stress and performance anxiety are common in musicians. Therefore, some use the Alexander Technique (AT), a psycho-physical method that helps to release unnecessary muscle tension and re-educates non-beneficial movement patterns through intentional inhibition of unwanted habitual behaviours. According to a recent review AT sessions may be effective for chronic back pain. This review aimed to evaluate the evidence for the effectiveness of AT sessions on musicians' performance, anxiety, respiratory function and posture. The following electronic databases were searched up to February 2014 for relevant publications: PUBMED, Google Scholar, CINAHL, EMBASE, AMED, PsycINFO and RILM. The search criteria were "Alexander Technique" AND "music*". References were searched, and experts and societies of AT or musicians' medicine contacted for further publications. 237 citations were assessed. 12 studies were included for further analysis, 5 of which were randomised controlled trials (RCTs), 5 controlled but not randomised (CTs), and 2 mixed methods studies. Main outcome measures in RCTs and CTs were music performance, respiratory function, performance anxiety, body use and posture. Music performance was judged by external experts and found to be improved by AT in 1 of 3 RCTs; in 1 RCT comparing neurofeedback (NF) to AT, only NF caused improvements. Respiratory function was investigated in 2 RCTs, but not improved by AT training. Performance anxiety was mostly assessed by questionnaires and decreased by AT in 2 of 2 RCTs and in 2 of 2 CTs. A variety of outcome measures has been used to investigate the effectiveness of AT sessions in musicians. Evidence from RCTs and CTs suggests that AT sessions may improve performance anxiety in musicians. Effects on music performance, respiratory function and posture yet remain inconclusive. Future trials with well-established study designs are warranted to further and more reliably explore the potential of AT in the interest of musicians.

Development and interrater reliability testing of a telephone interview training programme for Australian nurse interviewers.

PubMed

Ahern, Tracey; Gardner, Anne; Gardner, Glenn; Middleton, Sandy; Della, Phillip

2013-05-01

The final phase of a three phase study analysing the implementation and impact of the nurse practitioner role in Australia (the Australian Nurse Practitioner Project or AUSPRAC) was undertaken in 2009, requiring nurse telephone interviewers to gather information about health outcomes directly from patients and their treating nurse practitioners. A team of several registered nurses was recruited and trained as telephone interviewers. The aim of this paper is to report on development and evaluation of the training process for telephone interviewers. The training process involved planning the content and methods to be used in the training session; delivering the session; testing skills and understanding of interviewers post-training; collecting and analysing data to determine the degree to which the training process was successful in meeting objectives and post-training follow-up. All aspects of the training process were informed by established educational principles. Interrater reliability between interviewers was high for well-validated sections of the survey instrument resulting in 100% agreement between interviewers. Other sections with unvalidated questions showed lower agreement (between 75% and 90%). Overall the agreement between interviewers was 92%. Each interviewer was also measured against a specifically developed master script or gold standard and for this each interviewer achieved a percentage of correct answers of 94.7% or better. This equated to a Kappa value of 0.92 or better. The telephone interviewer training process was very effective and achieved high interrater reliability. We argue that the high reliability was due to the use of well validated instruments and the carefully planned programme based on established educational principles. There is limited published literature on how to successfully operationalise educational principles and tailor them for specific research studies; this report addresses this knowledge gap. Copyright © 2012 Elsevier Ltd. All rights reserved.

RELIABILITY OF THE TUCK JUMP INJURY RISK SCREENING ASSESSMENT IN ELITE MALE YOUTH SOCCER PLAYERS

PubMed Central

READ, PAUL; OLIVER, JON L.; DE STE CROIX, MARK B.A.; MYER, GREGORY D.; LLOYD, RHODRI S.

2015-01-01

Altered neuromuscular control has been suggested as a mechanism for injury in soccer players. Ligamentous injuries most often occur during dynamic movements, such as decelerations from jump-landing maneuvers where high risk movement patterns are present. The assessment of kinematic variables during jump-landing tasks as part of a pre-participation screen is useful in the identification of injury risk. An example of a field-based screening tool is the repeated tuck jump assessment. The purpose of this study was to analyze the within-subject variation of the tuck jump screening assessment in elite male youth soccer players. 25 pre and 25 post-peak height velocity (PHV) elite male youth soccer players from the academy of a professional English soccer club completed the assessment. A test, re-test design was used to explore the within-subject inter-session reliability. Technique was graded retrospectively against the 10-point criteria set out in the screening protocol using two-dimensional video cameras. The typical error range reported for tuck jump total score (0.90 – 1.01 in pre and post-PHV players respectively) was considered acceptable. When each criteria was analyzed individually, Kappa coefficient determined that knee valgus was the only criterion to reach substantial agreement across the two test sessions for both groups. The results of this study suggest that although tuck jump total score may be reliably assessed in elite male youth soccer players, caution should be applied in solely interpreting the composite score due to the high within-subject variation in a number of the individual criteria. Knee valgus may be reliably used to screen elite youth male soccer players for this plyometric technique error and for test, re-test comparison. PMID:26562715

Translation and Validation of the Arabic Version of the Fear-Avoidance Beliefs Questionnaire in Patients With Low Back Pain.

PubMed

Alanazi, Fahad; Gleeson, Peggy; Olson, Sharon; Roddey, Toni

2017-04-01

Prospective cohort study of a cross-cultural low back pain (LBP) questionnaire OBJECTIVE.: The objectives of the present study were to translate and cross-culturally adapt the Fear-Avoidance Beliefs Questionnaire (FABQ) to create a version in Arabic and to test its psychometric properties. The FABQ measures the effects that fear and avoidance beliefs have on work and on physical activity. An FABQ cross-culturally adapted for Arabic readers and speakers was created by forward translation, translation synthesis, and backward translation. Forty patients in Riyadh, Saudi Arabia, with LBP evaluated use of the questionnaire, and 70 patients from the same hospital participated in reliability, validity, and sensitivity studies. To determine test-retest reliability of the Arabic FABQ, patients completed it twice within 48 hours without receiving any active treatment between these two sessions. Patients completed the Arabic FABQ (and three other scales) at baseline and 14 days later to determine its validity and sensitivity. Test-retest reliability was good (FABQ-work: intraclass coefficient [ICC] = 0.74; FABQ-physical activity: ICC = 0.90; FABQ overall: ICC = 0.76). Correlations between the FABQ and three other instruments for measuring pain and disability were weak. The strongest correlation was found at the follow-up session with the Arabic Oswestry Questionnaire (r = 0.283; P ≤ 0.05). Sensitivity to change was low. The translation and adaptation of the Arabic version of the FABQ was successful. Overall, the Arabic FABQ had good test-retest reliability, acceptable construct validity, and low sensitivity to change. The Arabic version of the FABQ shows promise in the assessment of fear-avoidance beliefs among patients with LBP who speak and read Arabic. 3.

Effect of knee and trunk angle on kinetic variables during the isometric midthigh pull: test-retest reliability.

PubMed

Comfort, Paul; Jones, Paul A; McMahon, John J; Newton, Robert

2015-01-01

The isometric midthigh pull (IMTP) has been used to monitor changes in force, maximum rate of force development (mRFD), and impulse, with performance in this task being associated with performance in athletic tasks. Numerous postures have been adopted in the literature, which may affect the kinetic variables during the task; therefore, the aim of this investigation was to determine whether different knee-joint angles (120°, 130°, 140°, and 150°) and hip-joint angles (125° and 145°), including the subjects preferred posture, affect force, mRFD, and impulse during the IMTP. Intraclass correlation coefficients demonstrated high within-session reliability (r ≥ .870, P < .001) for all kinetic variables determined in all postures, excluding impulse measures during the 130° knee-flexion, 125° hip-flexion posture, which showed a low to moderate reliability (r = .666-.739, P < .001), while between-sessions testing demonstrated high reliability (r > .819, P < .001) for all kinetic variables. There were no significant differences in peak force (P > .05, Cohen d = 0.037, power = .408), mRFD (P > .05, Cohen d = 0.037, power = .409), or impulse at 100 ms (P > .05, Cohen d = 0.056, power = .609), 200 ms (P > .05, Cohen d = 0.057, power = .624), or 300 ms (P > .05, Cohen d = 0.061, power = .656) across postures. Smallest detectable differences demonstrated that changes in performance of >1.3% in peak isometric force, >10.3% in mRFD, >5.3% in impulse at 100 ms, >4.4% in impulse at 200 ms, and >7.1% in impulse at 300 ms should be considered meaningful, irrespective of posture.

Test-retest reliability of laser displacement mechanomyography in paraspinal muscles while in lumbar extension or flexion.

PubMed

Than, Christian; Seidl, Laura; Tosovic, Danijel; Brown, J Mark

2018-05-12

This study investigated test-retest reliability of mechanomyography (MMG) on lumbar paraspinal muscles. Healthy male and female subjects (mean ± standard deviation, 25 ± 9.4 years, BMI 21.8 ± 2.99, n = 34) were recruited. Two test sessions (one week apart) consisted of MMG (laser displacement sensor (LDS)) muscle evaluations over the 10 lumbar facet joints, and 2 bilateral sacral sites, in anatomical extension and flexion. Two-way repeated measures ANOVA with Tukey's post hoc showed no significant differences between testing sessions for the same position (p > 0.05). The intra-class correlation coefficients (ICCs) in extension were classified as 'very good' (0.8-0.9) for maximal muscle displacement (Dmax), contraction time (Tc) and velocity of contraction (Vr). Half relaxation time (½Tr) and half relaxation velocity (½Vr) were 'poor' (0.4-0.5) and 'good' (0.7-0.8). In flexion, Dmax, Tc and Vr were 'excellent' (≥0.9) whilst ½Tr and ½Vr were 'fair' (0.6-0.7) and 'very good'. Comparing extension against flexion, significant (p < 0.05) differences in Dmax and ½Vr were found (L1/L2-L5/S1). Tc was significant (p < 0.05) for all sites whilst Vc was for L1/L2 on both sides (p < 0.05). ½Tr showed no significance (p > 0.05). Most MMG-derived parameters thus appear as reliable measures of muscle contractile properties in lumbar extension and flexion, with flexion providing more reliable results (ICCs). Copyright © 2018. Published by Elsevier Ltd.

Development of a simulation evaluation tool for assessing nursing students' clinical judgment in caring for children with dehydration.

PubMed

Kim, Shin-Jeong; Kim, Sunghee; Kang, Kyung-Ah; Oh, Jina; Lee, Myung-Nam

2016-02-01

The lack of reliable and valid tools to evaluate learning outcomes during simulations has limited the adoption and progress of simulation-based nursing education. This study had two aims: (a) to develop a simulation evaluation tool (SET(c-dehydration)) to assess students' clinical judgment in caring for children with dehydration based on the Lasater Clinical Judgment Rubric (LCJR) and (b) to examine its reliability and validity. Undergraduate nursing students from two nursing schools in South Korea participated in this study from March 3 through June 10, 2014. The SET(c-dehydration) was developed, and 120 nursing students' clinical judgment was evaluated. Descriptive statistics, Cronbach's alpha, Cohen's kappa coefficient, and confirmatory factor analysis (CFA) were used to analyze the data. A 41-item version of the SET(c-dehydration) with three subscales was developed. Cohen's kappa (measuring inter-observer reliability) of the sessions ranged from .73 to .95, and Cronbach's alpha was .87. The mean total rating of the SET(c-dehydration) by the instructors was 1.92 (±.25), and the mean scores for the four LCJR dimensions of clinical judgment were as follows: noticing (1.74±.27), interpreting (1.85±.43), responding (2.17±.32), and reflecting (1.79±.35). CFA, which was performed to test construct validity, showed that the four dimensions of the SET(c-dehydration) was an appropriate framework. The SET(c-dehydration) provides a means to evaluate clinical judgment in simulation education. Its reliability and validity should be examined further. Copyright © 2015 Elsevier Ltd. All rights reserved.

Caffeine effects on mood and memory.

PubMed

Herz, R S

1999-09-01

The purpose of the present research was to assess whether a psychoactive dose of caffeine would have differential affects on the mood dimensions of arousal versus feelings of pleasantness and whether these mood alterations would influence memory either by (1) the experience of arousal at learning and/or (2) altered and congruent mood states at learning and recall. To address these questions, the administration of 5 mg/kg caffeine or placebo at learning and retrieval sessions was manipulated and subjects' mood was evaluated by several different self-report measures. Sixteen words were incidentally studied during the learning session and memory was evaluated by the number of words correctly recalled at the retrieval session two days later. Results revealed that caffeine reliably increased arousal, but did not affect any emotion dimensions related to feelings of pleasure. Subjects who received caffeine at learning and retrieval were also in equivalent mood states at both sessions. Moreover, caffeine did not produce any effects on memory; thus, neither hypothesis concerning the influence of arousal on memory was supported. These data show that caffeine is a useful method for manipulating arousal in the laboratory without influencing feelings of pleasantness or learning and memory performance.

An automated device for appetitive conditioning in zebrafish (Danio rerio).

PubMed

Manabe, Kazuchika; Dooling, R J; Takaku, Shinichi

2013-12-01

An automated device and a procedure for the operant conditioning individual zebrafish were developed. The key feature of this procedure was the construction of a simple, inexpensive feeder that can deliver extremely small amounts of food, thus preventing rapid satiation. This allows the experimenter to run multiple trails in a single test session and multiple sessions in one day. In addition, small response keys made from acryl rods and fiber sensors were developed that were sufficiently sensitive to detect fish contact. To illustrate the efficiency and utility of the device for traditional learning paradigms, we trained zebrafish in a fixed ratio schedule where subjects were reinforced with food after 10 responses. Zebrafish reliably responded on the response key for sessions that lasted as long 80-reinforcements. They also showed the traditional "break and run" response pattern that has been found in many species. These results show that this system will be valuable for behavioral studies with zebrafish, especially for experiments that need many repeated trials using food reinforcer in a session. The present system can be used for sensory and learning investigations, as well applications in behavioral pharmacology, behavioral genetics, and toxicology where the zebrafish is becoming the vertebrate model of choice.

Testing a mediation model of psychotherapy process and outcome in psychodynamic psychotherapy: Previous client distress, psychodynamic techniques, dyadic working alliance, and current client distress.

PubMed

Kivlighan, Dennis M; Hill, Clara E; Ross, Katherine; Kline, Kathryn; Furhmann, Amy; Sauber, Elizabeth

2018-01-05

To test a sequential model of psychotherapy process and outcome, we included previous client distress, therapist psychodynamic techniques, dyadic working alliance, and current client distress. For 114 sets of eight-session segments in 40 cases of psychodynamic psychotherapy, clients completed the Outcome Questionnaire-45 and Inventory of Interpersonal Problems-32 after the first and final session, judges reliably coded one middle sessions on the Psychodynamic subscale of the Multitheoretical List of Therapeutic Interventions, and clients and therapists completed the Working Alliance Inventory after every session. Results indicated that higher use of psychodynamic techniques was associated with higher levels of the working alliance, which in turn was associated decreased client distress; and working alliance was higher later in psychotherapy. There was a significant indirect effect of psychodynamic techniques on decreases in distress mediated by the working alliance. Implications for theory, practice, and research are provided. Clinical or methodological significance of this article: Conducted a longitudinal, latent variable examination of the relationships of psychodynamic techniques and working alliance on client distress. Psychodynamic techniques have an indirect effect on decreases in client distress through the dyadic working alliance.

Clients' and therapists' real relationship and session quality in brief therapy: an actor partner interdependence analysis.

PubMed

Markin, Rayna D; Kivlighan, Dennis M; Gelso, Charles J; Hummel, Ann M; Spiegel, Eric B

2014-09-01

This study used the Actor Partner Interdependence Model (APIM; Kenny & Cook, 1999) to examine the associations of client- and therapist-rated real relationship (RR) and session quality over time. Eighty-seven clients and their therapists (n = 25) completed RR and session quality measures after every session of brief therapy. Therapists' current session quality ratings were significantly related to all of the following: session number (b = .04), their session quality rating of the previous session (b = .24), their RR in the previous session (b = 1.091), their client's RR in the previous session (b = .17), and interactions between their own and their clients' RR and session number (b = -.16 and β = -.04, respectively). Clients' ratings of current session quality were significantly related to only their own RR in the previous session (b = .47). Implications for future research and practice are discussed. PsycINFO Database Record (c) 2014 APA, all rights reserved.

Electrode replacement does not affect classification accuracy in dual-session use of a passive brain-computer interface for assessing cognitive workload

PubMed Central

Estepp, Justin R.; Christensen, James C.

2015-01-01

The passive brain-computer interface (pBCI) framework has been shown to be a very promising construct for assessing cognitive and affective state in both individuals and teams. There is a growing body of work that focuses on solving the challenges of transitioning pBCI systems from the research laboratory environment to practical, everyday use. An interesting issue is what impact methodological variability may have on the ability to reliably identify (neuro)physiological patterns that are useful for state assessment. This work aimed at quantifying the effects of methodological variability in a pBCI design for detecting changes in cognitive workload. Specific focus was directed toward the effects of replacing electrodes over dual sessions (thus inducing changes in placement, electromechanical properties, and/or impedance between the electrode and skin surface) on the accuracy of several machine learning approaches in a binary classification problem. In investigating these methodological variables, it was determined that the removal and replacement of the electrode suite between sessions does not impact the accuracy of a number of learning approaches when trained on one session and tested on a second. This finding was confirmed by comparing to a control group for which the electrode suite was not replaced between sessions. This result suggests that sensors (both neurological and peripheral) may be removed and replaced over the course of many interactions with a pBCI system without affecting its performance. Future work on multi-session and multi-day pBCI system use should seek to replicate this (lack of) effect between sessions in other tasks, temporal time courses, and data analytic approaches while also focusing on non-stationarity and variable classification performance due to intrinsic factors. PMID:25805963

Aripiprazole effects on self-administration and pharmacodynamics of intravenous cocaine and cigarette smoking in humans.

PubMed

Lofwall, Michelle R; Nuzzo, Paul A; Campbell, Charles; Walsh, Sharon L

2014-06-01

Aripiprazole is a partial agonist at dopamine (D2) and serotonin (5-HT1a) receptors and 5-HT2 antagonist. Because cocaine affects dopamine and serotonin, this study assessed whether aripiprazole could diminish the reinforcing efficacy of cocaine. Secondary aims evaluated aripiprazole on ad lib cigarette smoking and with a novel 40-hr smoking abstinence procedure. Adults with regular cocaine and cigarette use completed this inpatient double blind, randomized, placebo-controlled mixed-design study. A placebo lead-in was followed by randomization to aripiprazole (0, 2 or 10 mg/day/p.o.; n = 7 completed/group). Three sets of test sessions, each consisting of 3 cocaine sample-choice (i.e., self-administration) sessions and 1 dose-response session, were conducted (once during the lead-in and twice after randomization). Sample sessions tested each cocaine dose (0, 20 and 40 mg/70 kg, i.v.) in random order; subjective, observer-rated and physiologic outcomes were collected. Later that day, participants chose between the morning's sample dose or descending amounts of money over 7 trials. In dose response sessions, all doses were given 1 hr apart in ascending order for pharmacodynamic and pharmacokinetic assessment. Two sets of smoking topography sessions were conducted during the lead-in and after randomization; 1 with and 1 without 40 hr of smoking abstinence. Number of ad lib cigarettes smoked during non-session days was collected. Cocaine produced prototypic effects, but aripiprazole did not significantly alter these effects or smoking outcomes. The smoking abstinence procedure reliably produced nicotine withdrawal and craving and increased smoking modestly. These data do not support further investigation of aripiprazole for cocaine or tobacco use disorder treatment. PsycINFO Database Record (c) 2014 APA, all rights reserved.

Electrode replacement does not affect classification accuracy in dual-session use of a passive brain-computer interface for assessing cognitive workload.

PubMed

Estepp, Justin R; Christensen, James C

2015-01-01

The passive brain-computer interface (pBCI) framework has been shown to be a very promising construct for assessing cognitive and affective state in both individuals and teams. There is a growing body of work that focuses on solving the challenges of transitioning pBCI systems from the research laboratory environment to practical, everyday use. An interesting issue is what impact methodological variability may have on the ability to reliably identify (neuro)physiological patterns that are useful for state assessment. This work aimed at quantifying the effects of methodological variability in a pBCI design for detecting changes in cognitive workload. Specific focus was directed toward the effects of replacing electrodes over dual sessions (thus inducing changes in placement, electromechanical properties, and/or impedance between the electrode and skin surface) on the accuracy of several machine learning approaches in a binary classification problem. In investigating these methodological variables, it was determined that the removal and replacement of the electrode suite between sessions does not impact the accuracy of a number of learning approaches when trained on one session and tested on a second. This finding was confirmed by comparing to a control group for which the electrode suite was not replaced between sessions. This result suggests that sensors (both neurological and peripheral) may be removed and replaced over the course of many interactions with a pBCI system without affecting its performance. Future work on multi-session and multi-day pBCI system use should seek to replicate this (lack of) effect between sessions in other tasks, temporal time courses, and data analytic approaches while also focusing on non-stationarity and variable classification performance due to intrinsic factors.

Obstetric team simulation program challenges.

PubMed

Bullough, A S; Wagner, S; Boland, T; Waters, T P; Kim, K; Adams, W

2016-12-01

To describe the challenges associated with the development and assessment of an obstetric emergency team simulation program. The goal was to develop a hybrid, in-situ and high fidelity obstetric emergency team simulation program that incorporated weekly simulation sessions on the labor and delivery unit, and quarterly, education protected sessions in the simulation center. All simulation sessions were video-recorded and reviewed. Labor and delivery unit and simulation center. Medical staff covering labor and delivery, anesthesiology and obstetric residents and obstetric nurses. Assessments included an on-line knowledge multiple-choice questionnaire about the simulation scenarios. This was completed prior to the initial in-situ simulation session and repeated 3 months later, the Clinical Teamwork Scale with inter-rater reliability, participant confidence surveys and subjective participant satisfaction. A web-based curriculum comprising modules on communication skills, team challenges, and team obstetric emergency scenarios was also developed. Over 4 months, only 6 labor and delivery unit in-situ sessions out of a possible 14 sessions were carried out. Four high-fidelity sessions were performed in 2 quarterly education protected meetings in the simulation center. Information technology difficulties led to the completion of only 18 pre/post web-based multiple-choice questionnaires. These test results showed no significant improvement in raw score performance from pre-test to post-test (P=.27). During Clinical Teamwork Scale live and video assessment, trained raters and program faculty were in agreement only 31% and 28% of the time, respectively (Kendall's W=.31, P<.001 and W=.28, P<.001). Participant confidence surveys overall revealed confidence significantly increased (P<.05), from pre-scenario briefing to after post-scenario debriefing. Program feedback indicates a high level of participant satisfaction and improved confidence yet further program refinement is required. Copyright © 2016 Elsevier Inc. All rights reserved.

Reliability of VEP Recordings Using Chronically Implanted Screw Electrodes in Mice

PubMed Central

Makowiecki, Kalina; Garrett, Andrew; Clark, Vince; Graham, Stuart L.; Rodger, Jennifer

2015-01-01

Purpose: Visual evoked potentials (VEPs) are widely used to objectively assess visual system function in animal models of ophthalmological diseases. Although use of chronically implanted electrodes is common in longitudinal VEP studies using rodent models, reliability of recordings over time has not been assessed. We compared VEPs 1 and 7 days after electrode implantation in the adult mouse. We also examined stimulus-independent changes over time, by assessing electroencephalogram (EEG) power and approximate entropy of the EEG signal. Methods: Stainless steel screws (600-μm diameter) were implanted into the skull overlying the right visual cortex and the orbitofrontal cortex of adult mice (C57Bl/6J, n = 7). Animals were reanesthetized 1 and 7 days after implantation to record VEP responses (flashed gratings) and EEG activity. Brain sections were stained for glial activation (GFAP) and cell death (TUNEL). Results: Reliability analysis, using intraclass correlation coefficients, showed VEP recordings had high reliability within the same session, regardless of time after electrode implantation and peak latencies and approximate entropy of the EEG did not change significantly with time. However, there was poorer reliability between recordings obtained on different days, and a significant decrease in VEP amplitudes and EEG power. This amplitude decrease could be normalized by scaling to EEG power (within-subjects). Furthermore, glial activation was present at both time points but there was no evidence of cell death. Conclusions: These results indicate that VEP responses can be reliably recorded even after a relatively short recovery period but decrease response peak amplitude over time. Although scaling the VEP trace to EEG power normalized this decrease, our results highlight that time-dependent cortical excitability changes are an important consideration in longitudinal VEP studies. Translational Relevance: This study shows changes in VEP characteristics over time in chronically implanted mice. Thus, future preclinical longitudinal studies should consider time in addition to amplitude and latency when designing and interpreting research. PMID:25938003

Kilovoltage Imaging of Implanted Fiducials to Monitor Intrafraction Motion With Abdominal Compression During Stereotactic Body Radiation Therapy for Gastrointestinal Tumors.

PubMed

Yorke, Ellen; Xiong, Ying; Han, Qian; Zhang, Pengpeng; Mageras, Gikas; Lovelock, Michael; Pham, Hai; Xiong, Jian-Ping; Goodman, Karyn A

2016-07-01

To assess intrafraction respiratory motion using a commercial kilovoltage imaging system for abdominal tumor patients with implanted fiducials and breathing constrained by pneumatic compression during stereotactic body radiation therapy (SBRT). A pneumatic compression belt limited respiratory motion in 19 patients with radiopaque fiducials in or near their tumor during SBRT for abdominal tumors. Kilovoltage images were acquired at 5- to 6-second intervals during treatment using a commercial system. Intrafractional fiducial displacements were measured using in-house software. The dosimetric effect of the observed displacements was calculated for 3 sessions for each patient. Intrafraction displacement patterns varied between patients and between individual treatment sessions. Averaged over 19 patients, 73 sessions, 7.6% of craniocaudal displacements exceeded 0.5 cm, and 1.2% exceeded 0.75 cm. The calculated single-session dose to 95% of gross tumor volume differed from planned by an average of -1.2% (range, -11.1% to 4.8%) but only for 4 patients was the total 3-session calculated dose to 95% of gross tumor volume more than 3% different from planned. Our pneumatic compression limited intrafractional abdominal target motion, maintained target position established at setup, and was moderately effective in preserving coverage. Commercially available intrafractional imaging is useful for surveillance but can be made more effective and reliable. Copyright © 2015 Elsevier Inc. All rights reserved.

Kilovoltage imaging of implanted fiducials to monitor intrafraction motion with abdominal compression during stereotactic body radiotherapy for GI tumors

PubMed Central

Yorke, Ellen; Xiong, Ying; Han, Qian; Zhang, Pengpeng; Mageras, Gikas; Lovelock, Michael; Pham, Hai; Xiong, Jian-Ping; Goodman, Karyn A.

2017-01-01

Purpose/Objective To assess intrafraction respiratory motion using a commercial kilovoltage imaging system for abdominal tumor patients with implanted fiducials and breathing constrained by pneumatic compression during stereotactic body radiotherapy (sbrt). Methods and Materials A pneumatic compression belt limited respiratory motion in 19 patients with radiopaque fiducials in or near their tumor during sbrt for abdominal tumors. Kilovoltage images were acquired at 5–6 sec intervals during treatment using a commercial system. Intrafractional fiducial displacements were measured using in-house software. The dosimetric effect of the observed displacements was calculated for three sessions for each patient. Results Intrafraction displacement patterns varied between patients and between individual treatment sessions. Averaged over 19 patients, 73 sessions, 7.6% of craniocaudal displacements exceeded 0.5 cm and 1.2% exceeded 0.75 cm. The calculated single session dose to 95% of gross tumor volume (GTVD95) differed from planned by an average of −1.2% (−11.1%−4.8%) but only for 4 patients was total 3-session calculated GTVD95 over 3% different from planned Conclusions Our pneumatic compression limited intrafractional abdominal target motion, maintained target position established at setup, and was moderately effective in preserving coverage. Commercially available intrafractional imaging is useful for surveillance but can be made more effective and reliable. PMID:26797539

Special Session 4: Astronomy Education between Past and Future

NASA Astrophysics Data System (ADS)

de Greve, Jean-Pierre

2010-11-01

The special session aims at discussing an integrated approach of the different efforts to increase and promote the teaching and learning of astronomy in the world, with emphasis on developing countries. To this end, attention will be given to research on education, specifically in the field of physics, to best practices of the use of astronomy in educational systems (specifically in developing countries), and to innovative learning initiatives other than formal education. The Special Session aims also at creating a universal perspective wherein modern (post-Copernican) astronomy will presented as an intellectual cumulus. The objective of the session is to disseminate best practices in teaching and learning activities of astronomy and to give an opportunity to learn about initiatives in different cultural and socio-economic settings. The special session also wants to give food-for-thought and proposals for reflection for an integrative approach, and for optimization processes, to enhance the interest in astronomy and its role as a trigger towards science education in the educational systems, with emphasis on the developing countries. The outcome should be a sensitization of teachers and students alike to the concept of a universal history of astronomy and creation of some reliable source material which can be used as a teaching aid in a culture-specific context. The outcome could be a set of recommendations for future integrated actions, and eventually recommendations on new initiatives, framed into the new decadal policy plan.

Validation of Cardiovascular Parameters during NASA's Functional Task Test

NASA Technical Reports Server (NTRS)

Arzeno, N. M.; Stenger, M. B.; Bloomberg, J. J.; Platts, S. H.

2009-01-01

Microgravity exposure causes physiological deconditioning and impairs crewmember task performance. The Functional Task Test (FTT) is designed to correlate these physiological changes to performance in a series of operationally-relevant tasks. One of these, the Recovery from Fall/Stand Test (RFST), tests both the ability to recover from a prone position and cardiovascular responses to orthostasis. PURPOSE: Three minutes were chosen for the duration of this test, yet it is unknown if this is long enough to induce cardiovascular responses similar to the operational 5 min stand test. The purpose of this study was to determine the validity and reliability of heart rate variability (HRV) analysis of a 3 min stand and to examine the effect of spaceflight on these measures. METHODS: To determine the validity of using 3 vs. 5 min of standing to assess HRV, ECG was collected from 7 healthy subjects who participated in a 6 min RFST. Mean R-R interval (RR) and spectral HRV were measured in minutes 0-3 and 0-5 following the heart rate transient due to standing. Significant differences between the segments were determined by a paired t-test. To determine the reliability of the 3-min stand test, 13 healthy subjects completed 3 trials of the FTT on separate days, including the RFST with a 3 min stand. Analysis of variance (ANOVA) was performed on the HRV measures. One crewmember completed the FTT before a 14-day mission, on landing day (R+0) and one (R+1) day after returning to Earth. RESULTS VALIDITY: HRV measures reflecting autonomic activity were not significantly different during the 0-3 and 0-5 min segments. RELIABILITY: The average coefficient of variation for RR, systolic (SBP) and diastolic blood pressures during the RFST were less than 8% for the 3 sessions. ANOVA results yielded a greater inter-subject variability (p<0.006) than inter-session variability (p>0.05) for HRV in the RFST. SPACEFLIGHT: Lower RR and higher SBP were observed on R+0 in rest and stand. On R+1, both RR and SBP trended towards preflight rest and stand values. Postflight HRV showed higher LF/HF for rest and stand and lower HFnu during rest. CONCLUSION: These studies show that a 3 min stand delivers repeatable HRV data in the context of this larger series of FTT tests. Spaceflight-induced changes in blood pressure, RR and autonomic function (HRV) are evident from the RFST.

An Experimental Investigation of Drunk Personality Using Self and Observer Reports

PubMed Central

Winograd, Rachel P.; Steinley, Douglas; Lane, Sean P.; Sher, Kenneth J.

2017-01-01

Across various cultures there are robust stereotypes regarding how alcohol intoxication alters individuals’ normative personalities. However, whether these stereotypes are rooted in genuine average effects or in salient, socially-proliferated exemplars remain unclear. The current study tested if differences between sober and intoxicated personality expression can be observed reliably by trained raters during a drinking episode. Participants (N = 156), half of whom received alcohol, attended laboratory sessions in same-gender friend groups and engaged in activities designed to elicit a range of personality expression. Participants completed self-reports of their “typical” sober and drunk personalities two weeks prior to their sessions and via two short measures during the session. Additionally, participants were recorded and rated by multiple (Range = 5–17) trained raters using three personality measures. Self-perceptions of sober-to-drunk personality differences were more pervasive than observer-perceptions, but alcohol-induced changes in Extraversion, specifically, were robust across measures and reporters. PMID:28785511

Do patterns of change during treatment for panic disorder predict future panic symptoms?

PubMed Central

Steinman, Shari A.; Hunter, Michael D.; Teachman, Bethany A.

2012-01-01

Background and Objectives Cognitive-behavioral therapies are currently the gold standard for panic disorder treatment, with well-documented treatment response. However, following interventions, some individuals continue to improve, while others experience a return of symptoms. The field lacks reliable ways to predict follow-up symptomology. In the current study, a cluster analysis with a repeated measures design was conducted to examine change patterns over 12 weeks of cognitive behavioral group therapy for panic disorder. The central aim of the study was to evaluate if change patterns predict level of panic symptom severity at a six month follow-up in this sample. Methods Individuals with panic disorder (N = 36) completed a measure of panic symptoms (Panic Disorder Severity Scale) at the outset of every therapy session and at a six month follow-up. Results Results revealed three patterns of change in this specific trial, which significantly predicted level of panic symptoms six months post-treatment, beyond initial or final level of panic symptoms, and beyond total symptom change. Limitations Given the relatively small, lab-based sample, replications in other settings and samples will be important. Conclusions Overall, results provide initial evidence that change patterns are meaningful predictors of panic symptom severity well after the final session of treatment. PMID:23187115

Developing a tool for assessing competency in root cause analysis.

PubMed

Gupta, Priyanka; Varkey, Prathibha

2009-01-01

Root cause analysis (RCA) is a tool for identifying the key cause(s) contributing to a sentinel event or near miss. Although training in RCA is gaining popularity in medical education, there is no published literature on valid or reliable methods for assessing competency in the same. A tool for assessing competency in RCA was pilot tested as part of an eight-station Objective Structured Clinical Examination that was conducted at the completion of a three-week quality improvement (QI) curriculum for the Mayo Clinic Preventive Medicine and Endocrinology fellowship programs. As part of the curriculum, fellows completed a QI project to enhance physician communication of the diagnosis and treatment plan at the end of a patient visit. They had a didactic session on RCA, followed by process mapping of the information flow at the project clinic, after which fellows conducted an actual RCA using the Ishikawa fishbone diagram. For the RCA competency assessment, fellows performed an RCA regarding a scenario describing an adverse medication event and provided possible solutions to prevent such errors in the future. All faculty strongly agreed or agreed that they were able to accurately assess competency in RCA using the tool. Interrater reliability for the global competency rating and checklist scoring were 0.96 and 0.85, respectively. Internal consistency (Cronbach's alpha) was 0.76. Six of eight of the fellows found the difficulty level of the test to be optimal. Assessment methods must accompany education programs to ensure that graduates are competent in QI methodologies and are able to apply them effectively in the workplace. The RCA assessment tool was found to be a valid, reliable, feasible, and acceptable method for assessing competency in RCA. Further research is needed to examine its predictive validity and generalizability.

Application of a low-cost web-based simulation to improve students' practical skills in medical education.

PubMed

Moreno-Ger, Pablo; Torrente, Javier; Bustamante, Julián; Fernández-Galaz, Carmen; Fernández-Manjón, Baltasar; Comas-Rengifo, María Dolores

2010-06-01

Practical sessions in undergraduate medical education are often costly and have to face constraints in terms of available laboratory time and practice materials (e.g. blood samples from animals). This makes it difficult to increase the time each student spends at the laboratory. We consider that it would be possible to improve the effectiveness of the laboratory time by providing the students with computer-based simulations for prior rehearsal. However, this approach still presents issues in terms of development costs and distribution to the students. This study investigates the employment of low-cost simulation to allow medical students to rehearse practical exercises through a web-based e-learning environment. The aim is to maximize the efficiency of laboratory time and resources allocated by letting students become familiarized with the equipment and the procedures before they attend a laboratory session, but without requiring large-scale investment. Moreover, students can access the simulation via the Internet and rehearse at their own pace. We have studied the effects of such a simulation in terms of impact on the laboratory session, learning outcomes and student satisfaction. We created a simulation that covers the steps of a practical exercise in a Physiology course (measuring hematocrit in a blood sample). An experimental group (EG, n=66) played the simulation 1 week before the laboratory session. A control group (CG, n=77) attended the laboratory session without playing the simulation. After the session, all students completed a survey about their perception of the difficulty of the exercise on a scale of 1-10 and the HCT final value that they obtained. The students in the EG also completed a survey about their satisfaction with the experience. After the laboratory session, the perceived difficulty of the procedure was lower on average in the EG compared to the CG (3.52 vs. 4.39, 95% CI: 0.16-1.57, P=.016). There was no significant difference in terms of perceived difficulty using the equipment. The HCT measures reported by the EG group also presented a much lower dispersion, meaning a higher reliability, in determining the HCT value (3.10 vs. 26.94, SD; variances significantly different, P<.001, F: 75.25, Dfd: 68.19 for EG and CG). In the satisfaction test, the majority of the students in the EG reported that the experience was positive or very positive (80.7%) and reported that it had helped them to identify and use the equipment (78%) and to perform the exercise (66%). The simulation was well received by students in the EG, who felt more comfortable during the laboratory session, and it helped them to perform the exercise better, obtaining more accurate results, which indicates more effective training. EG students perceived the procedure as easier to perform, but did not report an improvement in the perceived difficulty in using the equipment. The increased reliability demonstrates that low-cost simulations are a good complement to the laboratory sessions. Copyright 2010 Elsevier Ireland Ltd. All rights reserved.

Individual differneces in degraded speech perception

NASA Astrophysics Data System (ADS)

Carbonell, Kathy M.

One of the lasting concerns in audiology is the unexplained individual differences in speech perception performance even for individuals with similar audiograms. One proposal is that there are cognitive/perceptual individual differences underlying this vulnerability and that these differences are present in normal hearing (NH) individuals but do not reveal themselves in studies that use clear speech produced in quiet (because of a ceiling effect). However, previous studies have failed to uncover cognitive/perceptual variables that explain much of the variance in NH performance on more challenging degraded speech tasks. This lack of strong correlations may be due to either examining the wrong measures (e.g., working memory capacity) or to there being no reliable differences in degraded speech performance in NH listeners (i.e., variability in performance is due to measurement noise). The proposed project has 3 aims; the first, is to establish whether there are reliable individual differences in degraded speech performance for NH listeners that are sustained both across degradation types (speech in noise, compressed speech, noise-vocoded speech) and across multiple testing sessions. The second aim is to establish whether there are reliable differences in NH listeners' ability to adapt their phonetic categories based on short-term statistics both across tasks and across sessions; and finally, to determine whether performance on degraded speech perception tasks are correlated with performance on phonetic adaptability tasks, thus establishing a possible explanatory variable for individual differences in speech perception for NH and hearing impaired listeners.

Anthropometric Measurement Standardization in the US-Affiliated Pacific: Report from the Children’s Healthy Living Program

PubMed Central

LI, FENFANG; WILKENS, LYNNE R.; NOVOTNY, RACHEL; FIALKOWSKI, MARIE K.; PAULINO, YVETTE C.; NELSON, RANDALL; BERSAMIN, ANDREA; MARTIN, URSULA; DEENIK, JONATHAN; BOUSHEY, CAROL J.

2016-01-01

Objectives Anthropometric standardization is essential to obtain reliable and comparable data from different geographical regions. The purpose of this study is to describe anthropometric standardization procedures and findings from the Children’s Healthy Living (CHL) Program, a study on childhood obesity in 11 jurisdictions in the US-Affiliated Pacific Region, including Alaska and Hawai‘i. Methods Zerfas criteria were used to compare the measurement components (height, waist, and weight) between each trainee and a single expert anthropometrist. In addition, intra- and inter-rater technical error of measurement (TEM), coefficient of reliability, and average bias relative to the expert were computed. Results From September 2012 to December 2014, 79 trainees participated in at least 1 of 29 standardization sessions. A total of 49 trainees passed either standard or alternate Zerfas criteria and were qualified to assess all three measurements in the field. Standard Zerfas criteria were difficult to achieve: only 2 of 79 trainees passed at their first training session. Intra-rater TEM estimates for the 49 trainees compared well with the expert anthropometrist. Average biases were within acceptable limits of deviation from the expert. Coefficient of reliability was above 99% for all three anthropometric components. Conclusions Standardization based on comparison with a single expert ensured the comparability of measurements from the 49 trainees who passed the criteria. The anthropometric standardization process and protocols followed by CHL resulted in 49 standardized field anthropometrists and have helped build capacity in the health workforce in the Pacific Region. PMID:26457888

Aiming for excellence - A simulation-based study on adapting and testing an instrument for developing non-technical skills in Norwegian student nurse anaesthetists.

PubMed

Flynn, Fiona M; Sandaker, Kjersti; Ballangrud, Randi

2017-01-01

There is increasing focus on building safety into anaesthesia practice, with excellence in anaesthesia as an aspirational goal. Non-technical skills are an important factor in excellence and improved patient safety, though there have been few systematic attempts at integrating them into anaesthesia nursing education. This study aimed to test the reliability of NANTS-no, a specially adapted behavioural marker system for nurse anaesthetists in Norway, and explore the development of non-technical skills in student nurse anaesthetists. The pre-test post-test design incorporated a 10-week simulation-based programme, where non-technical skills in 14 student nurse anaesthetists were rated on three different occasions during high-fidelity simulation, before and after taking part in a training course. NANTS-no demonstrated high overall inter-rater reliability (ICC = 0.91), high test-retest reliability (ICC = 0.94) and good internal consistency (Cronbach's α of 0.85-0.92). A significant improvement was demonstrated across all categories of non-technical skills, with greatest improvements between the first and third and second and third sessions. There was also a significant improvement in two categories between the first and second sessions. NANTS-no is therefore suitable for assessing non-technical skills during simulation training in anaesthesia nursing education. More research is needed to validate its use in clinical practice. Copyright © 2016 Elsevier Ltd. All rights reserved.

Inter- and Intra-individual variability following intermittent theta burst stimulation: implications for rehabilitation and recovery.

PubMed

Hinder, Mark R; Goss, Emily L; Fujiyama, Hakuei; Canty, Alison J; Garry, Michael I; Rodger, Jennifer; Summers, Jeffery J

2014-01-01

The continued refinement of non-invasive brain stimulation (NBS) techniques is indicative of promising clinical and rehabilitative interventions that are able to modulate cortical excitability. Intermittent theta burst stimulation (iTBS) is one such technique that can increase cortical excitability, purportedly via LTP-like mechanisms. While iTBS may have the capacity to promote recovery after neurological injury, and to combat cognitive and motor decline, recent reports observed highly variable effects across individuals, questioning the efficacy of iTBS as a clinical tool. The aim of this study was to examine intra-individual reliability and inter-individual variability in responses to iTBS. Thirty healthy participants completed two experimental sessions of the iTBS protocol 1-3 weeks apart. Motor evoked potentials in response to single pulse TMS were used to assess corticospinal excitability prior to, and up to 36 min following, iTBS. At the group level, iTBS evoked statistically significant increases in motor cortical excitability across both sessions (P < 0.001), with 22 out of 30 participants exhibiting increases in excitability in both sessions. A strong intraclass correlation demonstrated that both the direction, and magnitude of the plastic changes were reliable at the individual level. Overall, our results suggest that iTBS is capable of inducing relatively robust and consistent effects within and between young individuals. As such, the capacity for iTBS to be exploited in clinical and rehabilitative interventions should continue to be explored. Copyright © 2014 Elsevier Inc. All rights reserved.

Using virtual robot-mediated play activities to assess cognitive skills.

PubMed

Encarnação, Pedro; Alvarez, Liliana; Rios, Adriana; Maya, Catarina; Adams, Kim; Cook, Al

2014-05-01

To evaluate the feasibility of using virtual robot-mediated play activities to assess cognitive skills. Children with and without disabilities utilized both a physical robot and a matching virtual robot to perform the same play activities. The activities were designed such that successfully performing them is an indication of understanding of the underlying cognitive skills. Participants' performance with both robots was similar when evaluated by the success rates in each of the activities. Session video analysis encompassing participants' behavioral, interaction and communication aspects revealed differences in sustained attention, visuospatial and temporal perception, and self-regulation, favoring the virtual robot. The study shows that virtual robots are a viable alternative to the use of physical robots for assessing children's cognitive skills, with the potential of overcoming limitations of physical robots such as cost, reliability and the need for on-site technical support. Virtual robots can provide a vehicle for children to demonstrate cognitive understanding. Virtual and physical robots can be used as augmentative manipulation tools allowing children with disabilities to actively participate in play, educational and therapeutic activities. Virtual robots have the potential of overcoming limitations of physical robots such as cost, reliability and the need for on-site technical support.

Development of an interprofessional lean facilitator assessment scale.

PubMed

Bravo-Sanchez, Cindy; Dorazio, Vincent; Denmark, Robert; Heuer, Albert J; Parrott, J Scott

2018-05-01

High reliability is important for optimising quality and safety in healthcare organisations. Reliability efforts include interprofessional collaborative practice (IPCP) and Lean quality/process improvement strategies, which require skilful facilitation. Currently, no validated Lean facilitator assessment tool for interprofessional collaboration exists. This article describes the development and pilot evaluation of such a tool; the Interprofessional Lean Facilitator Assessment Scale (ILFAS), which measures both technical and 'soft' skills, which have not been measured in other instruments. The ILFAS was developed using methodologies and principles from Lean/Shingo, IPCP, metacognition research and Bloom's Taxonomy of Learning Domains. A panel of experts confirmed the initial face validity of the instrument. Researchers independently assessed five facilitators, during six Lean sessions. Analysis included quantitative evaluation of rater agreement. Overall inter-rater agreement of the assessment of facilitator performance was high (92%), and discrepancies in the agreement statistics were analysed. Face and content validity were further established, and usability was evaluated, through primary stakeholder post-pilot feedback, uncovering minor concerns, leading to tool revision. The ILFAS appears comprehensive in the assessment of facilitator knowledge, skills, abilities, and may be useful in the discrimination between facilitators of different skill levels. Further study is needed to explore instrument performance and validity.

A Framework for Measuring the Progress in Exoskeleton Skills in People with Complete Spinal Cord Injury

PubMed Central

van Dijsseldonk, Rosanne B.; Rijken, Hennie; van Nes, Ilse J. W.; van de Meent, Henk; Keijsers, Noel L. W.

2017-01-01

For safe application of exoskeletons in people with spinal cord injury at home or in the community, it is required to have completed an exoskeleton training in which users learn to perform basic and advanced skills. So far, a framework to test exoskeleton skills is lacking. The aim of this study was to develop and test the hierarchy and reliability of a framework for measuring the progress in the ability to perform basic and advanced skills. Twelve participants with paraplegia were given twenty-four training sessions in 8 weeks with the Rewalk-exoskeleton. During the 2nd, 4th, and 6th training week the Intermediate-skills-test was performed consisting of 27 skills, measured in an hierarchical order of difficulty, until two skills were not achieved. When participants could walk independently, the Final-skills-test, consisting of 20 skills, was performed in the last training session. Each skill was performed at least two times with a maximum of three attempts. As a reliability measure the consistency was used, which was the number of skills performed the same in the first two attempts relative to the total number. Ten participants completed the training program. Their number of achieved intermediate skills was significantly different between the measurements XF2(2) = 12.36, p = 0.001. Post-hoc analysis revealed a significant increase in the median achieved intermediate skills from 4 [1–7] at the first to 10.5 [5–26] at the third Intermediate-skills-test. The rate of participants who achieved the intermediate skills decreased and the coefficient of reproducibility was 0.98. Eight participants met the criteria to perform the Final-skills-test. Their median number of successfully performed final skills was 16.5 [13–20] and 17 [14–19] skills in the first and second time. The overall consistency of >70% was achieved in the Intermediate-skills-test (73%) and the Final-skills-test (81%). Eight out of twelve participants experienced skin damage during the training, in four participants this resulted in missed training sessions. The framework proposed in this study measured the progress in performing basic and advanced exoskeleton skills during a training program. The hierarchical ordered skills-test could discriminate across participants' skill-level and the overall consistency was considered acceptable. PMID:29311780

A Framework for Measuring the Progress in Exoskeleton Skills in People with Complete Spinal Cord Injury.

PubMed

van Dijsseldonk, Rosanne B; Rijken, Hennie; van Nes, Ilse J W; van de Meent, Henk; Keijsers, Noel L W

2017-01-01

For safe application of exoskeletons in people with spinal cord injury at home or in the community, it is required to have completed an exoskeleton training in which users learn to perform basic and advanced skills. So far, a framework to test exoskeleton skills is lacking. The aim of this study was to develop and test the hierarchy and reliability of a framework for measuring the progress in the ability to perform basic and advanced skills. Twelve participants with paraplegia were given twenty-four training sessions in 8 weeks with the Rewalk-exoskeleton. During the 2nd, 4th, and 6th training week the Intermediate-skills-test was performed consisting of 27 skills, measured in an hierarchical order of difficulty, until two skills were not achieved. When participants could walk independently, the Final-skills-test, consisting of 20 skills, was performed in the last training session. Each skill was performed at least two times with a maximum of three attempts. As a reliability measure the consistency was used, which was the number of skills performed the same in the first two attempts relative to the total number. Ten participants completed the training program. Their number of achieved intermediate skills was significantly different between the measurements X F 2 (2) = 12.36, p = 0.001. Post-hoc analysis revealed a significant increase in the median achieved intermediate skills from 4 [1-7] at the first to 10.5 [5-26] at the third Intermediate-skills-test. The rate of participants who achieved the intermediate skills decreased and the coefficient of reproducibility was 0.98. Eight participants met the criteria to perform the Final-skills-test. Their median number of successfully performed final skills was 16.5 [13-20] and 17 [14-19] skills in the first and second time. The overall consistency of >70% was achieved in the Intermediate-skills-test (73%) and the Final-skills-test (81%). Eight out of twelve participants experienced skin damage during the training, in four participants this resulted in missed training sessions. The framework proposed in this study measured the progress in performing basic and advanced exoskeleton skills during a training program. The hierarchical ordered skills-test could discriminate across participants' skill-level and the overall consistency was considered acceptable.

Combined Medication and CBT for Generalized Anxiety Disorder with African American Participants: Reliability and Validity of Assessments and Preliminary Outcomes

PubMed Central

Markell, Hannah M.; Newman, Michelle G.; Gallop, Robert; Gibbons, Mary Beth Connolly; Rickels, Karl; Crits-Christoph, Paul

2014-01-01

Using data from a study of combined cognitive behavioral therapy (CBT) and venlafaxine XR in the treatment of generalized anxiety disorder (GAD), the current article examines the reliability and convergent validity of scales, and preliminary outcomes, for African American compared to European American patients. Internal consistency and short-term stability coefficients for African Americans (n=42) were adequate and similar or higher compared to those found for European Americans (n=164) for standard scales used in GAD treatment research. Correlations among outcome measures among African Americans were in general not significantly different for African Americans compared to European Americans. A subset of patients with DSM-IV–diagnosed GAD (n = 24 African Americans; n = 52 European Americans) were randomly selected to be offered the option of adding 12 sessions of CBT to venlafaxine XR treatment. Of those offered CBT, 33.3% (n = 8) of the African Americans, and 32.6% (n = 17) of the European Americans accepted and attended at least one CBT treatment session. The outcomes for African Americans receiving combined treatment were not significantly different from European Americans receiving combined treatment on primary or secondary efficacy measures. PMID:24912462

The 10m incremental shuttle walk test is a highly reliable field exercise test for patients referred to cardiac rehabilitation: a retest reliability study.

PubMed

Hanson, Lisa C; Taylor, Nicholas F; McBurney, Helen

2016-09-01

To determine the retest reliability of the 10m incremental shuttle walk test (ISWT) in a mixed cardiac rehabilitation population. Participants completed two 10m ISWTs in a single session in a repeated measures study. Ten participants completed a third 10m ISWT as part of a pilot study. Hospital physiotherapy department. 62 adults aged a mean of 68 years (SD 10) referred to a cardiac rehabilitation program. Retest reliability of the 10m ISWT expressed as relative reliability and measurement error. Relative reliability was expressed in a ratio in the form of an intraclass correlation coefficient (ICC) and measurement error in the form of the standard error of measurement (SEM) and 95% confidence intervals for the group and individual. There was a high level of relative reliability over the two walks with an ICC of .99. The SEMagreement was 17m, and a change of at least 23m for the group and 54m for the individual would be required to be 95% confident of exceeding measurement error. The 10m ISWT demonstrated good retest reliability and is sufficiently reliable to be applied in practice in this population without the use of a practice test. Copyright © 2015 Chartered Society of Physiotherapy. Published by Elsevier Ltd. All rights reserved.

Comparative analysis of a client's verbal responses in counseling sessions: quantitative case study.

PubMed

Lee, Han-Jong

2011-04-01

This study investigated how the in-session change in a client's verbal behavior might influence the effectiveness of counseling sessions. 10 sessions of counseling with a male undergraduate suffering from depressive mood were conducted by a humanistically oriented counselor. The two most effective and the two least effective sessions were identified according to the client's evaluation of the effectiveness of counseling sessions. Results indicated that over the three segments of the most effective sessions, the client gradually increased responses that indicated exploration of his own emotions, thoughts, and behaviors. By contrast, the client continued talking mainly about past events in a storytelling manner throughout the least effective sessions.

Test-retest reliability and practice effects of a rapid screen of mild traumatic brain injury.

PubMed

De Monte, Veronica Eileen; Geffen, Gina Malke; Kwapil, Karleigh

2005-07-01

Test-retest reliabilities and practice effects of measures from the Rapid Screen of Concussion (RSC), in addition to the Digit Symbol Substitution Test (Digit Symbol), were examined. Twenty five male participants were tested three times; each testing session scheduled a week apart. The test-retest reliability estimates for most measures were reasonably good, ranging from .79 to .97. An exception was the delayed word recall test, which has had a reliability estimate of .66 for the first retest, and .59 for the second retest. Practice effects were evident from Times 1 to 2 on the sentence comprehension and delayed recall subtests of the RSC, Digit Symbol and a composite score. There was also a practice effect of the same magnitude found from Time 2 to Time 3 on Digit Symbol, delayed recall and the composite score. Statistics on measures for both the first and second retest intervals, with associated practice effects, are presented to enable the calculation of reliable change indices (RCI). The RCI may be used to assess any improvement in cognitive functioning after mild Traumatic Brain Injury.

The validity and reliability of the sixth-year internal medical examination administered at the King Abdulaziz University Medical College.

PubMed

Fallatah, Hind I; Tekian, Ara; Park, Yoon Soo; Al Shawa, Lana

2015-02-01

Exams are essential components of medical students' knowledge and skill assessment during their clinical years of study. The paper provides a retrospective analysis of validity evidence for the internal medicine component of the written and clinical exams administered in 2012 and 2013 at King Abdulaziz University's Faculty of Medicine. Students' scores for the clinical and written exams were obtained. Four faculty members (two senior members and two junior members) were asked to rate the exam questions, including MCQs and OSCEs, for evidence of content validity using a rating scale of 1-5 for each item. Cronbach's alpha was used to measure the internal consistency reliability. Correlations were used to examine the associations between different forms of assessment and groups of students. A total of 824 students completed the internal medicine course and took the exam. The numbers of rated questions were 320 and 46 for the MCQ and OSCE, respectively. Significant correlations were found between the MCQ section, the OSCE section, and the continuous assessment marks, which include 20 long-case presentations during the course; participation in daily rounds, clinical sessions and tutorials; the performance of simple procedures, such as IV cannulation and ABG extraction; and the student log book. Although the OSCE exam was reliable for the two groups that had taken the final clinical OSCE, the clinical long- and short-case exams were not reliable across the two groups that had taken the oral clinical exams. The correlation analysis showed a significant linear association between the raters with respect to evidence of content validity for both the MCQ and OSCE, r = .219 P < .001 and r = .678 P < .001, respectively, and r = .241 P < .001 and r = .368 P = .023 for the internal structure validity, respectively. Reliability measured using Cronbach's alpha was greater for assessments administered in 2013. The pattern of relationships between the MCQ and OSCE scores provides evidence of the validity of these measures for use in the evaluation of knowledge and clinical skills in internal medicine. The OSCE exam is more reliable than the short- and long-case clinical exams and requires less effort on the part of examiners and patients.

The reliability of three-dimensional scapular attitudes in healthy people and people with shoulder impingement syndrome.

PubMed

Roy, Jean-Sébastien; Moffet, Hélène; Hébert, Luc J; St-Vincent, Guy; McFadyen, Bradford J

2007-06-21

Abnormal scapular displacements during arm elevation have been observed in people with shoulder impingement syndrome. These abnormal scapular displacements were evaluated using different methods and instruments allowing a 3-dimensional representation of the scapular kinematics. The validity and the intrasession reliability have been shown for the majority of these methods for healthy people. However, the intersession reliability on healthy people and people with impaired shoulders is not well documented. This measurement property needs to be assessed before using such methods in longitudinal comparative studies. The objective of this study is to evaluate the intra and intersession reliability of 3-dimensional scapular attitudes measured at different arm positions in healthy people and to explore the same measurement properties in people with shoulder impingement syndrome using the Optotrak Probing System. Three-dimensional scapular attitudes were measured twice (test and retest interspaced by one week) on fifteen healthy subjects (mean age 37.3 years) and eight subjects with subacromial shoulder impingement syndrome (mean age 46.1 years) in three arm positions (arm at rest, 70 degrees of humerothoracic flexion and 90 degrees of humerothoracic abduction) using the Optotrak Probing System. Two different methods of calculation of 3-dimensional scapular attitudes were used: relative to the position of the scapula at rest and relative to the trunk. Intraclass correlation coefficient (ICC) and standard error of measure (SEM) were used to estimate intra and intersession reliability. For both groups, the reliability of the three-dimensional scapular attitudes for elevation positions was very good during the same session (ICCs from 0.84 to 0.99; SEM from 0.6 degrees to 1.9 degrees ) and good to very good between sessions (ICCs from 0.62 to 0.97; SEM from 1.2 degrees to 4.2 degrees ) when using the method of calculation relative to the trunk. Higher levels of intersession reliability were found for the method of calculation relative to the trunk in anterior-posterior tilting at 70 degrees of flexion compared to the method of calculation relative to the scapula at rest. The estimation of three-dimensional scapular attitudes using the method of calculation relative to the trunk is reproducible in the three arm positions evaluated and can be used to document the scapular behavior.

The reliability of three-dimensional scapular attitudes in healthy people and people with shoulder impingement syndrome

PubMed Central

Roy, Jean-Sébastien; Moffet, Hélène; Hébert, Luc J; St-Vincent, Guy; McFadyen, Bradford J

2007-01-01

Background Abnormal scapular displacements during arm elevation have been observed in people with shoulder impingement syndrome. These abnormal scapular displacements were evaluated using different methods and instruments allowing a 3-dimensional representation of the scapular kinematics. The validity and the intrasession reliability have been shown for the majority of these methods for healthy people. However, the intersession reliability on healthy people and people with impaired shoulders is not well documented. This measurement property needs to be assessed before using such methods in longitudinal comparative studies. The objective of this study is to evaluate the intra and intersession reliability of 3-dimensional scapular attitudes measured at different arm positions in healthy people and to explore the same measurement properties in people with shoulder impingement syndrome using the Optotrak Probing System. Methods Three-dimensional scapular attitudes were measured twice (test and retest interspaced by one week) on fifteen healthy subjects (mean age 37.3 years) and eight subjects with subacromial shoulder impingement syndrome (mean age 46.1 years) in three arm positions (arm at rest, 70° of humerothoracic flexion and 90° of humerothoracic abduction) using the Optotrak Probing System. Two different methods of calculation of 3-dimensional scapular attitudes were used: relative to the position of the scapula at rest and relative to the trunk. Intraclass correlation coefficient (ICC) and standard error of measure (SEM) were used to estimate intra and intersession reliability. Results For both groups, the reliability of the three-dimensional scapular attitudes for elevation positions was very good during the same session (ICCs from 0.84 to 0.99; SEM from 0.6° to 1.9°) and good to very good between sessions (ICCs from 0.62 to 0.97; SEM from 1.2° to 4.2°) when using the method of calculation relative to the trunk. Higher levels of intersession reliability were found for the method of calculation relative to the trunk in anterior-posterior tilting at 70° of flexion compared to the method of calculation relative to the scapula at rest. Conclusion The estimation of three-dimensional scapular attitudes using the method of calculation relative to the trunk is reproducible in the three arm positions evaluated and can be used to document the scapular behavior. PMID:17584933

Validity and Reliability of Nintendo Wii Fit Balance Scores

PubMed Central

Wikstrom, Erik A.

2012-01-01

Context: Interactive gaming systems have the potential to help rehabilitate patients with musculoskeletal conditions. The Nintendo Wii Balance Board, which is part of the Wii Fit game, could be an effective tool to monitor progress during rehabilitation because the board and game can provide objective measures of balance. However, the validity and reliability of Wii Fit balance scores remain unknown. Objective: To determine the concurrent validity of balance scores produced by the Wii Fit game and the intrasession and intersession reliability of Wii Fit balance scores. Design: Descriptive laboratory study. Setting: Sports medicine research laboratory. Patients or Other Participants: Forty-five recreationally active participants (age  =  27.0 ± 9.8 years, height  =  170.9 ± 9.2 cm, mass  =  72.4 ± 11.8 kg) with a heterogeneous history of lower extremity injury. Intervention(s): Participants completed a single-limb–stance task on a force plate and the Star Excursion Balance Test (SEBT) during the first test session. Twelve Wii Fit balance activities were completed during 2 test sessions separated by 1 week. Main Outcome Measure(s): Postural sway in the anteroposterior (AP) and mediolateral (ML) directions and the AP, ML, and resultant center-of-pressure (COP) excursions were calculated from the single-limb stance. The normalized reach distance was recorded for the anterior, posteromedial, and posterolateral directions of the SEBT. Wii Fit balance scores that the game software generated also were recorded. Results: All 96 of the calculated correlation coefficients among Wii Fit activity outcomes and established balance outcomes were interpreted as poor (r < 0.50). Intrasession reliability for Wii Fit balance activity scores ranged from good (intraclass correlation coefficient [ICC]  =  0.80) to poor (ICC  =  0.39), with 8 activities having poor intrasession reliability. Similarly, 11 of the 12 Wii Fit balance activity scores demonstrated poor intersession reliability, with scores ranging from fair (ICC  =  0.74) to poor (ICC  =  0.29). Conclusions: Wii Fit balance activity scores had poor concurrent validity relative to COP outcomes and SEBT reach distances. In addition, the included Wii Fit balance activity scores generally had poor intrasession and intersession reliability. PMID:22892412

Validity and reliability of a low-cost digital dynamometer for measuring isometric strength of lower limb.

PubMed

Romero-Franco, Natalia; Jiménez-Reyes, Pedro; Montaño-Munuera, Juan A

2017-11-01

Lower limb isometric strength is a key parameter to monitor the training process or recognise muscle weakness and injury risk. However, valid and reliable methods to evaluate it often require high-cost tools. The aim of this study was to analyse the concurrent validity and reliability of a low-cost digital dynamometer for measuring isometric strength in lower limb. Eleven physically active and healthy participants performed maximal isometric strength for: flexion and extension of ankle, flexion and extension of knee, flexion, extension, adduction, abduction, internal and external rotation of hip. Data obtained by the digital dynamometer were compared with the isokinetic dynamometer to examine its concurrent validity. Data obtained by the digital dynamometer from 2 different evaluators and 2 different sessions were compared to examine its inter-rater and intra-rater reliability. Intra-class correlation (ICC) for validity was excellent in every movement (ICC > 0.9). Intra and inter-tester reliability was excellent for all the movements assessed (ICC > 0.75). The low-cost digital dynamometer demonstrated strong concurrent validity and excellent intra and inter-tester reliability for assessing isometric strength in the main lower limb movements.

Reliability of temporal summation and diffuse noxious inhibitory control

PubMed Central

Cathcart, Stuart; Winefield, Anthony H; Rolan, Paul; Lushington, Kurt

2009-01-01

BACKGROUND: The test-retest reliability of temporal summation (TS) and diffuse noxious inhibitory control (DNIC) has not been reported to date. Establishing such reliability would support the possibility of future experimental studies examining factors affecting TS and DNIC. Similarly, the use of manual algometry to induce TS, or an occlusion cuff to induce DNIC of TS to mechanical stimuli, has not been reported to date. Such devices may offer a simpler method than current techniques for inducing TS and DNIC, affording assessment at more anatomical locations and in more varied research settings. METHOD: The present study assessed the test-retest reliability of TS and DNIC using the above techniques. Sex differences on these measures were also investigated. RESULTS: Repeated measures ANOVA indicated successful induction of TS and DNIC, with no significant differences across test-retest occasions. Sex effects were not significant for any measure or interaction. Intraclass correlations indicated high test-retest reliability for all measures; however, there was large interindividual variation between test and retest measurements. CONCLUSION: The present results indicate acceptable within-session test-retest reliability of TS and DNIC. The results support the possibility of future experimental studies examining factors affecting TS and DNIC. PMID:20011713

Early Detection of Physical Activity for People With Type 1 Diabetes Mellitus.

PubMed

Dasanayake, Isuru S; Bevier, Wendy C; Castorino, Kristin; Pinsker, Jordan E; Seborg, Dale E; Doyle, Francis J; Dassau, Eyal

2015-06-30

Early detection of exercise in individuals with type 1 diabetes mellitus (T1DM) may allow changes in therapy to prevent hypoglycemia. Currently there is limited experience with automated methods that detect the onset and end of exercise in this population. We sought to develop a novel method to quickly and reliably detect the onset and end of exercise in these individuals before significant changes in blood glucose (BG) occur. Sixteen adults with T1DM were studied as outpatients using a diary, accelerometer, heart rate monitor, and continuous glucose monitor for 2 days. These data were used to develop a principal component analysis based exercise detection method. Subjects also performed 60 and 30 minute exercise sessions at 30% and 50% predicted heart rate reserve (HRR), respectively. The detection method was applied to the exercise sessions to determine how quickly the detection of start and end of exercise occurred relative to change in BG. Mild 30% HRR and moderate 50% HRR exercise onset was identified in 6 ± 3 and 5 ± 2 (mean ± SD) minutes, while completion was detected in 3 ± 8 and 6 ± 5 minutes, respectively. BG change from start of exercise to detection time was 1 ± 6 and -1 ± 3 mg/dL, and, from the end of exercise to detection time was 6 ± 4 and -17 ± 13 mg/dL, respectively, for the 2 exercise sessions. False positive and negative ratios were 4 ± 2% and 21 ± 22%. The novel method for exercise detection identified the onset and end of exercise in approximately 5 minutes, with an average BG change of only -6 mg/dL. © 2015 Diabetes Technology Society.

Alcohol enhances unprovoked 22–28 kHz USVs and suppresses USV mean frequency in High Alcohol Drinking (HAD-1) male rats

PubMed Central

Thakore, Neha; Reno, James M.; Gonzales, Rueben A.; Schallert, Timothy; Bell, Richard L.; Maddox, W. Todd; Duvauchelle, Christine L.

2016-01-01

Heightened emotional states increase impulsive behaviors such as excessive ethanol consumption in humans. Though positive and negative affective states in rodents can be monitored in real-time through ultrasonic vocalization (USV) emissions, few animal studies have focused on the role of emotional status as a stimulus for initial ethanol drinking. Our laboratory has recently developed reliable, high-speed analysis techniques to compile USV data during multiple-hour drinking sessions. Since High Alcohol Drinking (HAD-1) rats are selectively bred to voluntarily consume intoxicating levels of alcohol, we hypothesized that USVs emitted by HAD-1 rats would reveal unique emotional phenotypes predictive of alcohol intake and sensitive to alcohol experience. In this study, male HAD-1 rats had access to water, 15% and 30% EtOH or water only (i.e., Controls) during 8 weeks of daily 7-hr drinking-in-the-dark (DID) sessions. USVs, associated with both positive (i.e., 50–55 kHz frequency-modulated or FM) and negative (i.e., 22–28 kHz) emotional states, emitted during these daily DID sessions were examined. Findings showed basal 22–28 kHz USVs were emitted by both EtOH-Naïve (Control) and EtOH-experienced rats, alcohol experience enhanced 22–28 kHz USV emissions, and USV acoustic parameters (i.e., mean frequency in kHz) of both positive and negative USVs were significantly suppressed by chronic alcohol experience. These data suggest that negative affective status initiates and maintains excessive alcohol intake in selectively bred HAD-1 rats and support the notion that unprovoked emissions of negative affect-associated USVs (i.e., 22–28 kHz) predict vulnerability to excessive alcohol intake in distinct rodent models. PMID:26802730

Preventing Youths' Use of Inhalants and Other Harmful Legal Products in Frontier Alaskan Communities: A Randomized Trial

PubMed Central

Shamblen, Stephen R.; Ogilvie, Kristen A.; Collins, David; Saylor, Brian

2013-01-01

This study tests for the efficacy of a school-based drug prevention curriculum (Think Smart) that was designed to reduce use of Harmful Legal Products (HLPs, such as inhalants and over-the-counter drugs), alcohol, tobacco, and other drugs among fifth- and sixth-grade students in frontier Alaska. The curriculum consisted of 12 core sessions and 3 booster sessions administered 2 to 3 months later, and was an adaptation of the Schinke life skills training curriculum for Native Americans. Fourteen communities, which represented a mixture of Caucasian and Alaska Native populations in various regions of the state, were randomly assigned to intervention or control conditions. Single items measuring 30-day substance use and multi-item scales measuring the mediators under study were taken from prior studies. Scales for the mediators demonstrated satisfactory construct validity and internal reliability. A pre-intervention survey was administered in classrooms in each school in the fall semester of the fifth and sixth grades prior to implementing the Think Smart curriculum, and again in the spring semester immediately following the booster session. A follow-up survey was administered 6 months later in the fall semester of the sixth and seventh grades. A multi-level analysis found that the Think Smart curriculum produced a decrease (medium size effect) in the proportion of students who used HLPs over a 30-day period at the 6 month follow-up assessment. There were no effects on other drug use. Further, the direct effect of HLPs use was not mediated by the measured risk and protective factors that have been promoted in the prevention field. Alternative explanations and implications of these results are discussed. PMID:19440837

Alcohol enhances unprovoked 22-28 kHz USVs and suppresses USV mean frequency in High Alcohol Drinking (HAD-1) male rats.

PubMed

Thakore, Neha; Reno, James M; Gonzales, Rueben A; Schallert, Timothy; Bell, Richard L; Maddox, W Todd; Duvauchelle, Christine L

2016-04-01

Heightened emotional states increase impulsive behaviors such as excessive ethanol consumption in humans. Though positive and negative affective states in rodents can be monitored in real-time through ultrasonic vocalization (USV) emissions, few animal studies have focused on the role of emotional status as a stimulus for initial ethanol drinking. Our laboratory has recently developed reliable, high-speed analysis techniques to compile USV data during multiple-hour drinking sessions. Since High Alcohol Drinking (HAD-1) rats are selectively bred to voluntarily consume intoxicating levels of alcohol, we hypothesized that USVs emitted by HAD-1 rats would reveal unique emotional phenotypes predictive of alcohol intake and sensitive to alcohol experience. In this study, male HAD-1 rats had access to water, 15% and 30% EtOH or water only (i.e., Controls) during 8 weeks of daily 7-h drinking-in-the-dark (DID) sessions. USVs, associated with both positive (i.e., 50-55 kHz frequency-modulated or FM) and negative (i.e., 22-28 kHz) emotional states, emitted during these daily DID sessions were examined. Findings showed basal 22-28 kHz USVs were emitted by both EtOH-Naïve (Control) and EtOH-experienced rats, alcohol experience enhanced 22-28 kHz USV emissions, and USV acoustic parameters (i.e., mean frequency in kHz) of both positive and negative USVs were significantly suppressed by chronic alcohol experience. These data suggest that negative affective status initiates and maintains excessive alcohol intake in selectively bred HAD-1 rats and support the notion that unprovoked emissions of negative affect-associated USVs (i.e., 22-28 kHz) predict vulnerability to excessive alcohol intake in distinct rodent models. Published by Elsevier B.V.

Development of a clinical algorithm for treating urethral strictures based on a large retrospective single-center cohort

PubMed Central

Tolkach, Yuri; Herrmann, Thomas; Merseburger, Axel; Burchardt, Martin; Wolters, Mathias; Huusmann, Stefan; Kramer, Mario; Kuczyk, Markus; Imkamp, Florian

2017-01-01

Aim: To analyze clinical data from male patients treated with urethrotomy and to develop a clinical decision algorithm. Materials and methods: Two large cohorts of male patients with urethral strictures were included in this retrospective study, historical (1985-1995, n=491) and modern cohorts (1996-2006, n=470). All patients were treated with repeated internal urethrotomies (up to 9 sessions). Clinical outcomes were analyzed and systemized as a clinical decision algorithm. Results: The overall recurrence rates after the first urethrotomy were 32.4% and 23% in the historical and modern cohorts, respectively. In many patients, the second procedure was also effective with the third procedure also feasible in selected patients. The strictures with a length ≤ 2 cm should be treated according to the initial length. In patients with strictures ≤ 1 cm, the second session could be recommended in all patients, but not with penile strictures, strictures related to transurethral operations or for patients who were 31-50 years of age. The third session could be effective in selected cases of idiopathic bulbar strictures. For strictures with a length of 1-2 cm, a second operation is possible for the solitary low-grade bulbar strictures, given that the age is > 50 years and the etiology is not post-transurethral resection of the prostate. For penile strictures that are 1-2 cm, urethrotomy could be attempted in solitary but not in high-grade strictures. Conclusions: We present data on the treatment of urethral strictures with urethrotomy from a single center. Based on the analysis, a clinical decision algorithm was suggested, which could be a reliable basis for everyday clinical practice. PMID:28529689

"Wish we would have known that!" Communication Breakdown Impedes Person-Centered Care.

PubMed

Kolanowski, Ann; Van Haitsma, Kimberly; Penrod, Janice; Hill, Nikki; Yevchak, Andrea

2015-06-01

To understand how nursing home staff obtain information needed for implementing person-centered care (PCC) to residents with dementia who exhibit behavioral and psychological symptoms of dementia (BPSD), and how they communicate this information to other staff. Barriers to PCC and information exchange were also explored. Participants were 59 staff from two nursing homes. Focus group methodology captured discussions in eight 1-hr sessions. Sessions were audiotaped and transcribed. Data were analyzed using qualitative content analysis to provide a comprehensive summary of real world context of implementing PCC. To deliver PCC staff identified a need for access to psychosocial/medical history of the resident and knowledge of strategies families used for managing BPSD in the past. However, resident information is not routinely shared with all staff and written documentation systems for communicating resident-specific information do not support the time-pressured work pattern of certified nursing assistants (CNAs). Word-of-mouth was considered more reliable and expedient than educational sessions. CNAs described themselves as visual learners who prefer educational programs addressing individual resident emergent behaviors and programs that are scheduled at dedicated times. To improve PCC the flow of information exchange requires: inclusion of all staff, particularly CNAs; systems of communication that consider the time and resource constraints of nursing homes; development of educational programs for BPSD that are responsive to staff learning styles; administrative investment in nursing leadership to effect these changes; and reimbursement approaches to encourage culture change investments. © The Author 2015. Published by Oxford University Press on behalf of The Gerontological Society of America. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

Effectiveness of Disease-Specific Cognitive Behavioral Therapy on Anxiety, Depression, and Quality of Life in Youth With Inflammatory Bowel Disease: A Randomized Controlled Trial.

PubMed

Stapersma, Luuk; van den Brink, Gertrude; van der Ende, Jan; Szigethy, Eva M; Beukers, Ruud; Korpershoek, Thea A; Theuns-Valks, Sabine D M; Hillegers, Manon H J; Escher, Johanna C; Utens, Elisabeth M W J

2018-05-29

To evaluate the effectiveness of a disease-specific cognitive behavioral therapy (CBT) protocol on anxiety and depressive symptoms and health-related quality of life (HRQOL) in adolescents and young adults with inflammatory bowel disease (IBD). A parallel group randomized controlled trial was conducted in 6 centers of (pediatric) gastroenterology. Included were 70 patients and young adults (10-25 years) with IBD and subclinical anxiety and/or depressive symptoms. Patients were randomized into 2 groups, stratified by center: (a) standard medical care (care-as-usual [CAU]) plus disease-specific manualized CBT (Primary and Secondary Control Enhancement Training for Physical Illness; PASCET-PI), with 10 weekly sessions, 3 parent sessions, and 3 booster sessions (n = 37), or (b) CAU only (n = 33). Primary analysis concerned the reliable change in anxiety and depressive symptoms after 3 months (immediate posttreatment assessment). Exploratory analyses concerned (1) the course of anxiety and depressive symptoms and HRQOL in subgroups based on age, and (2) the influence of age, gender, and disease type on the effect of the PASCET-PI. Overall, all participants improved significantly in their anxiety and depressive symptoms and HRQOL, regardless of group, age, gender, and disease type. Primary chi-square tests and exploratory linear mixed models showed no difference in outcomes between the PASCET-PI (n = 35) and the CAU group (n = 33). In youth with IBD and subclinical anxiety and/or depressive symptoms, preliminary results of immediate post-treatment assessment indicated that a disease-specific CBT added to standard medical care did not perform better than standard medical care in improving psychological symptoms or HRQOL. ClinicalTrials.gov: NCT02265588.

Test-retest and interrater reliability of the functional lower extremity evaluation.

PubMed

Haitz, Karyn; Shultz, Rebecca; Hodgins, Melissa; Matheson, Gordon O

2014-12-01

Repeated-measures clinical measurement reliability study. To establish the reliability and face validity of the Functional Lower Extremity Evaluation (FLEE). The FLEE is a 45-minute battery of 8 standardized functional performance tests that measures 3 components of lower extremity function: control, power, and endurance. The reliability and normative values for the FLEE in healthy athletes are unknown. A face validity survey for the FLEE was sent to sports medicine personnel to evaluate the level of importance and frequency of clinical usage of each test included in the FLEE. The FLEE was then administered and rated for 40 uninjured athletes. To assess test-retest reliability, each athlete was tested twice, 1 week apart, by the same rater. To assess interrater reliability, 3 raters scored each athlete during 1 of the testing sessions. Intraclass correlation coefficients were used to assess the test-retest and interrater reliability of each of the FLEE tests. In the face validity survey, the FLEE tests were rated as highly important by 58% to 71% of respondents but frequently used by only 26% to 45% of respondents. Interrater reliability intraclass correlation coefficients ranged from 0.83 to 1.00, and test-retest reliability ranged from 0.71 to 0.95. The FLEE tests are considered clinically important for assessing lower extremity function by sports medicine personnel but are underused. The FLEE also is a reliable assessment tool. Future studies are required to determine if use of the FLEE to make return-to-play decisions may reduce reinjury rates.

Leveraging routine clinical materials and mobile technology to assess CBT fidelity: the Innovative Methods to Assess Psychotherapy Practices (imAPP) study.

PubMed

Wiltsey Stirman, Shannon; Marques, Luana; Creed, Torrey A; Gutner, Cassidy A; DeRubeis, Robert; Barnett, Paul G; Kuhn, Eric; Suvak, Michael; Owen, Jason; Vogt, Dawne; Jo, Booil; Schoenwald, Sonja; Johnson, Clara; Mallard, Kera; Beristianos, Matthew; La Bash, Heidi

2018-05-22

Identifying scalable strategies for assessing fidelity is a key challenge in implementation science. However, for psychosocial interventions, the existing, reliable ways to test treatment fidelity quality are often labor intensive, and less burdensome strategies may not reflect actual clinical practice. Cognitive behavioral therapies (CBTs) provide clinicians with a set of effective core elements to help treat a multitude of disorders, which, evidence suggests, need to be delivered with fidelity to maximize potential client impact. The current "gold standard" for rating CBTs is rating recordings of therapy sessions, which is extremely time-consuming and requires a substantial amount of initial training. Although CBTs can vary based on the target disorder, one common element employed in most CBTs is the use of worksheets to identify specific behaviors and thoughts that affect a client's ability to recover. The present study will develop and evaluate an innovative new approach to rate CBT fidelity, by developing a universal CBT scoring system based on worksheets completed in therapy sessions. To develop a scoring system for CBT worksheets, we will compile common CBT elements from a variety of CBT worksheets for a range of psychiatric disorders and create adherence and competence measures. We will collect archival worksheets from past studies to test the scoring system and assess test-retest reliability. To evaluate whether CBT worksheet scoring accurately reflects clinician fidelity, we will recruit clinicians who are engaged in a CBT for depression, anxiety, and/or posttraumatic stress disorder. Clinicians and clients will transmit routine therapy materials produced in session (e.g., worksheets, clinical notes, session recordings) to the study team after each session. We will compare observer-rated fidelity, clinical notes, and fidelity-rated worksheets to identify the most effective and efficient method to assess clinician fidelity. Clients will also be randomly assigned to either complete the CBT worksheets on paper forms or on a mobile application (app) to learn if worksheet format influences clinician and client experience or differs in terms of reflecting fidelity. Scoring fidelity using CBT worksheets may allow clinics to test fidelity in a short and effective manner, enhancing continuous quality improvement in the workplace. Clinicians and clinics can use such data to improve clinician fidelity in real time, leading to improved patient outcomes. ClinicalTrials.gov NCT03479398 . Retrospectively registered March 20, 2018.

Narrative Changes Predict a Decrease in Symptoms in CBT for Depression: An Exploratory Study.

PubMed

Gonçalves, Miguel M; Silva, Joana Ribeiro; Mendes, Inês; Rosa, Catarina; Ribeiro, António P; Batista, João; Sousa, Inês; Fernandes, Carlos F

2017-07-01

Innovative moments (IMs) are new and more adjusted ways of thinking, acting, feeling and relating that emerge during psychotherapy. Previous research on IMs has provided sustainable evidence that IMs differentiate recovered from unchanged psychotherapy cases. However, studies with cognitive behavioural therapy (CBT) are so far absent. The present study tests whether IMs can be reliably identified in CBT and examines if IMs and symptoms' improvement are associated. The following variables were assessed in each session from a sample of six cases of CBT for depression (a total of 111 sessions): (a) symptomatology outcomes (Outcome Questionnaire-OQ-10) and (b) IMs. Two hierarchical linear models were used: one to test whether IMs predicted a symptom decrease in the next session and a second one to test whether symptoms in one session predicted the emergence of IMs in the next session. Innovative moments were better predictors of symptom decrease than the reverse. A higher proportion of a specific type of IMs-reflection 2-in one session predicted a decrease in symptoms in the next session. Thus, when clients further elaborated this type of IM (in which clients describe positive contrasts or elaborate on changes processes), a reduction in symptoms was observed in the next session. A higher expression and elaboration of reflection 2 IMs appear to have a facilitative function in the reduction of depressive symptoms in this sample of CBT. Copyright © 2016 John Wiley & Sons, Ltd. Elaborating innovative moments (IMs) that are new ways of thinking, feeling, behaving and relating, in the therapeutic dialogue, may facilitate change. IMs that are more predictive of amelioration of symptoms in CBT are the ones focused on contrasts between former problematic patterns and new adjusted ones; and the ones in which the clients elaborate on processes of change. Therapists may integrate these kinds of questions (centred on contrasts and centred on what allowed change from the client's perspective), in the usual CBT techniques. When elaborating these IMs successfully, therapists may expect an improvement in symptoms in the next session of psychotherapy. Copyright © 2016 John Wiley & Sons, Ltd.

How useful are ARFI elastography cut-off values proposed by meta-analysis for predicting the significant fibrosis and compensated liver cirrhosis?

PubMed

Bota, Simona; Sporea, Ioan; Sirli, Roxana; Popescu, Alina; Gradinaru-Tascau, Oana

2015-06-01

To evaluate how often do we "miss" chronic hepatitis C patients with at least significant fibrosis (F>/=2) and those with compensated cirrhosis, by using Acoustic Radiation Force Impulse (ARFI) elastography cut-off values proposed by meta-analysis. Our study included 132 patients with chronic hepatitis C, evaluated by means of ARFI and liver biopsy (LB), in the same session. Reliable measurements were defined as: median value of 10 liver stiffness (LS) measurements with a success rate>/=60% and an interquartile range interval<30%. For predicting F>/=2 and F=4 we used the LS cut-offs proposed in the last published meta-analysis: 1.35 m/s and 1.87 m/s, respectively. Reliable LS measurements by means of ARFI were obtained in 117 patients (87.9%). In our study, 58 patients (49.6%) had LS values <1.35 m/s; from these 75.8% had F>/=2 in LB. From the 59 patients (50.4%) with LS values>/=1.35 m/s, only 6.8% had F0 or F1 in LB. Also, in our study, 88 patients (75.3%) had LS values <1.87 m/s; from these only 2.2 % had F4 in LB. From the 29 patients (24.7%) with LS values>/=1.87 m/s, 41.3% had F4 in LB. Both for prediction of at least significant fibrosis and liver cirrhosis, higher aminotransferases levels were associated with wrongly classified patients, in univariate and multivariate analysis. ARFI elastography had a very good positive predictive value (93.2%) for predicting the presence of significant fibrosis and excellent negative predictive value (97.8%) for excluding the presence of compensated liver cirrhosis.

Descriptors of sensation confirm the multidimensional nature of desire to void.

PubMed

Das, Rebekah; Buckley, Jonathan D; Williams, Marie T

2015-02-01

To collect and categorize descriptors of "desire to void" sensation, determine the reliability of descriptor categories and assess whether descriptor categories discriminate between people with and without symptoms of overactive bladder. This observational, repeated measures study involved 64 Australian volunteers (47 female), aged 50 years or more, with and without symptoms of overactive bladder. Descriptors of desire to void sensation were derived from a structured interview (conducted on two occasions, 1 week apart). Descriptors were recorded verbatim and categorized in a three-stage process. Overactive bladder status was determined by the Overactive Bladder Awareness Tool and the Overactive Bladder Symptom Score. McNemar's test assessed the reliability of descriptors volunteered between two occasions and Partial Least Squares Regression determined whether language categories discriminated according to overactive bladder status. Post hoc Chi squared analysis and relative risk calculation determined the size and direction of overactive bladder prediction. Thirteen language categories (Urgency, Fullness, Pressure, Tickle/tingle, Pain/ache, Heavy, Normal, Intense, Sudden, Annoying, Uncomfortable, Anxiety, and Unique somatic) encapsulated 344 descriptors of sensation. Descriptor categories were stable between two interviews. The categories "Urgency" and "Fullness" predicted overactive bladder status. Participants who volunteered "Urgency" descriptors were twice as likely to have overactive bladder and participants who volunteered "Fullness" descriptors were almost three times as likely not to have overactive bladder. The sensation of desire to void is reliably described over sessions separated by a week, the language used reflects multiple dimensions of sensation, and can predict overactive bladder status. © 2013 Wiley Periodicals, Inc.

A preliminary psychometric evaluation of Music in Dementia Assessment Scales (MiDAS).

PubMed

McDermott, Orii; Orgeta, Vasiliki; Ridder, Hanne Mette; Orrell, Martin

2014-06-01

Music in Dementia Assessment Scales (MiDAS), an observational outcome measure for music therapy with people with moderate to severe dementia, was developed from qualitative data of focus groups and interviews. Expert and peer consultations were conducted at each stage of the scale development to maximize its content validity. This study aimed to evaluate the psychometric properties of MiDAS. Care home residents with dementia attended weekly group music therapy for up to ten sessions. Music therapists and care home staff were requested to complete weekly MiDAS ratings. The Quality of Life Scale (QoL-AD) was completed at three time-points. A total of 629 (staff = 306, therapist = 323) MiDAS forms were completed. The statistical analysis revealed that MiDAS has high therapist inter-rater reliability, low staff inter-rater reliability, adequate staff test-retest reliability, adequate concurrent validity, and good construct validity. High factor loadings between the five MiDAS Visual Analogue Scale (VAS) items, levels of Interest, Response, Initiation, Involvement, and Enjoyment, were found. This study indicates that MiDAS has good psychometric properties despite the small sample size. Future research with a larger sample size could provide a more in-depth psychometric evaluation, including further exploration of the underlying factors. MiDAS provides a measure of engagement with musical experience and offers insight into who is likely to benefit on other outcomes such as quality of life or reduction in psychiatric symptoms.

Gait assessment using the Microsoft Xbox One Kinect: Concurrent validity and inter-day reliability of spatiotemporal and kinematic variables.

PubMed

Mentiplay, Benjamin F; Perraton, Luke G; Bower, Kelly J; Pua, Yong-Hao; McGaw, Rebekah; Heywood, Sophie; Clark, Ross A

2015-07-16

The revised Xbox One Kinect, also known as the Microsoft Kinect V2 for Windows, includes enhanced hardware which may improve its utility as a gait assessment tool. This study examined the concurrent validity and inter-day reliability of spatiotemporal and kinematic gait parameters estimated using the Kinect V2 automated body tracking system and a criterion reference three-dimensional motion analysis (3DMA) marker-based camera system. Thirty healthy adults performed two testing sessions consisting of comfortable and fast paced walking trials. Spatiotemporal outcome measures related to gait speed, speed variability, step length, width and time, foot swing velocity and medial-lateral and vertical pelvis displacement were examined. Kinematic outcome measures including ankle flexion, knee flexion and adduction and hip flexion were examined. To assess the agreement between Kinect and 3DMA systems, Bland-Altman plots, relative agreement (Pearson's correlation) and overall agreement (concordance correlation coefficients) were determined. Reliability was assessed using intraclass correlation coefficients, Cronbach's alpha and standard error of measurement. The spatiotemporal measurements had consistently excellent (r≥0.75) concurrent validity, with the exception of modest validity for medial-lateral pelvis sway (r=0.45-0.46) and fast paced gait speed variability (r=0.73). In contrast kinematic validity was consistently poor to modest, with all associations between the systems weak (r<0.50). In those measures with acceptable validity, the inter-day reliability was similar between systems. In conclusion, while the Kinect V2 body tracking may not accurately obtain lower body kinematic data, it shows great potential as a tool for measuring spatiotemporal aspects of gait. Copyright © 2015 Elsevier Ltd. All rights reserved.

Reliability and concurrent validity of the Microsoft Xbox One Kinect for assessment of standing balance and postural control.

PubMed

Clark, Ross A; Pua, Yong-Hao; Oliveira, Cristino C; Bower, Kelly J; Thilarajah, Shamala; McGaw, Rebekah; Hasanki, Ksaniel; Mentiplay, Benjamin F

2015-07-01

The Microsoft Kinect V2 for Windows, also known as the Xbox One Kinect, includes new and potentially far improved depth and image sensors which may increase its accuracy for assessing postural control and balance. The aim of this study was to assess the concurrent validity and reliability of kinematic data recorded using a marker-based three dimensional motion analysis (3DMA) system and the Kinect V2 during a variety of static and dynamic balance assessments. Thirty healthy adults performed two sessions, separated by one week, consisting of static standing balance tests under different visual (eyes open vs. closed) and supportive (single limb vs. double limb) conditions, and dynamic balance tests consisting of forward and lateral reach and an assessment of limits of stability. Marker coordinate and joint angle data were concurrently recorded using the Kinect V2 skeletal tracking algorithm and the 3DMA system. Task-specific outcome measures from each system on Day 1 and 2 were compared. Concurrent validity of trunk angle data during the dynamic tasks and anterior-posterior range and path length in the static balance tasks was excellent (Pearson's r>0.75). In contrast, concurrent validity for medial-lateral range and path length was poor to modest for all trials except single leg eyes closed balance. Within device test-retest reliability was variable; however, the results were generally comparable between devices. In conclusion, the Kinect V2 has the potential to be used as a reliable and valid tool for the assessment of some aspects of balance performance. Copyright © 2015 Elsevier B.V. All rights reserved.

Cognitive Sciences

NASA Technical Reports Server (NTRS)

1997-01-01

Session MP4 includes short reports on: (1) Face Recognition in Microgravity: Is Gravity Direction Involved in the Inversion Effect?; (2) Motor Timing under Microgravity; (3) Perceived Self-Motion Assessed by Computer-Generated Animations: Complexity and Reliability; (4) Prolonged Weightlessness Reference Frames and Visual Symmetry Detection; (5) Mental Representation of Gravity During a Locomotor Task; and (6) Haptic Perception in Weightlessness: A Sense of Force or a Sense of Effort?

A randomised controlled trial of three or one breathing technique training sessions for breathlessness in people with malignant lung disease.

PubMed

Johnson, Miriam J; Kanaan, Mona; Richardson, Gerry; Nabb, Samantha; Torgerson, David; English, Anne; Barton, Rachael; Booth, Sara

2015-09-07

About 90 % of patients with intra-thoracic malignancy experience breathlessness. Breathing training is helpful, but it is unknown whether repeated sessions are needed. The present study aims to test whether three sessions are better than one for breathlessness in this population. This is a multi-centre randomised controlled non-blinded parallel arm trial. Participants were allocated to three sessions or single (1:2 ratio) using central computer-generated block randomisation by an independent Trials Unit and stratified for centre. The setting was respiratory, oncology or palliative care clinics at eight UK centres. Inclusion criteria were people with intrathoracic cancer and refractory breathlessness, expected prognosis ≥3 months, and no prior experience of breathing training. The trial intervention was a complex breathlessness intervention (breathing training, anxiety management, relaxation, pacing, and prioritisation) delivered over three hour-long sessions at weekly intervals, or during a single hour-long session. The main primary outcome was worst breathlessness over the previous 24 hours ('worst'), by numerical rating scale (0 = none; 10 = worst imaginable). Our primary analysis was area under the curve (AUC) 'worst' from baseline to 4 weeks. All analyses were by intention to treat. Between April 2011 and October 2013, 156 consenting participants were randomised (52 three; 104 single). Overall, the 'worst' score reduced from 6.81 (SD, 1.89) to 5.84 (2.39). Primary analysis [n = 124 (79 %)], showed no between-arm difference in the AUC: three sessions 22.86 (7.12) vs single session 22.58 (7.10); P value = 0.83); mean difference 0.2, 95 % CIs (-2.31 to 2.97). Complete case analysis showed a non-significant reduction in QALYs with three sessions (mean difference -0.006, 95 % CIs -0.018 to 0.006). Sensitivity analyses found similar results. The probability of the single session being cost-effective (threshold value of £20,000 per QALY) was over 80 %. There was no evidence that three sessions conferred additional benefits, including cost-effectiveness, over one. A single session of breathing training seems appropriate and minimises patient burden. Registry: ISRCTN; ISRCTN49387307; http://www.isrctn.com/ISRCTN49387307 ; registration date: 25/01/2011.

Salivary α-amylase as a marker of stress reduction in individuals with intellectual disability and autism in response to occupational and music therapy.

PubMed

Poquérusse, J; Azhari, A; Setoh, P; Cainelli, S; Ripoli, C; Venuti, P; Esposito, G

2018-02-01

Although the benefits of a range of disability-centric therapies have been well studied, little remains known about how they work, let alone how to monitor these benefits in a precise and reliable way. Here, in two independent studies, we examine how sessions consisting of occupational or music therapy, both widely recognised for their effectiveness, modulate levels of salivary α-amylase (sAA), a now time- and cost-efficient marker of stress, in individuals with intellectual disability and autism spectrum disorder. Pre-session and post-session levels of sAA were compared in both groups in response to therapy and control sessions. In comparison to control sessions, occupational therapy significantly dampened rises in sAA levels while music therapy significantly decreased baseline sAA levels, highlighting the ability of both types of therapy to reduce stress and by proxy contribute to enhancing overall well-being. Not only do these results confirm the stress-reducing nature of two types of multisensory therapy, but they support the use of sAA as a potential tool for evaluating stress levels in individuals with intellectual disability and autism spectrum disorder, providing an important physiological lens that may guide strategies in clinical and non-clinical care for individuals with disabilities. © 2017 MENCAP and International Association of the Scientific Study of Intellectual and Developmental Disabilities and John Wiley & Sons Ltd.

Kilovoltage Imaging of Implanted Fiducials to Monitor Intrafraction Motion With Abdominal Compression During Stereotactic Body Radiation Therapy for Gastrointestinal Tumors

DOE Office of Scientific and Technical Information (OSTI.GOV)

Yorke, Ellen, E-mail: yorke@mskcc.org; Xiong, Ying; Han, Qian

2016-07-01

Purpose: To assess intrafraction respiratory motion using a commercial kilovoltage imaging system for abdominal tumor patients with implanted fiducials and breathing constrained by pneumatic compression during stereotactic body radiation therapy (SBRT). Methods and Materials: A pneumatic compression belt limited respiratory motion in 19 patients with radiopaque fiducials in or near their tumor during SBRT for abdominal tumors. Kilovoltage images were acquired at 5- to 6-second intervals during treatment using a commercial system. Intrafractional fiducial displacements were measured using in-house software. The dosimetric effect of the observed displacements was calculated for 3 sessions for each patient. Results: Intrafraction displacement patterns variedmore » between patients and between individual treatment sessions. Averaged over 19 patients, 73 sessions, 7.6% of craniocaudal displacements exceeded 0.5 cm, and 1.2% exceeded 0.75 cm. The calculated single-session dose to 95% of gross tumor volume differed from planned by an average of −1.2% (range, −11.1% to 4.8%) but only for 4 patients was the total 3-session calculated dose to 95% of gross tumor volume more than 3% different from planned. Conclusions: Our pneumatic compression limited intrafractional abdominal target motion, maintained target position established at setup, and was moderately effective in preserving coverage. Commercially available intrafractional imaging is useful for surveillance but can be made more effective and reliable.« less

Prediction of Auditory and Visual P300 Brain-Computer Interface Aptitude

PubMed Central

Halder, Sebastian; Hammer, Eva Maria; Kleih, Sonja Claudia; Bogdan, Martin; Rosenstiel, Wolfgang; Birbaumer, Niels; Kübler, Andrea

2013-01-01

Objective Brain-computer interfaces (BCIs) provide a non-muscular communication channel for patients with late-stage motoneuron disease (e.g., amyotrophic lateral sclerosis (ALS)) or otherwise motor impaired people and are also used for motor rehabilitation in chronic stroke. Differences in the ability to use a BCI vary from person to person and from session to session. A reliable predictor of aptitude would allow for the selection of suitable BCI paradigms. For this reason, we investigated whether P300 BCI aptitude could be predicted from a short experiment with a standard auditory oddball. Methods Forty healthy participants performed an electroencephalography (EEG) based visual and auditory P300-BCI spelling task in a single session. In addition, prior to each session an auditory oddball was presented. Features extracted from the auditory oddball were analyzed with respect to predictive power for BCI aptitude. Results Correlation between auditory oddball response and P300 BCI accuracy revealed a strong relationship between accuracy and N2 amplitude and the amplitude of a late ERP component between 400 and 600 ms. Interestingly, the P3 amplitude of the auditory oddball response was not correlated with accuracy. Conclusions Event-related potentials recorded during a standard auditory oddball session moderately predict aptitude in an audiory and highly in a visual P300 BCI. The predictor will allow for faster paradigm selection. Significance Our method will reduce strain on patients because unsuccessful training may be avoided, provided the results can be generalized to the patient population. PMID:23457444

An analysis of the delivery of anaesthetic training sessions in the United Kingdom.

PubMed

Green, A; Tatham, K C; Yentis, S M; Wilson, J; Cox, M

2017-11-01

We analysed data from the electronic rota system CLWRota, covering 2,689,962 anaesthetic sessions between 01/01/2014 and 31/12/2015, in 91 UK Trusts, in order to investigate trainees' supervision. There were 8209 trainee attachments analysed, during which 618,695 sessions were undertaken by trainees. The number of supervised sessions per week that trainees worked varied considerably (median (IQR [range]) 2.6 (1.6-3.6 [0-10]) for all grades combined), with senior trainees more likely than junior trainees to be supervised for fewer than the three sessions per week mandated by the Royal College of Anaesthetists. The number of supervised sessions was unrelated to Trusts' size, suggesting that trainees in smaller hospitals receive the same level of supervision as in larger teaching hospitals. Analysis of a dataset of this size should be a good reflection of the delivery of anaesthesia training in the UK. © 2017 The Association of Anaesthetists of Great Britain and Ireland.

The Incremental Effects of Manual Therapy or Booster Sessions in Addition to Exercise Therapy for Knee Osteoarthritis: A Randomized Clinical Trial.

PubMed

Abbott, J Haxby; Chapple, Catherine M; Fitzgerald, G Kelley; Fritz, Julie M; Childs, John D; Harcombe, Helen; Stout, Kirsten

2015-12-01

A factorial randomized controlled trial. To investigate the addition of manual therapy to exercise therapy for the reduction of pain and increase of physical function in people with knee osteoarthritis (OA), and whether "booster sessions" compared to consecutive sessions may improve outcomes. The benefits of providing manual therapy in addition to exercise therapy, or of distributing treatment sessions over time using periodic booster sessions, in people with knee OA are not well established. All participants had knee OA and were provided 12 sessions of multimodal exercise therapy supervised by a physical therapist. Participants were randomly allocated to 1 of 4 groups: exercise therapy in consecutive sessions, exercise therapy distributed over a year using booster sessions, exercise therapy plus manual therapy without booster sessions, and exercise therapy plus manual therapy with booster sessions. The primary outcome measure was the Western Ontario and McMaster Universities Osteoarthritis Index (WOMAC score; 0-240 scale) at 1-year follow-up. Secondary outcome measures were the numeric pain-rating scale and physical performance tests. Of 75 participants recruited, 66 (88%) were retained at 1-year follow-up. Factorial analysis of covariance of the main effects showed significant benefit from booster sessions (P = .009) and manual therapy (P = .023) over exercise therapy alone. Group analysis showed that exercise therapy with booster sessions (WOMAC score, -46.0 points; 95% confidence interval [CI]: -80.0, -12.0) and exercise therapy plus manual therapy (WOMAC score, -37.5 points; 95% CI: -69.7, -5.5) had superior effects compared with exercise therapy alone. The combined strategy of exercise therapy plus manual therapy with booster sessions was not superior to exercise therapy alone. Distributing 12 sessions of exercise therapy over a year in the form of booster sessions was more effective than providing 12 consecutive exercise therapy sessions. Providing manual therapy in addition to exercise therapy improved treatment effectiveness compared to providing 12 consecutive exercise therapy sessions alone. Trial registered with the Australian New Zealand Clinical Trials Registry (ACTRN12612000460808).

The histomorphological findings of kidneys after application of high dose and high-energy shock wave lithotripsy.

PubMed

Demir, Aslan; Türker, Polat; Bozkurt, Suheyla Uyar; İlker, Yalcin Nazmi

2015-01-01

In this animal study, we reviewed the histomorphological findings in rabbit kidneys after a high number of high-energy shock wave applications and observed if there were any cumulative effects after repeated sessions. We formed 2 groups, each consisting of 8 rabbits. Group 1 received 1 session and group 2 received 3 sessions of ESWL with a 7 day interval between sessions, consisting of 3500 beats to the left kidney and 5500 beats to the right kidney per session. The specimens of kidneys were examined histomorphologically after bilateral nephrectomy was performed. For statistical analysis, 4 groups of specimens were formed. The first and second groups received 1 session, 3500 and 5500 beats, respectively. The third and fourth groups received 3 sessions, at 3500 and 5500 beats per each session, respectively. The sections were evaluated under a light microscope to determine subcapsular thickening; subcapsular, intratubular and parenchymal hemorrhage; subcapsular, intersitital, perivascular and proximal ureteral fibrosis; paranchymal necrosis; tubular epithelial vacuolization; tubular atrophy; glomerular destruction and calcification. In histopathological examinations capsular thickening, subcapsular hematoma, tubuloepithelial vacuolisation, glomerular destruction, parenchymal hemorrhage, interstitial fibrosis, and perivascular fibrosis were observed in all groups. In statistical analysis, on the basis of perivascular fibrosis and tubular atrophy, there was a beats per session dependent increase of both. The detrimental effects from ESWL are dose dependent but not cumulative for up to 3 sessions. Histopathological experimental animal studies will aid in understanding local and maybe, by means of these local effects, systemic effects.

Patient Effort in Traumatic Brain Injury Inpatient Rehabilitation: Course and Associations With Age, Brain Injury Severity, and Time Postinjury

PubMed Central

Seel, Ronald T.; Corrigan, John D.; Dijkers, Marcel P.; Barrett, Ryan S.; Bogner, Jennifer; Smout, Randall J.; Garmoe, William; Horn, Susan D.

2016-01-01

Objective To describe patients' level of effort in occupational, physical, and speech therapy sessions during traumatic brain injury (TBI) inpatient rehabilitation and to evaluate how age, injury severity, cognitive impairment, and time are associated with effort. Design Prospective, multicenter, longitudinal cohort study. Setting Acute TBI rehabilitation programs. Participants Patients (N=1946) receiving 138,555 therapy sessions. Interventions Not applicable. Main Outcome Measures Effort in rehabilitation sessions rated on the Rehabilitation Intensity of Therapy Scale, FIM, Comprehensive Severity Index brain injury severity score, posttraumatic amnesia (PTA), and Agitated Behavior Scale (ABS). Results The Rehabilitation Intensity of Therapy Scale effort ratings in individual therapy sessions closely conformed to a normative distribution for all 3 disciplines. Mean Rehabilitation Intensity of Therapy Scale ratings for patients' therapy sessions were higher in the discharge week than in the admission week (P<.001). For patients who completed 2, 3, or 4 weeks of rehabilitation, differences in effort ratings (P<.001) were observed between 5 subgroups stratified by admission FIM cognitive scores and over time. In linear mixed-effects modeling, age and Comprehensive Severity Index brain injury severity score at admission, days from injury to rehabilitation admission, days from admission, and daily ratings of PTA and ABS score were predictors of level of effort (P<.0001). Conclusions Patients' level of effort can be observed and reliably rated in the TBI inpatient rehabilitation setting using the Rehabilitation Intensity of Therapy Scale. Patients who sustain TBI show varying levels of effort in rehabilitation therapy sessions, with effort tending to increase over the stay. PTA and agitated behavior are primary risk factors that substantially reduce patient effort in therapies. PMID:26212400

Development of a reliable method to assess footwear comfort during running.

PubMed

Mündermann, Anne; Nigg, Benno M; Stefanyshyn, Darren J; Humble, R Neil

2002-08-01

The purposes of this study were: (a) to determine whether subjects are able to distinguish between differences in footwear with respect to footwear comfort; and (b) to determine how reliably footwear comfort can be assessed using a visual analogue scale (VAS) and a protocol including a control condition during running. Intraclass correlation coefficients (ICCs) between comfort ratings for repeated conditions were high (ICC = 0.799). Differences in comfort ratings between the insert conditions were significant. A paired t-test revealed a significant difference in overall comfort ratings for the control insert when tested after the soft insert compared to when tested after the hard insert (P = 0.008). The results of this study showed that VASs provide a reliable measure to assess footwear comfort during running under the conditions that: (a) a control condition is included; and (b) the average comfort rating of sessions 4-6 is used. Copyright 2002 Elsevier Science B.V.

Anthropometric measurement standardization in the US-affiliated pacific: Report from the Children's Healthy Living Program.

PubMed

Li, Fenfang; Wilkens, Lynne R; Novotny, Rachel; Fialkowski, Marie K; Paulino, Yvette C; Nelson, Randall; Bersamin, Andrea; Martin, Ursula; Deenik, Jonathan; Boushey, Carol J

2016-05-01

Anthropometric standardization is essential to obtain reliable and comparable data from different geographical regions. The purpose of this study is to describe anthropometric standardization procedures and findings from the Children's Healthy Living (CHL) Program, a study on childhood obesity in 11 jurisdictions in the US-Affiliated Pacific Region, including Alaska and Hawai'i. Zerfas criteria were used to compare the measurement components (height, waist, and weight) between each trainee and a single expert anthropometrist. In addition, intra- and inter-rater technical error of measurement (TEM), coefficient of reliability, and average bias relative to the expert were computed. From September 2012 to December 2014, 79 trainees participated in at least 1 of 29 standardization sessions. A total of 49 trainees passed either standard or alternate Zerfas criteria and were qualified to assess all three measurements in the field. Standard Zerfas criteria were difficult to achieve: only 2 of 79 trainees passed at their first training session. Intra-rater TEM estimates for the 49 trainees compared well with the expert anthropometrist. Average biases were within acceptable limits of deviation from the expert. Coefficient of reliability was above 99% for all three anthropometric components. Standardization based on comparison with a single expert ensured the comparability of measurements from the 49 trainees who passed the criteria. The anthropometric standardization process and protocols followed by CHL resulted in 49 standardized field anthropometrists and have helped build capacity in the health workforce in the Pacific Region. Am. J. Hum. Biol. 28:364-371, 2016. © 2015 Wiley Periodicals, Inc. © 2015 Wiley Periodicals, Inc.

Dose and elasticity of demand for self-administered cocaine in rats.

PubMed

Kearns, David N; Silberberg, Alan

2016-04-01

The present experiment tested whether the elasticity of demand for self-administered cocaine in rats is dose-dependent. Subjects lever pressed for three different doses of intravenous cocaine - 0.11, 0.33, and 1.0 mg/kg/infusion - on a demand procedure where the number of lever presses required per infusion increased within a session. The main finding was that demand for the 0.11 mg/kg dose was more elastic than it was for the two larger doses. There was no difference in demand elasticity between the 0.33 and 1.0 mg/kg doses. These results parallel findings previously reported in monkeys. The present study also demonstrated that a within-session procedure can be used to generate reliable demand curves.

Effects of questionnaire-based diagnosis and training on inter-rater reliability among practitioners of traditional Chinese medicine.

PubMed

Mist, Scott; Ritenbaugh, Cheryl; Aickin, Mikel

2009-07-01

To investigate whether a training process that focused on a questionnaire-based diagnosis in Traditional Chinese Medicine (TCM), and developing diagnostic consensus, would improve the agreement of TCM diagnoses among 10 TCM practitioners evaluating patients with temporomandibular joint disorder (TMJD). Evaluation of a diagnostic training program at the Department of Family and Community Medicine, University of Arizona, Tucson, Arizona, and the Oregon College of Oriental Medicine, Portland, Oregon. Screened participants for a study of TCM for TMJD. PRACTITIONERS: Ten (10) licensed acupuncturists with a minimum of 5 years licensure and education in Chinese herbs. A training session using a questionnaire-based diagnostic form was conducted, followed by waves of diagnostic sessions. Between sessions, practitioners discussed the results of the previous round of participants with a focus on reducing variability in primary diagnosis and severity rating of each diagnosis: 3 waves of 5 patients were assessed by 4 practitioner pairs for a total of 120 diagnoses. At 18 months, practitioners completed a recalibration exercise with a similar format with a total of 32 diagnoses. These diagnoses were then examined with respect to the rate of agreement among the 10 practitioners using inter-rater correlations and kappas. The inter-rater correlation with respect to the TCM diagnoses among the 10 practitioners increased from 0.112 to 0.618 with training. Statistically significant improvements were found between the baseline and 18 month exercises (p < 0.01). Inter-rater reliability of TCM diagnosis may be improved through a training process and a questionnaire-based diagnosis process. The improvements varied by diagnosis, with the greatest congruence among primary and more severe diagnoses. Future TCM studies should consider including calibration training to improve the validity of results.

Development and Evaluation of a Training Program for Organ Procurement Coordinators Using Standardized Patient Methodology.

PubMed

Odabasi, Orhan; Elcin, Melih; Uzun Basusta, Bilge; Gulkaya Anik, Esin; Aki, Tuncay F; Bozoklar, Ata

2015-12-01

The low rate of consent by next of kin of donor-eligible patients is a major limiting factor in organ transplant. Educating health care professionals about their role may lead to measurable improvements in the process. Our aim was to describe the developmental steps of a communication skills training program for health care professionals using standardized patients and to evaluate the results. We developed a rubric and 5 cases for standardized family interviews. The 20 participants interviewed standardized families at the beginning and at the end of the training course, with interviews followed by debriefing sessions. Participants also provided feedback before and after the course. The performance of each participant was assessed by his or her peers using the rubric. We calculated the generalizability coefficient to measure the reliability of the rubric and used the Wilcoxon signed rank test to compare achievement among participants. Statistical analyses were performed with SPSS software (SPSS: An IBM Company, version 17.0, IBM Corporation, Armonk, NY, USA). All participants received higher scores in their second interview, including novice participants who expressed great discomfort during their first interview. The participants rated the scenarios and the standardized patients as very representative of real-life situations, with feedback forms showing that the interviews, the video recording sessions, and the debriefing sessions contributed to their learning. Our program was designed to meet the current expectations and implications in the field of donor consent from next of kin. Results showed that our training program developed using standardized patient methodology was effective in obtaining the communication skills needed for family interviews during the consent process. The rubric developed during the study was a valid and reliable assessment tool that could be used in further educational activities. The participants showed significant improvements in communication skills.

Measurement properties and usability of non-contact scanners for measuring transtibial residual limb volume.

PubMed

Kofman, Rianne; Beekman, Anna M; Emmelot, Cornelis H; Geertzen, Jan H B; Dijkstra, Pieter U

2018-06-01

Non-contact scanners may have potential for measurement of residual limb volume. Different non-contact scanners have been introduced during the last decades. Reliability and usability (practicality and user friendliness) should be assessed before introducing these systems in clinical practice. The aim of this study was to analyze the measurement properties and usability of four non-contact scanners (TT Design, Omega Scanner, BioSculptor Bioscanner, and Rodin4D Scanner). Quasi experimental. Nine (geometric and residual limb) models were measured on two occasions, each consisting of two sessions, thus in total 4 sessions. In each session, four observers used the four systems for volume measurement. Mean for each model, repeatability coefficients for each system, variance components, and their two-way interactions of measurement conditions were calculated. User satisfaction was evaluated with the Post-Study System Usability Questionnaire. Systematic differences between the systems were found in volume measurements. Most of the variances were explained by the model (97%), while error variance was 3%. Measurement system and the interaction between system and model explained 44% of the error variance. Repeatability coefficient of the systems ranged from 0.101 (Omega Scanner) to 0.131 L (Rodin4D). Differences in Post-Study System Usability Questionnaire scores between the systems were small and not significant. The systems were reliable in determining residual limb volume. Measurement systems and the interaction between system and residual limb model explained most of the error variances. The differences in repeatability coefficient and usability between the four CAD/CAM systems were small. Clinical relevance If accurate measurements of residual limb volume are required (in case of research), modern non-contact scanners should be taken in consideration nowadays.

Rolling in the Dough, Running from Reform: An Analysis and Critique of the 1994 Utah Legislative Session and Its Impact on Education.

ERIC Educational Resources Information Center

Johnson, Bob L., Jr.

This paper provides a critical review of the 1994 Utah Legislative session as it relates to public and higher education in the state. The paper discusses the defining contextual features of the 1994 Legislative Session, the agendas of key state educational policy actors for the 1994 session, and significant issues and legislation in the…