Usability Study of a Computer-Based Self-Management System for Older Adults with Chronic Diseases

PubMed Central

Tao, Da

2012-01-01

Background Usability can influence patients’ acceptance and adoption of a health information technology. However, little research has been conducted to study the usability of a self-management health care system, especially one geared toward elderly patients. Objective This usability study evaluated a new computer-based self-management system interface for older adults with chronic diseases, using a paper prototype approach. Methods Fifty older adults with different chronic diseases participated. Two usability evaluation methods were involved: (1) a heuristics evaluation and (2) end-user testing with a think-aloud testing method, audio recording, videotaping, and interviewing. A set of usability metrics was employed to determine the overall system usability, including task incompletion rate, task completion time, frequency of error, frequency of help, satisfaction, perceived usefulness, and perceived ease of use. Interviews were used to elicit participants’ comments on the system design. The quantitative data were analyzed using descriptive statistics and the qualitative data were analyzed for content. Results The participants were able to perform the predesigned self-management tasks with the current system design and they expressed mostly positive responses about the perceived usability measures regarding the system interface. However, the heuristics evaluation, performance measures, and interviews revealed a number of usability problems related to system navigation, information search and interpretation, information presentation, and readability. Design recommendations for further system interface modifications were discussed. Conclusions This study verified the usability of the self-management system developed for older adults with chronic diseases. Also, we demonstrated that our usability evaluation approach could be used to quickly and effectively identify usability problems in a health care information system at an early stage of the system development process using a paper prototype. Conducting a usability evaluation is an essential step in system development to ensure that the system features match the users’ true needs, expectations, and characteristics, and also to minimize the likelihood of the users committing user errors and having difficulties using the system. PMID:23612015

Debunking Health IT Usability Myths

PubMed Central

Staggers, N.; Xiao, Y.; Chapman, L.

2013-01-01

Poor usability is a threat to patient safety and linked to productivity loss, workflow disruption, user frustration, sub-optimal product use and system de-installations. Although usability is receiving more attention nationally and internationally, myths about usability persist. This editorial debunks five common myths about usability (1) usability only concerns the look and feel of a product and is, therefore, only a minor concern, (2) usability is not measurable, (3) usability stifles innovation, (4) vendors are solely responsible for product usability, and (5) usability methods are not practical for use in healthcare. PMID:23874361

Effectiveness and usability of Scanning Wizard software: a tool for enhancing switch scanning.

PubMed

Koester, Heidi Horstmann; Simpson, Richard C

2017-11-24

Scanning Wizard software helps scanning users improve the setup of their switch and scanning system. This study evaluated Scanning Wizard's effectiveness and usability. Ten people who use switch scanning and ten practitioners used Scanning Wizard in the initial session. Usability was high, based on survey responses averaging over 4.5 out of 5, and qualitative feedback was very positive. Five switch users were able to complete the multi-week protocol, using settings on their own scanning system that were recommended from the Scanning Wizard session. Using these revised settings, text entry rates improved by an average of 71%, ranging from 29% to 172% improvement. Results suggest that Scanning Wizard is a useful tool for improving the configuration of scanning systems for people who use switch scanning to communicate. Implications for Rehabilitation Some individuals with severe physical impairments use switch scanning for spoken and written communication. Scanning Wizard software helps scanning users improve the setup of their switch and scanning system. This study demonstrated high usability of Scanning Wizard (with 10 switch userpractitioner teams) and increased text entry rate by an average of 71% (for five switch users). Results suggest that Scanning Wizard is a useful tool for improving the configuration of scanning systems for people who use switch scanning to communicate.

Patient-Reported Usability of Positive Airway Pressure Equipment Is Associated With Adherence in Older Adults.

PubMed

Fung, Constance H; Martin, Jennifer L; Hays, Ron D; Patterson, Emily S; Aysola, Ravi; Col, Nananda; Mitchell, Michael N; Truong, Cindy; Dzierzewski, Joseph M; Jouldjian, Stella; Song, Yeonsu; Rodriguez, Juan Carlos; Josephson, Karen; Alessi, Cathy

2017-03-01

To examine the usability of positive airway pressure (PAP) devices and its association with PAP adherence among older adults with sleep-disordered breathing. We mailed questionnaires to patients aged ≥65 years prescribed PAP therapy during the prior 36 months from two large healthcare systems. Survey participants completed the Usability of Sleep Apnea Equipment-Positive Airway Pressure (USE-PAP) questionnaire, which assessed the usability of their PAP device. Other questionnaire items included demographics and self-rated health. We also abstracted adherence data (mean nightly hours of PAP use available from one site) and interface type from the electronic health record. Five hundred sixty-four patients completed the survey (response rate = 33%). The mean USE-PAP score (0 = best to 100 = worst) was 20 (SD ± 20). Mean duration of PAP use (available in 189 respondents) was 5.2 hours per night (SD ± 2.0). In a nested regression model predicting nightly hours of PAP use, a 10-point (0.5 SD) increase in USE-PAP score corresponded to a 0.37 hour/night reduction in PAP use. The model including the USE-PAP score explained a significant proportion (R2 = 15%) of the variation in nightly hours of PAP use above and beyond demographics, self-reported health, and interface type (∆R2 = 12%). Our results demonstrate that PAP usability varies among older patients and is associated with PAP adherence, above and beyond other predictors of adherence. These results support measuring and improving PAP usability to further improve PAP adherence for older patients. Published by Oxford University Press on behalf of Sleep Research Society (SRS) 2017. This work is written by (a) US Government employee(s) and is in the public domain in the US.

Measuring AT Usability with the Modified System Usability Scale (SUS).

PubMed

Friesen, Emma L

2017-01-01

The modified System Usability Scale (SUS) is a widely used generic measure of product usability. This study concerns the usability of mobile shower commodes using correlations between the SUS and AT device-specific measures. Results suggest the modified SUS, and corresponding adjective-anchored rating scale, are appropriate for measuring MSC usability, and have potential for use with other AT devices.

Usability of a barcode scanning system as a means of data entry on a PDA for self-report health outcome questionnaires: a pilot study in individuals over 60 years of age

PubMed Central

Boissy, Patrick; Jacobs, Karen; Roy, Serge H

2006-01-01

Background Throughout the medical and paramedical professions, self-report health status questionnaires are used to gather patient-reported outcome measures. The objective of this pilot study was to evaluate in individuals over 60 years of age the usability of a PDA-based barcode scanning system with a text-to-speech synthesizer to collect data electronically from self-report health outcome questionnaires. Methods Usability of the system was tested on a sample of 24 community-living older adults (7 men, 17 women) ranging in age from 63 to 93 years. After receiving a brief demonstration on the use of the barcode scanner, participants were randomly assigned to complete two sets of 16 questions using the bar code wand scanner for one set and a pen for the other. Usability was assessed using directed interviews with a usability questionnaire and performance-based metrics (task times, errors, sources of errors). Results Overall, participants found barcode scanning easy to learn, easy to use, and pleasant. Participants were marginally faster in completing the 16 survey questions when using pen entry (20/24 participants). The mean response time with the barcode scanner was 31 seconds longer than traditional pen entry for a subset of 16 questions (p = 0.001). The responsiveness of the scanning system, expressed as first scan success rate, was less than perfect, with approximately one-third of first scans requiring a rescan to successfully capture the data entry. The responsiveness of the system can be explained by a combination of factors such as the location of the scanning errors, the type of barcode used as an answer field in the paper version, and the optical characteristics of the barcode scanner. Conclusion The results presented in this study offer insights regarding the feasibility, usability and effectiveness of using a barcode scanner with older adults as an electronic data entry method on a PDA. While participants in this study found their experience with the barcode scanning system enjoyable and learned to become proficient in its use, the responsiveness of the system constitutes a barrier to wide-scale use of such a system. Optimizing the graphical presentation of the information on paper should significantly increase the system's responsiveness. PMID:17184533

Usability problems do not heal by themselves: National survey on physicians' experiences with EHRs in Finland.

PubMed

Kaipio, Johanna; Lääveri, Tinja; Hyppönen, Hannele; Vainiomäki, Suvi; Reponen, Jarmo; Kushniruk, Andre; Borycki, Elizabeth; Vänskä, Jukka

2017-01-01

Survey studies of health information systems use tend to focus on availability of functionalities, adoption and intensity of use. Usability surveys have not been systematically conducted by any healthcare professional groups on a national scale on a repeated basis. This paper presents results from two cross-sectional surveys of physicians' experiences with the usability of currently used EHR systems in Finland. The research questions were: To what extent has the overall situation improved between 2010 and 2014? What differences are there between healthcare sectors? In the spring of 2014, a survey was conducted in Finland using a questionnaire that measures usability and respondents' user experiences with electronic health record (EHR) systems. The survey was targeted to physicians who were actively doing clinical work. Twenty-four usability-related statements, that were identical in 2010 and 2014, were analysed from the survey. The respondents were also asked to give an overall rating of the EHR system they used. The study data comprised responses from 3081 physicians from the year 2014 and from 3223 physicians in the year 2010, who were using the nine most commonly used EHR system brands in Finland. Physicians' assessments of the usability of their EHR system remain as critical as they were in 2010. On a scale from 1 ('fail') to 7 ('excellent') the average of overall ratings of their principally used EHR systems varied from 3.2 to 4.4 in 2014 (and in 2010 from 2.5 to 4.3). The results show some improvements in the following EHR functionalities and characteristics: summary view of patient's health status, prevention of errors associated with medication ordering, patient's medication list as well as support for collaboration and information exchange between the physician and the nurses. Even so, support for cross-organizational collaboration between physicians and for physician-patient collaboration were still considered inadequate. Satisfaction with technical features had not improved in four years. The results show marked differences between the EHR system brands as well as between healthcare sectors (private sector, public hospitals, primary healthcare). Compared to responses from the public sector, physicians working in the private sector were more satisfied with their EHR systems with regards to statements about user interface characteristics and support for routine tasks. Overall, the study findings are similar to our previous study conducted in 2010. Surveys about the usability of EHR systems are needed to monitor their development at regional and national levels. To our knowledge, this study is the first national eHealth observatory questionnaire that focuses on usability and is used to monitor the long-term development of EHRs. The results do not show notable improvements in physician's ratings for their EHRs between the years 2010 and 2014 in Finland. Instead, the results indicate the existence of serious problems and deficiencies which considerably hinder the efficiency of EHR use and physician's routine work. The survey results call for considerable amount of development work in order to achieve the expected benefits of EHR systems and to avoid technology-induced errors which may endanger patient safety. The findings of repeated surveys can be used to inform healthcare providers, decision makers and politicians about the current state of EHR usability and differences between brands as well as for improvements of EHR usability. This survey will be repeated in 2017 and there is a plan to include other healthcare professional groups in future surveys. Copyright © 2016 The Authors. Published by Elsevier Ireland Ltd.. All rights reserved.

Evaluation of Nursing Information Systems: Application of Usability Aspects in the Development of Systems.

PubMed

Moghaddasi, Hamid; Rabiei, Reza; Asadi, Farkhondeh; Ostvan, Negin

2017-04-01

As the largest group providing healthcare services, nurses require well-designed information systems in their practice. This study aims to evaluate the usability of nursing information systems (NIS). This cross-sectional survey was conducted in 2015. The settings of the study consisted of four hospitals affiliated with three medical universities in Tehran (Iran). The subjects of the study included nurses who had access to and used a NIS developed by four major software companies. The data were collected using a modified version of a usability questionnaire known as IsoMetrics, based on the International Standard ISO 9241, Part 11. The questionnaire is composed of 35 questions divided into seven general criteria. The validity of the questionnaire was determined by experts in the field, and the reliability was checked using Cronbach's alpha (α = 0.91). The questionnaire was then distributed to 184 nurses. The response rate was 64.6%. Among the seven ISO usability criteria, suitability for the task (3.10 ± 1.24) and suitability for learning (3.10 ± 1.27) had the highest mean value. The lowest mean value (2.37 ± 1.29) was related to the suitability for individualization. Addressing issues related to individualization and self-descriptiveness could improve the usability of nursing systems. Considering usability requirements in the design of a NIS will lead to the efficient and effective use of these systems.

Evaluation of Home Health Care Devices: Remote Usability Assessment.

PubMed

Kortum, Philip; Peres, S Camille

2015-06-05

An increasing amount of health care is now performed in a home setting, away from the hospital. While there is growing anecdotal evidence about the difficulty patients and caregivers have using increasingly complex health care devices in the home, there has been little systematic scientific study to quantify the global nature of home health care device usability in the field. Research has tended to focus on a handful of devices, making it difficult to gain a broad view of the usability of home-care devices in general. The objective of this paper is to describe a remote usability assessment method using the System Usability Scale (SUS), and to report on the usability of a broad range of health care devices using this metric. A total of 271 participants selected and rated up to 10 home health care devices of their choice using the SUS, which scores usability from 0 (unusable) to 100 (highly usable). Participants rated a total of 455 devices in their own home without an experimenter present. Usability scores ranged from 98 (oxygen masks) to 59 (home hormone test kits). An analysis conducted on devices that had at least 10 ratings showed that the effect of device on SUS scores was significant (P<.001), and that the usability of these devices was on the low end when compared with other commonly used items in the home, such as microwave ovens and telephones. A large database of usability scores for home health care devices collected using this remote methodology would be beneficial for physicians, patients, and their caregivers.

A continuous usability evaluation of an electronic medication administration record application.

PubMed

Vicente Oliveros, Noelia; Gramage Caro, Teresa; Pérez Menéndez-Conde, Covadonga; Álvarez-Diaz, Ana María; Martín-Aragón Álvarez, Sagrario; Bermejo Vicedo, Teresa; Delgado Silveira, Eva

2017-12-01

The complexity of an electronic medication administration record (eMAR) has been underestimated by most designers in the past. Usability issues, such as poorly designed user application flow in eMAR, are therefore of vital importance, since they can have a negative impact on nursing activities and result in poor outcomes. The purpose of this study was to evaluate the usability of an eMAR application during its development. A usability evaluation was conducted during the development of the eMAR application. Two usability methods were used: a heuristic evaluation complemented by usability testing. Each eMAR application version provided by the vendor was evaluated by 2 hospital pharmacists, who applied the heuristic method. They reviewed the eMAR tasks, detected usability problems and their heuristic violations, and rated the severity of the usability problems. Usability testing was used to assess the final application version by observing how 3 nurses interacted with the application. Thirty-four versions were assessed before the eMAR application was considered usable. During the heuristic evaluation, the usability problems decreased from 46 unique usability problems in version 1 (V1) to 9 in version 34 (V34). In V1, usability problems were categorized into 154 heuristic violations, which decreased to 27 in V34. The average severity rating also decreased from major usability problem (2.96) to no problem (0.23). During usability testing, the 3 nurses did not encounter new usability problems. A thorough heuristic evaluation is a good method for obtaining a usable eMAR application. This evaluation points key areas for improvement and decreases usability problems and their severity. © 2017 John Wiley & Sons, Ltd.

Design and validation of a questionnaire to evaluate the usability of computerized critical care information systems.

PubMed

von Dincklage, Falk; Lichtner, Gregor; Suchodolski, Klaudiusz; Ragaller, Maximilian; Friesdorf, Wolfgang; Podtschaske, Beatrice

2017-08-01

The implementation of computerized critical care information systems (CCIS) can improve the quality of clinical care and staff satisfaction, but also holds risks of disrupting the workflow with consecutive negative impacts. The usability of CCIS is one of the key factors determining their benefits and weaknesses. However, no tailored instrument exists to measure the usability of such systems. Therefore, the aim of this study was to design and validate a questionnaire that measures the usability of CCIS. Following a mixed-method design approach, we developed a questionnaire comprising two evaluation models to assess the usability of CCIS: (1) the task-specific model rates the usability individually for several tasks which CCIS could support and which we derived by analyzing work processes in the ICU; (2) the characteristic-specific model rates the different aspects of the usability, as defined by the international standard "ergonomics of human-system interaction". We tested validity and reliability of the digital version of the questionnaire in a sample population. In the sample population of 535 participants both usability evaluation models showed a strong correlation with the overall rating of the system (multiple correlation coefficients ≥0.80) as well as a very high internal consistency (Cronbach's alpha ≥0.93). The novel questionnaire is a valid and reliable instrument to measure the usability of CCIS and can be used to study the influence of the usability on their implementation benefits and weaknesses.

A study of topics for distance education-A survey of U.S. Fish and Wildlife Service employees

USGS Publications Warehouse

Ratz, Joan M.; Schuster, Rudy M.; Marcy, Ann H.

2011-01-01

The purpose of this study was to identify training topics and distance education technologies preferred by U.S. Fish and Wildlife Service employees. This study was conducted on behalf of the National Conservation Training Center to support their distance education strategy planning and implementation. When selecting survey recipients, we focused on employees in positions involving conservation and environmental education and outreach programming. We conducted the study in two phases. First, we surveyed 72 employees to identify useful training topics. The response rate was 61 percent; respondents were from all regions and included supervisors and nonsupervisors. Five topics for training were identified: creating and maintaining partnerships (partnerships), technology, program planning and development (program planning), outreach methods to engage the community (outreach methods), and evaluation methods. In the second phase, we surveyed 1,488 employees to assess preferences for training among the five topics identified in the first survey and preferences among six distance education technologies: satellite television, video conferencing, audio conferencing, computer mediated training, written resources, and audio resources. Two types of instructor-led training were included on the survey to compare to the technology options. Respondents were asked what types of information, such as basic facts or problem solving skills, were needed for each of the five topics. The adjusted response rate was 64 percent; respondents were from all regions and included supervisors and nonsupervisors. The results indicated clear preferences among respondents for certain training topics and technologies. All five training topics were valued, but the topics of partnerships and technology were given equal value and were valued more than the other three topics. Respondents indicated a desire for training on the topics of partnerships, technology, program planning, and outreach methods. For the six distance education technologies, respondents indicated different levels of usability and access. Audio conferencing and written resources were reported to be most usable and accessible. The ratings of technology usability/access differed according to region; respondents in region 9 rated most technologies higher on usability/access. Respondents indicated they would take courses through either onsite or distance education approaches, but they prefer onsite training for most topics and most types of information.

Stress Indicators of Kentucky Elementary Principals.

ERIC Educational Resources Information Center

Kirby, H. J.; And Others

Stress has become a problem to educational administrators who often report a high level of stress. This study explored the perceived stress levels of Kentucky elementary school principals. Questionnaires mailed to 200 elementary school principals produced 115 usable returns, a 57.5 percent response rate. The questionnaire consisted of a 24-item…

Construction and Validation of a Professional Suitability Scale for Social Work Practice

ERIC Educational Resources Information Center

Tam, Dora M. Y.; Coleman, Heather

2009-01-01

This article reports on the construction and validation of a professional suitability scale, designed for assessing students' suitability for social work practice. Data were collected from 188 field supervisors who provided usable questionnaires, representing a response rate of 74%. Construct validation by exploratory factor analysis identified a…

Usability and clinical efficacy of diabetes mobile applications for adults with type 2 diabetes: A systematic review.

PubMed

Fu, Helen; McMahon, Siobhan K; Gross, Cynthia R; Adam, Terrence J; Wyman, Jean F

2017-09-01

To assess the usability and clinical effectiveness of diabetes mobile applications (diabetes apps) developed for adults with type 2 diabetes. A systematic review of the usability and effectiveness of diabetes apps was conducted. Searches were performed using MEDLINE, EMBASE, COMPENDEX, and IEEE XPLORE for articles published from January 1, 2011, to January 17, 2017. Search terms included: diabetes, mobile apps, and mobile health (mHealth). The search yielded 723 abstracts of which seven usability studies and ten clinical effectiveness studies met the inclusion criteria from 20 publications. Usability, as measured by satisfaction ratings from experts and patients, ranged from 38% to 80%. Usability problem ratings ranged from moderate to catastrophic. Top usability problems are multi-steps task, limited functionality and interaction, and difficult system navigation. Clinical effectiveness, measured by reductions in HbA1c, ranged from 0.15% to 1.9%. Despite meager satisfaction ratings and major usability problems, there is some limited evidence supporting the effectiveness of diabetes apps to improve glycemic control for adults with type 2 diabetes. Findings strongly suggest that efforts to improve user satisfaction, incorporate established principles of health behavior change, and match apps to user characteristics will increase the therapeutic impact of diabetes apps. Copyright © 2017 Elsevier B.V. All rights reserved.

An evaluation of patients' experienced usability of a diabetes mHealth system using a multi-method approach.

PubMed

Georgsson, Mattias; Staggers, Nancy

2016-02-01

mHealth systems are becoming more common to aid patients in their diabetes self-management, but recent studies indicate a need for thorough evaluation of patients' experienced usability. Current evaluations lack a multi-method design for data collection and structured methods for data analyses. The purpose of this study was to provide a feasibility test of a multi-method approach for both data collection and data analyses for patients' experienced usability of a mHealth system for diabetes type 2 self-management. A random sample of 10 users was selected from a larger clinical trial. Data collection methods included user testing with eight representative tasks and Think Aloud protocol, a semi-structured interview and a questionnaire on patients' experiences using the system. The Framework Analysis (FA) method and Usability Problem Taxonomy (UPT) were used to structure, code and analyze the results. A usability severity rating was assigned after classification. The combined methods resulted in a total of 117 problems condensed into 19 usability issues with an average severity rating of 2.47 or serious. The usability test detected 50% of the initial usability problems, followed by the post-interview at 29%. The usability test found 18 of 19 consolidated usability problems while the questionnaire uncovered one unique issue. Patients experienced most usability problems (8) in the Glucose Readings View when performing complex tasks such as adding, deleting, and exporting glucose measurements. The severity ratings were the highest for the Glucose Diary View, Glucose Readings View, and Blood Pressure View with an average severity rating of 3 (serious). Most of the issues were classified under the artifact component of the UPT and primary categories of Visualness (7) and Manipulation (6). In the UPT task component, most issues were in the primary category Task-mapping (12). Multiple data collection methods yielded a more comprehensive set of usability issues. Usability testing uncovered the largest volume of usability issues, followed by interviewing and then the questionnaire. The interview did not surface any unique consolidated usability issues while the questionnaire surfaced one. The FA and UPT were valuable in structuring and classifying problems. The resulting descriptions serve as a communication tool in problem solving and programming. We recommend the usage of multiple methods in data collection and employing the FA and UPT in data analyses for future usability testing. Copyright © 2015 The Authors. Published by Elsevier Inc. All rights reserved.

Mobile Health Applications, in the Absence of an Authentic Regulation, Does the Usability Score Correlate with a Better Medical Reliability?

PubMed

Yasini, Mobin; Marchand, Guillaume

2015-01-01

Health-related mobile applications (apps) have been shown to improve the quality of health and patient care. Their use in clinical and health-related environments is becoming more considerable. The number of health-related apps available for download has considerably increased, while the regulatory position of this new industry is not well known. Despite this lack of regulation, measuring the usability score of these apps is not difficult. We compared two samples of twenty health-related applications each. One of the samples contained the apps with top-rated usability scores, and the other contained the apps with lowest-rated usability scores. We found that a good usability score correlates with a better medical reliability of the app's content (p<0.005). In the period in which a valid regulation is still lacking, calculation and attribution of usability scores to mobile applications could be used to identify apps with better medical quality. However, the usability score method ought to be rigorous and should not be rounded off with a simple five stars rating (as is the case in the classic app stores).

Workforce Improvement Network 2000 Survey of Virginia Employers.

ERIC Educational Resources Information Center

Foucar-Szocki, Diane; Bolt, Les

A stratified random sample of Virginia's 4,000 employers with over 100 employees was surveyed about workplace-based foundational basic skills (oral and written communication, reading, math, thinking skills, teamwork, English proficiency, and basic computer literacy). A total of 446 surveys were sent with a usable response rate of 18 percent.…

Follow-Up Study of Fiscal Year 1997 Occupational Program Graduates, 1998.

ERIC Educational Resources Information Center

Illinois Community Coll. Board, Springfield.

This report provides information from graduates of selected occupational programs regarding the effectiveness of their Illinois community college experience. The study surveyed a pool of 2,190 occupational program graduates, which yielded a usable response rate of 58.6%. The majority of graduate respondents (64.5%) came from programs in four…

5 CFR 532.241 - Analysis of usable wage survey data.

Code of Federal Regulations, 2010 CFR

2010-01-01

... average rates identified and computed under paragraph (a) of this section. (ii) The frequency payline... PREVAILING RATE SYSTEMS Prevailing Rate Determinations § 532.241 Analysis of usable wage survey data. (a)(1) The lead agency shall compute a weighted average rate for each appropriated fund survey job having at...

Usability Evaluation of Spot and Runway Departure Advisor (SARDA) Concept in Dallas/Fort Worth Airport Tower Simulation

NASA Technical Reports Server (NTRS)

Hayashi, Miwa; Hoang, Ty; Jung, Yoon C.; Gupta, Gautam; Malik, Waqar; Dulchinos, Victoria

2013-01-01

Spot and Runway Departure Advisor (SARDA) is a proposed decision-support tool for air traffic control tower controllers for reducing taxi delay and optimizing the departure sequence. In the present study, the tool's usability was evaluated to ensure that its claimed performance benefits are not being realized at the cost of increasing the work burden on controllers. For the evaluation, workload ratings and questionnaire responses collected during a human-in-the-loop simulation experiment were analyzed to assess the SARDA advisories' effects on the controllers' ratings on cognitive resources (e.g., workload, spare attention) and satisfaction. The results showed that SARDA reduced the controllers' workload and increased their spare attention. It also made workload and attention levels less susceptible to the effects of increases in the traffic load. The questionnaire responses suggested that the controllers generally were satisfied with the ease of use of the tool and the objectives of the SARDA concept, but with some caution. To gain more trust from controllers, the the reasoning behind advisories may need to be made more transparent to them.

LATCH usability in vehicles.

DOT National Transportation Integrated Search

2012-04-01

This project investigated the usability of Lower Anchors and Tethers for CHildren (LATCH) hardware by measuring LATCH implementations in 98 2011 or 2010 model-year vehicles. ISO and SAE LATCH usability rating systems were used to assess all vehicles ...

Usability evaluation of Laboratory and Radiology Information Systems integrated into a hospital information system.

PubMed

Nabovati, Ehsan; Vakili-Arki, Hasan; Eslami, Saeid; Khajouei, Reza

2014-04-01

This study was conducted to evaluate the usability of widely used laboratory and radiology information systems. Three usability experts independently evaluated the user interfaces of Laboratory and Radiology Information Systems using heuristic evaluation method. They applied Nielsen's heuristics to identify and classify usability problems and Nielsen's severity rating to judge their severity. Overall, 116 unique heuristic violations were identified as usability problems. In terms of severity, 67 % of problems were rated as major and catastrophic. Among 10 heuristics, "consistency and standards" was violated most frequently. Moreover, mean severity of problems concerning "error prevention" and "help and documentation" heuristics was higher than of the others. Despite widespread use of specific healthcare information systems, they suffer from usability problems. Improving the usability of systems by following existing design standards and principles from the early phased of system development life cycle is recommended. Especially, it is recommended that the designers design systems that inhibit the initiation of erroneous actions and provide sufficient guidance to users.

Evaluating the parent-adolescent communication toolkit: Usability and preliminary content effectiveness of an online intervention.

PubMed

Toombs, Elaine; Unruh, Anita; McGrath, Patrick

2018-01-01

This study aimed to assess the Parent-Adolescent Communication Toolkit, an online intervention designed to help improve parent communication with their adolescents. Participant preferences for two module delivery systems (sequential and unrestricted module access) were identified. Usability assessment of the PACT intervention was completed using pre-test and posttest comparisons. Usability data, including participant completion and satisfaction ratings were examined. Parents ( N  =   18) of adolescents were randomized to a sequential or unrestricted chapter access group. Parent participants completed pre-test measures, the PACT intervention and posttest measures. Participants provided feedback for the intervention to improve modules and provided usability ratings. Adolescent pre- and posttest ratings were evaluated. Usability ratings were high and parent feedback was positive. The sequential module access groups rated the intervention content higher and completed more content than the unrestricted chapter access group, indicating support for the sequential access design. Parent mean posttest communication scores were significantly higher ( p  <   .05) than pre-test scores. No significant differences were detected for adolescent participants. Findings suggest that the Parent-Adolescent Communication Toolkit has potential to improve parent-adolescent communication but further effectiveness assessment is required.

A usability evaluation of medical software at an expert conference setting.

PubMed

Bond, Raymond Robert; Finlay, Dewar D; Nugent, Chris D; Moore, George; Guldenring, Daniel

2014-01-01

A usability test was employed to evaluate two medical software applications at an expert conference setting. One software application is a medical diagnostic tool (electrocardiogram [ECG] viewer) and the other is a medical research tool (electrode misplacement simulator [EMS]). These novel applications have yet to be adopted by the healthcare domain, thus, (1) we wanted to determine the potential user acceptance of these applications and (2) we wanted to determine the feasibility of evaluating medical diagnostic and medical research software at a conference setting as opposed to the conventional laboratory setting. The medical diagnostic tool (ECG viewer) was evaluated using seven delegates and the medical research tool (EMS) was evaluated using 17 delegates that were recruited at the 2010 International Conference on Computing in Cardiology. Each delegate/participant was required to use the software and undertake a set of predefined tasks during the session breaks at the conference. User interactions with the software were recorded using screen-recording software. The 'think-aloud' protocol was also used to elicit verbal feedback from the participants whilst they attempted the pre-defined tasks. Before and after each session, participants completed a pre-test and a post-test questionnaire respectively. The average duration of a usability session at the conference was 34.69 min (SD=10.28). However, taking into account that 10 min was dedicated to the pre-test and post-test questionnaires, the average time dedication to user interaction of the medical software was 24.69 min (SD=10.28). Given we have shown that usability data can be collected at conferences, this paper details the advantages of conference-based usability studies over the laboratory-based approach. For example, given delegates gather at one geographical location, a conference-based usability evaluation facilitates recruitment of a convenient sample of international subject experts. This would otherwise be very expensive to arrange. A conference-based approach also allows for data to be collected over a few days as opposed to months by avoiding administration duties normally involved in laboratory based approach, e.g. mailing invitation letters as part of a recruitment campaign. Following analysis of the user video recordings, 41 (previously unknown) use errors were identified in the advanced ECG viewer and 29 were identified in the EMS application. All use errors were given a consensus severity rating from two independent usability experts. Out of a rating scale of 4 (where 1=cosmetic and 4=critical), the average severity rating for the ECG viewer was 2.24 (SD=1.09) and the average severity rating for the EMS application was 2.34 (SD=0.97). We were also able to extract task completion rates and times from the video recordings to determine the effectiveness of the software applications. For example, six out of seven tasks were completed by all participants when using both applications. This statistic alone suggests both applications already have a high degree of usability. As well as extracting data from the video recordings, we were also able to extract data from the questionnaires. Using a semantic differential scale (where 1=poor and 5=excellent), delegates highly rated the 'responsiveness', 'usefulness', 'learnability' and the 'look and feel' of both applications. This study has shown the potential user acceptance and user-friendliness of the novel EMS and the ECG viewer applications within the healthcare domain. It has also shown that both medical diagnostic software and medical research software can be evaluated for their usability at an expert conference setting. The primary advantage of a conference-based usability evaluation over a laboratory-based evaluation is the high concentration of experts at one location, which is convenient, less time consuming and less expensive. Copyright © 2013 Elsevier Ireland Ltd. All rights reserved.

Unmet Dental Needs and Barriers to Dental Care among Children with Autism Spectrum Disorders

ERIC Educational Resources Information Center

Lai, Bien; Milano, Michael; Roberts, Michael W.; Hooper, Stephen R.

2012-01-01

Mail-in pilot-tested questionnaires were sent to a stratified random sample of 1,500 families from the North Carolina Autism Registry. Multivariate logistic regression analysis was used to determine the significance of unmet dental needs and other predictors. Of 568 surveys returned (Response Rate = 38%), 555 were complete and usable. Sixty-five…

Rural School Psychology: Re-Opening the Discussion

ERIC Educational Resources Information Center

Clopton, Kerri L.; Knesting, Kimberly

2006-01-01

The practice of school psychology in rural areas is a topic that has been fairly absent from the literature since the 1980s. A needs assessment of school psychologists practicing in rural counties in a midwestern state was conducted to explore current issues for rural school psychologists. The response rate for usable surveys was 72% (N = 106).…

Small Business and Health Care. Results of a Survey.

ERIC Educational Resources Information Center

Hall, Charles P., Jr.; Kuder, John M.

A 1989 mail survey collected data regarding health insurance from 18,614 small business owners who were employer members of the National Federation of Independent Business. In all, 5,368 usable surveys were returned for a 29 percent response rate. Data were obtained on opinions about health care, health care markets, and general health policy;…

Usability study of a novel, self-lighted, disposable speculum: military applications.

PubMed

Jones, Christina L; Gruber, Daniel D; Warner, William; Buller, Jerome L

2013-04-01

Data collected from a postutilization questionnaire were used to evaluate the usability of the OfficeSPEC disposable vaginal speculum, specifically the effectiveness, efficiency, and acceptability, in clinical, hospital, and austere environments. Usability data analysis showed the OfficeSPEC speculum had an effectiveness rating of 4.6/5, efficiency rating of 4.5/5, and acceptability rating of 4.6/5; overall usability in deployed environments was favorable. The overall rankings were 3.4 for plastic, 4.2 for metal (p < 0.001), and 4.5 for OfficeSPEC (p < 0.001). Cost analysis of the OfficeSPEC placed the disposable speculum as a reasonable alternative with yearly cost of $129,200, compared to traditional metal ($209,100) and plastic ($319,175). By evaluating the OfficeSPEC speculum within a usability framework, it proved to be practical, viable alternative in all environments, particularly in the forward deployed environment. Reprint & Copyright © 2013 Association of Military Surgeons of the U.S.

Health system guidance appraisal--concept evaluation and usability testing.

PubMed

Ako-Arrey, Denis E; Brouwers, Melissa C; Lavis, John N; Giacomini, Mita K

2016-01-05

Health system guidance (HSG) provides recommendations aimed to address health system challenges. However, there is a paucity of methods to direct, appraise, and report HSG. Earlier research identified 30 candidate criteria (concepts) that can be used to evaluate the quality of HSG and guide development and reporting requirements. The objective of this paper was to describe two studies aimed at evaluating the importance of these 30 criteria, design a draft HSG appraisal tool, and test its usability. This study involved a two-step survey process. In step 1, respondents rated the 30 concepts for appropriateness to, relevance to, and priority for health system decisions and HSG. This led to a draft tool. In step 2, respondents reviewed HSG documents, appraised them using the tool, and answered a series of questions. Descriptive analyses were computed. Fifty participants were invited in step 1, and we had a response rate of 82 %. The mean response rates for each concept within each survey question were universally favorable. There was also an overall agreement about the need for a high-quality tool to systematically direct the development, appraisal, and reporting of HSG. Qualitative feedback and a consensus process by the team led to refinements to some of the concepts and the creation of a beta (draft) version of the HSG tool. In step 2, 35 participants were invited and we had a response rate of 74 %. Exploratory analyses showed that the quality of the HSGs reviewed varied as a function of the HSG item and the specific document assessed. A favorable consensus was reached with participants agreeing that the HSG items were easy to understand and easy to apply. Moreover, the overall agreement was high for the usability of the tool to systematically direct the development (85 %), appraisal (92 %), and reporting (81 %) of HSG. From this process, version 1.0 of the HSG appraisal tool was generated complete with 32 items (and their descriptions) and 4 domains. The final tool, named the Appraisal of Guidelines for Research and Evaluation for Health Systems (AGREE-HS) (version 1), defines expectations of HSG and facilitates informed decisions among policymakers on health system delivery, financial, and governance arrangements.

Adapting an in-person patient-caregiver communication intervention to a tailored web-based format.

PubMed

Zulman, Donna M; Schafenacker, Ann; Barr, Kathryn L C; Moore, Ian T; Fisher, Jake; McCurdy, Kathryn; Derry, Holly A; Saunders, Edward W; An, Lawrence C; Northouse, Laurel

2012-03-01

Interventions that target cancer patients and their caregivers have been shown to improve patient-caregiver communication, support, and emotional well-being. To adapt an in-person communication intervention for cancer patients and caregivers to a web-based format, and to examine the usability and acceptability of the web-based program among representative users. A tailored, interactive web-based communication program for cancer patients and their family caregivers was developed based on an existing in-person, nurse-delivered intervention. The development process involved: (1) building a multidisciplinary team of content and web design experts, (2) combining key components of the in-person intervention with the unique tailoring and interactive features of a web-based platform, and (3) conducting focus groups and usability testing to obtain feedback from representative program users at multiple time points. Four focus groups with 2-3 patient-caregiver pairs per group (n = 22 total participants) and two iterations of usability testing with four patient-caregiver pairs per session (n = 16 total participants) were conducted. Response to the program's structure, design, and content was favorable, even among users who were older or had limited computer and Internet experience. The program received high ratings for ease of use and overall usability (mean System Usability Score of 89.5 out of 100). Many elements of a nurse-delivered patient-caregiver intervention can be successfully adapted to a web-based format. A multidisciplinary design team and an iterative evaluation process with representative users were instrumental in the development of a usable and well-received web-based program. Copyright © 2011 John Wiley & Sons, Ltd.

Brief Report: Adapting an In-Person Patient-Caregiver Communication Intervention to a Tailored Web-Based Format

PubMed Central

Zulman, Donna M.; Schafenacker, Ann; Barr, Kathryn L.C.; Moore, Ian T.; Fisher, Jake; McCurdy, Kathryn; Derry, Holly A.; Saunders, Edward W.; An, Lawrence C.; Northouse, Laurel

2011-01-01

Background Interventions that target cancer patients and their caregivers have been shown to improve communication, support, and emotional well-being. Objective To adapt an in-person communication intervention for cancer patients and caregivers to a web-based format, and to examine the usability and acceptability of the web-based program among representative users. Methods A tailored, interactive web-based communication program for cancer patients and their family caregivers was developed based on an existing in-person, nurse-delivered intervention. The development process involved: 1) building a multidisciplinary team of content and web design experts, 2) combining key components of the in-person intervention with the unique tailoring and interactive features of a web-based platform, and 3) conducting focus groups and usability testing to obtain feedback from representative program users at multiple time points. Results Four focus groups with 2 to 3 patient-caregiver pairs per group (n = 22 total participants) and two iterations of usability testing with 4 patient-caregiver pairs per session (n = 16 total participants) were conducted. Response to the program's structure, design, and content was favorable, even among users who were older or had limited computer and internet experience. The program received high ratings for ease of use and overall usability (mean System Usability Score of 89.5 out of 100). Conclusions Many elements of a nurse-delivered patient-caregiver intervention can be successfully adapted to a web-based format. A multidisciplinary design team and an iterative evaluation process with representative users were instrumental in the development of a usable and well-received web-based program. PMID:21830255

A study of usability principles and interface design for mobile e-books.

PubMed

Wang, Chao-Ming; Huang, Ching-Hua

2015-01-01

This study examined usability principles and interface designs in order to understand the relationship between the intentions of mobile e-book interface designs and users' perceptions. First, this study summarised 4 usability principles and 16 interface attributes, in order to conduct usability testing and questionnaire survey by referring to Nielsen (1993), Norman (2002), and Yeh (2010), who proposed the usability principles. Second, this study used the interviews to explore the perceptions and behaviours of user operations through senior users of multi-touch prototype devices. The results of this study are as follows: (1) users' behaviour of operating an interactive interface is related to user prior experience; (2) users' rating of the visibility principle is related to users' subjective perception but not related to user prior experience; however, users' ratings of the ease, efficiency, and enjoyment principles are related to user prior experience; (3) the interview survey reveals that the key attributes affecting users' behaviour of operating an interface include aesthetics, achievement, and friendliness. This study conducts experiments to explore the effects of users’ prior multi-touch experience on users’ behaviour of operating a mobile e-book interface and users’ rating of usability principles. Both qualitative and quantitative data analyses were performed. By applying protocol analysis, key attributes affecting users’ behaviour of operation were determined.

User ratings of prosthetic usability and satisfaction in VA study to optimize DEKA arm.

PubMed

Resnik, Linda; Borgia, Matthew

2014-01-01

The Department of Veterans Affairs study to optimize the DEKA Arm provided feedback to inform optimization of the gen 2 (second-generation) prototype and evaluate the gen 3 (third-generation) prototype. This article summarizes recommendations to improve gen 2 and reports satisfaction and usability ratings of gen 2 and gen 3. Data were collected from 39 subjects; 37 subjects were included in this analysis. Of the subjects, 24 were fit with gen 2 (8 radial configuration [RC], 6 humeral configuration [HC], and 10 shoulder configuration [SC]), 13 were fit with gen 3 (4 RC, 5 HC, and 4 SC), and 5 were fit with both. Usability and satisfaction were evaluated using the Trinity Amputation and Prosthesis Experience Scale (TAPES) and study-specific usability and satisfaction scales. Descriptive statistics were examined and prototypes compared using Wilcoxon rank-sum. Results were stratified by configuration level and outcomes compared by prototype. Satisfaction and usability were greater for gen 3 than gen 2. Overall TAPES scores were similar; however, scores of the TAPES aesthetic satisfaction subscale were higher for gen 3. Compared with gen 2 users, gen 3 users were more satisfied with appearance, grips, and doffing and rated overall usability higher. Features of gen 3, including weight, external cables and wires, hand covering, and fingernails, would benefit from further optimization.

An evaluation method of computer usability based on human-to-computer information transmission model.

PubMed

Ogawa, K

1992-01-01

This paper proposes a new evaluation and prediction method for computer usability. This method is based on our two previously proposed information transmission measures created from a human-to-computer information transmission model. The model has three information transmission levels: the device, software, and task content levels. Two measures, called the device independent information measure (DI) and the computer independent information measure (CI), defined on the software and task content levels respectively, are given as the amount of information transmitted. Two information transmission rates are defined as DI/T and CI/T, where T is the task completion time: the device independent information transmission rate (RDI), and the computer independent information transmission rate (RCI). The method utilizes the RDI and RCI rates to evaluate relatively the usability of software and device operations on different computer systems. Experiments using three different systems, in this case a graphical information input task, confirm that the method offers an efficient way of determining computer usability.

Usability evaluation of an emergency department information system prototype designed using cognitive systems engineering techniques.

PubMed

Clark, Lindsey N; Benda, Natalie C; Hegde, Sudeep; McGeorge, Nicolette M; Guarrera-Schick, Theresa K; Hettinger, A Zachary; LaVergne, David T; Perry, Shawna J; Wears, Robert L; Fairbanks, Rollin J; Bisantz, Ann M

2017-04-01

This article presents an evaluation of novel display concepts for an emergency department information system (EDIS) designed using cognitive systems engineering methods. EDISs assist emergency medicine staff with tracking patient care and ED resource allocation. Participants performed patient planning and orientation tasks using the EDIS displays and rated the display's ability to support various cognitive performance objectives along with the usability, usefulness, and predicted frequency of use for 18 system components. Mean ratings were positive for cognitive performance support objectives, usability, usefulness, and frequency of use, demonstrating the successful application of design methods to create useful and usable EDIS concepts that provide cognitive support for emergency medicine staff. Nurse and provider roles had significantly different perceptions of the usability and usefulness of certain EDIS components, suggesting that they have different information needs while working. Copyright © 2016 Elsevier Ltd. All rights reserved.

Usability evaluation of an emergency department information system prototype designed using cognitive systems engineering techniques

PubMed Central

Clark, Lindsey N.; Benda, Natalie C.; Hegde, Sudeep; McGeorge, Nicolette M.; Guarrera-Schick, Theresa K.; Hettinger, A. Zachary; LaVergne, David T.; Perry, Shawna J.; Wears, Robert L.; Fairbanks, Rollin J.; Bisantz, Ann M.

2017-01-01

This article presents an evaluation of novel display concepts for an emergency department information system (EDIS) designed using cognitive systems engineering methods. EDISs assist emergency medicine staff with tracking patient care and ED resource allocation. Participants performed patient planning and orientation tasks using the EDIS displays and rated the display’s ability to support various cognitive performance objectives along with the usability, usefulness, and predicted frequency of use for 18 system components. Mean ratings were positive for cognitive performance support objectives, usability, usefulness, and frequency of use, demonstrating the successful application of design methods to create useful and usable EDIS concepts that provide cognitive support for emergency medicine staff. Nurse and provider roles had significantly different perceptions of the usability and usefulness of certain EDIS components, suggesting that they have different information needs while working. PMID:28166896

Mobile Phone Apps for Smoking Cessation: Quality and Usability Among Smokers With Psychosis.

PubMed

Ferron, Joelle C; Brunette, Mary F; Geiger, Pamela; Marsch, Lisa A; Adachi-Mejia, Anna M; Bartels, Stephen J

2017-03-03

Smoking is one of the top preventable causes of mortality in people with psychotic disorders such as schizophrenia. Cessation treatment improves abstinence outcomes, but access is a barrier. Mobile phone apps are one way to increase access to cessation treatment; however, whether they are usable by people with psychotic disorders, who often have special learning needs, is not known. Researchers reviewed 100 randomly selected apps for smoking cessation to rate them based on US guidelines for nicotine addiction treatment and to categorize them based on app functions. We aimed to test the usability and usefulness of the top-rated apps in 21 smokers with psychotic disorders. We identified 766 smoking cessation apps and randomly selected 100 for review. Two independent reviewers rated each app with the Adherence Index to US Clinical Practice Guideline for Treating Tobacco Use and Dependence. Then, smokers with psychotic disorders evaluated the top 9 apps within a usability testing protocol. We analyzed quantitative results using descriptive statistics and t tests. Qualitative data were open-coded and analyzed for themes. Regarding adherence to practice guidelines, most of the randomly sampled smoking cessation apps scored poorly-66% rated lower than 10 out of 100 on the Adherence Index (Mean 11.47, SD 11.8). Regarding usability, three common usability problems emerged: text-dense content, abstract symbols on the homepage, and subtle directions to edit features. In order for apps to be effective and usable for this population, developers should utilize a balance of text and simple design that facilitate ease of navigation and content comprehension that will help people learn quit smoking skills. ©Joelle C Ferron, Mary F Brunette, Pamela Geiger, Lisa A Marsch, Anna M Adachi-Mejia, Stephen J Bartels. Originally published in JMIR Human Factors (http://humanfactors.jmir.org), 03.03.2017.

Mobile Phone Apps for Smoking Cessation: Quality and Usability Among Smokers With Psychosis

PubMed Central

Brunette, Mary F; Geiger, Pamela; Marsch, Lisa A; Adachi-Mejia, Anna M; Bartels, Stephen J

2017-01-01

Background Smoking is one of the top preventable causes of mortality in people with psychotic disorders such as schizophrenia. Cessation treatment improves abstinence outcomes, but access is a barrier. Mobile phone apps are one way to increase access to cessation treatment; however, whether they are usable by people with psychotic disorders, who often have special learning needs, is not known. Objective Researchers reviewed 100 randomly selected apps for smoking cessation to rate them based on US guidelines for nicotine addiction treatment and to categorize them based on app functions. We aimed to test the usability and usefulness of the top-rated apps in 21 smokers with psychotic disorders. Methods We identified 766 smoking cessation apps and randomly selected 100 for review. Two independent reviewers rated each app with the Adherence Index to US Clinical Practice Guideline for Treating Tobacco Use and Dependence. Then, smokers with psychotic disorders evaluated the top 9 apps within a usability testing protocol. We analyzed quantitative results using descriptive statistics and t tests. Qualitative data were open-coded and analyzed for themes. Results Regarding adherence to practice guidelines, most of the randomly sampled smoking cessation apps scored poorly—66% rated lower than 10 out of 100 on the Adherence Index (Mean 11.47, SD 11.8). Regarding usability, three common usability problems emerged: text-dense content, abstract symbols on the homepage, and subtle directions to edit features. Conclusions In order for apps to be effective and usable for this population, developers should utilize a balance of text and simple design that facilitate ease of navigation and content comprehension that will help people learn quit smoking skills. PMID:28258047

Collecting and Applying Usability Data from Distance Learners

ERIC Educational Resources Information Center

Mitchell, Emily; West, Brandon

2017-01-01

Growth of their college's off-campus and online course offerings led librarians at SUNY Oswego to run usability tests with off-campus students to compensate for a lack of responses from this population during earlier usability testing. Constraints on testing with off-campus students included lack of funding and librarian time, as well as…

The Imperative of Solving Nurses' Usability Problems With Health Information Technology.

PubMed

Staggers, Nancy; Elias, Beth L; Makar, Ellen; Alexander, Gregory L

2018-04-01

Health information technology (IT) usability issues are a key concern for nurse executives and nurses. The aims of this study are to understand usability pain points faced by nurses regarding the use of health IT, identify their impact and importance, discuss responsibilities, and develop possible solutions to improve the health IT-user experience for nurses. Twenty-seven experts were interviewed including nursing leaders, informaticists, executives, engineers, researchers, and human factors experts across acute care, long-term care, and vendor settings. Semistructured questions guided the interviews, and content analysis was used to identify themes. Four themes emerged: 1) user experience pain points, 2) importance of the issues, 3) the responsibility gap, and 4) acting on usability issues. Nurses continue to endure significant health IT-usability issues that negatively impact patients, nurses, and healthcare organizations. Solutions include enhancing the voice of nursing at the national and local levels, creating a digital strategy for nursing, providing incentives to improve usability in health IT, and accelerating the understanding of nurses' work intended to inform and translate nurses' work into health IT design.

A Modified User-Oriented Heuristic Evaluation of a Mobile Health System for Diabetes Self-management Support

PubMed Central

Georgsson, Mattias; Staggers, Nancy; Weir, Charlene

2016-01-01

Mobile health platforms offer significant opportunities for improving diabetic self-care, but only if adequate usability exists. Expert evaluations such as heuristic evaluation can provide distinct usability information about systems. The purpose of this study was to complete a usability evaluation of a mobile health system for diabetes patients using a modified heuristic evaluation technique of (1) dual-domain experts (healthcare professionals, usability experts), (2) validated scenarios and user tasks related to patients’ self-care, and (3) in-depth severity factor ratings. Experts identified 129 usability problems with 274 heuristic violations for the system. The categories Consistency and Standards dominated at 24.1% (n = 66), followed by Match Between System and Real World at 22.3% (n = 61). Average severity ratings across system views were 2.8 (of 4), with 9.3% (n = 12) rated as catastrophic and 53.5% (n = 69) as major. The large volume of violations with severe ratings indicated clear priorities for redesign. The modified heuristic approach allowed evaluators to identify unique and important issues, including ones related to self-management and patient safety. This article provides a template for one type of expert evaluation adding to the informaticists’ toolbox when needing to conduct a fast, resource-efficient and user-oriented heuristic evaluation. PMID:26657618

A Modified User-Oriented Heuristic Evaluation of a Mobile Health System for Diabetes Self-management Support.

PubMed

Georgsson, Mattias; Staggers, Nancy; Weir, Charlene

2016-02-01

Mobile health platforms offer significant opportunities for improving diabetic self-care, but only if adequate usability exists. Expert evaluations such as heuristic evaluation can provide distinct usability information about systems. The purpose of this study was to complete a usability evaluation of a mobile health system for diabetes patients using a modified heuristic evaluation technique of (1) dual-domain experts (healthcare professionals, usability experts), (2) validated scenarios and user tasks related to patients' self-care, and (3) in-depth severity factor ratings. Experts identified 129 usability problems with 274 heuristic violations for the system. The categories Consistency and Standards dominated at 24.1% (n = 66), followed by Match Between System and Real World at 22.3% (n = 61). Average severity ratings across system views were 2.8 (of 4), with 9.3% (n = 12) rated as catastrophic and 53.5% (n = 69) as major. The large volume of violations with severe ratings indicated clear priorities for redesign. The modified heuristic approach allowed evaluators to identify unique and important issues, including ones related to self-management and patient safety. This article provides a template for one type of expert evaluation adding to the informaticists' toolbox when needing to conduct a fast, resource-efficient and user-oriented heuristic evaluation.

Predictors of Registered Nurses' Intention To Quit: Implications for the Management of Health Care Human Resources in North Dakota Hospitals.

ERIC Educational Resources Information Center

Pooyan, Abdullah; And Others

Turnover rates for nurses are among the highest for all professional employees. This study investigated the potential predictors of registered nurses' intention to quit. Survey questionnaires were mailed to a population of 779 registered nurses from two hospitals in North Dakota. Approximately 4 weeks later, usable responses were received from 353…

Usability Evaluation of a Clinical Decision Support System for Geriatric ED Pain Treatment.

PubMed

Genes, Nicholas; Kim, Min Soon; Thum, Frederick L; Rivera, Laura; Beato, Rosemary; Song, Carolyn; Soriano, Jared; Kannry, Joseph; Baumlin, Kevin; Hwang, Ula

2016-01-01

Older adults are at risk for inadequate emergency department (ED) pain care. Unrelieved acute pain is associated with poor outcomes. Clinical decision support systems (CDSS) hold promise to improve patient care, but CDSS quality varies widely, particularly when usability evaluation is not employed. To conduct an iterative usability and redesign process of a novel geriatric abdominal pain care CDSS. We hypothesized this process would result in the creation of more usable and favorable pain care interventions. Thirteen emergency physicians familiar with the Electronic Health Record (EHR) in use at the study site were recruited. Over a 10-week period, 17 1-hour usability test sessions were conducted across 3 rounds of testing. Participants were given 3 patient scenarios and provided simulated clinical care using the EHR, while interacting with the CDSS interventions. Quantitative System Usability Scores (SUS), favorability scores and qualitative narrative feedback were collected for each session. Using a multi-step review process by an interdisciplinary team, positive and negative usability issues in effectiveness, efficiency, and satisfaction were considered, prioritized and incorporated in the iterative redesign process of the CDSS. Video analysis was used to determine the appropriateness of the CDS appearances during simulated clinical care. Over the 3 rounds of usability evaluations and subsequent redesign processes, mean SUS progressively improved from 74.8 to 81.2 to 88.9; mean favorability scores improved from 3.23 to 4.29 (1 worst, 5 best). Video analysis revealed that, in the course of the iterative redesign processes, rates of physicians' acknowledgment of CDS interventions increased, however most rates of desired actions by physicians (such as more frequent pain score updates) decreased. The iterative usability redesign process was instrumental in improving the usability of the CDSS; if implemented in practice, it could improve geriatric pain care. The usability evaluation process led to improved acknowledgement and favorability. Incorporating usability testing when designing CDSS interventions for studies may be effective to enhance clinician use.

The use of fault reporting of medical equipment to identify latent design flaws.

PubMed

Flewwelling, C J; Easty, A C; Vicente, K J; Cafazzo, J A

2014-10-01

Poor device design that fails to adequately account for user needs, cognition, and behavior is often responsible for use errors resulting in adverse events. This poor device design is also often latent, and could be responsible for "No Fault Found" (NFF) reporting, in which medical devices sent for repair by clinical users are found to be operating as intended. Unresolved NFF reports may contribute to incident under reporting, clinical user frustration, and biomedical engineering technologist inefficacy. This study uses human factors engineering methods to investigate the relationship between NFF reporting frequency and device usability. An analysis of medical equipment maintenance data was conducted to identify devices with a high NFF reporting frequency. Subsequently, semi-structured interviews and heuristic evaluations were performed in order to identify potential usability issues. Finally, usability testing was conducted in order to validate that latent usability related design faults result in a higher frequency of NFF reporting. The analysis of medical equipment maintenance data identified six devices with a high NFF reporting frequency. Semi-structured interviews, heuristic evaluations and usability testing revealed that usability issues caused a significant portion of the NFF reports. Other factors suspected to contribute to increased NFF reporting include accessory issues, intermittent faults and environmental issues. Usability testing conducted on three of the devices revealed 23 latent usability related design faults. These findings demonstrate that latent usability related design faults manifest themselves as an increase in NFF reporting and that devices containing usability related design faults can be identified through an analysis of medical equipment maintenance data. Copyright © 2014 The Authors. Published by Elsevier Inc. All rights reserved.

Mixed-Methods Analysis of Factors Impacting Use of a Postoperative mHealth App

PubMed Central

Scott, Aaron R; Alore, Elizabeth A; Naik, Aanand D; Berger, David H

2017-01-01

Background Limited communication and care coordination following discharge from hospitals may contribute to surgical complications. Smartphone apps offer a novel mechanism for communication and care coordination. However, factors which may affect patient app use in a postoperative, at-home setting are poorly understood. Objective The objectives of this study were to (1) gauge interest in smartphone app use among patients after colorectal surgery and (2) better understand factors affecting patient app use in a postoperative, at-home setting. Methods A prospective feasibility study was performed at a hospital that principally serves low socioeconomic status patients. After colorectal surgery, patients were enrolled and given a smartphone app, which uses previously validated content to provide symptom-based recommendations. Patients were instructed to use the app daily for 14 days after discharge. Demographics and usability data were collected at enrollment. Usability was measured with the System Usability Scale (SUS). At follow-up, the SUS was repeated and patients underwent a structured interview covering ease of use, willingness to use, and utility of use. Two members of the research team independently reviewed the field notes from follow-up interviews and extracted the most consistent themes. Chart and app log reviews identified clinical endpoints. Results We screened 115 patients, enrolled 20 patients (17.4%), and completed follow-up interviews with 17 patients (85%). Reasons for nonenrollment included: failure to meet inclusion criteria (47/115, 40.9%), declined to participate (26/115, 22.6%), and other reasons (22/115, 19.1%). There was no difference in patient ratings between usability at first-use and after extended use, with SUS scores greater than the 95th percentile at both time points. Despite high usability ratings, 6/20 (30%) of patients never used the app at home after hospital discharge and 2/20 (10%) only used the app once. Interviews revealed three themes related to app use: (1) patient-related barriers could prevent use even though the app had high usability scores; (2) patients viewed the app as a second opinion, rather than a primary source of information; and (3) many patients viewed the app as an external burden. Conclusions Use patterns in this study, and response rates after prompts to contact the operative team, suggest that apps need to be highly engaging to be adopted by patients. The growing penetration of smartphones and the proliferation of app-based interventions are unlikely to improve care coordination and communication, unless apps address the barriers and patient perceptions identified in this study. This study shows that high usability alone is not sufficient to motivate patients to use smartphone apps in the postoperative period. PMID:28179215

An eHealth Application of Self-Reported Sports-Related Injuries and Illnesses in Paralympic Sport: Pilot Feasibility and Usability Study

PubMed Central

2017-01-01

Background Sport participation is associated with a risk of sports-related injuries and illnesses, and Paralympic athletes’ additional medical issues can be a challenge to health care providers and medical staff. However, few prospective studies have assessed sports-related injuries and illnesses in Paralympic sport (SRIIPS) over time. Advances in mobile phone technology and networking systems offer novel opportunities to develop innovative eHealth applications for collection of athletes’ self-reports. Using eHealth applications for collection of self-reported SRIIPS is an unexplored area, and before initiation of full-scale research of SRIIPS, the feasibility and usability of such an approach needs to be ascertained. Objective The aim of this study was to perform a 4-week pilot study and (1) evaluate the monitoring feasibility and system usability of a novel eHealth application for self-reported SRIIPS and (2) report preliminary data on SRIIPS. Methods An eHealth application for routine collection of data from athletes was developed and adapted to Paralympic athletes. A 4-week pilot study was performed where Paralympic athletes (n=28) were asked to weekly self-report sport exposure, training load, general well-being, pain, sleep, anxiety, and possible SRIIPS. The data collection was followed by a poststudy use assessment survey. Quantitative data related to the system use (eg, completed self-reports, missing responses, and errors) were analyzed using descriptive statistics. The qualitative feasibility and usability data provided by the athletes were condensed and categorized using thematic analysis methods. Results The weekly response rate was 95%. The athletes were of the opinion that the eHealth application was usable and feasible but stated that it was not fully adapted to Paralympic athletes and their impairments. For example, it was difficult to understand how a new injury or illness should be identified when the impairment was involved. More survey items related to the impairments were requested, as the athletes perceived that injuries and illnesses often occurred because of the impairment. Options for description of multifactorial incidents including an injury, an illness, and the impairment were also insufficient. Few technical issues were encountered, but athletes with visual impairment reported usability difficulties with the speech synthesizer. An incidence rate of 1.8 injuries and 1.7 illnesses per 100 hours of athlete exposure were recorded. The weekly pain prevalence was 56% and the impairment contributed to 20% of the reported incidents. Conclusions The novel eHealth-based application for self-reported SRIIPS developed and tested in this pilot study was generally feasible and usable. With some adaptation to accommodate Paralympic athletes’ prerequisites and improved technical support for athletes with visual impairment, this application can be recommended for use in prospective studies of SRIIPS. Trial Registration ClinicalTrials.gov NCT02788500; https://clinicaltrials.gov/ct2/show/NCT02788500 (Archived by WebCite at http://www.webcitation.org/6v56OqTeP) PMID:29187343

The Influence of Product Aesthetics and User State in Usability Testing

ERIC Educational Resources Information Center

Sauer, Juergen; Sonderegger, Andreas

2011-01-01

An empirical study examined the effects of two influencing factors in usability tests on user performance and usability ratings. Product aesthetics (high vs. low) as the main independent factor and prior usage event (positive vs. negative) as a subsidiary independent factor were varied in a between-participants design. 60 participants took part in…

Testing Quick Response (QR) Codes as an Innovation to Improve Feedback Among Geographically-Separated Clerkship Sites.

PubMed

Snyder, Matthew J; Nguyen, Dana R; Womack, Jasmyne J; Bunt, Christopher W; Westerfield, Katie L; Bell, Adriane E; Ledford, Christy J W

2018-03-01

Collection of feedback regarding medical student clinical experiences for formative or summative purposes remains a challenge across clinical settings. The purpose of this study was to determine whether the use of a quick response (QR) code-linked online feedback form improves the frequency and efficiency of rater feedback. In 2016, we compared paper-based feedback forms, an online feedback form, and a QR code-linked online feedback form at 15 family medicine clerkship sites across the United States. Outcome measures included usability, number of feedback submissions per student, number of unique raters providing feedback, and timeliness of feedback provided to the clerkship director. The feedback method was significantly associated with usability, with QR code scoring the highest, and paper second. Accessing feedback via QR code was associated with the shortest time to prepare feedback. Across four rotations, separate repeated measures analyses of variance showed no effect of feedback system on the number of submissions per student or the number of unique raters. The results of this study demonstrate that preceptors in the family medicine clerkship rate QR code-linked feedback as a high usability platform. Additionally, this platform resulted in faster form completion than paper or online forms. An overarching finding of this study is that feedback forms must be portable and easily accessible. Potential implementation barriers and the social norm for providing feedback in this manner need to be considered.

The Use of an Adapted Health IT Usability Evaluation Model (Health-ITUEM) for Evaluating Consumer Reported Ratings of Diabetes mHealth Applications: Implications for Diabetes Care and Management

PubMed Central

Househ, Mowafa S.; Shubair, Mamdouh M.; Yunus, Faisel; Jamal, Amr; Aldossari, Bakheet

2015-01-01

Background: The aim of this paper is to present a usability analysis of the consumer ratings of key diabetes mHealth applications using an adapted Health IT Usability Evaluation Model (Health-ITUEM). Methods: A qualitative content analysis method was used to analyze publicly available consumer reported data posted on the Android Market and Google Play for four leading diabetes mHealth applications. Health-ITUEM concepts including information needs, flexibility/customizability, learnability, performance speed, and competency guided the categorization and analysis of the data. Health impact was an additional category that was included in the study. A total of 405 consumers’ ratings collected from January 9, 2014 to February 17, 2014 were included in the study. Results: Overall, the consumers’ ratings of the leading diabetes mHealth applications for both usability and health impacts were positive. The performance speed of the mHealth application and the information needs of the consumers were the primary usability factors impacting the use of the diabetes mHealth applications. There was also evidence on the positive health impacts of such applications. Conclusions: Consumers are more likely to use diabetes related mHealth applications that perform well and meet their information needs. Furthermore, there is preliminary evidence that diabetes mHealth applications can have positive impact on the health of patients. PMID:26635437

The Use of an Adapted Health IT Usability Evaluation Model (Health-ITUEM) for Evaluating Consumer Reported Ratings of Diabetes mHealth Applications: Implications for Diabetes Care and Management.

PubMed

Househ, Mowafa S; Shubair, Mamdouh M; Yunus, Faisel; Jamal, Amr; Aldossari, Bakheet

2015-10-01

The aim of this paper is to present a usability analysis of the consumer ratings of key diabetes mHealth applications using an adapted Health IT Usability Evaluation Model (Health-ITUEM). A qualitative content analysis method was used to analyze publicly available consumer reported data posted on the Android Market and Google Play for four leading diabetes mHealth applications. Health-ITUEM concepts including information needs, flexibility/customizability, learnability, performance speed, and competency guided the categorization and analysis of the data. Health impact was an additional category that was included in the study. A total of 405 consumers' ratings collected from January 9, 2014 to February 17, 2014 were included in the study. Overall, the consumers' ratings of the leading diabetes mHealth applications for both usability and health impacts were positive. The performance speed of the mHealth application and the information needs of the consumers were the primary usability factors impacting the use of the diabetes mHealth applications. There was also evidence on the positive health impacts of such applications. Consumers are more likely to use diabetes related mHealth applications that perform well and meet their information needs. Furthermore, there is preliminary evidence that diabetes mHealth applications can have positive impact on the health of patients.

Alaska birch crafts and gifts: marketing practices and demographics.

Treesearch

Rosemarie Braden; David Nicholls

2004-01-01

Craft and gift producers in Alaska who use birch as a primary species were surveyed via mail, telephone calls, and site visits. Forty-two usable mail surveys were obtained for a response rate of 38.5 percent. Firms were in business an average of 13 years and utilized an average of 4,778 board feet of birch per year to produce a variety of craft items, including turned...

The current status of usability studies of information technologies in China: a systematic study.

PubMed

Lei, Jianbo; Xu, Lufei; Meng, Qun; Zhang, Jiajie; Gong, Yang

2014-01-01

To systematically review and analyze the current status and characteristics of usability studies in China in the field of information technology in general and in the field of healthcare in particular. We performed a quantitative literature analysis in three major Chinese academic databases and one English language database using Chinese search terms equivalent to the concept of usability. Six hundred forty-seven publications were selected for analysis. We found that in China the literature on usability in the field of information technology began in 1994 and increased thereafter. The usability definitions from ISO 9241-11:1998 and Nielsen (1993) have been widely recognized and cited. Authors who have published several publications are rare. Fourteen journals have a publishing rate over 1%. Only nine publications about HIT were identified. China's usability research started relatively late. There is a lack of organized research teams and dedicated usability journals. High-impact theoretical studies are scarce. On the application side, no original and systematic research frameworks have been developed. The understanding and definition of usability is not well synchronized with international norms. Besides, usability research in HIT is rare. More human and material resources need to be invested in China's usability research, particularly in HIT.

Using Heuristic Evaluation to Improve Sepsis Alert Usability.

PubMed

Pertiwi, Ariani Arista Putri; Fraczkowski, Dan; Stogis, Sheryl L; Lopez, Karen Dunn

2018-06-01

Sepsis, life-threatening organ dysfunction in response to infection, is an alarmingly common and aggressive illness in US hospitals, especially for intensive care patients. Preventing sepsis deaths rests on the clinicians' ability to promptly recognize and treat sepsis. To aid early recognition, many organizations have employed clinician-facing electronic sepsis alert systems. However, the effectiveness of the alert relies on heavily on the visual interface, textual information, and overall usability. This article reports a usability inspection of a sepsis alert system. The authors found violations in 12 of the 14 usability principles and promote use of this method in practice to systematically identify usability problems. Copyright © 2018 Elsevier Inc. All rights reserved.

Does the use of structured reporting improve usability? A comparative evaluation of the usability of two approaches for findings reporting in a large-scale telecardiology context.

PubMed

Lacerda, Thaisa Cardoso; von Wangenheim, Christiane Gresse; von Wangenheim, Aldo; Giuliano, Isabela

2014-12-01

One of the main reasons that leads to a low adoption rate of telemedicine systems is poor usability. An aspect that influences usability during the reporting of findings is the input mode, e.g., if a free-text (FT) or a structured report (SR) interface is employed. The objective of our study is to compare the usability of FT and ST telemedicine systems, specifically in terms of user satisfaction, efficiency and general usability. We comparatively evaluate the usability of these two input modes in a telecardiology system for issuing electrocardiography reports in the context of a statewide telemedicine system in Brazil with more than 350.000 performed tele-electrocardiography examinations. We adopted a multiple method research strategy, applying three different kinds of usability evaluations: user satisfaction was evaluated through interviews with seven medical professionals using the System Usability Scale (SUS) questionnaire and specific questions related to adequacy and user experience. Efficiency was evaluated by estimating execution time using the Keystroke-Level Model (KLM). General usability was assessed based on the conformity of the systems to a set of e-health specific usability heuristics. The results of this comparison provide a first indication that a structured report (SR) input mode for such a system is more satisfactory and efficient with a larger conformity to usability heuristics than free-text (FT) input. User satisfaction using the SUS questionnaire has been scored in average with 58.8 and 77.5 points for the FT and SR system, respectively, which means that the SR system was rated 18.65 points higher than the FT system. In terms of efficiency, the completion of a findings report using the SR mode is estimated to take 8.5s, 3.74 times faster than using the FT system (31.8s). The SR system also demonstrated less violations to usability heuristics (8 points) in comparison to 14 points observed in the FT system. These results provide a first indication that the usage of structured reporting as an input mode in telecardiology systems may enhance usability. This also seems to confirm the advantages of the usage of structured reporting, as already described in the literature for other areas such as teleradiology. Copyright © 2014 Elsevier Inc. All rights reserved.

Human Factors in the Large: Experiences from Denmark, Finland and Canada in Moving Towards Regional and National Evaluations of Health Information System Usability. Contribution of the IMIA Human Factors Working Group.

PubMed

Kushniruk, A; Kaipio, J; Nieminen, M; Hyppönen, H; Lääveri, T; Nohr, C; Kanstrup, A M; Berg Christiansen, M; Kuo, M-H; Borycki, E

2014-08-15

The objective of this paper is to explore approaches to understanding the usability of health information systems at regional and national levels. Several different methods are discussed in case studies from Denmark, Finland and Canada. They range from small scale qualitative studies involving usability testing of systems to larger scale national level questionnaire studies aimed at assessing the use and usability of health information systems by entire groups of health professionals. It was found that regional and national usability studies can complement smaller scale usability studies, and that they are needed in order to understand larger trends regarding system usability. Despite adoption of EHRs, many health professionals rate the usability of the systems as low. A range of usability issues have been noted when data is collected on a large scale through use of widely distributed questionnaires and websites designed to monitor user perceptions of usability. As health information systems are deployed on a widespread basis, studies that examine systems used regionally or nationally are required. In addition, collection of large scale data on the usability of specific IT products is needed in order to complement smaller scale studies of specific systems.

Human Factors in the Large: Experiences from Denmark, Finland and Canada in Moving Towards Regional and National Evaluations of Health Information System Usability

PubMed Central

Kaipio, J.; Nieminen, M.; Hyppönen, H.; Lääveri, T.; Nohr, C.; Kanstrup, A. M.; Berg Christiansen, M.; Kuo, M.-H.; Borycki, E.

2014-01-01

Summary Objectives The objective of this paper is to explore approaches to understanding the usability of health information systems at regional and national levels. Methods Several different methods are discussed in case studies from Denmark, Finland and Canada. They range from small scale qualitative studies involving usability testing of systems to larger scale national level questionnaire studies aimed at assessing the use and usability of health information systems by entire groups of health professionals. Results It was found that regional and national usability studies can complement smaller scale usability studies, and that they are needed in order to understand larger trends regarding system usability. Despite adoption of EHRs, many health professionals rate the usability of the systems as low. A range of usability issues have been noted when data is collected on a large scale through use of widely distributed questionnaires and websites designed to monitor user perceptions of usability. Conclusion As health information systems are deployed on a widespread basis, studies that examine systems used regionally or nationally are required. In addition, collection of large scale data on the usability of specific IT products is needed in order to complement smaller scale studies of specific systems. PMID:25123725

75 FR 14145 - Agency Information Collection Activities: Proposed Collection; Comment Request

Federal Register 2010, 2011, 2012, 2013, 2014

2010-03-24

... made in response to usability testing as well as internal review. Changes have also been made to... burden of reporting using the electronic software and improve usability. The affected questions can be...

Effect of improving the usability of an e-learning resource: a randomized trial.

PubMed

Davids, Mogamat Razeen; Chikte, Usuf M E; Halperin, Mitchell L

2014-06-01

Optimizing the usability of e-learning materials is necessary to reduce extraneous cognitive load and maximize their potential educational impact. However, this is often neglected, especially when time and other resources are limited. We conducted a randomized trial to investigate whether a usability evaluation of our multimedia e-learning resource, followed by fixing of all problems identified, would translate into improvements in usability parameters and learning by medical residents. Two iterations of our e-learning resource [version 1 (V1) and version 2 (V2)] were compared. V1 was the first fully functional version and V2 was the revised version after all identified usability problems were addressed. Residents in internal medicine and anesthesiology were randomly assigned to one of the versions. Usability was evaluated by having participants complete a user satisfaction questionnaire and by recording and analyzing their interactions with the application. The effect on learning was assessed by questions designed to test the retention and transfer of knowledge. Participants reported high levels of satisfaction with both versions, with good ratings on the System Usability Scale and adjective rating scale. In contrast, analysis of video recordings revealed significant differences in the occurrence of serious usability problems between the two versions, in particular in the interactive HandsOn case with its treatment simulation, where there was a median of five serious problem instances (range: 0-50) recorded per participant for V1 and zero instances (range: 0-1) for V2 (P < 0.001). There were no differences in tests of retention or transfer of knowledge between the two versions. In conclusion, usability evaluation followed by a redesign of our e-learning resource resulted in significant improvements in usability. This is likely to translate into improved motivation and willingness to engage with the learning material. In this population of relatively high-knowledge participants, learning scores were similar across the two versions. Copyright © 2014 The American Physiological Society.

Effect of improving the usability of an e-learning resource: a randomized trial

PubMed Central

Chikte, Usuf M. E.; Halperin, Mitchell L.

2014-01-01

Optimizing the usability of e-learning materials is necessary to reduce extraneous cognitive load and maximize their potential educational impact. However, this is often neglected, especially when time and other resources are limited. We conducted a randomized trial to investigate whether a usability evaluation of our multimedia e-learning resource, followed by fixing of all problems identified, would translate into improvements in usability parameters and learning by medical residents. Two iterations of our e-learning resource [version 1 (V1) and version 2 (V2)] were compared. V1 was the first fully functional version and V2 was the revised version after all identified usability problems were addressed. Residents in internal medicine and anesthesiology were randomly assigned to one of the versions. Usability was evaluated by having participants complete a user satisfaction questionnaire and by recording and analyzing their interactions with the application. The effect on learning was assessed by questions designed to test the retention and transfer of knowledge. Participants reported high levels of satisfaction with both versions, with good ratings on the System Usability Scale and adjective rating scale. In contrast, analysis of video recordings revealed significant differences in the occurrence of serious usability problems between the two versions, in particular in the interactive HandsOn case with its treatment simulation, where there was a median of five serious problem instances (range: 0–50) recorded per participant for V1 and zero instances (range: 0–1) for V2 (P < 0.001). There were no differences in tests of retention or transfer of knowledge between the two versions. In conclusion, usability evaluation followed by a redesign of our e-learning resource resulted in significant improvements in usability. This is likely to translate into improved motivation and willingness to engage with the learning material. In this population of relatively high-knowledge participants, learning scores were similar across the two versions. PMID:24913451

Post-deployment usability evaluation of a radiology workstation.

PubMed

Jorritsma, Wiard; Cnossen, Fokie; Dierckx, Rudi A; Oudkerk, Matthijs; Van Ooijen, Peter M A

2016-01-01

To determine the number, nature and severity of usability issues radiologists encounter while using a commercially available radiology workstation in clinical practice, and to assess how well the results of a pre-deployment usability evaluation of this workstation generalize to clinical practice. The usability evaluation consisted of semi-structured interviews and observations of twelve users using the workstation during their daily work. Usability issues and positive usability findings were documented. Each issue was given a severity rating and its root cause was determined. Results were compared to the results of a pre-deployment usability evaluation of the same workstation. Ninety-two usability issues were identified, ranging from issues that cause minor frustration or delay, to issues that cause significant delays, prevent users from completing tasks, or even pose a potential threat to patient safety. The results of the pre-deployment usability evaluation had limited generalizability to clinical practice. This study showed that radiologists encountered a large number and a wide variety of usability issues when using a commercially available radiology workstation in clinical practice. This underlines the need for effective usability engineering in radiology. Given the limitations of pre-deployment usability evaluation in radiology, which were confirmed by our finding that the results of a pre-deployment usability evaluation of this workstation had limited generalizability to clinical practice, it is vital that radiology workstation vendors devote significant resources to usability engineering efforts before deployment of their workstation, and to continue these efforts after the workstation is deployed in a hospital. Copyright © 2015 Elsevier Ireland Ltd. All rights reserved.

An eHealth Application of Self-Reported Sports-Related Injuries and Illnesses in Paralympic Sport: Pilot Feasibility and Usability Study.

PubMed

Fagher, Kristina; Jacobsson, Jenny; Dahlström, Örjan; Timpka, Toomas; Lexell, Jan

2017-11-29

Sport participation is associated with a risk of sports-related injuries and illnesses, and Paralympic athletes' additional medical issues can be a challenge to health care providers and medical staff. However, few prospective studies have assessed sports-related injuries and illnesses in Paralympic sport (SRIIPS) over time. Advances in mobile phone technology and networking systems offer novel opportunities to develop innovative eHealth applications for collection of athletes' self-reports. Using eHealth applications for collection of self-reported SRIIPS is an unexplored area, and before initiation of full-scale research of SRIIPS, the feasibility and usability of such an approach needs to be ascertained. The aim of this study was to perform a 4-week pilot study and (1) evaluate the monitoring feasibility and system usability of a novel eHealth application for self-reported SRIIPS and (2) report preliminary data on SRIIPS. An eHealth application for routine collection of data from athletes was developed and adapted to Paralympic athletes. A 4-week pilot study was performed where Paralympic athletes (n=28) were asked to weekly self-report sport exposure, training load, general well-being, pain, sleep, anxiety, and possible SRIIPS. The data collection was followed by a poststudy use assessment survey. Quantitative data related to the system use (eg, completed self-reports, missing responses, and errors) were analyzed using descriptive statistics. The qualitative feasibility and usability data provided by the athletes were condensed and categorized using thematic analysis methods. The weekly response rate was 95%. The athletes were of the opinion that the eHealth application was usable and feasible but stated that it was not fully adapted to Paralympic athletes and their impairments. For example, it was difficult to understand how a new injury or illness should be identified when the impairment was involved. More survey items related to the impairments were requested, as the athletes perceived that injuries and illnesses often occurred because of the impairment. Options for description of multifactorial incidents including an injury, an illness, and the impairment were also insufficient. Few technical issues were encountered, but athletes with visual impairment reported usability difficulties with the speech synthesizer. An incidence rate of 1.8 injuries and 1.7 illnesses per 100 hours of athlete exposure were recorded. The weekly pain prevalence was 56% and the impairment contributed to 20% of the reported incidents. The novel eHealth-based application for self-reported SRIIPS developed and tested in this pilot study was generally feasible and usable. With some adaptation to accommodate Paralympic athletes' prerequisites and improved technical support for athletes with visual impairment, this application can be recommended for use in prospective studies of SRIIPS. ClinicalTrials.gov NCT02788500; https://clinicaltrials.gov/ct2/show/NCT02788500 (Archived by WebCite at http://www.webcitation.org/6v56OqTeP). ©Kristina Fagher, Jenny Jacobsson, Örjan Dahlström, Toomas Timpka, Jan Lexell. Originally published in JMIR Human Factors (http://humanfactors.jmir.org), 29.11.2017.

An Iterative, Mixed Usability Approach Applied to the Telekit System from the Danish TeleCare North Trial

PubMed Central

Schaarup, Clara; Hejlesen, Ole Kristian

2016-01-01

Objective. The aim of the present study is to evaluate the usability of the telehealth system, coined Telekit, by using an iterative, mixed usability approach. Materials and Methods. Ten double experts participated in two heuristic evaluations (HE1, HE2), and 11 COPD patients attended two think-aloud tests. The double experts identified usability violations and classified them into Jakob Nielsen's heuristics. These violations were then translated into measurable values on a scale of 0 to 4 indicating degree of severity. In the think-aloud tests, COPD participants were invited to verbalise their thoughts. Results. The double experts identified 86 usability violations in HE1 and 101 usability violations in HE2. The majority of the violations were rated in the 0–2 range. The findings from the think-aloud tests resulted in 12 themes and associated examples regarding the usability of the Telekit system. The use of the iterative, mixed usability approach produced both quantitative and qualitative results. Conclusion. The iterative, mixed usability approach yields a strong result owing to the high number of problems identified in the tests because the double experts and the COPD participants focus on different aspects of Telekit's usability. This trial is registered with Clinicaltrials.gov, NCT01984840, November 14, 2013. PMID:27974888

Beyond Effectiveness: A Pragmatic Evaluation Framework for Learning and Continuous Quality Improvement of e-Learning Interventions in Healthcare.

PubMed

Dafalla, Tarig Dafalla Mohamed; Kushniruk, Andre W; Borycki, Elizabeth M

2015-01-01

A pragmatic evaluation framework for evaluating the usability and usefulness of an e-learning intervention for a patient clinical information scheduling system is presented in this paper. The framework was conceptualized based on two different but related concepts (usability and usefulness) and selection of appropriate and valid methods of data collection and analysis that included: (1) Low-Cost Rapid Usability Engineering (LCRUE), (2) Cognitive Task Analysis (CTA), (3) Heuristic Evaluation (HE) criteria for web-based learning, and (4) Software Usability Measurement Inventory (SUMI). The results of the analysis showed some areas where usability that were related to General Interface Usability (GIU), instructional design and content was problematic; some of which might account for the poorly rated aspects of usability when subjectively measured. This paper shows that using a pragmatic framework can be a useful way, not only for measuring the usability and usefulness, but also for providing a practical objective evidences for learning and continuous quality improvement of e-learning systems. The findings should be of interest to educators, developers, designers, researchers, and usability practitioners involved in the development of e-learning systems in healthcare. This framework could be an appropriate method for assessing the usability, usefulness and safety of health information systems both in the laboratory and in the clinical context.

An Iterative, Mixed Usability Approach Applied to the Telekit System from the Danish TeleCare North Trial.

PubMed

Lilholt, Pernille Heyckendorff; Schaarup, Clara; Hejlesen, Ole Kristian

2016-01-01

Objective . The aim of the present study is to evaluate the usability of the telehealth system, coined Telekit, by using an iterative, mixed usability approach. Materials and Methods . Ten double experts participated in two heuristic evaluations (HE1, HE2), and 11 COPD patients attended two think-aloud tests. The double experts identified usability violations and classified them into Jakob Nielsen's heuristics. These violations were then translated into measurable values on a scale of 0 to 4 indicating degree of severity. In the think-aloud tests, COPD participants were invited to verbalise their thoughts. Results . The double experts identified 86 usability violations in HE1 and 101 usability violations in HE2. The majority of the violations were rated in the 0-2 range. The findings from the think-aloud tests resulted in 12 themes and associated examples regarding the usability of the Telekit system. The use of the iterative, mixed usability approach produced both quantitative and qualitative results. Conclusion . The iterative, mixed usability approach yields a strong result owing to the high number of problems identified in the tests because the double experts and the COPD participants focus on different aspects of Telekit's usability. This trial is registered with Clinicaltrials.gov, NCT01984840, November 14, 2013.

Combining usability evaluations to highlight the chain that leads from usability flaws to usage problems and then negative outcomes.

PubMed

Watbled, Ludivine; Marcilly, Romaric; Guerlinger, Sandra; Bastien, J-M Christian; Beuscart-Zéphir, Marie-Catherine; Beuscart, Régis

2018-02-01

Poor usability of health technology is thought to diminish work system performance, increase error rates and, potentially, harm patients. The present study (i) used a combination of usability evaluation methods to highlight the chain that leads from usability flaws to usage problems experienced by users and, ultimately, to negative patient outcomes, and (ii) validated this approach by studying two different discharge summary production systems. To comply with quality guidelines, the process of drafting and sending discharge summaries is increasingly being automated. However, the usability of these systems may modify their impact (or the absence thereof) in terms of production times and quality, and must therefore be evaluated. Here, we applied three successive techniques for usability evaluation (heuristic evaluation, user testing and field observation) to two discharge summary production systems (underpinned by different technologies). The systems' main usability flaws led respectively to an increase in the time need to produce a discharge summary and the risk of patient misidentification. Our results are discussed with regard to the possibility of linking the usability flaws, usage problems and the negative outcomes by successively applying three methods for evaluating usability (heuristic evaluation, user testing and in situ observations) throughout the system development life cycle. Copyright © 2018 Elsevier Inc. All rights reserved.

The Current Status of Usability Studies of Information Technologies in China: A Systematic Study

PubMed Central

Lei, Jianbo; Xu, Lufei; Meng, Qun; Zhang, Jiajie; Gong, Yang

2014-01-01

Objectives. To systematically review and analyze the current status and characteristics of usability studies in China in the field of information technology in general and in the field of healthcare in particular. Methods. We performed a quantitative literature analysis in three major Chinese academic databases and one English language database using Chinese search terms equivalent to the concept of usability. Results. Six hundred forty-seven publications were selected for analysis. We found that in China the literature on usability in the field of information technology began in 1994 and increased thereafter. The usability definitions from ISO 9241-11:1998 and Nielsen (1993) have been widely recognized and cited. Authors who have published several publications are rare. Fourteen journals have a publishing rate over 1%. Only nine publications about HIT were identified. Discussions. China's usability research started relatively late. There is a lack of organized research teams and dedicated usability journals. High-impact theoretical studies are scarce. On the application side, no original and systematic research frameworks have been developed. The understanding and definition of usability is not well synchronized with international norms. Besides, usability research in HIT is rare. Conclusions. More human and material resources need to be invested in China's usability research, particularly in HIT. PMID:25050362

Evaluation of Usability and Acceptance of a New Autoinjector Intended for Methotrexate Subcutaneous Self-Administration in the Management of Rheumatoid Arthritis.

PubMed

Hudry, Christophe; Lebrun, Agnès; Moura, Bertrand; Zinovieva, Elena; Backers, Onne; Herman-Demars, Hélène

2017-06-01

Rheumatoid arthritis (RA) is a chronic autoimmune inflammatory disease, for which the introduction of injectable treatments has had a major impact on quality of life directly related to the disease. The purpose of this descriptive study was to evaluate the usability of a new autoinjector, intended for methotrexate self-administration, based on the device's design and instructions for use (IFU). This multicenter trial included three user groups: a group of patients with established RA subdivided into two groups according to their hand disability, and a group of caregivers or nurses. Each subject performed three simulated injections with a water-filled device on a foam pad. The first injection was made just after reading the IFU without further instructions (first phase). The second phase consisted of two injections made after explanations provided upon request of the subject in an optimum environment and in a "worst-case" home environment. The usability of the autoinjector was assessed by a questionnaire (success: ≥75% of positive responses) and by a score card reflecting injection performances (success: execution of ≥75% of handling steps). Forty-two subjects were enrolled in the study. During the first phase, the great majority of subjects succeeded in the usability questionnaire (90.5%) and in the injection performance (95.2%) with no major differences between the user groups. In the Second phase, all subjects from all three user groups succeeded in the usability questionnaire and had a positive rate of device handling, regardless of the environment and of the user group. No safety concerns were raised during the study. This study found a very high level of usability and subject acceptance of the autoinjector, intended for methotrexate self-administration, regardless of the hand disability and environmental conditions. Nordic Group. EudraCT reference number: 2014-A0141245.

Getting a Technology-based Diabetes Intervention Ready for Primetime: A Review of Usability Testing Studies

PubMed Central

Lyles, Courtney R.; Sarkar, Urmimala; Osborn, Chandra Y.

2014-01-01

Consumer health technologies can educate patients about diabetes and support their self-management, yet usability evidence is rarely published even though it determines patient engagement, optimal benefit of any intervention, and an understanding of generalizability. Therefore, we conducted a narrative review of peer-reviewed articles published from 2009–2013 that tested the usability of a web- or mobile-delivered system/application designed to educate and support patients with diabetes. Overall, the 23 papers included in our review used mixed (n=11), descriptive quantitative (n=9), and qualitative methods (n=3) to assess usability, such as documenting which features performed as intended and how patients rated their experiences. More sophisticated usability evaluations combined several complementary approaches to elucidate more aspects of functionality. Future work pertaining to the design and evaluation of technology-delivered diabetes education/support interventions should aim to standardize the usability testing processes, and publish usability findings to inform interpretation of why an intervention succeeded or failed, and for whom. PMID:25173689

Applying human factors principles to alert design increases efficiency and reduces prescribing errors in a scenario-based simulation

PubMed Central

Russ, Alissa L; Zillich, Alan J; Melton, Brittany L; Russell, Scott A; Chen, Siying; Spina, Jeffrey R; Weiner, Michael; Johnson, Elizabette G; Daggy, Joanne K; McManus, M Sue; Hawsey, Jason M; Puleo, Anthony G; Doebbeling, Bradley N; Saleem, Jason J

2014-01-01

Objective To apply human factors engineering principles to improve alert interface design. We hypothesized that incorporating human factors principles into alerts would improve usability, reduce workload for prescribers, and reduce prescribing errors. Materials and methods We performed a scenario-based simulation study using a counterbalanced, crossover design with 20 Veterans Affairs prescribers to compare original versus redesigned alerts. We redesigned drug–allergy, drug–drug interaction, and drug–disease alerts based upon human factors principles. We assessed usability (learnability of redesign, efficiency, satisfaction, and usability errors), perceived workload, and prescribing errors. Results Although prescribers received no training on the design changes, prescribers were able to resolve redesigned alerts more efficiently (median (IQR): 56 (47) s) compared to the original alerts (85 (71) s; p=0.015). In addition, prescribers rated redesigned alerts significantly higher than original alerts across several dimensions of satisfaction. Redesigned alerts led to a modest but significant reduction in workload (p=0.042) and significantly reduced the number of prescribing errors per prescriber (median (range): 2 (1–5) compared to original alerts: 4 (1–7); p=0.024). Discussion Aspects of the redesigned alerts that likely contributed to better prescribing include design modifications that reduced usability-related errors, providing clinical data closer to the point of decision, and displaying alert text in a tabular format. Displaying alert text in a tabular format may help prescribers extract information quickly and thereby increase responsiveness to alerts. Conclusions This simulation study provides evidence that applying human factors design principles to medication alerts can improve usability and prescribing outcomes. PMID:24668841

Applying human factors principles to alert design increases efficiency and reduces prescribing errors in a scenario-based simulation.

PubMed

Russ, Alissa L; Zillich, Alan J; Melton, Brittany L; Russell, Scott A; Chen, Siying; Spina, Jeffrey R; Weiner, Michael; Johnson, Elizabette G; Daggy, Joanne K; McManus, M Sue; Hawsey, Jason M; Puleo, Anthony G; Doebbeling, Bradley N; Saleem, Jason J

2014-10-01

To apply human factors engineering principles to improve alert interface design. We hypothesized that incorporating human factors principles into alerts would improve usability, reduce workload for prescribers, and reduce prescribing errors. We performed a scenario-based simulation study using a counterbalanced, crossover design with 20 Veterans Affairs prescribers to compare original versus redesigned alerts. We redesigned drug-allergy, drug-drug interaction, and drug-disease alerts based upon human factors principles. We assessed usability (learnability of redesign, efficiency, satisfaction, and usability errors), perceived workload, and prescribing errors. Although prescribers received no training on the design changes, prescribers were able to resolve redesigned alerts more efficiently (median (IQR): 56 (47) s) compared to the original alerts (85 (71) s; p=0.015). In addition, prescribers rated redesigned alerts significantly higher than original alerts across several dimensions of satisfaction. Redesigned alerts led to a modest but significant reduction in workload (p=0.042) and significantly reduced the number of prescribing errors per prescriber (median (range): 2 (1-5) compared to original alerts: 4 (1-7); p=0.024). Aspects of the redesigned alerts that likely contributed to better prescribing include design modifications that reduced usability-related errors, providing clinical data closer to the point of decision, and displaying alert text in a tabular format. Displaying alert text in a tabular format may help prescribers extract information quickly and thereby increase responsiveness to alerts. This simulation study provides evidence that applying human factors design principles to medication alerts can improve usability and prescribing outcomes. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

The Superorbital Expansion Tube concept, experiment and analysis

NASA Technical Reports Server (NTRS)

Neely, A. J.; Morgan, R. G.

1995-01-01

In response to the need for ground testing facilities for super orbital re-entry research, a small scale facility has been set up at the University of Queensland to demonstrate the superorbital expansion tube concept. This unique device is a free piston driven, triple diaphragm, impulse shock facility which uses the enthalpy multiplication mechanism of the unsteady expansion process and the addition of a secondary shock driver to further heat the driver gas. The pilot facility has been operated to produce quasi-steady test flows in air with shock velocities in excess of 13 km/s and with a usable test flow duration of the order of 15 micro sec. an experimental condition produced in the facility with total enthalpy of 108 MJ/kg and a total pressure of 335 MPa is reported. A simple analytical flow model which accounts for non-ideal rupture of the light tertiary diaphragm and the resulting entropy increase in the test gas is discussed. It is shown that equilibrium calculations more accurately model the unsteady expansion process than calculations assuming frozen chemistry. This is because the high enthalpy flows produced in the facility can only be achieved if the chemical energy stored in the test flow during shock heating of the test gas is partially returned to the flow during the process of unsteady expansion. Measurements of heat transfer rates to a flat plate demonstrate the usability of test flow for aerothermodynamic testing and comparison of these rates with empirical calculations confirms the usable accuracy of the flow model.

Usability of Low-Cost Android Data Collection System for Community-Based Participatory Research.

PubMed

Salihu, Hamisu M; Salinas-Miranda, Abraham; Turner, DeAnne; King, Lindsey; Paothong, Arnut; Austin, Deborah; Berry, Estrellita Lo

2016-01-01

Android tablet computers can be valuable tools for data collection, but their usability has not been evaluated in community-based participatory research (CBPR). This article examines the usability of a low-cost bilingual touchscreen computerized survey system using Android tablets, piloted with a sample of 201 community residents in Tampa, Florida, from November 2013 to March 2014. Needs assessment questions were designed with the droidSURVEY software, and deployed using Android tablet computers. In addition, participants were asked questions about system usability. The mean system usability was 77.57 ± 17.66 (range, 0-100). The mean completion time for taking the 63 survey questions in the needs assessment was 23.11 ± 9.62 minutes. The survey completion rate was optimal (100%), with only 6.34% missingness per variable. We found no sociodemographic differences in usability scores. Our findings indicate that Android tablets could serve as useful tools in CBPR studies.

Exploring the Usability of Mobile Apps Supporting Radiologists' Training in Diagnostic Decision Making.

PubMed

Kim, Min Soon; Aro, Michael R; Lage, Kraig J; Ingalls, Kevin L; Sindhwani, Vivek; Markey, Mia K

2016-03-01

The objective of this study was to conduct a usability evaluation of mobile apps for supporting education and training in radiologic diagnostic decision-making processes. Of 381 mobile apps available at two major stores (Google Play and iTunes), eight iOS apps were selected for laboratory-based usability tests. Six staff radiologists completed eight app-specific task sets, using a think-aloud strategy. The triangular methods approach included quantitative performance measures, System Usability Scale (SUS), and qualitative thematic analysis using heuristic usability principles of usability issues. Overall, radiologists achieved higher than 70% success, with favorable SUS scores, in completing the tasks for seven of the eight apps. However, task success rate and SUS score had a weak relation (r = 0.23), indicating that the perceived usability may not reflect the holistic usability of the app. Task analysis and self-report revealed 108 usability issues, which were condensed to 55 unique issues and categorized by nine usability themes and mapped to ten usability heuristics. Nonintuitive functionality (eg, nonintuitive or misleading labels) was the most frequent theme observed, leading to inefficient navigation. These usability findings were consistent with the 13 improvements the radiologists suggested. This study demonstrates the feasibility of usability evaluation of radiology mobile apps and suggests potential improvements in the development of radiology mobile apps. This study also suggests that proficiency with mobile devices may not be equivalent to being an expert user, proficient in using the apps. Copyright © 2016 American College of Radiology. Published by Elsevier Inc. All rights reserved.

How Usability Testing Resulted in Improvements to Ground Collision Software for General Aviation: Improved Ground Collision Avoidance System (IGCAS)

NASA Technical Reports Server (NTRS)

Lamarr, Michael; Chinske, Chris; Williams, Ethan; Law, Cameron; Skoog, Mark; Sorokowski, Paul

2016-01-01

The NASA improved Ground Collision Avoidance System (iGCAS) team conducted an onsite usability study at Experimental Aircraft Association (EAA) Air Venture in Oshkosh, Wisconsin from July 19 through July 26, 2015. EAA Air Venture had approximately 550,000 attendees from which the sample pool of pilots were selected. The objectives of this study were to assess the overall appropriateness and acceptability of iGCAS as a warning system for General Aviation aircraft, usability of the iGCAS displays and audio cues, test terrain avoidance characteristics, performance, functionality, pilot response time, and correlate terrain avoidance performance and pilot response time data.

Quantifying usability: an evaluation of a diabetes mHealth system on effectiveness, efficiency, and satisfaction metrics with associated user characteristics.

PubMed

Georgsson, Mattias; Staggers, Nancy

2016-01-01

Mobile health (mHealth) systems are becoming more common for chronic disease management, but usability studies are still needed on patients' perspectives and mHealth interaction performance. This deficiency is addressed by our quantitative usability study of a mHealth diabetes system evaluating patients' task performance, satisfaction, and the relationship of these measures to user characteristics. We used metrics in the International Organization for Standardization (ISO) 9241-11 standard. After standardized training, 10 patients performed representative tasks and were assessed on individual task success, errors, efficiency (time on task), satisfaction (System Usability Scale [SUS]) and user characteristics. Tasks of exporting and correcting values proved the most difficult, had the most errors, the lowest task success rates, and consumed the longest times on task. The average SUS satisfaction score was 80.5, indicating good but not excellent system usability. Data trends showed males were more successful in task completion, and younger participants had higher performance scores. Educational level did not influence performance, but a more recent diabetes diagnosis did. Patients with more experience in information technology (IT) also had higher performance rates. Difficult task performance indicated areas for redesign. Our methods can assist others in identifying areas in need of improvement. Data about user background and IT skills also showed how user characteristics influence performance and can provide future considerations for targeted mHealth designs. Using the ISO 9241-11 usability standard, the SUS instrument for satisfaction and measuring user characteristics provided objective measures of patients' experienced usability. These could serve as an exemplar for standardized, quantitative methods for usability studies on mHealth systems. © The Author 2015. Published by Oxford University Press on behalf of the American Medical Informatics Association.

Quantifying usability: an evaluation of a diabetes mHealth system on effectiveness, efficiency, and satisfaction metrics with associated user characteristics

PubMed Central

Staggers, Nancy

2016-01-01

Objective Mobile health (mHealth) systems are becoming more common for chronic disease management, but usability studies are still needed on patients’ perspectives and mHealth interaction performance. This deficiency is addressed by our quantitative usability study of a mHealth diabetes system evaluating patients’ task performance, satisfaction, and the relationship of these measures to user characteristics. Materials and Methods We used metrics in the International Organization for Standardization (ISO) 9241-11 standard. After standardized training, 10 patients performed representative tasks and were assessed on individual task success, errors, efficiency (time on task), satisfaction (System Usability Scale [SUS]) and user characteristics. Results Tasks of exporting and correcting values proved the most difficult, had the most errors, the lowest task success rates, and consumed the longest times on task. The average SUS satisfaction score was 80.5, indicating good but not excellent system usability. Data trends showed males were more successful in task completion, and younger participants had higher performance scores. Educational level did not influence performance, but a more recent diabetes diagnosis did. Patients with more experience in information technology (IT) also had higher performance rates. Discussion Difficult task performance indicated areas for redesign. Our methods can assist others in identifying areas in need of improvement. Data about user background and IT skills also showed how user characteristics influence performance and can provide future considerations for targeted mHealth designs. Conclusion Using the ISO 9241-11 usability standard, the SUS instrument for satisfaction and measuring user characteristics provided objective measures of patients’ experienced usability. These could serve as an exemplar for standardized, quantitative methods for usability studies on mHealth systems. PMID:26377990

Virtual reality rehabilitation of balance: assessment of the usability of the Nintendo Wii(®) Fit Plus.

PubMed

Meldrum, Dara; Glennon, Aine; Herdman, Susan; Murray, Deirdre; McConn-Walsh, Rory

2012-05-01

The aim of this study was to investigate the usability of the Nintendo Wii Fit Plus(®) (NWFP) in the treatment of balance impairment in vestibular and other neurological disease. This was a cross-sectional, quasi-experimental study. Participants (n = 26; mean age 43 ± 14, M13:F13) with quantified balance impairment took part in a 30-minute session on the NWFP using exercises and games that challenge balance. Outcomes included the System Usability Scale (SUS), a numerical rating scale of enjoyment and a post treatment questionnaire. The mean SUS score was high (mean 82 ± 18%) with only two participants rating below 50%. There was a negative correlation of age with SUS scores (r = -0.54; p = 0.004). Mean numerical rating scale score (/10) for enjoyment of the NWFP session was 8.4 ± 3. Of the participants, 88.5% said that they would like to use the NWFP in future treatment. Seventy-three percent reported more enjoyment and motivation than usual physiotherapy. No falls occurred during testing. This study has quantified the usability of the NWFP as a treatment for balance impairment showing high levels of usability and enjoyment with no serious adverse effects. The results of this study may assist physiotherapists in devising novel balance rehabilitation programmes. [Box: see text].

A Novel Information Retrieval Tool to Find Hospital Care Team Members: Development and Usability Study.

PubMed

Morawski, Kyle; Monsen, Craig; Takhar, Sukhjit; Landman, Adam

2018-04-16

Hospital communication among members of a patient's care team is a central part of clinical workflow and consumes a large amount of a health care provider's time. Oftentimes the complexity of hospital care leads to difficulty in finding the appropriate contact, which can lead to inefficiencies and frustration. Squire is a Web-based information retrieval app created to improve the speed and efficiency in reaching the appropriate team member during the care of a hospitalized patient. The objective of the study was to design and develop Squire and to evaluate the usage, usability, and perceived effect of the app on finding the correct contact within a hospital. We used a mixed-methods design using a before-after survey methodology combined with one-on-one interviews to understand the perceived effect of Squire. The study took place at an academic medical center with internal medicine resident physicians. We surveyed residents on demographics, as well as time and efficiency of hospital communication before and after the use of Squire. After using Squire, participants were also asked to evaluate Squire's Net Promoter Score (NPS). A subset of voluntary participants participated in one-on-one interviews and completed the System Usability Scale (SUS). We performed descriptive statistics on participant characteristics, app usage data, and responses to surveys. Survey results were compared before and after Squire adoption using the Wilcoxon rank-sum test and a general linear model. Interview data were analyzed using content analysis with a qualitative description approach to review and categorize feedback from participants. There was a 67.9% (74/109) response rate to the pre-Squire survey and 89.9% (98/109) response rate to the post-Squire survey. At baseline, there was an average of 22.2 (95% CI 18.4-26.0) minutes/day spent searching for the right contact, and this decreased to 16.3 (95% CI 13.9-18.7) minutes/day after Squire was launched (P=.01). There were favorable usability scores, with an average SUS of 84.7, and a marginal NPS of +6.1. Overall, the use of Squire included 22,283 page views, most commonly to contact the admissions office or portable chest x-ray technician. Interviews highlighted common benefits of Squire, including decreased perceived time spent on hold with operators and improvement in connecting with the appropriate contact in specialized, complex departments. Future opportunities were also identified to improve Squire including adding a two-way communication between physician and nursing staff and providing offline access. Squire decreased the perceived time required to find an appropriate contact and had a favorable usability score; however, the NPS was marginal and several opportunities were identified to improve Squire for future use. ©Kyle Morawski, Craig Monsen, Sukhjit Takhar, Adam Landman. Originally published in JMIR Human Factors (http://humanfactors.jmir.org), 16.04.2018.

A usability evaluation of four commercial dental computer-based patient record systems

PubMed Central

Thyvalikakath, Thankam P.; Monaco, Valerie; Thambuganipalle, Hima Bindu; Schleyer, Titus

2008-01-01

Background The usability of dental computer-based patient record (CPR) systems has not been studied, despite early evidence that poor usability is a problem for dental CPR system users at multiple levels. Methods The authors conducted formal usability tests of four dental CPR systems by using a purposive sample of four groups of five novice users. The authors measured task outcomes (correctly completed, incorrectly completed and incomplete) in each CPR system while the participants performed nine clinical documentation tasks, as well as the number of usability problems identified in each CPR system and their potential relationship to task outcomes. The authors reviewed the software application design aspects responsible for these usability problems. Results The range for correctly completed tasks was 16 to 64 percent, for incorrectly completed tasks 18 to 38 percent and for incomplete tasks 9 to 47 percent. The authors identified 286 usability problems. The main types were three unsuccessful attempts, negative affect and task incorrectly completed. They also identified six problematic interface and interaction designs that led to usability problems. Conclusion The four dental CPR systems studied have significant usability problems for novice users, resulting in a steep learning curve and potentially reduced system adoption. Clinical Implications The significant number of data entry errors raises concerns about the quality of documentation in clinical practice. PMID:19047669

Using a fuzzy comprehensive evaluation method to determine product usability: A test case

PubMed Central

Zhou, Ronggang; Chan, Alan H. S.

2016-01-01

BACKGROUND: In order to take into account the inherent uncertainties during product usability evaluation, Zhou and Chan [1] proposed a comprehensive method of usability evaluation for products by combining the analytic hierarchy process (AHP) and fuzzy evaluation methods for synthesizing performance data and subjective response data. This method was designed to provide an integrated framework combining the inevitable vague judgments from the multiple stages of the product evaluation process. OBJECTIVE AND METHODS: In order to illustrate the effectiveness of the model, this study used a summative usability test case to assess the application and strength of the general fuzzy usability framework. To test the proposed fuzzy usability evaluation framework [1], a standard summative usability test was conducted to benchmark the overall usability of a specific network management software. Based on the test data, the fuzzy method was applied to incorporate both the usability scores and uncertainties involved in the multiple components of the evaluation. Then, with Monte Carlo simulation procedures, confidence intervals were used to compare the reliabilities among the fuzzy approach and two typical conventional methods combining metrics based on percentages. RESULTS AND CONCLUSIONS: This case study showed that the fuzzy evaluation technique can be applied successfully for combining summative usability testing data to achieve an overall usability quality for the network software evaluated. Greater differences of confidence interval widths between the method of averaging equally percentage and weighted evaluation method, including the method of weighted percentage averages, verified the strength of the fuzzy method. PMID:28035942

Using a fuzzy comprehensive evaluation method to determine product usability: A test case.

PubMed

Zhou, Ronggang; Chan, Alan H S

2017-01-01

In order to take into account the inherent uncertainties during product usability evaluation, Zhou and Chan [1] proposed a comprehensive method of usability evaluation for products by combining the analytic hierarchy process (AHP) and fuzzy evaluation methods for synthesizing performance data and subjective response data. This method was designed to provide an integrated framework combining the inevitable vague judgments from the multiple stages of the product evaluation process. In order to illustrate the effectiveness of the model, this study used a summative usability test case to assess the application and strength of the general fuzzy usability framework. To test the proposed fuzzy usability evaluation framework [1], a standard summative usability test was conducted to benchmark the overall usability of a specific network management software. Based on the test data, the fuzzy method was applied to incorporate both the usability scores and uncertainties involved in the multiple components of the evaluation. Then, with Monte Carlo simulation procedures, confidence intervals were used to compare the reliabilities among the fuzzy approach and two typical conventional methods combining metrics based on percentages. This case study showed that the fuzzy evaluation technique can be applied successfully for combining summative usability testing data to achieve an overall usability quality for the network software evaluated. Greater differences of confidence interval widths between the method of averaging equally percentage and weighted evaluation method, including the method of weighted percentage averages, verified the strength of the fuzzy method.

Overhead drilling: Comparing three bases for aligning a drilling jig to vertical

PubMed Central

Rempel, David; Star, Demetra; Barr, Alan; Janowitz, Ira

2010-01-01

Problem Drilling overhead into concrete or metal ceilings is a strenuous task done by construction workers to hang ductwork, piping, and electrical equipment. The task is associated with upper body pain and musculoskeletal disorders. Previously, we described a field usability evaluation of a foot lever and inverted drill press intervention devices that were compared to the usual method for overhead drilling. Both interventions were rated as inferior to the usual method based on poor setup time and mobility. Method Three new interventions, which differed on the design used for aligning the drilling column to vertical, were compared to the usual method for overhead drilling by commercial construction workers (n=16). Results The usual method was associated with the highest levels of regional body fatigue and the poorest usability ratings when compared to the three interventions. Conclusion Overall, the ‘Collar Base’ intervention design received the best usability ratings. Impact on Industry Intervention designs developed for overhead drilling may reduce shoulder fatigue and prevent subsequent musculoskeletal disorders. These designs may also be useful for other overhead work such as lifting and supporting materials (e.g., piping, ducts) that are installed near the ceiling. Workplace health and safety interventions may require multiple rounds of field-testing prior to achieving acceptable usability ratings by the end users. PMID:20630276

Do Perceptions of Insulin Pump Usability Impact Attitudes Toward Insulin Pump Therapy? A Pilot Study of Individuals With Type 1 and Insulin-Treated Type 2 Diabetes

PubMed Central

Gilgen, Emily

2014-01-01

Background: We assessed the impact of perceived insulin pump usability on attitudes toward insulin pump therapy in diabetic individuals currently treated with multiple daily insulin injections (MDI). Method: This comparative, single-arm study recruited 28 adults with type 1 (n = 16) and insulin-treated type 2 diabetes (n = 12) to evaluate 2 current insulin pumps: Medtronic Revel 723 (Pump 1), Asante Snap Insulin Pump (Pump 2). Participants were randomized 1:1 to 1 of 2 assessment sequences: Pump 1 followed by Pump 2; and Pump 2 followed by Pump 1. Structured observational protocols were utilized to assess participants’ ability and time required to learn/perform common tasks associated with pump setup/use. Participants used a modified version of the System Usability Scale (SUS) and investigator-developed questionnaires to rate pump usability and task difficulty; pre-post questionnaires assessed changes in attitudes toward insulin pump therapy. Results: All participants completed the study. SUS scores showed Pump 2 to be more usable than Pump 1 on all usability attributes. Participants rated Pump 2 more positively than Pump 1, overall mean SUS scores of 5.7 versus 4.1 respectively, F(1, 52) = 32.7, P < .001, and SUS scores were higher if participants used the Pump 2 last, 5.3 versus 4.4 for Pump 1 last, F(1, 52) = 10.8, P < .01. Pump 2 was preferred for all tasks: manual bolus (86%), bolus calculation (71%), managing basal rates (93%), interpreting alarms (96%), transferring settings (100%), changing insulin and infusion sets (93%), all P < .05. Conclusions: Perceptions of pump usability can directly impact acceptance and use of features that may benefit those who wear them. Simpler pump devices that decrease perceptions of complexity may encourage broader use of this technology. PMID:25269659

High usability of a smartphone application for reporting symptoms in adults with cystic fibrosis.

PubMed

Wood, Jamie; Jenkins, Sue; Putrino, David; Mulrennan, Siobhain; Morey, Sue; Cecins, Nola; Hill, Kylie

2017-01-01

Introduction In cystic fibrosis, exacerbations impair lung function and health-related quality of life, increase healthcare costs and reduce survival. Delayed reporting of worsening symptoms can result in more severe exacerbations and worse clinical outcomes; therefore there is a need for a novel approach to facilitate the early identification and treatment of exacerbations in this population. This study investigated the usability of a smartphone application to report symptoms in adults with cystic fibrosis, and the observer agreement in clinical decision-making between senior clinicians interpreting smartphone application responses. Methods Adults with cystic fibrosis used the smartphone application weekly for four weeks. The application comprised 10 yes/no questions regarding respiratory symptoms and two regarding emotional well-being. Usability was measured with the System Usability Scale; Observer agreement was tested by providing a cystic fibrosis physician and a nurse practitioner with 45 clinical scenarios. For each scenario the clinicians, who were blinded to each other's responses, were asked to indicate whether or not they would: (i) initiate telephone contact, and/or (ii) request a clinic visit for the individual. Results Ten participants (five female), aged mean (SD) 33 (11) years, FEV1 49 (27)% predicted completed the study. The mean (SD) System Usability Scale score was 94 (6). There was perfect agreement between clinicians for initiating contact with the participant ( κ = 1.0, p < 0.001), and near-perfect for requesting a clinic visit ( κ = 0.86, p < 0.001). Discussion The use of a smartphone application for reporting symptoms in adults with cystic fibrosis has excellent usability and near-perfect agreement between senior clinicians when interpreting the application responses.

Applying usability heuristics to radiotherapy systems.

PubMed

Chan, Alvita J; Islam, Mohammad K; Rosewall, Tara; Jaffray, David A; Easty, Anthony C; Cafazzo, Joseph A

2012-01-01

Heuristic evaluations have been used to evaluate safety of medical devices by identifying and assessing usability issues. Since radiotherapy treatment delivery systems often consist of multiple complex user-interfaces, a heuristic evaluation was conducted to assess the potential safety issues of such a system. A heuristic evaluation was conducted to evaluate the treatment delivery system at Princess Margaret Hospital (Toronto, Canada). Two independent evaluators identified usability issues with the user-interfaces and rated the severity of each issue. The evaluators identified 75 usability issues in total. Eighteen of them were rated as high severity, indicating the potential to have a major impact on patient safety. A majority of issues were found on the record and verify system, and many were associated with the patient setup process. While the hospital has processes in place to ensure patient safety, recommendations were developed to further mitigate the risks of potential consequences. Heuristic evaluation is an efficient and inexpensive method that can be successfully applied to radiotherapy delivery systems to identify usability issues and improve patient safety. Although this study was conducted only at one site, the findings may have broad implications for the design of these systems. Copyright © 2011 Elsevier Ireland Ltd. All rights reserved.

Mobile applications for diabetics: a systematic review and expert-based usability evaluation considering the special requirements of diabetes patients age 50 years or older.

PubMed

Arnhold, Madlen; Quade, Mandy; Kirch, Wilhelm

2014-04-09

A multitude of mhealth (mobile health) apps have been developed in recent years to support effective self-management of patients with diabetes mellitus type 1 or 2. We carried out a systematic review of all currently available diabetes apps for the operating systems iOS and Android. We considered the number of newly released diabetes apps, range of functions, target user groups, languages, acquisition costs, user ratings, available interfaces, and the connection between acquisition costs and user ratings. Additionally, we examined whether the available applications serve the special needs of diabetes patients aged 50 or older by performing an expert-based usability evaluation. We identified relevant keywords, comparative categories, and their specifications. Subsequently, we performed the app review based on the information given in the Google Play Store, the Apple App Store, and the apps themselves. In addition, we carried out an expert-based usability evaluation based on a representative 10% sample of diabetes apps. In total, we analyzed 656 apps finding that 355 (54.1%) offered just one function and 348 (53.0%) provided a documentation function. The dominating app language was English (85.4%, 560/656), patients represented the main user group (96.0%, 630/656), and the analysis of the costs revealed a trend toward free apps (53.7%, 352/656). The median price of paid apps was €1.90. The average user rating was 3.6 stars (maximum 5). Our analyses indicated no clear differences in the user rating between free and paid apps. Only 30 (4.6%) of the 656 available diabetes apps offered an interface to a measurement device. We evaluated 66 apps within the usability evaluation. On average, apps were rated best regarding the criterion "comprehensibility" (4.0 out of 5.0), while showing a lack of "fault tolerance" (2.8 out of 5.0). Of the 66 apps, 48 (72.7%) offered the ability to read the screen content aloud. The number of functions was significantly negative correlated with usability. The presence of documentation and analysis functions reduced the usability score significantly by 0.36 and 0.21 points. A vast number of diabetes apps already exist, but the majority offer similar functionalities and combine only one to two functions in one app. Patients and physicians alike should be involved in the app development process to a greater extent. We expect that the data transmission of health parameters to physicians will gain more importance in future applications. The usability of diabetes apps for patients aged 50 or older was moderate to good. But this result applied mainly to apps offering a small range of functions. Multifunctional apps performed considerably worse in terms of usability. Moreover, the presence of a documentation or analysis function resulted in significantly lower usability scores. The operability of accessibility features for diabetes apps was quite limited, except for the feature "screen reader".

Staples.com: Focus on Usability.

ERIC Educational Resources Information Center

McCann, Tom; Hynes, Colin

2002-01-01

Describes the Staples.com electronic commerce Web site; discusses its steady growth rate; and details two case studies in which data from a variety of sources were used to identify and resolve site usability issues and which are supported by compelling ROI (return on investment) figures. (Author/LRW)

Consumers' Patient Portal Preferences and Health Literacy: A Survey Using Crowdsourcing.

PubMed

Zide, Mary; Caswell, Kaitlyn; Peterson, Ellen; Aberle, Denise R; Bui, Alex At; Arnold, Corey W

2016-06-08

eHealth apps have the potential to meet the information needs of patient populations and improve health literacy rates. However, little work has been done to document perceived usability of portals and health literacy of specific topics. Our aim was to establish a baseline of lung cancer health literacy and perceived portal usability. A survey based on previously validated instruments was used to assess a baseline of patient portal usability and health literacy within the domain of lung cancer. The survey was distributed via Amazon's Mechanical Turk to 500 participants. Our results show differences in preferences and literacy by demographic cohorts, with a trend of chronically ill patients having a more positive reception of patient portals and a higher health literacy rate of lung cancer knowledge (P<.05). This article provides a baseline of usability needs and health literacy that suggests that chronically ill patients have a greater preference for patient portals and higher level of health literacy within the domain of lung cancer.

Usability Evaluation of Clinical Guidelines on the Web Using Eye-Tracker.

PubMed

Khodambashi, Soudabeh; Gilstad, Heidi; Nytrø, Øystein

2016-01-01

Publishing clinical guidelines (GLs) on the web increases their accessibility. However, evaluating their usability and understanding how users interact with the websites has been neglected. In this study we used Tobii eye-tracker to analyse users' interaction with five commercial and public GL sites popular in Norway (four in Norwegian and one English of US origin (UpToDate)). We measured number of clicks and usage rate for search functions, task completion time, users' objective and perception of task success rate. We also measured learning effect for inexperienced users. We found a direct correlation between participant's satisfaction regarding website usability and the time spent, number of mouse clicks and use of search function to obtain the desired results. Our study showed that users' perceived success rate was not reliable and GL publishers should evaluate their website regarding presentation format, layout, navigation bar and search function.

Developing Analytical Inspection Criteria for Health IT Personnel with Minimum Training in Cognitive Ergonomics: A Practical Solution to EHR Improving EHR Usability

PubMed Central

Zhang, Zhen; Franklin, Amy; Walji, Muhammad; Zhang, Jiajie; Gong, Yang

2014-01-01

EHR usability has been identified as a major barrier to care quality optimization. One major challenge of improving EHR usability is the lack of systematic training in usability or cognitive ergonomics for EHR designers/developers in the vendor community and EHR analysts making significant configurations in healthcare organizations. A practical solution is to provide usability inspection tools that can be easily operationalized by EHR analysts. This project is aimed at developing a set of usability tools with demonstrated validity and reliability. We present a preliminary study of a metric for cognitive transparency and an exploratory experiment testing its validity in predicting the effectiveness of action-effect mapping. Despite the pilot nature of both, we found high sensitivity and specificity of the metric and higher response accuracy within a shorter time for users to determine action-effect mappings in transparent user interface controls. We plan to expand the sample size in our empirical study. PMID:25954439

A Method for Automated Detection of Usability Problems from Client User Interface Events

PubMed Central

Saadawi, Gilan M.; Legowski, Elizabeth; Medvedeva, Olga; Chavan, Girish; Crowley, Rebecca S.

2005-01-01

Think-aloud usability analysis provides extremely useful data but is very time-consuming and expensive to perform because of the extensive manual video analysis that is required. We describe a simple method for automated detection of usability problems from client user interface events for a developing medical intelligent tutoring system. The method incorporates (1) an agent-based method for communication that funnels all interface events and system responses to a centralized database, (2) a simple schema for representing interface events and higher order subgoals, and (3) an algorithm that reproduces the criteria used for manual coding of usability problems. A correction factor was empirically determining to account for the slower task performance of users when thinking aloud. We tested the validity of the method by simultaneously identifying usability problems using TAU and manually computing them from stored interface event data using the proposed algorithm. All usability problems that did not rely on verbal utterances were detectable with the proposed method. PMID:16779121

Evaluating input device usability as a function of task difficulty in a tracking task.

PubMed

Rupp, Michael A; Oppold, Paul; McConnell, Daniel S

2015-01-01

Game controllers are emerging as a preferred choice for the manual control of unmanned vehicles, but an understanding of their usability characteristics has yet to emerge. We compared the usability of an Xbox 360 game controller in a dual task situation using MATB II to the traditional joystick and keyboard interface in two experiments. In the first experiment, performance with the game controller was associated with fewer tracking errors. In a second experiment, we trained users on the devices, and found that even after training the game controller was still associated with fewer tracking errors as well as higher usability and lower workload ratings. These results are consistent with the idea that game controllers are highly usable input devices and do not require high mental workload to operate, thus making them suitable for complex control tasks.

Feasibility of an Electronic Survey on iPads with In-Person Data Collectors for Data Collection with Health Care Professionals and Health Care Consumers in General Emergency Departments.

PubMed

Scott, Shannon D; Albrecht, Lauren; Given, Lisa M; Arseneau, Danielle; Klassen, Terry P

2016-06-29

Translating Emergency Knowledge for Kids was established to bridge the research-practice gap in pediatric emergency care by bringing the best evidence to Canadian general emergency departments (EDs). The first step in this process was to conduct a national needs assessment to determine the information needs and preferences of health professionals and parents in this clinical setting. To describe the development and implementation of two electronic surveys, and determine the feasibility of collecting electronic survey data on iPads with in-person data collectors in a busy clinical environment. Two descriptive surveys were conducted in 32 general EDs. Specific factors were addressed in four survey development and implementation stages: survey design, survey delivery, survey completion, and survey return. Feasibility of the data collection approach was determined by evaluating participation rates, completion rates, average survey time to completion, and usability of the platform. Usability was assessed with the in-person data collectors on five key variables: interactivity, portability, innovativeness, security, and proficiency. Health professional participation rates (1561/2575, 60.62%) and completion rates (1471/1561, 94.23%) were strong. Parental participation rates (974/1099, 88.63%) and completion rates (897/974, 92.09%) were excellent. Mean time to survey completion was 28.08 minutes for health professionals and 43.23 minutes for parents. Data collectors rated the platform "positively" to "very positively" on all five usability variables. A number of design and implementation considerations were explored and integrated into this mixed-mode survey data collection approach. Feasibility was demonstrated by the robust survey participation and completion rates, reasonable survey completion times, and very positive usability evaluation results.

Comparison of four different mobile devices for measuring heart rate and ECG with respect to aspects of usability and acceptance by older people.

PubMed

Ehmen, Hilko; Haesner, Marten; Steinke, Ines; Dorn, Mario; Gövercin, Mehmet; Steinhagen-Thiessen, Elisabeth

2012-05-01

In the area of product design and usability, most products are developed for the mass-market by technically oriented designers and developers for use by persons who themselves are also technically adept by today's standards. The demands of older people are commonly not given sufficient consideration within the early developmental process. In the present study, the usability and acceptability of four different devices meant to be worn for the measurement of heart rate or ECG were analyzed on the basis of qualitative subjective user ratings and structured interviews of twelve older participants. The data suggest that there was a relatively high acceptance concerning these belts by older adults but none of the four harnesses was completely usable. Especially problematic to the point of limiting satisfaction among older subjects were problems encountered while adjusting the length of the belt and/or closing the locking mechanism. The two devices intended for dedicated heart rate recording yielded the highest user ratings for design, and were clearly preferred for extended wearing time. Yet for all the devices participants identified several important deficiencies in their design, as well as suggestions for improvement. We conclude that the creation of an acceptable monitoring device for older persons requires designers and developers to consider the special demands and abilities of the target group. Copyright © 2011 Elsevier Ltd and The Ergonomics Society. All rights reserved.

Factors affecting the innovative practice of nurse managers in health organisations.

PubMed

Williams, Lindy; McMurray, Adela J

This exploratory study reports on two surveys conducted in metropolitan and rural health organisations. Two questionnaires consisting of open and closed questions were distributed to a total of 340 respondents resulting in 176 usable responses, yielding a response rate of 53%. The findings revealed that nurse managers require fairness, trust, recognition, supervisory encouragement, organisational support, and reward for efforts. These are key aspects of organisational climate, which support innovative practice. Experience and innovation were significantly related and other factors such as, management structures and management styles, also had an impact on nurse managers' ability to exhibit innovative behaviour in the 21st Century workplace.

Development of a web-based executive functioning intervention for adolescents with epilepsy: The Epilepsy Journey.

PubMed

Modi, Avani C; Schmidt, Matthew; Smith, Aimee W; Turnier, Luke; Glaser, Noah; Wade, Shari L

2017-07-01

Youth with epilepsy exhibit significant deficits in executive functioning (EF), yet there are few interventions to improve EF for adolescents. The aims of the current study were to develop an individually-tailored intervention, called Epilepsy Journey, to improve aspects of EF through an iterative, patient-centered process including focus groups and usability testing. Five adolescents and caregivers participated in focus groups. This input was used to develop ten learning modules based on subscales of the Behavioral Rating Inventory of Executive Functions and key issues that may impact EF in adolescents. Six adolescents participated in usability testing and a usability expert conducted a heuristic evaluation. Demographic information, chart reviews and measures of EF were also completed. Focus group participants and their parents reported difficulties with memory, attention, organization, monitoring, initiation, impulsivity, emotional control, sleep, awareness in schools and managing stress. They also identified successful strategies to address memory and organizational difficulties. Usability testing of the resultant Epilepsy Journey modules revealed problems with navigation and identified features that promoted usability, including progress bars and interactive modules. Program modifications were made after each usability trial resulting in a relatively brief, interactive and readily navigable program. Perceived utility was high with all but one participant. Participants rated the content as helpful and indicated they would recommend Epilepsy Journey to others. Feedback from the focus group and usability testing yielded a feasible, acceptable, relevant and user-friendly web-based intervention for adolescents with epilepsy. The Epilepsy Journey program will be further tested in an open pilot with adolescents with epilepsy and associated EF deficits. Copyright © 2017 Elsevier Inc. All rights reserved.

Written online situational feedback via mobile phone to support self-management of chronic widespread pain: a usability study of a Web-based intervention

PubMed Central

2011-01-01

Background This pretrial study aimed to develop and test the usability of a four-week Internet intervention delivered by a Web-enabled mobile phone to support self-management of chronic widespread pain. Methods The intervention included daily online entries and individualized written feedback, grounded in a mindfulness-based cognitive behavioral approach. The participants registered activities, emotions and pain cognitions three times daily using the mobile device. The therapist had immediate access to this information through a secure Web site. The situational information was used to formulate and send a personalized text message to the participant with the aim of stimulating effective self-management of the current situation. Six women participated and evaluated the experience. Results The intervention was rated as supportive, meaningful and user-friendly by the majority of the women. The response rate to the daily registration entries was high and technical problems were few. Conclusion The results indicate a feasible intervention. Web-applications are fast becoming standard features of mobile phones and interventions of this kind can therefore be more available than before. Trial registration number ClinicalTrials.gov: NCT01236209 PMID:21352516

Effect of font size, italics, and colour count on web usability.

PubMed

Bhatia, Sanjiv K; Samal, Ashok; Rajan, Nithin; Kiviniemi, Marc T

2011-04-01

Web usability measures the ease of use of a website. This study attempts to find the effect of three factors - font size, italics, and colour count - on web usability. The study was performed using a set of tasks and developing a survey questionnaire. We performed the study using a set of human subjects, selected from the undergraduate students taking courses in psychology. The data computed from the tasks and survey questionnaire were statistically analysed to find if there was any effect of font size, italics, and colour count on the three web usability dimensions. We found that for the student population considered, there was no significant effect of font size on usability. However, the manipulation of italics and colour count did influence some aspects of usability. The subjects performed better for pages with no italics and high italics compared to moderate italics. The subjects rated the pages that contained only one colour higher than the web pages with four or six colours. This research will help web developers better understand the effect of font size, italics, and colour count on web usability in general, and for young adults, in particular.

Effect of font size, italics, and colour count on web usability

PubMed Central

Samal, Ashok; Rajan, Nithin; Kiviniemi, Marc T.

2013-01-01

Web usability measures the ease of use of a website. This study attempts to find the effect of three factors – font size, italics, and colour count – on web usability. The study was performed using a set of tasks and developing a survey questionnaire. We performed the study using a set of human subjects, selected from the undergraduate students taking courses in psychology. The data computed from the tasks and survey questionnaire were statistically analysed to find if there was any effect of font size, italics, and colour count on the three web usability dimensions. We found that for the student population considered, there was no significant effect of font size on usability. However, the manipulation of italics and colour count did influence some aspects of usability. The subjects performed better for pages with no italics and high italics compared to moderate italics. The subjects rated the pages that contained only one colour higher than the web pages with four or six colours. This research will help web developers better understand the effect of font size, italics, and colour count on web usability in general, and for young adults, in particular. PMID:24358055

Monitoring dietary intake and physical activity electronically: feasibility, usability, and ecological validity of a mobile-based Ecological Momentary Assessment tool.

PubMed

Spook, Jorinde Eline; Paulussen, Theo; Kok, Gerjo; Van Empelen, Pepijn

2013-09-24

Despite the growing body of research on complex lifestyle behaviors (eg, Dietary Intake [DI] and Physical Activity [PA]), monitoring of these behaviors has been hampered by a lack of suitable methods. A possible solution to this deficiency is mobile-based Ecological Momentary Assessment (mEMA), which enables researchers to collect data on participants' states in real-time by means of a smartphone application. However, feasibility, usability, and ecological validity need to be anticipated and managed in order to enhance the validity of mEMA. To examine the feasibility, usability, and ecological validity of a mEMA application (app) with regard to DI and PA among Dutch vocational education students. The students (n=30) participated in the mEMA study for seven consecutive days. They downloaded the mEMA app on their smartphone. Feasibility and usability of the mEMA app were evaluated by completing an online evaluation after seven days of participation. Ecological validity was measured by assessing the degree to which the content of the mEMA app approximated the real-world setting that was being examined, through several multiple-choice questions. Compliance rates, as registered by the mEMA app, declined 46% over a seven-day period, while self-reported compliance, as measured with an online evaluation questionnaire afterwards, indicated a smaller decrease in compliance (29%). The students evaluated the mEMA app as feasible and usable. Ecological validity analyses showed that all DI and almost all PA multiple-choice options were covered with the compound response categories. The mEMA app offers the opportunity to assess complex health behaviors (eg, DI and PA) in real-time settings, in which specifically routinized behaviors are involved. However, the mEMA app faced several challenges that needed to be overcome in order to improve its validity. Overall, the present study showed that the mEMA app is a usable and ecologically valid tool to measure DI and PA behaviors among vocational education students, but compliance is still limited.

Mobile Applications for Diabetics: A Systematic Review and Expert-Based Usability Evaluation Considering the Special Requirements of Diabetes Patients Age 50 Years or Older

PubMed Central

Quade, Mandy; Kirch, Wilhelm

2014-01-01

Background A multitude of mhealth (mobile health) apps have been developed in recent years to support effective self-management of patients with diabetes mellitus type 1 or 2. Objective We carried out a systematic review of all currently available diabetes apps for the operating systems iOS and Android. We considered the number of newly released diabetes apps, range of functions, target user groups, languages, acquisition costs, user ratings, available interfaces, and the connection between acquisition costs and user ratings. Additionally, we examined whether the available applications serve the special needs of diabetes patients aged 50 or older by performing an expert-based usability evaluation. Methods We identified relevant keywords, comparative categories, and their specifications. Subsequently, we performed the app review based on the information given in the Google Play Store, the Apple App Store, and the apps themselves. In addition, we carried out an expert-based usability evaluation based on a representative 10% sample of diabetes apps. Results In total, we analyzed 656 apps finding that 355 (54.1%) offered just one function and 348 (53.0%) provided a documentation function. The dominating app language was English (85.4%, 560/656), patients represented the main user group (96.0%, 630/656), and the analysis of the costs revealed a trend toward free apps (53.7%, 352/656). The median price of paid apps was €1.90. The average user rating was 3.6 stars (maximum 5). Our analyses indicated no clear differences in the user rating between free and paid apps. Only 30 (4.6%) of the 656 available diabetes apps offered an interface to a measurement device. We evaluated 66 apps within the usability evaluation. On average, apps were rated best regarding the criterion “comprehensibility” (4.0 out of 5.0), while showing a lack of “fault tolerance” (2.8 out of 5.0). Of the 66 apps, 48 (72.7%) offered the ability to read the screen content aloud. The number of functions was significantly negative correlated with usability. The presence of documentation and analysis functions reduced the usability score significantly by 0.36 and 0.21 points. Conclusions A vast number of diabetes apps already exist, but the majority offer similar functionalities and combine only one to two functions in one app. Patients and physicians alike should be involved in the app development process to a greater extent. We expect that the data transmission of health parameters to physicians will gain more importance in future applications. The usability of diabetes apps for patients aged 50 or older was moderate to good. But this result applied mainly to apps offering a small range of functions. Multifunctional apps performed considerably worse in terms of usability. Moreover, the presence of a documentation or analysis function resulted in significantly lower usability scores. The operability of accessibility features for diabetes apps was quite limited, except for the feature “screen reader”. PMID:24718852

An investigation of the efficacy of collaborative virtual reality systems for moderated remote usability testing.

PubMed

Chalil Madathil, Kapil; Greenstein, Joel S

2017-11-01

Collaborative virtual reality-based systems have integrated high fidelity voice-based communication, immersive audio and screen-sharing tools into virtual environments. Such three-dimensional collaborative virtual environments can mirror the collaboration among usability test participants and facilitators when they are physically collocated, potentially enabling moderated usability tests to be conducted effectively when the facilitator and participant are located in different places. We developed a virtual collaborative three-dimensional remote moderated usability testing laboratory and employed it in a controlled study to evaluate the effectiveness of moderated usability testing in a collaborative virtual reality-based environment with two other moderated usability testing methods: the traditional lab approach and Cisco WebEx, a web-based conferencing and screen sharing approach. Using a mixed methods experimental design, 36 test participants and 12 test facilitators were asked to complete representative tasks on a simulated online shopping website. The dependent variables included the time taken to complete the tasks; the usability defects identified and their severity; and the subjective ratings on the workload index, presence and satisfaction questionnaires. Remote moderated usability testing methodology using a collaborative virtual reality system performed similarly in terms of the total number of defects identified, the number of high severity defects identified and the time taken to complete the tasks with the other two methodologies. The overall workload experienced by the test participants and facilitators was the least with the traditional lab condition. No significant differences were identified for the workload experienced with the virtual reality and the WebEx conditions. However, test participants experienced greater involvement and a more immersive experience in the virtual environment than in the WebEx condition. The ratings for the virtual environment condition were not significantly different from those for the traditional lab condition. The results of this study suggest that participants were productive and enjoyed the virtual lab condition, indicating the potential of a virtual world based approach as an alternative to conventional approaches for synchronous usability testing. Copyright © 2017 Elsevier Ltd. All rights reserved.

Usability test of an internet-based informatics tool for diabetes care providers: the comprehensive diabetes management program.

PubMed

Fonda, Stephanie J; Paulsen, Christine A; Perkins, Joan; Kedziora, Richard J; Rodbard, David; Bursell, Sven-Erik

2008-02-01

Research suggests Internet-based care management tools are associated with improvements in care and patient outcomes. However, although such tools change workflow, rarely is their usability addressed and reported. This article presents a usability study of an Internet-based informatics application called the Comprehensive Diabetes Management Program (CDMP), developed by content experts and technologists. Our aim is to demonstrate a process for conducting a usability study of such a tool and to report results. We conducted the usability test with six diabetes care providers under controlled conditions. Each provider worked with the CDMP in a single session using a "think aloud" process. Providers performed standardized tasks with fictitious patient data, and we observed how they approached these tasks, documenting verbalizations and subjective ratings. The providers then completed a usability questionnaire and interviews. Overall, the scores on the usability questionnaire were neutral to favorable. For specific subdomains of the questionnaire, the providers' reported problems with the application's ease of use, performance, and support features, but were satisfied with its visual appeal and content. The results from the observational and interview data indicated areas for improvement, particularly in navigation and terminology. The usability study identified several issues for improvement, confirming the need for usability testing of Internet-based informatics applications, even those developed by experts. To our knowledge, there have been no other usability studies of an Internet-based informatics application with the functionality of the CDMP. Such studies can form the foundation for translation of Internet-based medical informatics tools into clinical practice.

Evaluating a Web-Based Interface for Internet Telemedicine

NASA Technical Reports Server (NTRS)

Lathan, Corinna E.; Newman, Dava J.; Sebrechts, Marc M.; Doarn, Charles R.

1997-01-01

The objective is to introduce the usability engineering methodology, heuristic evaluation, to the design and development of a web-based telemedicine system. Using a set of usability criteria, or heuristics, one evaluator examined the Spacebridge to Russia web-site for usability problems. Thirty-four usability problems were found in this preliminary study and all were assigned a severity rating. The value of heuristic analysis in the iterative design of a system is shown because the problems can be fixed before deployment of a system and the problems are of a different nature than those found by actual users of the system. It was therefore determined that there is potential value of heuristic evaluation paired with user testing as a strategy for optimal system performance design.

Investigating the Usability of Classroom Management Strategies among Elementary Schoolteachers

ERIC Educational Resources Information Center

Briesch, Amy M.; Briesch, Jacquelyn M.; Chafouleas, Sandra M.

2015-01-01

Although teachers are often asked to implement classroom interventions to address student behavior, little is known about their perceived usability of many evidence-based strategies. One thousand five elementary schoolteachers completed the Usage Rating Profile-Intervention-Revised (URP-IR) with regard to the use of one of five evidence-based…

Assessment of the usability and impact of the Idaho Health Data Exchange (IHDE).

PubMed

Reis, Janet; MacKenzie, Lisa; Soelberg, Terri; Smith, Jennifer

2016-04-01

Eighty four health care professionals participated in an online survey assessing the usability, and clinical and administrative impact of the Idaho Health Data Exchange's (IHDE) Virtual Health Record (VHR). The IHDE VHR allows authorized users to use a secure web interface to view lab, radiology and transcribed reports from multiple facilities and view medical histories on patients in the data exchange. Results indicate the usability of the IHDE VHR was almost universally positively rated with the Software Usability Measurement Inventory (SUMI) utilized as the assessment method. Medical providers however had the lowest rating of the exchange, raising concerns about the need for additional training and support. The addition of other Idaho health care organizations to the health data exchange was most widely desired, with the most frequently cited benefit being more comprehensive access to patients' records. In contrast to other published evaluations of health data exchanges in the U.S., few of the concerns emerged about cost of implementation of the data exchange or trust in the quality of information contained therein.

The influence of socio-cultural background and product value in usability testing.

PubMed

Sonderegger, Andreas; Sauer, Juergen

2013-05-01

This article examines the influence of socio-cultural background and product value on different outcomes of usability tests. A study was conducted in two different socio-cultural regions, Switzerland and East Germany, which differed in a number of aspects (e.g. economic power, price sensitivity and culture). Product value (high vs. low) was varied by manipulating the price of the product. Sixty-four test participants were asked to carry out five typical user tasks in the context of coffee machine usage, measuring performance, perceived usability, and emotion. The results showed that in Switzerland, high-value products were rated higher in usability than low-value products whereas in East Germany, high-value products were evaluated lower in usability. A similar interaction effect of socio-cultural background and product value was observed for user emotion. Implications are that the outcomes of usability tests do not allow for a simple transfer across cultures and that the mediating influence of perceived product value needs to be taken into consideration. Copyright © 2012 Elsevier Ltd and The Ergonomics Society. All rights reserved.

Designing Real-time Decision Support for Trauma Resuscitations

PubMed Central

Yadav, Kabir; Chamberlain, James M.; Lewis, Vicki R.; Abts, Natalie; Chawla, Shawn; Hernandez, Angie; Johnson, Justin; Tuveson, Genevieve; Burd, Randall S.

2016-01-01

Background Use of electronic clinical decision support (eCDS) has been recommended to improve implementation of clinical decision rules. Many eCDS tools, however, are designed and implemented without taking into account the context in which clinical work is performed. Implementation of the pediatric traumatic brain injury (TBI) clinical decision rule at one Level I pediatric emergency department includes an electronic questionnaire triggered when ordering a head computed tomography using computerized physician order entry (CPOE). Providers use this CPOE tool in less than 20% of trauma resuscitation cases. A human factors engineering approach could identify the implementation barriers that are limiting the use of this tool. Objectives The objective was to design a pediatric TBI eCDS tool for trauma resuscitation using a human factors approach. The hypothesis was that clinical experts will rate a usability-enhanced eCDS tool better than the existing CPOE tool for user interface design and suitability for clinical use. Methods This mixed-methods study followed usability evaluation principles. Pediatric emergency physicians were surveyed to identify barriers to using the existing eCDS tool. Using standard trauma resuscitation protocols, a hierarchical task analysis of pediatric TBI evaluation was developed. Five clinical experts, all board-certified pediatric emergency medicine faculty members, then iteratively modified the hierarchical task analysis until reaching consensus. The software team developed a prototype eCDS display using the hierarchical task analysis. Three human factors engineers provided feedback on the prototype through a heuristic evaluation, and the software team refined the eCDS tool using a rapid prototyping process. The eCDS tool then underwent iterative usability evaluations by the five clinical experts using video review of 50 trauma resuscitation cases. A final eCDS tool was created based on their feedback, with content analysis of the evaluations performed to ensure all concerns were identified and addressed. Results Among 26 EPs (76% response rate), the main barriers to using the existing tool were that the information displayed is redundant and does not fit clinical workflow. After the prototype eCDS tool was developed based on the trauma resuscitation hierarchical task analysis, the human factors engineers rated it to be better than the CPOE tool for nine of 10 standard user interface design heuristics on a three-point scale. The eCDS tool was also rated better for clinical use on the same scale, in 84% of 50 expert–video pairs, and was rated equivalent in the remainder. Clinical experts also rated barriers to use of the eCDS tool as being low. Conclusions An eCDS tool for diagnostic imaging designed using human factors engineering methods has improved perceived usability among pediatric emergency physicians. PMID:26300010

Cost comparison of re-usable and single-use fibrescopes in a large English teaching hospital.

PubMed

McCahon, R A; Whynes, D K

2015-06-01

A number of studies in the U.S.A. and mainland Europe have described the costs of fibreoptic tracheal intubation. However, no such data from the UK appear available. We performed a cost assessment of fibreoptic intubation, using re-usable (various devices from Olympus, Acutronic and Karl Storz) and single-use (Ambu aScope) fibrescopes, at the Queens Medical Centre, Nottingham, U.K., between 1 January 2009 and 31 March 2014. The total annual cost of fibreoptic intubation with re-usable fibrescopes was £46,385. Based on 141 fibreoptic intubations per year, this equated to £329 per use, an average dominated by repair/maintenance costs (43%) and capital depreciation costs (42%). In comparison, the total annual cost of using single-use fibrescopes for the same work would have been around £200 per use. The analysis enabled us to develop a generic model, wherein we were able to describe the relationship between total cost of use vs number of uses for a fibrescope. An 'isopleth' was identified for this relationship: a line that joined all the points where the cost of re-usable vs single-use fibrescopes was equal. It appears cheaper to use single-use fibrescopes at up to 200 fibreoptic intubations per year (a range commensurate with normal practice) even when the repair rate for re-usable fibrescopes is low. Any centre, knowing its fibrescope use and repair rate, can plot its data similarly to help ascertain which of the re-usable or single-use fibrescope represents better value. © 2015 The Association of Anaesthetists of Great Britain and Ireland.

Usability of a real-time tracked augmented reality display system in musculoskeletal injections

NASA Astrophysics Data System (ADS)

Baum, Zachary; Ungi, Tamas; Lasso, Andras; Fichtinger, Gabor

2017-03-01

PURPOSE: Image-guided needle interventions are seldom performed with augmented reality guidance in clinical practice due to many workspace and usability restrictions. We propose a real-time optically tracked image overlay system to make image-guided musculoskeletal injections more efficient and assess its usability in a bed-side clinical environment. METHODS: An image overlay system consisting of an optically tracked viewbox, tablet computer, and semitransparent mirror allows users to navigate scanned patient volumetric images in real-time using software built on the open-source 3D Slicer application platform. A series of experiments were conducted to evaluate the latency and screen refresh rate of the system using different image resolutions. To assess the usability of the system and software, five medical professionals were asked to navigate patient images while using the overlay and completed a questionnaire to assess the system. RESULTS: In assessing the latency of the system with scanned images of varying size, screen refresh rates were approximately 5 FPS. The study showed that participants found using the image overlay system easy, and found the table-mounted system was significantly more usable and effective than the handheld system. CONCLUSION: It was determined that the system performs comparably with scanned images of varying size when assessing the latency of the system. During our usability study, participants preferred the table-mounted system over the handheld. The participants also felt that the system itself was simple to use and understand. With these results, the image overlay system shows promise for use in a clinical environment.

Satisfaction with web-based training in an integrated healthcare delivery network: do age, education, computer skills and attitudes matter?

PubMed Central

Atreja, Ashish; Mehta, Neil B; Jain, Anil K; Harris, CM; Ishwaran, Hemant; Avital, Michel; Fishleder, Andrew J

2008-01-01

Background Healthcare institutions spend enormous time and effort to train their workforce. Web-based training can potentially streamline this process. However the deployment of web-based training in a large-scale setting with a diverse healthcare workforce has not been evaluated. The aim of this study was to evaluate the satisfaction of healthcare professionals with web-based training and to determine the predictors of such satisfaction including age, education status and computer proficiency. Methods Observational, cross-sectional survey of healthcare professionals from six hospital systems in an integrated delivery network. We measured overall satisfaction to web-based training and response to survey items measuring Website Usability, Course Usefulness, Instructional Design Effectiveness, Computer Proficiency and Self-learning Attitude. Results A total of 17,891 healthcare professionals completed the web-based training on HIPAA Privacy Rule; and of these, 13,537 completed the survey (response rate 75.6%). Overall course satisfaction was good (median, 4; scale, 1 to 5) with more than 75% of the respondents satisfied with the training (rating 4 or 5) and 65% preferring web-based training over traditional instructor-led training (rating 4 or 5). Multivariable ordinal regression revealed 3 key predictors of satisfaction with web-based training: Instructional Design Effectiveness, Website Usability and Course Usefulness. Demographic predictors such as gender, age and education did not have an effect on satisfaction. Conclusion The study shows that web-based training when tailored to learners' background, is perceived as a satisfactory mode of learning by an interdisciplinary group of healthcare professionals, irrespective of age, education level or prior computer experience. Future studies should aim to measure the long-term outcomes of web-based training. PMID:18922178

Usability Evaluation of Laboratory Information Systems.

PubMed

Mathews, Althea; Marc, David

2017-01-01

Numerous studies have revealed widespread clinician frustration with the usability of electronic health records (EHRs) that is counterproductive to adoption of EHR systems to meet the aims of health-care reform. With poor system usability comes increased risk of negative unintended consequences. Usability issues could lead to user error and workarounds that have the potential to compromise patient safety and negatively impact the quality of care.[1] While there is ample research on EHR usability, there is little information on the usability of laboratory information systems (LISs). Yet, LISs facilitate the timely provision of a great deal of the information needed by physicians to make patient care decisions.[2] Medical and technical advances in genomics that require processing of an increased volume of complex laboratory data further underscore the importance of developing user-friendly LISs. This study aims to add to the body of knowledge on LIS usability. A survey was distributed among LIS users at hospitals across the United States. The survey consisted of the ten-item System Usability Scale (SUS). In addition, participants were asked to rate the ease of performing 24 common tasks with a LIS. Finally, respondents provided comments on what they liked and disliked about using the LIS to provide diagnostic insight into LIS perceived usability. The overall mean SUS score of 59.7 for the LIS evaluated is significantly lower than the benchmark of 68 ( P < 0.001). All LISs evaluated received mean SUS scores below 68 except for Orchard Harvest (78.7). While the years of experience using the LIS was found to be a statistically significant influence on mean SUS scores, the combined effect of years of experience and LIS used did not account for the statistically significant difference in the mean SUS score between Orchard Harvest and each of the other LISs evaluated. The results of this study indicate that overall usability of LISs is poor. Usability lags that of systems evaluated across 446 usability surveys.

Beyond qualitative and subjective techniques to assess usability of banking interfaces for senior citizens.

PubMed

Laparra-Hernández, José; Medina, Enric; Sancho, María; Soriano, Carolina; Durá, Juanvi; Barberà-Guillem, Ricard; Poveda-Puente, Rakel

2015-01-01

Senior citizens can benefit from banking services but the lack of usability hampers this possibility. New approaches based on physiological response, eye tracking and user movement analysis can provide more information during interface interaction. This research shows the differences depending on user knowledge and use of technology, gender and type of interface.

Design and usability evaluation of user-centered and visual-based aids for dietary food measurement on mobile devices in a randomized controlled trial.

PubMed

Liu, Ying-Chieh; Chen, Chien-Hung; Lee, Chien-Wei; Lin, Yu-Sheng; Chen, Hsin-Yun; Yeh, Jou-Yin; Chiu, Sherry Yueh-Hsia

2016-12-01

We designed and developed two interactive apps interfaces for dietary food measurements on mobile devices. The user-centered designs of both the IPI (interactive photo interface) and the SBI (sketching-based interface) were evaluated. Four types of outcomes were assessed to evaluate the usability of mobile devices for dietary measurements, including accuracy, absolute weight differences, and the response time to determine the efficacy of food measurements. The IPI presented users with images of pre-determined portion sizes of a specific food and allowed users to scan and then select the most representative image matching the food that they were measuring. The SBI required users to relate the food shape to a readily available comparator (e.g., credit card) and scribble to shade in the appropriate area. A randomized controlled trial was conducted to evaluate their usability. A total of 108 participants were randomly assigned into the following three groups: the IPI (n=36) and SBI (n=38) experimental groups and the traditional life-size photo (TLP) group as the control. A total of 18 types of food items with 3-4 different weights were randomly selected for assessment by each type. The independent Chi-square test and t-test were performed for the dichotomous and continuous variable analyses, respectively. The total accuracy rates were 66.98%, 44.15%, and 72.06% for the IPI, SBI, and TLP, respectively. No significant difference was observed between the IPI and TLP, regardless of the accuracy proportion or weight differences. The SBI accuracy rates were significantly lower than the IPI and TLP accuracy rates, especially for several spooned, square cube, and sliced pie food items. The time needed to complete the operation assessment by the user was significantly lower for the IPI than for the SBI. Our study corroborates that the user-centered visual-based design of the IPI on a mobile device is comparable the TLP in terms of the usability for dietary food measurements. However, improvements are needed because both the IPI and TLP accuracies associated with some food shapes were lower than 60%. The SBI is not yet a viable aid. This innovative alternative required further improvements to the user interface. Copyright © 2016 Elsevier Inc. All rights reserved.

Task-specific usability requirements of electronic medical records systems: Lessons learned from a national survey of end-users.

PubMed

Farzandipour, Mehrdad; Meidani, Zahra; Riazi, Hossein; Sadeqi Jabali, Monireh

2018-09-01

There are various approaches to evaluating the usability of electronic medical record (EMR) systems. User perspectives are an integral part of evaluation. Usability evaluations efficiently and effectively contribute to user-centered design and supports tasks and increase user satisfaction. This study determined the main usability requirements for EMRs by means of an end-user survey. A mixed-method strategy was conducted in three phases. A qualitative approach was employed to collect and formulate EMR usability requirements using the focus group method and the modified Delphi technique. Classic Delphi technique was used to evaluate the proposed requirements among 380 end-users in Iran. The final list of EMR usability requirements was verified and included 163 requirements divided into nine groups. The highest rates of end-user agreement relate to EMR visual clarity (3.65 ± 0.61), fault tolerance (3.58 ± 0.56), and suitability for learning (3.55 ± 0.54). The lowest end-user agreement was for auditory presentation (3.18 ± 0.69). The highest and lowest agreement among end-users was for visual clarity and auditory presentation by EMRs, respectively. This suggests that user priorities in determination of EMR usability and their understanding of the importance of the types of individual tasks and context characteristics differ.

The STEP database through the end-users eyes--USABILITY STUDY.

PubMed

Salunke, Smita; Tuleu, Catherine

2015-08-15

The user-designed database of Safety and Toxicity of Excipients for Paediatrics ("STEP") is created to address the shared need of drug development community to access the relevant information of excipients effortlessly. Usability testing was performed to validate if the database satisfies the need of the end-users. Evaluation framework was developed to assess the usability. The participants performed scenario based tasks and provided feedback and post-session usability ratings. Failure Mode Effect Analysis (FMEA) was performed to prioritize the problems and improvements to the STEP database design and functionalities. The study revealed several design vulnerabilities. Tasks such as limiting the results, running complex queries, location of data and registering to access the database were challenging. The three critical attributes identified to have impact on the usability of the STEP database included (1) content and presentation (2) the navigation and search features (3) potential end-users. Evaluation framework proved to be an effective method for evaluating database effectiveness and user satisfaction. This study provides strong initial support for the usability of the STEP database. Recommendations would be incorporated into the refinement of the database to improve its usability and increase user participation towards the advancement of the database. Copyright © 2015 Elsevier B.V. All rights reserved.

User perspectives on the usability of a regional health information exchange

PubMed Central

Ho, Yun-Xian; Cala, Cather Marie; Blakemore, Dana; Chen, Qingxia; Frisse, Mark E; Johnson, Kevin B

2011-01-01

Objective We assessed the usability of a health information exchange (HIE) in a densely populated metropolitan region. This grant-funded HIE had been deployed rapidly to address the imminent needs of the patient population and the need to draw wider participation from regional entities. Design We conducted a cross-sectional survey of individuals given access to the HIE at participating organizations and examined some of the usability and usage factors related to the technology acceptance model. Measurements We probed user perceptions using the Questionnaire for User Interaction Satisfaction, an author-generated Trust scale, and user characteristic questions (eg, age, weekly system usage time). Results Overall, users viewed the system favorably (ratings for all usability items were greater than neutral (one-sample Wilcoxon test, p<0.0014, Bonferroni-corrected for 35 tests). System usage was regressed on usability, trust, and demographic and user characteristic factors. Three usability factors were positively predictive of system usage: overall reactions (p<0 0.01), learning (p<0.05), and system functionality (p<0.01). Although trust is an important component in collaborative relationships, we did not find that user trust of other participating healthcare entities was significantly predictive of usage. An analysis of respondents' comments revealed ways to improve the HIE. Conclusion We used a rapid deployment model to develop an HIE and found that perceptions of system usability were positive. We also found that system usage was predicted well by some aspects of usability. Results from this study suggest that a rapid development approach may serve as a viable model for developing usable HIEs serving communities with limited resources. PMID:21622933

Why Citizen Science Without Usability Testing Will Underperform

NASA Astrophysics Data System (ADS)

Romano, C.; Gay, P.; Owens, R.; Burlea, G.

2017-12-01

Citizen science projects must undergo usability testing and optimization if they are to meet their stated goals. This presentation will include video of usability tests conducted upon citizen science websites. Usability testing is essential to the success of online interaction, however, citizen science projects have just begun to include this critical activity. Interaction standards in citizen science lag behind those of commercial interests, and published research on this topic is limited. Since online citizen science is by definition, an exchange of information, a clear understanding of how users experience an online project is essential to informed decision-making. Usability testing provides that insight. Usability testing collects data via direct observation of a person while she interacts with a digital product, such as a citizen science website. The test participant verbalizes her thoughts while using the website or application; the moderator follows the participant and captures quantitative measurement of the participant's confidence of success as she advances through the citizen science project. Over 15 years of usability testing, we have observed that users who do not report a consistent sense of progress are likely to abandon a website after as few as three unrewarding interactions. Since citizen science is also a voluntary activity, ensuring seamless interaction for users is mandatory. Usability studies conducted on citizen science websites demonstrate that project teams frequently underestimate a user's need for context and ease of use. Without usability testing, risks to online citizen science projects include high bounce rate (users leave the website without taking any action), abandonment (of the website, tutorials, registration), misunderstanding instructions (causing disorientation and erroneous conclusions), and ultimately, underperforming projects.

Development and usability testing of FOCUS: a smartphone system for self-management of schizophrenia.

PubMed

Ben-Zeev, Dror; Kaiser, Susan M; Brenner, Christopher J; Begale, Mark; Duffecy, Jennifer; Mohr, David C

2013-12-01

Mobile Health (mHealth) approaches can support the rehabilitation of individuals with psychiatric conditions. In the current article, we describe the development of a smartphone illness self-management system for people with schizophrenia. The research was conducted with consumers and practitioners at a community-based rehabilitation agency. Stage 1: 904 individuals with schizophrenia or schizoaffective disorder completed a survey reporting on their current use of mobile devices and interest in mHealth services. Eight practitioners completed a survey examining their attitudes and expectations from an mHealth intervention, and identified needs and potential obstacles. Stage 2: A multidisciplinary team incorporated consumer and practitioner input and employed design principles for the development of e-resources for people with schizophrenia to produce an mHealth intervention. Stage 3: 12 consumers participated in laboratory usability sessions. They performed tasks involved in operating the new system, and provided "think aloud" commentary and post-session usability ratings. 570 (63%) of survey respondents reported owning a mobile device and many expressed interest in receiving mHealth services. Most practitioners believed that consumers could learn to use and would benefit from an mHealth intervention. In response, we developed a smartphone system that targets medication adherence, mood regulation, sleep, social functioning, and coping with symptoms. Usability testing revealed several design vulnerabilities, and the system was adapted to address consumer needs and preferences accordingly. Through a comprehensive development process, we produced an mHealth illness self-management intervention that is likely to be used successfully, and is ready for deployment and systemic evaluation in real-world conditions. PsycINFO Database Record (c) 2013 APA, all rights reserved.

Evaluation of a BCMA’s Electronic Medication Administration Record

PubMed Central

Staggers, Nancy; Iribarren, Sarah; Guo, Jia-Wen; Weir, Charlene

2015-01-01

Barcode medication administration (BCMA) systems can reduce medication errors, but sociotechnical issues are quite common. Although crucial to nurses’ work, few usability evaluations are available for electronic medication administration record screens (eMARs). The purpose of this research was to identify current usability problems in the VA’s eMAR/BCMA system and explore how these might impact nurses’ situation awareness. Three expert evaluators used 10 tasks/elements, heuristic evaluation techniques and explored potential impacts using a situation awareness perspective. The results yielded 99 usability problems categorized into 440 heuristic violations with the largest volume in the category of Match with the Real World. Fifteen usability issues were rated as catastrophic with the Administer/Chart medications task having the most. Situational awareness was impacted at all levels, especially at Level 2, Comprehension. Usability problems point to important areas for improvement because these issues have the potential to impact nurses’ situation awareness, “at a glance” information, nurse productivity and patient safety. PMID:25601936

Evaluating authentication options for mobile health applications in younger and older adults

PubMed Central

Khan, Hassan; Hengartner, Urs; Ong, Stephanie; Logan, Alexander G.; Vogel, Daniel; Gebotys, Robert; Yang, Jilan

2018-01-01

Objective Apps promoting patient self-management may improve health outcomes. However, methods to secure stored information on mobile devices may adversely affect usability. We tested the reliability and usability of common user authentication techniques in younger and older adults. Methodology Usability testing was conducted in two age groups, 18 to 30 years and 50 years and older. After completing a demographic questionnaire, each participant tested four authentication options in random order: four-digit personal identification number (PIN), graphical password (GRAPHICAL), Android pattern-lock (PATTERN), and a swipe-style Android fingerprint scanner (FINGERPRINT). Participants rated each option using the Systems Usability Scale (SUS). Results A total of 59 older and 43 younger participants completed the study. Overall, PATTERN was the fastest option (3.44s), and PIN had the fewest errors per attempt (0.02). Participants were able to login using PIN, PATTERN, and GRAPHICAL at least 98% of the time. FINGERPRINT was the slowest (26.97s), had an average of 1.46 errors per attempt, and had a successful login rate of 85%. Overall, PIN and PATTERN had higher SUS scores than FINGERPRINT and GRAPHICAL. Compared to younger participants, older participants were also less likely to find PATTERN to be tiring, annoying or time consuming and less likely to consider PIN to be time consuming. Younger participants were more likely to rate GRAPHICAL as annoying, time consuming and tiring than older participants. Conclusions On mobile devices, PIN and pattern-lock outperformed graphical passwords and swipe-style fingerprints. All participants took longer to authenticate using the swipe-style fingerprint compared to other options. Older participants also took two to three seconds longer to authenticate using the PIN, pattern and graphical passwords though this did not appear to affect perceived usability. PMID:29300736

Evaluating authentication options for mobile health applications in younger and older adults.

PubMed

Grindrod, Kelly; Khan, Hassan; Hengartner, Urs; Ong, Stephanie; Logan, Alexander G; Vogel, Daniel; Gebotys, Robert; Yang, Jilan

2018-01-01

Apps promoting patient self-management may improve health outcomes. However, methods to secure stored information on mobile devices may adversely affect usability. We tested the reliability and usability of common user authentication techniques in younger and older adults. Usability testing was conducted in two age groups, 18 to 30 years and 50 years and older. After completing a demographic questionnaire, each participant tested four authentication options in random order: four-digit personal identification number (PIN), graphical password (GRAPHICAL), Android pattern-lock (PATTERN), and a swipe-style Android fingerprint scanner (FINGERPRINT). Participants rated each option using the Systems Usability Scale (SUS). A total of 59 older and 43 younger participants completed the study. Overall, PATTERN was the fastest option (3.44s), and PIN had the fewest errors per attempt (0.02). Participants were able to login using PIN, PATTERN, and GRAPHICAL at least 98% of the time. FINGERPRINT was the slowest (26.97s), had an average of 1.46 errors per attempt, and had a successful login rate of 85%. Overall, PIN and PATTERN had higher SUS scores than FINGERPRINT and GRAPHICAL. Compared to younger participants, older participants were also less likely to find PATTERN to be tiring, annoying or time consuming and less likely to consider PIN to be time consuming. Younger participants were more likely to rate GRAPHICAL as annoying, time consuming and tiring than older participants. On mobile devices, PIN and pattern-lock outperformed graphical passwords and swipe-style fingerprints. All participants took longer to authenticate using the swipe-style fingerprint compared to other options. Older participants also took two to three seconds longer to authenticate using the PIN, pattern and graphical passwords though this did not appear to affect perceived usability.

Evidence-based development and first usability testing of a social serious game based multi-modal system for early screening for atypical socio-cognitive development.

PubMed

Gyori, Miklos; Borsos, Zsófia; Stefanik, Krisztina

2015-01-01

At current, screening for, and diagnosis of, autism spectrum disorders (ASD) are based on purely behavioral data; established screening tools rely on human observation and ratings of relevant behaviors. The research and development project in the focus of this paper is aimed at designing, creating and evaluating a social serious game based multi-modal, interactive software system for screening for high functioning cases of ASD at kindergarten age. The aims of this paper are (1) to summarize the evidence-based design process and (2) to present results from the first usability test of the system. Game topic, candidate responses, and candidate game contents were identified via an iterative literature review. On this basis, the 1^st partial prototype of the fully playable game has been created, with complete data recording functionality but without the decision making component. A first usability test was carried out on this prototype (n=13). Overall results were unambiguously promising. Although sporadic difficulties in, and slightly negative attitudes towards, using the game occasionally arose, these were confined to non-target-group children only. The next steps of development include (1) completing the game design; (2) carrying out first large-n field test; (3) creating the first prototype of the decision making component.

Researching the Practice, Practicing the Research, and Promoting Responsible Policy: Usable Knowledge in Mind, Brain, and Education

ERIC Educational Resources Information Center

Christodoulou, Joanna A.; Daley, Samantha G.; Katzir, Tami

2009-01-01

The theme of Usable Knowledge in Mind, Brain, and Education will be a special section that will appear regularly in the journal. The section will focus on the synergistic connections between biology, cognitive science, and human development on the one hand and educational thought, policy, and practice on the other. Efforts to create usable…

Usability of clinical decision support system as a facilitator for learning the assistive technology adaptation process.

PubMed

Danial-Saad, Alexandra; Kuflik, Tsvi; Weiss, Patrice L Tamar; Schreuer, Naomi

2016-01-01

The aim of this study was to evaluate the usability of Ontology Supported Computerized Assistive Technology Recommender (OSCAR), a Clinical Decision Support System (CDSS) for the assistive technology adaptation process, its impact on learning the matching process, and to determine the relationship between its usability and learnability. Two groups of expert and novice clinicians (total, n = 26) took part in this study. Each group filled out system usability scale (SUS) to evaluate OSCAR's usability. The novice group completed a learning questionnaire to assess OSCAR's effect on their ability to learn the matching process. Both groups rated OSCAR's usability as "very good", (M [SUS] = 80.7, SD = 11.6, median = 83.7) by the novices, and (M [SUS] = 81.2, SD = 6.8, median = 81.2) by the experts. The Mann-Whitney results indicated that no significant differences were found between the expert and novice groups in terms of OSCAR's usability. A significant positive correlation existed between the usability of OSCAR and the ability to learn the adaptation process (rs = 0.46, p = 0.04). Usability is an important factor in the acceptance of a system. The successful application of user-centered design principles during the development of OSCAR may serve as a case study that models the significant elements to be considered, theoretically and practically in developing other systems. Implications for Rehabilitation Creating a CDSS with a focus on its usability is an important factor for its acceptance by its users. Successful usability outcomes can impact the learning process of the subject matter in general, and the AT prescription process in particular. The successful application of User-Centered Design principles during the development of OSCAR may serve as a case study that models the significant elements to be considered, theoretically and practically. The study emphasizes the importance of close collaboration between the developers and the end users.

Facilitating Energy Savings through Enhanced Usability of Thermostats

DOE Office of Scientific and Technical Information (OSTI.GOV)

Meier, Alan; Aragon, Cecilia; Peffer, Therese

2011-05-23

Residential thermostats play a key role in controlling heating and cooling systems. Occupants often find the controls of programmable thermostats confusing, sometimes leading to higher heating consumption than when the buildings are controlled manually. A high degree of usability is vital to a programmable thermostat's effectiveness because, unlike a more efficient heating system, occupants must engage in specific actions after installation to obtain energy savings. We developed a procedure for measuring the usability of thermostats and tested this methodology with 31 subjects on five thermostats. The procedure requires first identifying representative tasks associated with the device and then testing themore » subjects ability to accomplish those tasks. The procedure was able to demonstrate the subjects wide ability to accomplish tasks and the influence of a device's usability on success rates. A metric based on the time to accomplish the tasks and the fraction of subjects actually completing the tasks captured the key aspects of each thermostat's usability. The procedure was recently adopted by the Energy Star Program for its thermostat specification. The approach appears suitable for quantifying usability of controls in other products, such as heat pump water heaters and commercial lighting.« less

The effect of keyboard key spacing on typing speed, error, usability, and biomechanics, Part 2: Vertical spacing.

PubMed

Pereira, Anna; Hsieh, Chih-Ming; Laroche, Charles; Rempel, David

2014-06-01

The objective was to evaluate the effects of vertical key spacing on a conventional computer keyboard on typing speed, percentage error, usability, forearm muscle activity, and wrist posture for both females with small fingers and males with large fingers. Part I evaluated primarily horizontal key spacing and found that for male typists with large fingers, productivity and usability were similar for spacings of 17, 18, and 19 mm but were reduced for spacings of 16 mm. Few other key spacing studies are available, and the international standards that specify the spacing between keys on a keyboard have been mainly guided by design convention. Experienced female typists (n = 26) with small fingers (middle finger length < or = 7.71 cm or finger breadth of < or = 1.93 cm) and male typists (n = 26) with large fingers (middle finger length > or = 8.37 cm or finger breadth of > or = 2.24 cm) typed on five keyboards that differed primarily in vertical key spacing (17 x 18, 17 x 17, 17 x 16, 17 x 15.5, and 18 x 16 mm) while typing speed, error, fatigue, preference, forearm muscle activity, and wrist posture were recorded. Productivity and usability ratings were significantly worse for the keyboard with 15.5 mm vertical spacing compared to the other keyboards for both groups.There were few significant differences on usability ratings between the other keyboards. Reducing vertical key spacing,from 18 to 17 to 16 mm, had no significant effect on productivity or usability. The findings support the design of keyboards with vertical key spacings of 16, 17, or 18 mm. These findings may influence keyboard design and standards.

Initial Validation of the Usage Rating Profile-Assessment for Use within German Language Schools

ERIC Educational Resources Information Center

Briesch, Amy M.; Casale, Gino; Grosche, Michael; Volpe, Robert J.; Hennemann, Thomas

2017-01-01

Modern attempts to explain why some assessment tools are readily adopted by school-based personnel whereas others are not have focused on the concept of usability. Usability encompasses not only the degree to which consumers find an assessment tool to be acceptable, but also the degree to which it is well-understood, believed to be feasible,…

Bryophytes for Beginners: The Usability of a Printed Dichotomous Key versus a Multi-Access Computer-Based Key for Bryophyte Identification

ERIC Educational Resources Information Center

Stagg, Bethan C.; Donkin, Maria E.; Smith, Alison M.

2015-01-01

Bryophytes are a rewarding study group in field biology and the UK bryophyte flora has international importance to biodiversity conservation. We designed an identification key to common woodland moss species and compared the usability of two formats, web-based multi-access and printed dichotomous key, with undergraduate students. The rate of…

Dentists' perceptions of trends in restorative dentistry in the UK.

PubMed

Randall, Ros C; Vrijhoef, Matthijs M A; Wilson, Nairn H F

2003-04-01

To obtain responses to a questionnaire on likely trends in the clinical practice of restorative dentistry from a national sample of general dental practitioners (GDPs) who were principals of group practices in the UK. A panel of nine experts had been convened previously to define areas of trends in restorative dentistry in the UK and to formulate these into statements. Twenty trends were identified and framed into a 22-item questionnaire based on the trend statements. The questionnaire was sent to a national sample of 2800 principal dentists in group practices. Names of principal dentists were taken from the Yellow Pages directories, a group practice being defined as at least one principal dentist and one other practitioner. Levels of agreement for questionnaire scores of > or = 70% for all segments of a statement were taken as indicating a possible trend. Of the 2800 questionnaires sent out, 1448 were returned, a return rate of 52%. Of these, 1217 questionnaires were usable, an overall response rate of 44%. Good agreement was obtained for 14 statements (64%). The 14 trend statements that scored a level of good agreement were taken as indicating possible trends in dentistry in the UK as perceived by those GDPs who responded to the questionnaire. However, in view of the fact that the 1217 usable questionnaires received reflected the opinions of 10% of the principal dentists in group practice in the UK, this will not be representative of all principal dentists in practice. Nevertheless for the purposes of gaining some insight into trends in restorative dentistry, it could be considered to be of value.

The McMaster Optimal Aging Portal: Usability Evaluation of a Unique Evidence-Based Health Information Website.

PubMed

Barbara, Angela M; Dobbins, Maureen; Haynes, R Brian; Iorio, Alfonso; Lavis, John N; Raina, Parminder; Levinson, Anthony J

2016-05-11

Increasingly, older adults and their informal caregivers are using the Internet to search for health-related information. There is a proliferation of health information online, but the quality of this information varies, often based on exaggerated or dramatic findings, and not easily comprehended by consumers. The McMaster Optimal Aging Portal (Portal) was developed to provide Internet users with high-quality evidence about aging and address some of these current limitations of health information posted online. The Portal includes content for health professionals coming from three best-in-class resources (MacPLUS, Health Evidence, and Health Systems Evidence) and four types of content specifically prepared for the general public (Evidence Summaries, Web Resource Ratings, Blog Posts, and Twitter messages). Our objectives were to share the findings of the usability evaluation of the Portal with particular focus on the content features for the general public and to inform designers of health information websites and online resources for older adults about key usability themes. Data analysis included task performance during usability testing and qualitative content analyses of both the usability sessions and interviews to identify core themes. A total of 37 participants took part in 33 usability testing sessions and 21 focused interviews. Qualitative analysis revealed common themes regarding the Portal's strengths and challenges to usability. The strengths of the website were related to credibility, applicability, browsing function, design, and accessibility. The usability challenges included reluctance to register, process of registering, searching, terminology, and technical features. The study reinforced the importance of including end users during the development of this unique, dynamic, evidence-based health information website. The feedback was applied to iteratively improve website usability. Our findings can be applied by designers of health-related websites.

The McMaster Optimal Aging Portal: Usability Evaluation of a Unique Evidence-Based Health Information Website

PubMed Central

Dobbins, Maureen; Haynes, R. Brian; Iorio, Alfonso; Lavis, John N; Raina, Parminder

2016-01-01

Background Increasingly, older adults and their informal caregivers are using the Internet to search for health-related information. There is a proliferation of health information online, but the quality of this information varies, often based on exaggerated or dramatic findings, and not easily comprehended by consumers. The McMaster Optimal Aging Portal (Portal) was developed to provide Internet users with high-quality evidence about aging and address some of these current limitations of health information posted online. The Portal includes content for health professionals coming from three best-in-class resources (MacPLUS, Health Evidence, and Health Systems Evidence) and four types of content specifically prepared for the general public (Evidence Summaries, Web Resource Ratings, Blog Posts, and Twitter messages). Objective Our objectives were to share the findings of the usability evaluation of the Portal with particular focus on the content features for the general public and to inform designers of health information websites and online resources for older adults about key usability themes. Methods Data analysis included task performance during usability testing and qualitative content analyses of both the usability sessions and interviews to identify core themes. Results A total of 37 participants took part in 33 usability testing sessions and 21 focused interviews. Qualitative analysis revealed common themes regarding the Portal’s strengths and challenges to usability. The strengths of the website were related to credibility, applicability, browsing function, design, and accessibility. The usability challenges included reluctance to register, process of registering, searching, terminology, and technical features. Conclusions The study reinforced the importance of including end users during the development of this unique, dynamic, evidence-based health information website. The feedback was applied to iteratively improve website usability. Our findings can be applied by designers of health-related websites. PMID:27170443

Intraoperative ablation of atrial fibrillation - replication of the Cox's maze III procedure with re-usable radiofrequency and cryoablation devices.

PubMed

Patwardhan, Anil

2010-01-01

The cut and sew Cox's maze III procedure is time-consuming. Therefore, various energy sources have been used for ablation, to replace the cut and sew technique. We have used the bipolar radiofrequency output of a standard electrosurgical generator with re-usable forceps for replicating the Cox's maze III procedure from August 1996. In addition, re-usable nitrous oxide based cryoprobe has been used at the atrioventricular valve annuli and on the coronary sinus. The 85.7% cure rate at one year compares with that for surgical ablation of atrial fibrillation using alternative energy sources.

Evaluating Usability of Radiology Information Systems in Hospitals of Tabriz University of Medical Sciences.

PubMed

Rezaei-Hachesu, Peyman; Pesianian, Esmaeil; Mohammadian, Mohsen

2016-02-01

Radiology information system (RIS) in order to reduce workload and improve the quality of services must be well-designed. Heuristic evaluation is one of the methods that understand usability problems with the least time, cost and resources. The aim of present study is to evaluate the usability of RISs in hospitals. This is a cross-sectional descriptive study (2015) that uses heuristic evaluation method to evaluate the usability of RIS used in 3 hospitals of Tabriz city. The data are collected using a standard checklist based on 13 principles of Nielsen Heuristic evaluation method. Usability of RISs was investigated based on the number of components observed from Nielsen principles and problems of usability based on the number of non-observed components as well as non-existent or unrecognizable components. by evaluation of RISs in each of the hospitals 1, 2 and 3, total numbers of observed components were obtained as 173, 202 and 196, respectively. It was concluded that the usability of RISs in the studied population, on average and with observing 190 components of the 291 components related to the 13 principles of Nielsen is 65.41 %. Furthermore, problems of usability were obtained as 26.35%. The established and visible nature of some components such as response time of application, visual feedbacks, colors, view and design and arrangement of software objects cause more attention to these components as principal components in designing UI software. Also, incorrect analysis before system design leads to a lack of attention to secondary needs like Help software and security issues.

User Interface Problems of a Nationwide Inpatient Information System: A Heuristic Evaluation.

PubMed

Atashi, Alireza; Khajouei, Reza; Azizi, Amirabbas; Dadashi, Ali

2016-01-01

While studies have shown that usability evaluation could uncover many design problems of health information systems, the usability of health information systems in developing countries using their native language is poorly studied. The objective of this study was to evaluate the usability of a nationwide inpatient information system used in many academic hospitals in Iran. Three trained usability evaluators independently evaluated the system using Nielsen's 10 usability heuristics. The evaluators combined identified problems in a single list and independently rated the severity of the problems. We statistically compared the number and severity of problems identified by HIS experienced and non-experienced evaluators. A total of 158 usability problems were identified. After removing duplications 99 unique problems were left. The highest mismatch with usability principles was related to "Consistency and standards" heuristic (25%) and the lowest related to "Flexibility and efficiency of use" (4%). The average severity of problems ranged from 2.4 (Major problem) to 3.3 (Catastrophe problem). The experienced evaluator with HIS identified significantly more problems and gave higher severities to problems (p<0.02). Heuristic Evaluation identified a high number of usability problems in a widely used inpatient information system in many academic hospitals. These problems, if remain unsolved, may waste users' and patients' time, increase errors and finally threaten patient's safety. Many of them can be fixed with simple redesign solutions such as using clear labels and better layouts. This study suggests conducting further studies to confirm the findings concerning effect of evaluator experience on the results of Heuristic Evaluation.

User Interface Problems of a Nationwide Inpatient Information System: A Heuristic Evaluation

PubMed Central

Atashi, Alireza; Azizi, Amirabbas; Dadashi, Ali

2016-01-01

Summary Introduction While studies have shown that usability evaluation could uncover many design problems of health information systems, the usability of health information systems in developing countries using their native language is poorly studied. The objective of this study was to evaluate the usability of a nationwide inpatient information system used in many academic hospitals in Iran. Material and Methods Three trained usability evaluators independently evaluated the system using Nielsen’s 10 usability heuristics. The evaluators combined identified problems in a single list and independently rated the severity of the problems. We statistically compared the number and severity of problems identified by HIS experienced and non-experienced evaluators. Results A total of 158 usability problems were identified. After removing duplications 99 unique problems were left. The highest mismatch with usability principles was related to “Consistency and standards” heuristic (25%) and the lowest related to “Flexibility and efficiency of use” (4%). The average severity of problems ranged from 2.4 (Major problem) to 3.3 (Catastrophe problem). The experienced evaluator with HIS identified significantly more problems and gave higher severities to problems (p<0.02). Discussion Heuristic Evaluation identified a high number of usability problems in a widely used inpatient information system in many academic hospitals. These problems, if remain unsolved, may waste users’ and patients’ time, increase errors and finally threaten patient’s safety. Many of them can be fixed with simple redesign solutions such as using clear labels and better layouts. This study suggests conducting further studies to confirm the findings concerning effect of evaluator experience on the results of Heuristic Evaluation. PMID:27081409

Radiofrequency testing of satellite segment of simulated 30/20 GHz satellite communications system

NASA Technical Reports Server (NTRS)

Leonard, R. F.; Kerczewski, R.

1985-01-01

A laboratory communications system has been developed that can serve as a test bed for the evaluation of advanced microwave (30/20 GHz) components produced under NASA technology programs. The system will ultimately permit the transmission of a stream of high-rate (220 Mbps) digital data from the originating user, through a ground terminal, through a hardware-simulated satellite, to a receiving ground station, to the receiving user. This report contains the results of radiofrequency testing of the satellite portion of that system. Data presented include output spurious responses, attainable signal-to-noise ratios, a baseline power budget, usable frequency bands, phase and amplitude response data for each of the frequency bands, and the effects of power level variation.

A comprehensive experimental characterization of the iPIX gamma imager

NASA Astrophysics Data System (ADS)

Amgarou, K.; Paradiso, V.; Patoz, A.; Bonnet, F.; Handley, J.; Couturier, P.; Becker, F.; Menaa, N.

2016-08-01

The results of more than 280 different experiments aimed at exploring the main features and performances of a newly developed gamma imager, called iPIX, are summarized in this paper. iPIX is designed to quickly localize radioactive sources while estimating the ambient dose equivalent rate at the measurement point. It integrates a 1 mm thick CdTe detector directly bump-bonded to a Timepix chip, a tungsten coded-aperture mask, and a mini RGB camera. It also represents a major technological breakthrough in terms of lightness, compactness, usability, response sensitivity, and angular resolution. As an example of its key strengths, an 241Am source with a dose rate of only few nSv/h can be localized in less than one minute.

The ISEE-3 ULEWAT: Flux tape description and heavy ion fluxes 1978-1984. [plasma diagnostics

NASA Technical Reports Server (NTRS)

Mason, G. M.; Klecker, B.

1985-01-01

The ISEE ULEWAT FLUX tapes contain ULEWAT and ISEE pool tape data summarized over relatively long time intervals (1hr) in order to compact the data set into an easily usable size. (Roughly 3 years of data fit onto one 1600 BPI 9-track magnetic tape). In making the tapes, corrections were made to the ULEWAT basic data tapes in order to, remove rate spikes and account for changes in instrument response so that to a large extent instrument fluxes can be calculated easily from the FLUX tapes without further consideration of instrument performance.

Usability Testing of a Complex Clinical Decision Support Tool in the Emergency Department: Lessons Learned.

PubMed

Press, Anne; McCullagh, Lauren; Khan, Sundas; Schachter, Andy; Pardo, Salvatore; McGinn, Thomas

2015-09-10

As the electronic health record (EHR) becomes the preferred documentation tool across medical practices, health care organizations are pushing for clinical decision support systems (CDSS) to help bring clinical decision support (CDS) tools to the forefront of patient-physician interactions. A CDSS is integrated into the EHR and allows physicians to easily utilize CDS tools. However, often CDSS are integrated into the EHR without an initial phase of usability testing, resulting in poor adoption rates. Usability testing is important because it evaluates a CDSS by testing it on actual users. This paper outlines the usability phase of a study, which will test the impact of integration of the Wells CDSS for pulmonary embolism (PE) diagnosis into a large urban emergency department, where workflow is often chaotic and high stakes decisions are frequently made. We hypothesize that conducting usability testing prior to integration of the Wells score into an emergency room EHR will result in increased adoption rates by physicians. The objective of the study was to conduct usability testing for the integration of the Wells clinical prediction rule into a tertiary care center's emergency department EHR. We conducted usability testing of a CDS tool in the emergency department EHR. The CDS tool consisted of the Wells rule for PE in the form of a calculator and was triggered off computed tomography (CT) orders or patients' chief complaint. The study was conducted at a tertiary hospital in Queens, New York. There were seven residents that were recruited and participated in two phases of usability testing. The usability testing employed a "think aloud" method and "near-live" clinical simulation, where care providers interacted with standardized patients enacting a clinical scenario. Both phases were audiotaped, video-taped, and had screen-capture software activated for onscreen recordings. Phase I: Data from the "think-aloud" phase of the study showed an overall positive outlook on the Wells tool in assessing a patient for a PE diagnosis. Subjects described the tool as "well-organized" and "better than clinical judgment". Changes were made to improve tool placement into the EHR to make it optimal for decision-making, auto-populating boxes, and minimizing click fatigue. Phase II: After incorporating the changes noted in Phase 1, the participants noted tool improvements. There was less toggling between screens, they had all the clinical information required to complete the tool, and were able to complete the patient visit efficiently. However, an optimal location for triggering the tool remained controversial. This study successfully combined "think-aloud" protocol analysis with "near-live" clinical simulations in a usability evaluation of a CDS tool that will be implemented into the emergency room environment. Both methods proved useful in the assessment of the CDS tool and allowed us to refine tool usability and workflow.

An Exploratory Usability Evaluation of Colorado State University Libraries' Digital Collections and the Western Waters Digital Library Web Sites

ERIC Educational Resources Information Center

Zimmerman, Don; Paschal, Dawn Bastian

2009-01-01

In an exploratory study, participants (n = 18) completed 11 usability tasks to assess ease of use of two Web sites, and then a Web site perception questionnaire for each. Participants rated both Web sites positively, but 25% and 36% could not complete all tasks; doing so required more than a minute to complete. (Contains 2 figures and 7 tables.)

Usability of Videogame-Based Dexterity Training in the Early Rehabilitation Phase of Stroke Patients: A Pilot Study.

PubMed

Vanbellingen, Tim; Filius, Suzanne J; Nyffeler, Thomas; van Wegen, Erwin E H

2017-01-01

Approximately 70-80% of stroke survivors have limited activities of daily living, mainly due to dexterous problems. Videogame-based training (VBT) along with virtual reality seems to be beneficial to train upper limb function. To evaluate the usability of VBT using the Leap Motion Controller (LMC) to train fine manual dexterity in the early rehabilitation phase of stroke patients as an add-on to conventional therapy. Additionally, this study aimed to estimate the feasibility and potential efficacy of the VBT. During 3 months, 64 stroke patients were screened for eligibility, 13 stroke patients were included (4 women and 9 men; age range: 24-91 years; mean time post stroke: 28.2 days). Nine sessions of 30 min VBT, three times per week as an add-on to conventional therapy with stroke inpatients. Primary outcome was the usability of the system measured with the System Usability Scale. Secondary outcomes concerning feasibility were the compliance rate calculated from the total time spent on the intervention (TT) compared to planned time, the opinion of participants via open-end questions, and the level of active participation measured with the Pittsburgh Rehabilitation Participation Scale. Regarding the potential efficacy secondary outcomes were: functional dexterity measured with the Nine Hole Peg Test (NHPT), subjective dexterity measured with the Dexterity Questionnaire 24, grip strength measured with the Jamar dynamometer, and motor impairment of the upper limb measured with the Fugl-Meyer Upper Extremity (FM-UE) scale. Primarily, the usability of the system was good to excellent. The patient's perception of usability remained stable over a mean period of 3 weeks of VBT. Secondly, the compliance rate was good, and the level of active participation varied between good and very good. The opinion of the participants revealed that despite individual differences, the overall impression of the therapy and device was good. Patients showed significant improvements in hand dexterity. No changes were found in motor impairment of the upper limb (FM-UE) during intervention. VBT using LMC is a usable rehabilitation tool to train dexterity in the early rehabilitation phase of stroke inpatients.

[Method for the evaluation of the stability and usability after opening packages of orally disintegrating tablets: case of amlodipine besilate products].

PubMed

Hori, Katsuhito; Yoshida, Naoko; Okumura, Tomonori; Okamura, Yasufumi; Kawakami, Junichi

2010-08-01

Orally disintegrating (OD) tablets are widely used in clinical practice. However, drug information on the choice and dispensing based on their stability after opening packages and usability in patients and dispensaries is not sufficient. The aim of this study was to investigate possible evaluation methods of the stability and usability of amlodipine OD tablets. Additives of the brand were changed in April 2009, and therefore the previous and current forms and two generics, current and newly marketed (in November 2009) products of different firms, were used. OD tablets were stored at 25 degrees C and 75% relative humidity for 3 months after opening the packages, and their physicochemical properties were evaluated. Their weight, diameter, thickness, and color difference increased slightly from the initial state. The extent of the change in their hardness, disintegration time, and friability was different among products. These physicochemical changes were acceptable in dispensary practice. Storage after opening the packages did not affect their dissolution rate. The dissolution rate at the initial state of the current brand was slower than that of the previous one. All products used were able to be dispensed by an automatic tablet-packing machine and applied to the so-called simple suspension method for intubational administration. Sensory evaluation tests revealed no major difference in the oral disintegration time, taste, impression, and preference among products. In conclusion, the stability and usability of amlodipine OD tablets used in this study were examined using several methods, and they can be used equivalently from the stability and usability viewpoints.

How you spend your pennies ... factors affecting the efficiency of human waste disposal systems (re-usable and disposable) and their cost.

PubMed

Rollnick, M

1991-05-01

Both re-usable and disposable systems have their merits and problems. The disposable system, being fully integrated, appears to be steadily gaining market share compared with the re-usable system. Since its introduction, the success of the re-usable system has been limited by the use of pans not designed for automatic processing. Where the 'perfection' pan has been superseded by 'open' shaped receptacles and those used in commode chairs, cleaning effectiveness can be improved by a factor of 10. For this and other reasons, nursing involvement in the re-usable system can be high while the 'perfection' pan is in use. A work study exercise to compare nursing involvement in re-usable and disposable systems is under way. When selecting a human waste disposal system for any site, it is vital that all disciplines discuss and decide objectives. The equipment usage, space, site conditions, availability and quality of supplies (eg water, electricity), the costs of maintenance, nursing time and other expenditure must be considered. The disposable system is capable of high process rates (more than double that of the fastest re-usable system). Its capital cost is currently about 1,000 pounds less than an average re-usable system, but in the busiest wards, revenue costs may be higher. In such wards the space for disposable receptacle storage can be as much as five to ten times machine volume. The design of macerators is generally simpler (having less components) than washer-disinfectors. Monitoring and maintenance involvement are likewise expected to be lower, particularly in hospitals with modern drainage systems.(ABSTRACT TRUNCATED AT 250 WORDS)

Usability and feasibility of health IT interventions to enhance Self-Care for Lymphedema Symptom Management in breast cancer survivors.

PubMed

Fu, Mei R; Axelrod, Deborah; Guth, Amber A; Wang, Yao; Scagliola, Joan; Hiotis, Karen; Rampertaap, Kavita; El-Shammaa, Nardin

2016-09-01

The-Optimal-Lymph-Flow health IT system (TOLF) is a patient-centered, web-and-mobile-based educational and behavioral health IT system focusing on safe, innovative, and pragmatic self-care strategies for lymphedema symptom management. The purpose of this study was to evaluate usability, feasibility, and acceptability of TOLF among the end-user of breast cancer survivors. Two types of usability testing were completed with 30 breast cancer survivors: heuristic evaluation and end-user testing. Each participant was asked to think aloud while completing a set of specified tasks designed to explicate and freely explore the system features. A heuristic evaluation checklist, the Perceived Ease of Use and Usefulness Questionnaire, and The Post Study System Usability Questionnaire were used to evaluate usability of the system. Open-ended questions were used to gather qualitative data. Quantitative data were analyzed using descriptive statistics and qualitative data were summarized thematically. Breast cancer survivors were very satisfied with the system: 90% (n = 27) rated the system having no usability problems; 10% (n = 3) noted minor cosmetic problems: spelling errors or text font size. The majority of participants 96.6% (n = 29) strongly agreed that the system was easy to use and effective in helping to learn about lymphedema, symptoms and self-care strategies. Themes from the qualitative data included empowerment, high quality information, loving avatar simulation videos, easy accessibility, and user-friendliness. This usability study provided evidence on breast cancer survivor's acceptance and highly positive evaluation of TOLF's usability as well as feasibility of using technologically-driven delivery model to enhance self-care strategies for lymphedema symptom management.

Engaging Community Stakeholders to Evaluate the Design, Usability, and Acceptability of a Chronic Obstructive Pulmonary Disease Social Media Resource Center

PubMed Central

Chaney, Beth; Chaney, Don; Paige, Samantha; Payne-Purvis, Caroline; Tennant, Bethany; Walsh-Childers, Kim; Sriram, PS; Alber, Julia

2015-01-01

Background Patients with chronic obstructive pulmonary disease (COPD) often report inadequate access to comprehensive patient education resources. Objective The purpose of this study was to incorporate community-engagement principles within a mixed-method research design to evaluate the usability and acceptability of a self-tailored social media resource center for medically underserved patients with COPD. Methods A multiphase sequential design (qual → QUANT → quant + QUAL) was incorporated into the current study, whereby a small-scale qualitative (qual) study informed the design of a social media website prototype that was tested with patients during a computer-based usability study (QUANT). To identify usability violations and determine whether or not patients found the website prototype acceptable for use, each patient was asked to complete an 18-item website usability and acceptability questionnaire, as well as a retrospective, in-depth, semistructured interview (quant + QUAL). Results The majority of medically underserved patients with COPD (n=8, mean 56 years, SD 7) found the social media website prototype to be easy to navigate and relevant to their self-management information needs. Mean responses on the 18-item website usability and acceptability questionnaire were very high on a scale of 1 (strongly disagree) to 5 (strongly agree) (mean 4.72, SD 0.33). However, the majority of patients identified several usability violations related to the prototype’s information design, interactive capabilities, and navigational structure. Specifically, 6 out of 8 (75%) patients struggled to create a log-in account to access the prototype, and 7 out of 8 patients (88%) experienced difficulty posting and replying to comments on an interactive discussion forum. Conclusions Patient perceptions of most social media website prototype features (eg, clickable picture-based screenshots of videos, comment tools) were largely positive. Mixed-method stakeholder feedback was used to make design recommendations, categorize usability violations, and prioritize potential solutions for improving the usability of a social media resource center for COPD patient education. PMID:25630449

Evaluating the Functionality and Usability of Two Novel Wheelchair Anti-Rollback Devices for Ramp Ascent in Manual Wheelchair Users With Spinal Cord Injury.

PubMed

Deems-Dluhy, Susan L; Jayaraman, Chandrasekaran; Green, Steve; Albert, Mark V; Jayaraman, Arun

2017-05-01

Difficulty ascending ramps and inclines with a manual wheelchair adversely affects the everyday mobility and overall quality of life of manual wheelchair users. Currently, various anti-rollback devices are available to assist manual wheelchair users to ascend ramps and inclines. However, these devices have 2 main shortcomings: restriction to backward motion limiting recovery from an overturning wheelchair, which is a safety concern; and difficulty in engaging/disengaging the device while on the ramp. To evaluate the functionality and usability of 2 novel wheelchair anti-rollback devices developed to address these shortcomings (prototypes "Wheel" and "Brake"). Cross-sectional. Rehabilitation research facility. Twelve adult participants with chronic spinal cord injury. Participants completed training and tested with both the wheelchair anti-rollback devices on a 7.3-m-long ramp. Number of stops, perceived physical exertion, pain, and ease of use of these devices as participants maneuvered their wheelchairs up a 7.3-m ramp were assessed. Participants also evaluated their satisfaction with the usability of both the devices using the Quebec User Evaluation of Satisfaction With Assistive Technology (QUEST 2.0). Both prototypes evaluated overcame the limitations of the existing anti-rollback devices. Nonparametric statistical tests showed that participants rated both prototypes similarly for the overall functional and usability aspects. However, the participants' satisfactory rating were higher for the prototype "Brake" than for the prototype "Wheel" based on a functional aspect (ie, engaging/disengaging easiness), and higher for Wheel than for Brake, based on a usability aspect (prototype size). The qualitative and quantitative outcomes of this investigation, based on the usability and functional evaluations, provided useful information for the improvement in the design of both anti-rollback devices, which may allow manual wheelchair users to manage ramp ascent more safely and easily. Further evaluations with a different SCI population is recommended. IV. Copyright © 2017 American Academy of Physical Medicine and Rehabilitation. Published by Elsevier Inc. All rights reserved.

Acceptance and usability of a home-based monitoring tool of health indicators in children of people with dementia: a Proof of Principle (POP) study.

PubMed

Boessen, April Bcg; Vermeulen, Joan; de Witte, Luc P

2017-01-01

Large-scale cohort studies are needed to confirm the relation between dementia and its possible risk factors. The inclusion of people with dementia in research is a challenge, however, children of people with dementia are at risk and are highly motivated to participate in dementia research. For technologies to support home-based data collection during large-scale studies, participants should be able and willing to use technology for a longer period of time. This study investigated acceptance and usability of iVitality, a research platform for home-based monitoring of dementia health indicators, in 151 children of people with dementia and investigated which frequency of measurements is acceptable for them. Participants were randomized to fortnightly or monthly measurements. At baseline and after 3 months, participants completed an online questionnaire regarding the acceptance (Technology Acceptance Model; 38 items) and usability (Post-Study System Usability Questionnaire; 24 items) of iVitality. Items were rated from 1 (I totally disagree) to 7 (I totally agree). Participants were also invited to take part in an online focus group (OFG) after 3 months of follow-up. Descriptive statistics and both two-sample/independent and paired t -tests were used to analyze the online questionnaires and a directed content analysis was used to analyze the OFGs. Children of people with dementia accept iVitality after long-term use and evaluate iVitality as a user-friendly, useful, and trusted technology, despite some suggestions for improvement. Overall, mean scores on acceptance and usability were higher than 5 (I somewhat agree), although the acceptance subscales "social influence" and "time" were rated somewhat lower. No significant differences in acceptance and usability were found between both protocol groups. Over time, "affect" significantly increased among participants measuring blood pressure fortnightly. iVitality has the potential to be used in large-scale studies for home-based monitoring of health indicators related to the development of dementia.

Computer Administered Safety Planning for Individuals at Risk for Suicide: Development and Usability Testing.

PubMed

Boudreaux, Edwin D; Brown, Gregory K; Stanley, Barbara; Sadasivam, Rajani S; Camargo, Carlos A; Miller, Ivan W

2017-05-15

Safety planning is a brief intervention that has become an accepted practice in many clinical settings to help prevent suicide. Even though it is quick compared to other approaches, it frequently requires 20 min or more to complete, which can impede adoption. A self-administered, Web-based safety planning application could potentially reduce clinician time, help promote standardization and quality, and provide enhanced ability to share the created plan. The aim of this study was to design, build, and test the usability of a Web-based, self-administered safety planning application. We employed a user-centered software design strategy led by a multidisciplinary team. The application was tested for usability with a target sample of suicidal patients. Detailed observations, structured usability ratings, and Think Aloud procedures were used. Suicidal ideation intensity and perceived ability to cope were assessed pre-post engagement with the Web application. A total of 30 participants were enrolled. Usability ratings were generally strong, and all patients successfully built a safety plan. However, the completeness of the safety plan varied. The mean number of steps completed was 5.5 (SD 0.9) out of 6, with 90% (27/30) of participants completing at least 5 steps and 67% (20/30) completing all 6 steps. Some safety planning steps were viewed as inapplicable to some individuals. Some confusion in instructions led to modifications to improve understandability of each step. Ratings of suicide intensity after completion of the application were significantly lower than preratings, pre: mean 5.11 (SD 2.9) versus post: mean 4.46 (SD 3.0), t 27 =2.49, P=.02. Ratings of ability to cope with suicidal thoughts after completion of the application were higher than preratings, with the difference approaching statistical significance, pre: mean 5.93 (SD 2.9), post: mean 6.64 (SD 2.4), t 27 =-2.03, P=.05. We have taken the first step toward identifying the components needed to maximize usability of a self-administered, Web-based safety planning application. Results support initial consideration of the application as an adjunct to clinical contact. This allows for the clinician or other personnel to provide clarification, when needed, to help the patient build the plan, and to help review and revise the draft. ©Edwin D Boudreaux, Gregory K Brown, Barbara Stanley, Rajani S Sadasivam, Carlos A Camargo Jr, Ivan W Miller. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 15.05.2017.

Mobile phone-based interactive voice response as a tool for improving access to healthcare in remote areas in Ghana - an evaluation of user experiences.

PubMed

Brinkel, J; May, J; Krumkamp, R; Lamshöft, M; Kreuels, B; Owusu-Dabo, E; Mohammed, A; Bonacic Marinovic, A; Dako-Gyeke, P; Krämer, A; Fobil, J N

2017-05-01

To investigate and determine the factors that enhanced or constituted barriers to the acceptance of an mHealth system which was piloted in Asante-Akim North District of Ghana to support healthcare of children. Four semi-structured focus group discussions were conducted with a total of 37 mothers. Participants were selected from a study population of mothers who subscribed to a pilot mHealth system which used an interactive voice response (IVR) for its operations. Data were evaluated using qualitative content analysis methods. In addition, a short quantitative questionnaire assessed system's usability (SUS). Results revealed 10 categories of factors that facilitated user acceptance of the IVR system including quality-of-care experience, health education and empowerment of women. The eight categories of factors identified as barriers to user acceptance included the lack of human interaction, lack of update and training on the electronic advices provided and lack of social integration of the system into the community. The usability (SUS median: 79.3; range: 65-97.5) of the system was rated acceptable. The principles of the tested mHealth system could be of interest during infectious disease outbreaks, such as Ebola or Lassa fever, when there might be a special need for disease-specific health information within populations. © 2017 John Wiley & Sons Ltd.

Design principles for engaging and retaining virtual citizen scientists.

PubMed

Wald, Dara M; Longo, Justin; Dobell, A R

2016-06-01

Citizen science initiatives encourage volunteer participants to collect and interpret data and contribute to formal scientific projects. The growth of virtual citizen science (VCS), facilitated through websites and mobile applications since the mid-2000s, has been driven by a combination of software innovations and mobile technologies, growing scientific data flows without commensurate increases in resources to handle them, and the desire of internet-connected participants to contribute to collective outputs. However, the increasing availability of internet-based activities requires individual VCS projects to compete for the attention of volunteers and promote their long-term retention. We examined program and platform design principles that might allow VCS initiatives to compete more effectively for volunteers, increase productivity of project participants, and retain contributors over time. We surveyed key personnel engaged in managing a sample of VCS projects to identify the principles and practices they pursued for these purposes and led a team in a heuristic evaluation of volunteer engagement, website or application usability, and participant retention. We received 40 completed survey responses (33% response rate) and completed a heuristic evaluation of 20 VCS program sites. The majority of the VCS programs focused on scientific outcomes, whereas the educational and social benefits of program participation, variables that are consistently ranked as important for volunteer engagement and retention, were incidental. Evaluators indicated usability, across most of the VCS program sites, was higher and less variable than the ratings for participant engagement and retention. In the context of growing competition for the attention of internet volunteers, increased attention to the motivations of virtual citizen scientists may help VCS programs sustain the necessary engagement and retention of their volunteers. © 2016 Society for Conservation Biology.

12om Limited Objective Experiment #2: Final Results Summary and Recommendations

DTIC Science & Technology

2014-03-31

Acronym Definition ARP CD CF CFD CG CIM COA CONOPS CSE Dev DFATD DP DRDC FGS Gov HREC IDP KR LOE LOC MA MARS NASA TLX NGO OP OPP Ops ROC SA...weight Ratings (OPP Support) Ratings (IP) Ratings (CU) Ratings (CS) Ratings (Usability) Ratings (Training T/E) Ratings (Use T/E) NASA TLX Mental demand

Investigating the Usability and Acute Effects of a Bedside Video Console to Prefrontal Cortical Activity Alterations: A Preclinical Study in Healthy Elderly.

PubMed

Knols, Ruud H; Swanenburg, Jaap; De Bon, Dino; Gennaro, Federico; Wolf, Martin; Krüger, Bernard; Bettex, Dominique; de Bruin, Eling D

2017-01-01

Elderly people at risk of developing cognitive decline; e.g., following surgery, may benefit from structured, challenging, and repetitive cognitive video training. This study assessed usability and acute effects of a newly developed bedside console (COPHYCON). Fifteen healthy elderly individuals performed a one-time 80-min intervention, including cognitive video games aimed at improving awareness and selective attention. Perceived usefulness and perceived ease of use (Technology Acceptance Model) were assessed together with measures of the achieved game level, reaction times, (in-) correct responses during ALERT and SELECT game play. Further, prefrontal cortical involvement of the regional cerebral hemoglobin saturation (rS02%) assessed with functional near infrared spectroscopy (fNIRS) ( n = 5) and EEG power ( n = 10) was analyzed. All participants completed the study without any adverse events. Perceived usefulness and perceived ease of use (TAM scores range 1-7) of the system varied between 3.9 and 6.3. The game levels reached for awareness varied between 9 and 11 (initial score 8-10), for reaction speed between 439 and 469 ms, and for correct responses between 74.1 and 78.8%. The highest level for the selective attention games was 2 (initial score 1), where reaction speed varied between 439 and 469 ms, correct responses between 96.2 and 98.5%, respectively. The decrease of rS02% in the right prefrontal cortex during gameplay was significantly ( p < 0.001) lower, compared to the left prefrontal cortex. Four participants yielded significant lower rS02% measures after exergaming with the ALERT games ( p < 0.000), but not with the SELECT games. EEG recordings of theta power significantly decreased in the averaged ~0.25-0.75 time interval for the left prefrontal cortex sensor across the cognitive game levels between the ALERT 1 and SELECT 1, as well as between SELECT 1 and 2 games. Participants rated the usability of the COPHYCON training positively. Further results indicate that video gaming may be an effective measure to affect prefrontal cortical functioning in elderly. The results warrant a clinical explorative study investigating the feasibility of the COPHYCON in a clinical setting.

Improved usability of a multi-infusion setup using a centralized control interface: A task-based usability test

PubMed Central

Cnossen, Fokie; Dieperink, Willem; Bult, Wouter; de Smet, Anne Marie; Touw, Daan J.; Nijsten, Maarten W.

2017-01-01

The objective of this study was to assess the usability benefits of adding a bedside central control interface that controls all intravenous (IV) infusion pumps compared to the conventional individual control of multiple infusion pumps. Eighteen dedicated ICU nurses volunteered in a between-subjects task-based usability test. A newly developed central control interface was compared to conventional control of multiple infusion pumps in a simulated ICU setting. Task execution time, clicks, errors and questionnaire responses were evaluated. Overall the central control interface outperformed the conventional control in terms of fewer user actions (40±3 vs. 73±20 clicks, p<0.001) and fewer user errors (1±1 vs. 3±2 errors, p<0.05), with no difference in task execution times (421±108 vs. 406±119 seconds, not significant). Questionnaires indicated a significant preference for the central control interface. Despite being novice users of the central control interface, ICU nurses displayed improved performance with the central control interface compared to the conventional interface they were familiar with. We conclude that the new user interface has an overall better usability than the conventional interface. PMID:28800617

Improved usability of a multi-infusion setup using a centralized control interface: A task-based usability test.

PubMed

Doesburg, Frank; Cnossen, Fokie; Dieperink, Willem; Bult, Wouter; de Smet, Anne Marie; Touw, Daan J; Nijsten, Maarten W

2017-01-01

The objective of this study was to assess the usability benefits of adding a bedside central control interface that controls all intravenous (IV) infusion pumps compared to the conventional individual control of multiple infusion pumps. Eighteen dedicated ICU nurses volunteered in a between-subjects task-based usability test. A newly developed central control interface was compared to conventional control of multiple infusion pumps in a simulated ICU setting. Task execution time, clicks, errors and questionnaire responses were evaluated. Overall the central control interface outperformed the conventional control in terms of fewer user actions (40±3 vs. 73±20 clicks, p<0.001) and fewer user errors (1±1 vs. 3±2 errors, p<0.05), with no difference in task execution times (421±108 vs. 406±119 seconds, not significant). Questionnaires indicated a significant preference for the central control interface. Despite being novice users of the central control interface, ICU nurses displayed improved performance with the central control interface compared to the conventional interface they were familiar with. We conclude that the new user interface has an overall better usability than the conventional interface.

Facilitating energy savings with programmable thermostats: evaluation and guidelines for the thermostat user interface.

PubMed

Peffer, Therese; Perry, Daniel; Pritoni, Marco; Aragon, Cecilia; Meier, Alan

2013-01-01

Thermostats control heating and cooling in homes - representing a major part of domestic energy use - yet, poor ergonomics of these devices has thwarted efforts to reduce energy consumption. Theoretically, programmable thermostats can reduce energy by 5-15%, but in practice little to no savings compared to manual thermostats are found. Several studies have found that programmable thermostats are not installed properly, are generally misunderstood and have poor usability. After conducting a usability study of programmable thermostats, we reviewed several guidelines from ergonomics, general device usability, computer-human interfaces and building control sources. We analysed the characteristics of thermostats that enabled or hindered successfully completing tasks and in a timely manner. Subjects had higher success rates with thermostat displays with positive examples of guidelines, such as visibility of possible actions, consistency and standards, and feedback. We suggested other guidelines that seemed missing, such as navigation cues, clear hierarchy and simple decision paths. Our evaluation of a usability test of five residential programmable thermostats led to the development of a comprehensive set of specific guidelines for thermostat design including visibility of possible actions, consistency, standards, simple decision paths and clear hierarchy. Improving the usability of thermostats may facilitate energy savings.

Physician satisfaction with a critical care clinical information system using a multimethod evaluation of usability.

PubMed

Hudson, Darren; Kushniruk, Andre; Borycki, Elizabeth; Zuege, Danny J

2018-04-01

Physician satisfaction with electronic medical records has often been poor. Usability has frequently been identified as a source for decreased satisfaction. While surveys can identify many issues, and are logistically easier to administer, they may miss issues identified using other methods This study sought to understand the level of physician satisfaction and usability issues associated with a critical care clinical information system (eCritical Alberta) implemented throughout the province of Alberta, Canada. All critical care attending physicians using the system were invited to participate in an online survey. Questions included components of the User Acceptance of Information Technology and Usability Questionnaire as well as free text feedback on system components. Physicians were also invited to participate in a think aloud test using simulated scenarios. The transcribed think aloud text and questionnaire were subjected to textual analysis. 82% of all eligible physicians completed the on-line survey (n = 61). Eight physicians were invited and seven completed the think aloud test. Overall satisfaction with the system was moderate. Usability was identified as a significant factor contributing to satisfaction. The major usability factors identified were system response time and layout. The think aloud component identified additional factors beyond those identified in the on-line survey. This study found a modestly high level of physician satisfaction with a province-wide clinical critical care information system. Usability continues to be a significant factor in physician satisfaction. Using multiple methods of evaluation can capture the benefits of a large sample size and deeper understanding of the issues. Copyright © 2018 Elsevier B.V. All rights reserved.

Validity and usability of a professional association's web-based knowledge translation portal: American Physical Therapy Association's PTNow.org.

PubMed

Deutsch, Judith E; Romney, Wendy; Reynolds, Jan; Manal, Tara Jo

2015-10-08

PTNow.org is an evidence-based, on-line portal created by a professional membership association to promote use of evidence in practice and to help decrease unwarranted variation in practice. The site contains synthesis documents designed to promote efficient clinical reasoning. These documents were written and peer-reviewed by teams of content experts and master clinicians. The purpose of this paper is to report on the content and construct validity as well as usability of the site. Physical therapist participants used clinical summaries (available in 3 formats--as a full summary with hyperlinks, "quick takes" with hyperlinks, and a portable two-page version) on the PTNow.org site to answer knowledge acquisition and clinical reasoning questions related to four patient scenarios. They also responded to questions about ease of use related to website navigation and about format and completeness of information using a 1-5 Likert scale. Responses were coded to reflect how participants used the site and then were summarized descriptively. Preferences for clinical summary format were analyzed using an analysis of variance (ANOVA) and a Dunnett T3 post hoc analysis. Seventeen participants completed the study. Clinical relevance and completeness ratings by experienced clinicians, which were used as the measure of content validity, ranged from 3.1 to 4.6 on a 5 point scale. Construct validity based on the information on the PTNow.org site was supported for knowledge acquisition questions 66 % of the time and for clinical reasoning questions 40 % of the time. Usability ratings for the full clinical summary were 4.6 (1.2); for the quick takes, 3.5 (.98); and for the portable clinical summary, 4.0 (.45). Participants preferred the full clinical summary over the other two formats (F = 5.908, P = 0.007). One hundred percent of the participants stated that they would recommend the PTNow site to their colleagues. Prelimary evidence supported both content validity and construct validity of knowledge acquisition, and partially supported construct validity of clinical reasoning for the clinical summaries on the PTNow.org site. Usability was supported, with users preferring the full clinical summary over the other two formats. Iterative design is ongoing.

Enhancing patient safety and quality of care by improving the usability of electronic health record systems: recommendations from AMIA.

PubMed

Middleton, Blackford; Bloomrosen, Meryl; Dente, Mark A; Hashmat, Bill; Koppel, Ross; Overhage, J Marc; Payne, Thomas H; Rosenbloom, S Trent; Weaver, Charlotte; Zhang, Jiajie

2013-06-01

In response to mounting evidence that use of electronic medical record systems may cause unintended consequences, and even patient harm, the AMIA Board of Directors convened a Task Force on Usability to examine evidence from the literature and make recommendations. This task force was composed of representatives from both academic settings and vendors of electronic health record (EHR) systems. After a careful review of the literature and of vendor experiences with EHR design and implementation, the task force developed 10 recommendations in four areas: (1) human factors health information technology (IT) research, (2) health IT policy, (3) industry recommendations, and (4) recommendations for the clinician end-user of EHR software. These AMIA recommendations are intended to stimulate informed debate, provide a plan to increase understanding of the impact of usability on the effective use of health IT, and lead to safer and higher quality care with the adoption of useful and usable EHR systems.

Development and preliminary testing of a web-based, self-help application for disaster-affected families

PubMed Central

Yuen, Erica K; Gros, Kirstin; Welsh, Kyleen E; McCauley, Jenna; Resnick, Heidi S; Danielson, Carla K; Price, Matthew; Ruggiero, Kenneth J

2015-01-01

Technology-based self-help interventions have the potential to increase access to evidence-based mental healthcare, especially for families affected by natural disasters. However, development of these interventions is a complex process and poses unique challenges. Usability testing, which assesses the ability of individuals to use an application successfully, can have a significant impact on the quality of a self-help intervention. This article describes (a) the development of a novel web-based multi-module self-help intervention for disaster-affected adolescents and their parents and (b) a mixed-methods formal usability study to evaluate user response. A total of 24 adolescents were observed, videotaped, and interviewed as they used the depressed mood component of the self-help intervention. Quantitative results indicated an above-average user experience, and qualitative analysis identified 120 unique usability issues. We discuss the challenges of developing self-help applications, including design considerations and the value of usability testing in technology-based interventions, as well as our plan for widespread dissemination. PMID:25933798

Enhancing patient safety and quality of care by improving the usability of electronic health record systems: recommendations from AMIA

PubMed Central

Middleton, Blackford; Bloomrosen, Meryl; Dente, Mark A; Hashmat, Bill; Koppel, Ross; Overhage, J Marc; Payne, Thomas H; Rosenbloom, S Trent; Weaver, Charlotte; Zhang, Jiajie

2013-01-01

In response to mounting evidence that use of electronic medical record systems may cause unintended consequences, and even patient harm, the AMIA Board of Directors convened a Task Force on Usability to examine evidence from the literature and make recommendations. This task force was composed of representatives from both academic settings and vendors of electronic health record (EHR) systems. After a careful review of the literature and of vendor experiences with EHR design and implementation, the task force developed 10 recommendations in four areas: (1) human factors health information technology (IT) research, (2) health IT policy, (3) industry recommendations, and (4) recommendations for the clinician end-user of EHR software. These AMIA recommendations are intended to stimulate informed debate, provide a plan to increase understanding of the impact of usability on the effective use of health IT, and lead to safer and higher quality care with the adoption of useful and usable EHR systems. PMID:23355463

Usability testing and requirements derivation for EMU-compatible electrical connectors

NASA Technical Reports Server (NTRS)

Reaux, Ray A.; Griffin, Thomas J.; Lewis, Ruthan

1989-01-01

On-orbit servicing of payloads is simplified when a spacecraft has been designed for serviceability. A key design criterion for a serviceable spaceraft is standardization of electrical connectors. This paper investigates the effects of extravehicular mobility unit (EMU) glove size, connector size, and connector type on usability of electrical connectors. An experiment was conducted exploring participants' ability to mate and demate connectors in an evacuated glovebox. Independent variables were two EMU glove-sizes, five connector size groups, and seven connector types. Significant differences in performance times and heart rate changes during mate and demate operations were found. Subjective assessments of connectors were collected from participants with a usability questionnaire. The data were used to derive design recommendations for a NASA-recommended EMU-compatible electrical connector.

Development of the Lupus Interactive Navigator as an Empowering Web-Based eHealth Tool to Facilitate Lupus Management: Users Perspectives on Usability and Acceptability.

PubMed

Neville, Carolyn; Da Costa, Deborah; Rochon, Murray; Peschken, Christine A; Pineau, Christian A; Bernatsky, Sasha; Keeling, Stephanie; Avina-Zubieta, Antonio; Lye, Elizabeth; Eng, Davy; Fortin, Paul R

2016-05-30

Systemic Lupus Erythematosus (SLE) is a serious, complex, and chronic illness. Similar to most other chronic illness states, there is great interest in helping persons with SLE engage in their disease management. The objectives of this study were to (1) develop the Lupus Interactive Navigator (LIN), a web-based self-management program for persons with SLE, and (2) test the LIN for usability and acceptability. The LIN development platform was based on the results of preliminary comprehensive needs assessments and adapted from the Oncology Interactive Navigator, a web-based tool developed for persons with cancer. Medical researchers, writers, designers, and programmers worked with clinical experts and persons with SLE to develop content for the LIN. Usability and acceptability of the LIN was tested on individuals with SLE meeting American College of Rheumatology criteria, who were recruited from five Canadian SLE clinics. Participants were provided with access to the LIN and were asked to use it over a two-week period. Following the testing period, participants were contacted for a 30-minute telephone interview to assess usability and acceptability. The content for the LIN was subdivided into six primary information topics with interview videos featuring rheumatologists, allied health professionals, and persons with SLE. Usability and acceptability of the LIN was tested on 43 females with SLE. Of these, 37 (86%) completed telephone interviews. The average age was 43.6 (SD 15.9) years and disease duration averaged 14.1 (SD 10.8) years. Median time spent on LIN was 16.3 (interquartile range [IQR]:13.7, 53.5) minutes and median number of sessions was 2 (IQR: 1, 3). Overall, Likert ratings (0=strongly disagree; 7=strongly agree) of website usability and content were very high, with 75% scoring >6 out of 7 on all items. All participants agreed that LIN was easy to use, would recommend it to others with SLE, and would refer to it for future questions about SLE. Very high ratings were also given to relevancy, credibility, and usefulness of the information provided. Overall, 73% of the participants rated all topics helpful to very helpful. Participants who reported more prior knowledge about SLE rated items regarding improvement in knowledge and helpfulness relatively lower than persons with less prior knowledge. Most participants commented that the LIN would be very useful to those newly diagnosed with SLE. Minor revisions were recommended. This study furthers the understanding of the needs in the SLE community and delivers a unique eHealth tool to promote self-management in persons with SLE. The LIN was found to be highly acceptable in content and usability. The information provided on LIN may be most helpful for individuals with less experience with the disease, such as those newly diagnosed, indicating the need to tailor the content for persons with more SLE experience.

Assessment of Crew Workload for the RAH-66 Comanche Force Development Experiment 1

DTIC Science & Technology

2001-10-01

Scale and a cockpit controls and displays usability questionnaire . Results of the assessment indicate that (a) workload was tolerable for the pilots...Workload Levels Between Front Seat and Back Seat 13 3.4 Pilot Responses to Controls and Displays Usability Questionnaire 13 3.5 HMD Symbology 13 4... questionnaire . The data were analyzed to determine if the pilot flying the aircraft (pilot on controls) and the pilot operating the mission equipment

How Do Clinical Information Systems Affect the Cognitive Demands of General Practitioners?: Usability Study with a Focus on Cognitive Workload.

PubMed

Ariza, Ferran; Kalra, Dipak; Potts, Henry Ww

2015-11-20

Clinical information systems in the National Health Service do not need to conform to any explicit usability requirements. Poor usability can increase the mental workload experienced by clinicians and cause fatigue, increase error rates and impact the overall patient safety. Mental workload can be used as a measure of usability. To assess the subjective cognitive workload experienced by general practitioners (GPs) with their systems. To raise awareness of the importance of usability in system design among users, designers, developers and policymakers. We used a modified version of the NASA Task Load Index, adapted for web. We developed a set of common clinical scenarios and computer tasks on an online survey. We emailed the study link to 199 clinical commissioning groups and 1,646 GP practices in England. Sixty-seven responders completed the survey. The respondents had spent an average of 17 years in general practice, had experience of using a mean of 1.5 GP computer systems and had used their current system for a mean time of 6.7 years. The mental workload score was not different among systems. There were significant differences among the task scores, but these differences were not specific to particular systems. The overall score and task scores were related to the length of experience with their present system. Four tasks imposed a higher mental workload on GPs: 'repeat prescribing', 'find episode', 'drug management' and 'overview records'. Further usability studies on GP systems should focus on these tasks. Users, policymakers, designers and developers should remain aware of the importance of usability in system design.What does this study add?• Current GP systems in England do not need to conform to explicit usability requirements. Poor usability can increase the mental workload of clinicians and lead to errors.• Some clinical computer tasks incur more cognitive workload than others and should be considered carefully during the design of a system.• GPs did not report overall very high levels of subjective cognitive workload when undertaking common clinical tasks with their systems.• Further usability studies on GP systems should focus on the tasks incurring higher cognitive workload.• Users, policymakers, and designers and developers should remain aware of the importance of usability in system design.

Effects of tool handle dimension and workpiece orientation and size on wrist ulnar/radial torque strength, usability and discomfort in a wrench task.

PubMed

Dianat, Iman; Rahimi, Soleyman; Nedaei, Moein; Asghari Jafarabadi, Mohammad; Oskouei, Ali E

2017-03-01

The effects of tool handle dimension (three modified designs of wrenches with 30-50 mm diameter cylindrical handles and traditional design with rectangular cross-sectional (5 mm × 25 mm) handle), workpiece orientation (vertical/horizontal) and workpiece size (small/large) as well as user's hand size on wrist ulnar/radial (U/R) torque strength, usability and discomfort, and also the relationship between these variables were evaluated in a maximum torque task using wrenches. The highest and lowest levels of maximal wrist U/R torque strength were recorded for the 30 mm diameter handle and traditional wrench design, respectively. The prototype handle with 30 mm diameter, together with 40 mm diameter handle, was also better than other designs as they received higher usability ratings and caused less discomfort. The mean wrist torque strength exerted on a vertically oriented workpiece (in the sagittal plane) was 23.8% higher than that exerted on a horizontally oriented one (in the transverse plane). The user's hand size had no effect on torque exertions. The wrist torque strength and usability were negatively correlated with hand and finger discomfort ratings. The results are also discussed in terms of their implications for hand tool and workstation configuration in torque tasks involving wrenches. Copyright © 2016 Elsevier Ltd. All rights reserved.

Extending the Direct Behavior Rating: An Examination of Schoolwide Behavior Ratings and Academic Engagement

ERIC Educational Resources Information Center

Bruhn, Allison; Barron, Sheila; Fernando, Josephine; Balint-Langel, Kinga

2018-01-01

Direct behavior ratings have been identified as a practical and feasible alternative to direct observation of behavior for monitoring behavioral progress. Despite the evidence of usability, there have been calls for further examination of direct behavior ratings using different behaviors and scales. To this end, we examined the ratings of…

Improving the Interoperability and Usability of NASA Earth Observation Data

NASA Astrophysics Data System (ADS)

Walter, J.; Berrick, S. W.; Murphy, K. J.; Mitchell, A. E.; Tilmes, C.

2014-12-01

NASA's Earth Science Data and Information System Project (ESDIS) is charged with managing, maintaining, and evolving NASA's Earth Observing System Data and Information System (EOSDIS) and is responsible for processing, archiving, and distributing NASA Earth Science data. The system supports a multitude of missions and serves diverse science research and other user communities. While NASA has made, and continues to make, great strides in the discoverability and accessibility of its earth observation data holdings, issues associated with data interoperability and usability still present significant challenges to realizing the full scientific and societal benefits of these data. This concern has been articulated by multiple government agencies, both U.S. and international, as well as other non-governmental organizations around the world. Among these is the White House Office of Science and Technology Policy who, in response, has launched the Big Earth Data Initiative and the Climate Data Initiative to address these concerns for U.S. government agencies. This presentation will describe NASA's approach for addressing data interoperability and usability issues with our earth observation data.

National questionnaire study on clinical ICT systems proofs: physicians suffer from poor usability.

PubMed

Viitanen, Johanna; Hyppönen, Hannele; Lääveri, Tinja; Vänskä, Jukka; Reponen, Jarmo; Winblad, Ilkka

2011-10-01

In the health informatics field, usability studies typically focus on evaluating a single information system and involve a rather small group of end-users. However, little is known about the usability of clinical information and communication technology (ICT) environment in which healthcare professionals work daily. This paper aims at contributing to usability research and user-oriented development of healthcare technologies with three objectives: inform researchers and practitioners about the current state of usability of clinical ICT systems, increase the understanding of usability aspects specific for clinical context, and encourage a more holistic approach on studying usability issues in health informatics field. A national web questionnaire study was conducted in Finland in spring 2010 with 3929 physicians actively working in patient care. For the purposes of the study, we described three dimensions of clinical ICT system usability that reflect the physicians' viewpoint on system usage: (1) compatibility between clinical ICT systems and physicians' tasks, (2) ICT support for information exchange, communication and collaboration in clinical work, and (3) interoperability and reliability. The dimensions derive from the definitions of usability and clinical context of use analysis, and reflect the ability of ICT systems to have a positive impact on patient care by supporting physicians in achieving their goals with a pleasant user experience. The research data incorporated 32 statements with a five-point Likert-scale on physicians' experiences on usability of their currently used ICT systems and a summative question about school grade given to electronic health record (EHR) systems. Physicians' estimates of their EHR systems were very critical. With the rating scale from 4 or fail to 10 or excellent, the average of the grades varied from 6.1 to 8.4 dependent on the kind of facility the physician is working. Questionnaire results indicated several usability problems and deficiencies which considerably hindered the efficiency of clinical ICT use and physician's routine work. Systems lacked the appropriate features to support typical clinical tasks, such as decision making, prevention of medical errors, and review of a patient's treatment chart. The systems also required physicians to perform fixed sequences of steps and tasks, and poorly supported the documentation and retrieval of patient data. The findings on ICT support for collaboration showed mainly negative results, aside from collaboration between co-located physicians. In addition, the study results pointed out physicians suffering from system failures and a lack of integration between the systems. The described study and related results are unique in several ways. A national usability study with nearly 4000 respondents had not been conducted in other countries in which healthcare technologies are widely adopted. The questionnaire study provided a generalized picture about the usability problems, however, it should be noted that there were significant differences between legacy systems in use. Previously, researchers had not approached contextual aspects of usability the context of clinical work, where numerous systems are in use. The described usability dimensions and the presented study results can be considered as the first step towards conceptualizing ICT usability in the unique setting of clinical work. Copyright © 2011 Elsevier Ireland Ltd. All rights reserved.

Development and evaluation of a multimedia e-learning resource for electrolyte and acid-base disorders.

PubMed

Davids, Mogamat Razeen; Chikte, Usuf M E; Halperin, Mitchell L

2011-09-01

This article reports on the development and evaluation of a Web-based application that provides instruction and hands-on practice in managing electrolyte and acid-base disorders. Our teaching approach, which focuses on concepts rather than details, encourages quantitative analysis and a logical problem-solving approach. Identifying any dangers to the patient is a vital first step. Concepts such as an "appropriate response" to a given perturbation and the need for electroneutrality in body fluids are used repeatedly. Our Electrolyte Workshop was developed using Flash and followed an iterative design process. Two case-based tutorials were built in this first phase, with one tutorial including an interactive treatment simulation. Users select from a menu of therapies and see the impact of their choices on the patient. Appropriate text messages are displayed, and changes in body compartment sizes, brain size, and plasma sodium concentrations are illustrated via Flash animation. Challenges encountered included a shortage of skilled Flash developers, budgetary constraints, and challenges in communication between the authors and the developers. The application was evaluated via user testing by residents and specialists in internal medicine. Satisfaction was measured with a questionnaire based on the System Usability Scale. The mean System Usability Scale score was 78.4 ± 13.8, indicating a good level of usability. Participants rated the content as being scientifically sound; they liked the teaching approach and felt that concepts were conveyed clearly. They indicated that the application held their interest, that it increased their understanding of hyponatremia, and that they would recommend this learning resource to others.

The value of usability testing for Internet-based adolescent self-management interventions: "Managing Hemophilia Online".

PubMed

Breakey, Vicky R; Warias, Ashley V; Ignas, Danial M; White, Meghan; Blanchette, Victor S; Stinson, Jennifer N

2013-10-04

As adolescents with hemophilia approach adulthood, they are expected to assume responsibility for their disease management. A bilingual (English and French) Internet-based self-management program, "Teens Taking Charge: Managing Hemophilia Online," was developed to support adolescents with hemophilia in this transition. This study explored the usability of the website and resulted in refinement of the prototype. A purposive sample (n=18; age 13-18; mean age 15.5 years) was recruited from two tertiary care centers to assess the usability of the program in English and French. Qualitative observations using a "think aloud" usability testing method and semi-structured interviews were conducted in four iterative cycles, with changes to the prototype made as necessary following each cycle. This study was approved by research ethics boards at each site. Teens responded positively to the content and appearance of the website and felt that it was easy to navigate and understand. The multimedia components (videos, animations, quizzes) were felt to enrich the experience. Changes to the presentation of content and the website user-interface were made after the first, second and third cycles of testing in English. Cycle four did not result in any further changes. Overall, teens found the website to be easy to use. Usability testing identified end-user concerns that informed improvements to the program. Usability testing is a crucial step in the development of Internet-based self-management programs to ensure information is delivered in a manner that is accessible and understood by users.

Usability Assessment of the Missouri Cancer Registry's Published Interactive Mapping Reports: Round One.

PubMed

Ben Ramadan, Awatef Ahmed; Jackson-Thompson, Jeannette; Schmaltz, Chester Lee

2017-08-04

 Many users of spatial data have difficulty interpreting information in health-related spatial reports. The Missouri Cancer Registry and Research Center (MCR-ARC) has produced interactive reports for several years. These reports have never been tested for usability.  The aims of this study were to: (1) conduct a multi-approach usability testing study to understand ease of use (user friendliness) and user satisfaction; and (2) evaluate the usability of MCR-ARC's published InstantAtlas reports.   An institutional review board (IRB) approved mixed methodology usability testing study using a convenience sample of health professionals. A recruiting email was sent to faculty in the Master of Public Health program and to faculty and staff in the Department of Health Management and Informatics at the University of Missouri-Columbia. The study included 7 participants. The test included a pretest questionnaire, a multi-task usability test, and the System Usability Scale (SUS). Also, the researchers collected participants' comments about the tested maps immediately after every trial. Software was used to record the computer screen during the trial and the participants' spoken comments. Several performance and usability metrics were measured to evaluate the usability of MCR-ARC's published mapping reports. Of the 10 assigned tasks, 6 reached a 100% completion success rate, and this outcome was relative to the complexity of the tasks. The simple tasks were handled more efficiently than the complicated tasks. The SUS score ranged between 20-100 points, with an average of 62.7 points and a median of 50.5 points. The tested maps' effectiveness outcomes were better than the efficiency and satisfaction outcomes. There was a statistically significant relationship between the subjects' performance on the study test and the users' previous experience with geographic information system (GIS) tools (P=.03). There were no statistically significant relationships between users' performance and satisfaction and their education level, work type, or previous experience in health care (P>.05). There were strong positive correlations between the three measured usability elements. The tested maps should undergo an extensive refining and updating to overcome all the discovered usability issues and meet the perspectives and needs of the tested maps' potential users. The study results might convey the perspectives of academic health professionals toward GIS health data. We need to conduct a second-round usability study with public health practitioners and cancer professionals who use GIS tools on a routine basis. Usability testing should be conducted before and after releasing MCR-ARC's maps in the future. ©Awatef Ahmed Ben Ramadan, Jeannette Jackson-Thompson, Chester Lee Schmaltz. Originally published in JMIR Human Factors (http://humanfactors.jmir.org), 04.08.2017.

Usability Assessment of the Missouri Cancer Registry’s Published Interactive Mapping Reports: Round One

PubMed Central

Jackson-Thompson, Jeannette; Schmaltz, Chester Lee

2017-01-01

Background  Many users of spatial data have difficulty interpreting information in health-related spatial reports. The Missouri Cancer Registry and Research Center (MCR-ARC) has produced interactive reports for several years. These reports have never been tested for usability. Objective  The aims of this study were to: (1) conduct a multi-approach usability testing study to understand ease of use (user friendliness) and user satisfaction; and (2) evaluate the usability of MCR-ARC’s published InstantAtlas reports. Methods   An institutional review board (IRB) approved mixed methodology usability testing study using a convenience sample of health professionals. A recruiting email was sent to faculty in the Master of Public Health program and to faculty and staff in the Department of Health Management and Informatics at the University of Missouri-Columbia. The study included 7 participants. The test included a pretest questionnaire, a multi-task usability test, and the System Usability Scale (SUS). Also, the researchers collected participants’ comments about the tested maps immediately after every trial. Software was used to record the computer screen during the trial and the participants’ spoken comments. Several performance and usability metrics were measured to evaluate the usability of MCR-ARC’s published mapping reports. Results Of the 10 assigned tasks, 6 reached a 100% completion success rate, and this outcome was relative to the complexity of the tasks. The simple tasks were handled more efficiently than the complicated tasks. The SUS score ranged between 20-100 points, with an average of 62.7 points and a median of 50.5 points. The tested maps’ effectiveness outcomes were better than the efficiency and satisfaction outcomes. There was a statistically significant relationship between the subjects’ performance on the study test and the users’ previous experience with geographic information system (GIS) tools (P=.03). There were no statistically significant relationships between users’ performance and satisfaction and their education level, work type, or previous experience in health care (P>.05). There were strong positive correlations between the three measured usability elements. Conclusions The tested maps should undergo an extensive refining and updating to overcome all the discovered usability issues and meet the perspectives and needs of the tested maps’ potential users. The study results might convey the perspectives of academic health professionals toward GIS health data. We need to conduct a second-round usability study with public health practitioners and cancer professionals who use GIS tools on a routine basis. Usability testing should be conducted before and after releasing MCR-ARC’s maps in the future. PMID:28778842

Applications of palynology and kerogen analysis to California Paleogene stratigraphy and paleoenvironment

DOE Office of Scientific and Technical Information (OSTI.GOV)

Lucas-Clark, J.

1988-03-01

Paleogene strata of California commonly yield usable preserved organic material. Fossil pollen, spores, and dinoflagellates of chronostratigraphic significance are recovered from Paleogene rocks that contain no other usable fossil material. Palynofacies analysis, which combines data from fossil species with data from kerogen analysis, is used to interpret paleo-environmental aspects such as paleobathymetry, probable upwelling, turbulence, and rates of sedimentation. Examples of applications come from Paleogene submarine canyon deposits, the northern California Franciscan coastal belt, and southern California Transverse Ranges.

Semantic Indexing of Medical Learning Objects: Medical Students' Usage of a Semantic Network

PubMed Central

Gießler, Paul; Ohnesorge-Radtke, Ursula; Spreckelsen, Cord

2015-01-01

Background The Semantically Annotated Media (SAM) project aims to provide a flexible platform for searching, browsing, and indexing medical learning objects (MLOs) based on a semantic network derived from established classification systems. Primarily, SAM supports the Aachen emedia skills lab, but SAM is ready for indexing distributed content and the Simple Knowledge Organizing System standard provides a means for easily upgrading or even exchanging SAM’s semantic network. There is a lack of research addressing the usability of MLO indexes or search portals like SAM and the user behavior with such platforms. Objective The purpose of this study was to assess the usability of SAM by investigating characteristic user behavior of medical students accessing MLOs via SAM. Methods In this study, we chose a mixed-methods approach. Lean usability testing was combined with usability inspection by having the participants complete four typical usage scenarios before filling out a questionnaire. The questionnaire was based on the IsoMetrics usability inventory. Direct user interaction with SAM (mouse clicks and pages accessed) was logged. Results The study analyzed the typical usage patterns and habits of students using a semantic network for accessing MLOs. Four scenarios capturing characteristics of typical tasks to be solved by using SAM yielded high ratings of usability items and showed good results concerning the consistency of indexing by different users. Long-tail phenomena emerge as they are typical for a collaborative Web 2.0 platform. Suitable but nonetheless rarely used keywords were assigned to MLOs by some users. Conclusions It is possible to develop a Web-based tool with high usability and acceptance for indexing and retrieval of MLOs. SAM can be applied to indexing multicentered repositories of MLOs collaboratively. PMID:27731860

Semantic Indexing of Medical Learning Objects: Medical Students' Usage of a Semantic Network.

PubMed

Tix, Nadine; Gießler, Paul; Ohnesorge-Radtke, Ursula; Spreckelsen, Cord

2015-11-11

The Semantically Annotated Media (SAM) project aims to provide a flexible platform for searching, browsing, and indexing medical learning objects (MLOs) based on a semantic network derived from established classification systems. Primarily, SAM supports the Aachen emedia skills lab, but SAM is ready for indexing distributed content and the Simple Knowledge Organizing System standard provides a means for easily upgrading or even exchanging SAM's semantic network. There is a lack of research addressing the usability of MLO indexes or search portals like SAM and the user behavior with such platforms. The purpose of this study was to assess the usability of SAM by investigating characteristic user behavior of medical students accessing MLOs via SAM. In this study, we chose a mixed-methods approach. Lean usability testing was combined with usability inspection by having the participants complete four typical usage scenarios before filling out a questionnaire. The questionnaire was based on the IsoMetrics usability inventory. Direct user interaction with SAM (mouse clicks and pages accessed) was logged. The study analyzed the typical usage patterns and habits of students using a semantic network for accessing MLOs. Four scenarios capturing characteristics of typical tasks to be solved by using SAM yielded high ratings of usability items and showed good results concerning the consistency of indexing by different users. Long-tail phenomena emerge as they are typical for a collaborative Web 2.0 platform. Suitable but nonetheless rarely used keywords were assigned to MLOs by some users. It is possible to develop a Web-based tool with high usability and acceptance for indexing and retrieval of MLOs. SAM can be applied to indexing multicentered repositories of MLOs collaboratively.

Reduction of Burnout in Mental Health Care Providers Using the Provider Resilience Mobile Application.

PubMed

Wood, Amanda Ernst; Prins, Annabel; Bush, Nigel E; Hsia, Jennifer F; Bourn, Laura E; Earley, Michael D; Walser, Robyn D; Ruzek, Josef

2017-05-01

This pilot study examined the usability, acceptability, and effectiveness of a free Provider Resilience (PR) mobile application (app) designed by the National Center for Telehealth and Technology to reduce provider burnout. Outpatient mental health providers (N = 30) used the PR app for 1 month. Participants rated the PR app on the System Usability Scale with an overall score of 79.7, which is in the top quartile for usability. Results of paired sample t tests on the Professional Quality of Life Scale indicated significant decreases on the Burnout (t = 3.65, p < .001) and Compassion Fatigue (t = 4.54, p < .001) subscales. The Provider Resilience app shows promise in reducing burnout and compassion fatigue in mental health care providers.

Usability evaluation of a medication reconciliation tool: Embedding safety probes to assess users' detection of medication discrepancies.

PubMed

Russ, Alissa L; Jahn, Michelle A; Patel, Himalaya; Porter, Brian W; Nguyen, Khoa A; Zillich, Alan J; Linsky, Amy; Simon, Steven R

2018-06-01

An electronic medication reconciliation tool was previously developed by another research team to aid provider-patient communication for medication reconciliation. To evaluate the usability of this tool, we integrated artificial safety probes into standard usability methods. The objective of this article is to describe this method of using safety probes, which enabled us to evaluate how well the tool supports users' detection of medication discrepancies. We completed a mixed-method usability evaluation in a simulated setting with 30 participants: 20 healthcare professionals (HCPs) and 10 patients. We used factual scenarios but embedded three artificial safety probes: (1) a missing medication (i.e., omission); (2) an extraneous medication (i.e., commission); and (3) an inaccurate dose (i.e., dose discrepancy). We measured users' detection of each probe to estimate the probability that a HCP or patient would detect these discrepancies. Additionally, we recorded participants' detection of naturally occurring discrepancies. Each safety probe was detected by ≤50% of HCPs. Patients' detection rates were generally higher. Estimates indicate that a HCP and patient, together, would detect 44.8% of these medication discrepancies. Additionally, HCPs and patients detected 25 and 45 naturally-occurring discrepancies, respectively. Overall, detection of medication discrepancies was low. Findings indicate that more advanced interface designs are warranted. Future research is needed on how technologies can be designed to better aid HCPs' and patients' detection of medication discrepancies. This is one of the first studies to evaluate the usability of a collaborative medication reconciliation tool and assess HCPs' and patients' detection of medication discrepancies. Results demonstrate that embedded safety probes can enhance standard usability methods by measuring additional, clinically-focused usability outcomes. The novel safety probes we used may serve as an initial, standard set for future medication reconciliation research. More prevalent use of safety probes could strengthen usability research for a variety of health information technologies. Published by Elsevier Inc.

APRN Usability Testing of a Tailored Computer-Mediated Health Communication Program

PubMed Central

Lin, Carolyn A.; Neafsey, Patricia J.; Anderson, Elizabeth

2010-01-01

This study tested the usability of a touch-screen enabled “Personal Education Program” (PEP) with Advanced Practice Registered Nurses (APRN). The PEP is designed to enhance medication adherence and reduce adverse self-medication behaviors in older adults with hypertension. An iterative research process was employed, which involved the use of: (1) pre-trial focus groups to guide the design of system information architecture, (2) two different cycles of think-aloud trials to test the software interface, and (3) post-trial focus groups to gather feedback on the think-aloud studies. Results from this iterative usability testing process were utilized to systematically modify and improve the three PEP prototype versions—the pilot, Prototype-1 and Prototype-2. Findings contrasting the two separate think-aloud trials showed that APRN users rated the PEP system usability, system information and system-use satisfaction at a moderately high level between trials. In addition, errors using the interface were reduced by 76 percent and the interface time was reduced by 18.5 percent between the two trials. The usability testing processes employed in this study ensured an interface design adapted to APRNs' needs and preferences to allow them to effectively utilize the computer-mediated health-communication technology in a clinical setting. PMID:19940619

Update on Electronic Dental Record and Clinical Computing Adoption Among Dental Practices in the United States

PubMed Central

Schroeder, Dixie; Schwei, Kelsey; Chyou, Po-Huang

2017-01-01

This study sought to re-characterize trends and factors affecting electronic dental record (EDR) and technologies adoption by dental practices and the impact of the Health Information Technology for Economic and Clinical Health (HITECH) act on adoption rates through 2012. A 39-question survey was disseminated nationally over 3 months using a novel, statistically-modeled approach informed by early response rates to achieve a predetermined sample. EDR adoption rate for clinical support was 52%. Adoption rates were higher among: (1) younger dentists; (2) dentists ≤ 15 years in practice; (3) females; and (4) group practices. Top barriers to adoption were EDR cost/expense, cost-benefit ratio, electronic format conversion, and poor EDR usability. Awareness of the Federal HITECH incentive program was low. The rate of chairside computer implementation was 72%. Adoption of EDR in dental offices in the United States was higher in 2012 than electronic health record adoption rates in medical offices and was not driven by the HITECH program. Patient portal adoption among dental practices in the United States remained low. PMID:29229631

Record completeness and data concordance in an anesthesia information management system using context-sensitive mandatory data-entry fields.

PubMed

Avidan, Alexander; Weissman, Charles

2012-03-01

Use of an anesthesia information management system (AIMS) does not insure record completeness and data accuracy. Mandatory data-entry fields can be used to assure data completeness. However, they are not suited for data that is mandatory depending on the clinical situation (context sensitive). For example, information on equal breath sounds should be mandatory with tracheal intubation, but not with mask ventilation. It was hypothesized that employing context-sensitive mandatory data-entry fields can insure high data-completeness and accuracy while maintaining usability. A commercial off-the-shelf AIMS was enhanced using its built-in VBScript programming tool to build event-driven forms with context-sensitive mandatory data-entry fields. One year after introduction of the system, all anesthesia records were reviewed for data completeness. Data concordance, used as a proxy for accuracy, was evaluated using verifiable age-related data. Additionally, an anonymous satisfaction survey on general acceptance and usability of the AIMS was performed. During the initial 12 months of AIMS use, 12,241 (99.6%) of 12,290 anesthesia records had complete data. Concordances of entered data (weight, size of tracheal tubes, laryngoscopy blades and intravenous catheters) with patients' ages were 98.7-99.9%. The AIMS implementation was deemed successful by 98% of the anesthesiologists. Users rated the AIMS usability in general as very good and the data-entry forms in particular as comfortable. Due to the complexity and the high costs of implementation of an anesthesia information management system it was not possible to compare various system designs (for example with or without context-sensitive mandatory data entry-fields). Therefore, it is possible that a different or simpler design would have yielded the same or even better results. This refers also to the evaluation of usability, since users did not have the opportunity to work with different design approaches or even different computer programs. Using context-sensitive mandatory fields in an anesthesia information management system was associated with high record completeness rate and data concordance. In addition, the system's usability was rated as very good by its users. Copyright © 2011 Elsevier Ireland Ltd. All rights reserved.

Direct Behavior Rating: A Review of the Issues and Research in Its Development

ERIC Educational Resources Information Center

Chafouleas, Sandra M.

2011-01-01

The conceptual foundation for Direct Behavior Rating as a behavior assessment method is reviewed. A contemporary definition of Direct Behavior Rating is framed as combining strengths of systematic direct observation and behavior rating scales, which may result in a usable and defensible assessment tool for educators engaged in formative purposes.…

Interface design recommendations for computerised clinical audit and feedback: Hybrid usability evidence from a research-led system.

PubMed

Brown, Benjamin; Balatsoukas, Panos; Williams, Richard; Sperrin, Matthew; Buchan, Iain

2016-10-01

Audit and Feedback (A&F) is a widely used quality improvement technique that measures clinicians' clinical performance and reports it back to them. Computerised A&F (e-A&F) system interfaces may consist of four key components: (1) Summaries of clinical performance; (2) Patient lists; (3) Patient-level data; (4) Recommended actions. There is a lack of evidence regarding how to best design e-A&F interfaces; establishing such evidence is key to maximising usability, and in turn improving patient safety. To evaluate the usability of a novel theoretically-informed and research-led e-A&F system for primary care (the Performance Improvement plaN GeneratoR: PINGR). (1) Describe PINGR's design, rationale and theoretical basis; (2) Identify usability issues with PINGR; (3) Understand how these issues may interfere with the cognitive goals of end-users; (4) Translate the issues into recommendations for the user-centred design of e-A&F systems. Eight experienced health system evaluators performed a usability inspection using an innovative hybrid approach consisting of five stages: (1) Development of representative user tasks, Goals, and Actions; (2) Combining Heuristic Evaluation and Cognitive Walkthrough methods into a single protocol to identify usability issues; (3) Consolidation of issues; (4) Severity rating of consolidated issues; (5) Analysis of issues according to usability heuristics, interface components, and Goal-Action structure. A final list of 47 issues were categorised into 8 heuristic themes. The most error-prone heuristics were 'Consistency and standards' (13 usability issues; 28% of the total) and 'Match between system and real world' (n=10, 21%). The recommended actions component of the PINGR interface had the most usability issues (n=21, 45%), followed by patient-level data (n=5, 11%), patient lists (n=4, 9%), and summaries of clinical performance (n=4, 9%). The most error-prone Actions across all user Goals were: (1) Patient selection from a list; (2) Data identification from a figure (both population-level and patient-level); (3) Disagreement with a system recommendation. By contextualising our findings within the wider literature on health information system usability, we provide recommendations for the design of e-A&F system interfaces relating to their four key components, in addition to how they may be integrated within a system. Copyright © 2016. Published by Elsevier Ireland Ltd.

Usability Evaluation of Public Web Mapping Sites

NASA Astrophysics Data System (ADS)

Wang, C.

2014-04-01

Web mapping sites are interactive maps that are accessed via Webpages. With the rapid development of Internet and Geographic Information System (GIS) field, public web mapping sites are not foreign to people. Nowadays, people use these web mapping sites for various reasons, in that increasing maps and related map services of web mapping sites are freely available for end users. Thus, increased users of web mapping sites led to more usability studies. Usability Engineering (UE), for instance, is an approach for analyzing and improving the usability of websites through examining and evaluating an interface. In this research, UE method was employed to explore usability problems of four public web mapping sites, analyze the problems quantitatively and provide guidelines for future design based on the test results. Firstly, the development progress for usability studies were described, and simultaneously several usability evaluation methods such as Usability Engineering (UE), User-Centered Design (UCD) and Human-Computer Interaction (HCI) were generally introduced. Then the method and procedure of experiments for the usability test were presented in detail. In this usability evaluation experiment, four public web mapping sites (Google Maps, Bing maps, Mapquest, Yahoo Maps) were chosen as the testing websites. And 42 people, who having different GIS skills (test users or experts), gender (male or female), age and nationality, participated in this test to complete the several test tasks in different teams. The test comprised three parts: a pretest background information questionnaire, several test tasks for quantitative statistics and progress analysis, and a posttest questionnaire. The pretest and posttest questionnaires focused on gaining the verbal explanation of their actions qualitatively. And the design for test tasks targeted at gathering quantitative data for the errors and problems of the websites. Then, the results mainly from the test part were analyzed. The success rate from different public web mapping sites was calculated and compared, and displayed by the means of diagram. And the answers from questionnaires were also classified and organized in this part. Moreover, based on the analysis, this paper expands the discussion about the layout, map visualization, map tools, search logic and etc. Finally, this paper closed with some valuable guidelines and suggestions for the design of public web mapping sites. Also, limitations for this research stated in the end.

Acceptance and usability of a home-based monitoring tool of health indicators in children of people with dementia: a Proof of Principle (POP) study

PubMed Central

Boessen, April BCG; Vermeulen, Joan; de Witte, Luc P

2017-01-01

Background Large-scale cohort studies are needed to confirm the relation between dementia and its possible risk factors. The inclusion of people with dementia in research is a challenge, however, children of people with dementia are at risk and are highly motivated to participate in dementia research. For technologies to support home-based data collection during large-scale studies, participants should be able and willing to use technology for a longer period of time. Objective This study investigated acceptance and usability of iVitality, a research platform for home-based monitoring of dementia health indicators, in 151 children of people with dementia and investigated which frequency of measurements is acceptable for them. Methods Participants were randomized to fortnightly or monthly measurements. At baseline and after 3 months, participants completed an online questionnaire regarding the acceptance (Technology Acceptance Model; 38 items) and usability (Post-Study System Usability Questionnaire; 24 items) of iVitality. Items were rated from 1 (I totally disagree) to 7 (I totally agree). Participants were also invited to take part in an online focus group (OFG) after 3 months of follow-up. Descriptive statistics and both two-sample/independent and paired t-tests were used to analyze the online questionnaires and a directed content analysis was used to analyze the OFGs. Results Children of people with dementia accept iVitality after long-term use and evaluate iVitality as a user-friendly, useful, and trusted technology, despite some suggestions for improvement. Overall, mean scores on acceptance and usability were higher than 5 (I somewhat agree), although the acceptance subscales “social influence” and “time” were rated somewhat lower. No significant differences in acceptance and usability were found between both protocol groups. Over time, “affect” significantly increased among participants measuring blood pressure fortnightly. Conclusion iVitality has the potential to be used in large-scale studies for home-based monitoring of health indicators related to the development of dementia. PMID:28814839

Development and preliminary testing of a web-based, self-help application for disaster-affected families.

PubMed

Yuen, Erica K; Gros, Kirstin; Welsh, Kyleen E; McCauley, Jenna; Resnick, Heidi S; Danielson, Carla K; Price, Matthew; Ruggiero, Kenneth J

2016-09-01

Technology-based self-help interventions have the potential to increase access to evidence-based mental healthcare, especially for families affected by natural disasters. However, development of these interventions is a complex process and poses unique challenges. Usability testing, which assesses the ability of individuals to use an application successfully, can have a significant impact on the quality of a self-help intervention. This article describes (a) the development of a novel web-based multi-module self-help intervention for disaster-affected adolescents and their parents and (b) a mixed-methods formal usability study to evaluate user response. A total of 24 adolescents were observed, videotaped, and interviewed as they used the depressed mood component of the self-help intervention. Quantitative results indicated an above-average user experience, and qualitative analysis identified 120 unique usability issues. We discuss the challenges of developing self-help applications, including design considerations and the value of usability testing in technology-based interventions, as well as our plan for widespread dissemination. © The Author(s) 2015.

Web-Based Intervention for Nutritional Management in Cystic Fibrosis: Development, Usability, and Pilot Trial.

PubMed

Stark, Lori J; Opipari-Arrigan, Lisa; Filigno, Stephanie S; Simon, Stacey L; Leonard, Amanda; Mogayzel, Peter J; Rausch, Joseph; Zion, Cynthia; Powers, Scott W

2016-06-01

Usability and pilot testing of a web intervention (BeInCharge.org [BIC]) of behavior plus nutrition intervention for children with cystic fibrosis (CF) ages 4-9 years. Think Aloud methodology was used with five mothers to assess usability and refine the intervention. A pilot trial was then conducted with 10 mothers of children with CF ages 4-9 years randomized to the web-based BIC or a Standard Care Control (STC). Change in weight gain for each group was compared in a pre-to-post design. Mothers rated the usability and clarity of BIC highly. The pilot trial showed children of mothers who received BIC had a significant change in weight pre-to-post-treatment (0.67 kg, p = .04). Change for the STC was not significant (0.41 kg, p = .10). A web-based behavior plus nutrition intervention appears promising in increasing weight gain in children with CF. © The Author 2015. Published by Oxford University Press on behalf of the Society of Pediatric Psychology. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

The value of usability testing for Internet-based adolescent self-management interventions: “Managing Hemophilia Online”

PubMed Central

2013-01-01

Background As adolescents with hemophilia approach adulthood, they are expected to assume responsibility for their disease management. A bilingual (English and French) Internet-based self-management program, “Teens Taking Charge: Managing Hemophilia Online,” was developed to support adolescents with hemophilia in this transition. This study explored the usability of the website and resulted in refinement of the prototype. Methods A purposive sample (n=18; age 13–18; mean age 15.5 years) was recruited from two tertiary care centers to assess the usability of the program in English and French. Qualitative observations using a “think aloud” usability testing method and semi-structured interviews were conducted in four iterative cycles, with changes to the prototype made as necessary following each cycle. This study was approved by research ethics boards at each site. Results Teens responded positively to the content and appearance of the website and felt that it was easy to navigate and understand. The multimedia components (videos, animations, quizzes) were felt to enrich the experience. Changes to the presentation of content and the website user-interface were made after the first, second and third cycles of testing in English. Cycle four did not result in any further changes. Conclusions Overall, teens found the website to be easy to use. Usability testing identified end-user concerns that informed improvements to the program. Usability testing is a crucial step in the development of Internet-based self-management programs to ensure information is delivered in a manner that is accessible and understood by users. PMID:24094082

Evaluating patient-reported outcome measurement comparability between paper and alternate versions, using the lung function questionnaire as an example.

PubMed

Dalal, Anand A; Nelson, Lauren; Gilligan, Theresa; McLeod, Lori; Lewis, Sandy; DeMuro-Mercon, Carla

2011-01-01

The goal of this study was to provide recommended steps to assess measurement comparability using a crossover study design and to demonstrate these steps using a short patient-reported outcome (PRO) instrument as an example. The example PRO instrument was administered via paper, Web, interactive voice response system, and interview; a randomized crossover design was used to gather data across the multiple administration types. Participants completed the PRO instrument, demographic and health questions, and a short preference questionnaire. Evaluation included comparisons of the item-level responses and agreement, comparison of mean scale scores, score classifications, and questions designed to collect usability and administration preference. Here the authors provide a four-step evaluation guide to evaluate measurement comparability and illustrate these steps using a case-finding tool. In the example, item-level kappa statistics between the paper and the alternate versions ranged from good to excellent, intraclass correlation coefficient for mean scores were above 0.70, and the rate of disagreement ranged from 2% to 14%. In addition, although participants had an administration preference, they reported few difficulties with the versions they were assigned. The steps described in this article provide a guide for evaluating whether to combine scores across administration versions to simplify analyses and interpretation under a crossover design. The guide recommends the investigation of item-level responses, summary scores, and participant usability/preference when comparing versions, with each step providing unique information to support comprehensive evaluation and informed decisions regarding whether to combine data. Copyright © 2011 International Society for Pharmacoeconomics and Outcomes Research (ISPOR). Published by Elsevier Inc. All rights reserved.

Review of free software tools for image analysis of fluorescence cell micrographs.

PubMed

Wiesmann, V; Franz, D; Held, C; Münzenmayer, C; Palmisano, R; Wittenberg, T

2015-01-01

An increasing number of free software tools have been made available for the evaluation of fluorescence cell micrographs. The main users are biologists and related life scientists with no or little knowledge of image processing. In this review, we give an overview of available tools and guidelines about which tools the users should use to segment fluorescence micrographs. We selected 15 free tools and divided them into stand-alone, Matlab-based, ImageJ-based, free demo versions of commercial tools and data sharing tools. The review consists of two parts: First, we developed a criteria catalogue and rated the tools regarding structural requirements, functionality (flexibility, segmentation and image processing filters) and usability (documentation, data management, usability and visualization). Second, we performed an image processing case study with four representative fluorescence micrograph segmentation tasks with figure-ground and cell separation. The tools display a wide range of functionality and usability. In the image processing case study, we were able to perform figure-ground separation in all micrographs using mainly thresholding. Cell separation was not possible with most of the tools, because cell separation methods are provided only by a subset of the tools and are difficult to parametrize and to use. Most important is that the usability matches the functionality of a tool. To be usable, specialized tools with less functionality need to fulfill less usability criteria, whereas multipurpose tools need a well-structured menu and intuitive graphical user interface. © 2014 Fraunhofer-Institute for Integrated Circuits IIS Journal of Microscopy © 2014 Royal Microscopical Society.

Evaluation of the usability of a serious game aiming to teach facial expressions to schizophrenic patients.

PubMed

Isleyen, Filiz; Gulkesen, K Hakan; Cinemre, Buket; Samur, M Kemal; Zayim, Nese; Sen Kaya, Semiha

2014-01-01

In some psychological disorders such as autism and schizophrenia, loss of facial expression recognition skill may complicate patient's daily life. Information technology may help to develop facial expression recognition skill by educational software and games. We designed and developed an interactive web-based educational program with which we performed a usability study before investigating its effectiveness on the schizophrenia patients' ability of emotion perception. The purpose of this study is to describe the usability evaluation for a web-based game set that has been designed to teach facial expressions to schizophrenic patients. The usability study was done at two steps; first, we applied heuristic evaluation and the violations were rated in a scale from most to least severe and the major problems were solved. In the second step, think-aloud method was used and the web site was assessed by five schizophrenic patients. Eight experts participated in the heuristic evaluation, in which a total of 60 violations were identified with a mean severity of 2.77 (range: 0-4). All of the major problems (severity over 2.5) were listed and the usability problems were solved by the development team. After solving the problems, five users with a diagnosis of schizophrenia used the web site with the same scenario. They reported to have experienced minor, but different problems. In conclusion, we suggest that a combination of heuristic evaluation and think-aloud method may be an effective and efficient way for usability evaluations for the serious games that have been designed for special patient groups.

A Mobile App (BEDSide Mobility) to Support Nurses’ Tasks at the Patient's Bedside: Usability Study

PubMed Central

Weinhold, Thomas; Joe, Jonathan; Lovis, Christian; Blondon, Katherine

2018-01-01

Background The introduction of clinical information systems has increased the amount of clinical documentation. Although this documentation generally improves patient safety, it has become a time-consuming task for nurses, which limits their time with the patient. On the basis of a user-centered methodology, we have developed a mobile app named BEDSide Mobility to support nurses in their daily workflow and to facilitate documentation at the bedside. Objective The aim of the study was to assess the usability of the BEDSide Mobility app in terms of the navigation and interaction design through usability testing. Methods Nurses were asked to complete a scenario reflecting their daily work with patients. Their interactions with the app were captured with eye-tracking glasses and by using the think aloud protocol. After completing the tasks, participants filled out the system usability scale questionnaire. Descriptive statistics were used to summarize task completion rates and the users’ performance. Results A total of 10 nurses (aged 21-50) participated in the study. Overall, they were satisfied with the navigation, layout, and interaction design of the app, with the exception of one user who was unfamiliar with smartphones. The problems identified were related to the ambiguity of some icons, the navigation logic, and design inconsistency. Conclusions Besides the usability issues identified in the app, the participants’ results do indicate good usability, high acceptance, and high satisfaction with the developed app. However, the results must be taken with caution because of the poor ecological validity of the experimental setting. PMID:29563074

Graphical Weather Information System Evaluation: Usability, Perceived Utility, and Preferences from General Aviation Pilots

NASA Technical Reports Server (NTRS)

Latorella, Kara A.; Chamberlain, James P.

2002-01-01

Weather is a significant factor in General Aviation (GA) accidents and fatality rates. Graphical Weather Information Systems (GWISs) for the flight deck are appropriate technologies for mitigating the difficulties GA pilots have with current aviation weather information sources. This paper describes usability evaluations of a prototype GWIS by 12 GA pilots after using the system in flights towards convective weather. We provide design guidance for GWISs and discuss further research required to support weather situation awareness and in-flight decision making for GA pilots.

Student Engagement with Assessment and Feedback: Some Lessons from Short-Answer Free-Text E-Assessment Questions

ERIC Educational Resources Information Center

Jordan, Sally

2012-01-01

Students were observed directly, in a usability laboratory, and indirectly, by means of an extensive evaluation of responses, as they attempted interactive computer-marked assessment questions that required free-text responses of up to 20 words and as they amended their responses after receiving feedback. This provided more general insight into…

Technology for home dementia care: A prototype locating system put to the test.

PubMed

Megges, Herlind; Freiesleben, Silka Dawn; Jankowski, Natalie; Haas, Brigitte; Peters, Oliver

2017-09-01

The user experience of persons with dementia and their primary caregivers with locating systems is not firmly established. Eighteen dyads used a prototype locating system during 4 weeks. Primary outcome measures were ratings of usability, and product functions and features. Secondary outcome measures were caregiver burden, perceived self-efficacy, frequency of use, and willingness to purchase the prototype. Changes in scores between baseline (T 1 ) and end of testing period (T 2 ) were compared by performing independent and dependent samples correlations and descriptive statistics. Seventeen dyads made up the final sample. Ratings of usability and product functions and features were fair, but usability ratings were significantly reduced after 4 weeks. Although the prototype was used infrequently by majority of the participants, most caregivers would be willing to purchase the prototype, with men more willing than women. No significant change in technological willingness, caregiver burden, or perceived self-efficacy was found between T 1 and T 2 . Perceived self-efficacy significantly negatively correlated with willingness to purchase the prototype after 4 weeks. Results highlight the importance of including end users in the research and development phase of locating systems to improve the user experience in home dementia care. Necessary indications for further research are carrying out randomized controlled trials with larger, more representative samples and developing innovative software and hardware solutions.

Feasibility Study of an Interactive Multimedia Electronic Problem Solving Treatment Program for Depression: A Preliminary Uncontrolled Trial

PubMed Central

Berman, Margit I.; Jr., Jay C. Buckey; Hull, Jay G.; Linardatos, Eftihia; Song, Sueyoung L.; McLellan, Robert K.; Hegel, Mark T.

2014-01-01

Computer-based depression interventions lacking live therapist support have difficulty engaging users. This study evaluated the usability, acceptability, credibility, therapeutic alliance and efficacy of a stand-alone multimedia, interactive, computer-based Problem Solving Treatment program (ePST™) for depression. The program simulated live treatment from an expert PST therapist, and delivered 6 ePST™ sessions over 9 weeks. Twenty-nine participants with moderate-severe symptoms received the intervention; 23 completed a mini mally adequate dose of ePST™ (at least 4 sessions). Program usability, acceptability, credibility, and therapeutic alliance were assessed at treatment midpoint and endpoint. Depressive symptoms and health-related functioning were assessed at baseline, treatment midpoint (4 weeks), and study endpoint (10 weeks). Depression outcomes and therapeutic alliance ratings were also compared to previously published research on live PST and computer-based depression therapy. Participants rated the program as highly usable, acceptable, and credible, and reported a therapeutic alliance with the program comparable to that observed in live therapy. Depressive symptoms improved significantly over time. These findings also provide preliminary evidence that ePST™ may be effective as a depression treatment. Larger clinical trials with diverse samples are indicated. PMID:24680231

Investigating the Usability and Acute Effects of a Bedside Video Console to Prefrontal Cortical Activity Alterations: A Preclinical Study in Healthy Elderly

PubMed Central

Knols, Ruud H.; Swanenburg, Jaap; De Bon, Dino; Gennaro, Federico; Wolf, Martin; Krüger, Bernard; Bettex, Dominique; de Bruin, Eling D.

2017-01-01

Elderly people at risk of developing cognitive decline; e.g., following surgery, may benefit from structured, challenging, and repetitive cognitive video training. This study assessed usability and acute effects of a newly developed bedside console (COPHYCON). Fifteen healthy elderly individuals performed a one-time 80-min intervention, including cognitive video games aimed at improving awareness and selective attention. Perceived usefulness and perceived ease of use (Technology Acceptance Model) were assessed together with measures of the achieved game level, reaction times, (in-) correct responses during ALERT and SELECT game play. Further, prefrontal cortical involvement of the regional cerebral hemoglobin saturation (rS02%) assessed with functional near infrared spectroscopy (fNIRS) (n = 5) and EEG power (n = 10) was analyzed. All participants completed the study without any adverse events. Perceived usefulness and perceived ease of use (TAM scores range 1–7) of the system varied between 3.9 and 6.3. The game levels reached for awareness varied between 9 and 11 (initial score 8–10), for reaction speed between 439 and 469 ms, and for correct responses between 74.1 and 78.8%. The highest level for the selective attention games was 2 (initial score 1), where reaction speed varied between 439 and 469 ms, correct responses between 96.2 and 98.5%, respectively. The decrease of rS02% in the right prefrontal cortex during gameplay was significantly (p < 0.001) lower, compared to the left prefrontal cortex. Four participants yielded significant lower rS02% measures after exergaming with the ALERT games (p < 0.000), but not with the SELECT games. EEG recordings of theta power significantly decreased in the averaged ~0.25–0.75 time interval for the left prefrontal cortex sensor across the cognitive game levels between the ALERT 1 and SELECT 1, as well as between SELECT 1 and 2 games. Participants rated the usability of the COPHYCON training positively. Further results indicate that video gaming may be an effective measure to affect prefrontal cortical functioning in elderly. The results warrant a clinical explorative study investigating the feasibility of the COPHYCON in a clinical setting. PMID:29234277

Less is more: development and evaluation of an interactive e-atlas to support anatomy learning.

PubMed

Guy, Richard; Pisani, Heather R; Rich, Peter; Leahy, Cathy; Mandarano, Giovanni; Molyneux, Tom

2015-01-01

An Interactive electronic Atlas (IeA) was developed to assist first-year nursing students with interpretation of laboratory-based prosected cadaveric material. It was designed, using pedagogically sound principles, as a student-centered resource accessible to students from a wide range of learning backgrounds. It consisted of a highly simplified interactive interface limited to essential anatomical structures and was intended for use in a blended learning situation. The IeA's nine modules mirrored the body systems covered in a Nursing Biosciences course, with each module comprising a maximum of 10 pages using the same template: an image displaying a cadaveric specimen and, in most cases, a corresponding anatomical model with navigation panes (menus) on one side. Cursor movement over the image or clicking the menu highlighted the structure with a transparent overlay and revealed a succinct functional description. The atlas was complemented by a multiple-choice database of nearly 1,000 questions using IeA images. Students' perceptions of usability and utility were measured by survey (n = 115; 57% of the class) revealing mean access of 2.3 times per week during the 12-week semester and a median time of three hours of use. Ratings for usability and utility were high, with means ranging between 4.24 and 4.54 (five-point Likert scale; 5 = strongly agree). Written responses told a similar story for both usability and utility. The role of providing basic computer-assisted learning support for a large first-year class is discussed in the context of current research into student-centered resources and blended learning in human anatomy. © 2014 American Association of Anatomists.

Development of a Wearable Cardiac Monitoring System for Behavioral Neurocardiac Training: A Usability Study

PubMed Central

Morita, Plinio P; Tallevi, Kevin; Armour, Kevin; Li, John; Nolan, Robert P; Cafazzo, Joseph A

2016-01-01

Background Elevated blood pressure is one of the main risk factors for death globally. Behavioral neurocardiac training (BNT) is a complementary approach to blood pressure and stress management that is intended to exercise the autonomic reflexes, improve stress recovery, and lower blood pressure. BNT involves cognitive-behavioral therapy with a paced breathing technique and heart rate variability biofeedback. BNT is limited to in-clinic delivery and faces an accessibility barrier because of the need for clinical oversight and the use of complex monitoring tools. Objective The objective of this project was to design, develop, and evaluate a wearable electrocardiographic (ECG) sensor system for the delivery of BNT in a home setting. Methods The wearable sensor system, Beat, consists of an ECG sensor and a mobile app. It was developed iteratively using the principles of test-driven Agile development and user-centered design. A usability study was conducted at Toronto General Hospital to evaluate feasibility and user experience and identify areas of improvement. Results The Beatsensor was designed as a modular patch to be worn on the user’s chest and uses standard ECG electrodes. It streams a single-lead ECG wirelessly to a mobile phone using Bluetooth Low Energy. The use of small, low-power electronics, a low device profile, and a tapered enclosure allowed for a device that can be unobtrusively worn under clothing. The sensor was designed to operate with a mobile app that guides users through the BNT exercises to train them to a slow-paced breathing technique for stress recovery. The BNT app uses the ECG captured by the sensor to provide heart rate variability biofeedback in the form of a real-time heart rate waveform to complement and reinforce the impact of the training. Usability testing (n=6) indicated that the overall response to the design and user experience of the system was perceived positively. All participants indicated that the system had a positive effect on stress management and that they would use it at home. Areas of improvement were identified, which focused primarily on the delivery of training and education on BNT through the app. Conclusions The outcome of this project was a wearable sensor system to deliver BNT at home. The system has the potential to offer a complementary approach to blood pressure and stress management at home and reduce current accessibility barriers. PMID:27106171

Development of a Wearable Cardiac Monitoring System for Behavioral Neurocardiac Training: A Usability Study.

PubMed

Uddin, Akib A; Morita, Plinio P; Tallevi, Kevin; Armour, Kevin; Li, John; Nolan, Robert P; Cafazzo, Joseph A

2016-04-22

Elevated blood pressure is one of the main risk factors for death globally. Behavioral neurocardiac training (BNT) is a complementary approach to blood pressure and stress management that is intended to exercise the autonomic reflexes, improve stress recovery, and lower blood pressure. BNT involves cognitive-behavioral therapy with a paced breathing technique and heart rate variability biofeedback. BNT is limited to in-clinic delivery and faces an accessibility barrier because of the need for clinical oversight and the use of complex monitoring tools. The objective of this project was to design, develop, and evaluate a wearable electrocardiographic (ECG) sensor system for the delivery of BNT in a home setting. The wearable sensor system, Beat, consists of an ECG sensor and a mobile app. It was developed iteratively using the principles of test-driven Agile development and user-centered design. A usability study was conducted at Toronto General Hospital to evaluate feasibility and user experience and identify areas of improvement. The Beat sensor was designed as a modular patch to be worn on the user's chest and uses standard ECG electrodes. It streams a single-lead ECG wirelessly to a mobile phone using Bluetooth Low Energy. The use of small, low-power electronics, a low device profile, and a tapered enclosure allowed for a device that can be unobtrusively worn under clothing. The sensor was designed to operate with a mobile app that guides users through the BNT exercises to train them to a slow-paced breathing technique for stress recovery. The BNT app uses the ECG captured by the sensor to provide heart rate variability biofeedback in the form of a real-time heart rate waveform to complement and reinforce the impact of the training. Usability testing (n=6) indicated that the overall response to the design and user experience of the system was perceived positively. All participants indicated that the system had a positive effect on stress management and that they would use it at home. Areas of improvement were identified, which focused primarily on the delivery of training and education on BNT through the app. The outcome of this project was a wearable sensor system to deliver BNT at home. The system has the potential to offer a complementary approach to blood pressure and stress management at home and reduce current accessibility barriers.

Electronic physiologic and subjective data acquisition in home-dwelling heart failure patients: An assessment of patient use and perception of usability.

PubMed

Gardner, Cubby L; Flanagan, Michael C; Franklin, Cathy; John-Swayers, Cherly; Walsh-Pouch, Stacy; Bryant, F Joyce; Romano, Carol A; Gibbons, Susanne; De Jong, Marla; Hoang, Albert; Becher, Dorothy; Burke, Harry B

2016-09-01

The current approach to the outpatient management of heart failure involves patients recollecting what has happened to them since their last clinic visit. But patients' recollection of their symptoms may not be sufficiently accurate to optimally manage their disease. Most of what is known about heart failure is related to patients' diurnal symptoms and activities. Some mobile electronic technologies can operate continuously to collect data from the time patients go to bed until they get up in the morning. We were therefore interested to evaluate if patients would use a system of selected patient-facing devices to collect physiologic and subjective state data in and around the patients' period of sleep, and if there were differences in device use and perceptions of usability at the device level This descriptive observational study of home-dwelling patients with heart failure, between 21 and 90 years of age, enrolled in an outpatient heart failure clinic was conducted between December 2014 and June 2015. Patients received five devices, namely, body weight scale, blood pressure device, an iPad-based subjective states assessment, pulse oximeter, and actigraph, to collect their physiologic (body weight, blood pressure, heart rate, blood oxygen saturation, and physical activity) and subjective state data (symptoms and subjective states) at home for the next six consecutive nights. Use was defined as the ratio of observed use over expected use, where 1.0 is observed equals expected. Usability was determined by the overall System Usability Scale score. Participants were 39 clinical heart failure patients, mean age 68.1 (SD, 12.3), 72% male, 62% African American. The ratio of observed over expected use for the body weight scale, blood pressure device, iPad application, pulse oximeter and actigraph was 0.8, 1.0, 1.1, 0.9, and 1.9, respectively. The mean overall System Usability Scale score for each device were 84.5, 89.7, 85.7, 87.6, and 85.2, respectively. Patients were able to use all of the devices and they rated the usability of all the devices higher than expected. Our study provides support for at-home patient-collected physiologic and subjective state data. To our knowledge, this is the first study to assess the use and usability of electronic objective and subjective data collection devices in heart failure patients' homes overnight. Published by Elsevier Ireland Ltd.

A new method for overhead drilling.

PubMed

Rempel, David; Star, Demetra; Barr, Alan; Gibbons, Billy; Janowitz, Ira

2009-12-01

In the construction sector, overhead drilling into concrete or metal ceilings is a strenuous task associated with shoulder, neck and back musculoskeletal disorders due to the large applied forces and awkward arm postures. Two intervention devices, an inverted drill press and a foot lever design, were developed then compared to the usual method by construction workers performing their normal overhead drilling activities (n = 14). While the intervention devices were rated as less fatiguing than the usual method, their ratings on usability measures were worse than the usual method. The study demonstrates that the intervention devices can reduce fatigue; however, additional modifications are necessary in order to improve usability and productivity. Devices designed to improve workplace safety may need to undergo several rounds of field testing and modification prior to implementation.

9 CFR 55.23 - Responsibilities of States and enrolled herd owners.

Code of Federal Regulations, 2013 CFR

2013-01-01

... testing in accordance with instructions from the APHIS or State representative. In cases where animals... will investigate whether the unavailability of animals or usable samples for testing constitutes a... 9 Animals and Animal Products 1 2013-01-01 2013-01-01 false Responsibilities of States and...

9 CFR 55.23 - Responsibilities of States and enrolled herd owners.

Code of Federal Regulations, 2014 CFR

2014-01-01

... testing in accordance with instructions from the APHIS or State representative. In cases where animals... will investigate whether the unavailability of animals or usable samples for testing constitutes a... 9 Animals and Animal Products 1 2014-01-01 2014-01-01 false Responsibilities of States and...

Income and Expenditures of Arizona Postsecondary Students.

ERIC Educational Resources Information Center

Erbschloe, R. Ross; And Others

Results of a spring 1983 survey of the sources and amounts of income, the expenditures, and the background characteristics of Arizona postsecondary students are presented. Survey questionnaires were sent to 4,821 randomly selected students at 36 schools, and 1,694 usable responses were obtained. The responses were cross-analyzed by four…

HISTORICAL DEVELOPMENTS AFFECTING AMERICAN EDUCATIONAL PROCESSES.

ERIC Educational Resources Information Center

KNOWLES, LAURENCE W.; THOMSON, W. SCOTT

QUESTIONNAIRES (1,000) WERE MAILED TO SCHOOL DISTRICTS IN THE 50 STATES. THE FINAL SAMPLE GROUP CONSISTED OF 350 USABLE RESPONSES. THE STUDY DEALT WITH THE CONSTITUTIONAL RIGHTS AND RESPONSIBILITIES OF STUDENTS, TEACHERS, AND SCHOOL ADMINISTRATORS. PERSONAL INTERVIEWS SUPPLEMENTED THE QUESTIONNAIRES. THE MAJOR TOPICS OF INQUIRY WERE (1) FREEDOM OF…

Usability/Sentiment for the Enterprise and ENTERPRISE

NASA Technical Reports Server (NTRS)

Meza, David; Berndt, Sarah

2014-01-01

The purpose of the Sentiment of Search Study for NASA Johnson Space Center (JSC) is to gain insight into the intranet search environment. With an initial usability survey, the authors were able to determine a usability score based on the Systems Usability Scale (SUS). Created in 1986, the freely available, well cited, SUS is commonly used to determine user perceptions of a system (in this case the intranet search environment). As with any improvement initiative, one must first examine and document the current reality of the situation. In this scenario, a method was needed to determine the usability of a search interface in addition to the user's perception on how well the search system was providing results. The use of the SUS provided a mechanism to quickly ascertain information in both areas, by adding one additional open-ended question at the end. The first ten questions allowed us to examine the usability of the system, while the last questions informed us on how the users rated the performance of the search results. The final analysis provides us with a better understanding of the current situation and areas to focus on for improvement. The power of search applications to enhance knowledge transfer is indisputable. The performance impact for any user unable to find needed information undermines project lifecycle, resource and scheduling requirements. Ever-increasing complexity of content and the user interface make usability considerations for the intranet, especially for search, a necessity instead of a 'nice-to-have'. Despite these arguments, intranet usability is largely disregarded due to lack of attention beyond the functionality of the infrastructure (White, 2013). The data collected from users of the JSC search system revealed their overall sentiment by means of the widely-known System Usability Scale. Results of the scores suggest 75%, +/-0.04, of the population rank the search system below average. In terms of a grading scaled, this equated to D or lower. It is obvious JSC users are not satisfied with the current situation, however they are eager to provide information and assistance in improving the search system. A majority of the respondents provided feedback on the issues most troubling them. This information will be used to enrich the next phase, root cause analysis and solution creation.

Society of Pediatric Psychology Workforce Survey: Factors Related to Compensation of Pediatric Psychologists

PubMed Central

Brosig, Cheryl L.; Hilliard, Marisa E.; Williams, Andre; Armstrong, F. Daniel; Christidis, Peggy; Kichler, Jessica; Pendley, Jennifer Shroff; Stamm, Karen E.; Wysocki, Tim

2017-01-01

Abstract Objective To summarize compensation results from the 2015 Society of Pediatric Psychology (SPP) Workforce Survey and identify factors related to compensation of pediatric psychologists. Methods All full members of SPP (n = 1,314) received the online Workforce Survey; 404 (32%) were returned with usable data. The survey assessed salary, benefits, and other income sources. The relationship between demographic and employment-related factors and overall compensation was explored. Results Academic rank, level of administrative responsibility, and cost of living index of employment location were associated with compensation. Compensation did not vary by gender; however, women were disproportionately represented at the assistant and associate professor level. Conclusions Compensation of pediatric psychologists is related to multiple factors. Longitudinal administration of the Workforce Survey is needed to determine changes in compensation and career advancement for this profession over time. Strategies to increase the response rate of future Workforce Surveys are discussed. PMID:28369549

Safety and usability evaluation of a web-based insulin self-titration system for patients with type 2 diabetes mellitus.

PubMed

Simon, Airin C R; Holleman, Frits; Gude, Wouter T; Hoekstra, Joost B L; Peute, Linda W; Jaspers, Monique W M; Peek, Niels

2013-09-01

The rising incidence of type 2 diabetes mellitus (T2DM) induces severe challenges for the health care system. Our research group developed a web-based system named PANDIT that provides T2DM patients with insulin dosing advice using state of the art clinical decision support technology. The PANDIT interface resembles a glucose diary and provides advice through pop-up messages. Diabetes nurses (DNs) also have access to the system, allowing them to intervene when needed. The objective of this study was to establish whether T2DM patients can safely use PANDIT at home. To this end, we assessed whether patients experience usability problems with a high risk of compromising patient safety when interacting with the system, and whether PANDIT's insulin dosing advice are clinically safe. The study population consisted of patients with T2DM (aged 18-80) who used a once daily basal insulin as well as DNs from a university hospital. The usability evaluation consisted of think-aloud sessions with four patients and three DNs. Video data, audio data and verbal utterances were analyzed for usability problems encountered during PANDIT interactions. Usability problems were rated by a physician and a usability expert according to their potential impact on patient safety. The usability evaluation was followed by an implementation with a duration of four weeks. This implementation took place at the patients' homes with ten patients to evaluate clinical safety of PANDIT advice. PANDIT advice were systematically compared with DN advice. Deviating advice were evaluated with respect to patient safety by a panel of experienced physicians, which specialized in diabetes care. We detected seventeen unique usability problems, none of which was judged to have a high risk of compromising patient safety. Most usability problems concerned the lay-out of the diary, which did not clearly indicate which data entry fields had to be entered in order to obtain an advice. 27 out of 74 (36.5%) PANDIT advice differed from those provided by DNs. However, only one of these (1.4%) was considered unsafe by the panel. T2DM patients with no prior experience with the web-based self-management system were capable of consulting the system without encountering significant usability problems. Furthermore, the large majority of PANDIT advice were considered clinically safe according to the expert panel. One advice was considered unsafe. This could however easily be corrected by implementing a small modification to the system's knowledge base. Copyright © 2013 Elsevier B.V. All rights reserved.

Heuristic evaluation of online COPD respiratory therapy and education video resource center.

PubMed

Stellefson, Michael; Chaney, Beth; Chaney, Don

2014-10-01

Abstract Purpose: Because of limited accessibility to pulmonary rehabilitation programs, patients with chronic obstructive pulmonary disease (COPD) are infrequently provided with patient education resources. To help educate patients with COPD on how to live a better life with diminished breathing capacity, we developed a novel social media resource center containing COPD respiratory therapy and education videos called "COPDFlix." A heuristic evaluation of COPDFlix was conducted as part of a larger study to determine whether the prototype was successful in adhering to formal Web site usability guidelines for older adults. A purposive sample of three experts, with expertise in Web design and health communications technology, was recruited (a) to identify usability violations and (b) to propose solutions to improve the functionality of the COPDFlix prototype. Each expert evaluated 18 heuristics in four categories of task-based criteria (i.e., interaction and navigation, information architecture, presentation design, and information design). Seventy-six subcriteria across these four categories were assessed. Quantitative ratings and qualitative comments from each expert were compiled into a single master list, noting the violated heuristic and type/location of problem(s). Sixty-one usability violations were identified across the 18 heuristics. Evaluators rated the majority of heuristic subcriteria as either a "minor hindrance" (n=32) or "no problem" (n=132). Moreover, only 2 of the 18 heuristic categories were noted as "major" violations, with mean severity scores of ≥3. Mixed-methods data analysis helped the multidisciplinary research team to categorize and prioritize usability problems and solutions, leading to 26 discrete design modifications within the COPDFlix prototype.

Development of a Just-in-Time Adaptive mHealth Intervention for Insomnia: Usability Study.

PubMed

Pulantara, I Wayan; Parmanto, Bambang; Germain, Anne

2018-05-17

Healthy sleep is a fundamental component of physical and brain health. Insomnia, however, is a prevalent sleep disorder that compromises functioning, productivity, and health. Therefore, developing efficient treatment delivery methods for insomnia can have significant societal and personal health impacts. Cognitive behavioral therapy for insomnia (CBTI) is the recommended first-line treatment of insomnia but access is currently limited for patients, since treatment must occur in specialty sleep clinics, which suffer from an insufficient number of trained clinicians. Smartphone-based interventions offer a promising means for improving the delivery of CBTI. Furthermore, novel features such as real-time monitoring and assessment, personalization, dynamic adaptations of the intervention, and context awareness can enhance treatment personalization and effectiveness, and reduce associated costs. Ultimately, this "Just in Time Adaptive Intervention" for insomnia-an intervention approach that is acceptable to patients and clinicians, and is based on mobile health (mHealth) platform and tools-can significantly improve patient access and clinician delivery of evidence-based insomnia treatments. This study aims to develop and assess the usability of a Just in Time Adaptive Intervention application platform called iREST ("interactive Resilience Enhancing Sleep Tactics") for use in behavioral insomnia interventions. iREST can be used by both patients and clinicians. The development of iREST was based on the Iterative and Incremental Development software development model. Requirement analysis was based on the case study's description, workflow and needs, clinician inputs, and a previously conducted BBTI military study/implementation of the Just in Time Adaptive Intervention architecture. To evaluate the usability of the iREST mHealth tool, a pilot usability study was conducted. Additionally, this study explores the feasibility of using an off-the-shelf wearable device to supplement the subjective assessment of patient sleep patterns. The iREST app was developed from the mobile logical architecture of Just in Time Adaptive Intervention. It consists of a cross-platform smartphone app, a clinician portal, and secure 2-way communications platform between the app and the portal. The usability study comprised 19 Active Duty Service Members and Veterans between the ages of 18 and 60. Descriptive statistics based on in-app questionnaires indicate that on average, 12 (mean 12.23, SD 8.96) unique devices accessed the clinician portal per day for more than two years, while the app was rated as "highly usable", achieving a mean System Usability Score score of 85.74 (SD 12.37), which translates to an adjective rating of "Excellent". The participants also gave high scores on "ease of use and learnability" with an average score of 4.33 (SD 0.65) on a scale of 1 to 5. iREST provides a feasible platform for the implementation of Just in Time Adaptive Intervention in mHealth-based and remote intervention settings. The system was rated highly usable and its cross-platformness made it readily implemented within the heavily segregated smartphone market. The use of wearables to track sleep is promising; yet the accuracy of this technology needs further improvement. Ultimately, iREST demonstrates that mHealth-based Just in Time Adaptive Intervention is not only feasible, but also works effectively. ©I Wayan Pulantara, Bambang Parmanto, Anne Germain. Originally published in JMIR Human Factors (http://humanfactors.jmir.org), 17.05.2018.

Off-Setting Differences in Reviewer Stringency.

ERIC Educational Resources Information Center

Cason, Carolyn L.; And Others

A total of 1,071 rating sheets were completed by individual reviewers evaluating abstracts submitted to Sigma Theta Tau International Honor Society for the International Research Congress in Edinburgh, Scotland. Only 972 sheets contained usable data. Reviewers indicated a total of 12 ratings with possible comments for each abstract on machine…

Standards for Instrument Migration When Implementing Paper Patient-Reported Outcome Instruments Electronically: Recommendations from a Qualitative Synthesis of Cognitive Interview and Usability Studies.

PubMed

Muehlhausen, Willie; Byrom, Bill; Skerritt, Barbara; McCarthy, Marie; McDowell, Bryan; Sohn, Jeremy

2018-01-01

To synthesize the findings of cognitive interview and usability studies performed to assess the measurement equivalence of patient-reported outcome (PRO) instruments migrated from paper to electronic formats (ePRO), and make recommendations regarding future migration validation requirements and ePRO design best practice. We synthesized findings from all cognitive interview and usability studies performed by a contract research organization between 2012 and 2015: 53 studies comprising 68 unique instruments and 101 instrument evaluations. We summarized study findings to make recommendations for best practice and future validation requirements. Five studies (9%) identified minor findings during cognitive interview that may possibly affect instrument measurement properties. All findings could be addressed by application of ePRO best practice, such as eliminating scrolling, ensuring appropriate font size, ensuring suitable thickness of visual analogue scale lines, and providing suitable instructions. Similarly, regarding solution usability, 49 of the 53 studies (92%) recommended no changes in display clarity, navigation, operation, and completion without help. Reported usability findings could be eliminated by following good product design such as the size, location, and responsiveness of navigation buttons. With the benefit of accumulating evidence, it is possible to relax the need to routinely conduct cognitive interview and usability studies when implementing minor changes during instrument migration. Application of design best practice and selecting vendor solutions with good user interface and user experience properties that have been assessed in a representative group may enable many instrument migrations to be accepted without formal validation studies by instead conducting a structured expert screen review. Copyright © 2018 International Society for Pharmacoeconomics and Outcomes Research (ISPOR). Published by Elsevier Inc. All rights reserved.

Development of a Web-based Family Intervention for BRCA Carriers and Their Biological Relatives: Acceptability, Feasibility, and Usability Study.

PubMed

Katapodi, Maria C; Jung, Miyeon; Schafenacker, Ann M; Milliron, Kara J; Mendelsohn-Victor, Kari E; Merajver, Sofia D; Northouse, Laurel L

2018-04-13

Carriers of breast cancer gene (BRCA) mutations are asked to communicate genetic test results to their biological relatives to increase awareness of cancer risk and promote use of genetic services. This process is highly variable from family to family. Interventions that support communication of genetic test results, coping, and offer decision support in families harboring a pathogenic variant may contribute to effective management of hereditary cancer. The aim of this paper was to describe the development of the Family Gene Toolkit, a Web-based intervention targeting BRCA carriers and untested blood relatives, designed to enhance coping, family communication, and decision making. We present findings from focus groups regarding intervention acceptability and participant satisfaction and from a pre-post pilot study with random allocation to a wait-listed control group regarding intervention feasibility and usability. The Family Gene Toolkit was developed by a multidisciplinary team as a psycho-educational and skills-building intervention. It includes two live webinar sessions and a follow-up phone call guided by a certified genetic counselor and a master's prepared oncology nurse. Each live webinar includes two modules (total four modules) presenting information about BRCA mutations, a decision aid for genetic testing, and two skill-building modules for effective coping and family communication. Participants in focus groups (n=11) were highly satisfied with the intervention, reporting it to be useful and describing clearly the important issues. From the 12 dyads recruited in the pre-post pilot study (response rate 12/52, 23%), completion rate was 71% (10/14) for intervention and 40% (4/10) for wait-listed control groups. Acceptability and satisfaction with the Family Gene Toolkit is high. On the basis of the findings from usability and feasibility testing, modifications on timing, delivery mode, and recruitment methods have been implemented. ClinicalTrials.gov NCT02154633; https://clinicaltrials.gov/ct2/show/NCT02154633 (Archived by WebCite at http://www.webcitation.org/6yYNvLPjv). ©Maria C Katapodi, Miyeon Jung, Ann M Schafenacker, Kara J Milliron, Kari E Mendelsohn-Victor, Sofia D Merajver, Laurel L Northouse. Originally published in JMIR Cancer (http://cancer.jmir.org), 13.04.2018.

Sensitivity, reliability and the effects of diurnal variation on a test battery of field usable upper limb fatigue measures.

PubMed

Yung, Marcus; Wells, Richard P

2017-07-01

Fatigue has been linked to deficits in production quality and productivity and, if of long duration, work-related musculoskeletal disorders. It may thus be a useful risk indicator and design and evaluation tool. However, there is limited information on the test-retest reliability, the sensitivity and the effects of diurnal fluctuation on field usable fatigue measures. This study reports on an evaluation of 11 measurement tools and their 14 parameters. Eight measures were found to have test-retest ICC values greater than 0.8. Four measures were particularly responsive during an intermittent fatiguing condition. However, two responsive measures demonstrated rhythmic behaviour, with significant time effects from 08:00 to mid-afternoon and early evening. Action tremor, muscle mechanomyography and perceived fatigue were found to be most reliable and most responsive; but additional analytical considerations might be required when interpreting daylong responses of MMG and action tremor. Practitioner Summary: This paper presents findings from test-retest and daylong reliability and responsiveness evaluations of 11 fatigue measures. This paper suggests that action tremor, muscle mechanomyography and perceived fatigue were most reliable and most responsive. However, mechanomyography and action tremor may be susceptible to diurnal changes.

Developing an Android-Based Patient Decision Aid Based on Ottawa Standards for Patients After Kidney Transplant and Its Usability Evaluation.

PubMed

Zare Moayedi, Mahboobeh; Aslani, Azam; Fakhrahmad, Mostafa; Ezzatzadegan J, Shahrokh

2018-01-01

This study was conducted to develop an android based patient decision aid (PDA) as a self-care instrument for patients after kidney transplant and its usability evaluation. In this study, the systematic development process of Android-based self-care application for patients after kidney transplant based on Ottawa standard was included: scoping, assemble steering group, analysis of requirements, designing, develop of a prototype and system evaluation. The PDA is a self-triage system that will help early identification of risk symptoms in patients, and help manage them. System recommendations for risk signs are: Refer to the nearest hospital or healthcare center without delay, refer to the doctor and tell your doctor in the next visit. To identify patient care needs, a semi-structured interview with members of steering group, including patients and clinical experts, was conducted by the researchers. A prototype of the decision aid was made according to identified needs in the previous step. Finally, in order to evaluate its usability rate by using the System Usability Scale (SUS) questionnaire, it was used by exerts and patients. This study identified information needs, risk signs and steps that patients need to make appropriate decisions about them. The main capabilities of the decision aid are features such as reminders for appointment/test, time of taking medication, registration of symptoms, weight, blood pressure, body temperature, advising to patient in case of signs of risk, weight, blood pressure, body temperature and test results which were reported in the diagram. The mean score of system's usability evaluated by medical informatics specialists, clinicians, and patients were 88.33, 95, and 91. PDAs was usable and desirable from the point of view of medical informatics specialists, clinicians and patients.

A Mobile App (BEDSide Mobility) to Support Nurses' Tasks at the Patient's Bedside: Usability Study.

PubMed

Ehrler, Frederic; Weinhold, Thomas; Joe, Jonathan; Lovis, Christian; Blondon, Katherine

2018-03-21

The introduction of clinical information systems has increased the amount of clinical documentation. Although this documentation generally improves patient safety, it has become a time-consuming task for nurses, which limits their time with the patient. On the basis of a user-centered methodology, we have developed a mobile app named BEDSide Mobility to support nurses in their daily workflow and to facilitate documentation at the bedside. The aim of the study was to assess the usability of the BEDSide Mobility app in terms of the navigation and interaction design through usability testing. Nurses were asked to complete a scenario reflecting their daily work with patients. Their interactions with the app were captured with eye-tracking glasses and by using the think aloud protocol. After completing the tasks, participants filled out the system usability scale questionnaire. Descriptive statistics were used to summarize task completion rates and the users' performance. A total of 10 nurses (aged 21-50) participated in the study. Overall, they were satisfied with the navigation, layout, and interaction design of the app, with the exception of one user who was unfamiliar with smartphones. The problems identified were related to the ambiguity of some icons, the navigation logic, and design inconsistency. Besides the usability issues identified in the app, the participants' results do indicate good usability, high acceptance, and high satisfaction with the developed app. However, the results must be taken with caution because of the poor ecological validity of the experimental setting. ©Frederic Ehrler, Thomas Weinhold, Jonathan Joe, Christian Lovis, Katherine Blondon. Originally published in JMIR Mhealth and Uhealth (http://mhealth.jmir.org), 21.03.2018.

Digital casts in orthodontics: a comparison of 4 software systems.

PubMed

Westerlund, Anna; Tancredi, Weronika; Ransjö, Maria; Bresin, Andrea; Psonis, Spyros; Torgersson, Olof

2015-04-01

The introduction of digital cast models is inevitable in the otherwise digitized everyday life of orthodontics. The introduction of this new technology, however, is not straightforward, and selecting an appropriate system can be difficult. The aim of the study was to compare 4 orthodontic digital software systems regarding service, features, and usability. Information regarding service offered by the companies was obtained from questionnaires and Web sites. The features of each software system were collected by exploring the user manuals and the software programs. Replicas of pretreatment casts were sent to Cadent (OrthoCAD; Cadent, Carlstadt, NJ), OthoLab (O3DM; OrthoLab, Poznan, Poland), OrthoProof (DigiModel; OrthoProof, Nieuwegein, The Netherlands), and 3Shape (OrthoAnalyzer; 3Shape, Copenhagen, Denmark). The usability of the programs was assessed by experts in interaction design and usability using the "enhanced cognitive walkthrough" method: 4 tasks were defined and performed by a group of domain experts while they were observed by usability experts. The services provided by the companies were similar. Regarding the features, all 4 systems were able to perform basic measurements; however, not all provided the peer assessment rating index or the American Board of Orthodontics analysis, simulation of the treatment with braces, or digital articulation of the casts. All systems demonstrated weaknesses in usability. However, OrthoCAD and 03DM were considered to be easier to learn for first-time users. In general, the usability of these programs was poor and needs to be further developed. Hands-on training supervised by the program experts is recommended for beginners. Copyright © 2015 American Association of Orthodontists. Published by Elsevier Inc. All rights reserved.

Nurses' perceptions and problems in the usability of a medication safety app.

PubMed

Ankem, Kalyani; Cho, Sookyung; Simpson, Diana

2017-10-16

The majority of medication apps support medication adherence. Equally, if not more important, is medication safety. Few apps report on medication safety, and fewer studies have been conducted with these apps. The usability of a medication safety app was tested with nurses to reveal their perceptions of the graphical user interface and to discover problems they encountered in using the app. Usability testing of the app was conducted with RN-BSN students and informatics students (n = 18). Perceptions of the graphical components were gathered in pretest and posttest questionnaires, and video recordings of the usability testing were transcribed. The significance of the difference in mean performance time for 8 tasks was tested, and qualitative analysis was deployed to identify problems encountered and to rate the severity of each problem. While all participants perceived the graphical user interface as easy to understand, nurses took significantly more time to complete certain tasks. More nurses found the medication app to be lacking in intuitiveness of user interface design, in capability to match real-world data, and in providing optimal information architecture. To successfully integrate mobile devices in healthcare, developers must address the problems that nurses encountered in use of the app.

"Usability of data integration and visualization software for multidisciplinary pediatric intensive care: a human factors approach to assessing technology".

PubMed

Lin, Ying Ling; Guerguerian, Anne-Marie; Tomasi, Jessica; Laussen, Peter; Trbovich, Patricia

2017-08-14

Intensive care clinicians use several sources of data in order to inform decision-making. We set out to evaluate a new interactive data integration platform called T3™ made available for pediatric intensive care. Three primary functions are supported: tracking of physiologic signals, displaying trajectory, and triggering decisions, by highlighting data or estimating risk of patient instability. We designed a human factors study to identify interface usability issues, to measure ease of use, and to describe interface features that may enable or hinder clinical tasks. Twenty-two participants, consisting of bedside intensive care physicians, nurses, and respiratory therapists, tested the T3™ interface in a simulation laboratory setting. Twenty tasks were performed with a true-to-setting, fully functional, prototype, populated with physiological and therapeutic intervention patient data. Primary data visualization was time series and secondary visualizations were: 1) shading out-of-target values, 2) mini-trends with exaggerated maxima and minima (sparklines), and 3) bar graph of a 16-parameter indicator. Task completion was video recorded and assessed using a use error rating scale. Usability issues were classified in the context of task and type of clinician. A severity rating scale was used to rate potential clinical impact of usability issues. Time series supported tracking a single parameter but partially supported determining patient trajectory using multiple parameters. Visual pattern overload was observed with multiple parameter data streams. Automated data processing using shading and sparklines was often ignored but the 16-parameter data reduction algorithm, displayed as a persistent bar graph, was visually intuitive. However, by selecting or automatically processing data, triggering aids distorted the raw data that clinicians use regularly. Consequently, clinicians could not rely on new data representations because they did not know how they were established or derived. Usability issues, observed through contextual use, provided directions for tangible design improvements of data integration software that may lessen use errors and promote safe use. Data-driven decision making can benefit from iterative interface redesign involving clinician-users in simulated environments. This study is a first step in understanding how software can support clinicians' decision making with integrated continuous monitoring data. Importantly, testing of similar platforms by all the different disciplines who may become clinician users is a fundamental step necessary to understand the impact on clinical outcomes of decision aids.

A Description and Evaluation of the Concussion Education Application HEADS UP Rocket Blades.

PubMed

Daugherty, Jill; Miles, Isa; Sarmiento, Kelly; Sansone, Cristina; Kroshus, Emily; Bethea, Brittaney

2018-03-01

Concussions are responsible for numerous emergency department visits and hospitalizations among children annually. However, there remains a great deal of confusion about how to prevent and manage concussions in youth. To teach children aged 6 to 8 years about concussion safety, the Centers for Disease Control and Prevention (CDC) created a mobile gaming application called HEADS UP Rocket Blades. This report introduces the game and presents findings on its evaluation. The aim of the game is to teach children what a concussion is, its commons signs and symptoms, how to prevent one, and what to do if one occurs. An early version of the game went through two rounds of usability testing with children and parents to obtain initial impressions and make improvements. The first round of usability testing focused on the mechanics of the game. Based on feedback from this session, CDC and the developers simplified the messaging and adjusted the game's level of difficulty. The second round focused on the gaming experience. The children indicated that they enjoyed playing, and nearly all were able to relay at least one learning objective. Parents and children rated Rocket Blades as a good learning tool and indicated that they would download it for personal use.

Responsive upper limb and cognitive fatigue measures during light precision work: an 8-hour simulated micro-pipetting study.

PubMed

Yung, Marcus; Wells, Richard P

2017-07-01

Many contemporary occupations are characterised by long periods of low loads. These lower force levels, which are relevant to the development of work-related musculoskeletal disorders, are usually not the focus of fatigue studies. In studies that did measure fatigue in light manual or precision work, within and between measurement responses were inconsistent. The aim of this study was to identify fatigue measures that were responsive at lower force levels (<10% MVC) over the course of an 8-h period. A complementary set of fatigue measures, reflecting both neuromuscular and cognitive mechanisms, was measured during a light precision micro-pipetting task performed by 11 participants. Nine measures were found to be significantly responsive over the 8-h period, including: ratings of perceived fatigue, postural tremor, blink frequency and critical flicker fusion frequency threshold. Common field measures, specifically electromyography RMS amplitude and maximum voluntary contractions, did not lead to extraordinary time effects. Practitioner summary: The findings provide insight towards the responsiveness of a complementary set of field usable fatigue measures at low work intensities Although commonly used measures did not reveal significant increases in fatigue, nine alternative measures were significantly responsive over the 8-h period.

Online public health preparedness training programs: an evaluation of user experience with the technological environment.

PubMed

Nambisan, Priya

2010-01-01

Several public health education programs and government agencies across the country have started offering virtual or online training programs in emergency preparedness for people who are likely to be involved in managing or responding to different types of emergency situations such as natural disasters, epidemics, bioterrorism, etc. While such online training programs are more convenient and cost-effective than traditional classroom-based programs, their success depends to a great extent on the underlying technological environment. Specifically, in an online technological environment, different types of user experiences come in to play-users' utilitarian or pragmatic experience, their fun or hedonic experience, their social experience, and most importantly, their usability experience-and these different user experiences critically shape the program outcomes, including course completion rates. This study adopts a multi-disciplinary approach and draws on theories in human computer interaction, distance learning theories, usability research, and online consumer behavior to evaluate users' experience with the technological environment of an online emergency preparedness training program and discusses its implications for the design of effective online training programs. . Data was collected using a questionnaire from 377 subjects who had registered for and participated in online public health preparedness training courses offered by a large public university in the Northeast. Analysis of the data indicates that as predicted, participants had higher levels of pragmatic and usability experiences compared to their hedonic and sociability experiences. Results also indicate that people who experienced higher levels of pragmatic, hedonic, sociability and usability experiences were more likely to complete the course(s) they registered for compared to those who reported lower levels. The study findings hold important implications for the design of effective online emergency preparedness training targeted at diverse audiences including the general public, health care and public health professionals, and emergency responders. Strategies for improving participants' pragmatic, hedonic, sociability and usability experiences are outlined. There are ample opportunities to improve the pragmatic, hedonic, sociability and usability experiences of the target audience. This is critical to improve the participants' learning and retention as well as the completion rates for the courses offered. Online emergency preparedness programs are likely to play a crucial role in preparing emergency responders at all levels in the future and their success has critical implications for public health informatics.

Evaluating response shift in training evaluation: comparing the retrospective pretest with an adapted measurement invariance approach in a classroom management training program.

PubMed

Piwowar, Valentina; Thiel, Felicitas

2014-10-01

Response shift (RS) can threaten the internal validity of pre-post designs. As RS may indicate a redefinition of the target construct, its occurrence in training evaluation is rather likely. The most common approach to deal with RS is to implement a retrospective pretest (then-test) instead of the traditional pre-test. In health psychology, an adapted measurement invariance approach (MIad) was developed as an alternative technique to study RS. Results produced by identifying RS with the two approaches were rarely studied simultaneously or within an experimental framework. To study RS in two different treatment conditions and compare results produced by both techniques in identifying various types of RS. We further studied validity aspects of the then-test. We evaluated RS by applying the then-test procedure (TP) and the measurement invariance apporach MIad within an experimental design: Participants either attended a short-term or a long-term classroom management training program. Participants were 146 student teachers in their first year of master's study. Pre (before training), post, and then self-ratings (after training) on classroom management knowledge were administered. Results indicated that the two approaches do not yield the same results. The MIad identified more and also group-specific RS as opposed to the findings of the TP, which found less and only little evidence for group-specific RS. Further research is needed to study the usability and validity of the respective approaches. In particular, the usability of the then-test seems to be challenged. © The Author(s) 2014.

Concurrent validity and sensitivity to change of Direct Behavior Rating Single-Item Scales (DBR-SIS) within an elementary sample.

PubMed

Smith, Rhonda L; Eklund, Katie; Kilgus, Stephen P

2018-03-01

The purpose of this study was to evaluate the concurrent validity, sensitivity to change, and teacher acceptability of Direct Behavior Rating single-item scales (DBR-SIS), a brief progress monitoring measure designed to assess student behavioral change in response to intervention. Twenty-four elementary teacher-student dyads implemented a daily report card intervention to promote positive student behavior during prespecified classroom activities. During both baseline and intervention, teachers completed DBR-SIS ratings of 2 target behaviors (i.e., Academic Engagement, Disruptive Behavior) whereas research assistants collected systematic direct observation (SDO) data in relation to the same behaviors. Five change metrics (i.e., absolute change, percent of change from baseline, improvement rate difference, Tau-U, and standardized mean difference; Gresham, 2005) were calculated for both DBR-SIS and SDO data, yielding estimates of the change in student behavior in response to intervention. Mean DBR-SIS scores were predominantly moderately to highly correlated with SDO data within both baseline and intervention, demonstrating evidence of the former's concurrent validity. DBR-SIS change metrics were also significantly correlated with SDO change metrics for both Disruptive Behavior and Academic Engagement, yielding evidence of the former's sensitivity to change. In addition, teacher Usage Rating Profile-Assessment (URP-A) ratings indicated they found DBR-SIS to be acceptable and usable. Implications for practice, study limitations, and areas of future research are discussed. (PsycINFO Database Record (c) 2018 APA, all rights reserved).

Development and Testing of a Multidimensional iPhone Pain Assessment Application for Adolescents with Cancer

PubMed Central

Jibb, Lindsay A; Nguyen, Cynthia; Nathan, Paul C; Maloney, Anne Marie; Dupuis, L Lee; Gerstle, J Ted; Alman, Benjamin; Hopyan, Sevan; Strahlendorf, Caron; Portwine, Carol; Johnston, Donna L; Orr, Mike

2013-01-01

Background Pain is one of the most common and distressing symptoms reported by adolescents with cancer. Despite advancements in pain assessment and management research, pain due to cancer and/or its treatments continues to be poorly managed. Our research group has developed a native iPhone application (app) called Pain Squad to tackle the problem of poorly managed pain in the adolescent with cancer group. The app functions as an electronic pain diary and is unique in its ability to collect data on pain intensity, duration, location, and the impact pain has on an adolescent’s life (ie, relationships, school work, sleep, mood). It also evaluates medications and other physical and psychological pain management strategies used. Users are prompted twice daily at configurable times to complete 20 questions characterizing their pain and the app transmits results to a database for aggregate reporting through a Web interface. Each diary entry represents a pain case filed by an adolescent with cancer and a reward system (ie, moving up through law-enforcement team ranks, built-in videotaped acknowledgements from fictitious officers) encourages consistent use of the diary. Objective Our objective was to design, develop, and test the usability, feasibility, compliance, and satisfaction of a game-based smartphone pain assessment tool for adolescents with cancer. Methods We used both low- and high-fidelity qualitative usability testing with qualitative semi-structured, audio-taped interviews and iterative cycles to design and refine the iPhone based Pain Squad app. Qualitative thematic analysis of interviews using constant comparative methodology captured emergent themes related to app usability. Content validity was assessed using question importance-rating surveys completed by participants. Compliance and satisfaction data were collected following a 2-week feasibility trial where users were alarmed to record their pain twice daily on the app. Results Thematic analysis of usability interviews showed the app to be appealing overall to adolescents. Analyses of both low- and high-fidelity testing resulted in minor revisions to the app to refine the theme and improve its usability. Adolescents resoundingly endorsed the game-based nature of the app and its virtual reward system. The importance of app pain diary questions was established by content validity analysis. Compliance with the app, assessed during feasibility testing, was high (mean 81%, SD 22%) and adolescents from this phase of the study found the app likeable, easy to use, and not bothersome to complete. Conclusions A multifaceted usability approach demonstrated how the Pain Squad app could be made more appealing to children and adolescents with cancer. The game-based nature and built-in reward system of the app was appealing to adolescents and may have resulted in the high compliance rates and satisfaction ratings observed during clinical feasibility testing. PMID:23475457

Development and testing of a multidimensional iPhone pain assessment application for adolescents with cancer.

PubMed

Stinson, Jennifer N; Jibb, Lindsay A; Nguyen, Cynthia; Nathan, Paul C; Maloney, Anne Marie; Dupuis, L Lee; Gerstle, J Ted; Alman, Benjamin; Hopyan, Sevan; Strahlendorf, Caron; Portwine, Carol; Johnston, Donna L; Orr, Mike

2013-03-08

Pain is one of the most common and distressing symptoms reported by adolescents with cancer. Despite advancements in pain assessment and management research, pain due to cancer and/or its treatments continues to be poorly managed. Our research group has developed a native iPhone application (app) called Pain Squad to tackle the problem of poorly managed pain in the adolescent with cancer group. The app functions as an electronic pain diary and is unique in its ability to collect data on pain intensity, duration, location, and the impact pain has on an adolescent's life (ie, relationships, school work, sleep, mood). It also evaluates medications and other physical and psychological pain management strategies used. Users are prompted twice daily at configurable times to complete 20 questions characterizing their pain and the app transmits results to a database for aggregate reporting through a Web interface. Each diary entry represents a pain case filed by an adolescent with cancer and a reward system (ie, moving up through law-enforcement team ranks, built-in videotaped acknowledgements from fictitious officers) encourages consistent use of the diary. Our objective was to design, develop, and test the usability, feasibility, compliance, and satisfaction of a game-based smartphone pain assessment tool for adolescents with cancer. We used both low- and high-fidelity qualitative usability testing with qualitative semi-structured, audio-taped interviews and iterative cycles to design and refine the iPhone based Pain Squad app. Qualitative thematic analysis of interviews using constant comparative methodology captured emergent themes related to app usability. Content validity was assessed using question importance-rating surveys completed by participants. Compliance and satisfaction data were collected following a 2-week feasibility trial where users were alarmed to record their pain twice daily on the app. Thematic analysis of usability interviews showed the app to be appealing overall to adolescents. Analyses of both low- and high-fidelity testing resulted in minor revisions to the app to refine the theme and improve its usability. Adolescents resoundingly endorsed the game-based nature of the app and its virtual reward system. The importance of app pain diary questions was established by content validity analysis. Compliance with the app, assessed during feasibility testing, was high (mean 81%, SD 22%) and adolescents from this phase of the study found the app likeable, easy to use, and not bothersome to complete. A multifaceted usability approach demonstrated how the Pain Squad app could be made more appealing to children and adolescents with cancer. The game-based nature and built-in reward system of the app was appealing to adolescents and may have resulted in the high compliance rates and satisfaction ratings observed during clinical feasibility testing.

The Role of the Chief Financial Officer in Large Public Universities.

ERIC Educational Resources Information Center

Jenkins, William A.

1985-01-01

The characteristics and qualifications of chief financial officers (CFOs) of large public universities, the internal organizational relationships of CFOs, and their responsibilities were studied in 1983. Findings of a similar 1973 study are also considered. A total of 135 usable questionnaire responses provided information on age; sex; length of…

Development and testing of painometer: a smartphone app to assess pain intensity.

PubMed

de la Vega, Rocío; Roset, Roman; Castarlenas, Elena; Sánchez-Rodríguez, Elisabet; Solé, Ester; Miró, Jordi

2014-10-01

Electronic and information technologies are increasingly being used to assess pain. This study aims to 1) introduce Painometer, a smartphone app that helps users to assess pain intensity, and 2) report on its usability (ie, user performance and satisfaction) and acceptability (ie, the willingness to use it) when it is made available to health care professionals and nonprofessionals. Painometer includes 4 well-known pain intensity scales: the Faces Pain Scale-Revised, the numerical rating scale-11, the Coloured Analogue Scale, and the visual analog scale. Scores reported with these scales, when used in their traditional format, have shown to be valid and reliable. The app was tested in a sample of 24 health care professionals and 30 nonprofessionals. Two iterative usability cycles were conducted with a qualitative usability testing approach and a semistructured interview. The participants had an average of 10 years' experience in using computers. The domains measured were ease of use, errors in usage, most popular characteristics, suggested changes, and acceptability. Adding instructions and changing format and layout details solved the usability problems reported in cycle 1. No further problems were reported in cycle 2. Painometer has been found to be a useful, user-friendly app that may help to improve the accuracy of pain intensity assessment. Painometer, a smartphone app to assess pain intensity, shows good usability and acceptability properties when used by health care professionals and nonprofessionals. Copyright © 2014 American Pain Society. Published by Elsevier Inc. All rights reserved.

Dams, reservoirs, and withdrawals for water supply; historic trends

USGS Publications Warehouse

Langbein, W.B.

1982-01-01

The U.S. Geological Survey (USGS) from time to time has published an inventory of major reservoirs and controlled natural lakes. The latest available USGS report indicated that as of 1963, usable capacity in major reservoirs (those having 5 ,000 acre-ft of usable capacity) totaled 359 million acre-ft. The growth rate for total capacity averaged about 80%/decade until the early 1960's. Since then, reservoir capacity has increased at a markedly slower rate, the effects of approaching an asymptotic limit on capacity in some areas, compounded, by increasing public aversion toward reservoir construction. The trend toward non-structural measures places greater dependence on management skill and on better forecasts. At some point, the potentials of conservation and better management will become less effective than reservoirs and there will again be an upward trend in reservoir capacity. (Lantz-PTT)

Efficacy, Safety, and Usability of Remifentanil as Premedication for INSURE in Preterm Neonates.

PubMed

Audil, Hadiyah Y; Tse, Sara; Pezzano, Chad; Mitchell-van Steele, Amy; Pinheiro, Joaquim M B

2018-05-22

Background : We previously reported a 67% extubation failure with INSURE (Intubation, Surfactant, Extubation) using morphine as analgosedative premedication. Remifentanil, a rapid- and short-acting narcotic, might be ideal for INSURE, but efficacy and safety data for this indication are limited. Objectives : To assess whether remifentanil premedication increases extubation success rates compared with morphine, and to evaluate remifentanil's safety and usability in a teaching hospital context. Methods : Retrospective review of remifentanil orders for premedication, at a large teaching hospital neonatal intensive care unit (NICU). We compared INSURE failure rates (needing invasive ventilation after INSURE) with prior morphine-associated rates. Additionally, we surveyed NICU staff to identify usability and logistic issues with remifentanil. Results : 73 remifentanil doses were administered to 62 neonates (mean 31.6 ± 3.8 weeks' gestation). Extubation was successful in 88%, vs. 33% with morphine premedication ( p < 0.001). Significant adverse events included chest wall rigidity (4%), one case of cardiopulmonary resuscitation (CPR) post-surfactant, naloxone reversal (5%), and notable transient desaturation (34%). Among 137 completed surveys, 57% indicated concerns, including delayed drug availability (median 1.1 h after order), rapid desaturations narrowing intubation timeframes and hindering trainee involvement, and difficulty with bag-mask ventilation after unsuccessful intubation attempts. Accordingly, 33% of ultimate intubators were attending neonatologists, versus 16% trainees. Conclusions : Remifentanil premedication was superior to morphine in allowing successful extubation, despite occasional chest wall rigidity and unfavorable conditions for trainees. We recommend direct supervision and INSURE protocols aimed at ensuring rapid intubation.

Usability of EFBs for Viewing NOTAMs and AIS/MET Data Link Messages

NASA Technical Reports Server (NTRS)

Evans, Emory T.; Young, Steven D.; Daniels, Tammi S.; Myer, Robert R.

2014-01-01

Electronic Flight Bags (EFB) are increasingly integral to flight deck information management. A piloted simulation study was conducted at NASA Langley Research Center, one aspect of which was to evaluate the usability and acceptability of EFBs for viewing and managing Notices to Airmen (NOTAMs) and data linked aeronautical information services (AIS) and meteorological information (MET). The study simulated approaches and landings at Memphis International Airport (KMEM) using various flight scenarios and weather conditions. Ten two-pilot commercial airline crews participated, utilizing the Cockpit Motion Facility's Research Flight Deck (CMF/RFD) simulator. Each crew completed approximately two dozen flights over a two day period. Two EFBs were installed, one for each pilot. Study data were collected in the form of questionnaire/interview responses, audio/video recordings, oculometer recordings, and aircraft/system state data. Preliminary usability results are reported primarily based on pilot interviews and responses to questions focused on ease of learning, ease of use, usefulness, satisfaction, and acceptability. Analysis of the data from the other objective measures (e.g., oculometer) is ongoing and will be reported in a future publication. This paper covers how the EFB functionality was set up for the study; the NOTAM, AIS/MET data link, and weather messages that were presented; questionnaire results; selected pilot observations; and conclusions.

An integrated development facility for the calibration of low-energy charged particle flight instrumentation

NASA Technical Reports Server (NTRS)

Biddle, A. P.; Reynolds, J. M.

1985-01-01

A system was developed for the calibration and development of thermal ion instrumentation. The system provides an extended beam with usable current rates, approx. 1 pA/sq cm, at beam energies as low as 1 eV, with much higher values available with increasing energy. A tandem electrostatic and variable geometry magnetic mirror configuration within the ion source optimizes the use of the ionizing electrons. The system is integrated under microcomputer control to allow automatic control and monitoring of the beam energy and composition and the mass and angle-dependent response of the instrument under test. The system is pumped by a combination of carbon vane and cryogenic sorption roughing pumps and ion and liquid helium operating pumps.

5 CFR 532.239 - Review by the lead agency.

Code of Federal Regulations, 2014 CFR

2014-01-01

... 5 Administrative Personnel 1 2014-01-01 2014-01-01 false Review by the lead agency. 532.239... PREVAILING RATE SYSTEMS Prevailing Rate Determinations § 532.239 Review by the lead agency. (a) The lead... wage data collection forms. (b) The lead agency shall determine whether the usable data collected in...

5 CFR 532.239 - Review by the lead agency.

Code of Federal Regulations, 2011 CFR

2011-01-01

... 5 Administrative Personnel 1 2011-01-01 2011-01-01 false Review by the lead agency. 532.239... PREVAILING RATE SYSTEMS Prevailing Rate Determinations § 532.239 Review by the lead agency. (a) The lead... wage data collection forms. (b) The lead agency shall determine whether the usable data collected in...

5 CFR 532.239 - Review by the lead agency.

Code of Federal Regulations, 2012 CFR

2012-01-01

... 5 Administrative Personnel 1 2012-01-01 2012-01-01 false Review by the lead agency. 532.239... PREVAILING RATE SYSTEMS Prevailing Rate Determinations § 532.239 Review by the lead agency. (a) The lead... wage data collection forms. (b) The lead agency shall determine whether the usable data collected in...

5 CFR 532.239 - Review by the lead agency.

Code of Federal Regulations, 2013 CFR

2013-01-01

... 5 Administrative Personnel 1 2013-01-01 2013-01-01 false Review by the lead agency. 532.239... PREVAILING RATE SYSTEMS Prevailing Rate Determinations § 532.239 Review by the lead agency. (a) The lead... wage data collection forms. (b) The lead agency shall determine whether the usable data collected in...

3D CPR Game Can Improve CPR Skill Retention.

PubMed

Li, Jia; Xu, Yimin; Xu, Yahong; Yue, Peng; Sun, Liu; Guo, Ming; Xiao, Shuqin; Ding, Shu; Cui, Yanyan; Li, Shulan; Yang, Qiuying; Chang, Polun; Wu, Ying

2015-01-01

Adequate cardiopulmonary resuscitation (CPR) skill is essential in improving survival rate of sudden cardiac arrest (SCA). However, the skill deteriorates rapidly following CPR training. We developed a computer game by using 3-Dimensional virtual technology (3-D CPR game) for laypersons in the purpose to improve skill retention. As the testing phase, a randomized control trial, in which we recruited 97 freshman medical students who had no prior CPR training experience, was used to test its effect on 3-month CPR Skill retention. The usability of the game was also tested using a 33 item questionnaire rated with 5-point Likert scale. Three months after the initial CPR training, the retention rate of CPR skill in the game group was significantly higher compared with the control (p<0.05) and the average score on 4 dimensions of usability were 3.99-4.05. Overall, using 3-D CPR game in improving CPR skill retention is feasible and effective.

Downsizing of health-system pharmacist positions.

PubMed

Kahaleh, A A; Siganga, W; Holiday-Goodman, M; Lively, B T

1998-11-15

The effects of downsizing on institutional pharmacists were studied. A national mail survey was sent to a random sample of 533 members of ASHP in January 1997. The questionnaire was designed to determine (1) the influence of selected factors on the downsizing of pharmacist positions and (2) pharmacists' attitudes about downsizing. A total of 256 usable questionnaires were received, for a net response rate of 48%. Forty-four pharmacists, or 17%, had personally been affected by downsizing. Sixty-one percent of the pharmacists affected by downsizing had had administrative positions. After downsizing, only 32% of the pharmacists had an administrative position. Most of the pharmacists were currently employed. Thirty-five (79%) described their current job responsibilities as substantially changed. Two thirds made the same salaries or higher salaries. Pharmacists who had been downsized rated mergers, the impact of managed care, and the profit motive as the most influential causes of downsizing of pharmacist positions. The three most common negative comments about the impact of downsizing cited reduction in the quality of patient care, increased stress, and lowered morale. Most of the pharmacists believed that communication skills, education, cross-training, and clinical skills are keys to surviving downsizing. Most pharmacists whose positions were downsized said they went on to jobs with similar or higher salaries and substantially different responsibilities.

Piloted Simulator Investigation of Techniques to Achieve Attitude Command Response with Limited Authority Servos

NASA Technical Reports Server (NTRS)

Key, David L.; Heffley, Robert K.

2002-01-01

The purpose of the study was to develop generic design principles for obtaining attitude command response in moderate to aggressive maneuvers without increasing SCAS series servo authority from the existing +/- 10%. In particular, to develop a scheme that would work on the UH-60 helicopter so that it can be considered for incorporation in future upgrades. The basic math model was a UH-60A version of GENHEL. The simulation facility was the NASA-Ames Vertical Motion Simulator (VMS). Evaluation tasks were Hover, Acceleration-Deceleration, and Sidestep, as defined in ADS-33D-PRF for Degraded Visual Environment (DVE). The DVE was adjusted to provide a Usable Cue Environment (UCE) equal to two. The basic concept investigated was the extent to which the limited attitude command authority achievable by the series servo could be supplemented by a 10%/sec trim servo. The architecture used provided angular rate feedback to only the series servo, shared the attitude feedback between the series and trim servos, and when the series servo approached saturation the attitude feedback was slowly phased out. Results show that modest use of the trim servo does improve pilot ratings, especially in and around hover. This improvement can be achieved with little degradation in response predictability during moderately aggressive maneuvers.

Dust control technology usage patterns in the drywall finishing industry.

PubMed

Young-Corbett, Deborah E; Nussbaum, Maury A

2009-06-01

A telephone survey was conducted to quantify drywall finishing industry usage rates of dust control technology, identify barriers to technology adoption, and explore firm owner perception of risk. Industry use of the following technologies was described: wet methods, respiratory protection, pole sanders, ventilated sanders, and low-dust joint compound. A survey instrument composed of both Likert-type scaled items and open-ended items was developed and administered by telephone to the census population of the owners of member firms of trade associations: Finishing Contractors Association and Association of the Wall and Ceiling Industries. Of 857 firms, 264 interviews were completed. Along with descriptive statistics, results were analyzed to examine effects of firm size and union affiliation on responses. Responses to open-ended items were analyzed using content analysis procedures. Firm owners rated the risk of dust to productivity and customer satisfaction as low-moderate. Half rated the dust as having some impact on worker health, with higher impacts indicated by owners of small firms. Among the available control technologies, respiratory protection was used most frequently. Several barriers to implementation of the more effective control technologies were identified. Barriers associated with technology usability, productivity, and cost, as well as misperceptions of risk, should be addressed to improve dust control in the drywall finishing industry.

Mobile Applications for Participation at the Shopping Mall: Content Analysis and Usability for Persons with Physical Disabilities and Communication or Cognitive Limitations

PubMed Central

Auger, Claudine; Leduc, Emilie; Labbé, Delphine; Guay, Cassioppée; Fillion, Brigitte; Bottari, Carolina; Swaine, Bonnie

2014-01-01

The aim of this exploratory study was to determine the important features in content and usability of existing mobile applications evaluating environmental barriers and facilitators (EBF) to participation for persons with physical disabilities presenting mild communication or cognitive limitations. A rigorous process based on a user-centered design approach led to the identification of two relevant mobile applications to evaluate the EBF. An accessibility expert, the research team as well as five users then tested the mobile applications in a shopping mall. A thematic content analysis of the research team’s and users’ comments established 10 categories of key features that adequately respond to the needs of the clientele targeted in this study. In terms of content, granularity and contextualization of the information provided were considered important. With respect to usability, relevant features were place finding, rating system, presentation of results, compatibility, user-friendliness, aesthetics, credibility of the information as well as connectivity/interactiveness. The research team and the users agreed on some aspects such as aesthetics, but had different perspectives on features such as the rating system or the connectivity/interactiveness of the application. The users proposed new features suggesting that the existing mobile applications did not correspond to all their needs. PMID:25513999

Mobile applications for participation at the shopping mall: content analysis and usability for persons with physical disabilities and communication or cognitive limitations.

PubMed

Auger, Claudine; Leduc, Emilie; Labbé, Delphine; Guay, Cassioppée; Fillion, Brigitte; Bottari, Carolina; Swaine, Bonnie

2014-12-01

The aim of this exploratory study was to determine the important features in content and usability of existing mobile applications evaluating environmental barriers and facilitators (EBF) to participation for persons with physical disabilities presenting mild communication or cognitive limitations. A rigorous process based on a user-centered design approach led to the identification of two relevant mobile applications to evaluate the EBF. An accessibility expert, the research team as well as five users then tested the mobile applications in a shopping mall. A thematic content analysis of the research team's and users' comments established 10 categories of key features that adequately respond to the needs of the clientele targeted in this study. In terms of content, granularity and contextualization of the information provided were considered important. With respect to usability, relevant features were place finding, rating system, presentation of results, compatibility, user-friendliness, aesthetics, credibility of the information as well as connectivity/interactiveness. The research team and the users agreed on some aspects such as aesthetics, but had different perspectives on features such as the rating system or the connectivity/interactiveness of the application. The users proposed new features suggesting that the existing mobile applications did not correspond to all their needs.

Glasses-type wearable computer displays: usability considerations examined with a 3D glasses case study.

PubMed

Chang, Joonho; Moon, Seung Ki; Jung, Kihyo; Kim, Wonmo; Parkinson, Matthew; Freivalds, Andris; Simpson, Timothy W; Baik, Seon Pill

2018-05-01

This study presents usability considerations and solutions for the design of glasses-type wearable computer displays and examines their effectiveness in a case study. Design countermeasures were investigated by a four-step design process: (1) preliminary design analysis; (2) design idea generation; (3) final design selection; and (4) virtual fitting trial. Three design interventions were devised from the design process: (1) weight balance to reduce pressure concentrated on the nose, (2) compliant temples to accommodate diverse head sizes and (3) a hanger mechanism to help spectacle users hang their wearable display on their eye glasses. To investigate their effectiveness, in the case study, the novel 3D glasses adopting the three interventions were compared with two existing 3D glasses in terms of neck muscle fatigue and subjective discomfort rating. While neck muscle fatigue was not significantly different among the three glasses (p = 0.467), the novel glasses had significantly smaller discomfort ratings (p = 0.009). Relevance to Industry: A four-step design process identified usability considerations and solutions for the design of glasses-type wearable computer displays. A novel 3D glasses was proposed through the process and its effectiveness was validated. The results identify design considerations and opportunities relevant to the emerging wearable display industry.

Heuristic Evaluation of Online COPD Respiratory Therapy and Education Video Resource Center

PubMed Central

Chaney, Beth; Chaney, Don

2014-01-01

Abstract Purpose: Because of limited accessibility to pulmonary rehabilitation programs, patients with chronic obstructive pulmonary disease (COPD) are infrequently provided with patient education resources. To help educate patients with COPD on how to live a better life with diminished breathing capacity, we developed a novel social media resource center containing COPD respiratory therapy and education videos called “COPDFlix.” Methodology: A heuristic evaluation of COPDFlix was conducted as part of a larger study to determine whether the prototype was successful in adhering to formal Web site usability guidelines for older adults. A purposive sample of three experts, with expertise in Web design and health communications technology, was recruited (a) to identify usability violations and (b) to propose solutions to improve the functionality of the COPDFlix prototype. Each expert evaluated 18 heuristics in four categories of task-based criteria (i.e., interaction and navigation, information architecture, presentation design, and information design). Seventy-six subcriteria across these four categories were assessed. Quantitative ratings and qualitative comments from each expert were compiled into a single master list, noting the violated heuristic and type/location of problem(s). Results: Sixty-one usability violations were identified across the 18 heuristics. Evaluators rated the majority of heuristic subcriteria as either a “minor hindrance” (n=32) or “no problem” (n=132). Moreover, only 2 of the 18 heuristic categories were noted as “major” violations, with mean severity scores of ≥3. Conclusions: Mixed-methods data analysis helped the multidisciplinary research team to categorize and prioritize usability problems and solutions, leading to 26 discrete design modifications within the COPDFlix prototype. PMID:24650318

Telephone-Based Mindfulness Therapy Intervention for Patients with Chronic Pancreatitis.

PubMed

Aivaliotis, Vasiliki Irene; Lee, Yvonne; Zia, Jasmine; Wassef, Wahid; Abramson, Mark; Park, Walter

2017-02-01

Patients with chronic pancreatitis (CP) have substantially impaired quality of life (QOL) both physically and mentally. Mindfulness therapy is a form of treatment that has been shown to be beneficial in many medical conditions but has not been evaluated in the CP patient population. The aims of this study were (1) to test the feasibility and usability of a novel telephone-based mindfulness therapy service for patients with CP and (2) to determine whether there was any effect on CP quality of life. We recruited ten patients with suspected or confirmed CP and five controls who were asked to utilize our telephone-based mindfulness therapy service daily for 28 days. Feasibility of the service was defined as the fraction of subjects with a ≥50% compliance rate. Usability was assessed using a System Usability Scale (SUS). QOL was evaluated using the SF-36 questionnaire and the Pancreatitis Quality of Life Instrument (PANQOLI). Paired t tests were used to compare the SF-36 and PANQOLI pre- and post-intervention. There was an overall compliance rate of 67%. The mean SUS score for all participants was 79.3, above the average published score of 68. Results showed a significant improvement in the SF-36 Mental Component Summary scores after 28 days of mindfulness therapy for patients with CP, t(9) = 2.48, p = 0.035. There was also a significant improvement in the mean total PANQOLI scores in CP patients, t(9) = 2.41, p = 0.04, most notably in the social domain. Our telephone-based mindfulness therapy service represents a feasible and easily usable treatment adjunct for patients with CP, which may provide benefit in QOL by improving mental health-related domains.

Accessible weight loss: Adapting a lifestyle intervention for adults with impaired mobility.

PubMed

Betts, Andrea C; Froehlich-Grobe, Katherine

2017-01-01

Despite disparities in obesity between those with and without disability, there is limited evidence to guide weight loss intervention in people with impaired mobility (IM), particularly those with severe impairments. Examine the usability, feasibility, and effectiveness of adapting an existing evidence-based weight loss program for people with IM. In this single-group pre-test post-test pilot study, 10 overweight or obese individuals with permanent IM (e.g. spinal cord injury, spina bifida, osteoarthritis) participated in a 20-week modification of the DPP Group Lifestyle Balance™ (DPP GLB) program, a group-based adaptation of the Diabetes Prevention Program (DPP). Fifteen conference calls encouraged reducing calorie and fat intake and increasing exercise through self-monitoring and problem solving. We defined feasibility as retention and engagement, usability as participants' program satisfaction ratings, and effectiveness as physiological and psychosocial change measured on three occasions over 20 weeks. Analytic methods included basic descriptive statistics (feasibility and usability) and repeated measures ANOVA (effectiveness). The program retained 70% of participants. These individuals attended an average of 79.3% of conference calls and self-monitored more than half of the weeks. Participants rated the program highly, with mean overall scores of 6.3 ± 0.3 and 6.2 ± 0.6 out of 7 on helpfulness and satisfaction scales, respectively. Program completers experienced a significant mean weight loss of 8.86 ± 8.37 kg (p = 0.024), or 7.4% of their start weight, and significantly reduced their BMI. An adapted version of the DPP GLB is a feasible, usable, and potentially effective intervention for promoting weight loss among persons with IM. Copyright © 2016 Elsevier Inc. All rights reserved.

VA FitHeart, a Mobile App for Cardiac Rehabilitation: Usability Study

PubMed Central

Magnusson, Sara L; Fortney, John C; Sayre, George G; Whooley, Mary A

2018-01-01

Background Cardiac rehabilitation (CR) improves outcomes for patients with ischemic heart disease or heart failure but is underused. New strategies to improve access to and engagement in CR are needed. There is considerable interest in technology-facilitated home CR. However, little is known about patient acceptance and use of mobile technology for CR. Objective The aim of this study was to develop a mobile app for technology-facilitated home CR and seek to determine its usability. Methods We recruited patients eligible for CR who had access to a mobile phone, tablet, or computer with Internet access. The mobile app includes physical activity goal setting, logs for tracking physical activity and health metrics (eg, weight, blood pressure, and mood), health education, reminders, and feedback. Study staff demonstrated the mobile app to participants in person and then observed participants completing prespecified tasks with the mobile app. Participants completed the System Usability Scale (SUS, 0-100), rated likelihood to use the mobile app (0-100), questionnaires on mobile app use, and participated in a semistructured interview. The Unified Theory of Acceptance and Use of Technology and the Theory of Planned Behavior informed the analysis. On the basis of participant feedback, we made iterative revisions to the mobile app between users. Results We conducted usability testing in 13 participants. The first version of the mobile app was used by the first 5 participants, and revised versions were used by the final 8 participants. From the first version to revised versions, task completion success rate improved from 44% (11/25 tasks) to 78% (31/40 tasks; P=.05), SUS improved from 54 to 76 (P=.04; scale 0-100, with 100 being the best usability), and self-reported likelihood of use remained high at 76 and 87 (P=.30; scale 0-100, with 100 being the highest likelihood). In interviews, patients expressed interest in tracking health measures (“I think it’ll be good to track my exercise and to see what I’m doing”), a desire for introductory training (“Initially, training with a technical person, instead of me relying on myself”), and an expectation for sharing data with providers (“It would also be helpful to share with my doctor, it just being a matter of clicking a button and sharing it with my doctor”). Conclusions With participant feedback and iterative revisions, we significantly improved the usability of a mobile app for CR. Patient expectations for using a mobile app for CR include tracking health metrics, introductory training, and sharing data with providers. Iterative mixed-method evaluation may be useful for improving the usability of health technology. PMID:29335235

VA FitHeart, a Mobile App for Cardiac Rehabilitation: Usability Study.

PubMed

Beatty, Alexis L; Magnusson, Sara L; Fortney, John C; Sayre, George G; Whooley, Mary A

2018-01-15

Cardiac rehabilitation (CR) improves outcomes for patients with ischemic heart disease or heart failure but is underused. New strategies to improve access to and engagement in CR are needed. There is considerable interest in technology-facilitated home CR. However, little is known about patient acceptance and use of mobile technology for CR. The aim of this study was to develop a mobile app for technology-facilitated home CR and seek to determine its usability. We recruited patients eligible for CR who had access to a mobile phone, tablet, or computer with Internet access. The mobile app includes physical activity goal setting, logs for tracking physical activity and health metrics (eg, weight, blood pressure, and mood), health education, reminders, and feedback. Study staff demonstrated the mobile app to participants in person and then observed participants completing prespecified tasks with the mobile app. Participants completed the System Usability Scale (SUS, 0-100), rated likelihood to use the mobile app (0-100), questionnaires on mobile app use, and participated in a semistructured interview. The Unified Theory of Acceptance and Use of Technology and the Theory of Planned Behavior informed the analysis. On the basis of participant feedback, we made iterative revisions to the mobile app between users. We conducted usability testing in 13 participants. The first version of the mobile app was used by the first 5 participants, and revised versions were used by the final 8 participants. From the first version to revised versions, task completion success rate improved from 44% (11/25 tasks) to 78% (31/40 tasks; P=.05), SUS improved from 54 to 76 (P=.04; scale 0-100, with 100 being the best usability), and self-reported likelihood of use remained high at 76 and 87 (P=.30; scale 0-100, with 100 being the highest likelihood). In interviews, patients expressed interest in tracking health measures ("I think it'll be good to track my exercise and to see what I'm doing"), a desire for introductory training ("Initially, training with a technical person, instead of me relying on myself"), and an expectation for sharing data with providers ("It would also be helpful to share with my doctor, it just being a matter of clicking a button and sharing it with my doctor"). With participant feedback and iterative revisions, we significantly improved the usability of a mobile app for CR. Patient expectations for using a mobile app for CR include tracking health metrics, introductory training, and sharing data with providers. Iterative mixed-method evaluation may be useful for improving the usability of health technology. ©Alexis L Beatty, Sara L Magnusson, John C Fortney, George G Sayre, Mary A Whooley. Originally published in JMIR Human Factors (http://humanfactors.jmir.org), 15.01.2018.

Usability of a patient education and motivation tool using heuristic evaluation.

PubMed

Joshi, Ashish; Arora, Mohit; Dai, Liwei; Price, Kathleen; Vizer, Lisa; Sears, Andrew

2009-11-06

Computer-mediated educational applications can provide a self-paced, interactive environment to deliver educational content to individuals about their health condition. These programs have been used to deliver health-related information about a variety of topics, including breast cancer screening, asthma management, and injury prevention. We have designed the Patient Education and Motivation Tool (PEMT), an interactive computer-based educational program based on behavioral, cognitive, and humanistic learning theories. The tool is designed to educate users and has three key components: screening, learning, and evaluation. The objective of this tutorial is to illustrate a heuristic evaluation using a computer-based patient education program (PEMT) as a case study. The aims were to improve the usability of PEMT through heuristic evaluation of the interface; to report the results of these usability evaluations; to make changes based on the findings of the usability experts; and to describe the benefits and limitations of applying usability evaluations to PEMT. PEMT was evaluated by three usability experts using Nielsen's usability heuristics while reviewing the interface to produce a list of heuristic violations with severity ratings. The violations were sorted by heuristic and ordered from most to least severe within each heuristic. A total of 127 violations were identified with a median severity of 3 (range 0 to 4 with 0 = no problem to 4 = catastrophic problem). Results showed 13 violations for visibility (median severity = 2), 38 violations for match between system and real world (median severity = 2), 6 violations for user control and freedom (median severity = 3), 34 violations for consistency and standards (median severity = 2), 11 violations for error severity (median severity = 3), 1 violation for recognition and control (median severity = 3), 7 violations for flexibility and efficiency (median severity = 2), 9 violations for aesthetic and minimalist design (median severity = 2), 4 violations for help users recognize, diagnose, and recover from errors (median severity = 3), and 4 violations for help and documentation (median severity = 4). We describe the heuristic evaluation method employed to assess the usability of PEMT, a method which uncovers heuristic violations in the interface design in a quick and efficient manner. Bringing together usability experts and health professionals to evaluate a computer-mediated patient education program can help to identify problems in a timely manner. This makes this method particularly well suited to the iterative design process when developing other computer-mediated health education programs. Heuristic evaluations provided a means to assess the user interface of PEMT.

Usability of a Patient Education and Motivation Tool Using Heuristic Evaluation

PubMed Central

Arora, Mohit; Dai, Liwei; Price, Kathleen; Vizer, Lisa; Sears, Andrew

2009-01-01

Background Computer-mediated educational applications can provide a self-paced, interactive environment to deliver educational content to individuals about their health condition. These programs have been used to deliver health-related information about a variety of topics, including breast cancer screening, asthma management, and injury prevention. We have designed the Patient Education and Motivation Tool (PEMT), an interactive computer-based educational program based on behavioral, cognitive, and humanistic learning theories. The tool is designed to educate users and has three key components: screening, learning, and evaluation. Objective The objective of this tutorial is to illustrate a heuristic evaluation using a computer-based patient education program (PEMT) as a case study. The aims were to improve the usability of PEMT through heuristic evaluation of the interface; to report the results of these usability evaluations; to make changes based on the findings of the usability experts; and to describe the benefits and limitations of applying usability evaluations to PEMT. Methods PEMT was evaluated by three usability experts using Nielsen’s usability heuristics while reviewing the interface to produce a list of heuristic violations with severity ratings. The violations were sorted by heuristic and ordered from most to least severe within each heuristic. Results A total of 127 violations were identified with a median severity of 3 (range 0 to 4 with 0 = no problem to 4 = catastrophic problem). Results showed 13 violations for visibility (median severity = 2), 38 violations for match between system and real world (median severity = 2), 6 violations for user control and freedom (median severity = 3), 34 violations for consistency and standards (median severity = 2), 11 violations for error severity (median severity = 3), 1 violation for recognition and control (median severity = 3), 7 violations for flexibility and efficiency (median severity = 2), 9 violations for aesthetic and minimalist design (median severity = 2), 4 violations for help users recognize, diagnose, and recover from errors (median severity = 3), and 4 violations for help and documentation (median severity = 4). Conclusion We describe the heuristic evaluation method employed to assess the usability of PEMT, a method which uncovers heuristic violations in the interface design in a quick and efficient manner. Bringing together usability experts and health professionals to evaluate a computer-mediated patient education program can help to identify problems in a timely manner. This makes this method particularly well suited to the iterative design process when developing other computer-mediated health education programs. Heuristic evaluations provided a means to assess the user interface of PEMT. PMID:19897458

Computer Center: Software Review.

ERIC Educational Resources Information Center

Duhrkopf, Richard, Ed.; Belshe, John F., Ed.

1988-01-01

Reviews a software package, "Mitosis-Meiosis," available for Apple II or IBM computers with colorgraphics capabilities. Describes the documentation, presentation and flexibility of the program. Rates the program based on graphics and usability in a biology classroom. (CW)

Computer Calculation of Fire Danger

Treesearch

William A. Main

1969-01-01

This paper describes a computer program that calculates National Fire Danger Rating Indexes. fuel moisture, buildup index, and drying factor are also available. The program is written in FORTRAN and is usable on even the smallest compiler.

Usability of a novel digital medicine system in adults with schizophrenia treated with sensor-embedded tablets of aripiprazole.

PubMed

Peters-Strickland, Timothy; Pestreich, Linda; Hatch, Ainslie; Rohatagi, Shashank; Baker, Ross A; Docherty, John P; Markovtsova, Lada; Raja, Praveen; Weiden, Peter J; Walling, David P

2016-01-01

Digital medicine system (DMS) is a novel drug-device combination that objectively measures and reports medication ingestion. The DMS consists of medication embedded with an ingestible sensor (digital medicine), a wearable sensor, and software applications. This study evaluated usability of the DMS in adults with schizophrenia rated by both patients and their health care providers (HCPs) during 8-week treatment with prescribed doses of digital aripiprazole. Six US sites enrolled outpatients into this Phase IIa, open-label study (NCT02219009). The study comprised a screening phase, a training phase (three weekly site visits), and a 5-week independent phase. Patients and HCPs independently rated usability of and satisfaction with the DMS. Sixty-seven patients were enrolled, and 49 (73.1%) patients completed the study. The mean age (SD) of the patients was 46.6 years (9.7 years); the majority of them were male (74.6%), black (76.1%), and rated mildly ill on the Clinical Global Impression - Severity scale (70.1%). By the end of week 8 or early termination, 82.1% (55/67) of patients had replaced the wearable sensor independently or with minimal assistance, based on HCP rating. The patients used the wearable sensor for a mean (SD) of 70.7% (24.7%) and a median of 77.8% of their time in the trial. The patients contacted a call center most frequently at week 1. At the last visit, 78% (47/60) of patients were somewhat satisfied/satisfied/extremely satisfied with the DMS. A high proportion of patients with schizophrenia were able to use the DMS and reported satisfaction with the DMS. These data support the potential utility of the DMS in clinical practice.

An evaluation of the feasibility and usability of a proof of concept mobile app for adverse event reporting post influenza vaccination

PubMed Central

Wilson, Kumanan; Atkinson, Katherine M.; Westeinde, Jacqueline; Bell, Cameron; Marty, Kim; Fergusson, Dean; Deeks, Shelley L.; Crowcroft, Natasha; Bettinger, Julie A.

2016-01-01

ABSTRACT The Canadian National Vaccine Safety network (CANVAS) gathers and analyzes safety data on individuals receiving the influenza vaccine during the early stages of annual influenza vaccination campaigns with data collected via participant surveys through the Internet. We sought to examine whether it was feasible to use a mobile application (app) to facilitate AEFI reporting for the CANVAS network. To explore this, we developed a novel smartphone app, recruited participants from a hospital influenza immunization clinic and by word of mouth and instructed them to download and utilize the app. The app reminded participants to complete the CANVAS AEFI surveillance surveys (“AEFI surveys”) on day 8 and 30, a survey capturing app usability metrics at day 30 (“usability survey”) and provided a mechanism to report AEFI events spontaneously throughout the whole study period. All survey results and spontaneous reports were recorded on a privacy compliant, cloud server. A software plug-in, Lookback, was used to record the on-screen experience of the app sessions. Of the 76 participants who consented to participate, 48(63%) successfully downloaded the app and created a profile. In total, 38 unique participants completed all of the required surveillance surveys; transmitting 1104 data points (survey question responses and spontaneous reports) from 83 completed surveys, including 21 usability surveys and one spontaneous report. In total, we received information on new or worsening health conditions after receiving the influenza vaccine from 11(28%) participants. Of the usability survey responses, 86% agreed or strongly agreed that they would prefer to use a mobile app based reporting system instead of a web-based system. The single spontaneous report received was from a participant who had also reported using the Day 8 survey. Of Lookback observable sessions, an accurate transmission proportion of 100% (n=290) was reported for data points. We demonstrated that a mobile app can be used for AEFI reporting, although download and survey completion proportions suggest potential barriers to adoption. Future studies should examine implementation of mobile reporting in a broader audience and impact on the quality of reporting of adverse events following immunization. PMID:26905396

An evaluation of the feasibility and usability of a proof of concept mobile app for adverse event reporting post influenza vaccination.

PubMed

Wilson, Kumanan; Atkinson, Katherine M; Westeinde, Jacqueline; Bell, Cameron; Marty, Kim; Fergusson, Dean; Deeks, Shelley L; Crowcroft, Natasha; Bettinger, Julie A

2016-07-02

The Canadian National Vaccine Safety network (CANVAS) gathers and analyzes safety data on individuals receiving the influenza vaccine during the early stages of annual influenza vaccination campaigns with data collected via participant surveys through the Internet. We sought to examine whether it was feasible to use a mobile application (app) to facilitate AEFI reporting for the CANVAS network. To explore this, we developed a novel smartphone app, recruited participants from a hospital influenza immunization clinic and by word of mouth and instructed them to download and utilize the app. The app reminded participants to complete the CANVAS AEFI surveillance surveys ("AEFI surveys") on day 8 and 30, a survey capturing app usability metrics at day 30 ("usability survey") and provided a mechanism to report AEFI events spontaneously throughout the whole study period. All survey results and spontaneous reports were recorded on a privacy compliant, cloud server. A software plug-in, Lookback, was used to record the on-screen experience of the app sessions. Of the 76 participants who consented to participate, 48(63%) successfully downloaded the app and created a profile. In total, 38 unique participants completed all of the required surveillance surveys; transmitting 1104 data points (survey question responses and spontaneous reports) from 83 completed surveys, including 21 usability surveys and one spontaneous report. In total, we received information on new or worsening health conditions after receiving the influenza vaccine from 11(28%) participants. Of the usability survey responses, 86% agreed or strongly agreed that they would prefer to use a mobile app based reporting system instead of a web-based system. The single spontaneous report received was from a participant who had also reported using the Day 8 survey. Of Lookback observable sessions, an accurate transmission proportion of 100% (n=290) was reported for data points. We demonstrated that a mobile app can be used for AEFI reporting, although download and survey completion proportions suggest potential barriers to adoption. Future studies should examine implementation of mobile reporting in a broader audience and impact on the quality of reporting of adverse events following immunization.

49 CFR 37.103 - Purchase or lease of new non-rail vehicles by private entities primarily engaged in the business...

Code of Federal Regulations, 2010 CFR

2010-10-01

... new vehicle other than an automobile, a van with a seating capacity of less than eight persons... and usable by individuals with disabilities, including individuals who use wheelchairs. (c) Demand responsive systems. If the entity operates a demand responsive system, and purchases or leases a new vehicle...

Checking an integrated model of web accessibility and usability evaluation for disabled people.

PubMed

Federici, Stefano; Micangeli, Andrea; Ruspantini, Irene; Borgianni, Stefano; Corradi, Fabrizio; Pasqualotto, Emanuele; Olivetti Belardinelli, Marta

2005-07-08

A combined objective-oriented and subjective-oriented method for evaluating accessibility and usability of web pages for students with disability was tested. The objective-oriented approach is devoted to verifying the conformity of interfaces to standard rules stated by national and international organizations responsible for web technology standardization, such as W3C. Conversely, the subjective-oriented approach allows assessing how the final users interact with the artificial system, accessing levels of user satisfaction based on personal factors and environmental barriers. Five kinds of measurements were applied as objective-oriented and subjective-oriented tests. Objective-oriented evaluations were performed on the Help Desk web page for students with disability, included in the website of a large Italian state university. Subjective-oriented tests were administered to 19 students labeled as disabled on the basis of their own declaration at the University enrolment: 13 students were tested by means of the SUMI test and six students by means of the 'Cooperative evaluation'. Objective-oriented and subjective-oriented methods highlighted different and sometimes conflicting results. Both methods have pointed out much more consistency regarding levels of accessibility than of usability. Since usability is largely affected by individual differences in user's own (dis)abilities, subjective-oriented measures underscored the fact that blind students encountered much more web surfing difficulties.

Adaptive Strategies and Person-Environment Fit among Functionally Limited Older Adults Aging in Place: A Mixed Methods Approach

PubMed Central

Lien, Laura L.; Steggell, Carmen D.; Iwarsson, Susanne

2015-01-01

Older adults prefer to age in place, necessitating a match between person and environment, or person-environment (P-E) fit. In occupational therapy practice, home modifications can support independence, but more knowledge is needed to optimize interventions targeting the housing situation of older adults. In response, this study aimed to explore the accessibility and usability of the home environment to further understand adaptive environmental behaviors. Mixed methods data were collected using objective and perceived indicators of P-E fit among 12 older adults living in community-dwelling housing. Quantitative data described objective P-E fit in terms of accessibility, while qualitative data explored perceived P-E fit in terms of usability. While accessibility problems were prevalent, participants’ perceptions of usability revealed a range of adaptive environmental behaviors employed to meet functional needs. A closer examination of the P-E interaction suggests that objective accessibility does not always stipulate perceived usability, which appears to be malleable with age, self-perception, and functional competency. Findings stress the importance of evaluating both objective and perceived indicators of P-E fit to provide housing interventions that support independence. Further exploration of adaptive processes in older age may serve to deepen our understanding of both P-E fit frameworks and theoretical models of aging well. PMID:26404352

Usability Testing of an Interactive Virtual Reality Distraction Intervention to Reduce Procedural Pain in Children and Adolescents With Cancer.

PubMed

Birnie, Kathryn A; Kulandaivelu, Yalinie; Jibb, Lindsay; Hroch, Petra; Positano, Karyn; Robertson, Simon; Campbell, Fiona; Abla, Oussama; Stinson, Jennifer

2018-06-01

Needle procedures are among the most distressing aspects of pediatric cancer-related treatment. Virtual reality (VR) distraction offers promise for needle-related pain and distress given its highly immersive and interactive virtual environment. This study assessed the usability (ease of use and understanding, acceptability) of a custom VR intervention for children with cancer undergoing implantable venous access device (IVAD) needle insertion. Three iterative cycles of mixed-method usability testing with semistructured interviews were undertaken to refine the VR. Participants included 17 children and adolescents (8-18 years old) with cancer who used the VR intervention prior to or during IVAD access. Most participants reported the VR as easy to use (82%) and understand (94%), and would like to use it during subsequent needle procedures (94%). Based on usability testing, refinements were made to VR hardware, software, and clinical implementation. Refinements focused on increasing responsiveness, interaction, and immersion of the VR program, reducing head movement for VR interaction, and enabling participant alerts to steps of the procedure by clinical staff. No adverse events of nausea or dizziness were reported. The VR intervention was deemed acceptable and safe. Next steps include assessing feasibility and effectiveness of the VR intervention for pain and distress.

Adaptive Strategies and Person-Environment Fit among Functionally Limited Older Adults Aging in Place: A Mixed Methods Approach.

PubMed

Lien, Laura L; Steggell, Carmen D; Iwarsson, Susanne

2015-09-23

Older adults prefer to age in place, necessitating a match between person and environment, or person-environment (P-E) fit. In occupational therapy practice, home modifications can support independence, but more knowledge is needed to optimize interventions targeting the housing situation of older adults. In response, this study aimed to explore the accessibility and usability of the home environment to further understand adaptive environmental behaviors. Mixed methods data were collected using objective and perceived indicators of P-E fit among 12 older adults living in community-dwelling housing. Quantitative data described objective P-E fit in terms of accessibility, while qualitative data explored perceived P-E fit in terms of usability. While accessibility problems were prevalent, participants' perceptions of usability revealed a range of adaptive environmental behaviors employed to meet functional needs. A closer examination of the P-E interaction suggests that objective accessibility does not always stipulate perceived usability, which appears to be malleable with age, self-perception, and functional competency. Findings stress the importance of evaluating both objective and perceived indicators of P-E fit to provide housing interventions that support independence. Further exploration of adaptive processes in older age may serve to deepen our understanding of both P-E fit frameworks and theoretical models of aging well.

Mobile application for diabetes self-management in China: Do they fit for older adults?

PubMed

Gao, Chenchen; Zhou, Lanshu; Liu, Zhihui; Wang, Haocen; Bowers, Barbara

2017-05-01

Despite the exponential proliferation of Chinese diabetes applications, none are designed to meet the needs of the largest potential user population. The purpose of this study is to examine the features and contents of Chinese diabetes mobile applications in terms of their suitability for use by older adults with diabetes. A search of the Apple application store and the 360 Mobile Assistant was conducted to identify Chinese diabetes applications. Next, we compared the features and contents of all the included and most popular diabetes applications with both the International Diabetes Federation (IDF) clinical guideline and recommended usability criteria for older adults respectively. Seventy-one diabetes apps were randomly selected (from a pool of 552 diabetes apps) and reviewed. The features of most apps failed to include content areas of known importance for managing diabetes in older adults. Usability of all tested applications was rated moderate to good. Designing maximally effective medical applications would benefit from attention to both usability and content guidelines targeted for the largest potential user population. Despite the preponderance of older adults in the potential user group, failing to consider the relevance of content, in addition to usability for the specific population will ultimately limit the usefulness of the app. Copyright © 2017 Elsevier B.V. All rights reserved.

A Multicentre Audit of Single-Use Surgical Instruments (SUSI) for Tonsillectomy and Adenoidectomy

PubMed Central

O'Flynn, P; Silva, S; Kothari, P; Persaud, R

2007-01-01

INTRODUCTION Prions are resistant to conventional sterilisation procedures and, therefore, could be transmitted iatrogenically through re-usable adenoid and tonsil surgical instruments. Using disposable instruments would avoid the risk of transmission. We present the results of a complete audit loop using BBraun single-use surgical instruments (SUSI). PATIENTS AND METHODS This was a prospective multicentre audit. Surgeons were asked to fill in a standardised questionnaire recording details including postoperative complications, and evaluation of each piece of equipment compared with their own experience of conventional re-usable instruments. In the first cycle, constructive criticisms of the instruments were noted and the manufacturers modified the instruments accordingly. A second cycle of audit was subsequently undertaken. RESULTS A total of 86 patients were audited in the first cycle and 97 in the second cycle. Postoperative haemorrhage rate for both cycles was well within acceptable range. In the first audit cycle, surgeons generally found the Draffin rods, Boyle-Davis gag and bipolar diathermy forceps of poor quality and difficult to use. These were redesigned and, on repeat evaluation during the second audit cycle, were found to be just as good, if not better, than the re-usable instruments. CONCLUSIONS This study suggests that SUSI may be just as good as re-usable instruments. Furthermore, they may be more cost effective. PMID:18201478

Web-based Education for Low-literate Parents in Neonatal Intensive Care Unit: Development of a Website and Heuristic Evaluation and Usability Testing

PubMed Central

Choi, Jeungok; Bakken, Suzanne

2010-01-01

Purpose Low health literacy has been associated with poor health-related outcomes. The purposes are to report the development of a website for low-literate parents in the Neonatal Intensive Care Unit (NICU), and the findings of heuristic evaluation and a usability testing of this website. Methods To address low literacy of NICU parents, multimedia educational Website using visual aids (e.g., pictographs, photographs), voice-recorded text message in addition to a simplified text was developed. The text was created at the 5th grade readability level. The heuristic evaluation was conducted by three usability experts using 10 heuristics. End-users’ performance was measured by counting the time spent completing tasks and number of errors, as well as recording users’ perception of ease of use and usefulness (PEUU) in a sample of 10 NICU parents. Results Three evaluators identified 82 violations across the 10 heuristics. All violations, however, received scores <2, indicating minor usability problems. Participants’ time to complete task varies from 81.2 seconds (SD=30.9) to 2.2 seconds (SD=1.3). Participants rated the Website as easy to use and useful (PEUU Mean= 4.52, SD=0.53). Based on the participants’ comments, appropriate modifications were made. Discussion and Conclusions Different types of visuals on the Website were well accepted by low-literate users and agreement of visuals with text improved understanding of the educational materials over that with text alone. The findings suggest that using concrete and realistic pictures and pictographs with clear captions would maximize the benefit of visuals. One emerging theme was “simplicity” in design (e.g., limited use of colors, one font type and size), content (e.g., avoid lengthy text), and technical features (e.g., limited use of pop-ups). The heuristic evaluation by usability experts and the usability test with actual users provided complementary expertise, which can give a richer assessment of a design for low literacy Website. These results facilitated design modification and implementation of solutions by categorizing and prioritizing the usability problems. PMID:20617546

Web-based education for low-literate parents in Neonatal Intensive Care Unit: development of a website and heuristic evaluation and usability testing.

PubMed

Choi, Jeungok; Bakken, Suzanne

2010-08-01

Low health literacy has been associated with poor health-related outcomes. The purposes are to report the development of a website for low-literate parents in the Neonatal Intensive Care Unit (NICU), and the findings of heuristic evaluation and a usability testing of this website. To address low literacy of NICU parents, multimedia educational Website using visual aids (e.g., pictographs, photographs), voice-recorded text message in addition to a simplified text was developed. The text was created at the 5th grade readability level. The heuristic evaluation was conducted by three usability experts using 10 heuristics. End-users' performance was measured by counting the time spent completing tasks and number of errors, as well as recording users' perception of ease of use and usefulness (PEUU) in a sample of 10 NICU parents. Three evaluators identified 82 violations across the 10 heuristics. All violations, however, received scores <2, indicating minor usability problems. Participants' time to complete task varies from 81.2 s (SD = 30.9) to 2.2 s (SD = 1.3). Participants rated the Website as easy to use and useful (PEUU mean = 4.52, SD = 0.53). Based on the participants' comments, appropriate modifications were made. Different types of visuals on the Website were well accepted by low-literate users and agreement of visuals with text improved understanding of the educational materials over that with text alone. The findings suggest that using concrete and realistic pictures and pictographs with clear captions would maximize the benefit of visuals. One emerging theme was "simplicity" in design (e.g., limited use of colors, one font type and size), content (e.g., avoid lengthy text), and technical features (e.g., limited use of pop-ups). The heuristic evaluation by usability experts and the usability test with actual users provided complementary expertise, which can give a richer assessment of a design for low literacy Website. These results facilitated design modification and implementation of solutions by categorizing and prioritizing the usability problems.

Qualitative and quantitative evaluation of EHR-integrated mobile patient questionnaires regarding usability and cost-efficiency.

PubMed

Fritz, Fleur; Balhorn, Sebastian; Riek, Markus; Breil, Bernhard; Dugas, Martin

2012-05-01

The objective of this evaluation study is to assess a web-based application, currently available on iPad, to document questionnaires regarding patient reported outcomes such as quality of life. Based on the single source approach, the results of these questionnaires are available in the electronic health record to be used for treatment and research purposes. The assessment focuses on the usability and efficiency of the system. The system usability scale questionnaire with seven additional items was used to rate the usability by the patients. It was formally validated by a Cronbach Alpha test. In addition, semi-structured interviews were conducted with patients and medical staff. Time and cost measures, based on official tables of costs, were taken through workflow observations. This study was conducted in the department of dermatology at the University Hospital of Münster, Germany from April to June 2011. Using the web-based application questionnaire, results about patient reported outcomes like quality of life are immediately available in the electronic health record and can be used for treatment or research purposes. 118 patients and four staff members participated in the study. The usability score reached 80 from 100 points and patients as well as medical staff stated in the interviews that the usability of the web-based system was high, and they preferred it to the previously used paper-based questionnaires. In the setting of our pilot department the mobile devices amortized their costs after 6.7 months. In general, depending on the professional group who are going to post process the paper-based forms, the earliest break-even point to use mobile questionnaires is at 1737 paper sheets per year. The mobile patient questionnaires, integrated into the electronic health record, were well accepted in our pilot setting with high usability scores from patients and medical staff alike. The system has also proved to be cost-efficient compared to the paper-based workflow, given that a certain number of questionnaires is used per year. Copyright © 2011 Elsevier Ireland Ltd. All rights reserved.

Interactivity Centered Usability Evaluation (ICUE) for Course Management Systems

ERIC Educational Resources Information Center

Yoon, Sangil

2010-01-01

ICUE (Interactivity Centered Usability Evaluation) is an enhanced usability testing protocol created by the researcher. ICUE augments the facilitator's role for usability testing, and offers strategies in developing and presenting usability tasks during a testing session. ICUE was designed to address weaknesses found in the usability evaluation of…

Usability Prediction & Ranking of SDLC Models Using Fuzzy Hierarchical Usability Model

NASA Astrophysics Data System (ADS)

Gupta, Deepak; Ahlawat, Anil K.; Sagar, Kalpna

2017-06-01

Evaluation of software quality is an important aspect for controlling and managing the software. By such evaluation, improvements in software process can be made. The software quality is significantly dependent on software usability. Many researchers have proposed numbers of usability models. Each model considers a set of usability factors but do not cover all the usability aspects. Practical implementation of these models is still missing, as there is a lack of precise definition of usability. Also, it is very difficult to integrate these models into current software engineering practices. In order to overcome these challenges, this paper aims to define the term `usability' using the proposed hierarchical usability model with its detailed taxonomy. The taxonomy considers generic evaluation criteria for identifying the quality components, which brings together factors, attributes and characteristics defined in various HCI and software models. For the first time, the usability model is also implemented to predict more accurate usability values. The proposed system is named as fuzzy hierarchical usability model that can be easily integrated into the current software engineering practices. In order to validate the work, a dataset of six software development life cycle models is created and employed. These models are ranked according to their predicted usability values. This research also focuses on the detailed comparison of proposed model with the existing usability models.

Formative Evaluation of Care Nexus: a Tool for the Visualization and Management of Care Teams of Complex Pediatric Patients

PubMed Central

Ranade-Kharkar, Pallavi; Norlin, Chuck; Del Fiol, Guilherme

2017-01-01

Complex and chronic conditions in pediatric patients with special needs often result in large and diverse patient care teams. Having a comprehensive view of the care teams is crucial to achieving effective and efficient care coordination for these vulnerable patients. In this study, we iteratively design and develop two alternative user interfaces (graphical and tabular) of a prototype of a tool for visualizing and managing care teams and conduct a formative assessment of the usability, usefulness, and efficiency of the tool. The median time to task completion for the 21 study participants was less than 7 seconds for 19 out of the 22 usability tasks. While both the prototype formats were well-liked in terms of usability and usefulness, the tabular format was rated higher for usefulness (p=0.02). Inclusion of CareNexus-like tools in electronic and personal health records has the potential to facilitate care coordination in complex pediatric patients. PMID:29854215

Rhinoplasty planning with an iPhone app: analysis of otolaryngologists response.

PubMed

Larrosa, Francesc; Dura, Maria J; Roura, Josep; Hernandez, Anabella

2013-09-01

The field of medical applications is currently one of the most dynamic in medicine due to the great potential for improving clinical practice they hold. However, clinicians' opinion around their usability in daily clinical care has not been thoroughly addressed. This study aimed to analyze the otolaryngologists response to a rhinoplasty application. It was designed as a survey of 21 otolaryngologists with regards to a rhinoplasty planning application for the iPhone with the capacity to project potential surgery outcomes through tactile morphing software compared to a photo tracing method used as the gold standard. The participants were asked to rate the usefulness of the two technologies on a visual analog scale from 0-10. Questions addressed included four topics: physician-patient communication; imaging process time; perceived usefulness for preoperative planning; and perceived usefulness for surgery. A one sample t-test was applied to compare the scores of both methods for each question. The test subjects (mean age 43.21 years) rated the utility of the iPhone application as superior to that of the photo tracing method (p < 0.05) concluding that the iPhone application could facilitate an immediate preliminary analysis of the options for nasal improvement.

The effect of touch-key size on the usability of In-Vehicle Information Systems and driving safety during simulated driving.

PubMed

Kim, Heejin; Kwon, Sunghyuk; Heo, Jiyoon; Lee, Hojin; Chung, Min K

2014-05-01

Investigating the effect of touch-key size on usability of In-Vehicle Information Systems (IVISs) is one of the most important research issues since it is closely related to safety issues besides its usability. This study investigated the effects of the touch-key size of IVISs with respect to safety issues (the standard deviation of lane position, the speed variation, the total glance time, the mean glance time, the mean time between glances, and the mean number of glances) and the usability of IVISs (the task completion time, error rate, subjective preference, and NASA-TLX) through a driving simulation. A total of 30 drivers participated in the task of entering 5-digit numbers with various touch-key sizes while performing simulated driving. The size of the touch-key was 7.5 mm, 12.5 mm, 17.5 mm, 22.5 mm and 27.5 mm, and the speed of driving was set to 0 km/h (stationary state), 50 km/h and 100 km/h. As a result, both the driving safety and the usability of the IVISs increased as the touch-key size increased up to a certain size (17.5 mm in this study), at which they reached asymptotes. We performed Fitts' law analysis of our data, and this revealed that the data from the dual task experiment did not follow Fitts' law. Copyright © 2013 Elsevier Ltd and The Ergonomics Society. All rights reserved.

Usability Testing of a Computerized Communication Tool in a Diverse Urban Pediatric Population

PubMed Central

Tsimicalis, Argerie; Stone, Patricia W.; Bakken, Suzanne; Yoon, Sunmoo; Sands, Stephen; Porter, Rechelle; Ruland, Cornelia

2015-01-01

Background Developed in Norway, Sisom is an interactive, rigorously tested, computerized, communication tool designed to help children with cancer express their perceived symptoms/problems. Children travel virtually from island to island rating their symptoms/problems. While Sisom has been found to significantly improve communication in patient consultations in Norway, usability testing is warranted with US children prior to further use in research studies. Objective To determine the usability of Sisom in a sample of English and Spanish speaking children in an urban US community. Methods A mixed methods usability study was conducted with a purposive sample of healthy children and children with cancer. Semi-structured interviews were used to assess healthy children’s symptom recognition. Children with cancer completed 8 usability tasks captured with Morae® 3.3 software. Data were downloaded, transcribed, and analyzed descriptively. Results Four healthy children and 8 children with cancer participated. Of the 44 symptoms assessed, healthy children recognized 15 (34%) pictorial symptoms immediately or indicated 13 (30%) pictures were good representations of the symptom. Six children with cancer completed all tasks. All children navigated successfully from one island to the next, ranking their symptom/problem severity, clicking the magnifying glass for help, or asking the researcher for assistance. All children were satisfied with the aesthetics and expressed an interest in using Sisom to communicate their symptoms. Conclusions A few minor suggestions for improvement and adjustment may optimize the use of Sisom for US children. Implications for Practice Sisom may help clinicians overcome challenges assessing children’s complex symptoms/problems in a child-friendly manner. PMID:24457227

Integrating Visual Mnemonics and Input Feedback With Passphrases to Improve the Usability and Security of Digital Authentication.

PubMed

Juang, Kevin; Greenstein, Joel

2018-04-01

We developed a new authentication system based on passphrases instead of passwords. Our new system incorporates a user-generated mnemonic picture displayed during login, definition tooltips, error correction to reduce typographical errors, a decoy-based input masking technique, and random passphrase generation using either a specialized wordlist or a sentence template. Passphrases exhibit a greater level of security than traditional passwords, but their wider adoption has been hindered by human factors issues. Our assertion is that the added features of our system work particularly well with passphrases and help address these shortcomings. We conducted a study to evaluate our new system with a customized 1,450-word list and our new system with a 6-word sentence structure against the control conditions of a user-created passphrase of at least 24 characters and a system-generated passphrase using a 10,326-word list. Fifty participants completed two sessions so that we could measure the usability and security of the authentication schemes. With the new system conditions, memorability was improved, and security was equivalent to or better than the control conditions. Usability and overall ratings also favored the new system conditions over the control conditions. Our research presents a new authentication system using innovative techniques that improve on the usability and security of existing password and passphrase authentication systems. In computer security, drastic changes should never happen overnight, but we recommend that our contributions be incorporated into current authentication systems to help facilitate a transition from passwords to usable passphrases.

Effect of questionnaire length, personalisation and reminder type on response rate to a complex postal survey: randomised controlled trial

PubMed Central

2011-01-01

Background Minimising participant non-response in postal surveys helps to maximise the generalisability of the inferences made from the data collected. The aim of this study was to examine the effect of questionnaire length, personalisation and reminder type on postal survey response rate and quality and to compare the cost-effectiveness of the alternative survey strategies. Methods In a pilot study for a population study of travel behaviour, physical activity and the environment, 1000 participants sampled from the UK edited electoral register were randomly allocated using a 2 × 2 factorial design to receive one of four survey packs: a personally addressed long (24 page) questionnaire pack, a personally addressed short (15 page) questionnaire pack, a non-personally addressed long questionnaire pack or a non-personally addressed short questionnaire pack. Those who did not return a questionnaire were stratified by initial randomisation group and further randomised to receive either a full reminder pack or a reminder postcard. The effects of the survey design factors on response were examined using multivariate logistic regression. Results An overall response rate of 17% was achieved. Participants who received the short version of the questionnaire were more likely to respond (OR = 1.48, 95% CI 1.06 to 2.07). In those participants who received a reminder, personalisation of the survey pack and reminder also increased the odds of response (OR = 1.44, 95% CI 1.01 to 1.95). Item non-response was relatively low, but was significantly higher in the long questionnaire than the short (9.8% vs 5.8%; p = .04). The cost per additional usable questionnaire returned of issuing the reminder packs was £23.1 compared with £11.3 for the reminder postcards. Conclusions In contrast to some previous studies of shorter questionnaires, this trial found that shortening a relatively lengthy questionnaire significantly increased the response. Researchers should consider the trade off between the value of additional questions and a larger sample. If low response rates are expected, personalisation may be an important strategy to apply. Sending a full reminder pack to non-respondents appears a worthwhile, albeit more costly, strategy. PMID:21548947

Health figures: an open source JavaScript library for health data visualization.

PubMed

Ledesma, Andres; Al-Musawi, Mohammed; Nieminen, Hannu

2016-03-22

The way we look at data has a great impact on how we can understand it, particularly when the data is related to health and wellness. Due to the increased use of self-tracking devices and the ongoing shift towards preventive medicine, better understanding of our health data is an important part of improving the general welfare of the citizens. Electronic Health Records, self-tracking devices and mobile applications provide a rich variety of data but it often becomes difficult to understand. We implemented the hFigures library inspired on the hGraph visualization with additional improvements. The purpose of the library is to provide a visual representation of the evolution of health measurements in a complete and useful manner. We researched the usefulness and usability of the library by building an application for health data visualization in a health coaching program. We performed a user evaluation with Heuristic Evaluation, Controlled User Testing and Usability Questionnaires. In the Heuristics Evaluation the average response was 6.3 out of 7 points and the Cognitive Walkthrough done by usability experts indicated no design or mismatch errors. In the CSUQ usability test the system obtained an average score of 6.13 out of 7, and in the ASQ usability test the overall satisfaction score was 6.64 out of 7. We developed hFigures, an open source library for visualizing a complete, accurate and normalized graphical representation of health data. The idea is based on the concept of the hGraph but it provides additional key features, including a comparison of multiple health measurements over time. We conducted a usability evaluation of the library as a key component of an application for health and wellness monitoring. The results indicate that the data visualization library was helpful in assisting users in understanding health data and its evolution over time.

Telemonitoring of patients with Parkinson's disease using inertia sensors.

PubMed

Piro, N E; Baumann, L; Tengler, M; Piro, L; Blechschmidt-Trapp, R

2014-01-01

Medical treatment in patients suffering from Parkinson's disease is very difficult as dose-finding is mainly based on selective and subjective impressions by the physician. To allow for the objective evaluation of patients' symptoms required for optimal dosefinding, a telemonitoring system tracks the motion of patients in their surroundings. The system focuses on providing interoperability and usability in order to ensure high acceptance. Patients wear inertia sensors and perform standardized motor tasks. Data are recorded, processed and then presented to the physician in a 3D animated form. In addition, the same data is rated based on the UPDRS score. Interoperability is realized by developing the system in compliance with the recommendations of the Continua Health Alliance. Detailed requirements analysis and continuous collaboration with respective user groups help to achieve high usability. A sensor platform was developed that is capable of measuring acceleration and angular rate of motions as well as the absolute orientation of the device itself through an included compass sensor. The system architecture was designed and required infrastructure, and essential parts of the communication between the system components were implemented following Continua guidelines. Moreover, preliminary data analysis based on three-dimensional acceleration and angular rate data could be established. A prototype system for the telemonitoring of Parkinson's disease patients was successfully developed. The developed sensor platform fully satisfies the needs of monitoring patients of Parkinson's disease and is comparable to other sensor platforms, although these sensor platforms have yet to be tested rigorously against each other. Suitable approaches to provide interoperability and usability were identified and realized and remain to be tested in the field.

Improving usability and pregnancy rates of a fertility monitor by an additional mobile application: results of a retrospective efficacy study of Daysy and DaysyView app.

PubMed

Koch, Martin C; Lermann, Johannes; van de Roemer, Niels; Renner, Simone K; Burghaus, Stefanie; Hackl, Janina; Dittrich, Ralf; Kehl, Sven; Oppelt, Patricia G; Hildebrandt, Thomas; Hack, Caroline C; Pöhls, Uwe G; Renner, Stefan P; Thiel, Falk C

2018-03-02

Daysy is a fertility monitor that uses the fertility awareness method by tracking and analyzing the individual menstrual cycle. In addition, Daysy can be connected to the application DaysyView to transfer stored personal data from Daysy to a smartphone or tablet (IOS, Android). This combination is interesting because as it is shown in various studies, the use of apps is increasing patients´ focus on their disease or their health behavior. The aim of this study was to investigate if by the additional use of an App and thereby improved usability of the medical device, it is possible to enhance the typical-use related as well as the method-related pregnancy rates. In the resultant group of 125 women (2076 cycles in total), 2 women indicated that they had been unintentionally pregnant during the use of the device, giving a typical-use related Pearl-Index of 1.3. Counting only the pregnancies which occurred as a result of unprotected intercourse during the infertile (green) phase, we found 1 pregnancy, giving a method-related Pearl-Index of 0.6. Calculating the pregnancy rate resulting from continuous use and unprotected intercourse exclusively on green days, gives a perfect-use Pearl-Index of 0.8. It seems that combining a specific biosensor-embedded device (Daysy), which gives the method a very high repeatable accuracy, and a mobile application (DaysyView) which leads to higher user engagement, results in higher overall usability of the method.

Smartphone Text Input Method Performance, Usability, and Preference With Younger and Older Adults.

PubMed

Smith, Amanda L; Chaparro, Barbara S

2015-09-01

User performance, perceived usability, and preference for five smartphone text input methods were compared with younger and older novice adults. Smartphones are used for a variety of functions other than phone calls, including text messaging, e-mail, and web browsing. Research comparing performance with methods of text input on smartphones reveals a high degree of variability in reported measures, procedures, and results. This study reports on a direct comparison of five of the most common input methods among a population of younger and older adults, who had no experience with any of the methods. Fifty adults (25 younger, 18-35 years; 25 older, 60-84 years) completed a text entry task using five text input methods (physical Qwerty, onscreen Qwerty, tracing, handwriting, and voice). Entry and error rates, perceived usability, and preference were recorded. Both age groups input text equally fast using voice input, but older adults were slower than younger adults using all other methods. Both age groups had low error rates when using physical Qwerty and voice, but older adults committed more errors with the other three methods. Both younger and older adults preferred voice and physical Qwerty input to the remaining methods. Handwriting consistently performed the worst and was rated lowest by both groups. Voice and physical Qwerty input methods proved to be the most effective for both younger and older adults, and handwriting input was the least effective overall. These findings have implications to the design of future smartphone text input methods and devices, particularly for older adults. © 2015, Human Factors and Ergonomics Society.

Evaluating an Innovative eLearning Pain Education Interprofessional Resource: A Pre-Post Study.

PubMed

Watt-Watson, Judy; McGillion, Michael; Lax, Leila; Oskarsson, Jon; Hunter, Judith; MacLennan, Cameron; Knickle, Kerry; Victor, J Charles

2018-06-20

The challenges of moving the pain education agenda forward are significant worldwide, and resources, including online, are needed to help educators in curriculum development. Online resources are available but with insufficient evaluation in the context of prelicensure pain education. Therefore, this pre-post study examined the impact of an innovative eLearning model: the Pain Education Interprofessional Resource (PEIR) on usability, pain knowledge, beliefs, and understanding of pain assessment skills including empathy. Participants were students (N = 96) recruited from seven prelicensure health sciences programs at the University of Toronto. They worked through three multifaceted modules, developed by an interprofessional team, that followed a patient with acute to persistent postsurgical pain up to one year. Module objectives, content, and assessment were based on International Association for the Study of Pain Pain Curricula domains and related pain core competencies. Multimedia interactive components focused on pain mechanisms and key pain care issues. Outcome measures included previously validated tools; data were analyzed in SPSS. Online exercises provided concurrent individual feedback throughout all modules. The completion rate for modules and online assessments was 100%. Overall usability scores (SD) were strong 4.27/5 (0.56). On average, pain knowledge scores increased 20% (P < 0.001). The Pain Assessment Skills Tool was sensitive to differences in student and expert pain assessment evaluation ratings and was useful as a tool to deliver formative feedback while engaged in interactive eLearning about pain assessment. PEIR is an effective eLearning program with high student ratings for educational design and usability that significantly improved pain knowledge and understanding of collaborative care.

Usability and Feasibility of an Internet-Based Virtual Pedestrian Environment to Teach Children to Cross Streets Safely

PubMed Central

Schwebel, David C.; McClure, Leslie A.; Severson, Joan

2013-01-01

Child pedestrian injury is a preventable global health challenge. Successful training efforts focused on child behavior, including individualized streetside training and training in large virtual pedestrian environments, are laborious and expensive. This study considers the usability and feasibility of a virtual pedestrian environment “game” application to teach children safe street-crossing behavior via the internet, a medium that could be broadly disseminated at low cost. Ten 7- and 8-year-old children participated. They engaged in an internet-based virtual pedestrian environment and completed a brief assessment survey. Researchers rated children's behavior while engaged in the game. Both self-report and researcher observations indicated the internet-based system was readily used by the children without adult support. The youth understood how to engage in the system and used it independently and attentively. The program also was feasible. It provided multiple measures of pedestrian safety that could be used for research or training purposes. Finally, the program was rated by children as engaging and educational. Researcher ratings suggested children used the program with minimal fidgeting or boredom. The pilot test suggests an internet-based virtual pedestrian environment offers a usable, feasible, engaging, and educational environment for child pedestrian safety training. If future research finds children learn the cognitive and perceptual skills needed to cross streets safely within it, internet-based training may provide a low-cost medium to broadly disseminate child pedestrian safety training. The concept may be generalized to other domains of health-related functioning such as teen driving safety, adolescent sexual risk-taking, and adolescent substance use. PMID:24678263

Towards a Usability and Error "Safety Net": A Multi-Phased Multi-Method Approach to Ensuring System Usability and Safety.

PubMed

Kushniruk, Andre; Senathirajah, Yalini; Borycki, Elizabeth

2017-01-01

The usability and safety of health information systems have become major issues in the design and implementation of useful healthcare IT. In this paper we describe a multi-phased multi-method approach to integrating usability engineering methods into system testing to ensure both usability and safety of healthcare IT upon widespread deployment. The approach involves usability testing followed by clinical simulation (conducted in-situ) and "near-live" recording of user interactions with systems. At key stages in this process, usability problems are identified and rectified forming a usability and technology-induced error "safety net" that catches different types of usability and safety problems prior to releasing systems widely in healthcare settings.

Positive technology: a free mobile platform for the self-management of psychological stress.

PubMed

Gaggioli, Andrea; Cipresso, Pietro; Serino, Silvia; Campanaro, Danilo Marco; Pallavicini, Federica; Wiederhold, Brenda K; Riva, Giuseppe

2014-01-01

We describe the main features and preliminary evaluation of Positive Technology, a free mobile platform for the self-management of psychological stress (http://positiveapp.info/). The mobile platform features three main components: (i) guided relaxation, which provides the user with the opportunity of browsing a gallery of relaxation music and video-narrative resources for reducing stress; (ii) 3D biofeedback, which helps the user learning to control his/her responses, by visualizing variations of heart rate in an engaging 3D environment; (iii) stress tracking, by the recording of heart rate and self-reports. We evaluated the Positive Technology app in an online trial involving 32 participants, out of which 7 used the application in combination with the wrist sensor. Overall, feedback from users was satisfactory and the analysis of data collected online indicated the capability of the app for reducing perceived stress levels. A future goal is to improve the usability of the application and include more advanced stress monitoring features, based on the analysis of heart rate variability indexes.

User-centered development and testing of a monitoring system that provides feedback regarding physical functioning to elderly people

PubMed Central

Vermeulen, Joan; Neyens, Jacques CL; Spreeuwenberg, Marieke D; van Rossum, Erik; Sipers, Walther; Habets, Herbert; Hewson, David J; de Witte, Luc P

2013-01-01

Purpose To involve elderly people during the development of a mobile interface of a monitoring system that provides feedback to them regarding changes in physical functioning and to test the system in a pilot study. Methods and participants The iterative user-centered development process consisted of the following phases: (1) selection of user representatives; (2) analysis of users and their context; (3) identification of user requirements; (4) development of the interface; and (5) evaluation of the interface in the lab. Subsequently, the monitoring and feedback system was tested in a pilot study by five patients who were recruited via a geriatric outpatient clinic. Participants used a bathroom scale to monitor weight and balance, and a mobile phone to monitor physical activity on a daily basis for six weeks. Personalized feedback was provided via the interface of the mobile phone. Usability was evaluated on a scale from 1 to 7 using a modified version of the Post-Study System Usability Questionnaire (PSSUQ); higher scores indicated better usability. Interviews were conducted to gain insight into the experiences of the participants with the system. Results The developed interface uses colors, emoticons, and written and/or spoken text messages to provide daily feedback regarding (changes in) weight, balance, and physical activity. The participants rated the usability of the monitoring and feedback system with a mean score of 5.2 (standard deviation 0.90) on the modified PSSUQ. The interviews revealed that most participants liked using the system and appreciated that it signaled changes in their physical functioning. However, usability was negatively influenced by a few technical errors. Conclusion Involvement of elderly users during the development process resulted in an interface with good usability. However, the technical functioning of the monitoring system needs to be optimized before it can be used to support elderly people in their self-management. PMID:24039407

From Usability Engineering to Evidence-based Usability in Health IT.

PubMed

Marcilly, Romaric; Peute, Linda; Beuscart-Zephir, Marie-Catherine

2016-01-01

Usability is a critical factor in the acceptance, safe use, and success of health IT. The User-Centred Design process is widely promoted to improve usability. However, this traditional case by case approach that is rooted in the sound understanding of users' needs is not sufficient to improve technologies' usability and prevent usability-induced use-errors that may harm patients. It should be enriched with empirical evidence. This evidence is on design elements (what are the most valuable design principles, and the worst usability mistakes), and on the usability evaluation methods (which combination of methods is most suitable in which context). To achieve this evidence, several steps must be fulfilled and challenges must be overcome. Some attempts to search evidence for designing elements of health IT and for usability evaluation methods exist and are summarized. A concrete instance of evidence-based usability design principles for medication-related alerting systems is briefly described.

5 CFR 532.241 - Analysis of usable wage survey data.

Code of Federal Regulations, 2014 CFR

2014-01-01

... the straight-line, least squares regression formula: Y=a+bx, where Y is the hourly rate, x is grade, a... least 10 unweighed matches and for each nonappropriated fund job having at least 5 unweighed matches...

5 CFR 532.241 - Analysis of usable wage survey data.

Code of Federal Regulations, 2013 CFR

2013-01-01

... the straight-line, least squares regression formula: Y=a+bx, where Y is the hourly rate, x is grade, a... least 10 unweighed matches and for each nonappropriated fund job having at least 5 unweighed matches...

5 CFR 532.241 - Analysis of usable wage survey data.

Code of Federal Regulations, 2012 CFR

2012-01-01

... the straight-line, least squares regression formula: Y=a+bx, where Y is the hourly rate, x is grade, a... least 10 unweighed matches and for each nonappropriated fund job having at least 5 unweighed matches...

5 CFR 532.241 - Analysis of usable wage survey data.

Code of Federal Regulations, 2011 CFR

2011-01-01

... the straight-line, least squares regression formula: Y=a+bx, where Y is the hourly rate, x is grade, a... least 10 unweighed matches and for each nonappropriated fund job having at least 5 unweighed matches...

Time in Your Tanks

DOT National Transportation Integrated Search

1995-01-01

What does "Time in Your Tanks" mean? Depending upon your aircraft's particular fuel consumption rate, the amount of usable fuel in your aircraft equates directly to how long your aircraft will fly. The longer you can fly, the more choices you have fo...

Automated Scoring of Teachers' Open-Ended Responses to Video Prompts: Bringing the Classroom-Video-Analysis Assessment to Scale

ERIC Educational Resources Information Center

Kersting, Nicole B.; Sherin, Bruce L.; Stigler, James W.

2014-01-01

In this study, we explored the potential for machine scoring of short written responses to the Classroom-Video-Analysis (CVA) assessment, which is designed to measure teachers' usable mathematics teaching knowledge. We created naïve Bayes classifiers for CVA scales assessing three different topic areas and compared computer-generated scores to…

Assessing the Integration of Audience Response System Technology in Teaching of Anatomical Sciences

ERIC Educational Resources Information Center

Alexander, Cara J.; Crescini, Weronika M.; Juskewitch, Justin E.; Lachman, Nirusha; Pawlina, Wojciech

2009-01-01

The goals of our study were to determine the predictive value and usability of an audience response system (ARS) as a knowledge assessment tool in an undergraduate medical curriculum. Over a three year period (2006-2008), data were collected from first year didactic blocks in Genetics/Histology and Anatomy/Radiology (n = 42-50 per class). During…

Microwave characteristics of GaAs MMIC integratable optical detectors

NASA Technical Reports Server (NTRS)

Claspy, Paul C.; Hill, Scott M.; Bhasin, Kul B.

1989-01-01

Interdigitated photoconductive detectors were fabricated on microwave device structures, making them easily integratable with Monolithic Microwave Integrated Circuits (MMIC). Detector responsivity as high as 2.5 A/W and an external quantum efficiency of 3.81 were measured. Response speed was nearly independent of electrode geometry, and all detectors had usable response at frequencies to 6 GHz. A small signal model of the detectors based on microwave measurements was also developed.

Middle-aged women's decisions about body weight management: needs assessment and testing of a knowledge translation tool.

PubMed

Stacey, Dawn; Jull, Janet; Beach, Sarah; Dumas, Alex; Strychar, Irene; Adamo, Kristi; Brochu, Martin; Prud'homme, Denis

2015-04-01

This study aims to assess middle-aged women's needs when making body weight management decisions and to evaluate a knowledge translation tool for addressing their needs. A mixed-methods study used an interview-guided theory-based survey of professional women aged 40 to 65 years. The tool summarized evidence to address their needs and enabled women to monitor actions taken. Acceptability and usability were reported descriptively. Sixty female participants had a mean body mass index of 28.0 kg/m(2) (range, 17.0-44.9 kg/m(2)), and half were premenopausal. Common options for losing (82%) or maintaining (18%) weight included increasing physical activity (60%), eating healthier (57%), and getting support (40%). Decision-making involved getting information on options (52%), soliciting others' decisions/advice (20%), and being self-motivated (20%). Preferred information sources included written information (97%), counseling (90%), and social networking websites (43%). Five professionals (dietitian, personal trainer, occupational therapist, and two physicians) had similar responses. Of 53 women sent the tool, 27 provided acceptability feedback. They rated it as good to excellent for information on menopause (96%), body weight changes (85%), and managing body weight (85%). Most would tell others about it (81%). After 4 weeks of use, 25 women reported that the wording made sense (96%) and that the tool had clear instructions (92%) and was easy to use across time (88%). The amount of information was rated as just right (64%), but the tool had limited space for responding (72%). When making decisions about body weight management, women's needs were "getting information" and "getting support." The knowledge translation tool was acceptable and usable, but further evaluation is required.

Middle-aged women’s decisions about body weight management: needs assessment and testing of a knowledge translation tool

PubMed Central

Stacey, Dawn; Jull, Janet; Beach, Sarah; Dumas, Alex; Strychar, Irene; Adamo, Kristi; Brochu, Martin; Prud’homme, Denis

2015-01-01

Abstract Objective This study aims to assess middle-aged women’s needs when making body weight management decisions and to evaluate a knowledge translation tool for addressing their needs. Methods A mixed-methods study used an interview-guided theory-based survey of professional women aged 40 to 65 years. The tool summarized evidence to address their needs and enabled women to monitor actions taken. Acceptability and usability were reported descriptively. Results Sixty female participants had a mean body mass index of 28.0 kg/m2 (range, 17.0-44.9 kg/m2), and half were premenopausal. Common options for losing (82%) or maintaining (18%) weight included increasing physical activity (60%), eating healthier (57%), and getting support (40%). Decision-making involved getting information on options (52%), soliciting others’ decisions/advice (20%), and being self-motivated (20%). Preferred information sources included written information (97%), counseling (90%), and social networking websites (43%). Five professionals (dietitian, personal trainer, occupational therapist, and two physicians) had similar responses. Of 53 women sent the tool, 27 provided acceptability feedback. They rated it as good to excellent for information on menopause (96%), body weight changes (85%), and managing body weight (85%). Most would tell others about it (81%). After 4 weeks of use, 25 women reported that the wording made sense (96%) and that the tool had clear instructions (92%) and was easy to use across time (88%). The amount of information was rated as just right (64%), but the tool had limited space for responding (72%). Conclusions When making decisions about body weight management, women’s needs were “getting information” and “getting support.” The knowledge translation tool was acceptable and usable, but further evaluation is required. PMID:25816120

Performance in the vertical test of the 832 nine-cell 1.3 GHz cavities for the European X-ray Free Electron Laser

NASA Astrophysics Data System (ADS)

Reschke, D.; Gubarev, V.; Schaffran, J.; Steder, L.; Walker, N.; Wenskat, M.; Monaco, L.

2017-04-01

The successful production and associated vertical testing of over 800 superconducting 1.3 GHz accelerating cavities for the European X-ray Free Electron Laser (XFEL) represents the culmination of over 20 years of superconducting radio-frequency R&D. The cavity production took place at two industrial vendors under the shared responsibility of INFN Milano-LASA and DESY. Average vertical testing rates at DESY exceeded 10 cavities per week, peaking at up to 15 cavities per week. The cavities sent for cryomodule assembly at Commissariat à l'énergie atomique (CEA) Saclay achieved an average maximum gradient of approximately 33 MV /m , reducing to ˜30 MV /m when the operational specifications on quality factor (Q) and field emission were included (the so-called usable gradient). Only 16% of the cavities required an additional surface retreatment to recover their low performance (usable gradient less than 20 MV /m ). These cavities were predominantly limited by excessive field emission for which a simple high pressure water rinse (HPR) was sufficient. Approximately 16% of the cavities also received an additional HPR, e.g. due to vacuum problems before or during the tests or other reasons, but these were not directly related to gradient performance. The in-depth statistical analyses presented in this report have revealed several features of the series produced cavities.

Unmet dental needs and barriers to dental care among children with autism spectrum disorders.

PubMed

Lai, Bien; Milano, Michael; Roberts, Michael W; Hooper, Stephen R

2012-07-01

Mail-in pilot-tested questionnaires were sent to a stratified random sample of 1,500 families from the North Carolina Autism Registry. Multivariate logistic regression analysis was used to determine the significance of unmet dental needs and other predictors. Of 568 surveys returned (Response Rate = 38%), 555 were complete and usable. Sixty-five (12%) children had unmet dental needs. Of 516 children (93%) who had been to a dentist, 11% still reported unmet needs. The main barriers were child's behavior, cost, and lack of insurance. The significant predictor variables of unmet needs were child's behavior (p = 0.01), child's dental health (p < 0.001), and caregiver's last dental visit greater than 6 months (p = 0.002). Type of ASD did not have an effect on having unmet dental needs.

An instrument to measure job satisfaction of nursing home administrators

PubMed Central

Castle, Nicholas G

2006-01-01

Background The psychometric properties of the nursing home administrator job satisfaction questionnaire (NHA-JSQ) are presented, and the steps used to develop this instrument. Methods The NHA-JSQ subscales were developed from pilot survey activities with 93 administrators, content analysis, and a research panel. The resulting survey was sent to 1,000 nursing home administrators. Factor analyses were used to determine the psychometric properties of the instrument. Results Of the 1,000 surveys mailed, 721 usable surveys were returned (72 percent response rate). The factor analyses show that the items were representative of six underlying factors (i.e., coworkers, work demands, work content, work load, work skills, and rewards). Conclusion The NHA-JSQ represents a short, psychometrically sound job satisfaction instrument for use in nursing homes. PMID:17029644

Usage Position and Virtual Keyboard Design Affect Upper-Body Kinematics, Discomfort, and Usability during Prolonged Tablet Typing

PubMed Central

Lin, Ming-I Brandon; Hong, Ruei-Hong; Chang, Jer-Hao; Ke, Xin-Min

2015-01-01

Purpose The increase in tablet usage allows people to perform computer work in non-traditional office environments. The aim of this study was to assess the effects of changes in tablet keyboard design on postures of the upper extremities and neck, discomfort, and usability under different usage positions during prolonged touch-typing. Methods Eighteen healthy participants familiar with touch-screen devices were randomized into three usage positions (desk, lap, and bed) and completed six, 60-minute typing sessions using three virtual keyboard designs (standard, wide, split). Electrogoniometers continuously measured the postures of the wrists, elbow, and neck. Body discomfort and system usability were evaluated by questionnaires before and immediately after each typing session. Results Separate linear mixed effects models on various postural measures and subjective ratings are conducted with usage position as the between-subject factors, keyboard design and typing duration as the with-in subject factors were conducted. Using the tablet in bed led to more extended wrists but a more natural elbow flexion than the desk position. The angled split virtual keyboard significantly reduced the extent of wrist ulnar deviation than the keyboard with either standard or wide design. However, little difference was observed across the usage position and keyboard design. When the postural data were compared between the middle and end of typing sessions, the wrists, elbow, and neck all exhibited a substantially increased range of joint movements (13% to 38%). The discomfort rating also increased significantly over time in every upper body region investigated. Additionally, the split keyboard design received a higher usability rating in the bed position, whereas participants had more satisfactory experience while using the wide keyboard in the traditional desk setting. Conclusions Prolonged use of tablets in non-traditional office environments may result in awkward postures in the upper body that may expose users to greater risks of developing musculoskeletal symptoms. Adequate virtual keyboard designs show the potential to alleviate some postural effects and improve the user experience without changing the tablet form factors. PMID:26629989

Missing the mark for patient engagement: mHealth literacy strategies and behavior change processes in smoking cessation apps.

PubMed

Paige, Samantha R; Alber, Julia M; Stellefson, Michael L; Krieger, Janice L

2018-05-01

To examine how Transtheoretical Model (TTM)'s processes of change and mHealth literacy strategies are employed in mobile smoking cessation apps. A purposive sample of 100 iTunes apps were coded to assess descriptive (price, type, developer, user-rating) and engagement metrics, including processes of change and mHealth literacy strategies (plain language, usability, interactivity). One-way ANOVAs and independent samples t-tests examined associations between descriptive and engagement metrics. Over half of the apps included 7 (78%) processes of change. Fewer included self-liberation (36%) and reinforcement management (34%). Most apps incorporated plain language, but few integrated usability and interactivity strategies. Hypnotherapy and informational apps included more behavioral processes of change than apps incorporating a combination of features, including gaming, cigarette trackers, and motivational coaching (p<0.01). Apps included behavior change processes but rarely incorporated usability and interactivity features to promote patient engagement. Engagement metrics did not vary by app user-ratings, price-to-download, or developer, including for-profit organizations or government and educational institutions. Providers should acknowledge the popularity of smoking cessation apps as potential cessation aids and communicate their benefits and drawbacks to patients. Future efforts to improve smoking cessation apps should focus on enhancing the quality of tailored and interactive content. Copyright © 2017 Elsevier B.V. All rights reserved.

Strategic planning by independent community pharmacies.

PubMed

Harrison, Donald L

2005-01-01

(1) To assess the degree and level of use of the strategic planning process (none, partly, fully) by independent community pharmacy owners/managers and (2) to evaluate the relationships between independent community pharmacy owners/managers' level of strategic planning and indicators of pharmacy performance; including new and refill prescriptions filled, gross margin, rated patient care performance, rated dispensing performance, rated non-pharmacy performance, and rated financial performance. Cross-sectional study. United States. Nationwide random sample of 1,250 owners/managers of independent community pharmacies. Mailed survey. Quality of strategic planning conducted; pharmacy performance measures. Only 141 of 527 (26.8%) usable responses indicated use of some (77 pharmacies, 54.6%) or all (64 pharmacies, 45.4%) of the seven steps typical of strategic planning. Significant associations were observed between the level of strategic planning use and all pharmacy performance variables assessed, including indicators such as greater numbers of new and refill prescriptions dispensed, gross margins, patient care performance, dispensing performance, non-pharmacy performance, and financial performance. Greater ratings of pharmacy performance were significantly associated with the level of strategic planning use. Respondents who fully used strategic planning had significantly higher indicators than partial users; respondents who partly used the process had significantly higher ratings than respondents who did not conduct strategic planning.

Barriers to comparing the usability of electronic health records.

PubMed

Ratwani, Raj M; Hettinger, A Zachary; Fairbanks, Rollin J

2017-04-01

Despite the widespread adoption of electronic health records (EHRs), usability of many EHRs continues to be suboptimal, with some vendors failing to meet usability standards, resulting in clinician frustration and patient safety hazards. In an effort to increase EHR vendor competition on usability, recommendations have been made and legislation drafted to develop comparison tools that would allow purchasers to better understand the usability of EHR products prior to purchase. Usability comparison can be based on EHR vendor design and development processes, vendor usability testing as part of the Office of the National Coordinator for Health Information Technology certification program, and usability of implemented products. Barriers exist within the current certified health technology program that prevent effective comparison of usability during each of these stages. We describe the importance of providing purchasers with improved information about EHR usability, barriers to making usability comparisons, and solutions to overcome these barriers. © The Author 2016. Published by Oxford University Press on behalf of the American Medical Informatics Association. All rights reserved. For Permissions, please email: journals.permissions@oup.com.

36 CFR 1193.39 - Prohibited reduction of accessibility, usability, and compatibility.

Code of Federal Regulations, 2010 CFR

2010-07-01

... accessibility, usability, and compatibility. 1193.39 Section 1193.39 Parks, Forests, and Public Property... Requirements for Accessibility and Usability § 1193.39 Prohibited reduction of accessibility, usability, and... accessibility, usability, or compatibility of telecommunications equipment or customer premises equipment. (b...

36 CFR 1193.39 - Prohibited reduction of accessibility, usability, and compatibility.

Code of Federal Regulations, 2011 CFR

2011-07-01

... accessibility, usability, and compatibility. 1193.39 Section 1193.39 Parks, Forests, and Public Property... Requirements for Accessibility and Usability § 1193.39 Prohibited reduction of accessibility, usability, and... accessibility, usability, or compatibility of telecommunications equipment or customer premises equipment. (b...

36 CFR 1193.39 - Prohibited reduction of accessibility, usability, and compatibility.

Code of Federal Regulations, 2014 CFR

2014-07-01

... accessibility, usability, and compatibility. 1193.39 Section 1193.39 Parks, Forests, and Public Property... Requirements for Accessibility and Usability § 1193.39 Prohibited reduction of accessibility, usability, and... accessibility, usability, or compatibility of telecommunications equipment or customer premises equipment. (b...

36 CFR 1193.39 - Prohibited reduction of accessibility, usability, and compatibility.

Code of Federal Regulations, 2012 CFR

2012-07-01

... accessibility, usability, and compatibility. 1193.39 Section 1193.39 Parks, Forests, and Public Property... Requirements for Accessibility and Usability § 1193.39 Prohibited reduction of accessibility, usability, and... accessibility, usability, or compatibility of telecommunications equipment or customer premises equipment. (b...

Usability of patient-centered health IT: mixed-methods usability study of ePill.

PubMed

Schmidt-Kraepelin, Manuel; Dehling, Tobias; Sunyaev, Ali

2014-01-01

To facilitate use of patient-centered health IT applications in everyday life, a high degree of usability is required. Based on the example of a patient-centered web application, we propose a usability study design enabling developers and researchers to assess usability of patient-centered health IT applications and derive implications for their improvement. Our study design integrates tasks that subjects have to process, an associated questionnaire based on Perceived Ease of Use, Perceived Usefulness, Attitude Toward Using, and Behavioral Intention to Use, a System Usability Scale questionnaire, and focus groups. Application of the usability study design demonstrates its feasibility and provides insights for assessment of usability in related projects in research and practice.

A Survey of Usability Practices in Free/Libre/Open Source Software

NASA Astrophysics Data System (ADS)

Paul, Celeste Lyn

A review of case studies about usability in eight Free/Libre/Open Source Software (FLOSS) projects showed that an important issue regarding a usability initiative in the project was the lack of user research. User research is a key component in the user-centered design (UCD) process and a necessary step for creating usable products. Reasons why FLOSS projects suffered from a lack of user research included poor or unclear project leadership, cultural differences between developer and designers, and a lack of usability engineers. By identifying these critical issues, the FLOSS usability community can begin addressing problems in the efficacy of usability activities and work towards creating more usable FLOSS products.

Digital Health Intervention for Asthma: Patient-Reported Value and Usability.

PubMed

Merchant, Rajan; Inamdar, Rubina; Henderson, Kelly; Barrett, Meredith; Su, Jason G; Riley, Jesika; Van Sickle, David; Stempel, David

2018-06-04

Although digital health tools are increasingly recognized as effective in improving clinical outcomes such as asthma control and medication adherence, few studies have assessed patient experiences and perception of value. The aim of this study was to evaluate patient satisfaction, perception of usability and value, and desire to continue after 12 months of using a digital health intervention to support asthma management. Participants were enrolled in a randomized controlled study evaluating the impact of a digital health platform for asthma management. Participants used electronic inhaler sensors to track medication use and accessed their information in a digital health platform. Electronic surveys were administered to intervention arm participants aged 12 years and older after 12 months of use. The survey assessed asthma control, patient satisfaction with the sensor device, and perception of the usability and value of the digital health platform through closed-ended and open-ended questions. Logistic regression models were used to assess the impact of participants' characteristics on survey completion, satisfaction, and perception of value. Of the 207 intervention arm participants aged 12 years and older, 89 submitted survey responses (42.9% response rate). Of these 89 participants, 70 reported being very satisfied (79%, 70/89) or somewhat satisfied (20%, 18/89) with the inhaler sensor device. Moreover, 93% (83/89) expressed satisfaction with the reports, and 90% (80/89) found the information from the reports useful for learning about their asthma. In addition, 72% (64/89) of the participants reported that they were interested in continuing to use the sensor and platform beyond the study. There were no significant differences in satisfaction with the device or the platform across participants' characteristics, including device type, age, sex, insurance type, asthma control, or syncing history; however, participants with smartphones and longer participation were more likely to take the survey. Electronic sensors and a digital health platform were well received by participants who reported satisfaction and perceived value. These results were consistent across multiple participants' characteristics. These findings can add to a limited literature to keep improving digital health interventions and ensure the meaningful and enduring impact on patient outcomes. ©Rajan Merchant, Rubina Inamdar, Kelly Henderson, Meredith Barrett, Jason G Su, Jesika Riley, David Van Sickle, David Stempel. Originally published in JMIR Mhealth and Uhealth (http://mhealth.jmir.org), 04.06.2018.

Improving Access to HIV and AIDS Information Resources for Patients, Caregivers, and Clinicians: Results from the SHINE Project.

PubMed

Dixon, Brian E; Kaneshiro, Kellie

2012-01-01

Human immunodeficiency virus and acquired immunodeficiency syndrome (HIV/AIDS) remains a significant international public health challenge. The Statewide HIV/AIDS Information Network (SHINE) Project was created to improve HIV/AIDS health information use and access for health care professionals, patients, and affected communities in Indiana. Our objective was to assess the information-seeking behaviors of health care professionals and consumers who seek information on the testing, treatment, and management of HIV/AIDS and the usability of the SHINE Project's resources in meeting end user needs. The feedback was designed to help SHINE Project members improve and expand the SHINE Project's online resources. A convenience sample of health care professionals and consumers participated in a usability study. Participants were asked to complete typical HIV/AIDS information-seeking tasks using the SHINE Project website. Feedback was provided in the form of standardized questionnaire and usability "think-aloud" responses. Thirteen participants took part in the usability study. Clinicians generally reported the site to be "very good," while consumers generally found it to be "good." Health care professionals commented that they lack access to comprehensive resources for treating patients with HIV/AIDS. They requested new electronic resources that could be integrated in clinical practice and existing information technology infrastructures. Consumers found the SHINE website and its collected information resources overwhelming and difficult to navigate. They requested simpler, multimedia-content rich resources to deliver information on HIV/AIDS testing, treatment, and disease management. Accessibility, usability, and user education remain important challenges that public health and information specialists must address when developing and deploying interventions intended to empower consumers and support coordinated, patient-centric care.

Setting priorities for comparative effectiveness research on management of primary angle closure: a survey of Asia-Pacific clinicians.

PubMed

Yu, Tsung; Li, Tianjing; Lee, Kinbo J; Friedman, David S; Dickersin, Kay; Puhan, Milo A

2015-01-01

To set priorities for new systematic reviews (SRs) and randomized clinical trials on the management of primary angle closure (PAC) using clinical practice guidelines and a survey of Asia-Pacific clinicians. We restated the American Academy of Ophthalmology's Preferred Practice Patterns recommendations for management of PAC into answerable clinical questions. We asked participants at the Asia-Pacific Joint Glaucoma Congress 2010 in Taipei to rate the importance of having an answer to each question for providing effective patient care, using a Likert-type scale and scoring from 0 (not important at all) to 10 (highly important). We identified relevant SRs and mapped the evidence to clinical questions to identify evidence gaps. We generated 42 clinical questions. One hundred seventy-five individuals agreed to participate in the survey, 132 responded (75.4% response rate) and 96 completed the questionnaire (54.9% usable response rate). Questions rated important include laser iridotomy for the prevention of angle closure in primary angle-closure suspects, further therapies in eyes with plateau iris syndrome after laser iridotomy, and evaluation of the fellow eye in acute angle-closure patients for improving prognosis. Up-to-date and conclusive SR evidence was not available for any of the 42 clinical questions. We identified high priority clinical questions on the management of PAC, none of which had reliable SR evidence available. New SRs and randomized clinical trials can be initiated to address these evidence gaps.

Hybrid P300-based brain-computer interface to improve usability for people with severe motor disability: electromyographic signals for error correction during a spelling task.

PubMed

Riccio, Angela; Holz, Elisa Mira; Aricò, Pietro; Leotta, Francesco; Aloise, Fabio; Desideri, Lorenzo; Rimondini, Matteo; Kübler, Andrea; Mattia, Donatella; Cincotti, Febo

2015-03-01

To evaluate the impact of a hybrid control on usability of a P300-based brain-computer interface (BCI) system that was designed to control an assistive technology software and was integrated with an electromyographic channel for error correction. Proof-of-principle study with a convenience sample. Neurologic rehabilitation hospital. Participants (N=11) in this pilot study included healthy (n=8) and severely motor impaired (n=3) persons. The 3 people with severe motor disability were identified as potential candidates to benefit from the proposed hybrid BCI system for communication and environmental interaction. To eventually investigate the improvement in usability, we compared 2 modalities of BCI system control: a P300-based and a hybrid P300 electromyographic-based mode of control. System usability was evaluated according to the following outcome measures within 3 domains: (1) effectiveness (overall system accuracy and P300-based BCI accuracy); (2) efficiency (throughput time and users' workload); and (3) satisfaction (users' satisfaction). We also considered the information transfer rate and time for selection. Findings obtained in healthy participants were in favor of a higher usability of the hybrid control as compared with the nonhybrid. A similar trend was indicated by the observational results gathered from each of the 3 potential end-users. The proposed hybrid BCI control modality could provide end-users with severe motor disability with an option to exploit some residual muscular activity, which could not be fully reliable for properly controlling an assistive technology device. The findings reported in this pilot study encourage the implementation of a clinical trial involving a large cohort of end-users. Copyright © 2015 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.

[Exploring nurse, usage effectiveness of mobile nursing station].

PubMed

Chang, Fang-Mei; Lee, Ting-Ting

2013-04-01

A mobile nursing station is an innovative cart that integrates a wireless network, information technology devices, and online charts. In addition to improving clinical work and workflow efficiencies, data is integrated among different information systems and hardware devices to promote patient safety. This study investigated the effectiveness of mobile nursing cart use. We compared different distributions of nursing activity working samples to evaluate the nursing information systems in terms of interface usability and usage outcomes. There were two parts of this study. Part one used work sampling to collect nursing activity data necessary to compare a unit that used a mobile nursing cart (mobile group, n = 18) with another that did not (traditional group, n = 14). Part two applied a nursing information system interface usability questionnaire to survey the mobile unit with nurses who had used a mobile nursing station (including those who had worked in this unit as floating nurses) (n = 30) in order to explore interface usability and effectiveness. We found that using the mobile nursing station information system increased time spent on direct patient care and decreased time spent on indirect patient care and documentation. Results further indicated that participants rated interface usability as high and evaluated usage effectiveness positively. Comments made in the open-ended question section raised several points of concern, including problems / inadequacies related to hardware devices, Internet speed, and printing. This study indicates that using mobile nursing station can improve nursing activity distributions and that nurses hold generally positive attitudes toward mobile nursing station interface usability and usage effectiveness. The authors thus encourage the continued implementation of mobile nursing stations and related studies to further enhance clinical nursing care.

Development of a Prototype Continuity of Care Record with Context-Specific Links to Meet the Information Needs of Case Managers for Persons Living with HIV

PubMed Central

Cimino, James J.; Bakken, Suzanne

2012-01-01

Objectives (1) To develop a prototype Continuity of Care Record (CCR) with context-specific links to electronic HIV information resources; and (2) to assess case managers’ perceptions regarding the usability of the prototype. Methods We integrated context-specific links to HIV case management information resources into a prototype CCR using the Infobutton Manager and Librarian Infobutton Tailoring Environment (LITE). Case managers (N=9) completed a think-aloud protocol and the Computer System Usability Questionnaire (CSUQ) to evaluate the usability of the prototype. Verbalizations from the think-aloud protocol were summarized using thematic analysis. CSUQ data were analyzed with descriptive statistics. Results Although participants expressed positive comments regarding the usability of the prototype, the think-aloud protocol also identified the need for improvement in resource labels and for additional resources. On a scale ranging from 1 (strongly agree) to 7 (strongly disagree), the average CSUQ overall satisfaction was 2.25 indicating that users (n=9) were generally satisfied with the system. Mean CSUQ factor scores were: System Usefulness (M=2.13), Information Quality (M=2.46), and Interface Quality (M=2.26). Conclusion Our novel application of the Infobutton Manager and LITE in the context of case management for persons living with HIV in community-based settings resulted in a prototype CCR with infobuttons that met the majority of case managers’ information needs and received relatively positive usability ratings. Findings from this study inform future integration of context-specific links into CCRs and electronic health records and support their use for meeting end-users information needs. PMID:22632821

Evaluation of the acceptability and usability of a decision support system to encourage safe and effective use of opioid therapy for chronic, noncancer pain by primary care providers.

PubMed

Trafton, Jodie; Martins, Susana; Michel, Martha; Lewis, Eleanor; Wang, Dan; Combs, Ann; Scates, Naquell; Tu, Samson; Goldstein, Mary K

2010-04-01

To develop and evaluate a clinical decision support system (CDSS) named Assessment and Treatment in Healthcare: Evidenced-Based Automation (ATHENA)-Opioid Therapy, which encourages safe and effective use of opioid therapy for chronic, noncancer pain. CDSS development and iterative evaluation using the analysis, design, development, implementation, and evaluation process including simulation-based and in-clinic assessments of usability for providers followed by targeted system revisions. Volunteers provided detailed feedback to guide improvements in the graphical user interface, and content and design changes to increase clinical usefulness, understandability, clinical workflow fit, and ease of completing guideline recommended practices. Revisions based on feedback increased CDSS usability ratings over time. Practice concerns outside the scope of the CDSS were also identified. Usability testing optimized the CDSS to better address barriers such as lack of provider education, confusion in dosing calculations and titration schedules, access to relevant patient information, provider discontinuity, documentation, and access to validated assessment tools. It also highlighted barriers to good clinical practice that are difficult to address with CDSS technology in its current conceptualization. For example, clinicians indicated that constraints on time and competing priorities in primary care, discomfort in patient-provider communications, and lack of evidence to guide opioid prescribing decisions impeded their ability to provide effective, guideline-adherent pain management. Iterative testing was essential for designing a highly usable and acceptable CDSS; however, identified barriers may limit the impact of the ATHENA-Opioid Therapy system and other CDSS on clinical practices and outcomes unless CDSS are paired with parallel initiatives to address these issues.

Development and Cross-cultural Validation of the Korean Version of SMArtphone's uSability Heuristics (SMASH).

PubMed

Jeong, Yeo Won; Kim, Jung A

2017-10-01

The purpose of this study was to develop and cross-culturally validate the Korean version of SMArtphone's uSability Heuristics (K-SMASH). In the study, it was used the adaptation process consisted of five stages, namely, translation, synthesis, back translation, expert committee review, and pretesting. In the pretesting stage, a mobile application, using the prefinal K-SMASH, was evaluated for the severity of usability problems by three experts in computer science and informatics. Each participant completed the evaluation and was interviewed about their understanding, interpretation, and opinion of the cultural relevance of the prefinal K-SMASH. Next, we reviewed the differences in the experts' opinions and the questionnaire results. Twelve SMASH items, words and sentences, were translated, back translated, and revised, considering the conceptual meaning in the context of the Korean culture, by experts in various fields, including a Korean linguist and a bilingual translator, through the first stage to the fourth stage. In the pretesting stage, the results showed no major differences among the severity ratings of participants. Furthermore, all participants answered that there were no critical discrepancies or inconsistencies with the cultural relevance of the prefinal K-SMASH. The results of the study provide preliminary evidence that the modified K-SMASH can be used for heuristic evaluation, one of the usability tests, when developing applications in Korea.

Effect of hand sanitizer location on hand hygiene compliance.

PubMed

Cure, Laila; Van Enk, Richard

2015-09-01

Hand hygiene is the most important intervention to prevent infection in hospitals. Health care workers should clean their hands at least before and after contact with patients. Hand sanitizer dispensers are important to support hand hygiene because they can be made available throughout hospital units. The aim of this study was to determine whether the usability of sanitizer dispensers correlates with compliance of staff in using the sanitizer in a hospital. This study took place in a Midwest, 404-bed, private, nonprofit community hospital with 15 inpatient care units in addition to several ambulatory units. The usability and standardization of sanitizers in 12 participating inpatient units were evaluated. The hospital measured compliance of staff with hand hygiene as part of their quality improvement program. Data from 2010-2012 were analyzed to measure the relationship between compliance and usability using mixed-effects logistic regression models. The total usability score (P = .0046), visibility (P = .003), and accessibility of the sanitizer on entrance to the patient room (P = .00055) were statistically associated with higher observed compliance rates. Standardization alone showed no significant impact on observed compliance (P = .37). Hand hygiene compliance can be influenced by visibility and accessibility of dispensers. The sanitizer location should be part of multifaceted interventions to improve hand hygiene. Copyright © 2015 Association for Professionals in Infection Control and Epidemiology, Inc. Published by Elsevier Inc. All rights reserved.

Development and Cross-cultural Validation of the Korean Version of SMArtphone’s uSability Heuristics (SMASH)

PubMed Central

Jeong, Yeo Won

2017-01-01

Objectives The purpose of this study was to develop and cross-culturally validate the Korean version of SMArtphone's uSability Heuristics (K-SMASH). Methods In the study, it was used the adaptation process consisted of five stages, namely, translation, synthesis, back translation, expert committee review, and pretesting. In the pretesting stage, a mobile application, using the prefinal K-SMASH, was evaluated for the severity of usability problems by three experts in computer science and informatics. Each participant completed the evaluation and was interviewed about their understanding, interpretation, and opinion of the cultural relevance of the prefinal K-SMASH. Next, we reviewed the differences in the experts’ opinions and the questionnaire results. Results Twelve SMASH items, words and sentences, were translated, back translated, and revised, considering the conceptual meaning in the context of the Korean culture, by experts in various fields, including a Korean linguist and a bilingual translator, through the first stage to the fourth stage. In the pretesting stage, the results showed no major differences among the severity ratings of participants. Furthermore, all participants answered that there were no critical discrepancies or inconsistencies with the cultural relevance of the prefinal K-SMASH. Conclusions The results of the study provide preliminary evidence that the modified K-SMASH can be used for heuristic evaluation, one of the usability tests, when developing applications in Korea. PMID:29181243

ERP Software Implementation Best Practices.

ERIC Educational Resources Information Center

Frantz, Pollyanne S.; Southerland, Arthur R.; Johnson, James T.

2002-01-01

Studied the perceptions of chief financial and information officers of enterprise resource planning (ERP) software implementation best practices. Usable responses from 159 respondents show consensus for the most part between the perceptions of the two groups and describe some best practices that represent common ground. (SLD)

How Do We Teach Usability? An Investigation of Usability Instruction in Technical Communication

ERIC Educational Resources Information Center

Chong, Felicia

2013-01-01

This dissertation investigates the curricular implementation of usability instruction in technical communication. Though there are a plethora of publications and studies on usability in technical communication, little discussion focuses on usability instruction in the classroom or its implementation in the curriculum. Thus, this exploratory…

Early-Stage Software Design for Usability

ERIC Educational Resources Information Center

Golden, Elspeth

2010-01-01

In spite of the goodwill and best efforts of software engineers and usability professionals, systems continue to be built and released with glaring usability flaws that are costly and difficult to fix after the system has been built. Although user interface (UI) designers, be they usability or design experts, communicate usability requirements to…

36 CFR § 1193.39 - Prohibited reduction of accessibility, usability, and compatibility.

Code of Federal Regulations, 2013 CFR

2013-07-01

... accessibility, usability, and compatibility. § 1193.39 Section § 1193.39 Parks, Forests, and Public Property... Requirements for Accessibility and Usability § 1193.39 Prohibited reduction of accessibility, usability, and... accessibility, usability, or compatibility of telecommunications equipment or customer premises equipment. (b...

Increasing EHR system usability through standards: Conformance criteria in the HL7 EHR-system functional model.

PubMed

Meehan, Rebecca A; Mon, Donald T; Kelly, Kandace M; Rocca, Mitra; Dickinson, Gary; Ritter, John; Johnson, Constance M

2016-10-01

Though substantial work has been done on the usability of health information technology, improvements in electronic health record system (EHR) usability have been slow, creating frustration, distrust of EHRs and the use of potentially unsafe work-arounds. Usability standards could be part of the solution for improving EHR usability. EHR system functional requirements and standards have been used successfully in the past to specify system behavior, the criteria of which have been gradually implemented in EHR systems through certification programs and other national health IT strategies. Similarly, functional requirements and standards for usability can help address the multitude of sequelae associated with poor usability. This paper describes the evidence-based functional requirements for usability contained in the Health Level Seven (HL7) EHR System Functional Model, and the benefits of open and voluntary EHR system usability standards. Copyright © 2016 Elsevier Inc. All rights reserved.

Usability in Mobile Electronic Data Collection Tools: Form Developers' Views.

PubMed

Mugisha, Alice; Babic, Ankica; Wakholi, Peter; Nankabirwa, Victoria; Tylleskar, Thorkild

2017-01-01

Mobile Electronic Data Collection Tools (MEDCTs) are created by form developers to collect data. Usability being one of the top quality attributes is of great concern to developers of any interactive applications. However, little is known about the form developers' understanding of usability, how they measure usability and their limitations in designing for usability. We conducted an empirical study where we aimed at getting the developers' views on usability by interviewing 8 form developers. These are creators of forms used for data collection. We found that developers knew about usability, but it was not their main focus during form development. Challenges included constraining deadlines, software limitations and the insufficient communication with the field users to establish the usability needs. Furthermore, the methods used to evaluate the usability of created forms varied amongst developers and these included in-house evaluations and feedback from piloting sessions with end users.

Survey Summary: Students and Scholars from the People's Republic of China in the United States, August 1981.

ERIC Educational Resources Information Center

Fingar, Thomas; Reed, Linda A.

A survey of 313 American colleges and universities thought to have accepted students and/or scholars from the People's Republic of China (PRC) was conducted in March 1981 by the U.S.-China Education Clearinghouse. Usable responses were received from 164 institutions. The responses indicated that a total of 3,467 PRC students and scholars were…

Lignocellulose hydrolysis by multienzyme complexes

USDA-ARS?s Scientific Manuscript database

Lignocellulosic biomass is the most abundant renewable resource on the planet. Converting this material into a usable fuel is a multi-step process, the rate-limiting step being enzymatic hydrolysis of organic polymers into monomeric sugars. While the substrate can be complex and require a multitud...

Using Smartphone Apps to Promote Psychiatric and Physical Well-Being.

PubMed

Macias, Cathaleene; Panch, Trishan; Hicks, Yale M; Scolnick, Jason S; Weene, David Lyle; Öngür, Dost; Cohen, Bruce M

2015-12-01

This pilot study tested the acceptability and usability of a prototype app designed to promote the physical well-being of adults with psychiatric disorders. The application under evaluation, WellWave, promoted walking as a physical exercise, and offered a variety of supportive non-physical activities, including confidential text-messaging with peer staff, and a digital library of readings and videos on recovery from psychiatric illness. Study participants engaged strongly in the app throughout the 4-week study, showing a 94 % mean daily usage rate, and a 73 % mean response rate across all electronic messages and prompts, which approximates the gold standard of 75 % for momentary ecological assessment studies. Seven of the ten study participants averaged two or more walks per week, beginning with 5-min walks and ending with walks lasting 20 min or longer. This responsiveness to the walking prompts, and the overall high rate of engagement in other app features, suggest that adults with psychiatric conditions would welcome and benefit from similar smartphone interventions that promote healthy behaviours in life domains other than exercise. Pilot study results also suggest that smartphone applications can be useful as research tools in the development and testing of theories and practical strategies for encouraging healthy lifestyles. Participants were prompted periodically to rate their own health quality, perceived control over their health, and stage-of-change in adopting a walking routine, and these electronic self-ratings showed acceptable concurrent and discriminant validity, with all participants reporting moderate to high motivation to exercise by the end of the study.

Task analysis of Air Force pharmacy practice.

PubMed

Bartholomew, A; Sawyer, W T; Coats, L

1995-01-15

The frequency with which United States Air Force pharmacists perform specific professional tasks and the pharmacists' views as to the importance of those tasks were studied. A questionnaire was prepared that asked recipients to rate each of 36 tasks selected as representing the spectrum of practice activities. There were four categories of tasks: managerial tasks, dispensing tasks, drug information tasks, and patient care tasks. Recipients rated the tasks with respect to frequency of performance and importance on separate 6-point scales. The questionnaire was mailed in May 1991 to the 225 pharmacists then serving in the Air Force worldwide. Of the 225 questionnaires, 150 usable questionnaires were returned (response rate, 67%). All the tasks in the survey were performed by at least one Air Force pharmacy officer, although the frequency of task performance varied. In particular, the frequency of many patient care tasks was low. All the tasks were perceived to have some importance, but drug information tasks were rated as being significantly more important than tasks in the other categories; patient care tasks were rated lowest in importance. The results varied with the respondents' demographic characteristics. Pharmacy officers with more years of service, more senior positions, higher rank, or an advanced degree in a field other than pharmacy tended to give responses that diverged from those of the population. A 1991 survey showed an awareness among Air Force pharmacists of the need to orient practice around patient care; however, they were not spending substantial time on patient care and tended to view it as less important than more traditional pharmacy tasks.

Evaluation of expert system application based on usability aspects

NASA Astrophysics Data System (ADS)

Munaiseche, C. P. C.; Liando, O. E. S.

2016-04-01

Usability usually defined as a point of human acceptance to a product or a system based on understands and right reaction to an interface. The performance of web application has been influence by the quality of the interface of that web to supporting information transfer process. Preferably, before the applications of expert systems were installed in the operational environment, these applications must be evaluated first by usability testing. This research aimed to measure the usability of the expert system application using tasks as interaction media. This study uses an expert system application to diagnose skin disease in human using questionnaire method which utilize the tasks as interaction media in measuring the usability. Certain tasks were executed by the participants in observing usability value of the application. The usability aspects observed were learnability, efficiency, memorability, errors, and satisfaction. Each questionnaire question represent aspects of usability. The results present the usability value for each aspect and the total average merit for all the five-usability aspect was 4.28, this indicated that the tested expert system application is in the range excellent for the usability level, so the application can be implemented as the operated system by user. The main contribution of the study is the research became the first step in using task model in the usability evaluation for the expert system application software.

Multi-method laboratory user evaluation of an actionable clinical performance information system: Implications for usability and patient safety.

PubMed

Brown, Benjamin; Balatsoukas, Panos; Williams, Richard; Sperrin, Matthew; Buchan, Iain

2018-01-01

Electronic audit and feedback (e-A&F) systems are used worldwide for care quality improvement. They measure health professionals' performance against clinical guidelines, and some systems suggest improvement actions. However, little is known about optimal interface designs for e-A&F, in particular how to present suggested actions for improvement. We developed a novel theory-informed system for primary care (the Performance Improvement plaN GeneratoR; PINGR) that covers the four principal interface components: clinical performance summaries; patient lists; detailed patient-level information; and suggested actions. As far as we are aware, this is the first report of an e-A&F system with all four interface components. (1) Use a combination of quantitative and qualitative methods to evaluate the usability of PINGR with target end-users; (2) refine existing design recommendations for e-A&F systems; (3) determine the implications of these recommendations for patient safety. We recruited seven primary care physicians to perform seven tasks with PINGR, during which we measured on-screen behaviour and eye movements. Participants subsequently completed usability questionnaires, and were interviewed in-depth. Data were integrated to: gain a more complete understanding of usability issues; enhance and explain each other's findings; and triangulate results to increase validity. Participants committed a median of 10 errors (range 8-21) when using PINGR's interface, and completed a median of five out of seven tasks (range 4-7). Errors violated six usability heuristics: clear response options; perceptual grouping and data relationships; representational formats; unambiguous description; visually distinct screens for confusable items; and workflow integration. Eye movement analysis revealed the integration of components largely supported effective user workflow, although the modular design of clinical performance summaries unnecessarily increased cognitive load. Interviews and questionnaires revealed PINGR is user-friendly, and that improved information prioritisation could further promote useful user action. Comparing our results with the wider usability literature we refine a previously published set of interface design recommendations for e-A&F. The implications for patient safety are significant regarding: user engagement; actionability; and information prioritisation. Our results also support adopting multi-method approaches in usability studies to maximise issue discovery and the credibility of findings. Copyright © 2017 The Authors. Published by Elsevier Inc. All rights reserved.

Workload measurement in a communication application operated through a P300-based brain-computer interface

NASA Astrophysics Data System (ADS)

Riccio, A.; Leotta, F.; Bianchi, L.; Aloise, F.; Zickler, C.; Hoogerwerf, E.-J.; Kübler, A.; Mattia, D.; Cincotti, F.

2011-04-01

Advancing the brain-computer interface (BCI) towards practical applications in technology-based assistive solutions for people with disabilities requires coping with problems of accessibility and usability to increase user acceptance and satisfaction. The main objective of this study was to introduce a usability-oriented approach in the assessment of BCI technology development by focusing on evaluation of the user's subjective workload and satisfaction. The secondary aim was to compare two applications for a P300-based BCI. Eight healthy subjects were asked to use an assistive technology solution which integrates the P300-based BCI with commercially available software under two conditions—visual stimuli needed to evoke the P300 response were either overlaid onto the application's graphical user interface or presented on a separate screen. The two conditions were compared for effectiveness (level of performance), efficiency (subjective workload measured by means of NASA-TXL) and satisfaction of the user. Although no significant difference in usability could be detected between the two conditions, the methodology proved to be an effective tool to highlight weaknesses in the technical solution.

Perceived Usability Evaluation of Learning Management Systems: Empirical Evaluation of the System Usability Scale

ERIC Educational Resources Information Center

Orfanou, Konstantina; Tselios, Nikolaos; Katsanos, Christos

2015-01-01

Perceived usability affects greatly student's learning effectiveness and overall learning experience, and thus is an important requirement of educational software. The System Usability Scale (SUS) is a well-researched and widely used questionnaire for perceived usability evaluation. However, surprisingly few studies have used SUS to evaluate the…

A Breastfeed-Promoting Mobile App Intervention: Usability and Usefulness Study

PubMed Central

2018-01-01

Background Breastfeeding is proven to have lasting health benefits for both mothers and infants; however, 6-month exclusive breastfeeding rate remains below 20% in Thailand. Although the number of research literature and commercial apps for breastfeeding women is significantly growing, they are country-specific and restricted to English-speaking users. There exists a major knowledge gap on how mobile health apps could support breastfeeding in Thailand. To address these gaps, MoomMae has been developed with the intention to support Thai women in breastfeeding outside of their homes and in keeping their feeding records. Objective The aim of this study was to evaluate the usability and usefulness of MoomMae, a mobile phone app designed to support breastfeeding women. Methods Our study was reviewed and approved by Thailand’s National Science and Technology Development Agency (NSTDA) ethics committee. A total of 21 breastfeeding women with at least one Android phone or tablet were recruited via convenience and snowball sampling. The study process for each participant was as follows: the participant was requested to attend a preuse interview and given the app to use for 4 weeks. Following this period, a postuse interview was conducted to examine the usability and usefulness of the app. Both sessions were held individually and audiorecorded for qualitative analysis. Results The mean scores of usability and usefulness from the postuse survey were 4.33 (SD 0.87; range 1-5) and 4.60 (SD 0.74; range 2-5). Our qualitative analysis revealed a total of 137 feedbacks: 71 related to usability and 66 associated with usefulness. A further sentimental analysis showed that comments on usability were generally negative (59 negative, 11 positive, and 1 neutral), and comments on usefulness were relatively positive (56 positive, 9 negative, and 1 neutral). We discovered 26 unique design issues and proposed recommendations for future improvement. Conclusions Our usability and usefulness assessment of MoomMae demonstrated that MoomMae has a great potential to be a useful self-management tool for breastfeeding mothers in Thailand. The qualitative analysis suggested that the app is supportive of breastfeeding on demand, but the flow and inputs of the app should be redesigned to be more intuitive. For future implementations, the most desirable feature is a pump-reminding notification system. PMID:29374000

A Breastfeed-Promoting Mobile App Intervention: Usability and Usefulness Study.

PubMed

Wang, Chih-Jau; Chaovalit, Pimwadee; Pongnumkul, Suporn

2018-01-26

Breastfeeding is proven to have lasting health benefits for both mothers and infants; however, 6-month exclusive breastfeeding rate remains below 20% in Thailand. Although the number of research literature and commercial apps for breastfeeding women is significantly growing, they are country-specific and restricted to English-speaking users. There exists a major knowledge gap on how mobile health apps could support breastfeeding in Thailand. To address these gaps, MoomMae has been developed with the intention to support Thai women in breastfeeding outside of their homes and in keeping their feeding records. The aim of this study was to evaluate the usability and usefulness of MoomMae, a mobile phone app designed to support breastfeeding women. Our study was reviewed and approved by Thailand's National Science and Technology Development Agency (NSTDA) ethics committee. A total of 21 breastfeeding women with at least one Android phone or tablet were recruited via convenience and snowball sampling. The study process for each participant was as follows: the participant was requested to attend a preuse interview and given the app to use for 4 weeks. Following this period, a postuse interview was conducted to examine the usability and usefulness of the app. Both sessions were held individually and audiorecorded for qualitative analysis. The mean scores of usability and usefulness from the postuse survey were 4.33 (SD 0.87; range 1-5) and 4.60 (SD 0.74; range 2-5). Our qualitative analysis revealed a total of 137 feedbacks: 71 related to usability and 66 associated with usefulness. A further sentimental analysis showed that comments on usability were generally negative (59 negative, 11 positive, and 1 neutral), and comments on usefulness were relatively positive (56 positive, 9 negative, and 1 neutral). We discovered 26 unique design issues and proposed recommendations for future improvement. Our usability and usefulness assessment of MoomMae demonstrated that MoomMae has a great potential to be a useful self-management tool for breastfeeding mothers in Thailand. The qualitative analysis suggested that the app is supportive of breastfeeding on demand, but the flow and inputs of the app should be redesigned to be more intuitive. For future implementations, the most desirable feature is a pump-reminding notification system. ©Chih-Jau Wang, Pimwadee Chaovalit, Suporn Pongnumkul. Originally published in JMIR Mhealth and Uhealth (http://mhealth.jmir.org), 26.01.2018.

Exploring Challenges in Developing a Smart and Effective Assistive System for Improving the Experience of the Elderly Drivers

NASA Astrophysics Data System (ADS)

Jung, Sebin; Meng, Hong-Ying; Qin, Sheng-Feng

2017-09-01

As the overall population ages, driving-related accidents and injuries, associated with elderly drivers, have risen. Existing research about elderly drivers mainly focuses on factual data collection and analysis, indicating the elderly's growing fatal accident rates and their different behaviours compared to younger drivers. However, few research has focused on design-led practical solutions to mitigate the elderly's growing fatal accidents, by considering their usability and body conditions, afflicting the elderly, such as decreased vision, hearing, and reaction times. In this paper, first, current worldwide situations on growing fatal accident rates for elderly drivers is reviewed and the key impact factors are identified and discussed with regarding to usability and design trend in the automotive technology for elderly. Second, existing smart vehicle technology-based solutions to promote safe driving are explored and their pros and cons are discussed and analysed. Most of solutions are not created by people with driving difficulties, which are caused by health problems most commonly afflicting the elderly. Thirdly, diverse design-led research activities are taken, such as a survey, observation, and interviews to gain new understanding of what kinds of driving problems elderly drivers have and demonstrate how new system concepts could be developed for the elderly's benefits. Finally, it is found that the elderly's low vision and late reaction are main factors causing their driving difficulties. Based on this finding, usable vehicle system design ideas have been proposed, by utilising facial expression sensing technology as a solution. The proposed solutions would ensure reducing both the elderly's driving problems and high fatal accident rates and provide a more enjoyable driving environment for the elderly population.

Development and psychometric evaluation of the Assessment of Core CBT Skills (ACCS): An observation-based tool for assessing cognitive behavioral therapy competence.

PubMed

Muse, Kate; McManus, Freda; Rakovshik, Sarah; Thwaites, Richard

2017-05-01

This article outlines the development and psychometric evaluation of the Assessment of Core CBT Skills (ACCS) rating scale. The ACCS aims to provide a novel assessment framework to deliver formative and summative feedback regarding therapists' performance within observed cognitive-behavioral treatment sessions, and for therapists to rate and reflect on their own performance. Findings from 3 studies are outlined: (a) a feedback study (n = 66) examining content validity, face validity and usability; (b) a focus group (n = 9) evaluating usability and utility; and (c) an evaluation of the psychometric properties of the ACCS in real world cognitive behavioral therapy (CBT) training and routine clinical practice contexts. Results suggest that the ACCS has good face validity, content validity, and usability and provides a user-friendly tool that is useful for promoting self-reflection and providing formative feedback. Scores on both the self and assessor-rated versions of the ACCS demonstrate good internal consistency, interrater reliability, and discriminant validity. In addition, ACCS scores were found to be correlated with, but distinct from, the Revised Cognitive Therapy Scale (CTS-R) and were comparable to CTS-R scores in terms of internal consistency and discriminant validity. In addition, the ACCS may have advantages over the CTS-R in terms of interrater reliability of scores. The studies also provided insight into areas for refinement and a number of modifications were undertaken to improve the scale. In summary, the ACCS is an appropriate and useful measure of CBT competence that can be used to promote self-reflection and provide therapists with formative and summative feedback. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

Prostate Cancer on the Web-Expedient Tool for Patients' Decision-Making?

PubMed

Borgmann, Hendrik; Wölm, Jan-Henning; Vallo, Stefan; Mager, Rene; Huber, Johannes; Breyer, Johannes; Salem, Johannes; Loeb, Stacy; Haferkamp, Axel; Tsaur, Igor

2017-03-01

Many patients diagnosed with cancer search for health information on the Web. We aimed to assess the quality and reliability of online health information on prostate cancer. Google, Yahoo, and Bing were searched for the term "prostate cancer." After selecting the most frequented websites, quality was measured by DISCERN score, JAMA benchmark criteria, and presence of HONcode certification. Popularity was assessed by Alexa tool, while accessibility, usability, and reliability were investigated by LIDA tool. Readability was analyzed by Flesch-Kincaid Reading Grade Level and Automated Readability Index. All 13 selected websites were rated as being of high quality according to the DISCERN instrument (76.5 ± 2.6 out of 80 points). JAMA benchmark criteria were fulfilled by 87 % of websites, whereas only 37 % were certified by the HONcode. Median Alexa Traffic Rank was 2718 ranging from 7 to 679,038. Websites received 2.3 ± 0.5 daily pageviews per visitor and users spent an average of 2 min 58 s ± 39 sec on the website. Accessibility (92 ± 5 %) and usability (92 ± 3 %) scores were high and reliability (88 ± 8 %) moderate according to the LIDA tool. Flesch-Kincaid Grade Level was 7.9 ± 2.2, and Automated Readability Index was 7.5 ± 2.4, rating the websites as fairly difficult to read. In conclusion, quality, accessibility, and usability of websites on prostate cancer provided a high rating in the current analysis. These findings are encouraging in view of the growing frequency of patients' access of health information online.

Adolescents’ experience of a rapid HIV self-testing device in youth-friendly clinic settings in Cape Town South Africa: a cross-sectional community based usability study

PubMed Central

Smith, Philip; Wallace, Melissa; Bekker, Linda-Gail

2016-01-01

Abstract Introduction: Since HIV testing in South African adolescents and young adults is sub-optimal, the objective of the current study was to investigate the feasibility and acceptability of an HIV rapid self-testing device in adolescents and young people at the Desmond Tutu HIV Foundation Youth Centre and Mobile Clinic. Methods: Self-presenting adolescents and young adults were invited to participate in a study investigating the fidelity, usability and acceptability of the AtomoRapid HIV Rapid self-testing device. Trained healthcare workers trained participants to use the device before the participant conducted the HIV self-test with device usage instructions. The healthcare worker then conducted a questionnaire-based survey to assess outcomes. Results: Of the 224 enrolled participants between 16 and 24 years of age, 155 (69,2%) were female. Overall, fidelity was high; 216 (96,4%) participants correctly completed the test and correctly read and interpreted the HIV test result. There were eight (3,6%) user errors overall; six participants failed to prick their finger even though the lancet fired correctly. There were two user errors where participants failed to use the capillary tube correctly. Participants rated acceptability and usability highly, with debut testers giving significantly higher ratings for both. Younger participants gave significantly higher ratings of acceptability. Conclusions: Adolescents and young adults found HIV self-testing highly acceptable with the AtomoRapid and they used the device accurately. Further research should investigate how, where and when to deploy HIV self-testing as a means to accompany existing strategies in reaching the UNAIDS goal to test 90% of all individuals worldwide. PMID:28406597

Usability Methods for Ensuring Health Information Technology Safety: Evidence-Based Approaches. Contribution of the IMIA Working Group Health Informatics for Patient Safety.

PubMed

Borycki, E; Kushniruk, A; Nohr, C; Takeda, H; Kuwata, S; Carvalho, C; Bainbridge, M; Kannry, J

2013-01-01

Issues related to lack of system usability and potential safety hazards continue to be reported in the health information technology (HIT) literature. Usability engineering methods are increasingly used to ensure improved system usability and they are also beginning to be applied more widely for ensuring the safety of HIT applications. These methods are being used in the design and implementation of many HIT systems. In this paper we describe evidence-based approaches to applying usability engineering methods. A multi-phased approach to ensuring system usability and safety in healthcare is described. Usability inspection methods are first described including the development of evidence-based safety heuristics for HIT. Laboratory-based usability testing is then conducted under artificial conditions to test if a system has any base level usability problems that need to be corrected. Usability problems that are detected are corrected and then a new phase is initiated where the system is tested under more realistic conditions using clinical simulations. This phase may involve testing the system with simulated patients. Finally, an additional phase may be conducted, involving a naturalistic study of system use under real-world clinical conditions. The methods described have been employed in the analysis of the usability and safety of a wide range of HIT applications, including electronic health record systems, decision support systems and consumer health applications. It has been found that at least usability inspection and usability testing should be applied prior to the widespread release of HIT. However, wherever possible, additional layers of testing involving clinical simulations and a naturalistic evaluation will likely detect usability and safety issues that may not otherwise be detected prior to widespread system release. The framework presented in the paper can be applied in order to develop more usable and safer HIT, based on multiple layers of evidence.

Mobile Apps for Self-Injury: A Content Analysis.

PubMed

Vieira, Aaron M; Lewis, Stephen P

2018-05-01

A growing body of research points to the salience of the Internet and mobile material among individuals who self-injure. However, to date, no research has investigated the mobile apps related to nonsuicidal self-injury (NSSI). Such information would clarify which apps may be useful for those who self-injure while highlighting whether app-related content warrants improvement. The current study examined the content and usability of NSSI apps available on the two largest app-related platforms (Google Play and iTunes). Using content analysis, apps were examined regarding their content (e.g., presence of NSSI myths and types of coping strategies) as well as usability (e.g., app performance). Results indicate that NSSI apps have varied content, with few developed by, or affiliated with, a trusted source (e.g., university). NSSI apps tend to not propagate NSSI myths that vary with respect to the quality of coping strategies offered. They also tend to be rated favorably in terms of their usability. Overall, the present findings add to the NSSI literature and highlight several implications and avenues for future work, which are discussed.

Ten factors to consider when developing usability scenarios and tasks for health information technology.

PubMed

Russ, Alissa L; Saleem, Jason J

2018-02-01

The quality of usability testing is highly dependent upon the associated usability scenarios. To promote usability testing as part of electronic health record (EHR) certification, the Office of the National Coordinator (ONC) for Health Information Technology requires that vendors test specific capabilities of EHRs with clinical end-users and report their usability testing process - including the test scenarios used - along with the results. The ONC outlines basic expectations for usability testing, but there is little guidance in usability texts or scientific literature on how to develop usability scenarios for healthcare applications. The objective of this article is to outline key factors to consider when developing usability scenarios and tasks to evaluate computer-interface based health information technologies. To achieve this goal, we draw upon a decade of our experience conducting usability tests with a variety of healthcare applications and a wide range of end-users, to include healthcare professionals as well as patients. We discuss 10 key factors that influence scenario development: objectives of usability testing; roles of end-user(s); target performance goals; evaluation time constraints; clinical focus; fidelity; scenario-related bias and confounders; embedded probes; minimize risks to end-users; and healthcare related outcome measures. For each factor, we present an illustrative example. This article is intended to aid usability researchers and practitioners in their efforts to advance health information technologies. The article provides broad guidance on usability scenario development and can be applied to a wide range of clinical information systems and applications. Published by Elsevier Inc.

Usability flaws of medication-related alerting functions: A systematic qualitative review.

PubMed

Marcilly, Romaric; Ammenwerth, Elske; Vasseur, Francis; Roehrer, Erin; Beuscart-Zéphir, Marie-Catherine

2015-06-01

Medication-related alerting functions may include usability flaws that limit their optimal use. A first step on the way to preventing usability flaws is to understand the characteristics of these usability flaws. This systematic qualitative review aims to analyze the type of usability flaws found in medication-related alerting functions. Papers were searched via PubMed, Scopus and Ergonomics Abstracts databases, along with references lists. Paper selection, data extraction and data analysis was performed by two to three Human Factors experts. Meaningful semantic units representing instances of usability flaws were the main data extracted. They were analyzed through qualitative methods: categorization following general usability heuristics and through an inductive process for the flaws specific to medication-related alerting functions. From the 6380 papers initially identified, 26 met all eligibility criteria. The analysis of the papers identified a total of 168 instances of usability flaws that could be classified into 13 categories of usability flaws representing either violations of general usability principles (i.e. they could be found in any system, e.g. guidance and workload issues) or infractions specific to medication-related alerting functions. The latter refer to issues of low signal-to-noise ratio, incomplete content of alerts, transparency, presentation mode and timing, missing alert features, tasks and control distribution. The list of 168 instances of usability flaws of medication-related alerting functions provides a source of knowledge for checking the usability of medication-related alerting functions during their design and evaluation process and ultimately constructs evidence-based usability design principles for these functions. Copyright © 2015 Elsevier Inc. All rights reserved.

Usability of a Novel Mobile Health iPad App by Vulnerable Populations.

PubMed

Miller, David P; Weaver, Kathryn E; Case, L Doug; Babcock, Donald; Lawler, Donna; Denizard-Thompson, Nancy; Pignone, Michael P; Spangler, John G

2017-04-11

Recent advances in mobile technologies have created new opportunities to reach broadly into populations that are vulnerable to health disparities. However, mobile health (mHealth) strategies could paradoxically increase health disparities, if low socioeconomic status individuals lack the technical or literacy skills needed to navigate mHealth programs. The aim of this study was to determine whether patients from vulnerable populations could successfully navigate and complete an mHealth patient decision aid. We analyzed usability data from a randomized controlled trial of an iPad program designed to promote colorectal cancer (CRC) screening. The trial was conducted in six primary care practices and enrolled 450 patients, aged 50-74 years, who were due for CRC screening. The iPad program included a self-survey and randomly displayed either a screening decision aid or a video about diet and exercise. We measured participant ability to complete the program without assistance and participant-rated program usability. Two-thirds of the participants (305/450) were members of a vulnerable population (limited health literacy, annual income < US $20,000, or black race). Over 92% (417/450) of the participants rated the program highly on all three usability items (90.8% for vulnerable participants vs 96.6% for nonvulnerable participants, P=.006). Only 6.9% (31/450) of the participants needed some assistance to complete the program. In multivariable logistic regression, being a member of a vulnerable population was not associated with needing assistance. Only older age, less use of text messaging (short message service, SMS), and lack of Internet use predicted needing assistance. Individuals who are vulnerable to health disparities can successfully use well-designed mHealth programs. Future research should investigate whether mHealth interventions can reduce health disparities. ©David P Miller Jr, Kathryn E Weaver, L Doug Case, Donald Babcock, Donna Lawler, Nancy Denizard-Thompson, Michael P Pignone, John G Spangler. Originally published in JMIR Mhealth and Uhealth (http://mhealth.jmir.org), 11.04.2017.

Testing the Feasibility and Usability of a Novel Smartphone-Based Self-Management Support System for Dialysis Patients: A Pilot Study.

PubMed

Hayashi, Aki; Yamaguchi, Satoko; Waki, Kayo; Fujiu, Katsuhito; Hanafusa, Norio; Nishi, Takahiro; Tomita, Hyoe; Kobayashi, Haruka; Fujita, Hideo; Kadowaki, Takashi; Nangaku, Masaomi; Ohe, Kazuhiko

2017-04-20

Diet and fluid restrictions that need continuous self-management are among the most difficult aspects of dialysis treatment. Smartphone applications may be useful for supporting self-management. Our objective is to investigate the feasibility and usability of a novel smartphone-based self-management support system for dialysis patients. We developed the Self-Management and Recording System for Dialysis (SMART-D), which supports self-monitoring of three mortality-related factors that can be modified by lifestyle: interdialytic weight gain and predialysis serum potassium and phosphorus concentrations. Data is displayed graphically, with all data evaluated automatically to determine whether they achieve the values suggested by the Japanese Society for Dialysis Therapy guidelines. In a pilot study, 9 dialysis patients used SMART-D system for 2 weeks. A total of 7 of them completed questionnaires rating their assessment of SMART-D's usability and their satisfaction with the system. In addition, the Kidney Disease Quality of Life scale was compared before and after the study period. All 9 participants were able to use SMART-D with no major problems. Completion rates for body weight, pre- and postdialysis weight, and serum potassium and phosphorus concentrations were, respectively, 89% (SD 23), 95% (SD 7), and 78% (SD 44). Of the 7 participants who completed the usability survey, all were motivated by the sense of security derived from using the system, and 6 of the 7 (86%) reported that using SMART-D helped improve their lifestyle and self-management. Using SMART-D was feasible, and the system was well regarded by patients. Further study with larger scale cohorts and longer study and follow-up periods is needed to evaluate the effects of SMART-D on clinical outcomes and quality of life. ©Aki Hayashi, Satoko Yamaguchi, Kayo Waki, Katsuhito Fujiu, Norio Hanafusa, Takahiro Nishi, Hyoe Tomita, Haruka Kobayashi, Hideo Fujita, Takashi Kadowaki, Masaomi Nangaku, Kazuhiko Ohe. Originally published in JMIR Research Protocols (http://www.researchprotocols.org), 20.04.2017.

Testing the Feasibility and Usability of a Novel Smartphone-Based Self-Management Support System for Dialysis Patients: A Pilot Study

PubMed Central

Fujiu, Katsuhito; Hanafusa, Norio; Nishi, Takahiro; Tomita, Hyoe; Kobayashi, Haruka; Fujita, Hideo; Kadowaki, Takashi; Nangaku, Masaomi; Ohe, Kazuhiko

2017-01-01

Background Diet and fluid restrictions that need continuous self-management are among the most difficult aspects of dialysis treatment. Smartphone applications may be useful for supporting self-management. Objective Our objective is to investigate the feasibility and usability of a novel smartphone-based self-management support system for dialysis patients. Methods We developed the Self-Management and Recording System for Dialysis (SMART-D), which supports self-monitoring of three mortality-related factors that can be modified by lifestyle: interdialytic weight gain and predialysis serum potassium and phosphorus concentrations. Data is displayed graphically, with all data evaluated automatically to determine whether they achieve the values suggested by the Japanese Society for Dialysis Therapy guidelines. In a pilot study, 9 dialysis patients used SMART-D system for 2 weeks. A total of 7 of them completed questionnaires rating their assessment of SMART-D’s usability and their satisfaction with the system. In addition, the Kidney Disease Quality of Life scale was compared before and after the study period. Results All 9 participants were able to use SMART-D with no major problems. Completion rates for body weight, pre- and postdialysis weight, and serum potassium and phosphorus concentrations were, respectively, 89% (SD 23), 95% (SD 7), and 78% (SD 44). Of the 7 participants who completed the usability survey, all were motivated by the sense of security derived from using the system, and 6 of the 7 (86%) reported that using SMART-D helped improve their lifestyle and self-management. Conclusions Using SMART-D was feasible, and the system was well regarded by patients. Further study with larger scale cohorts and longer study and follow-up periods is needed to evaluate the effects of SMART-D on clinical outcomes and quality of life. PMID:28428168

Microcomputers on Campus.

ERIC Educational Resources Information Center

Schimizzi, Ned V.; Dudley, Donald

The study reports on a nationwide survey that investigated the specific planning steps and procedures used by colleges and universities in implementing microcomputer instruction into their teacher education curriculum. The findings presented are based on 101 usable responses to a 55-item questionnaire mailed to five major college and university…

A Competitive Benchmarking Study of Noncredit Program Administration.

ERIC Educational Resources Information Center

Alstete, Jeffrey W.

1996-01-01

A benchmarking project to measure administrative processes and financial ratios received 57 usable replies from 300 noncredit continuing education programs. Programs with strong financial surpluses were identified and their processes benchmarked (including response to inquiries, registrants, registrant/staff ratio, new courses, class size,…

Usability Flaws in Medication Alerting Systems: Impact on Usage and Work System.

PubMed

Marcilly, R; Ammenwerth, E; Roehrer, E; Pelayo, S; Vasseur, F; Beuscart-Zéphir, M-C

2015-08-13

Previous research has shown that medication alerting systems face usability issues. There has been no previous attempt to systematically explore the consequences of usability flaws in such systems on users (i.e. usage problems) and work systems (i.e. negative outcomes). This paper aims at exploring and synthesizing the consequences of usability flaws in terms of usage problems and negative outcomes on the work system. A secondary analysis of 26 papers included in a prior systematic review of the usability flaws in medication alerting was performed. Usage problems and negative outcomes were extracted and sorted. Links between usability flaws, usage problems, and negative outcomes were also analyzed. Poor usability generates a large variety of consequences. It impacts the user from a cognitive, behavioral, emotional, and attitudinal perspective. Ultimately, usability flaws have negative consequences on the workflow, the effectiveness of the technology, the medication management process, and, more importantly, patient safety. Only few complete pathways leading from usability flaws to negative outcomes were identified. Usability flaws in medication alerting systems impede users, and ultimately their work system, and negatively impact patient safety. Therefore, the usability dimension may act as a hidden explanatory variable that could explain, at least partly, the (absence of) intended outcomes of new technology.

Usability Flaws in Medication Alerting Systems: Impact on Usage and Work System

PubMed Central

Ammenwerth, E.; Roehrer, E.; Pelayo, S.; Vasseur, F.; Beuscart-Zéphir, M.-C.

2015-01-01

Summary Objectives Previous research has shown that medication alerting systems face usability issues. There has been no previous attempt to systematically explore the consequences of usability flaws in such systems on users (i.e. usage problems) and work systems (i.e. negative outcomes). This paper aims at exploring and synthesizing the consequences of usability flaws in terms of usage problems and negative outcomes on the work system. Methods A secondary analysis of 26 papers included in a prior systematic review of the usability flaws in medication alerting was performed. Usage problems and negative outcomes were extracted and sorted. Links between usability flaws, usage problems, and negative outcomes were also analyzed. Results Poor usability generates a large variety of consequences. It impacts the user from a cognitive, behavioral, emotional, and attitudinal perspective. Ultimately, usability flaws have negative consequences on the workflow, the effectiveness of the technology, the medication management process, and, more importantly, patient safety. Only few complete pathways leading from usability flaws to negative outcomes were identified. Conclusion Usability flaws in medication alerting systems impede users, and ultimately their work system, and negatively impact patient safety. Therefore, the usability dimension may act as a hidden explanatory variable that could explain, at least partly, the (absence of) intended outcomes of new technology. PMID:26123906

Farm Mapping to Assist, Protect, and Prepare Emergency Responders: Farm MAPPER.

PubMed

Reyes, Iris; Rollins, Tami; Mahnke, Andrea; Kadolph, Christopher; Minor, Gerald; Keifer, Matthew

2014-01-01

Responders such as firefighters and emergency medical technicians who respond to farm emergencies often face complex and unknown environments. They may encounter hazards such as fuels, solvents, pesticides, caustics, and exploding gas storage cylinders. Responders may be unaware of dirt roads within the farm that can expedite their arrival at critical sites or snow-covered manure pits that act as hidden hazards. A response to a farm, unless guided by someone familiar with the operation, may present a risk to responders and post a challenge in locating the victim. This project explored the use of a Web-based farm-mapping application optimized for tablets and accessible via easily accessible on-site matrix barcodes, or quick response codes (QR codes), to provide emergency responders with hazard and resource information to agricultural operations. Secured portals were developed for both farmers and responders, allowing both parties to populate and customize farm maps with icons. Data were stored online and linked to QR codes attached to mailbox posts where emergency responders may read them with a mobile device. Mock responses were conducted on dairy farms to test QR code linking efficacy, Web site security, and field usability. Findings from farmer usability tests showed willingness to enter data as well as ease of Web site navigation and data entry even with farmers who had limited computer knowledge. Usability tests with emergency responders showed ease of QR code connectivity to the farm maps and ease of Web site navigation. Further research is needed to improve data security as well as assess the program's applicability to nonfarm environments and integration with existing emergency response systems. The next phases of this project will expand the program for regional and national use, develop QR code-linked, Web-based extrication guidance for farm machinery for victim entrapment rescue, and create QR code-linked online training videos and materials for limited English proficient immigrant farm workers.

Telecoil-mode hearing aid compatibility performance requirements for wireless and cordless handsets: magnetic signal-to-noise.

PubMed

Julstrom, Stephen; Kozma-Spytek, Linda; Isabelle, Scott

2011-09-01

During the revision of the American National Standards Institute (ANSI) C63.19 and the development of the ANSI/Telecommunications Industry Association-1083 hearing aid compatibility standards, it became evident that additional data concerning user acceptance of interfering magnetic noises generated by wireless and cordless telephones were needed in order to determine the requirements for telecoil-coupling compatibility. Further insight was needed into the magnetic signal-to-noise (S/N) ratios required to achieve specific levels of telephone usability by hearing aid wearers. (A companion article addresses magnetic signal level requirements.) Test subjects used their own hearing aids. The magnetic signals were applied through large magnetic head-worn coils, selected for the field orientation appropriate for each hearing aid. After adjusting their aid's volume control to an acoustic speech reference, the subjects adjusted the applied magnetic signal level to find their Most Comfortable Level (MCL). Each subject then adjusted the levels of six of eight different representative interfering noises to three levels of subjective telephone usability: "usable for a brief call," "acceptable for normal use," and "excellent performance." Each subject's objective noise audibility threshold in the presence of speech was also obtained for the various noise types. The 57 test subjects covered an age range of 22 to 79 yr, with a self-reported hearing loss duration of 12 to 72 yr. All had telecoils that they used for at least some telecommunications needs. The self-reported degree of hearing loss ranged from moderate to profound. A guided intake questionnaire yielded general background information for each subject. A test control box fed by prepared speech and noise recordings from computer files enabled the subject or the tester, depending on the portion of the test, to select A-weighting-normalized noise interference levels in 1.25 dB steps relative to the selected MCL. For each subject for each tested noise type, the values for the selected S/N ratios were recorded for the three categories of subjective usability and the objective noise threshold. About half of the test subjects needed a minimum 21 dB S/N ratio for them to consider their listening experience "acceptable for normal use" of a telephone. With a 30 dB S/N ratio, about 85% of the subjects reported normal use acceptability. Significant differences were apparent in the measured S/N user requirements among the noise types, though, indicating a deficiency in an A-weighted level measurement's ability to consistently predict the subjective acceptability of the various noises. An improved weighting function having both spectral and temporal components was developed to substantially eliminate these predictive inconsistencies. The interfering noise level that subjects chose for a telephone usability rating of "excellent performance" matched closely their objectively measured noise audibility threshold. A rating of "acceptable for normal use" was typically achieved at a 4 dB higher noise level, and a rating of "usable for a brief call," at a 10.4 dB higher noise level. These results did not relate significantly to noise type or to the subject's aided noise-in-speech hearing acuity. American Academy of Audiology.

Validity and usability of a safe driving behaviors measure for older adults : strategy for congestion mitigation.

DOT National Transportation Integrated Search

2012-01-01

Statistics project that crash/injury/fatality rates of older drivers will increase with the future growth of : this population. Accurate and precise measurement of older driver behaviors becomes imperative to : curtail these crash trends and resultin...

An information management system for patients with tuberculosis: usability assessment with end-users.

PubMed

Darby, Jonathan; Black, Jim; Morrison, David; Buising, Kirsty

2012-01-01

Information systems with clinical decision support (CDS) offer great potential to assist the co-ordination of patients with chronic diseases and to improve patient care. Despite this, few have entered routine clinical use. Tuberculosis (TB) is an infection of public health importance. It has complex interactions with many comorbid conditions, requires close supervised care and prolonged treatment for effective cure. These features make it suitable for use with an information management system with CDS features. In close consultation with key stakeholders, a clinical application was developed for the management of TB patients in Victoria. A formal usability assessment using semi-structured case-scenario based exercises was performed. Subjects were 12 individuals closely involved in the care of TB patients, including Infectious Diseases and Respiratory Physicians, and Public Health Nurses. Two researchers conducted the sessions, independently analysed responses and discrepancies compared to the voice record for validity. Despite varied computer experience, responses were positive regarding user interface and content. Data location was not always intuitive, however this improved with familiarity of the program. Decision support was considered valuable, with useful suggestions for expansion of these features. Automated reporting for correspondence and notification to the Health Department were felt worth the initial investment in data entry. An important workflow-based issue regarding dismissal of alerts and several errors were detected. Usability assessment validated many design elements of the system, provided a unique insight into workflow issues faced by users and hopefully will impact on its ultimate clinical utility.

Improving Public Relations Web Sites through Usability Research.

ERIC Educational Resources Information Center

Hallahan, Kirk

2001-01-01

Argues that usability research has particular relevance for enhancing the effectiveness of websites. Examines the nature and value of usability research, and the elements of an effective website based on usability principles. (SR)

Applying usability methods to identify health literacy issues: an example using a Personal Health Record.

PubMed

Monkman, Helen; Kushniruk, Andre

2013-01-01

The prevalence of consumer health information systems is increasing. However, usability and health literacy impact both the value and adoption of these systems. Health literacy and usability are closely related in that systems may not be used accurately if users cannot understand the information therein. Thus, it is imperative to focus on mitigating the demands on health literacy in consumer health information systems. This study modified two usability evaluation methods (heuristic evaluation and usability testing) to incorporate the identification of potential health literacy issues in a Personal Health Record (PHR). Heuristic evaluation is an analysis of a system performed by a usability specialist who evaluates how well the system abides by usability principles. In contrast, a usability test involves a post hoc analysis of a representative user interacting with the system. These two methods revealed several health literacy issues and suggestions to ameliorate them were made. Thus, it was demonstrated that usability methods could be successfully augmented for the purpose of investigating health literacy issues. To improve users' health knowledge, the adoption of consumer health information systems, and the accuracy of the information contained therein, it is encouraged that usability methods be applied with an added focus on health literacy.

Usability evaluation techniques in mobile commerce applications: A systematic review

NASA Astrophysics Data System (ADS)

Hussain, Azham; Mkpojiogu, Emmanuel O. C.

2016-08-01

Obviously, there are a number of literatures concerning the usability of mobile commerce (m-commerce) applications and related areas, but they do not adequately provide knowledge about usability techniques used in most of the empirical usability evaluation for m-commerce application. Therefore, this paper is aimed at producing the usability techniques frequently used in the aspect of usability evaluation for m-commerce applications. To achieve the stated objective, systematic literature review was employed. Sixty seven papers were downloaded in usability evaluation for m-commerce and related areas; twenty one most relevant studies were selected for review in order to extract the appropriate information. The results from the review shows that heuristic evaluation, formal test and think aloud methods are the most commonly used methods in m-commerce application in comparison to cognitive walkthrough and the informal test methods. Moreover, most of the studies applied control experiment (33.3% of the total studies); other studies that applied case study for usability evaluation are 14.28%. The results from this paper provide additional knowledge to the usability practitioners and research community for the current state and use of usability techniques in m-commerce application.

Usability testing for the rest of us: the application of discount usability principles in the development of an online communications assessment application.

PubMed

Brock, Douglas; Kim, Sara; Palmer, Odawni; Gallagher, Thomas; Holmboe, Eric

2013-01-01

Usability evaluation provides developers and educators with the means to understand user needs, improve overall product utility, and increase user satisfaction. The application of "discount usability" principles developed to make usability testing more practical and useful may improve user experience at minimal cost and require little existing expertise to conduct. We describe an application of discount usability to a high-fidelity online communications assessment application developed by the University of Washington for the American Board of Internal Medicine. Eight internal medicine physicians completed a discount usability test. Sessions were recorded and the videos analyzed for significant usability concerns. Concerns were identified, summarized, discussed, and prioritized by the authors in collaboration with the software developers before implementing any changes to the interface. Thirty-eight significant usability issues were detected and four technical problems were identified. Each issue was responded to through modification of the software, by providing additional instruction, or delayed for a later version to be developed. Discount usability can be easily implemented in academic developmental activities. Our study resulted in the discovery and remediation of significant user problems, in addition to giving important insight into the novel methods built into the application.

Alterable Magnetic Gratings for Fiber Optic Switching.

DTIC Science & Technology

1982-12-01

monotonically decreasing function as X moves into the infrared from the visible. The Faraday rotation of bismuth garnet samples including the new large... photodector giving as fast a response as possible while still providing usable signal levels, measure the detector response * using the electro-optic...icity. Normally a stripe domain array is configured as a linear grating. In-plane magnetic fields can rotate the grating as well as alter the periodicity

Fabrication and evaluation of polymeric early-warning fire-alarm devices. [combustion products

NASA Technical Reports Server (NTRS)

Senturia, S. D.

1975-01-01

The electrical resistivities were investigated of some polymers known to be enhanced by the presence of certain gases. This was done to make a device capable of providing early warning to fire through its response with the gases produced in the early phases of combustion. Eight polymers were investigated: poly(phenyl acetylene), poly(p-aminophenyl acetylene), poly(p-nitrophenyl acetylene), poly(p-formamidophenyl acetylene), poly(ethynyl ferrocene), poly(ethynyl carborane), poly(ethynyl pyridine), and the polymer made from 1,2,3,6 tetramethyl pyridazine. A total of 40 usable thin-film sandwich devices and a total of 70 usable interdigitated-electrode lock-and-key devices were fabricated. The sandwich devices were used for measurements of contact linearity, polymer conductivity, and polymer dielectric constant. The lock-and-key devices were used to determine the response of the polymers to a spectrum of gases that included ammonia, carbon nonoxide, carbon dioxide, sulfur dioxide, ethylene, acrolein, water vapor, and normal laboratory air. Strongest responses were to water vapor, ammonia, and acrolein, and depending on the polymer, weaker responses to carbon dioxide, sulfur dioxide, and carbon monoxide were observed. A quantitative theory of device operation, capable of accounting for observed device leakage current and sensitivity, was developed. A prototype detection/alarm system was designed and built for use in demonstrating sensor performance.

Earthdata Search Usability Study Process

NASA Technical Reports Server (NTRS)

Reese, Mark

2016-01-01

User experience (UX) design is the process of enhancing user satisfaction by improving various aspects of the user's interaction with an application or website. One aspect of UX design is usability, or the extent to which an application can be used to to accomplish tasks efficiently, effectively, and with satisfaction. NASA's Earthdata Search Client recently underwent a focused usability testing project to measure usability and gain valuable user feedback and insights to increase usability for its end-users. This presentation focuses on the process by which the usability tests were administered and the lessons learned throughout the process.

An Analysis of Agricultural Mechanics Safety Practices in Agricultural Science Laboratories.

ERIC Educational Resources Information Center

Swan, Michael K.

North Dakota secondary agricultural mechanics instructors were surveyed regarding instructional methods and materials, safety practices, and equipment used in the agricultural mechanics laboratory. Usable responses were received from 69 of 89 instructors via self-administered mailed questionnaires. Findings were consistent with results of similar…

Older Workers' Communication Satisfaction in the Lodging Industry.

ERIC Educational Resources Information Center

Fu, Yao-Yi; Mount, Daniel J.

2002-01-01

Usable responses from 374 hotel employees compared the satisfaction with workplace communications of younger (n=80) and older workers (n=81). Differences in terms of downward and vertical communication, corporate information, communication climate, feedback, and coworker communication suggest different ways to manage workers. (Contains 33…

78 FR 75353 - Agency Information Collection Activities: Proposed Collection: Public Comment Request

Federal Register 2010, 2011, 2012, 2013, 2014

2013-12-11

... cognitive interviews, focus groups, usability tests, field tests/pilot interviews, and experimental research... as more basic research on response errors in surveys. HRSA staff use various techniques to evaluate... interview structure consists of respondents first answering a draft survey question and then providing...

Response of dwarf mistletoe-infested ponderosa pine to thinning: 1. Sapling growth.

Treesearch

James W. Barrett; Lewis F. Roth

1985-01-01

Observations of thinned ponderosa pine infested with dwarf mistletoe over a 17-year period suggests that on average or better Sites most infested stands can be managed to produce usable wood products in reasonable time, if trends found in juvenile stands continue.

A Survey of Corporate Executives' Perceptions of Collegiate International Business Preparation.

ERIC Educational Resources Information Center

Hart, Sara A.; And Others

1994-01-01

According to 106 usable responses from 600 chief executive officers, they want increased corporate input in collegiate international business programs; they prefer graduates with a solid business foundation and communication skills; and interpersonal skills were most important when hiring for international positions. (SK)

GADRAS-DRF 18.6 User's Manual

DOE Office of Scientific and Technical Information (OSTI.GOV)

Horne, Steve M.; Thoreson, Greg G.; Theisen, Lisa A.

2016-05-01

The Gamma Detector Response and Analysis Software–Detector Response Function (GADRAS-DRF) application computes the response of gamma-ray and neutron detectors to incoming radiation. This manual provides step-by-step procedures to acquaint new users with the use of the application. The capabilities include characterization of detector response parameters, plotting and viewing measured and computed spectra, analyzing spectra to identify isotopes, and estimating source energy distributions from measured spectra. GADRAS-DRF can compute and provide detector responses quickly and accurately, giving users the ability to obtain usable results in a timely manner (a matter of seconds or minutes).

Qualitative review of usability problems in health information systems for radiology.

PubMed

Dias, Camila Rodrigues; Pereira, Marluce Rodrigues; Freire, André Pimenta

2017-12-01

Radiology processes are commonly supported by Radiology Information System (RIS), Picture Archiving and Communication System (PACS) and other software for radiology. However, these information technologies can present usability problems that affect the performance of radiologists and physicians, especially considering the complexity of the tasks involved. The purpose of this study was to extract, classify and analyze qualitatively the usability problems in PACS, RIS and other software for radiology. A systematic review was performed to extract usability problems reported in empirical usability studies in the literature. The usability problems were categorized as violations of Nielsen and Molich's usability heuristics. The qualitative analysis indicated the causes and the effects of the identified usability problems. From the 431 papers initially identified, 10 met the study criteria. The analysis of the papers identified 90 instances of usability problems, classified into categories corresponding to established usability heuristics. The five heuristics with the highest number of instances of usability problems were "Flexibility and efficiency of use", "Consistency and standards", "Match between system and the real world", "Recognition rather than recall" and "Help and documentation", respectively. These problems can make the interaction time consuming, causing delays in tasks, dissatisfaction, frustration, preventing users from enjoying all the benefits and functionalities of the system, as well as leading to more errors and difficulties in carrying out clinical analyses. Furthermore, the present paper showed a lack of studies performed on systems for radiology, especially usability evaluations using formal methods of evaluation involving the final users. Copyright © 2017 Elsevier Inc. All rights reserved.

Design and implementation of a hospital-based usability laboratory: insights from a Department of Veterans Affairs laboratory for health information technology.

PubMed

Russ, Alissa L; Weiner, Michael; Russell, Scott A; Baker, Darrell A; Fahner, W Jeffrey; Saleem, Jason J

2012-12-01

Although the potential benefits of more usable health information technologies (HIT) are substantial-reduced HIT support costs, increased work efficiency, and improved patient safety--human factors methods to improve usability are rarely employed. The US Department of Veterans Affairs (VA) has emerged as an early leader in establishing usability laboratories to inform the design of HIT, including its electronic health record. Experience with a usability laboratory at a VA Medical Center provides insights on how to design, implement, and leverage usability laboratories in the health care setting. The VA Health Services Research and Development Service Human-Computer Interaction & Simulation Laboratory emerged as one of the first VA usability laboratories and was intended to provide research-based findings about HIT designs. This laboratory supports rapid prototyping, formal usability testing, and analysis tools to assess existing technologies, alternative designs, and potential future technologies. RESULTS OF IMPLEMENTATION: Although the laboratory has maintained a research focus, it has become increasingly integrated with VA operations, both within the medical center and on a national VA level. With this resource, data-driven recommendations have been provided for the design of HIT applications before and after implementation. The demand for usability testing of HIT is increasing, and information on how to develop usability laboratories for the health care setting is often needed. This article may assist other health care organizations that want to invest in usability resources to improve HIT. The establishment and utilization of usability laboratories in the health care setting may improve HIT designs and promote safe, high-quality care for patients.

Usability and Acceptability of a Web-Based Program for Chemotherapy-Induced Peripheral Neuropathy.

PubMed

Tofthagen, Cindy; Kip, Kevin E; Passmore, Denise; Loy, Ian; Berry, Donna L

2016-07-01

Chemotherapy-induced neuropathy is a painful and debilitating adverse effect of certain chemotherapy drugs. There have not been any patient-centered, easily accessible Web-based interventions to assist with self-management of chemotherapy-induced neuropathy. The aims of this study were to evaluate usability and acceptability and to estimate an effect size of a Web-based intervention for assessing and managing chemotherapy-induced neuropathy. Participants (N = 14) were instructed to complete the Creativity, Optimism, Planning, and Expert Information for Chemotherapy-Induced Peripheral Neuropathy program and provide verbal responses to the program. Participants completed the Chemotherapy Induced Peripheral Neuropathy Assessment Tool and Post-Study System Usability Questionnaire. Iterative changes were made to the COPE-CIPN. Participants were asked to provide feedback on the revised COPE-CIPN, repeat the Chemotherapy Induced Peripheral Neuropathy Assessment Tool, and evaluate acceptability using the Acceptability e-Scale. The COPE-CIPN demonstrated high usability (mean, 1.98 [SD, 1.12]) and acceptability (mean, 4.40 [SD, 0.52]). Comments indicated that the interface was easy to use, and the information was helpful. While neuropathy symptoms continued to increase in this group of patients receiving neurotoxic chemotherapy, there was a decrease in mean level of interference with activities from 53.71 to 39.29 over 3 to 4 months, which indicated a moderate effect (d = 0.39) size. The COPE-CIPN may be a useful intervention to support self-management of chemotherapy-induced neuropathy.

Refereed Publications of Vital Business Educators

ERIC Educational Resources Information Center

Blaszczynski, Carol; Scott, James Calvert; Green, Diana J.

2009-01-01

Problem: No systematic research has explored the refereed publications records of vital business educators. Data Collection Procedures: A total of 120 prominent business educators were mailed a survey about their publication practices and history, yielding a 61% usable return rate from 73 completed questionnaires. Results: The six research…

A Usability Study of a Serious Game in Cognitive Rehabilitation: A Compensatory Navigation Training in Acquired Brain Injury Patients

PubMed Central

van der Kuil, Milan N. A.; Visser-Meily, Johanna M. A.; Evers, Andrea W. M.; van der Ham, Ineke J. M.

2018-01-01

Acquired brain injury patients often report navigation impairments. A cognitive rehabilitation therapy has been designed in the form of a serious game. The aim of the serious game is to aid patients in the development of compensatory navigation strategies by providing exercises in 3D virtual environments on their home computers. The objective of this study was to assess the usability of three critical gaming attributes: movement control in 3D virtual environments, instruction modality and feedback timing. Thirty acquired brain injury patients performed three tasks in which objective measures of usability were obtained. Mouse controlled movement was compared to keyboard controlled movement in a navigation task. Text-based instructions were compared to video-based instructions in a knowledge acquisition task. The effect of feedback timing on performance and motivation was examined in a navigation training game. Subjective usability ratings of all design options were assessed using questionnaires. Results showed that mouse controlled interaction in 3D environments is more effective than keyboard controlled interaction. Patients clearly preferred video-based instructions over text-based instructions, even though video-based instructions were not more effective in context of knowledge acquisition and comprehension. No effect of feedback timing was found on performance and motivation in games designed to train navigation abilities. Overall appreciation of the serious game was positive. The results provide valuable insights in the design choices that facilitate the transfer of skills from serious games to real-life situations. PMID:29922196

Formative usability evaluation of a fixed-dose pen-injector platform device

PubMed Central

Lange, Jakob; Nemeth, Tobias

2018-01-01

Background This article for the first time presents a formative usability study of a fixed-dose pen injector platform device used for the subcutaneous delivery of biopharmaceuticals, primarily for self-administration by the patient. The study was conducted with a user population of both naïve and experienced users across a range of ages. The goals of the study were to evaluate whether users could use the devices safely and effectively relying on the instructions for use (IFU) for guidance, as well as to benchmark the device against another similar injector established in the market. Further objectives were to capture any usability issues and obtain participants’ subjective ratings on the properties and performance of both devices. Methods A total of 20 participants in three groups studied the IFU and performed simulated injections into an injection pad. Results All participants were able to use the device successfully. The device was well appreciated by all users with, maximum usability feedback scores reported by 90% or more on handling forces and device feedback, and by 85% or more on fit and grip of the device. The presence of clear audible and visible feedbacks upon successful loading of a dose and completion of injection was seen to be a significant improvement over the benchmark injector. Conclusion The observation that the platform device can be safely and efficiently used by all user groups provides confidence that the device and IFU in their current form will pass future summative testing in specific applications. PMID:29670411

Usability of a CKD educational website targeted to patients and their family members.

PubMed

Diamantidis, Clarissa J; Zuckerman, Marni; Fink, Wanda; Hu, Peter; Yang, Shiming; Fink, Jeffrey C

2012-10-01

Web-based technology is critical to the future of healthcare. As part of the Safe Kidney Care cohort study evaluating patient safety in CKD, this study determined how effectively a representative sample of patients with CKD or family members could interpret and use the Safe Kidney Care website (www.safekidneycare.org), an informational website on safety in CKD. Between November of 2011 and January of 2012, persons with CKD or their family members underwent formal usability testing administered by a single interviewer with a second recording observer. Each participant was independently provided a list of 21 tasks to complete, with each task rated as either easily completed/noncritical error or critical error (user cannot complete the task without significant interviewer intervention). Twelve participants completed formal usability testing. Median completion time for all tasks was 17.5 minutes (range=10-44 minutes). In total, 10 participants had greater than or equal to one critical error. There were 55 critical errors in 252 tasks (22%), with the highest proportion of critical errors occurring when participants were asked to find information on treatments that may damage kidneys, find the website on the internet, increase font size, and scroll to the bottom of the webpage. Participants were generally satisfied with the content and usability of the website. Web-based educational materials for patients with CKD should target a wide range of computer literacy levels and anticipate variability in competency in use of the computer and internet.

Adapting a Psychosocial Intervention for Smartphone Delivery to Middle-Aged and Older Adults with Serious Mental Illness.

PubMed

Whiteman, Karen L; Lohman, Matthew C; Gill, Lydia E; Bruce, Martha L; Bartels, Stephen J

2017-08-01

To describe the process of adapting an integrated medical and psychiatric self-management intervention to a smartphone application for middle-aged and older adults with serious mental illness using an adaptive systems engineering framework and user-centered design. First, we determined the technical abilities and needs of middle-aged and older adults with serious mental illnesses using smartphones. Then, we developed smartphone content through principles of user-centered design and modified an existing smartphone platform. Finally, we conducted a usability test using "think aloud" and verbal probing. We adapted a psychosocial self-management intervention to a smartphone application and tested its usability. Ten participants (mean age: 55.3 years, SD: 6.2 years) with serious mental illness and comorbid chronic health conditions reported a high level of usability and satisfaction with the smartphone application. Middle-aged and older adults with serious mental illness and limited technical abilities were able to participate in a process involving user-centered design and adaptation of a self-management intervention to be delivered by a smartphone. High usability ratings suggest that middle-aged and older adults with serious mental illness have the potential to use tailored smartphone interventions. Future research is indicated to establish effectiveness and to determine the type and intensity of clinical support needed to successfully implement smartphone applications as a component of community-based services for older adults with psychiatric and medical conditions. Copyright © 2017 American Association for Geriatric Psychiatry. Published by Elsevier Inc. All rights reserved.

Use of Online Machine Translation for Nursing Literature: A Questionnaire-Based Survey

PubMed Central

Anazawa, Ryoko; Ishikawa, Hirono; Takahiro, Kiuchi

2013-01-01

Background: The language barrier is a significant obstacle for nurses who are not native English speakers to obtain information from international journals. Freely accessible online machine translation (MT) offers a possible solution to this problem. Aim: To explore how Japanese nursing professionals use online MT and perceive its usability in reading English articles and to discuss what should be considered for better utilisation of online MT lessening the language barrier. Method: In total, 250 randomly selected assistants and research associates at nursing colleges across Japan answered a questionnaire examining the current use of online MT and perceived usability among Japanese nurses, along with the number of articles read in English and the perceived language barrier. The items were rated on Likert scales, and t-test, ANOVA, chi-square test, and Spearman’s correlation were used for analyses. Results: Of the participants, 73.8% had used online MT. More than half of them felt it was usable. The language barrier was strongly felt, and academic degrees and English proficiency level were associated factors. The perceived language barrier was related to the frequency of online MT use. No associated factor was found for the perceived usability of online MT. Conclusion: Language proficiency is an important factor for optimum utilisation of MT. A need for education in the English language, reading scientific papers, and online MT training was indicated. Cooperation with developers and providers of MT for the improvement of their systems is required. PMID:23459140

A Usability Study of a Serious Game in Cognitive Rehabilitation: A Compensatory Navigation Training in Acquired Brain Injury Patients.

PubMed

van der Kuil, Milan N A; Visser-Meily, Johanna M A; Evers, Andrea W M; van der Ham, Ineke J M

2018-01-01

Acquired brain injury patients often report navigation impairments. A cognitive rehabilitation therapy has been designed in the form of a serious game. The aim of the serious game is to aid patients in the development of compensatory navigation strategies by providing exercises in 3D virtual environments on their home computers. The objective of this study was to assess the usability of three critical gaming attributes: movement control in 3D virtual environments, instruction modality and feedback timing. Thirty acquired brain injury patients performed three tasks in which objective measures of usability were obtained. Mouse controlled movement was compared to keyboard controlled movement in a navigation task. Text-based instructions were compared to video-based instructions in a knowledge acquisition task. The effect of feedback timing on performance and motivation was examined in a navigation training game. Subjective usability ratings of all design options were assessed using questionnaires. Results showed that mouse controlled interaction in 3D environments is more effective than keyboard controlled interaction. Patients clearly preferred video-based instructions over text-based instructions, even though video-based instructions were not more effective in context of knowledge acquisition and comprehension. No effect of feedback timing was found on performance and motivation in games designed to train navigation abilities. Overall appreciation of the serious game was positive. The results provide valuable insights in the design choices that facilitate the transfer of skills from serious games to real-life situations.

Comparison of Brief Summary Formats Through a Health Literacy Lens.

PubMed

Sharp, Michele L; Hall, Lori; Eleftherion, Anthony; Simpson, Katherine; Neuhauser, Linda

2018-01-01

Print pharmaceutical advertisements in the United States require inclusion of a brief summary of side effects, warnings, precautions, and contraindications from the labeling. The full package insert, which sponsors have traditionally used to fulfill the brief summary requirement, does not adhere to health literacy best practices, limiting its value to consumers. This study compared the understandability and usability of brief summaries in 3 formats designed to be more consumer friendly. Three brief summary formats were tested: (1) 2-column "Question and Answer"; (2) "Prescription Drug Facts Box," similar to current US over-the-counter drug facts labeling; and (3) "Health Literacy," based on clear communication principles. Researchers evaluated the formats using the Suitability Assessment of Materials (SAM) tool and conducted structured, scripted, one-on-one interviews (usability tests) with participants with estimated low to average education levels. This research was replicated across 2 therapeutic areas (type 2 diabetes and plaque psoriasis). SAM scores showed that the Health Literacy format outperformed the Question and Answer format and the Prescription Drug Facts Box format in both therapeutic areas, with both Health Literacy brief summaries rated on the SAM as "superior." Qualitative usability tests supported the SAM findings, with the Health Literacy format preferred consistently over the Question and Answer format, and more often than not over the Prescription Drug Facts Box format. Sponsors can employ a user-tested Health Literacy format to improve the understandability and usability of brief summaries with patients.

A methodology for evaluating the usability of audiovisual consumer electronic products.

PubMed

Kwahk, Jiyoung; Han, Sung H

2002-09-01

Usability evaluation is now considered an essential procedure in consumer product development. Many studies have been conducted to develop various techniques and methods of usability evaluation hoping to help the evaluators choose appropriate methods. However, planning and conducting usability evaluation requires considerations of a number of factors surrounding the evaluation process including the product, user, activity, and environmental characteristics. In this perspective, this study suggested a new methodology of usability evaluation through a simple, structured framework. The framework was outlined by three major components: the interface features of a product as design variables, the evaluation context consisting of user, product, activity, and environment as context variables, and the usability measures as dependent variables. Based on this framework, this study established methods to specify the product interface features, to define evaluation context, and to measure usability. The effectiveness of this methodology was demonstrated through case studies in which the usability of audiovisual products was evaluated by using the methods developed in this study. This study is expected to help the usability practitioners in consumer electronics industry in various ways. Most directly, it supports the evaluators' plan and conduct usability evaluation sessions in a systematic and structured manner. In addition, it can be applied to other categories of consumer products (such as appliances, automobiles, communication devices, etc.) with minor modifications as necessary.

OPTIMIZING USABILITY OF AN ECONOMIC DECISION SUPPORT TOOL: PROTOTYPE OF THE EQUIPT TOOL.

PubMed

Cheung, Kei Long; Hiligsmann, Mickaël; Präger, Maximilian; Jones, Teresa; Józwiak-Hagymásy, Judit; Muñoz, Celia; Lester-George, Adam; Pokhrel, Subhash; López-Nicolás, Ángel; Trapero-Bertran, Marta; Evers, Silvia M A A; de Vries, Hein

2018-01-01

Economic decision-support tools can provide valuable information for tobacco control stakeholders, but their usability may impact the adoption of such tools. This study aims to illustrate a mixed-method usability evaluation of an economic decision-support tool for tobacco control, using the EQUIPT ROI tool prototype as a case study. A cross-sectional mixed methods design was used, including a heuristic evaluation, a thinking aloud approach, and a questionnaire testing and exploring the usability of the Return of Investment tool. A total of sixty-six users evaluated the tool (thinking aloud) and completed the questionnaire. For the heuristic evaluation, four experts evaluated the interface. In total twenty-one percent of the respondents perceived good usability. A total of 118 usability problems were identified, from which twenty-six problems were categorized as most severe, indicating high priority to fix them before implementation. Combining user-based and expert-based evaluation methods is recommended as these were shown to identify unique usability problems. The evaluation provides input to optimize usability of a decision-support tool, and may serve as a vantage point for other developers to conduct usability evaluations to refine similar tools before wide-scale implementation. Such studies could reduce implementation gaps by optimizing usability, enhancing in turn the research impact of such interventions.

To twist or poke? A method for identifying usability issues with the rotary controller and touch screen for control of in-vehicle information systems.

PubMed

Harvey, Catherine; Stanton, Neville A; Pickering, Carl A; McDonald, Mike; Zheng, Pengjun

2011-07-01

In-vehicle information systems (IVIS) can be controlled by the user via direct or indirect input devices. In order to develop the next generation of usable IVIS, designers need to be able to evaluate and understand the usability issues associated with these two input types. The aim of this study was to investigate the effectiveness of a set of empirical usability evaluation methods for identifying important usability issues and distinguishing between the IVIS input devices. A number of usability issues were identified and their causal factors have been explored. These were related to the input type, the structure of the menu/tasks and hardware issues. In particular, the translation between inputs and on-screen actions and a lack of visual feedback for menu navigation resulted in lower levels of usability for the indirect device. This information will be useful in informing the design of new IVIS, with improved usability. STATEMENT OF RELEVANCE: This paper examines the use of empirical methods for distinguishing between direct and indirect IVIS input devices and identifying usability issues. Results have shown that the characteristics of indirect input devices produce more serious usability issues, compared with direct devices and can have a negative effect on the driver-vehicle interaction.

Ergonomic evaluation of ten single-channel pipettes.

PubMed

Lichty, Monica G; Janowitz, Ira L; Rempel, David M

2011-01-01

Repetitive pipetting is a task that is associated with work-related musculoskeletal disorders of the hand and arm. The purpose of this study was to evaluate the usability and ergonomic performance of commercially available pipettes as determined by user ratings and objective measurements. Participants were laboratory technicians and scientists at the Lawrence Berkeley National Laboratory with experience performing pipetting tasks. Twenty-one experienced pipette users completed a standardized pipetting task with 5 manual and 5 electronic pipettes. After using each pipette, the user rated it for attributes of comfort and usability. Although no single pipette was rated significantly better than all of the others for every attribute tested, some significant differences were found between pipettes. The Rainin Pipet-Lite received the highest overall quality score among manual pipettes, while the Thermo Scientific Finnpipette Novus was the top-ranked electronic pipette. Features correlated with greater hand and arm comfort were lower tip ejection force, lower blowout force, and pipette balance in the hand. The findings, when considered with participant comments, provide insights into desirable pipette features and emphasize the value of user testing and the importance of the interactions between task, workplace layout, and pipette design. © 2011 - IOS Press and the authors. All rights reserved

A knitted garment using intarsia technique for Heart Rate Variability biofeedback: Evaluation of initial prototype.

PubMed

Abtahi, F; Ji, G; Lu, K; Rödby, K; Seoane, F

2015-01-01

Heart rate variability (HRV) biofeedback is a method based on paced breathing at specific rate called resonance frequency by giving online feedbacks from user respiration and its effect on HRV. Since the HRV is also influence by different factors like stress and emotions, stress related to an unfamiliar measurement device, cables and skin electrodes may cover the underling effect of such kind of intervention. Wearable systems are usually considered as intuitive solutions which are more familiar to the end-user and can help to improve usability and hence reducing the stress. In this work, a prototype of a knitted garment using intarsia technique is developed and evaluated. Results show the satisfactory level of quality for Electrocardiogram and thoracic electrical bioimpedance i.e. for respiration monitoring as a part of HRV biofeedback system. Using intarsia technique and conductive yarn for making the connection instead of cables will reduce the complexity of fabrication in textile production and hence reduce the final costs in a final commercial product. Further development of garment and Android application is ongoing and usability and efficiency of final prototype will be evaluated in detail.

Retrospectively exploring the importance of items in the decision to leave the emergency medical services (EMS) profession and their relationships to life satisfaction after leaving EMS and likelihood of returning to EMS.

PubMed

Blau, Gary; Chapman, Susan

2011-01-01

An exit survey was returned by a sample of 127 respondents in fully compensated positions who left the EMS profession, most within 12 months prior to filling out the exit survey. A very high percentage continued to work after leaving EMS. Respondents were asked to rate the importance of each of 17 items in affecting their decision to leave EMS. A higher than anticipated response to a "not applicable" response choice affected the usability of 8 of these items. Nine of the 17 items had at least 65 useable responses and were used for further analysis. Within these 9, stress/burnout and lack of job challenges had the highest importance in affecting the decision to leave EMS, while desire for better pay and benefits had the lowest importance. Desire for career change was positively related to life satisfaction after leaving EMS and negatively related to likelihood of returning to EMS. Stress/burnout was positively related to life satisfaction after leaving EMS. Study limitations and future research issues are briefly discussed.

Evaluation of the Digital Alzheimer Center: Testing Usability and Usefulness of an Online Portal for Patients with Dementia and Their Carers.

PubMed

Hattink, Bart; Droes, Rose-Marie; Sikkes, Sietske; Oostra, Ellen; Lemstra, Afina W

2016-07-21

Dementia is a progressive and highly disabling neurodegenerative disease that will likely become highly prevalent in the future due to the globally aging population. To improve health care efficiency and quality for dementia care, eHealth could help with, for example, an online portal, such as the Digital Alzheimer Center (DAC) of the Vrije Universiteit Medical Center Amsterdam. It provides up-to-date disease information, peer-to-peer contact, and methods for contacting the hospital and health professionals. We aimed to investigate the usability and usefulness of the DAC for patients with dementia and carers to get insight into the feasibility and value of this eHealth app in dementia care and to recommend potential improvements. A descriptive study among patients, carers, and health care professionals was performed. Mixed methods were used, consisting of observations (n=10, 4 people with dementia, 6 carers), an online survey (n=287; 88 patients, 199 carers), and semistructured interviews (n=18; 6 patients, 6 carers, 6 health care professionals). During the observations, participants performed a set of five different prescribed tasks on the portal. Speed, number of errors, and navigation were noted. The online survey aimed to assess users' opinions on the portal's usability and usefulness. Semistructured interviews were conducted in a subsample of patients, carers, and health care professionals to gain more in-depth information. In the usability assessment, eight categories of errors were distinguished, of which three were of critical, two of medium, and three of low severity. In the survey, 45% (40/88) of the patients and 53% (105/199) of the carers indicated they used the portal. In all, 33% (12/36) of patients and 61% (62/102) of carers found it easy to learn to work with the portal. Most considered the DAC generally useful: 65% (17/26) of patients and 78% (67/86) of carers found the DAC useful, especially for understanding dementia (patients: 64%, 16/25; carers: 62%, 53/86). In the semistructured interviews, the site was generally rated positively on usability and usefulness and being well designed. People with dementia and carers indicated it helped them to understand and deal with dementia. To our knowledge, this is the first study investigating the usability and usefulness of an Internet portal especially designed for people with dementia and their carers. An online patient portal could be a useful means to help to support patients and carers in dealing with dementia: the majority of users positively evaluated usability and usefulness of the portal, and appreciated the information on it. However, only a minority of patients found it easy to work with the portal. Good design and frequent usability testing is essential to offer a good online portal.

Medical and Nonmedical Users of Prescription Drugs among College Students

ERIC Educational Resources Information Center

Rozenbroek, Katelyn; Rothstein, William G.

2011-01-01

Objectives: To examine medical and nonmedical users of prescription opioids, central nervous system depressants, and stimulants taken individually and in combination. Participants: Undergraduates at an urban mid-Atlantic university with 12,000 students. Methods: A questionnaire administered in classes provided 413 responses, with a usable response…

Significant modulation of mitochondrial electron transport system by nicotine in various rat brain regions

USDA-ARS?s Scientific Manuscript database

The mitochondrion is the organelle responsible for generation of most usable energy in a cell. It also plays an important role in a series of physiological processes such as apoptosis and proliferation. Although previous studies have demonstrated that nicotine modulates the morphology and function ...

European Management Learning: A Cross-Cultural Interpretation of Kolb's Learning Cycle.

ERIC Educational Resources Information Center

Jackson, Terence

1995-01-01

A survey of a French business school with multinational branch campuses received 123 usable responses supporting the proposition that cross-cultural differences exist within each of Kolb's learning cycle stages. National profiles of learning preferences were developed for French, German, Spanish, Anglo-Irish, and Eastern European learners. (SK)

TV and Extension in Carbon County, Pa.

ERIC Educational Resources Information Center

Reitz, Ray W.

To help improve televised extension education, a study was made of the interests and characteristics of the potential audience (9,300) of PTVC, a community antenna television system in Carbon County, Pennsylvania. A checklist questionnaire survey drew 160 usable responses from the communities of Jim Thorpe, Lehighton, and Palmerton. Data on…

Reducing School Violence in Florida. Hot Topics: Usable Research.

ERIC Educational Resources Information Center

Kadel, Stephanie; Follman, Joseph

Violence pervades schools across the nation, disrupting school functioning and preventing students and teachers from learning and teaching. The most effective crisis management and response strategies are designed by a school team that includes administrators, faculty and staff, students, parents, bus drivers and other support staff, as well as…

Validity and Usability of a Safe Driving Behavior Measure for Older Adults : [Summary

DOT National Transportation Integrated Search

2012-01-01

Florida leads the U.S. in number of people over : 65, now 18%, rising to 27% by 2030. Also likely to : rise are crashes involving over-65 drivers. Most : older adults modify their driving behaviors in : response to age-related changes; however, at-ri...

36 CFR 1193.31 - Accessibility and usability.

Code of Federal Regulations, 2011 CFR

2011-07-01

... 36 Parks, Forests, and Public Property 3 2011-07-01 2011-07-01 false Accessibility and usability... COMPLIANCE BOARD TELECOMMUNICATIONS ACT ACCESSIBILITY GUIDELINES Requirements for Accessibility and Usability § 1193.31 Accessibility and usability. When required by § 1193.21, telecommunications equipment and...

36 CFR 1193.31 - Accessibility and usability.

Code of Federal Regulations, 2010 CFR

2010-07-01

... 36 Parks, Forests, and Public Property 3 2010-07-01 2010-07-01 false Accessibility and usability... COMPLIANCE BOARD TELECOMMUNICATIONS ACT ACCESSIBILITY GUIDELINES Requirements for Accessibility and Usability § 1193.31 Accessibility and usability. When required by § 1193.21, telecommunications equipment and...

36 CFR 1193.31 - Accessibility and usability.

Code of Federal Regulations, 2014 CFR

2014-07-01

... 36 Parks, Forests, and Public Property 3 2014-07-01 2014-07-01 false Accessibility and usability... COMPLIANCE BOARD TELECOMMUNICATIONS ACT ACCESSIBILITY GUIDELINES Requirements for Accessibility and Usability § 1193.31 Accessibility and usability. When required by § 1193.21, telecommunications equipment and...

36 CFR 1193.31 - Accessibility and usability.

Code of Federal Regulations, 2012 CFR

2012-07-01

... 36 Parks, Forests, and Public Property 3 2012-07-01 2012-07-01 false Accessibility and usability... COMPLIANCE BOARD TELECOMMUNICATIONS ACT ACCESSIBILITY GUIDELINES Requirements for Accessibility and Usability § 1193.31 Accessibility and usability. When required by § 1193.21, telecommunications equipment and...

LiveDescribe: Can Amateur Describers Create High-Quality Audio Description?

ERIC Educational Resources Information Center

Branje, Carmen J.; Fels, Deborah I.

2012-01-01

Introduction: The study presented here evaluated the usability of the audio description software LiveDescribe and explored the acceptance rates of audio description created by amateur describers who used LiveDescribe to facilitate the creation of their descriptions. Methods: Twelve amateur describers with little or no previous experience with…

The effects of policy implementation uncertainty on groundwater extraction

USDA-ARS?s Scientific Manuscript database

Concerns about the high rate of depletion of the Ogallala Aquifer in the Southern High Plains of Texas (Texas High Plains) in recent years have led to the enactment of policies designed to slow down water extraction and increase the usable life of the aquifer. However, policy implementation has not ...

Software, Copyright, and Site-License Agreements: Publishers' Perspective of Library Practice.

ERIC Educational Resources Information Center

Happer, Stephanie K.

Thirty-one academic publishers of stand-alone software and book/disk packages were surveyed to determine whether publishers have addressed the copyright issues inherent in circulating these packages within the library environment. Twenty-two questionnaires were returned, providing a 71% return rate. There were 18 usable questionnaires. Publishers…

Marketing through Usability.

ERIC Educational Resources Information Center

Morgan, Eric Lease

1999-01-01

Suggests that one of the best ways to get word-of-mouth marketing of library technology is to provide "usable" products and services. Provides an international standards definition on usability and notes that understanding usability combines an understanding of user needs/wants with an understanding of goals, functions, and limitations…

The effect of sampling rate and anti-aliasing filters on high-frequency response spectra

USGS Publications Warehouse

Boore, David M.; Goulet, Christine

2013-01-01

The most commonly used intensity measure in ground-motion prediction equations is the pseudo-absolute response spectral acceleration (PSA), for response periods from 0.01 to 10 s (or frequencies from 0.1 to 100 Hz). PSAs are often derived from recorded ground motions, and these motions are usually filtered to remove high and low frequencies before the PSAs are computed. In this article we are only concerned with the removal of high frequencies. In modern digital recordings, this filtering corresponds at least to an anti-aliasing filter applied before conversion to digital values. Additional high-cut filtering is sometimes applied both to digital and to analog records to reduce high-frequency noise. Potential errors on the short-period (high-frequency) response spectral values are expected if the true ground motion has significant energy at frequencies above that of the anti-aliasing filter. This is especially important for areas where the instrumental sample rate and the associated anti-aliasing filter corner frequency (above which significant energy in the time series is removed) are low relative to the frequencies contained in the true ground motions. A ground-motion simulation study was conducted to investigate these effects and to develop guidance for defining the usable bandwidth for high-frequency PSA. The primary conclusion is that if the ratio of the maximum Fourier acceleration spectrum (FAS) to the FAS at a frequency fsaa corresponding to the start of the anti-aliasing filter is more than about 10, then PSA for frequencies above fsaa should be little affected by the recording process, because the ground-motion frequencies that control the response spectra will be less than fsaa . A second topic of this article concerns the resampling of the digital acceleration time series to a higher sample rate often used in the computation of short-period PSA. We confirm previous findings that sinc-function interpolation is preferred to the standard practice of using linear time interpolation for the resamplin

Defining Usability: How Library Practice Differs from Published Research

ERIC Educational Resources Information Center

Chen, Yu-Hui; Germain, Carol Anne; Rorissa, Abebe

2011-01-01

Library/information science professionals need a clearly articulated definition of usability/Web usability to implement intuitive websites. In this study, the authors analyzed usability definitions provided by the ARL library professionals and those found in the library/information science and computer science-information systems literature.…

48 CFR 552.270-20 - Payment.

Code of Federal Regulations, 2010 CFR

2010-10-01

..., usable square footage delivered will be confirmed by either: (1) The Government's measurement of plans... of usable square footage stated in the lease. (c) If the amount of usable square footage delivered is... space delivered and the annual rental will be adjusted as follows: Usable square feet (USF) not...

The value of Retrospective and Concurrent Think Aloud in formative usability testing of a physician data query tool.

PubMed

Peute, Linda W P; de Keizer, Nicolette F; Jaspers, Monique W M

2015-06-01

To compare the performance of the Concurrent (CTA) and Retrospective (RTA) Think Aloud method and to assess their value in a formative usability evaluation of an Intensive Care Registry-physician data query tool designed to support ICU quality improvement processes. Sixteen representative intensive care physicians participated in the usability evaluation study. Subjects were allocated to either the CTA or RTA method by a matched randomized design. Each subject performed six usability-testing tasks of varying complexity in the query tool in a real-working context. Methods were compared with regard to number and type of problems detected. Verbal protocols of CTA and RTA were analyzed in depth to assess differences in verbal output. Standardized measures were applied to assess thoroughness in usability problem detection weighted per problem severity level and method overall effectiveness in detecting usability problems with regard to the time subjects spent per method. The usability evaluation of the data query tool revealed a total of 43 unique usability problems that the intensive care physicians encountered. CTA detected unique usability problems with regard to graphics/symbols, navigation issues, error messages, and the organization of information on the query tool's screens. RTA detected unique issues concerning system match with subjects' language and applied terminology. The in-depth verbal protocol analysis of CTA provided information on intensive care physicians' query design strategies. Overall, CTA performed significantly better than RTA in detecting usability problems. CTA usability problem detection effectiveness was 0.80 vs. 0.62 (p<0.05) respectively, with an average difference of 42% less time spent per subject compared to RTA. In addition, CTA was more thorough in detecting usability problems of a moderate (0.85 vs. 0.7) and severe nature (0.71 vs. 0.57). In this study, the CTA is more effective in usability-problem detection and provided clarification of intensive care physician query design strategies to inform redesign of the query tool. However, CTA does not outperform RTA. The RTA additionally elucidated unique usability problems and new user requirements. Based on the results of this study, we recommend the use of CTA in formative usability evaluation studies of health information technology. However, we recommend further research on the application of RTA in usability studies with regard to user expertise and experience when focusing on user profile customized (re)design. Copyright © 2015 Elsevier Inc. All rights reserved.

Concepts of Interface Usability and the Enhancement of Design through Eye Tracking and Psychophysiology

DTIC Science & Technology

2008-09-01

attention. Heart rate (HR) and heart rate variability ( HRV ) are biometrics that can be used to identify periods of high mental effort and high stress...HR is known to increase when a person is exposed to mental stressors; HRV will decrease in the same situation. HRV is a much more sensitive measure...mistakes, the display is cluttered, meaningfulness. Measuring specific attitudes Annoyance, anxiety , complexity control, engagement, flexibility, fun

Rehabilitation professionals' satisfaction with continuing education delivered at a distance using different technologies.

PubMed

Liu, Lili; Cook, Albert; Varnhagen, Stanley; Miyazaki, Masako

2004-01-01

This paper examines learner satisfaction with technologies used for distance delivery of continuing education across 10 Canadian sites: nine within the province of Alberta and one in Nunavut Territory. The technologies were satellite (or videotapes of) broadcasts, videoconferencing, and web-based technology. Learner satisfaction was evaluated using questionnaires. A survey on general issues related to continuing education was developed and mailed to random samples of health professionals and a convenience sample of stakeholders. The learners (n = 1,141) represented 20 types of health service providers who had attended at least one session delivered via satellite, videotape, or videoconferencing. Seven individuals completed the web-based course. Overall, the majority of participants were satisfied or very satisfied. In general, satellite delivery was received more favorably compared with videotapes of the same content. A total of 350 (33% response rate) health professionals and 37 (50% response rate) stakeholders returned the surveys. Nearly 50% of health professionals thought that clinical case presentations (rounds) were valuable to them, but over half of the stakeholders perceived that videotapes, rounds, and research seminars were valuable to health professionals. Ratings for the web-based course varied, indicating different learner characteristics. We conclude that it is possible to utilize multiple technologies to meet the continuing education needs of an interdisciplinary group of health service providers, but future research is needed to develop a framework for evaluating the usability of multiple existing and emerging technologies for distance education.

Advancing Usability Evaluation through Human Reliability Analysis

DOE Office of Scientific and Technical Information (OSTI.GOV)

Ronald L. Boring; David I. Gertman

2005-07-01

This paper introduces a novel augmentation to the current heuristic usability evaluation methodology. The SPAR-H human reliability analysis method was developed for categorizing human performance in nuclear power plants. Despite the specialized use of SPAR-H for safety critical scenarios, the method also holds promise for use in commercial off-the-shelf software usability evaluations. The SPAR-H method shares task analysis underpinnings with human-computer interaction, and it can be easily adapted to incorporate usability heuristics as performance shaping factors. By assigning probabilistic modifiers to heuristics, it is possible to arrive at the usability error probability (UEP). This UEP is not a literal probabilitymore » of error but nonetheless provides a quantitative basis to heuristic evaluation. When combined with a consequence matrix for usability errors, this method affords ready prioritization of usability issues.« less

Promoting Usability in Organizations with a New Health Usability Model: Implications for Nursing Informatics

PubMed Central

Staggers, Nancy; Rodney, Melanie

2012-01-01

Usability issues with products such as Electronic Health Records (EHRs) are of global interest to nursing informaticists. Although improvements in patient safety, clinical productivity and effectiveness are possible when usability principles and practices are in place, most organizations do not embrace usability. This paper presents a new Health Usability Maturity Model consisting of 5 phases: unrecognized, preliminary, implemented, integrated and strategic. Within each level various aspects are discussed including focus on users, management, education, resources, processes and infrastructure. Nurse informaticists may use this new model as a guide for assessing their organization’s level of usability and transitioning to the next level. Using tactics outlined here, nurse informaticists may also serve as catalysts for change and lead efforts to improve the user experience in organizations across industry, academe and healthcare settings. PMID:24199128

Benefits and work-schedule options in hospital pharmacy practice.

PubMed

Gaither, C A; Mason, N A; Diokno, D A; Hoffman, E J

1994-03-15

Hospital pharmacy directors were surveyed to determine whether their departments offered specific family-related benefits and work-schedule options and how their attitudes about these options compared with those of female hospital pharmacists. Questionnaires were mailed to 300 randomly selected hospital pharmacy directors to collect the following information: vacancy rates and male:female ratios in hospital pharmacy positions, which of 13 selected benefits and work-schedule options were offered, barriers that prevented the other options from being offered, and attitudes about the listed options. The options included in the survey were selected because they represent ways of balancing home and work (e.g., maternity leave, job sharing, day care). The pharmacy directors' responses were compared with those from a similar survey of female hospital pharmacists. The usable response rate was 50.3%. Position vacancy rates ranged from 5.5% for directors to 35.8% for clinical supervisors. All full-time positions had an even distribution of men and women except for director and assistant or associate director positions. Of 13 options, only maternity leave, part-time schedules, and flexible schedules were offered by more than half of the hospitals. These three were also the only listed options that the respondents considered important in recruiting and retaining pharmacists. Barriers to offering other options included the perception that current benefits and work-schedule options were adequate, lack of staff coverage, lack of funds, and the perception that some positions are not compatible with alternative schedules. Respondents' ratings of the importance of the listed benefits and work-schedule options were significantly lower than ratings given by female hospital pharmacists in a separate survey.(ABSTRACT TRUNCATED AT 250 WORDS)

Systematic Review Protocol to Assess the Effectiveness of Usability Questionnaires in mHealth App Studies

PubMed Central

Bao, Jie; Parmanto, Bambang

2017-01-01

Background Usability questionnaires have a wide use in mobile health (mHealth) app usability studies. However, no systematic review has been conducted for assessing the effectiveness of these questionnaires. Objective This paper describes a protocol for conducting a systematic review of published questionnaire-based mHealth app usability studies. Methods In this systematic review, we will select recently published (2008-2017) articles from peer-reviewed journals and conferences that describe mHealth app usability studies and implement at least one usability questionnaire. The search strategy will include terms such as “mobile app” and “usability.” Multiple databases such as PubMed, CINAHL, IEEE Xplore, ACM Digital Library, and INSPEC will be searched. There will be 2 independent reviewers in charge of screening titles and abstracts as well as determining those articles that should be included for a full-text review. The third reviewer will act as a mediator between the other 2 reviewers. Moreover, a data extraction form will be created and used during the full article data analysis. Notably, the Preferred Reporting Items for Systematic Review and Meta-Analysis Protocols (PRISMA-P) guidelines will be followed in reporting this protocol. Results A preliminary search produced 1271 articles, 40 of which are duplicate records. The inclusion-exclusion criteria are being strictly followed in performing the ongoing study selection. Conclusions Usability questionnaires are an important tool in mHealth app usability studies. This review will summarize the usability questionnaires used in published research articles while assessing the efficacy of these questionnaires in determining the usability of mHealth apps. PMID:28765101

Usability evaluation of the interactive Personal Patient Profile-Prostate decision support system with African American men.

PubMed

Jaja, Cheedy; Pares-Avila, Jose; Wolpin, Seth; Berry, Donna

2010-04-01

The Personal Patient Profile-Prostate (P4) program is an interactive Web-based decision support system that provides men with localized prostate cancer customized education and coaching with which to make the best personal treatment decision. This study assessed functionality and usability of the P4 program and identified problems in user-computer interaction in a sample of African American men. Usability testing was conducted with 12 community-dwelling African American adult men. The health status of participants was not known or collected by the research team. Each participant worked with the P4 program and provided simultaneous feedback using the "think aloud" technique. Handwritten field notes were collated and assigned to 3 standard coded categories. Aspects of P4 program usability was made based on common issues in the assigned categories. Summary statistics were derived for types and frequency of usability issues noted in the coded data. Twelve participants reported a total of 122 usability comments, with a mean of 9 usability comments. The most common usability issue by participant was completeness of information content, which comprised 53 (43%) of the total issues. Comprehensibility of text and graphics was second, comprising 51 (42%) of the total issues. This study provided initial inventory of usability issues for community African American men that may potentially interfere with application of the P4 system in the community setting and overall system usability, confirming the need for usability testing of a culturally appropriate Internet-based decision support system before community application.

76 FR 8715 - Proposed Collection; Comment Request

Federal Register 2010, 2011, 2012, 2013, 2014

2011-02-15

.... Title; Associated Form; and OMB Number: Electronic Health Record (EHR) Usability Survey; OMB Control... longitudinal measure of how end-users perceive the usability of the Department of Defense (DoD) suite of... usability of a system. This usability attribute describes the ease with which people can use the system to...

77 FR 25707 - Submission for OMB Review; Comment request

Federal Register 2010, 2011, 2012, 2013, 2014

2012-05-01

... and OMB Number: Electronic Health Record (EHR) Usability Survey; OMB Control Number 0720-TBD. Type of... information collection is to develop a longitudinal measure of how end-users perceive the usability of the... the focus has shifted towards understanding the usability of a system. This usability attribute...

36 CFR § 1193.31 - Accessibility and usability.

Code of Federal Regulations, 2013 CFR

2013-07-01

... 36 Parks, Forests, and Public Property 3 2013-07-01 2012-07-01 true Accessibility and usability. § 1193.31 Section § 1193.31 Parks, Forests, and Public Property ARCHITECTURAL AND TRANSPORTATION... and Usability § 1193.31 Accessibility and usability. When required by § 1193.21, telecommunications...

‘Much clearer with pictures’: using community-based participatory research to design and test a Picture Option Grid for underserved patients with breast cancer

PubMed Central

Durand, Marie-Anne; Alam, Shama; Grande, Stuart W; Elwyn, Glyn

2016-01-01

Objective Women of low socioeconomic status (SES) diagnosed with early stage breast cancer experience decision-making, treatment and outcome disparities. Evidence suggests that decision aids can benefit underserved patients, when tailored to their needs. Our aim was to develop and test the usability, acceptability and accessibility of a pictorial encounter decision aid targeted at women of low SES diagnosed with early stage breast cancer. Design Community-based participatory research (CBPR) using think-aloud protocols (phases 1 and 2) and semistructured interviews (phase 3). Setting Underserved community settings (eg, knitting groups, bingo halls, senior centres) and breast clinics. Participants In phase 1, we recruited a convenience sample of clinicians and academics. In phase 2, we targeted women over 40 years of age, of low SES, regardless of breast cancer history, and in phase 3, women of low SES, recently diagnosed with breast cancer. Intervention The pictorial encounter decision aid was derived from an evidence-based table comparing treatment options for breast cancer (http://www.optiongrid.org). Outcome measures We assessed the usability, acceptability and accessibility of the pictorial decision aid prototypes using the think-aloud protocol and semistructured interviews. Results After initial testing of the first prototype with 18 academics and health professionals, new versions were developed and tested with 53 lay individuals in community settings. Usability was high. In response to feedback indicating that the use of cartoon characters was considered insensitive, a picture-only version was developed and tested with 23 lay people in phase 2, and 10 target users in phase 3. Conclusions and relevance Using CBPR methods and iterative user testing cycles improved usability and accessibility, and led to the development of the Picture Option Grid, entirely guided by multiple stakeholder feedback. All women of low SES recently diagnosed with early stage breast cancer found the Picture Option Grid usable, acceptable and accessible. PMID:26839014

User value and usability of a web-based mindfulness intervention for families living with mental health problems.

PubMed

Stjernswärd, Sigrid; Hansson, Lars

2017-03-01

Mental health problems affect the patients and their families, who may also need therapeutic interventions. Mindfulness interventions have shown beneficial health effects for clinical and healthy populations. A web-based mindfulness intervention was tailored to address families' needs of support and tested in a pilot intervention study. The aim of this study was to explore the participants' experiences of using an 8-week web-based mindfulness programme in terms of user value and usability. Qualitative semi-structured interviews were carried out over the phone (Spring 2015, Sweden) with 15 randomly selected participants after the 3-month follow-up as part of the pilot study. Data were also collected through usability surveys online post intervention and at the 3-month follow-up. Qualitative data were analysed with content analysis and quantitative data with descriptive statistics. The analysis of the interviews resulted in four categories describing the participants' experiences of the programme's usability and value: A valuable and flexible tool that requires time and discipline, New perspective and coping strategies for an enhanced well-being, I'm important too - my limits, my responsibility, and Taming the inner critic. The programme's usability was satisfactory and largely corroborated by the surveys. The programme was experienced as a valuable tool to cope with stress in both private and professional contexts, making it a viable option to support families living with mental health problems. Time for self-care, a widened perspective, a less judgmental and more accepting attitude, deterring automatic reactions and setting limits helped the participants to deal with their situation and health. The programme's ease and flexibility of use were major advantages, although the training requires discipline. Motivators and barriers to use were illuminated, which should be considered in the development of further online services and study designs. © 2016 John Wiley & Sons Ltd.

Dry-powder inhalers in patients with persistent airflow limitation: usability and preference.

PubMed

Dal Negro, Roberto W; Povero, Massimiliano

2016-01-01

Inhalation devices represent per sé critical factors because they can affect the therapeutic outcomes independently of the drug used. The role of patients' usability and preference (PUP) for Dry Powder Inhalers (DPIs) is high indeed because they can influence the extent of the adherence to treatment and the therapeutic outcomes. Aim of the study was to assess and compare the PUP of three different DPIs in out-patients with persistent airflow limitation due to asthma or COPD. The PUP of three different DPIs (Breezhaler; Genuair; Handihaler) were investigated by means of the Handling Questionnaire in out-patients with persistent airflow limitation needing an inhalation therapy. Patients had to report their preference before and after the nurse's instruction on the handling of each device. The nurse had also to note the critical steps during the patient's procedure for actuation; to count the number of attempts needed for actuating the device properly, and to measure the time (in sec.) required for these procedures. Data were collected up to three attempts per device. Welch test was used for normal distributed variables, while the Wilcoxon test for not normal distributed variables. The χ (2) test and the ANOVA test were also used. Univariate and multivariate regressions were also performed in order to investigate the effect of patients' characteristics and of technical differences of each device on their proper use. Three hundred thirty-three consecutive out-patients (age range 55-58 years, and well matched for gender), with persistent airway limitation of different severity were investigated, suffering from bronchial asthma (n = 175) or from chronic obstructive pulmonary disease (COPD) (n = 158). In particular, 127 patients (38 %) tested the three DPIs, while 110 (33 %) tested Breezhaler and Genuair, and 96 (29 %) Breezhaler and Handihaler. More than 50 % of patients who tested all devices preferred the Genuair and perceived this device as the easiest to use. The nurse's judgement confirmed their opinion. When compared to the other two DPIs, Genuair proved the least problematic either according to the patients' judgement and to the nurse's opinion. Mean number of attempts aimed to achieving the first proper actuation was lower with Genuair than with Breezhaler and Handihaler (1.5 vs 2.5-2.6, p < 0.0001). Finally, Genuair also proved the easiest to use and the least problematic according to the nurse judgement (0.0001), the most easily learned (0.0001), and that one with a successful rate of more than 56 % at the first attempt. Breezhaler and Handihaler needed an average of about one additional attempt to be used properly (p < 0.0001), and their usability proved significantly more difficult (OR of successful rate between 0.15 and 0.17, p < 0.001). In general, older patients needed more attempts to perform their first proper inhalation; their successful rate was lower, and they needed more time to learn how to use devices properly: with Genuair these differences were minimized. The possibility of grading objectively the performance of different DPIs in terms of their usability and therapeutic convenience in daily life represents a crucial operational opportunity to pursue. To note that a substantial discrepancy exists between the patients' belief "at glance" and the patients' effective usability with can be registered with some devices. From a general point of view, devices requiring less manual actions for their actuation confirmed their better usability and proper handling after less attempts. In particular, Genuair came out as the most preferred DPI also when several different aspects of preference and usability are assessed objectively and compared.

Society of Pediatric Psychology Workforce Survey: Factors Related to Compensation of Pediatric Psychologists.

PubMed

Brosig, Cheryl L; Hilliard, Marisa E; Williams, Andre; Armstrong, F Daniel; Christidis, Peggy; Kichler, Jessica; Pendley, Jennifer Shroff; Stamm, Karen E; Wysocki, Tim

2017-05-01

To summarize compensation results from the 2015 Society of Pediatric Psychology (SPP) Workforce Survey and identify factors related to compensation of pediatric psychologists. All full members of SPP ( n  = 1,314) received the online Workforce Survey; 404 (32%) were returned with usable data. The survey assessed salary, benefits, and other income sources. The relationship between demographic and employment-related factors and overall compensation was explored.   Academic rank, level of administrative responsibility, and cost of living index of employment location were associated with compensation. Compensation did not vary by gender; however, women were disproportionately represented at the assistant and associate professor level. Compensation of pediatric psychologists is related to multiple factors. Longitudinal administration of the Workforce Survey is needed to determine changes in compensation and career advancement for this profession over time. Strategies to increase the response rate of future Workforce Surveys are discussed. © The Author 2017. Published by Oxford University Press on behalf of the Society of Pediatric Psychology. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com

Prevention and treatment of hand oedema after stroke.

PubMed

Kuppens, Stefanie P M; Pijlman, Hanneke C P; Hitters, Minou W M G C; van Heugten, Caroline M

2014-01-01

As there is no evidence for a specific treatment for post-stroke-induced hand oedema, rehabilitation centre Blixembosch formalized a best practice protocol. We investigated whether the Blixembosch hand oedema protocol is usable in daily practice and leads to lower incidence (prevention) and shorter duration (treatment) compared with care as usual. In a non-randomised comparative trial, we investigated 206 post-stroke patients admitted to two Dutch rehabilitation centres. Hand volumes were measured at least bi-weekly using a volumeter. Treatment was started according the protocol (Blixembosch) or following care as usual (Leijpark). Usability was assessed with a survey among professionals. In the Blixembosch group, 16% developed oedema after admission, compared with 21% in the control group (p = 0.019). Average duration of oedema (both developed before and after admission) was 6.5 weeks in the Blixembosch group compared with 3.1 weeks in the control group (p = 0.000). Professionals were positive about the protocol. The study showed that the protocol is usable in daily practice and has a small beneficial effect on hand oedema incidence rates compared with care as usual. The negative effect on duration of hand oedema could also be caused by the difference in prognosis between the two groups.

A multimedia psychosocial support program for couples receiving infertility treatment: a feasibility study.

PubMed

Cousineau, Tara M; Lord, Sarah E; Seibring, Angel R; Corsini, Evelyn A; Viders, Jessie C; Lakhani, Shaheen R

2004-03-01

To develop and test the feasibility of a theory-driven, psychosocial support CD-ROM prototype for couples in infertility treatment. Focus group meetings with reproductive health experts, semistructured interviews with infertility patients, and content analysis of an infertility message board to determine content domains of the CD-ROM. Usability and acceptance testing of prototype CD-ROM based on predetermined feasibility criteria. Private offices and fertility centers. Expert panel of 5 reproductive health specialists; interviews with 62 individuals with infertility (35 women, 27 men); feasibility study with 12 patients and 12 experts in reproductive medicine and infertility support. None. Product usability/acceptance test. Participant feedback and content analysis informed the development of a prototype patient education CD-ROM that uses audio, video, interactive tasks, and personalized feedback. Over 80% of participants successfully completed usability tasks, and over 90% rated prototype satisfaction as "good" to "excellent." Some areas were noted for improvement in navigation and refinement in delivery of instructions. Results strongly indicate an interest in an infertility multimedia support tool. Multimedia methods may serve as an effective, innovative psychosocial intervention for infertility patients and overcome barriers of limited local access to educational and support services.

Multimedia software to help caregivers cope.

PubMed

Chambers, Mary G; Connor, Samantha L; McGonigle, Mary; Diver, Mike G

2003-01-01

This report describes the design and evaluation of a software application to help carers cope when faced with caring problems and emergencies. The design process involved users at each stage to ensure the content of the software application was appropriate, and the research team carefully considered the requirements of disabled and elderly users. Focus group discussions and individual interviews were conducted in five European countries to ascertain the needs of caregivers in this area. The findings were used to design a three-part multimedia software application to help family caregivers prepare to cope with sudden, unexpected, and difficult situations that may arise during their time as a caregiver. This prototype then was evaluated via user trials and usability questionnaires to consider the usability and acceptance of the application and any changes that may be required. User acceptance of the software application was high, and the key features of usability such as content, appearance, and navigation were highly rated. In general, comments were positive and enthusiastic regarding the content of the software application and relevance to the caring situation. The software application has the potential to offer information and support to those who are caring for the elderly and disabled at home and to help them prepare for a crisis.

Usability of digital media in patients with COPD: a pilot study.

PubMed

Cheung, Amy; Janssen, Anton; Amft, Oliver; Wouters, Emiel F M; Spruit, Martijn A

2013-04-01

Digital media can be integrated in tele-monitoring solutions, serving as the main interface between the patient and the caregiver. Consequently, the selection of the most appropriate digital medium for the specified target group is critical to ensure compliance with the tele-monitoring system. This pilot study aims to gather insights from patients with chronic obstructive pulmonary disease (COPD) on the ease-of-use, efficacy, effectiveness, and satisfaction of different types of digital media. Five off-the-shelf digital media devices were tested on nine patients at CIRO+ in Horn, The Netherlands. Usability was evaluated by asking patients to use each device to answer questions related to their symptoms and health status. Subsequently, patients completed a paper-based device usability questionnaire, which assessed prior experience with digital media, device dimensions, device controllability, response speed, screen readability, ease-of-use, and overall satisfaction. After testing all the devices, patients ranked the devices according to their preference. We identified the netbook as the preferred type of device due to its good controllability, fast response time, and large screen size. The smartphone was the least favorite device as patients found the size of the screen to be too small, which made it difficult to interact with. The pilot study has provided important insights to guide the selection of the most appropriate type of digital medium for implementation in tele-monitoring solutions for patients with COPD. As the digital medium is an important interface to the patient in tele-monitoring solutions, it is essential that patients feel motivated to interact with the digital medium on a regular basis.

Usability Assessment of Secure Messaging for Clinical Document Sharing between Health Care Providers and Patients.

PubMed

Jahn, Michelle A; Porter, Brian W; Patel, Himalaya; Zillich, Alan J; Simon, Steven R; Russ, Alissa L

2018-04-01

 Web-based patient portals feature secure messaging systems that enable health care providers and patients to communicate information. However, little is known about the usability of these systems for clinical document sharing.  This article evaluates the usability of a secure messaging system for providers and patients in terms of its ability to support sharing of electronic clinical documents.  We conducted usability testing with providers and patients in a human-computer interaction laboratory at a Midwestern U.S. hospital. Providers sent a medication list document to a fictitious patient via secure messaging. Separately, patients retrieved the clinical document from a secure message and returned it to a fictitious provider. We collected use errors, task completion, task time, and satisfaction.  Twenty-nine individuals participated: 19 providers (6 physicians, 6 registered nurses, and 7 pharmacists) and 10 patients. Among providers, 11 (58%) attached and sent the clinical document via secure messaging without requiring assistance, in a median (range) of 4.5 (1.8-12.7) minutes. No patients completed tasks without moderator assistance. Patients accessed the secure messaging system within 3.6 (1.2-15.0) minutes; retrieved the clinical document within 0.8 (0.5-5.7) minutes; and sent the attached clinical document in 6.3 (1.5-18.1) minutes. Although median satisfaction ratings were high, with 5.8 for providers and 6.0 for patients (scale, 0-7), we identified 36 different use errors. Physicians and pharmacists requested additional features to support care coordination via health information technology, while nurses requested features to support efficiency for their tasks.  This study examined the usability of clinical document sharing, a key feature of many secure messaging systems. Our results highlight similarities and differences between provider and patient end-user groups, which can inform secure messaging design to improve learnability and efficiency. The observations suggest recommendations for improving the technical aspects of secure messaging for clinical document sharing. Schattauer GmbH Stuttgart.

Validating a Web-based Diabetes Education Program in continuing nursing education: knowledge and competency change and user perceptions on usability and quality

PubMed Central

2014-01-01

Background Nurses as the members of health care professionals need to improve their knowledge and competencies particularly in diabetes mellitus through continuing nursing education programs. E-learning is an indirect method of training that can meet nurses’ educational needs. This study is aimed at validating a web-based diabetes education program through measurement of nurses’ knowledge and clinical competency in diabetes and nurses’ perception about its usability and quality. Methods This Quasi-experimental research was conducted on a single group of 31 nurses employed in hospitals affiliated with Shiraz University of Medical Sciences. We used a 125 MCQ knowledge test and Objective Structured Clinical Exam (OSCE) to measure knowledge and clinical competency of nurses in diabetes before and after intervention. A Learning Management System (LMS) was designed to provide educational content in the form of 12 multimedia electronic modules, interactive tests; a forum and learning activities. Nurses were trained for two months in this system after which the post-test was administered. Each nurse completed two questionnaires for measurement of their perceptions on usability and quality. We used descriptive statistics for demographic and descriptive data analysis. Paired t-test was used to compare pre- and post-data using SPSS. Results The findings showed significant differences in knowledge scores (p < 0.001), total score of clinical competencies (p < 0.001), and all ten assessed clinical competencies. The range of ratings given by participants varied on the six usability variables of Web-based training (2.96-4.23 from 5) and eight quality variables of Web-based training (3.58-4.37 from 5). Conclusion Web-based education increased nurses’ knowledge and competencies in diabetes. They positively evaluated Web-based learning usability and quality. It is hoped that this course will have a positive clinical outcomes. PMID:26086025

Validating a Web-based Diabetes Education Program in continuing nursing education: knowledge and competency change and user perceptions on usability and quality.

PubMed

Moattari, Marzieh; Moosavinasab, Elham; Dabbaghmanesh, Mohammad Hossein; ZarifSanaiey, Nahid

2014-01-01

Nurses as the members of health care professionals need to improve their knowledge and competencies particularly in diabetes mellitus through continuing nursing education programs. E-learning is an indirect method of training that can meet nurses' educational needs. This study is aimed at validating a web-based diabetes education program through measurement of nurses' knowledge and clinical competency in diabetes and nurses' perception about its usability and quality. This Quasi-experimental research was conducted on a single group of 31 nurses employed in hospitals affiliated with Shiraz University of Medical Sciences. We used a 125 MCQ knowledge test and Objective Structured Clinical Exam (OSCE) to measure knowledge and clinical competency of nurses in diabetes before and after intervention. A Learning Management System (LMS) was designed to provide educational content in the form of 12 multimedia electronic modules, interactive tests; a forum and learning activities. Nurses were trained for two months in this system after which the post-test was administered. Each nurse completed two questionnaires for measurement of their perceptions on usability and quality. We used descriptive statistics for demographic and descriptive data analysis. Paired t-test was used to compare pre- and post-data using SPSS. The findings showed significant differences in knowledge scores (p < 0.001), total score of clinical competencies (p < 0.001), and all ten assessed clinical competencies. The range of ratings given by participants varied on the six usability variables of Web-based training (2.96-4.23 from 5) and eight quality variables of Web-based training (3.58-4.37 from 5). Web-based education increased nurses' knowledge and competencies in diabetes. They positively evaluated Web-based learning usability and quality. It is hoped that this course will have a positive clinical outcomes.

Macquarie Surgical Innovation Identification Tool (MSIIT): a study protocol for a usability and pilot test

PubMed Central

Blakely, Brette; Rogers, Wendy A; Clay-Williams, Robyn

2016-01-01

Introduction Medicine relies on innovation to continually improve. However, innovation is potentially risky, and not all innovations are successful. Therefore, it is important to identify innovations prospectively and provide support, to make innovation as safe and effective as possible. The Macquarie Surgical Innovation Identification Tool (MSIIT) is a simple checklist designed as a practical tool for hospitals to identify planned surgical innovations. This project aims to test the usability and pilot the use of the MSIIT in a surgical setting. Methods and analysis The project will run in two phases at two Australian hospitals, one public and one private. Phase I will involve interviews, focus groups and a survey of hospital administrators and surgical teams to assess the usability and system requirements for the use of the MSIIT. Current practice regarding surgical innovation within participating hospitals will be mapped, and the best implementation strategy for MSIIT completion will be established. Phase II will involve trialling the MSIIT for each surgery within the trial period by various surgical personnel. Follow-up interviews, focus groups and a survey will be conducted with trial participants to collect feedback on their experience of using the MSIIT during the trial period. Comparative data on rates of surgical innovation during the trial period will also be gathered from existing hospital systems and compared to the rates identified by the MSIIT. Ethics and dissemination Ethical approval has been obtained. The results of this study will be presented to interested health services and other stakeholders, presented at conferences and published in a peer-reviewed MEDLINE-indexed journal. PMID:27864253

Quality Measures for Hospice and Palliative Care: Piloting the PEACE Measures

PubMed Central

Rokoske, Franziska S.; Durham, Danielle; Cagle, John G.; Hanson, Laura C.

2014-01-01

Abstract Background: The Carolinas Center for Medical Excellence launched the PEACE project in 2006, under contract with the Centers for Medicare & Medicaid Services (CMS), to identify, develop, and pilot test quality measures for hospice and palliative care programs. Objectives: The project collected pilot data to test the usability and feasibility of potential quality measures and data collection processes for hospice and palliative care programs. Settings/subjects: Twenty-two hospices participating in a national Quality Improvement Collaborative (QIC) submitted data from 367 chart reviews for pain care and 45 chart reviews for nausea care. Fourteen additional hospices completed a one-time data submission of 126 chart reviews on 60 potential patient-level quality measures across eight domains of care and an organizational assessment evaluating structure and processes of care. Design: Usability was assessed by examining the range, variability and size of the populations targeted by each quality measure. Feasibility was assessed during the second pilot study by surveying data abstractors about the abstraction process and examining the rates of missing data. The impact of data collection processes was assessed by comparing results obtained using different processes. Results: Measures shown to be both usable and feasible included: screening for physical symptoms on admission and documentation of treatment preferences. Methods of data collection and measure construction appear to influence observed rates of quality of care. Conclusions: We successfully identified quality measures with potential for use in hospices and palliative care programs. Future research is needed to understand whether these measures are sensitive to quality improvement interventions. PMID:24921162

Usability: Human Research Program - Space Human Factors and Habitability

NASA Technical Reports Server (NTRS)

Sandor, Aniko; Holden, Kritina L.

2009-01-01

The Usability project addresses the need for research in the area of metrics and methodologies used in hardware and software usability testing in order to define quantifiable and verifiable usability requirements. A usability test is a human-in-the-loop evaluation where a participant works through a realistic set of representative tasks using the hardware/software under investigation. The purpose of this research is to define metrics and methodologies for measuring and verifying usability in the aerospace domain in accordance with FY09 focus on errors, consistency, and mobility/maneuverability. Usability metrics must be predictive of success with the interfaces, must be easy to obtain and/or calculate, and must meet the intent of current Human Systems Integration Requirements (HSIR). Methodologies must work within the constraints of the aerospace domain, be cost and time efficient, and be able to be applied without extensive specialized training.

A human reliability based usability evaluation method for safety-critical software

DOE Office of Scientific and Technical Information (OSTI.GOV)

Boring, R. L.; Tran, T. Q.; Gertman, D. I.

2006-07-01

Boring and Gertman (2005) introduced a novel method that augments heuristic usability evaluation methods with that of the human reliability analysis method of SPAR-H. By assigning probabilistic modifiers to individual heuristics, it is possible to arrive at the usability error probability (UEP). Although this UEP is not a literal probability of error, it nonetheless provides a quantitative basis to heuristic evaluation. This method allows one to seamlessly prioritize and identify usability issues (i.e., a higher UEP requires more immediate fixes). However, the original version of this method required the usability evaluator to assign priority weights to the final UEP, thusmore » allowing the priority of a usability issue to differ among usability evaluators. The purpose of this paper is to explore an alternative approach to standardize the priority weighting of the UEP in an effort to improve the method's reliability. (authors)« less

Usability Evaluation of a Web-Based Learning System

ERIC Educational Resources Information Center

Nguyen, Thao

2012-01-01

The paper proposes a contingent, learner-centred usability evaluation method and a prototype tool of such systems. This is a new usability evaluation method for web-based learning systems using a set of empirically-supported usability factors and can be done effectively with limited resources. During the evaluation process, the method allows for…

The Development of MSFC Usability Lab

NASA Technical Reports Server (NTRS)

Cheng, Yiwei; Richardson, Sally

2010-01-01

This conference poster reviews the development of the usability lab at Marshall Space Flight Center. The purpose of the lab was to integrate a fully functioning usability laboratory to provide a resource for future human factor assessments. and to implement preliminary usability testing on a MSFC website to validate the functionality of the lab.

Understanding Usability: Investigating an Integrated Design Environment and Management System

ERIC Educational Resources Information Center

Lee, Jason Chong; Wahid, Shahtab; McCrickard, D. Scott; Chewar, C. M.; Congleton, Ben

2007-01-01

Purpose: Decades of innovation in designing usable (and unusable) interfaces have resulted in a plethora of guidelines, usability methods, and other design tools. The purpose of this research is to develop ways for novice developers to effectively leverage and contribute to the large and growing body of usability knowledge and methods.…

Usability and Gratifications--Towards a Website Analysis Model.

ERIC Educational Resources Information Center

Bunz, Ulla K.

This paper discusses Web site usability issues. Specifically, it assumes that the usability of a Web site depends more on the perception of the user than on the objectively assessable usability criteria of the Web site. Two pilot studies, based on theoretical notions of uses and gratifications theory and similar theories, are presented. In the…

The Electronic Patient Reported Outcome Tool: Testing Usability and Feasibility of a Mobile App and Portal to Support Care for Patients With Complex Chronic Disease and Disability in Primary Care Settings

PubMed Central

Gill, Ashlinder; Khan, Anum Irfan; Hans, Parminder Kaur; Kuluski, Kerry; Cott, Cheryl

2016-01-01

Background People experiencing complex chronic disease and disability (CCDD) face some of the greatest challenges of any patient population. Primary care providers find it difficult to manage multiple discordant conditions and symptoms and often complex social challenges experienced by these patients. The electronic Patient Reported Outcome (ePRO) tool is designed to overcome some of these challenges by supporting goal-oriented primary care delivery. Using the tool, patients and providers collaboratively develop health care goals on a portal linked to a mobile device to help patients and providers track progress between visits. Objectives This study tested the usability and feasibility of adopting the ePRO tool into a single interdisciplinary primary health care practice in Toronto, Canada. The Fit between Individuals, Fask, and Technology (FITT) framework was used to guide our assessment and explore whether the ePRO tool is: (1) feasible for adoption in interdisciplinary primary health care practices and (2) usable from both the patient and provider perspectives. This usability pilot is part of a broader user-centered design development strategy. Methods A 4-week pilot study was conducted in which patients and providers used the ePRO tool to develop health-related goals, which patients then monitored using a mobile device. Patients and providers collaboratively set goals using the system during an initial visit and had at least 1 follow-up visit at the end of the pilot to discuss progress. Focus groups and interviews were conducted with patients and providers to capture usability and feasibility measures. Data from the ePRO system were extracted to provide information regarding tool usage. Results Six providers and 11 patients participated in the study; 3 patients dropped out mainly owing to health issues. The remaining 8 patients completed 210 monitoring protocols, equal to over 1300 questions, with patients often answering questions daily. Providers and patients accessed the portal on an average of 10 and 1.5 times, respectively. Users found the system easy to use, some patients reporting that the tool helped in their ability to self-manage, catalyzed a sense of responsibility over their care, and improved patient-centered care delivery. Some providers found that the tool helped focus conversations on goal setting. However, the tool did not fit well with provider workflows, monitoring questions were not adequately tailored to individual patient needs, and daily reporting became tedious and time-consuming for patients. Conclusions Although our study suggests relatively low usability and feasibility of the ePRO tool, we are encouraged by the early impact on patient outcomes and generally positive responses from both user groups regarding the potential of the tool to improve care for patients with CCDD. As is consistent with our user-centered design development approach, we have modified the tool based on user feedback, and are now testing the redeveloped tool through an exploratory trial. PMID:27256035

Integration of MSFC Usability Lab with Usability Testing

NASA Technical Reports Server (NTRS)

Cheng, Yiwei; Richardson, Sally

2010-01-01

As part of the Stage Analysis Branch, human factors engineering plays an important role in relating humans to the systems of hardware and structure designs of the new launch vehicle. While many branches are involved in the technical aspects of creating a launch vehicle, human factors connects humans to the scientific systems with the goal of improving operational performance and safety while reducing operational error and damage to the hardware. Human factors engineers use physical and computerized models to visualize possible areas for improvements to ensure human accessibility to components requiring maintenance and that the necessary maintenance activities can be accomplished with minimal risks to human and hardware. Many methods of testing are used to fulfill this goal, such as physical mockups, computerized visualization, and usability testing. In this analysis, a usability test is conducted to test how usable a website is to users who are and are not familiar with it. The testing is performed using participants and Morae software to record and analyze the results. This analysis will be a preliminary test of the usability lab in preparation for use in new spacecraft programs, NASA Enterprise, or other NASA websites. The usability lab project is divided into two parts: integration of the usability lab and a preliminary test of the usability lab.

Coping Mechanisms Used by Rural Principals. SSTA Research Centre Report #95-13.

ERIC Educational Resources Information Center

SSTA Research in Brief, 1995

1995-01-01

A survey examined the use of coping mechanisms by rural Saskatchewan principals and principals' perceptions of the effectiveness of coping mechanisms used. A modified form of the Ways of Coping questionnaire was mailed to 110 rural principals throughout Saskatchewan (Canada); 48 usable responses were returned. The questionnaire focused on eight…

The Usability of a Commercial Game Physics Engine to Develop Physics Educational Materials: An Investigation

ERIC Educational Resources Information Center

Price, Colin B.

2008-01-01

Commercial computer games contain "physics engine" components, responsible for providing realistic interactions among game objects. The question naturally arises of whether these engines can be used to develop educational materials for high school and university physics education. To answer this question, the author's group recently conducted a…

Administrative Office Managers' Utilization of Participative Management in Supervising Office Employees.

ERIC Educational Resources Information Center

Quible, Zane K.

An analysis was undertaken of the self-perceived role of administrative office managers in participative management. The primary purpose of the study was to enable office educators to develop relevant instructional programs based on current practices found in the business world. Data were compiled from 132 usable questionnaire responses returned…

Conceptual Data Visualization in Archival Finding Aids: Preliminary User Responses

ERIC Educational Resources Information Center

Bahde, Anne

2017-01-01

This paper explores possibilities for marrying data visualization to online archival finding aids, which have continually suffered from usability issues in their long history. This paper describes a project in which two different data visualization models were built to replace sections of an archival finding aid. Users were then shown the models,…

The Emergence of Institutional Research in Western Europe. AIR 1986 Annual Forum Paper.

ERIC Educational Resources Information Center

Maassen, Peter A. M.

Institutional research in Western Europe was analyzed in the context of the changing relationship between higher education and the central government. Questionnaires concerning institutional research activities were sent to colleges in 16 countries, and usable responses were returned by 48 institutions, almost half of which were located in…

Conservation Education Improvement. Final Report.

ERIC Educational Resources Information Center

Diem, Kenneth L.; Hennebry, Howard M.

In an attempt to improve the teaching of conservation in elementary and junior high schools, a set of integrated sequential core units was formulated and tested in five Wyoming school districts during the fall and early winter of 1968. Based on a total sample of 840 elementary students (38% usable response) and 960 junior high students (49% usable…

Response of a collection of waxy (reduced amylose) wheat breeding lines to Fusarium graminearum

USDA-ARS?s Scientific Manuscript database

Loss of function mutations in the Waxy (Wx) gene encoding granule bound starch synthase I (GBSSI) that synthesizes amylose, result in starch granules containing mostly amylopectin. Wheat grain with this trait has increased usability for some foods due to the ability to modify starch composition and ...

77 FR 52033 - Agency Information Collection Request. 60-Day Public Comment Request

Federal Register 2010, 2011, 2012, 2013, 2014

2012-08-28

...). ONC intends to revise the project to use the same focus group and cognitive usability interview... per Total burden respondent respondents respondent response hours Cognitive Testing Screening General Public 84 1 15/60 21 Cognitive Testing General Public 42 1 90/60 63 Total 126 84 Keith A. Tucker...

FERPA Training Practices: Results of the AACRAO January 2016 60 Second Survey

ERIC Educational Resources Information Center

American Association of Collegiate Registrars and Admissions Officers (AACRAO), 2016

2016-01-01

The January 2016 American Association of Collegiate Registrars and Admissions Officers (AACRAO) "60 Second Survey" focused on institutional Family Educational Rights and Privacy Act (FERPA) training practices and measuring the level of interest in an AACRAO-developed online FERPA training module. The survey received 878 usable responses.…

POLICIES AFFECTING ACCEPTANCE OF TRANSFER CREDIT FOR COURSES IN TECHNICAL EDUCATION.

ERIC Educational Resources Information Center

PURTZER, WAYNE R.

A 16-STATE QUESTIONNAIRE SURVEY OF 80 COLLEGES WAS DESIGNED TO IDENTIFY THE POLICIES OF THESE INSTITUTIONS CONCERNING GRANTING OF CREDIT FOR TECHNICAL SKILLS ACQUIRED IN OTHER SCHOOLS AND COLLEGES, MILITARY TRAINING, AND WORK EXPERIENCE. USABLE RESPONSES WERE OBTAINED FROM 48 COLLEGES. ALL COLLEGES EXCEPT ONE GRANTED SUCH CREDIT FOR COURSES IN…

An Assessment of a Community College Reentry Program for Women.

ERIC Educational Resources Information Center

Forrest, Joy Davis

In 1980, a study was conducted to determine the characteristics, attitudes, and subsequent experiences of women who had completed the Women's Education Development Incentive (WENDI) re-entry program at Brevard Community College, Florida, in 1977. From the original mailing of 79 questionnaires, 33 usable responses were returned. Two-thirds of the…

40 CFR 310.3 - What terms have specific definitions?

Code of Federal Regulations, 2011 CFR

2011-07-01

..., and the term does not include natural gas, natural gas liquids, liquefied natural gas, or synthetic gas usable for fuel (or mixtures of natural gas and such synthetic gas). (g) Local emergency response... substance under section 101(14)(A) through (F) of CERCLA, nor does it include natural gas, liquefied natural...

40 CFR 310.3 - What terms have specific definitions?

Code of Federal Regulations, 2010 CFR

2010-07-01

..., and the term does not include natural gas, natural gas liquids, liquefied natural gas, or synthetic gas usable for fuel (or mixtures of natural gas and such synthetic gas). (g) Local emergency response... substance under section 101(14)(A) through (F) of CERCLA, nor does it include natural gas, liquefied natural...

40 CFR 310.3 - What terms have specific definitions?

Code of Federal Regulations, 2012 CFR

2012-07-01

..., and the term does not include natural gas, natural gas liquids, liquefied natural gas, or synthetic gas usable for fuel (or mixtures of natural gas and such synthetic gas). (g) Local emergency response... substance under section 101(14)(A) through (F) of CERCLA, nor does it include natural gas, liquefied natural...

40 CFR 310.3 - What terms have specific definitions?

Code of Federal Regulations, 2013 CFR

2013-07-01

..., and the term does not include natural gas, natural gas liquids, liquefied natural gas, or synthetic gas usable for fuel (or mixtures of natural gas and such synthetic gas). (g) Local emergency response... substance under section 101(14)(A) through (F) of CERCLA, nor does it include natural gas, liquefied natural...

40 CFR 310.3 - What terms have specific definitions?

Code of Federal Regulations, 2014 CFR

2014-07-01

..., and the term does not include natural gas, natural gas liquids, liquefied natural gas, or synthetic gas usable for fuel (or mixtures of natural gas and such synthetic gas). (g) Local emergency response... substance under section 101(14)(A) through (F) of CERCLA, nor does it include natural gas, liquefied natural...

Generation of standard gas mixtures of halogenated, aliphatic, and aromatic compounds and prediction of the individual output rates based on molecular formula and boiling point.

PubMed

Thorenz, Ute R; Kundel, Michael; Müller, Lars; Hoffmann, Thorsten

2012-11-01

In this work, we describe a simple diffusion capillary device for the generation of various organic test gases. Using a set of basic equations the output rate of the test gas devices can easily be predicted only based on the molecular formula and the boiling point of the compounds of interest. Since these parameters are easily accessible for a large number of potential analytes, even for those compounds which are typically not listed in physico-chemical handbooks or internet databases, the adjustment of the test gas source to the concentration range required for the individual analytical application is straightforward. The agreement of the predicted and measured values is shown to be valid for different groups of chemicals, such as halocarbons, alkanes, alkenes, and aromatic compounds and for different dimensions of the diffusion capillaries. The limits of the predictability of the output rates are explored and observed to result in an underprediction of the output rates when very thin capillaries are used. It is demonstrated that pressure variations are responsible for the observed deviation of the output rates. To overcome the influence of pressure variations and at the same time to establish a suitable test gas source for highly volatile compounds, also the usability of permeation sources is explored, for example for the generation of molecular bromine test gases.

Systematic Review Protocol to Assess the Effectiveness of Usability Questionnaires in mHealth App Studies.

PubMed

Zhou, Leming; Bao, Jie; Parmanto, Bambang

2017-08-01

Usability questionnaires have a wide use in mobile health (mHealth) app usability studies. However, no systematic review has been conducted for assessing the effectiveness of these questionnaires. This paper describes a protocol for conducting a systematic review of published questionnaire-based mHealth app usability studies. In this systematic review, we will select recently published (2008-2017) articles from peer-reviewed journals and conferences that describe mHealth app usability studies and implement at least one usability questionnaire. The search strategy will include terms such as "mobile app" and "usability." Multiple databases such as PubMed, CINAHL, IEEE Xplore, ACM Digital Library, and INSPEC will be searched. There will be 2 independent reviewers in charge of screening titles and abstracts as well as determining those articles that should be included for a full-text review. The third reviewer will act as a mediator between the other 2 reviewers. Moreover, a data extraction form will be created and used during the full article data analysis. Notably, the Preferred Reporting Items for Systematic Review and Meta-Analysis Protocols (PRISMA-P) guidelines will be followed in reporting this protocol. A preliminary search produced 1271 articles, 40 of which are duplicate records. The inclusion-exclusion criteria are being strictly followed in performing the ongoing study selection. Usability questionnaires are an important tool in mHealth app usability studies. This review will summarize the usability questionnaires used in published research articles while assessing the efficacy of these questionnaires in determining the usability of mHealth apps. ©Leming Zhou, Jie Bao, Bambang Parmanto. Originally published in JMIR Research Protocols (http://www.researchprotocols.org), 01.08.2017.

Comparison of two heuristic evaluation methods for evaluating the usability of health information systems.

PubMed

Khajouei, Reza; Hajesmaeel Gohari, Sadrieh; Mirzaee, Moghaddameh

2018-04-01

In addition to following the usual Heuristic Evaluation (HE) method, the usability of health information systems can also be evaluated using a checklist. The objective of this study is to compare the performance of these two methods in identifying usability problems of health information systems. Eight evaluators independently evaluated different parts of a Medical Records Information System using two methods of HE (usual and with a checklist). The two methods were compared in terms of the number of problems identified, problem type, and the severity of identified problems. In all, 192 usability problems were identified by two methods in the Medical Records Information System. This was significantly higher than the number of usability problems identified by the checklist and usual method (148 and 92, respectively) (p < 0.0001). After removing the duplicates, the difference between the number of unique usability problems identified by the checklist method (n = 100) and usual method (n = 44) was significant (p < 0.0001). Differences between the mean severity of the real usability problems (1.83) and those identified by only one of the methods (usual = 2.05, checklist = 1.74) were significant (p = 0.001). This study revealed the potential of the two HE methods for identifying usability problems of health information systems. The results demonstrated that the checklist method had significantly better performance in terms of the number of identified usability problems; however, the performance of the usual method for identifying problems of higher severity was significantly better. Although the checklist method can be more efficient for less experienced evaluators, wherever usability is critical, the checklist should be used with caution in usability evaluations. Copyright © 2018 Elsevier Inc. All rights reserved.

A usability evaluation of a SNOMED CT based compositional interface terminology for intensive care.

PubMed

Bakhshi-Raiez, F; de Keizer, N F; Cornet, R; Dorrepaal, M; Dongelmans, D; Jaspers, M W M

2012-05-01

To evaluate the usability of a large compositional interface terminology based on SNOMED CT and the terminology application for registration of the reasons for intensive care admission in a Patient Data Management System. Observational study with user-based usability evaluations before and 3 months after the system was implemented and routinely used. Usability was defined by five aspects: effectiveness, efficiency, learnability, overall user satisfaction, and experienced usability problems. Qualitative (the Think-Aloud user testing method) and quantitative (the System Usability Scale questionnaire and Time-on-Task analyses) methods were used to examine these usability aspects. The results of the evaluation study revealed that the usability of the interface terminology fell short (SUS scores before and after implementation of 47.2 out of 100 and 37.5 respectively out of 100). The qualitative measurements revealed a high number (n=35) of distinct usability problems, leading to ineffective and inefficient registration of reasons for admission. The effectiveness and efficiency of the system did not change over time. About 14% (n=5) of the revealed usability problems were related to the terminology content based on SNOMED CT, while the remaining 86% (n=30) was related to the terminology application. The problems related to the terminology content were more severe than the problems related to the terminology application. This study provides a detailed insight into how clinicians interact with a controlled compositional terminology through a terminology application. The extensiveness, complexity of the hierarchy, and the language usage of an interface terminology are defining for its usability. Carefully crafted domain-specific subsets and a well-designed terminology application are needed to facilitate the use of a complex compositional interface terminology based on SNOMED CT. Copyright © 2011 Elsevier Ireland Ltd. All rights reserved.

Usability, Acceptability, and Impact of a Pediatric Teledermatology Mobile Health Application.

PubMed

Fiks, Alexander G; Fleisher, Linda; Berrigan, Lindsay; Sykes, Emily; Mayne, Stephanie L; Gruver, Rachel; Halkyard, Katherine; Jew, Olivia S; FitzGerald, Patrick; Winston, Flaura; McMahon, Patrick

2018-03-01

Pediatric dermatology appointment wait times often exceed several months. We evaluated the usability, acceptability, and clinical impact of a store-and-forward teledermatology mobile application (app) linking families with pediatric dermatologists. Parents of children age 6 weeks to 17 years or individuals 18-21 years old were invited (by e-mail or referral) to participate in this single group, prospective study. Within the app, users photographed the skin condition, answered questions, and submitted their case for review. One pediatric dermatologist viewed cases, diagnosed conditions, and provided instructions and prescriptions. User surveys immediately following app use and 1 week later, supplemented by electronic logs, assessed usability, acceptability, and impact. One hundred ninety-seven parents and one adolescent submitted cases within 39 days of invitation. App users were more likely to be white than those in the population invited (67% vs. 34%, p < 0.001) and their children were slightly younger (mean 7.3 vs. 9.0 years, p < 0.001). A majority, 83% found the app easy to use, 97% felt that submitting a case took "the right amount of time," 87% were satisfied, and 93% would use the app again. Prescription receipt was associated with increased app satisfaction (p = 0.008). The median user received a response in 2.8 h (interquartile range 1.1-6.4). Had the app been unavailable, 44% reported that they would have waited for primary care, 32% for a dermatology appointment, and 7% would have gone to an urgent care clinic. A mobile health app allowing families to directly consult a pediatric dermatologist was usable, acceptable, and expedited care.

Translation, Cross-Cultural Adaptation, and Validation of the Malay Version of the System Usability Scale Questionnaire for the Assessment of Mobile Apps.

PubMed

Mohamad Marzuki, Muhamad Fadhil; Yaacob, Nor Azwany; Yaacob, Najib Majdi

2018-05-14

A mobile app is a programmed system designed to be used by a target user on a mobile device. The usability of such a system refers not only to the extent to which product can be used to achieve the task that it was designed for, but also its effectiveness and efficiency, as well as user satisfaction. The System Usability Scale is one of the most commonly used questionnaires used to assess the usability of a system. The original 10-item version of System Usability Scale was developed in English and thus needs to be adapted into local languages to assess the usability of a mobile apps developed in other languages. The aim of this study is to translate and validate (with cross-cultural adaptation) the English System Usability Scale questionnaire into Malay, the main language spoken in Malaysia. The development of a translated version will allow the usability of mobile apps to be assessed in Malay. Forward and backward translation of the questionnaire was conducted by groups of Malay native speakers who spoke English as their second language. The final version was obtained after reconciliation and cross-cultural adaptation. The content of the Malay System Usability Scale questionnaire for mobile apps was validated by 10 experts in mobile app development. The efficacy of the questionnaire was further probed by testing the face validity on 10 mobile phone users, followed by reliability testing involving 54 mobile phone users. The content validity index was determined to be 0.91, indicating good relevancy of the 10 items used to assess the usability of a mobile app. Calculation of the face validity index resulted in a value of 0.94, therefore indicating that the questionnaire was easily understood by the users. Reliability testing showed a Cronbach alpha value of .85 (95% CI 0.79-0.91) indicating that the translated System Usability Scale questionnaire is a reliable tool for the assessment of usability of a mobile app. The Malay System Usability Scale questionnaire is a valid and reliable tool to assess the usability of mobile app in Malaysia. ©Muhamad Fadhil Mohamad Marzuki, Nor Azwany Yaacob, Najib Majdi Yaacob. Originally published in JMIR Human Factors (http://humanfactors.jmir.org), 14.05.2018.

Usability of a new disposable autoinjector platform device: results of a formative study conducted with a broad user population.

PubMed

Lange, Jakob; Richard, Philipp; Bradley, Nick

2015-01-01

This article presents a late-stage formative usability study of an autoinjector platform device. Such devices are used for the subcutaneous delivery of biopharmaceuticals, primarily for self-administration by the patient. Previous usability work on autoinjectors reported in the literature has been specific to single indications. This study was instead conducted with a broad user population, defined to represent user characteristics across a range of indications. The goals of the study were to evaluate whether users could use the devices safely and effectively, and could understand the instructions for use (IFU) as well as the accompanying training. Further objectives were to capture any usability issues and to obtain participants' subjective ratings on the IFU and training as well as the confidence and comfort in using the device. A total of 43 participants in 5 groups received training and performed simulated injections either into an injection pad or a mannequin. All participants were able to successfully use the device. The device was well appreciated by all users, with a reported degree of confidence in using the device of 98%, of user comfort of 93%, and of comprehensibility of IFU and training of 98%. These values are higher than other comparable results reported in the literature. The presence of both audible and visible feedback during injection was seen to be a significant factor contributing to injection success. The observation that the device can be safely and efficiently used by all tested user groups provides confidence that the device and IFU in their current form will pass future summative testing in specific applications.

PHIT for Duty, a Mobile Application for Stress Reduction, Sleep Improvement, and Alcohol Moderation.

PubMed

Kizakevich, Paul N; Eckhoff, Randall; Brown, Janice; Tueller, Stephen J; Weimer, Belinda; Bell, Stacey; Weeks, Adam; Hourani, Laurel L; Spira, James L; King, Laurel A

2018-03-01

Post-traumatic stress and other problems often occur after combat, deployment, and other military operations. Because techniques such as mindfulness meditation show efficacy in improving mental health, our team developed a mobile application (app) for individuals in the armed forces with subclinical psychological problems as secondary prevention of more significant disease. Based on the Personal Health Intervention Toolkit (PHIT), a mobile app framework for personalized health intervention studies, PHIT for Duty integrates mindfulness-based relaxation, behavioral education in sleep quality and alcohol use, and psychometric and psychophysiological data capture. We evaluated PHIT for Duty in usability and health assessment studies to establish app quality for use in health research. Participants (N = 31) rated usability on a 1 (very hard) to 5 (very easy) scale and also completed the System Usability Scale (SUS) questionnaire (N = 9). Results were (mean ± SD) overall (4.5 ± 0.6), self-report instruments (4.5 ± 0.7), pulse sensor (3.7 ± 1.2), sleep monitor (4.4 ± 0.7), sleep monitor comfort (3.7 ± 1.1), and wrist actigraphy comfort (2.7 ± 0.9). The average SUS score was 85 ± 12, indicating a rank of 95%. A comparison of PHIT-based assessments to traditional paper forms demonstrated a high overall correlation (r = 0.87). These evaluations of usability, health assessment accuracy, physiological sensing, system acceptability, and overall functionality have shown positive results and affirmation for using the PHIT framework and PHIT for Duty application in mobile health research.

Usability of a CKD Educational Website Targeted to Patients and Their Family Members

PubMed Central

Zuckerman, Marni; Fink, Wanda; Hu, Peter; Yang, Shiming; Fink, Jeffrey C.

2012-01-01

Summary Background and objectives Web-based technology is critical to the future of healthcare. As part of the Safe Kidney Care cohort study evaluating patient safety in CKD, this study determined how effectively a representative sample of patients with CKD or family members could interpret and use the Safe Kidney Care website (www.safekidneycare.org), an informational website on safety in CKD. Design, setting, participants, & measurements Between November of 2011 and January of 2012, persons with CKD or their family members underwent formal usability testing administered by a single interviewer with a second recording observer. Each participant was independently provided a list of 21 tasks to complete, with each task rated as either easily completed/noncritical error or critical error (user cannot complete the task without significant interviewer intervention). Results Twelve participants completed formal usability testing. Median completion time for all tasks was 17.5 minutes (range=10–44 minutes). In total, 10 participants had greater than or equal to one critical error. There were 55 critical errors in 252 tasks (22%), with the highest proportion of critical errors occurring when participants were asked to find information on treatments that may damage kidneys, find the website on the internet, increase font size, and scroll to the bottom of the webpage. Participants were generally satisfied with the content and usability of the website. Conclusions Web-based educational materials for patients with CKD should target a wide range of computer literacy levels and anticipate variability in competency in use of the computer and internet. PMID:22798537

47 CFR 1.1404 - Complaint.

Code of Federal Regulations, 2014 CFR

2014-10-01

... default rate of return; (xi) The average amount of usable space per pole for those poles used for pole... unusable space per pole for those poles used for pole attachments (a 24 foot presumption may be used in...) The number of ducts in the conduit subject to the complaint; (vi) The number of inner-ducts in the...

47 CFR 1.1404 - Complaint.

Code of Federal Regulations, 2011 CFR

2011-10-01

... default rate of return; (xi) The average amount of usable space per pole for those poles used for pole... unusable space per pole for those poles used for pole attachments (a 24 foot presumption may be used in...) The number of ducts in the conduit subject to the complaint; (vi) The number of inner-ducts in the...

47 CFR 1.1404 - Complaint.

Code of Federal Regulations, 2013 CFR

2013-10-01

... default rate of return; (xi) The average amount of usable space per pole for those poles used for pole... unusable space per pole for those poles used for pole attachments (a 24 foot presumption may be used in...) The number of ducts in the conduit subject to the complaint; (vi) The number of inner-ducts in the...

Mapping Skills and Activities with Children's Literature

ERIC Educational Resources Information Center

Gandy, S. Kay

2006-01-01

In the primary grades, maps are useful tools to help the young reader put stories into perspective. This article presents 18 quality children's books that contain maps or lessons about maps, as well as activities to use in the classroom to teach map skills. A table is included with ratings of the usability of the maps.

Rating the Accessibility of Library Tutorials from Leading Research Universities

ERIC Educational Resources Information Center

Clossen, Amanda; Proces, Paul

2017-01-01

Video and Web-based tutorials created by libraries from 71 public universities designated by the Carnegie Classification as having the Highest Research Activity (R1) were reviewed for accessibility and usability by disabled people. The results of this review indicate that a large portion of library tutorial content meets neither the minimum legal…

Students, Librarians, and Subject Guides: Improving a Poor Rate of Return

ERIC Educational Resources Information Center

Reeb, Brenda; Gibbons, Susan

2004-01-01

Librarians use subject guides to introduce students to library materials. Surveys, usability tests, and usage statistics demonstrate that students do not relate well to subject guides. We suggest that library resources organized or delivered at a course level are more in line with how undergraduate students approach library research. (Contains 26…

Do Smoking Cessation Websites Meet the Needs of Smokers with Severe Mental Illnesses?

ERIC Educational Resources Information Center

Brunette, Mary F.; Ferron, Joelle C.; Devitt, Timothy; Geiger, Pamela; Martin, Wendy M.; Pratt, Sarah; Santos, Meghan; McHugo, Gregory J.

2012-01-01

Many people learn about smoking cessation through information on the Internet. Whether people with severe mental illnesses, who have very high rates of smoking, are able to use currently available websites about smoking cessation is unknown. The study reported here assessed whether four smoking cessation websites met usability guidelines and…

A usability study of a mobile monitoring system for congestive heart failure patients.

PubMed

Svagård, I; Austad, H O; Seeberg, T; Vedum, J; Liverud, A; Mathiesen, B M; Keller, B; Bendixen, O C; Osborne, P; Strisland, F

2014-01-01

Sensor-based monitoring of congestive heart-failure (CHF) patients living at home can improve quality of care, detect exacerbations of disease at an earlier stage and motivate the patient for better self care. This paper reports on a usability study of the ESUMS system that provides continuous measurements of heart rate, activity, upper body posture and skin temperature via a sensor belt and a smartphone as patient terminal. Five CHF patients were included in the trial, all recently discharged from hospital. The nurses experienced continuous heart rate, activity and posture monitoring as useful and objective tools that helped them in their daily assessment of patient health. They also saw the system as an important educational tool to help patients gain insight into their own condition. Three patients liked that they could have a view of their own physiological and activity data, however the smartphones used in the study turned out to be too complicated for the patients to operate. A smartphone is built to be a multi-purpose device, and this may (conceptually and practically) be incompatible with the patients' demands for ease of use.

Initial Usability Testing of a Hand-Held Electronic Logbook Prototype for the Human Research Facility

NASA Technical Reports Server (NTRS)

Berman, Andrea H.; Whitmore, Mihriban

1996-01-01

The Apple(R) Newton(TM) MessagePad 110 was flown aboard the KC-135 reduced gravity aircraft for microgravity usability testing. The Newton served as the initial hand-held electronic logbook prototype for the International Space Station (ISS) Human Research Facility (HRF). Subjects performed three different tasks with the Newton: (1) using the stylus to tap on different sections of the screen in order to launch an application and to select options within it; (2) using the stylus to write, and; (3) correcting handwriting recognition errors in a handwriting-intensive application. Subjects rated handwriting in microgravity 'Borderline' and had great difficulties finding a way in which to adequately restrain themselves at the lower body in order to have their hands free for the Newton. Handwriting recognition was rated 'Unacceptable,' but this issue is hardware-related and not unique to the microgravity environment. It is suggested that the restraint and handwriting issues are related and require further joint research with the current Handheld Electronic Logbook prototype: the Norand Pen*key Model #6300.

A study on comparison of Gafchromic EBT2 film response under single and cumulative exposure conditions

PubMed Central

Ganapathy, K.; Kurup, P.G.G.; Murali, V.; Muthukumaran, M.; Velmurugan, J.

2013-01-01

Gafchromic films are used as dosimeter for in vivo and in phantom dose measurements. The dose response of Gafchromic EBT2 film under single and repeated exposure conditions is compared in this study to analyze the usability of Gafchromic EBT2 films in cumulative dose measurements. The post-irradiation change in response of the film is studied for up to 4 days after irradiation. The effect of repeated exposure to scanner light on the response of the film is also studied. To check usability of Gafchromic EBT2 films in cumulative dose measurements, three EBT2 films were exposed to a daily fraction dose of 100 cGy, 150 cGy and 200 cGy, respectively, for 4 days. The dose response of the films exposed to cumulative irradiation was compared with the dose measured from films exposed to the same dose but in a single exposure. It is observed that the post-irradiation darkening of the film does not saturate and continue to take place even 4 days after irradiation. The dose measured from the EBT2 films after 4 days from irradiation was around 2% higher than the dose measured from the same films at 24 hours post-irradiation. It was also observed that the repeated exposure to scanner light does not produce any significant change in the film response. The dose response of films exposed to cumulative irradiation agrees with the dose response of films exposed to the same dose in a single irradiation with less than 3% difference. Gafchromic EBT2 films can be used to measure the cumulative dose delivered over multiple fractions, when the delivered dose is uniform across the film. PMID:24672151

Improving the Usability of the User Interface for a Digital Textbook Platform for Elementary-School Students

ERIC Educational Resources Information Center

Lim, Cheolil; Song, Hae-Deok; Lee, Yekyung

2012-01-01

Usability is critical to the development of a user-friendly digital textbook platform interface, yet thorough research on interface development based on usability principles is in short supply. This study addresses that need by looking at usability attributes and corresponding design elements from a learning perspective. The researchers used a…

Using Cluster Analysis to Extend Usability Testing to Instructional Content. CRESST Report 816

ERIC Educational Resources Information Center

Kerr, Deirdre S.; Chung, Gregory K. W. K.

2012-01-01

Commercial video games undergo usability studies to determine the degree to which the player is able to learn, control, and understand the game. Usability studies allow game designers to improve their games before they are released to the public. If usability studies could be expanded to include information about the presentation of the…

Usability Testing of a Multimedia e-Learning Resource for Electrolyte and Acid-Base Disorders

ERIC Educational Resources Information Center

Davids, Mogamat Razeen; Chikte, Usuf; Grimmer-Somers, Karen; Halperin, Mitchell L.

2014-01-01

The usability of computer interfaces may have a major influence on learning. Design approaches that optimize usability are commonplace in the software development industry but are seldom used in the development of e-learning resources, especially in medical education. We conducted a usability evaluation of a multimedia resource for teaching…

Advocating for Greater Usability in Clinical Technologies: The Role of the Practicing Nurse.

PubMed

Lopez, Karen Dunn; Fahey, Linda

2018-06-01

Health care, especially ICUs, rely on multiple types of technology to promote the best patient outcomes. Unfortunately, too often these technologies are poorly designed, causing errors, additional workload, and unnecessary frustration. The purpose of this article is to (1) empower nurses with the needed usability and usability testing vocabulary to identify and articulate clinical technology usability problems and (2) provide ideas on ways nurses can advocate to have an impact on positive change related to technology usability within a health care organization. Copyright © 2018 Elsevier Inc. All rights reserved.

Real-Time Processing Library for Open-Source Hardware Biomedical Sensors

PubMed Central

Castro-García, Juan A.; Lebrato-Vázquez, Clara

2018-01-01

Applications involving data acquisition from sensors need samples at a preset frequency rate, the filtering out of noise and/or analysis of certain frequency components. We propose a novel software architecture based on open-software hardware platforms which allows programmers to create data streams from input channels and easily implement filters and frequency analysis objects. The performances of the different classes given in the size of memory allocated and execution time (number of clock cycles) were analyzed in the low-cost platform Arduino Genuino. In addition, 11 people took part in an experiment in which they had to implement several exercises and complete a usability test. Sampling rates under 250 Hz (typical for many biomedical applications) makes it feasible to implement filters, sliding windows and Fourier analysis, operating in real time. Participants rated software usability at 70.2 out of 100 and the ease of use when implementing several signal processing applications was rated at just over 4.4 out of 5. Participants showed their intention of using this software because it was percieved as useful and very easy to use. The performances of the library showed that it may be appropriate for implementing small biomedical real-time applications or for human movement monitoring, even in a simple open-source hardware device like Arduino Genuino. The general perception about this library is that it is easy to use and intuitive. PMID:29596394

Clinical performance of a new blood control peripheral intravenous catheter: A prospective, randomized, controlled study.

PubMed

Seiberlich, Laura E; Keay, Vanessa; Kallos, Stephane; Junghans, Tiffany; Lang, Eddy; McRae, Andrew D

2016-03-01

The performance of a new safety peripheral intravenous catheter (PIVC) that contains a blood control feature in the hub (blood control) was compared against the current hospital standard without blood control (standard). In this prospective, non-blinded trial, patients were randomized 1:1 to receive either device. Insertions were performed and rated by emergency room nurses. Primary endpoints included clinical acceptability, incidence of blood leakage, and risk of blood exposure. Secondary endpoints were digital compression, insertion success, and usability. 15 clinicians performed 152 PIVC insertions (73 blood control, 79 standard). Clinical acceptability of the blood control device (100%) was non-inferior to the standard (98.7%) (p < 0.0001). The blood control device had a lower incidence of blood leakage (14.1% vs 68.4%), was superior in eliminating the risk of blood exposure (93.9% vs 19.1%) and the need for digital compression (95.3% vs 19.1%), while maintaining non-inferior insertion success rates (95.9% vs 93.7%) and usability ratings (p < 0.0001). In comparison with the hospital-standard, the new safety PIVC with integrated blood control valve had similar clinical acceptability ratings yet demonstrated superior advantages to both clinicians and patients to decrease blood leakage and the clinician's risk of blood exposure, during the insertion process. Copyright © 2016 The Authors. Published by Elsevier Ltd.. All rights reserved.

Real-Time Processing Library for Open-Source Hardware Biomedical Sensors.

PubMed

Molina-Cantero, Alberto J; Castro-García, Juan A; Lebrato-Vázquez, Clara; Gómez-González, Isabel M; Merino-Monge, Manuel

2018-03-29

Applications involving data acquisition from sensors need samples at a preset frequency rate, the filtering out of noise and/or analysis of certain frequency components. We propose a novel software architecture based on open-software hardware platforms which allows programmers to create data streams from input channels and easily implement filters and frequency analysis objects. The performances of the different classes given in the size of memory allocated and execution time (number of clock cycles) were analyzed in the low-cost platform Arduino Genuino. In addition, 11 people took part in an experiment in which they had to implement several exercises and complete a usability test. Sampling rates under 250 Hz (typical for many biomedical applications) makes it feasible to implement filters, sliding windows and Fourier analysis, operating in real time. Participants rated software usability at 70.2 out of 100 and the ease of use when implementing several signal processing applications was rated at just over 4.4 out of 5. Participants showed their intention of using this software because it was percieved as useful and very easy to use. The performances of the library showed that it may be appropriate for implementing small biomedical real-time applications or for human movement monitoring, even in a simple open-source hardware device like Arduino Genuino. The general perception about this library is that it is easy to use and intuitive.

Development of a Video Coding Scheme for Analyzing the Usability and Usefulness of Health Information Systems.

PubMed

Kushniruk, Andre W; Borycki, Elizabeth M

2015-01-01

Usability has been identified as a key issue in health informatics. Worldwide numerous projects have been carried out in an attempt to increase and optimize health system usability. Usability testing, involving observing end users interacting with systems, has been widely applied and numerous publications have appeared describing such studies. However, to date, fewer works have been published describing methodological approaches to analyzing the rich data stream that results from usability testing. This includes analysis of video, audio and screen recordings. In this paper we describe our work in the development and application of a coding scheme for analyzing the usability of health information systems. The phases involved in such analyses are described.

Walking-adaptability assessments with the Interactive Walkway: Between-systems agreement and sensitivity to task and subject variations.

PubMed

Geerse, Daphne J; Coolen, Bert H; Roerdink, Melvyn

2017-05-01

The ability to adapt walking to environmental circumstances is an important aspect of walking, yet difficult to assess. The Interactive Walkway was developed to assess walking adaptability by augmenting a multi-Kinect-v2 10-m walkway with gait-dependent visual context (stepping targets, obstacles) using real-time processed markerless full-body kinematics. In this study we determined Interactive Walkway's usability for walking-adaptability assessments in terms of between-systems agreement and sensitivity to task and subject variations. Under varying task constraints, 21 healthy subjects performed obstacle-avoidance, sudden-stops-and-starts and goal-directed-stepping tasks. Various continuous walking-adaptability outcome measures were concurrently determined with the Interactive Walkway and a gold-standard motion-registration system: available response time, obstacle-avoidance and sudden-stop margins, step length, stepping accuracy and walking speed. The same holds for dichotomous classifications of success and failure for obstacle-avoidance and sudden-stops tasks and performed short-stride versus long-stride obstacle-avoidance strategies. Continuous walking-adaptability outcome measures generally agreed well between systems (high intraclass correlation coefficients for absolute agreement, low biases and narrow limits of agreement) and were highly sensitive to task and subject variations. Success and failure ratings varied with available response times and obstacle types and agreed between systems for 85-96% of the trials while obstacle-avoidance strategies were always classified correctly. We conclude that Interactive Walkway walking-adaptability outcome measures are reliable and sensitive to task and subject variations, even in high-functioning subjects. We therefore deem Interactive Walkway walking-adaptability assessments usable for obtaining an objective and more task-specific examination of one's ability to walk, which may be feasible for both high-functioning and fragile populations since walking adaptability can be assessed at various levels of difficulty. Copyright © 2017 Elsevier B.V. All rights reserved.

Feasibility study of an attention training application for older adults.

PubMed

Hill, Nikki L; Mogle, Jacqueline; Colancecco, Elise; Dick, Robert; Hannan, John; Lin, Feng Vankee

2015-09-01

Technology-based attention training has demonstrated promise in its potential to improve cognitive functioning in older people. Developing mobile applications, with older users specifically in mind, may support future dissemination of these interventions and integration into daily life. The purpose of this pilot study was to test the feasibility of an Attention Training Application (ATA) for community-dwelling older adults using mobile technology. A descriptive, mixed-methods design was used to capture older adults' feedback on the usability and acceptability of the ATA. A convenience sample of older adults (n = 9) from two independent living facilities participated in a 2-hour training and practice session with the ATA. Participants were given personally tailored instructions for using the mobile device and the ATA specifically. Following a practice session, participants provided ratings on multiple components of the ATA and completed an audio-recorded, semi-structured interview to provide detailed descriptions of their experience and perceptions. An iterative process of content analysis was used to characterise the open-ended responses. Participants rated the ATA favourably overall on several 0-10 scales including likeability [8.5 (1.6)], interest [8.8 (2.3)] and satisfaction [8.2 (1.9)]. The qualitative analyses revealed several issues relevant to the feasibility of the ATA among older people including the importance of the technological background of the user, limiting negative feedback, challenges with the touch screen interface, personal preferences for challenge, extending the practice period and the difficulty of the dual-task condition. The use of the ATA is feasible in the older adult population. Future development should specifically consider personal characteristics as well as preferences to maximise usability and acceptability among older people. Older adults enjoyed the ATA. This opens doors to user-friendly technological interventions that may be effective in assisting older adults maintain and possibly even improve their cognitive function. © 2015 John Wiley & Sons Ltd.

Ready, Set, Change! Development and usability testing of an online readiness for change decision support tool for healthcare organizations.

PubMed

Timmings, Caitlyn; Khan, Sobia; Moore, Julia E; Marquez, Christine; Pyka, Kasha; Straus, Sharon E

2016-02-24

To address challenges related to selecting a valid, reliable, and appropriate readiness assessment measure in practice, we developed an online decision support tool to aid frontline implementers in healthcare settings in this process. The focus of this paper is to describe a multi-step, end-user driven approach to developing this tool for use during the planning stages of implementation. A multi-phase, end-user driven approach was used to develop and test the usability of a readiness decision support tool. First, readiness assessment measures that are valid, reliable, and appropriate for healthcare settings were identified from a systematic review. Second, a mapping exercise was performed to categorize individual items of included measures according to key readiness constructs from an existing framework. Third, a modified Delphi process was used to collect stakeholder ratings of the included measures on domains of feasibility, relevance, and likelihood to recommend. Fourth, two versions of a decision support tool prototype were developed and evaluated for usability. Nine valid and reliable readiness assessment measures were included in the decision support tool. The mapping exercise revealed that of the nine measures, most measures (78 %) focused on assessing readiness for change at the organizational versus the individual level, and that four measures (44 %) represented all constructs of organizational readiness. During the modified Delphi process, stakeholders rated most measures as feasible and relevant for use in practice, and reported that they would be likely to recommend use of most measures. Using data from the mapping exercise and stakeholder panel, an algorithm was developed to link users to a measure based on characteristics of their organizational setting and their readiness for change assessment priorities. Usability testing yielded recommendations that were used to refine the Ready, Set, Change! decision support tool . Ready, Set, Change! decision support tool is an implementation support that is designed to facilitate the routine incorporation of a readiness assessment as an early step in implementation. Use of this tool in practice may offer time and resource-saving implications for implementation.