Comparing two anesthesia information management system user interfaces: a usability evaluation.

PubMed

Wanderer, Jonathan P; Rao, Anoop V; Rothwell, Sarah H; Ehrenfeld, Jesse M

2012-11-01

Anesthesia information management systems (AIMS) have been developed by multiple vendors and are deployed in thousands of operating rooms around the world, yet not much is known about measuring and improving AIMS usability. We developed a methodology for evaluating AIMS usability in a low-fidelity simulated clinical environment and used it to compare an existing user interface with a revised version. We hypothesized that the revised user interface would be more useable. In a low-fidelity simulated clinical environment, twenty anesthesia providers documented essential anesthetic information for the start of the case using both an existing and a revised user interface. Participants had not used the revised user interface previously and completed a brief training exercise prior to the study task. All participants completed a workload assessment and a satisfaction survey. All sessions were recorded. Multiple usability metrics were measured. The primary outcome was documentation accuracy. Secondary outcomes were perceived workload, number of documentation steps, number of user interactions, and documentation time. The interfaces were compared and design problems were identified by analyzing recorded sessions and survey results. Use of the revised user interface was shown to improve documentation accuracy from 85.1% to 92.4%, a difference of 7.3% (95% confidence interval [CI] for the difference 1.8 to 12.7). The revised user interface decreased the number of user interactions by 6.5 for intravenous documentation (95% CI 2.9 to 10.1) and by 16.1 for airway documentation (95% CI 11.1 to 21.1). The revised user interface required 3.8 fewer documentation steps (95% CI 2.3 to 5.4). Airway documentation time was reduced by 30.5 seconds with the revised workflow (95% CI 8.5 to 52.4). There were no significant time differences noted in intravenous documentation or in total task time. No difference in perceived workload was found between the user interfaces. Two user interface design problems were identified in the revised user interface. The usability of anesthesia information management systems can be evaluated using a low-fidelity simulated clinical environment. User testing of the revised user interface showed improvement in some usability metrics and highlighted areas for further revision. Vendors of AIMS and those who use them should consider adopting methods to evaluate and improve AIMS usability.

User ratings of prosthetic usability and satisfaction in VA study to optimize DEKA arm.

PubMed

Resnik, Linda; Borgia, Matthew

2014-01-01

The Department of Veterans Affairs study to optimize the DEKA Arm provided feedback to inform optimization of the gen 2 (second-generation) prototype and evaluate the gen 3 (third-generation) prototype. This article summarizes recommendations to improve gen 2 and reports satisfaction and usability ratings of gen 2 and gen 3. Data were collected from 39 subjects; 37 subjects were included in this analysis. Of the subjects, 24 were fit with gen 2 (8 radial configuration [RC], 6 humeral configuration [HC], and 10 shoulder configuration [SC]), 13 were fit with gen 3 (4 RC, 5 HC, and 4 SC), and 5 were fit with both. Usability and satisfaction were evaluated using the Trinity Amputation and Prosthesis Experience Scale (TAPES) and study-specific usability and satisfaction scales. Descriptive statistics were examined and prototypes compared using Wilcoxon rank-sum. Results were stratified by configuration level and outcomes compared by prototype. Satisfaction and usability were greater for gen 3 than gen 2. Overall TAPES scores were similar; however, scores of the TAPES aesthetic satisfaction subscale were higher for gen 3. Compared with gen 2 users, gen 3 users were more satisfied with appearance, grips, and doffing and rated overall usability higher. Features of gen 3, including weight, external cables and wires, hand covering, and fingernails, would benefit from further optimization.

Defining Usability: How Library Practice Differs from Published Research

ERIC Educational Resources Information Center

Chen, Yu-Hui; Germain, Carol Anne; Rorissa, Abebe

2011-01-01

Library/information science professionals need a clearly articulated definition of usability/Web usability to implement intuitive websites. In this study, the authors analyzed usability definitions provided by the ARL library professionals and those found in the library/information science and computer science-information systems literature.…

Using a fuzzy comprehensive evaluation method to determine product usability: A proposed theoretical framework

PubMed Central

Zhou, Ronggang; Chan, Alan H. S.

2016-01-01

BACKGROUND: In order to compare existing usability data to ideal goals or to that for other products, usability practitioners have tried to develop a framework for deriving an integrated metric. However, most current usability methods with this aim rely heavily on human judgment about the various attributes of a product, but often fail to take into account of the inherent uncertainties in these judgments in the evaluation process. OBJECTIVE: This paper presents a universal method of usability evaluation by combining the analytic hierarchical process (AHP) and the fuzzy evaluation method. By integrating multiple sources of uncertain information during product usability evaluation, the method proposed here aims to derive an index that is structured hierarchically in terms of the three usability components of effectiveness, efficiency, and user satisfaction of a product. METHODS: With consideration of the theoretical basis of fuzzy evaluation, a two-layer comprehensive evaluation index was first constructed. After the membership functions were determined by an expert panel, the evaluation appraisals were computed by using the fuzzy comprehensive evaluation technique model to characterize fuzzy human judgments. Then with the use of AHP, the weights of usability components were elicited from these experts. RESULTS AND CONCLUSIONS: Compared to traditional usability evaluation methods, the major strength of the fuzzy method is that it captures the fuzziness and uncertainties in human judgments and provides an integrated framework that combines the vague judgments from multiple stages of a product evaluation process. PMID:28035943

Applying usability methods to identify health literacy issues: an example using a Personal Health Record.

PubMed

Monkman, Helen; Kushniruk, Andre

2013-01-01

The prevalence of consumer health information systems is increasing. However, usability and health literacy impact both the value and adoption of these systems. Health literacy and usability are closely related in that systems may not be used accurately if users cannot understand the information therein. Thus, it is imperative to focus on mitigating the demands on health literacy in consumer health information systems. This study modified two usability evaluation methods (heuristic evaluation and usability testing) to incorporate the identification of potential health literacy issues in a Personal Health Record (PHR). Heuristic evaluation is an analysis of a system performed by a usability specialist who evaluates how well the system abides by usability principles. In contrast, a usability test involves a post hoc analysis of a representative user interacting with the system. These two methods revealed several health literacy issues and suggestions to ameliorate them were made. Thus, it was demonstrated that usability methods could be successfully augmented for the purpose of investigating health literacy issues. To improve users' health knowledge, the adoption of consumer health information systems, and the accuracy of the information contained therein, it is encouraged that usability methods be applied with an added focus on health literacy.

Usability analysis of industrial cooking equipment.

PubMed

Calado, Alexana Vilar Soares; Soares, Marcelo Márcio

2012-01-01

This paper refers to the comparative study of the equipment used for cooking in commercial of kitchens restaurants that use the system of traditional cooking and those ones which use the system called smart cooking (combination oven). The study investigates the usability issues concerning to the two systems, analyzing comparatively the aspects related to anthropometry, dimensional variables, the use of the product and also the product safety, as well as issues of information related to operation of the new concepts of cooking in intelligent systems.

Ten factors to consider when developing usability scenarios and tasks for health information technology.

PubMed

Russ, Alissa L; Saleem, Jason J

2018-02-01

The quality of usability testing is highly dependent upon the associated usability scenarios. To promote usability testing as part of electronic health record (EHR) certification, the Office of the National Coordinator (ONC) for Health Information Technology requires that vendors test specific capabilities of EHRs with clinical end-users and report their usability testing process - including the test scenarios used - along with the results. The ONC outlines basic expectations for usability testing, but there is little guidance in usability texts or scientific literature on how to develop usability scenarios for healthcare applications. The objective of this article is to outline key factors to consider when developing usability scenarios and tasks to evaluate computer-interface based health information technologies. To achieve this goal, we draw upon a decade of our experience conducting usability tests with a variety of healthcare applications and a wide range of end-users, to include healthcare professionals as well as patients. We discuss 10 key factors that influence scenario development: objectives of usability testing; roles of end-user(s); target performance goals; evaluation time constraints; clinical focus; fidelity; scenario-related bias and confounders; embedded probes; minimize risks to end-users; and healthcare related outcome measures. For each factor, we present an illustrative example. This article is intended to aid usability researchers and practitioners in their efforts to advance health information technologies. The article provides broad guidance on usability scenario development and can be applied to a wide range of clinical information systems and applications. Published by Elsevier Inc.

Human Factors in the Large: Experiences from Denmark, Finland and Canada in Moving Towards Regional and National Evaluations of Health Information System Usability. Contribution of the IMIA Human Factors Working Group.

PubMed

Kushniruk, A; Kaipio, J; Nieminen, M; Hyppönen, H; Lääveri, T; Nohr, C; Kanstrup, A M; Berg Christiansen, M; Kuo, M-H; Borycki, E

2014-08-15

The objective of this paper is to explore approaches to understanding the usability of health information systems at regional and national levels. Several different methods are discussed in case studies from Denmark, Finland and Canada. They range from small scale qualitative studies involving usability testing of systems to larger scale national level questionnaire studies aimed at assessing the use and usability of health information systems by entire groups of health professionals. It was found that regional and national usability studies can complement smaller scale usability studies, and that they are needed in order to understand larger trends regarding system usability. Despite adoption of EHRs, many health professionals rate the usability of the systems as low. A range of usability issues have been noted when data is collected on a large scale through use of widely distributed questionnaires and websites designed to monitor user perceptions of usability. As health information systems are deployed on a widespread basis, studies that examine systems used regionally or nationally are required. In addition, collection of large scale data on the usability of specific IT products is needed in order to complement smaller scale studies of specific systems.

Human Factors in the Large: Experiences from Denmark, Finland and Canada in Moving Towards Regional and National Evaluations of Health Information System Usability

PubMed Central

Kaipio, J.; Nieminen, M.; Hyppönen, H.; Lääveri, T.; Nohr, C.; Kanstrup, A. M.; Berg Christiansen, M.; Kuo, M.-H.; Borycki, E.

2014-01-01

Summary Objectives The objective of this paper is to explore approaches to understanding the usability of health information systems at regional and national levels. Methods Several different methods are discussed in case studies from Denmark, Finland and Canada. They range from small scale qualitative studies involving usability testing of systems to larger scale national level questionnaire studies aimed at assessing the use and usability of health information systems by entire groups of health professionals. Results It was found that regional and national usability studies can complement smaller scale usability studies, and that they are needed in order to understand larger trends regarding system usability. Despite adoption of EHRs, many health professionals rate the usability of the systems as low. A range of usability issues have been noted when data is collected on a large scale through use of widely distributed questionnaires and websites designed to monitor user perceptions of usability. Conclusion As health information systems are deployed on a widespread basis, studies that examine systems used regionally or nationally are required. In addition, collection of large scale data on the usability of specific IT products is needed in order to complement smaller scale studies of specific systems. PMID:25123725

Usability evaluation of Laboratory and Radiology Information Systems integrated into a hospital information system.

PubMed

Nabovati, Ehsan; Vakili-Arki, Hasan; Eslami, Saeid; Khajouei, Reza

2014-04-01

This study was conducted to evaluate the usability of widely used laboratory and radiology information systems. Three usability experts independently evaluated the user interfaces of Laboratory and Radiology Information Systems using heuristic evaluation method. They applied Nielsen's heuristics to identify and classify usability problems and Nielsen's severity rating to judge their severity. Overall, 116 unique heuristic violations were identified as usability problems. In terms of severity, 67 % of problems were rated as major and catastrophic. Among 10 heuristics, "consistency and standards" was violated most frequently. Moreover, mean severity of problems concerning "error prevention" and "help and documentation" heuristics was higher than of the others. Despite widespread use of specific healthcare information systems, they suffer from usability problems. Improving the usability of systems by following existing design standards and principles from the early phased of system development life cycle is recommended. Especially, it is recommended that the designers design systems that inhibit the initiation of erroneous actions and provide sufficient guidance to users.

Design and usability study of an iconic user interface to ease information retrieval of medical guidelines.

PubMed

Griffon, Nicolas; Kerdelhué, Gaétan; Hamek, Saliha; Hassler, Sylvain; Boog, César; Lamy, Jean-Baptiste; Duclos, Catherine; Venot, Alain; Darmoni, Stéfan J

2014-10-01

Doc'CISMeF (DC) is a semantic search engine used to find resources in CISMeF-BP, a quality controlled health gateway, which gathers guidelines available on the internet in French. Visualization of Concepts in Medicine (VCM) is an iconic language that may ease information retrieval tasks. This study aimed to describe the creation and evaluation of an interface integrating VCM in DC in order to make this search engine much easier to use. Focus groups were organized to suggest ways to enhance information retrieval tasks using VCM in DC. A VCM interface was created and improved using the ergonomic evaluation approach. 20 physicians were recruited to compare the VCM interface with the non-VCM one. Each evaluator answered two different clinical scenarios in each interface. The ability and time taken to select a relevant resource were recorded and compared. A usability analysis was performed using the System Usability Scale (SUS). The VCM interface contains a filter based on icons, and icons describing each resource according to focus group recommendations. Some ergonomic issues were resolved before evaluation. Use of VCM significantly increased the success of information retrieval tasks (OR=11; 95% CI 1.4 to 507). Nonetheless, it took significantly more time to find a relevant resource with VCM interface (101 vs 65 s; p=0.02). SUS revealed 'good' usability with an average score of 74/100. VCM was successfully implemented in DC as an option. It increased the success rate of information retrieval tasks, despite requiring slightly more time, and was well accepted by end-users. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

The McMaster Optimal Aging Portal: Usability Evaluation of a Unique Evidence-Based Health Information Website.

PubMed

Barbara, Angela M; Dobbins, Maureen; Haynes, R Brian; Iorio, Alfonso; Lavis, John N; Raina, Parminder; Levinson, Anthony J

2016-05-11

Increasingly, older adults and their informal caregivers are using the Internet to search for health-related information. There is a proliferation of health information online, but the quality of this information varies, often based on exaggerated or dramatic findings, and not easily comprehended by consumers. The McMaster Optimal Aging Portal (Portal) was developed to provide Internet users with high-quality evidence about aging and address some of these current limitations of health information posted online. The Portal includes content for health professionals coming from three best-in-class resources (MacPLUS, Health Evidence, and Health Systems Evidence) and four types of content specifically prepared for the general public (Evidence Summaries, Web Resource Ratings, Blog Posts, and Twitter messages). Our objectives were to share the findings of the usability evaluation of the Portal with particular focus on the content features for the general public and to inform designers of health information websites and online resources for older adults about key usability themes. Data analysis included task performance during usability testing and qualitative content analyses of both the usability sessions and interviews to identify core themes. A total of 37 participants took part in 33 usability testing sessions and 21 focused interviews. Qualitative analysis revealed common themes regarding the Portal's strengths and challenges to usability. The strengths of the website were related to credibility, applicability, browsing function, design, and accessibility. The usability challenges included reluctance to register, process of registering, searching, terminology, and technical features. The study reinforced the importance of including end users during the development of this unique, dynamic, evidence-based health information website. The feedback was applied to iteratively improve website usability. Our findings can be applied by designers of health-related websites.

The McMaster Optimal Aging Portal: Usability Evaluation of a Unique Evidence-Based Health Information Website

PubMed Central

Dobbins, Maureen; Haynes, R. Brian; Iorio, Alfonso; Lavis, John N; Raina, Parminder

2016-01-01

Background Increasingly, older adults and their informal caregivers are using the Internet to search for health-related information. There is a proliferation of health information online, but the quality of this information varies, often based on exaggerated or dramatic findings, and not easily comprehended by consumers. The McMaster Optimal Aging Portal (Portal) was developed to provide Internet users with high-quality evidence about aging and address some of these current limitations of health information posted online. The Portal includes content for health professionals coming from three best-in-class resources (MacPLUS, Health Evidence, and Health Systems Evidence) and four types of content specifically prepared for the general public (Evidence Summaries, Web Resource Ratings, Blog Posts, and Twitter messages). Objective Our objectives were to share the findings of the usability evaluation of the Portal with particular focus on the content features for the general public and to inform designers of health information websites and online resources for older adults about key usability themes. Methods Data analysis included task performance during usability testing and qualitative content analyses of both the usability sessions and interviews to identify core themes. Results A total of 37 participants took part in 33 usability testing sessions and 21 focused interviews. Qualitative analysis revealed common themes regarding the Portal’s strengths and challenges to usability. The strengths of the website were related to credibility, applicability, browsing function, design, and accessibility. The usability challenges included reluctance to register, process of registering, searching, terminology, and technical features. Conclusions The study reinforced the importance of including end users during the development of this unique, dynamic, evidence-based health information website. The feedback was applied to iteratively improve website usability. Our findings can be applied by designers of health-related websites. PMID:27170443

Design and implementation of a hospital-based usability laboratory: insights from a Department of Veterans Affairs laboratory for health information technology.

PubMed

Russ, Alissa L; Weiner, Michael; Russell, Scott A; Baker, Darrell A; Fahner, W Jeffrey; Saleem, Jason J

2012-12-01

Although the potential benefits of more usable health information technologies (HIT) are substantial-reduced HIT support costs, increased work efficiency, and improved patient safety--human factors methods to improve usability are rarely employed. The US Department of Veterans Affairs (VA) has emerged as an early leader in establishing usability laboratories to inform the design of HIT, including its electronic health record. Experience with a usability laboratory at a VA Medical Center provides insights on how to design, implement, and leverage usability laboratories in the health care setting. The VA Health Services Research and Development Service Human-Computer Interaction & Simulation Laboratory emerged as one of the first VA usability laboratories and was intended to provide research-based findings about HIT designs. This laboratory supports rapid prototyping, formal usability testing, and analysis tools to assess existing technologies, alternative designs, and potential future technologies. RESULTS OF IMPLEMENTATION: Although the laboratory has maintained a research focus, it has become increasingly integrated with VA operations, both within the medical center and on a national VA level. With this resource, data-driven recommendations have been provided for the design of HIT applications before and after implementation. The demand for usability testing of HIT is increasing, and information on how to develop usability laboratories for the health care setting is often needed. This article may assist other health care organizations that want to invest in usability resources to improve HIT. The establishment and utilization of usability laboratories in the health care setting may improve HIT designs and promote safe, high-quality care for patients.

The current status of usability studies of information technologies in China: a systematic study.

PubMed

Lei, Jianbo; Xu, Lufei; Meng, Qun; Zhang, Jiajie; Gong, Yang

2014-01-01

To systematically review and analyze the current status and characteristics of usability studies in China in the field of information technology in general and in the field of healthcare in particular. We performed a quantitative literature analysis in three major Chinese academic databases and one English language database using Chinese search terms equivalent to the concept of usability. Six hundred forty-seven publications were selected for analysis. We found that in China the literature on usability in the field of information technology began in 1994 and increased thereafter. The usability definitions from ISO 9241-11:1998 and Nielsen (1993) have been widely recognized and cited. Authors who have published several publications are rare. Fourteen journals have a publishing rate over 1%. Only nine publications about HIT were identified. China's usability research started relatively late. There is a lack of organized research teams and dedicated usability journals. High-impact theoretical studies are scarce. On the application side, no original and systematic research frameworks have been developed. The understanding and definition of usability is not well synchronized with international norms. Besides, usability research in HIT is rare. More human and material resources need to be invested in China's usability research, particularly in HIT.

Finding online health-related information: usability issues of health portals.

PubMed

Gurel Koybasi, Nergis A; Cagiltay, Kursat

2012-01-01

As Internet and computers become widespread, health portals offering online health-related information become more popular. The most important point for health portals is presenting reliable and valid information. Besides, portal needs to be usable to be able to serve information to users effectively. This study aims to determine usability issues emerging when health-related information is searched on a health portal. User-based usability tests are conducted and eye movement analyses are used in addition to traditional performance measures. Results revealed that users prefer systematic, simple and consistent designs offering interactive tools. Moreover, content and partitions needs to be shaped according to the medical knowledge of target users.

The Current Status of Usability Studies of Information Technologies in China: A Systematic Study

PubMed Central

Lei, Jianbo; Xu, Lufei; Meng, Qun; Zhang, Jiajie; Gong, Yang

2014-01-01

Objectives. To systematically review and analyze the current status and characteristics of usability studies in China in the field of information technology in general and in the field of healthcare in particular. Methods. We performed a quantitative literature analysis in three major Chinese academic databases and one English language database using Chinese search terms equivalent to the concept of usability. Results. Six hundred forty-seven publications were selected for analysis. We found that in China the literature on usability in the field of information technology began in 1994 and increased thereafter. The usability definitions from ISO 9241-11:1998 and Nielsen (1993) have been widely recognized and cited. Authors who have published several publications are rare. Fourteen journals have a publishing rate over 1%. Only nine publications about HIT were identified. Discussions. China's usability research started relatively late. There is a lack of organized research teams and dedicated usability journals. High-impact theoretical studies are scarce. On the application side, no original and systematic research frameworks have been developed. The understanding and definition of usability is not well synchronized with international norms. Besides, usability research in HIT is rare. Conclusions. More human and material resources need to be invested in China's usability research, particularly in HIT. PMID:25050362

Web usability evaluation on BloobIS website by using hallway usability testing method and ISO 9241:11

NASA Astrophysics Data System (ADS)

Dwi Susanto, Tony; Ingesti Prasetyo, Anisa; Astuti, Hanim Maria

2018-03-01

At this moment, the need for web as an information media is highly important. Not only confined in the infotainment area, government, and education, but health as well uses the web media as a medium for providing information effectively. BloobIS is a web based application which integrates blood supply and distribution information at the Blood Transfusion Unit. Knowing how easy information is on BloobIS is marked by how convenient the website is used. Up until now, the BloobIS website is nearing completion but testing has not yet been performed to users and is on the testing and development phase in the Development Life Cycle software. Thus, an evaluation namely the quality control software which focuses on the perspective of BloobIs web usability is required. Hallway Usability Testing and ISO 9241:11 are the methods chosen to measure the BloobIS application usability. The expected outputs of the quality control software focusing on the usability evaluation are being able to rectify the usability deficiencies on the BloobIs web and provide recommendations to develop the web as a basic BloobIS web quality upgraed which sets a goal to amplify the satisfaction of web users based on usability factors in ISO 9241:11.

A Usability Case Study Using TREC and ZPRISE.

ERIC Educational Resources Information Center

Downey, Laura L.; Tice, Dawn M.

1999-01-01

Examines the challenges involved in conducting an informal usability case study based on the introduction of a new information-retrieval system to experienced users. Identifies problems users were having with TREC (Text Retrieval Conference) and examines the usability of the new ZPRISE interface. (Author/LRW)

Usability study of a computer-based self-management system for older adults with chronic diseases.

PubMed

Or, Calvin; Tao, Da

2012-11-08

Usability can influence patients' acceptance and adoption of a health information technology. However, little research has been conducted to study the usability of a self-management health care system, especially one geared toward elderly patients. This usability study evaluated a new computer-based self-management system interface for older adults with chronic diseases, using a paper prototype approach. Fifty older adults with different chronic diseases participated. Two usability evaluation methods were involved: (1) a heuristics evaluation and (2) end-user testing with a think-aloud testing method, audio recording, videotaping, and interviewing. A set of usability metrics was employed to determine the overall system usability, including task incompletion rate, task completion time, frequency of error, frequency of help, satisfaction, perceived usefulness, and perceived ease of use. Interviews were used to elicit participants' comments on the system design. The quantitative data were analyzed using descriptive statistics and the qualitative data were analyzed for content. The participants were able to perform the predesigned self-management tasks with the current system design and they expressed mostly positive responses about the perceived usability measures regarding the system interface. However, the heuristics evaluation, performance measures, and interviews revealed a number of usability problems related to system navigation, information search and interpretation, information presentation, and readability. Design recommendations for further system interface modifications were discussed. This study verified the usability of the self-management system developed for older adults with chronic diseases. Also, we demonstrated that our usability evaluation approach could be used to quickly and effectively identify usability problems in a health care information system at an early stage of the system development process using a paper prototype. Conducting a usability evaluation is an essential step in system development to ensure that the system features match the users' true needs, expectations, and characteristics, and also to minimize the likelihood of the users committing user errors and having difficulties using the system.

Usability Study of a Computer-Based Self-Management System for Older Adults with Chronic Diseases

PubMed Central

Tao, Da

2012-01-01

Background Usability can influence patients’ acceptance and adoption of a health information technology. However, little research has been conducted to study the usability of a self-management health care system, especially one geared toward elderly patients. Objective This usability study evaluated a new computer-based self-management system interface for older adults with chronic diseases, using a paper prototype approach. Methods Fifty older adults with different chronic diseases participated. Two usability evaluation methods were involved: (1) a heuristics evaluation and (2) end-user testing with a think-aloud testing method, audio recording, videotaping, and interviewing. A set of usability metrics was employed to determine the overall system usability, including task incompletion rate, task completion time, frequency of error, frequency of help, satisfaction, perceived usefulness, and perceived ease of use. Interviews were used to elicit participants’ comments on the system design. The quantitative data were analyzed using descriptive statistics and the qualitative data were analyzed for content. Results The participants were able to perform the predesigned self-management tasks with the current system design and they expressed mostly positive responses about the perceived usability measures regarding the system interface. However, the heuristics evaluation, performance measures, and interviews revealed a number of usability problems related to system navigation, information search and interpretation, information presentation, and readability. Design recommendations for further system interface modifications were discussed. Conclusions This study verified the usability of the self-management system developed for older adults with chronic diseases. Also, we demonstrated that our usability evaluation approach could be used to quickly and effectively identify usability problems in a health care information system at an early stage of the system development process using a paper prototype. Conducting a usability evaluation is an essential step in system development to ensure that the system features match the users’ true needs, expectations, and characteristics, and also to minimize the likelihood of the users committing user errors and having difficulties using the system. PMID:23612015

Multi-method laboratory user evaluation of an actionable clinical performance information system: Implications for usability and patient safety.

PubMed

Brown, Benjamin; Balatsoukas, Panos; Williams, Richard; Sperrin, Matthew; Buchan, Iain

2018-01-01

Electronic audit and feedback (e-A&F) systems are used worldwide for care quality improvement. They measure health professionals' performance against clinical guidelines, and some systems suggest improvement actions. However, little is known about optimal interface designs for e-A&F, in particular how to present suggested actions for improvement. We developed a novel theory-informed system for primary care (the Performance Improvement plaN GeneratoR; PINGR) that covers the four principal interface components: clinical performance summaries; patient lists; detailed patient-level information; and suggested actions. As far as we are aware, this is the first report of an e-A&F system with all four interface components. (1) Use a combination of quantitative and qualitative methods to evaluate the usability of PINGR with target end-users; (2) refine existing design recommendations for e-A&F systems; (3) determine the implications of these recommendations for patient safety. We recruited seven primary care physicians to perform seven tasks with PINGR, during which we measured on-screen behaviour and eye movements. Participants subsequently completed usability questionnaires, and were interviewed in-depth. Data were integrated to: gain a more complete understanding of usability issues; enhance and explain each other's findings; and triangulate results to increase validity. Participants committed a median of 10 errors (range 8-21) when using PINGR's interface, and completed a median of five out of seven tasks (range 4-7). Errors violated six usability heuristics: clear response options; perceptual grouping and data relationships; representational formats; unambiguous description; visually distinct screens for confusable items; and workflow integration. Eye movement analysis revealed the integration of components largely supported effective user workflow, although the modular design of clinical performance summaries unnecessarily increased cognitive load. Interviews and questionnaires revealed PINGR is user-friendly, and that improved information prioritisation could further promote useful user action. Comparing our results with the wider usability literature we refine a previously published set of interface design recommendations for e-A&F. The implications for patient safety are significant regarding: user engagement; actionability; and information prioritisation. Our results also support adopting multi-method approaches in usability studies to maximise issue discovery and the credibility of findings. Copyright © 2017 The Authors. Published by Elsevier Inc. All rights reserved.

Qualitative review of usability problems in health information systems for radiology.

PubMed

Dias, Camila Rodrigues; Pereira, Marluce Rodrigues; Freire, André Pimenta

2017-12-01

Radiology processes are commonly supported by Radiology Information System (RIS), Picture Archiving and Communication System (PACS) and other software for radiology. However, these information technologies can present usability problems that affect the performance of radiologists and physicians, especially considering the complexity of the tasks involved. The purpose of this study was to extract, classify and analyze qualitatively the usability problems in PACS, RIS and other software for radiology. A systematic review was performed to extract usability problems reported in empirical usability studies in the literature. The usability problems were categorized as violations of Nielsen and Molich's usability heuristics. The qualitative analysis indicated the causes and the effects of the identified usability problems. From the 431 papers initially identified, 10 met the study criteria. The analysis of the papers identified 90 instances of usability problems, classified into categories corresponding to established usability heuristics. The five heuristics with the highest number of instances of usability problems were "Flexibility and efficiency of use", "Consistency and standards", "Match between system and the real world", "Recognition rather than recall" and "Help and documentation", respectively. These problems can make the interaction time consuming, causing delays in tasks, dissatisfaction, frustration, preventing users from enjoying all the benefits and functionalities of the system, as well as leading to more errors and difficulties in carrying out clinical analyses. Furthermore, the present paper showed a lack of studies performed on systems for radiology, especially usability evaluations using formal methods of evaluation involving the final users. Copyright © 2017 Elsevier Inc. All rights reserved.

Usability Evaluation of Laboratory Information Systems.

PubMed

Mathews, Althea; Marc, David

2017-01-01

Numerous studies have revealed widespread clinician frustration with the usability of electronic health records (EHRs) that is counterproductive to adoption of EHR systems to meet the aims of health-care reform. With poor system usability comes increased risk of negative unintended consequences. Usability issues could lead to user error and workarounds that have the potential to compromise patient safety and negatively impact the quality of care.[1] While there is ample research on EHR usability, there is little information on the usability of laboratory information systems (LISs). Yet, LISs facilitate the timely provision of a great deal of the information needed by physicians to make patient care decisions.[2] Medical and technical advances in genomics that require processing of an increased volume of complex laboratory data further underscore the importance of developing user-friendly LISs. This study aims to add to the body of knowledge on LIS usability. A survey was distributed among LIS users at hospitals across the United States. The survey consisted of the ten-item System Usability Scale (SUS). In addition, participants were asked to rate the ease of performing 24 common tasks with a LIS. Finally, respondents provided comments on what they liked and disliked about using the LIS to provide diagnostic insight into LIS perceived usability. The overall mean SUS score of 59.7 for the LIS evaluated is significantly lower than the benchmark of 68 ( P < 0.001). All LISs evaluated received mean SUS scores below 68 except for Orchard Harvest (78.7). While the years of experience using the LIS was found to be a statistically significant influence on mean SUS scores, the combined effect of years of experience and LIS used did not account for the statistically significant difference in the mean SUS score between Orchard Harvest and each of the other LISs evaluated. The results of this study indicate that overall usability of LISs is poor. Usability lags that of systems evaluated across 446 usability surveys.

From Usability Testing to Clinical Simulations: Bringing Context into the Design and Evaluation of Usable and Safe Health Information Technologies. Contribution of the IMIA Human Factors Engineering for Healthcare Informatics Working Group.

PubMed

Kushniruk, A; Nohr, C; Jensen, S; Borycki, E M

2013-01-01

The objective of this paper is to explore human factors approaches to understanding the use of health information technology (HIT) by extending usability engineering approaches to include analysis of the impact of clinical context through use of clinical simulations. Methods discussed are considered on a continuum from traditional laboratory-based usability testing to clinical simulations. Clinical simulations can be conducted in a simulation laboratory and they can also be conducted in real-world settings. The clinical simulation approach attempts to bring the dimension of clinical context into stronger focus. This involves testing of systems with representative users doing representative tasks, in representative settings/environments. Application of methods where realistic clinical scenarios are used to drive the study of users interacting with systems under realistic conditions and settings can lead to identification of problems and issues with systems that may not be detected using traditional usability engineering methods. In conducting such studies, careful consideration is needed in creating ecologically valid test scenarios. The evidence obtained from such evaluation can be used to improve both the usability and safety of HIT. In addition, recent work has shown that clinical simulations, in particular those conducted in-situ, can lead to considerable benefits when compared to the costs of running such studies. In order to bring context of use into the testing of HIT, clinical simulation, involving observing representative users carrying out tasks in representative settings, holds considerable promise.

Development of a Video Coding Scheme for Analyzing the Usability and Usefulness of Health Information Systems.

PubMed

Kushniruk, Andre W; Borycki, Elizabeth M

2015-01-01

Usability has been identified as a key issue in health informatics. Worldwide numerous projects have been carried out in an attempt to increase and optimize health system usability. Usability testing, involving observing end users interacting with systems, has been widely applied and numerous publications have appeared describing such studies. However, to date, fewer works have been published describing methodological approaches to analyzing the rich data stream that results from usability testing. This includes analysis of video, audio and screen recordings. In this paper we describe our work in the development and application of a coding scheme for analyzing the usability of health information systems. The phases involved in such analyses are described.

An evaluation method of computer usability based on human-to-computer information transmission model.

PubMed

Ogawa, K

1992-01-01

This paper proposes a new evaluation and prediction method for computer usability. This method is based on our two previously proposed information transmission measures created from a human-to-computer information transmission model. The model has three information transmission levels: the device, software, and task content levels. Two measures, called the device independent information measure (DI) and the computer independent information measure (CI), defined on the software and task content levels respectively, are given as the amount of information transmitted. Two information transmission rates are defined as DI/T and CI/T, where T is the task completion time: the device independent information transmission rate (RDI), and the computer independent information transmission rate (RCI). The method utilizes the RDI and RCI rates to evaluate relatively the usability of software and device operations on different computer systems. Experiments using three different systems, in this case a graphical information input task, confirm that the method offers an efficient way of determining computer usability.

Usability Evaluation of Electronic Health Record System around Clinical Notes Usage-An Ethnographic Study.

PubMed

Rizvi, Rubina F; Marquard, Jenna L; Hultman, Gretchen M; Adam, Terrence J; Harder, Kathleen A; Melton, Genevieve B

2017-10-01

Background A substantial gap exists between current Electronic Health Record (EHR) usability and potential optimal usability. One of the fundamental reasons for this discrepancy is poor incorporation of a User-Centered Design (UCD) approach during the Graphical User Interface (GUI) development process. Objective To evaluate usability strengths and weaknesses of two widely implemented EHR GUIs for critical clinical notes usage tasks. Methods Twelve Internal Medicine resident physicians interacting with one of the two EHR systems (System-1 at Location-A and System-2 at Location-B) were observed by two usability evaluators employing an ethnographic approach. User comments and observer findings were analyzed for two critical tasks: (1) clinical notes entry and (2) related information-seeking tasks. Data were analyzed from two standpoints: (1) usability references categorized by usability evaluators as positive, negative, or equivocal and (2) usability impact of each feature measured through a 7-point severity rating scale. Findings were also validated by user responses to a post observation questionnaire. Results For clinical notes entry, System-1 surpassed System-2 with more positive (26% vs. 12%) than negative (12% vs. 34%) usability references. Greatest impact features on EHR usability (severity score pertaining to each feature) for clinical notes entry were: autopopulation (6), screen options (5.5), communication (5), copy pasting (4.5), error prevention (4.5), edit ability (4), and dictation and transcription (3.5). Both systems performed equally well on information-seeking tasks and features with greatest impacts on EHR usability were navigation for notes (7) and others (e.g., looking for ancillary data; 5.5). Ethnographic observations were supported by follow-up questionnaire responses. Conclusion This study provides usability-specific insights to inform future, improved, EHR interface that is better aligned with UCD approach.

A comparison of usability factors of four mobile devices for accessing healthcare information by adolescents.

PubMed

Sheehan, B; Lee, Y; Rodriguez, M; Tiase, V; Schnall, R

2012-01-01

Mobile health (mHealth) is a growing field aimed at developing mobile information and communication technologies for healthcare. Adolescents are known for their ubiquitous use of mobile technologies in everyday life. However, the use of mHealth tools among adolescents is not well described. We examined the usability of four commonly used mobile devices (an iPhone, an Android with touchscreen keyboard, an Android with built-in keyboard, and an iPad) for accessing healthcare information among a group of urban-dwelling adolescents. Guided by the FITT (Fit between Individuals, Task, and Technology) framework, a thinkaloud protocol was combined with a questionnaire to describe usability on three dimensions: 1) task-technology fit; 2) individual-technology fit; and 3) individual-task fit. For task-technology fit, we compared the efficiency, and effectiveness of each of the devices tested and found that the iPhone was the most usable had the fewest errors and prompts and had the lowest mean overall task time For individual-task fit, we compared efficiency and learnability measures by website tasks and found no statistically significant effect on tasks steps, task time and number of errors. Following our comparison of success rates by website tasks, we compared the difference between two mobile applications which were used for diet tracking and found statistically significant effect on tasks steps, task time and number of errors. For individual-technology fit, interface quality was significantly different across devices indicating that this is an important factor to be considered in developing future mobile devices. All of our users were able to complete all of the tasks, however the time needed to complete the tasks was significantly different by mobile device and mHealth application. Future design of mobile technology and mHealth applications should place particular importance on interface quality.

Exploring the Role of Usability in the Software Process: A Study of Irish Software SMEs

NASA Astrophysics Data System (ADS)

O'Connor, Rory V.

This paper explores the software processes and usability techniques used by Small and Medium Enterprises (SMEs) that develop web applications. The significance of this research is that it looks at development processes used by SMEs in order to assess to what degree usability is integrated into the process. This study seeks to gain an understanding into the level of awareness of usability within SMEs today and their commitment to usability in practice. The motivation for this research is to explore the current development processes used by SMEs in developing web applications and to understand how usability is represented in those processes. The background for this research is provided by the growth of the web application industry beyond informational web sites to more sophisticated applications delivering a broad range of functionality. This paper presents an analysis of the practices of several Irish SMEs that develop web applications through a series of case studies. With the focus on SMEs that develop web applications as Management Information Systems and not E-Commerce sites, informational sites, online communities or web portals. This study gathered data about the usability techniques practiced by these companies and their awareness of usability in the context of the software process in those SMEs. The contribution of this study is to further the understanding of the current role of usability within the software development processes of SMEs that develop web applications.

Usability evaluation techniques in mobile commerce applications: A systematic review

NASA Astrophysics Data System (ADS)

Hussain, Azham; Mkpojiogu, Emmanuel O. C.

2016-08-01

Obviously, there are a number of literatures concerning the usability of mobile commerce (m-commerce) applications and related areas, but they do not adequately provide knowledge about usability techniques used in most of the empirical usability evaluation for m-commerce application. Therefore, this paper is aimed at producing the usability techniques frequently used in the aspect of usability evaluation for m-commerce applications. To achieve the stated objective, systematic literature review was employed. Sixty seven papers were downloaded in usability evaluation for m-commerce and related areas; twenty one most relevant studies were selected for review in order to extract the appropriate information. The results from the review shows that heuristic evaluation, formal test and think aloud methods are the most commonly used methods in m-commerce application in comparison to cognitive walkthrough and the informal test methods. Moreover, most of the studies applied control experiment (33.3% of the total studies); other studies that applied case study for usability evaluation are 14.28%. The results from this paper provide additional knowledge to the usability practitioners and research community for the current state and use of usability techniques in m-commerce application.

Developing a quit smoking website that is usable by people with severe mental illnesses.

PubMed

Ferron, Joelle C; Brunette, Mary F; McHugo, Gregory J; Devitt, Timothy S; Martin, Wendy M; Drake, Robert E

2011-01-01

Evidence-based treatments may be delivered in computerized, web-based formats. This strategy can deliver the intervention consistently with minimal treatment provider time and cost. However, standard web sites may not be usable by people with severe mental illnesses who may experience cognitive deficits and low computer experience. This manuscript reports on the iterative development and usability testing of a website designed to educate and motivate adults with severe mental illnesses to engage in smoking cessation activities. Three phases of semi-structured interviews were performed with participants after they used the program and combined with information from screen-recorded usability data. T-tests compared the differences between uses of the first computer program version and a later version. Iteratively conducted usability tests demonstrated an increased ease of use from the first to the last version of the website through significant improvement in the percentage of unproductive clicking along with fewer questions asked about how to use the program. The improvement in use of the website resulted from changes such as: integrating a mouse tutorial, increasing font sizes, and increasing button sizes. The website usability recommendations provide some guidelines for interventionists developing web tools for people who experience serious psychiatric disabilities. In general, insights from the study highlight the need for thoughtful design and usability testing when creating a website for people with severe mental illness.

Evaluating the Usability of a Free Electronic Health Record for Training

PubMed Central

Hoyt, Robert; Adler, Kenneth; Ziesemer, Brandy; Palombo, Georgina

2013-01-01

The United States will need to train a large workforce of skilled health information technology (HIT) professionals in order to meet the US government's goal of universal electronic health records (EHRs) for all patients and widespread health information exchange. The Health Information Technology for Economic and Clinical Health (HITECH) Act established several HIT workforce educational programs to accomplish this goal. Recent studies have shown that EHR usability is a significant concern of physicians and is a potential obstacle to EHR adoption. It is important to have a highly usable EHR to train both clinicians and students. In this article, we report a qualitative-quantitative usability analysis of a web-based EHR for training health informatics and health information management students. PMID:23805062

A usability evaluation toolkit for In-Vehicle Information Systems (IVISs).

PubMed

Harvey, Catherine; Stanton, Neville A; Pickering, Carl A; McDonald, Mike; Zheng, Pengjun

2011-05-01

Usability must be defined specifically for the context of use of the particular system under investigation. This specific context of use should also be used to guide the definition of specific usability criteria and the selection of appropriate evaluation methods. There are four principles which can guide the selection of evaluation methods, relating to the information required in the evaluation, the stage at which to apply methods, the resources required and the people involved in the evaluation. This paper presents a framework for the evaluation of usability in the context of In-Vehicle Information Systems (IVISs). This framework guides designers through defining usability criteria for an evaluation, selecting appropriate evaluation methods and applying those methods. These stages form an iterative process of design-evaluation-redesign with the overall aim of improving the usability of IVISs and enhancing the driving experience, without compromising the safety of the driver. Copyright © 2010 Elsevier Ltd and The Ergonomics Society. All rights reserved.

77 FR 25707 - Submission for OMB Review; Comment request

Federal Register 2010, 2011, 2012, 2013, 2014

2012-05-01

... and OMB Number: Electronic Health Record (EHR) Usability Survey; OMB Control Number 0720-TBD. Type of... information collection is to develop a longitudinal measure of how end-users perceive the usability of the... the focus has shifted towards understanding the usability of a system. This usability attribute...

How the Website Usability Elements Impact Performance

NASA Astrophysics Data System (ADS)

Aljukhadar, Muhammad; Senecal, Sylvain

This research builds on the results of a large scale study in which participants performed an informational task on one of 59 websites spanning various industries to examine how the website usability elements (graphical attractiveness, information, interactivity, trust, and ease of use) drive users’ attitudes and intentions toward the website and how these effects vary according to site experience and end product tangibility. Results show that while the effects of site interactivity and graphical attractiveness were more influential for services sites, the effects of site information and trust were stronger for tangibles sites. Alternatively, compared to returning site visitors, first-time visitors perceived the website as less easy to use, needed more time to accomplish the online task, and based positive attitudes and intentions more strongly on the site information and interactivity. The results of a second study performed in a proximate culture largely corroborate these findings.

Usability Evaluation of Public Web Mapping Sites

NASA Astrophysics Data System (ADS)

Wang, C.

2014-04-01

Web mapping sites are interactive maps that are accessed via Webpages. With the rapid development of Internet and Geographic Information System (GIS) field, public web mapping sites are not foreign to people. Nowadays, people use these web mapping sites for various reasons, in that increasing maps and related map services of web mapping sites are freely available for end users. Thus, increased users of web mapping sites led to more usability studies. Usability Engineering (UE), for instance, is an approach for analyzing and improving the usability of websites through examining and evaluating an interface. In this research, UE method was employed to explore usability problems of four public web mapping sites, analyze the problems quantitatively and provide guidelines for future design based on the test results. Firstly, the development progress for usability studies were described, and simultaneously several usability evaluation methods such as Usability Engineering (UE), User-Centered Design (UCD) and Human-Computer Interaction (HCI) were generally introduced. Then the method and procedure of experiments for the usability test were presented in detail. In this usability evaluation experiment, four public web mapping sites (Google Maps, Bing maps, Mapquest, Yahoo Maps) were chosen as the testing websites. And 42 people, who having different GIS skills (test users or experts), gender (male or female), age and nationality, participated in this test to complete the several test tasks in different teams. The test comprised three parts: a pretest background information questionnaire, several test tasks for quantitative statistics and progress analysis, and a posttest questionnaire. The pretest and posttest questionnaires focused on gaining the verbal explanation of their actions qualitatively. And the design for test tasks targeted at gathering quantitative data for the errors and problems of the websites. Then, the results mainly from the test part were analyzed. The success rate from different public web mapping sites was calculated and compared, and displayed by the means of diagram. And the answers from questionnaires were also classified and organized in this part. Moreover, based on the analysis, this paper expands the discussion about the layout, map visualization, map tools, search logic and etc. Finally, this paper closed with some valuable guidelines and suggestions for the design of public web mapping sites. Also, limitations for this research stated in the end.

User needs analysis and usability assessment of DataMed - a biomedical data discovery index.

PubMed

Dixit, Ram; Rogith, Deevakar; Narayana, Vidya; Salimi, Mandana; Gururaj, Anupama; Ohno-Machado, Lucila; Xu, Hua; Johnson, Todd R

2017-11-30

To present user needs and usability evaluations of DataMed, a Data Discovery Index (DDI) that allows searching for biomedical data from multiple sources. We conducted 2 phases of user studies. Phase 1 was a user needs analysis conducted before the development of DataMed, consisting of interviews with researchers. Phase 2 involved iterative usability evaluations of DataMed prototypes. We analyzed data qualitatively to document researchers' information and user interface needs. Biomedical researchers' information needs in data discovery are complex, multidimensional, and shaped by their context, domain knowledge, and technical experience. User needs analyses validate the need for a DDI, while usability evaluations of DataMed show that even though aggregating metadata into a common search engine and applying traditional information retrieval tools are promising first steps, there remain challenges for DataMed due to incomplete metadata and the complexity of data discovery. Biomedical data poses distinct problems for search when compared to websites or publications. Making data available is not enough to facilitate biomedical data discovery: new retrieval techniques and user interfaces are necessary for dataset exploration. Consistent, complete, and high-quality metadata are vital to enable this process. While available data and researchers' information needs are complex and heterogeneous, a successful DDI must meet those needs and fit into the processes of biomedical researchers. Research directions include formalizing researchers' information needs, standardizing overviews of data to facilitate relevance judgments, implementing user interfaces for concept-based searching, and developing evaluation methods for open-ended discovery systems such as DDIs. © The Author 2017. Published by Oxford University Press on behalf of the American Medical Informatics Association. All rights reserved. For Permissions, please email: journals.permissions@oup.com

Usability evaluation of an emergency department information system prototype designed using cognitive systems engineering techniques.

PubMed

Clark, Lindsey N; Benda, Natalie C; Hegde, Sudeep; McGeorge, Nicolette M; Guarrera-Schick, Theresa K; Hettinger, A Zachary; LaVergne, David T; Perry, Shawna J; Wears, Robert L; Fairbanks, Rollin J; Bisantz, Ann M

2017-04-01

This article presents an evaluation of novel display concepts for an emergency department information system (EDIS) designed using cognitive systems engineering methods. EDISs assist emergency medicine staff with tracking patient care and ED resource allocation. Participants performed patient planning and orientation tasks using the EDIS displays and rated the display's ability to support various cognitive performance objectives along with the usability, usefulness, and predicted frequency of use for 18 system components. Mean ratings were positive for cognitive performance support objectives, usability, usefulness, and frequency of use, demonstrating the successful application of design methods to create useful and usable EDIS concepts that provide cognitive support for emergency medicine staff. Nurse and provider roles had significantly different perceptions of the usability and usefulness of certain EDIS components, suggesting that they have different information needs while working. Copyright © 2016 Elsevier Ltd. All rights reserved.

Usability evaluation of an emergency department information system prototype designed using cognitive systems engineering techniques

PubMed Central

Clark, Lindsey N.; Benda, Natalie C.; Hegde, Sudeep; McGeorge, Nicolette M.; Guarrera-Schick, Theresa K.; Hettinger, A. Zachary; LaVergne, David T.; Perry, Shawna J.; Wears, Robert L.; Fairbanks, Rollin J.; Bisantz, Ann M.

2017-01-01

This article presents an evaluation of novel display concepts for an emergency department information system (EDIS) designed using cognitive systems engineering methods. EDISs assist emergency medicine staff with tracking patient care and ED resource allocation. Participants performed patient planning and orientation tasks using the EDIS displays and rated the display’s ability to support various cognitive performance objectives along with the usability, usefulness, and predicted frequency of use for 18 system components. Mean ratings were positive for cognitive performance support objectives, usability, usefulness, and frequency of use, demonstrating the successful application of design methods to create useful and usable EDIS concepts that provide cognitive support for emergency medicine staff. Nurse and provider roles had significantly different perceptions of the usability and usefulness of certain EDIS components, suggesting that they have different information needs while working. PMID:28166896

Beyond Effectiveness: A Pragmatic Evaluation Framework for Learning and Continuous Quality Improvement of e-Learning Interventions in Healthcare.

PubMed

Dafalla, Tarig Dafalla Mohamed; Kushniruk, Andre W; Borycki, Elizabeth M

2015-01-01

A pragmatic evaluation framework for evaluating the usability and usefulness of an e-learning intervention for a patient clinical information scheduling system is presented in this paper. The framework was conceptualized based on two different but related concepts (usability and usefulness) and selection of appropriate and valid methods of data collection and analysis that included: (1) Low-Cost Rapid Usability Engineering (LCRUE), (2) Cognitive Task Analysis (CTA), (3) Heuristic Evaluation (HE) criteria for web-based learning, and (4) Software Usability Measurement Inventory (SUMI). The results of the analysis showed some areas where usability that were related to General Interface Usability (GIU), instructional design and content was problematic; some of which might account for the poorly rated aspects of usability when subjectively measured. This paper shows that using a pragmatic framework can be a useful way, not only for measuring the usability and usefulness, but also for providing a practical objective evidences for learning and continuous quality improvement of e-learning systems. The findings should be of interest to educators, developers, designers, researchers, and usability practitioners involved in the development of e-learning systems in healthcare. This framework could be an appropriate method for assessing the usability, usefulness and safety of health information systems both in the laboratory and in the clinical context.

Usability study of the EduMod eLearning Program for contouring nodal stations of the head and neck.

PubMed

Deraniyagala, Rohan; Amdur, Robert J; Boyer, Arthur L; Kaylor, Scott

2015-01-01

A major strategy for improving radiation oncology education and competence evaluation is to develop eLearning programs that reproduce the real work environment. A valuable measure of the quality of an eLearning program is "usability," which is a multidimensional endpoint defined from the end user's perspective. The gold standard for measuring usability is the Software Usability Measurement Inventory (SUMI). The purpose of this study is to use the SUMI to measure usability of an eLearning course that uses innovative software to teach and test contouring of nodal stations of the head and neck. This is a prospective institutional review board-approved study in which all participants gave written informed consent. The study population was radiation oncology residents from 8 different programs across the United States. The subjects had to pass all sections of the same 2 eLearning modules and then complete the SUMI usability evaluation instrument. We reached the accrual goal of 25 participants. Usability results for the EduMod eLearning course, "Nodal Stations of the Head and Neck," were compared with a large database of scores of other major software programs. Results were evaluated in 5 domains: Affect, Helpfulness, Control, Learnability, and Global Usability. In all 5 domains, usability scores for the study modules were higher than the database mean and statistically superior in 4 domains. This is the first study to evaluate usability of an eLearning program related to radiation oncology. Usability of 2 representative modules related to contouring nodal stations of the head and neck was highly favorable, with scores that were superior to the industry standard in multiple domains. These results support the continued development of this type of eLearning program for teaching and testing radiation oncology technical skills. Copyright © 2015 American Society for Radiation Oncology. Published by Elsevier Inc. All rights reserved.

Usability Evaluation at the Point-of-Care: A Method to Identify User Information Needs in CPOE Applications

PubMed Central

Washburn, Jeff; Fiol, Guilherme Del; Rocha, Roberto A.

2006-01-01

Point of care usability evaluation may help identify information needs that occur during the process of providing care. We describe the process of using usability-specific recording software to record Computerized Physician Order Entry (CPOE) ordering sessions on admitted adult and pediatric patients at two urban tertiary hospitals in the Intermountain Healthcare system of hospitals. PMID:17238756

The use of think-aloud and instant data analysis in evaluation research: Exemplar and lessons learned.

PubMed

Joe, Jonathan; Chaudhuri, Shomir; Le, Thai; Thompson, Hilaire; Demiris, George

2015-08-01

While health information technologies have become increasingly popular, many have not been formally tested to ascertain their usability. Traditional rigorous methods take significant amounts of time and manpower to evaluate the usability of a system. In this paper, we evaluate the use of instant data analysis (IDA) as developed by Kjeldskov et al. to perform usability testing on a tool designed for older adults and caregivers. The IDA method is attractive because it takes significantly less time and manpower than the traditional usability testing methods. In this paper we demonstrate how IDA was used to evaluate usability of a multifunctional wellness tool, discuss study results and lessons learned while using this method. We also present findings from an extension of the method which allows the grouping of similar usability problems in an efficient manner. We found that the IDA method is a quick, relatively easy approach to identifying and ranking usability issues among health information technologies. Copyright © 2015 Elsevier Inc. All rights reserved.

The Imperative of Solving Nurses' Usability Problems With Health Information Technology.

PubMed

Staggers, Nancy; Elias, Beth L; Makar, Ellen; Alexander, Gregory L

2018-04-01

Health information technology (IT) usability issues are a key concern for nurse executives and nurses. The aims of this study are to understand usability pain points faced by nurses regarding the use of health IT, identify their impact and importance, discuss responsibilities, and develop possible solutions to improve the health IT-user experience for nurses. Twenty-seven experts were interviewed including nursing leaders, informaticists, executives, engineers, researchers, and human factors experts across acute care, long-term care, and vendor settings. Semistructured questions guided the interviews, and content analysis was used to identify themes. Four themes emerged: 1) user experience pain points, 2) importance of the issues, 3) the responsibility gap, and 4) acting on usability issues. Nurses continue to endure significant health IT-usability issues that negatively impact patients, nurses, and healthcare organizations. Solutions include enhancing the voice of nursing at the national and local levels, creating a digital strategy for nursing, providing incentives to improve usability in health IT, and accelerating the understanding of nurses' work intended to inform and translate nurses' work into health IT design.

Towards a Usability and Error "Safety Net": A Multi-Phased Multi-Method Approach to Ensuring System Usability and Safety.

PubMed

Kushniruk, Andre; Senathirajah, Yalini; Borycki, Elizabeth

2017-01-01

The usability and safety of health information systems have become major issues in the design and implementation of useful healthcare IT. In this paper we describe a multi-phased multi-method approach to integrating usability engineering methods into system testing to ensure both usability and safety of healthcare IT upon widespread deployment. The approach involves usability testing followed by clinical simulation (conducted in-situ) and "near-live" recording of user interactions with systems. At key stages in this process, usability problems are identified and rectified forming a usability and technology-induced error "safety net" that catches different types of usability and safety problems prior to releasing systems widely in healthcare settings.

A web-based program for informal caregivers of persons with Alzheimer's disease: an iterative user-centered design.

PubMed

Cristancho-Lacroix, Victoria; Moulin, Florence; Wrobel, Jérémy; Batrancourt, Bénédicte; Plichart, Matthieu; De Rotrou, Jocelyne; Cantegreil-Kallen, Inge; Rigaud, Anne-Sophie

2014-09-15

Web-based programs have been developed for informal caregivers of people with Alzheimer's disease (PWAD). However, these programs can prove difficult to adopt, especially for older people, who are less familiar with the Internet than other populations. Despite the fundamental role of usability testing in promoting caregivers' correct use and adoption of these programs, to our knowledge, this is the first study describing this process before evaluating a program for caregivers of PWAD in a randomized clinical trial. The objective of the study was to describe the development process of a fully automated Web-based program for caregivers of PWAD, aiming to reduce caregivers' stress, and based on the user-centered design approach. There were 49 participants (12 health care professionals, 6 caregivers, and 31 healthy older adults) that were involved in a double iterative design allowing for the adaptation of program content and for the enhancement of website usability. This process included three component parts: (1) project team workshops, (2) a proof of concept, and (3) two usability tests. The usability tests were based on a mixed methodology using behavioral analysis, semistructured interviews, and a usability questionnaire. The user-centered design approach provided valuable guidelines to adapt the content and design of the program, and to improve website usability. The professionals, caregivers (mainly spouses), and older adults considered that our project met the needs of isolated caregivers. Participants underlined that contact between caregivers would be desirable. During usability observations, the mistakes of users were also due to ergonomics issues from Internet browsers and computer interfaces. Moreover, negative self-stereotyping was evidenced, when comparing interviews and results of behavioral analysis. Face-to-face psycho-educational programs may be used as a basis for Web-based programs. Nevertheless, a user-centered design approach involving targeted users (or their representatives) remains crucial for their correct use and adoption. For future user-centered design studies, we recommend to involve end-users from preconception stages, using a mixed research method in usability evaluations, and implementing pilot studies to evaluate acceptability and feasibility of programs.

Using Cluster Analysis to Extend Usability Testing to Instructional Content. CRESST Report 816

ERIC Educational Resources Information Center

Kerr, Deirdre S.; Chung, Gregory K. W. K.

2012-01-01

Commercial video games undergo usability studies to determine the degree to which the player is able to learn, control, and understand the game. Usability studies allow game designers to improve their games before they are released to the public. If usability studies could be expanded to include information about the presentation of the…

An Evaluation of Understandability of Patient Journey Models in Mental Health.

PubMed

Percival, Jennifer; McGregor, Carolyn

2016-07-28

There is a significant trend toward implementing health information technology to reduce administrative costs and improve patient care. Unfortunately, little awareness exists of the challenges of integrating information systems with existing clinical practice. The systematic integration of clinical processes with information system and health information technology can benefit the patients, staff, and the delivery of care. This paper presents a comparison of the degree of understandability of patient journey models. In particular, the authors demonstrate the value of a relatively new patient journey modeling technique called the Patient Journey Modeling Architecture (PaJMa) when compared with traditional manufacturing based process modeling tools. The paper also presents results from a small pilot case study that compared the usability of 5 modeling approaches in a mental health care environment. Five business process modeling techniques were used to represent a selected patient journey. A mix of both qualitative and quantitative methods was used to evaluate these models. Techniques included a focus group and survey to measure usability of the various models. The preliminary evaluation of the usability of the 5 modeling techniques has shown increased staff understanding of the representation of their processes and activities when presented with the models. Improved individual role identification throughout the models was also observed. The extended version of the PaJMa methodology provided the most clarity of information flows for clinicians. The extended version of PaJMa provided a significant improvement in the ease of interpretation for clinicians and increased the engagement with the modeling process. The use of color and its effectiveness in distinguishing the representation of roles was a key feature of the framework not present in other modeling approaches. Future research should focus on extending the pilot case study to a more diversified group of clinicians and health care support workers.

A literature review about usability evaluation methods for e-learning platforms.

PubMed

Freire, Luciana Lopes; Arezes, Pedro Miguel; Campos, José Creissac

2012-01-01

The usability analysis of information systems has been the target of several research studies over the past thirty years. These studies have highlighted a great diversity of points of view, including researchers from different scientific areas such as Ergonomics, Computer Science, Design and Education. Within the domain of information ergonomics, the study of tools and methods used for usability evaluation dedicated to E-learning presents evidence that there is a continuous and dynamic evolution of E-learning systems, in many different contexts -academics and corporative. These systems, also known as LMS (Learning Management Systems), can be classified according to their educational goals and their technological features. However, in these systems the usability issues are related with the relationship/interactions between user and system in the user's context. This review is a synthesis of research project about Information Ergonomics and embraces three dimensions, namely the methods, models and frameworks that have been applied to evaluate LMS. The study also includes the main usability criteria and heuristics used. The obtained results show a notorious change in the paradigms of usability, with which it will be possible to discuss about the studies carried out by different researchers that were focused on usability ergonomic principles aimed at E-learning.

A Pedagogical Approach toward Teaching an Information Systems Student How to Conduct a Web Usability Study for an Honors Project: A Case Study

ERIC Educational Resources Information Center

Jesse, Gayle

2013-01-01

The purpose of this paper is to provide educators with a course model and pedagogy to teach a computer information systems usability course. This paper offers a case study based on an honors student project titled "Web Usability: Phases of Developing an Interactive Event Database." Each individual phase--creating a prototype along with…

Usability Evaluation of NLP-PIER: A Clinical Document Search Engine for Researchers.

PubMed

Hultman, Gretchen; McEwan, Reed; Pakhomov, Serguei; Lindemann, Elizabeth; Skube, Steven; Melton, Genevieve B

2017-01-01

NLP-PIER (Natural Language Processing - Patient Information Extraction for Research) is a self-service platform with a search engine for clinical researchers to perform natural language processing (NLP) queries using clinical notes. We conducted user-centered testing of NLP-PIER's usability to inform future design decisions. Quantitative and qualitative data were analyzed. Our findings will be used to improve the usability of NLP-PIER.

Applying human factors principles to alert design increases efficiency and reduces prescribing errors in a scenario-based simulation

PubMed Central

Russ, Alissa L; Zillich, Alan J; Melton, Brittany L; Russell, Scott A; Chen, Siying; Spina, Jeffrey R; Weiner, Michael; Johnson, Elizabette G; Daggy, Joanne K; McManus, M Sue; Hawsey, Jason M; Puleo, Anthony G; Doebbeling, Bradley N; Saleem, Jason J

2014-01-01

Objective To apply human factors engineering principles to improve alert interface design. We hypothesized that incorporating human factors principles into alerts would improve usability, reduce workload for prescribers, and reduce prescribing errors. Materials and methods We performed a scenario-based simulation study using a counterbalanced, crossover design with 20 Veterans Affairs prescribers to compare original versus redesigned alerts. We redesigned drug–allergy, drug–drug interaction, and drug–disease alerts based upon human factors principles. We assessed usability (learnability of redesign, efficiency, satisfaction, and usability errors), perceived workload, and prescribing errors. Results Although prescribers received no training on the design changes, prescribers were able to resolve redesigned alerts more efficiently (median (IQR): 56 (47) s) compared to the original alerts (85 (71) s; p=0.015). In addition, prescribers rated redesigned alerts significantly higher than original alerts across several dimensions of satisfaction. Redesigned alerts led to a modest but significant reduction in workload (p=0.042) and significantly reduced the number of prescribing errors per prescriber (median (range): 2 (1–5) compared to original alerts: 4 (1–7); p=0.024). Discussion Aspects of the redesigned alerts that likely contributed to better prescribing include design modifications that reduced usability-related errors, providing clinical data closer to the point of decision, and displaying alert text in a tabular format. Displaying alert text in a tabular format may help prescribers extract information quickly and thereby increase responsiveness to alerts. Conclusions This simulation study provides evidence that applying human factors design principles to medication alerts can improve usability and prescribing outcomes. PMID:24668841

Applying human factors principles to alert design increases efficiency and reduces prescribing errors in a scenario-based simulation.

PubMed

Russ, Alissa L; Zillich, Alan J; Melton, Brittany L; Russell, Scott A; Chen, Siying; Spina, Jeffrey R; Weiner, Michael; Johnson, Elizabette G; Daggy, Joanne K; McManus, M Sue; Hawsey, Jason M; Puleo, Anthony G; Doebbeling, Bradley N; Saleem, Jason J

2014-10-01

To apply human factors engineering principles to improve alert interface design. We hypothesized that incorporating human factors principles into alerts would improve usability, reduce workload for prescribers, and reduce prescribing errors. We performed a scenario-based simulation study using a counterbalanced, crossover design with 20 Veterans Affairs prescribers to compare original versus redesigned alerts. We redesigned drug-allergy, drug-drug interaction, and drug-disease alerts based upon human factors principles. We assessed usability (learnability of redesign, efficiency, satisfaction, and usability errors), perceived workload, and prescribing errors. Although prescribers received no training on the design changes, prescribers were able to resolve redesigned alerts more efficiently (median (IQR): 56 (47) s) compared to the original alerts (85 (71) s; p=0.015). In addition, prescribers rated redesigned alerts significantly higher than original alerts across several dimensions of satisfaction. Redesigned alerts led to a modest but significant reduction in workload (p=0.042) and significantly reduced the number of prescribing errors per prescriber (median (range): 2 (1-5) compared to original alerts: 4 (1-7); p=0.024). Aspects of the redesigned alerts that likely contributed to better prescribing include design modifications that reduced usability-related errors, providing clinical data closer to the point of decision, and displaying alert text in a tabular format. Displaying alert text in a tabular format may help prescribers extract information quickly and thereby increase responsiveness to alerts. This simulation study provides evidence that applying human factors design principles to medication alerts can improve usability and prescribing outcomes. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

Information accountability and usability: are there any connections?

PubMed

Sahama, Tony; Kushniruk, Andre; Kuwata, Shigeki

2013-01-01

Availability of health information is rapidly increasing and the expansion and proliferation of health information is inevitable. The Electronic Healthcare Record, Electronic Medical Record and Personal Health Record are at the core of this trend and are required for appropriate and practicable exchange and sharing of health information. However, it is becoming increasingly recognized that it is essential to preserve patient privacy and information security when utilising sensitive information for clinical, management and administrative processes. Furthermore, the usability of emerging healthcare applications is also becoming a growing concern. This paper proposes a novel approach for integrating consideration of information accountability with a perspective from usability engineering that can be applied when developing healthcare information technology applications. A social networking user case in the healthcare information exchange will be presented in the context of our approach.

Record completeness and data concordance in an anesthesia information management system using context-sensitive mandatory data-entry fields.

PubMed

Avidan, Alexander; Weissman, Charles

2012-03-01

Use of an anesthesia information management system (AIMS) does not insure record completeness and data accuracy. Mandatory data-entry fields can be used to assure data completeness. However, they are not suited for data that is mandatory depending on the clinical situation (context sensitive). For example, information on equal breath sounds should be mandatory with tracheal intubation, but not with mask ventilation. It was hypothesized that employing context-sensitive mandatory data-entry fields can insure high data-completeness and accuracy while maintaining usability. A commercial off-the-shelf AIMS was enhanced using its built-in VBScript programming tool to build event-driven forms with context-sensitive mandatory data-entry fields. One year after introduction of the system, all anesthesia records were reviewed for data completeness. Data concordance, used as a proxy for accuracy, was evaluated using verifiable age-related data. Additionally, an anonymous satisfaction survey on general acceptance and usability of the AIMS was performed. During the initial 12 months of AIMS use, 12,241 (99.6%) of 12,290 anesthesia records had complete data. Concordances of entered data (weight, size of tracheal tubes, laryngoscopy blades and intravenous catheters) with patients' ages were 98.7-99.9%. The AIMS implementation was deemed successful by 98% of the anesthesiologists. Users rated the AIMS usability in general as very good and the data-entry forms in particular as comfortable. Due to the complexity and the high costs of implementation of an anesthesia information management system it was not possible to compare various system designs (for example with or without context-sensitive mandatory data entry-fields). Therefore, it is possible that a different or simpler design would have yielded the same or even better results. This refers also to the evaluation of usability, since users did not have the opportunity to work with different design approaches or even different computer programs. Using context-sensitive mandatory fields in an anesthesia information management system was associated with high record completeness rate and data concordance. In addition, the system's usability was rated as very good by its users. Copyright © 2011 Elsevier Ireland Ltd. All rights reserved.

Four Current Awareness Databases: Coverage and Currency Compared.

ERIC Educational Resources Information Center

Jaguszewski, Janice M.; Kempf, Jody L.

1995-01-01

Discusses the usability and content of the following table of contents (TOC) databases selected by science and engineering librarians at the University of Minnesota Twin Cities: Current Contents on Diskette (CCoD), CARL Uncover2, Inside Information, and Contents1st. (AEF)

Usability Methods for Ensuring Health Information Technology Safety: Evidence-Based Approaches. Contribution of the IMIA Working Group Health Informatics for Patient Safety.

PubMed

Borycki, E; Kushniruk, A; Nohr, C; Takeda, H; Kuwata, S; Carvalho, C; Bainbridge, M; Kannry, J

2013-01-01

Issues related to lack of system usability and potential safety hazards continue to be reported in the health information technology (HIT) literature. Usability engineering methods are increasingly used to ensure improved system usability and they are also beginning to be applied more widely for ensuring the safety of HIT applications. These methods are being used in the design and implementation of many HIT systems. In this paper we describe evidence-based approaches to applying usability engineering methods. A multi-phased approach to ensuring system usability and safety in healthcare is described. Usability inspection methods are first described including the development of evidence-based safety heuristics for HIT. Laboratory-based usability testing is then conducted under artificial conditions to test if a system has any base level usability problems that need to be corrected. Usability problems that are detected are corrected and then a new phase is initiated where the system is tested under more realistic conditions using clinical simulations. This phase may involve testing the system with simulated patients. Finally, an additional phase may be conducted, involving a naturalistic study of system use under real-world clinical conditions. The methods described have been employed in the analysis of the usability and safety of a wide range of HIT applications, including electronic health record systems, decision support systems and consumer health applications. It has been found that at least usability inspection and usability testing should be applied prior to the widespread release of HIT. However, wherever possible, additional layers of testing involving clinical simulations and a naturalistic evaluation will likely detect usability and safety issues that may not otherwise be detected prior to widespread system release. The framework presented in the paper can be applied in order to develop more usable and safer HIT, based on multiple layers of evidence.

'Televaluation' of clinical information systems: an integrative approach to assessing Web-based systems.

PubMed

Kushniruk, A W; Patel, C; Patel, V L; Cimino, J J

2001-04-01

The World Wide Web provides an unprecedented opportunity for widespread access to health-care applications by both patients and providers. The development of new methods for assessing the effectiveness and usability of these systems is becoming a critical issue. This paper describes the distance evaluation (i.e. 'televaluation') of emerging Web-based information technologies. In health informatics evaluation, there is a need for application of new ideas and methods from the fields of cognitive science and usability engineering. A framework is presented for conducting evaluations of health-care information technologies that integrates a number of methods, ranging from deployment of on-line questionnaires (and Web-based forms) to remote video-based usability testing of user interactions with clinical information systems. Examples illustrating application of these techniques are presented for the assessment of a patient clinical information system (PatCIS), as well as an evaluation of use of Web-based clinical guidelines. Issues in designing, prototyping and iteratively refining evaluation components are discussed, along with description of a 'virtual' usability laboratory.

Developing alternative over-the-counter medicine label formats: How do they compare when evaluated by consumers?

PubMed

Tong, Vivien; Raynor, David K; Aslani, Parisa

2018-03-01

In recent years, the Australian Therapeutic Goods Administration (TGA) has proposed implementing a standardized over-the-counter (OTC) medicine label. However, there were mixed consumer opinions regarding a label proposed in 2012 and limited evidence demonstrating the usability of the revised (2014) format. To develop and examine the usability of alternative OTC medicine label formats for standardization, and explore consumer perspectives on the labels. Four alternative labels were developed for the exemplar medicine diclofenac. One was based on the Medicine Information label proposed by the TGA ('Medicine Information'), one was based on the U.S. Drug Facts label ('Drug Facts'), and two were based on suggestions proposed by consumers in the earlier needs analysis phase of this research (referred to as the 'Medicine Facts' and 'Consumer Desires' label formats). Five cohorts of 10 participants were recruited. Each cohort was assigned to user test one of the alternative labels or an existing label for a proprietary diclofenac product (which acted as a comparator) for diagnostic purposes. Each participant then provided feedback on all 5 labels. Each interview consisted of the administration of a user testing questionnaire, measuring consumers' ability to find and understand key points of information, and a semi-structured interview exploring consumer perspectives. Overall, all 4 alternative label formats supported consumers' ability to find and understand key points. The existing comparator label was the poorer label with respect to participants' ability to find and understand key points. Factors such as perceived usability, color, design, content, and/or content ordering impacted consumer preferences. The 'Consumer Desires' or 'Drug Facts' label formats were most often preferred by consumers for use as the standardized OTC label over the TGA proposed format. All alternative label formats demonstrated satisfactory usability and could be considered for use in OTC label standardization. User testing of OTC labels and consumer feedback received as part of the testing process can assist in the refinement of OTC labeling to ensure that implemented policies are evidence-based. Copyright © 2017 Elsevier Inc. All rights reserved.

Health literacy and usability of clinical trial search engines.

PubMed

Utami, Dina; Bickmore, Timothy W; Barry, Barbara; Paasche-Orlow, Michael K

2014-01-01

Several web-based search engines have been developed to assist individuals to find clinical trials for which they may be interested in volunteering. However, these search engines may be difficult for individuals with low health and computer literacy to navigate. The authors present findings from a usability evaluation of clinical trial search tools with 41 participants across the health and computer literacy spectrum. The study consisted of 3 parts: (a) a usability study of an existing web-based clinical trial search tool; (b) a usability study of a keyword-based clinical trial search tool; and (c) an exploratory study investigating users' information needs when deciding among 2 or more candidate clinical trials. From the first 2 studies, the authors found that users with low health literacy have difficulty forming queries using keywords and have significantly more difficulty using a standard web-based clinical trial search tool compared with users with adequate health literacy. From the third study, the authors identified the search factors most important to individuals searching for clinical trials and how these varied by health literacy level.

Physician satisfaction with a critical care clinical information system using a multimethod evaluation of usability.

PubMed

Hudson, Darren; Kushniruk, Andre; Borycki, Elizabeth; Zuege, Danny J

2018-04-01

Physician satisfaction with electronic medical records has often been poor. Usability has frequently been identified as a source for decreased satisfaction. While surveys can identify many issues, and are logistically easier to administer, they may miss issues identified using other methods This study sought to understand the level of physician satisfaction and usability issues associated with a critical care clinical information system (eCritical Alberta) implemented throughout the province of Alberta, Canada. All critical care attending physicians using the system were invited to participate in an online survey. Questions included components of the User Acceptance of Information Technology and Usability Questionnaire as well as free text feedback on system components. Physicians were also invited to participate in a think aloud test using simulated scenarios. The transcribed think aloud text and questionnaire were subjected to textual analysis. 82% of all eligible physicians completed the on-line survey (n = 61). Eight physicians were invited and seven completed the think aloud test. Overall satisfaction with the system was moderate. Usability was identified as a significant factor contributing to satisfaction. The major usability factors identified were system response time and layout. The think aloud component identified additional factors beyond those identified in the on-line survey. This study found a modestly high level of physician satisfaction with a province-wide clinical critical care information system. Usability continues to be a significant factor in physician satisfaction. Using multiple methods of evaluation can capture the benefits of a large sample size and deeper understanding of the issues. Copyright © 2018 Elsevier B.V. All rights reserved.

Design and validation of a questionnaire to evaluate the usability of computerized critical care information systems.

PubMed

von Dincklage, Falk; Lichtner, Gregor; Suchodolski, Klaudiusz; Ragaller, Maximilian; Friesdorf, Wolfgang; Podtschaske, Beatrice

2017-08-01

The implementation of computerized critical care information systems (CCIS) can improve the quality of clinical care and staff satisfaction, but also holds risks of disrupting the workflow with consecutive negative impacts. The usability of CCIS is one of the key factors determining their benefits and weaknesses. However, no tailored instrument exists to measure the usability of such systems. Therefore, the aim of this study was to design and validate a questionnaire that measures the usability of CCIS. Following a mixed-method design approach, we developed a questionnaire comprising two evaluation models to assess the usability of CCIS: (1) the task-specific model rates the usability individually for several tasks which CCIS could support and which we derived by analyzing work processes in the ICU; (2) the characteristic-specific model rates the different aspects of the usability, as defined by the international standard "ergonomics of human-system interaction". We tested validity and reliability of the digital version of the questionnaire in a sample population. In the sample population of 535 participants both usability evaluation models showed a strong correlation with the overall rating of the system (multiple correlation coefficients ≥0.80) as well as a very high internal consistency (Cronbach's alpha ≥0.93). The novel questionnaire is a valid and reliable instrument to measure the usability of CCIS and can be used to study the influence of the usability on their implementation benefits and weaknesses.

Methods for Evaluating the Content, Usability, and Efficacy of Commercial Mobile Health Apps

PubMed Central

Silfee, Valerie J; Waring, Molly E; Boudreaux, Edwin D; Sadasivam, Rajani S; Mullen, Sean P; Carey, Jennifer L; Hayes, Rashelle B; Ding, Eric Y; Bennett, Gary G; Pagoto, Sherry L

2017-01-01

Commercial mobile apps for health behavior change are flourishing in the marketplace, but little evidence exists to support their use. This paper summarizes methods for evaluating the content, usability, and efficacy of commercially available health apps. Content analyses can be used to compare app features with clinical guidelines, evidence-based protocols, and behavior change techniques. Usability testing can establish how well an app functions and serves its intended purpose for a target population. Observational studies can explore the association between use and clinical and behavioral outcomes. Finally, efficacy testing can establish whether a commercial app impacts an outcome of interest via a variety of study designs, including randomized trials, multiphase optimization studies, and N-of-1 studies. Evidence in all these forms would increase adoption of commercial apps in clinical practice, inform the development of the next generation of apps, and ultimately increase the impact of commercial apps. PMID:29254914

Increasing EHR system usability through standards: Conformance criteria in the HL7 EHR-system functional model.

PubMed

Meehan, Rebecca A; Mon, Donald T; Kelly, Kandace M; Rocca, Mitra; Dickinson, Gary; Ritter, John; Johnson, Constance M

2016-10-01

Though substantial work has been done on the usability of health information technology, improvements in electronic health record system (EHR) usability have been slow, creating frustration, distrust of EHRs and the use of potentially unsafe work-arounds. Usability standards could be part of the solution for improving EHR usability. EHR system functional requirements and standards have been used successfully in the past to specify system behavior, the criteria of which have been gradually implemented in EHR systems through certification programs and other national health IT strategies. Similarly, functional requirements and standards for usability can help address the multitude of sequelae associated with poor usability. This paper describes the evidence-based functional requirements for usability contained in the Health Level Seven (HL7) EHR System Functional Model, and the benefits of open and voluntary EHR system usability standards. Copyright © 2016 Elsevier Inc. All rights reserved.

Older Workers' Communication Satisfaction in the Lodging Industry.

ERIC Educational Resources Information Center

Fu, Yao-Yi; Mount, Daniel J.

2002-01-01

Usable responses from 374 hotel employees compared the satisfaction with workplace communications of younger (n=80) and older workers (n=81). Differences in terms of downward and vertical communication, corporate information, communication climate, feedback, and coworker communication suggest different ways to manage workers. (Contains 33…

National questionnaire study on clinical ICT systems proofs: physicians suffer from poor usability.

PubMed

Viitanen, Johanna; Hyppönen, Hannele; Lääveri, Tinja; Vänskä, Jukka; Reponen, Jarmo; Winblad, Ilkka

2011-10-01

In the health informatics field, usability studies typically focus on evaluating a single information system and involve a rather small group of end-users. However, little is known about the usability of clinical information and communication technology (ICT) environment in which healthcare professionals work daily. This paper aims at contributing to usability research and user-oriented development of healthcare technologies with three objectives: inform researchers and practitioners about the current state of usability of clinical ICT systems, increase the understanding of usability aspects specific for clinical context, and encourage a more holistic approach on studying usability issues in health informatics field. A national web questionnaire study was conducted in Finland in spring 2010 with 3929 physicians actively working in patient care. For the purposes of the study, we described three dimensions of clinical ICT system usability that reflect the physicians' viewpoint on system usage: (1) compatibility between clinical ICT systems and physicians' tasks, (2) ICT support for information exchange, communication and collaboration in clinical work, and (3) interoperability and reliability. The dimensions derive from the definitions of usability and clinical context of use analysis, and reflect the ability of ICT systems to have a positive impact on patient care by supporting physicians in achieving their goals with a pleasant user experience. The research data incorporated 32 statements with a five-point Likert-scale on physicians' experiences on usability of their currently used ICT systems and a summative question about school grade given to electronic health record (EHR) systems. Physicians' estimates of their EHR systems were very critical. With the rating scale from 4 or fail to 10 or excellent, the average of the grades varied from 6.1 to 8.4 dependent on the kind of facility the physician is working. Questionnaire results indicated several usability problems and deficiencies which considerably hindered the efficiency of clinical ICT use and physician's routine work. Systems lacked the appropriate features to support typical clinical tasks, such as decision making, prevention of medical errors, and review of a patient's treatment chart. The systems also required physicians to perform fixed sequences of steps and tasks, and poorly supported the documentation and retrieval of patient data. The findings on ICT support for collaboration showed mainly negative results, aside from collaboration between co-located physicians. In addition, the study results pointed out physicians suffering from system failures and a lack of integration between the systems. The described study and related results are unique in several ways. A national usability study with nearly 4000 respondents had not been conducted in other countries in which healthcare technologies are widely adopted. The questionnaire study provided a generalized picture about the usability problems, however, it should be noted that there were significant differences between legacy systems in use. Previously, researchers had not approached contextual aspects of usability the context of clinical work, where numerous systems are in use. The described usability dimensions and the presented study results can be considered as the first step towards conceptualizing ICT usability in the unique setting of clinical work. Copyright © 2011 Elsevier Ireland Ltd. All rights reserved.

Systematic Heuristic Evaluation of Computerized Consultation Order Templates: Clinicians' and Human Factors Engineers' Perspectives.

PubMed

Savoy, April; Patel, Himalaya; Flanagan, Mindy E; Weiner, Michael; Russ, Alissa L

2017-08-01

We assessed the usability of consultation order templates and identified problems to prioritize in design efforts for improving referral communication. With a sample of 26 consultation order templates, three evaluators performed a usability heuristic evaluation. The evaluation used 14 domain-independent heuristics and the following three supplemental references: 1 new domain-specific heuristic, 6 usability goals, and coded clinicians' statements regarding ease of use for 10 sampled templates. Evaluators found 201 violations, a mean of 7.7 violations per template. Minor violations outnumbered major violations almost twofold, 115 (57%) to 62 (31%). Approximately 68% of violations were linked to 5 heuristics: aesthetic and minimalist design (17%), error prevention (16%), consistency and standards (14%), recognition rather than recall (11%), and meet referrers' information needs (10%). Severe violations were attributed mostly to meet referrers' information needs and recognition rather than recall. Recorded violations yielded potential negative consequences for efficiency, effectiveness, safety, learnability, and utility. Evaluators and clinicians demonstrated 80% agreement in usability assessment. Based on frequency and severity of usability heuristic violations, the consultation order templates reviewed may impede clinical efficiency and risk patient safety. Results support the following design considerations: communicate consultants' requirements, facilitate information seeking, and support communication. While the most frequent heuristic violations involved interaction design and presentation, the most severe violations lacked information desired by referring clinicians. Violations related to templates' inability to support referring clinicians' information needs had the greatest potential negative impact on efficiency and safety usability goals. Heuristics should be prioritized in future design efforts.

Using a medical simulation center as an electronic health record usability laboratory

PubMed Central

Landman, Adam B; Redden, Lisa; Neri, Pamela; Poole, Stephen; Horsky, Jan; Raja, Ali S; Pozner, Charles N; Schiff, Gordon; Poon, Eric G

2014-01-01

Usability testing is increasingly being recognized as a way to increase the usability and safety of health information technology (HIT). Medical simulation centers can serve as testing environments for HIT usability studies. We integrated the quality assurance version of our emergency department (ED) electronic health record (EHR) into our medical simulation center and piloted a clinical care scenario in which emergency medicine resident physicians evaluated a simulated ED patient and documented electronically using the ED EHR. Meticulous planning and close collaboration with expert simulation staff was important for designing test scenarios, pilot testing, and running the sessions. Similarly, working with information systems teams was important for integration of the EHR. Electronic tools are needed to facilitate entry of fictitious clinical results while the simulation scenario is unfolding. EHRs can be successfully integrated into existing simulation centers, which may provide realistic environments for usability testing, training, and evaluation of human–computer interactions. PMID:24249778

Usability/Sentiment for the Enterprise and ENTERPRISE

NASA Technical Reports Server (NTRS)

Meza, David; Berndt, Sarah

2014-01-01

The purpose of the Sentiment of Search Study for NASA Johnson Space Center (JSC) is to gain insight into the intranet search environment. With an initial usability survey, the authors were able to determine a usability score based on the Systems Usability Scale (SUS). Created in 1986, the freely available, well cited, SUS is commonly used to determine user perceptions of a system (in this case the intranet search environment). As with any improvement initiative, one must first examine and document the current reality of the situation. In this scenario, a method was needed to determine the usability of a search interface in addition to the user's perception on how well the search system was providing results. The use of the SUS provided a mechanism to quickly ascertain information in both areas, by adding one additional open-ended question at the end. The first ten questions allowed us to examine the usability of the system, while the last questions informed us on how the users rated the performance of the search results. The final analysis provides us with a better understanding of the current situation and areas to focus on for improvement. The power of search applications to enhance knowledge transfer is indisputable. The performance impact for any user unable to find needed information undermines project lifecycle, resource and scheduling requirements. Ever-increasing complexity of content and the user interface make usability considerations for the intranet, especially for search, a necessity instead of a 'nice-to-have'. Despite these arguments, intranet usability is largely disregarded due to lack of attention beyond the functionality of the infrastructure (White, 2013). The data collected from users of the JSC search system revealed their overall sentiment by means of the widely-known System Usability Scale. Results of the scores suggest 75%, +/-0.04, of the population rank the search system below average. In terms of a grading scaled, this equated to D or lower. It is obvious JSC users are not satisfied with the current situation, however they are eager to provide information and assistance in improving the search system. A majority of the respondents provided feedback on the issues most troubling them. This information will be used to enrich the next phase, root cause analysis and solution creation.

Improving Access to HIV and AIDS Information Resources for Patients, Caregivers, and Clinicians: Results from the SHINE Project.

PubMed

Dixon, Brian E; Kaneshiro, Kellie

2012-01-01

Human immunodeficiency virus and acquired immunodeficiency syndrome (HIV/AIDS) remains a significant international public health challenge. The Statewide HIV/AIDS Information Network (SHINE) Project was created to improve HIV/AIDS health information use and access for health care professionals, patients, and affected communities in Indiana. Our objective was to assess the information-seeking behaviors of health care professionals and consumers who seek information on the testing, treatment, and management of HIV/AIDS and the usability of the SHINE Project's resources in meeting end user needs. The feedback was designed to help SHINE Project members improve and expand the SHINE Project's online resources. A convenience sample of health care professionals and consumers participated in a usability study. Participants were asked to complete typical HIV/AIDS information-seeking tasks using the SHINE Project website. Feedback was provided in the form of standardized questionnaire and usability "think-aloud" responses. Thirteen participants took part in the usability study. Clinicians generally reported the site to be "very good," while consumers generally found it to be "good." Health care professionals commented that they lack access to comprehensive resources for treating patients with HIV/AIDS. They requested new electronic resources that could be integrated in clinical practice and existing information technology infrastructures. Consumers found the SHINE website and its collected information resources overwhelming and difficult to navigate. They requested simpler, multimedia-content rich resources to deliver information on HIV/AIDS testing, treatment, and disease management. Accessibility, usability, and user education remain important challenges that public health and information specialists must address when developing and deploying interventions intended to empower consumers and support coordinated, patient-centric care.

Usability engineering for augmented reality: employing user-based studies to inform design.

PubMed

Gabbard, Joseph L; Swan, J Edward

2008-01-01

A major challenge, and thus opportunity, in the field of human-computer interaction and specifically usability engineering is designing effective user interfaces for emerging technologies that have no established design guidelines or interaction metaphors or introduce completely new ways for users to perceive and interact with technology and the world around them. Clearly, augmented reality is one such emerging technology. We propose a usability engineering approach that employs user-based studies to inform design, by iteratively inserting a series of user-based studies into a traditional usability engineering lifecycle to better inform initial user interface designs. We present an exemplar user-based study conducted to gain insight into how users perceive text in outdoor augmented reality settings and to derive implications for design in outdoor augmented reality. We also describe lessons learned from our experiences conducting user-based studies as part of the design process.

75 FR 14575 - Voting Equipment Evaluations Phase III

Federal Register 2010, 2011, 2012, 2013, 2014

2010-03-26

..., Human Performance-Based Standards and Usability Testing. NIST Phase III research is designed to: (1... vendor equipment will not be released. Comparative information may be released in a blind manner... electronic poll book systems as well as software used for ballot design and creation. Dated: March 23, 2010...

Access and Perceived ICT Usability among Students with Disabilities Attending Higher Education Institutions

ERIC Educational Resources Information Center

Heiman, Tali; Fichten, Catherine S.; Olenik-Shemesh, Dorit; Keshet, Noam S.; Jorgensen, Mary

2017-01-01

An increasing number of students with disabilities are attending higher education. These students might face various difficulties coping with academic skills and with learning methods compared to students without disabilities. Integrating information and communication technologies (ICTs) in academic studies may be effective and constructive for…

Usability testing of ANSWER: a web-based methotrexate decision aid for patients with rheumatoid arthritis

PubMed Central

2013-01-01

Background Decision aids are evidence-based tools designed to inform people of the potential benefit and harm of treatment options, clarify their preferences and provide a shared decision-making structure for discussion at a clinic visit. For patients with rheumatoid arthritis (RA) who are considering methotrexate, we have developed a web-based patient decision aid called the ANSWER (Animated, Self-serve, Web-based Research Tool). This study aimed to: 1) assess the usability of the ANSWER prototype; 2) identify strengths and limitations of the ANSWER from the patient’s perspective. Methods The ANSWER prototype consisted of: 1) six animated patient stories and narrated information on the evidence of methotrexate for RA; 2) interactive questionnaires to clarify patients’ treatment preferences. Eligible participants for the usability test were patients with RA who had been prescribed methotrexate. They were asked to verbalize their thoughts (i.e., think aloud) while using the ANSWER, and to complete the System Usability Scale (SUS) to assess overall usability (range = 0-100; higher = more user friendly). Participants were audiotaped and observed, and field notes were taken. The testing continued until no new modifiable issues were found. We used descriptive statistics to summarize participant characteristics and the SUS scores. Content analysis was used to identified usability issues and navigation problems. Results 15 patients participated in the usability testing. The majority were aged 50 or over and were university/college graduates (n = 8, 53.4%). On average they took 56 minutes (SD = 34.8) to complete the tool. The mean SUS score was 81.2 (SD = 13.5). Content analysis of audiotapes and field notes revealed four categories of modifiable usability issues: 1) information delivery (i.e., clarity of the information and presentation style); 2) navigation control (i.e., difficulties in recognizing and using the navigation control buttons); 3) layout (i.e., position of the videos, text, diagrams and navigation buttons); 4) aesthetic (i.e., the colour, look and feel of the online tool). Conclusions Although the SUS score indicated high usability before and after major modification, findings from the think-aloud sessions illustrated areas that required further refinement. Our results highlight the importance of formative evaluation in usability testing. PMID:24289731

Usability testing of ANSWER: a web-based methotrexate decision aid for patients with rheumatoid arthritis.

PubMed

Li, Linda C; Adam, Paul M; Townsend, Anne F; Lacaille, Diane; Yousefi, Charlene; Stacey, Dawn; Gromala, Diane; Shaw, Chris D; Tugwell, Peter; Backman, Catherine L

2013-12-01

Decision aids are evidence-based tools designed to inform people of the potential benefit and harm of treatment options, clarify their preferences and provide a shared decision-making structure for discussion at a clinic visit. For patients with rheumatoid arthritis (RA) who are considering methotrexate, we have developed a web-based patient decision aid called the ANSWER (Animated, Self-serve, Web-based Research Tool). This study aimed to: 1) assess the usability of the ANSWER prototype; 2) identify strengths and limitations of the ANSWER from the patient's perspective. The ANSWER prototype consisted of: 1) six animated patient stories and narrated information on the evidence of methotrexate for RA; 2) interactive questionnaires to clarify patients' treatment preferences. Eligible participants for the usability test were patients with RA who had been prescribed methotrexate. They were asked to verbalize their thoughts (i.e., think aloud) while using the ANSWER, and to complete the System Usability Scale (SUS) to assess overall usability (range = 0-100; higher = more user friendly). Participants were audiotaped and observed, and field notes were taken. The testing continued until no new modifiable issues were found. We used descriptive statistics to summarize participant characteristics and the SUS scores. Content analysis was used to identified usability issues and navigation problems. 15 patients participated in the usability testing. The majority were aged 50 or over and were university/college graduates (n = 8, 53.4%). On average they took 56 minutes (SD = 34.8) to complete the tool. The mean SUS score was 81.2 (SD = 13.5). Content analysis of audiotapes and field notes revealed four categories of modifiable usability issues: 1) information delivery (i.e., clarity of the information and presentation style); 2) navigation control (i.e., difficulties in recognizing and using the navigation control buttons); 3) layout (i.e., position of the videos, text, diagrams and navigation buttons); 4) aesthetic (i.e., the colour, look and feel of the online tool). Although the SUS score indicated high usability before and after major modification, findings from the think-aloud sessions illustrated areas that required further refinement. Our results highlight the importance of formative evaluation in usability testing.

The Virtual Anatomy Laboratory: Usability Testing to Improve an Online Learning Resource for Anatomy Education

ERIC Educational Resources Information Center

Doubleday, Eldridge G.; O'Loughlin, Valerie D.; Doubleday, Alison F.

2011-01-01

An increasing number of instructors are seeking to provide students with online anatomy resources. Many researchers have attempted to identify associations between resource use and student learning but few studies discuss the importance of usability testing in resource design and modification. Usability testing provides information about ease of…

Using Eye Trackers for Usability Evaluation of Health Information Technology: A Systematic Literature Review

PubMed Central

Yang, Yushi

2015-01-01

Background Eye-tracking technology has been used to measure human cognitive processes and has the potential to improve the usability of health information technology (HIT). However, it is still unclear how the eye-tracking method can be integrated with other traditional usability methodologies to achieve its full potential. Objective The objective of this study was to report on HIT evaluation studies that have used eye-tracker technology, and to envision the potential use of eye-tracking technology in future research. Methods We used four reference databases to initially identify 5248 related papers, which resulted in only 9 articles that met our inclusion criteria. Results Eye-tracking technology was useful in finding usability problems in many ways, but is still in its infancy for HIT usability evaluation. Limited types of HITs have been evaluated by eye trackers, and there has been a lack of evaluation research in natural settings. Conclusions More research should be done in natural settings to discover the real contextual-based usability problems of clinical and mobile HITs using eye-tracking technology with more standardized methodologies and guidance. PMID:27026079

Internationalization and localization: evaluating and testing a Website for Asian users.

PubMed

Rau, Pei-Luen Patrick; Liang, Sheau-Farn Max

2003-01-15

The objective of this study was to combine internationalization and localization of Websites and improvement of Website usability with user-centred design methods. This study designed for internationalization and localization of Websites for Asian users, and implemented usability engineering into every phase of Website usability testing, based on the internationalization and localization perspectives of the honeywell.com/your home Website. The first step was to develop the usage scenarios. Three Asian usability specialists carried out one heuristic evaluation session for the current honeywell.com/your home Website. The usability problems were analysed and possible solutions to these problems were discussed. In the next phase, cluster analysis was utilized to test current information architecture. The results provided options for future information architecture development for this Website. Finally, a performance measurement test was conducted to investigate the performance for Asian users. Based on the results, suggestions for improving the Website usability from the localization perspective were provided. The results demonstrate the user-centred design (UCD) approach and stress international and local issues in Website development to Website designers.

User-friendly technology to help family carers cope.

PubMed

Chambers, Mary; Connor, Samantha L

2002-12-01

Increases in the older adult population are occurring simultaneously with a growth in new technology. Modern technology presents an opportunity to enhance the quality of life and independence of older people and their family carers through communication and access to health care information. To evaluate the usability of a multimedia software application designed to provide family carers of the elderly or disabled with information, advice and psychological support to increase their coping capacity. The interactive application consisted of an information-based package that provided carers with advice on the promotion of psychological health, including relaxation and other coping strategies. The software application also included a carer self-assessment instrument, designed to provide both family and professional carers with information to assess how family carers were coping with their care-giving role. Usability evaluation was carried out in two stages. In the first stage (verification), user trials and an evaluation questionnaire were used to refine and develop the content and usability of the multimedia software application. In the second (demonstration), stage evaluation questionnaires were used to appraise the usability of the modified software application. The findings evidenced that the majority of users found the software to be usable and informative. Some areas were highlighted for improvement in the navigation of the software. The authors conclude that with further refinement, the software application has the potential to offer information and support to those who are caring for the elderly and disabled at home.

A Framework for Usability Evaluation in EHR Procurement.

PubMed

Tyllinen, Mari; Kaipio, Johanna; Lääveri, Tinja

2018-01-01

Usability should be considered already by the procuring organizations when selecting future systems. In this paper, we present a framework for usability evaluation during electronic health record (EHR) system procurement. We describe the objectives of the evaluation, the procedure, selected usability attributes and the evaluation methods to measure them. We also present the emphasis usability had in the selection process. We do not elaborate on the details of the results, the application of methods or gathering of data. Instead we focus on the components of the framework to inform and give an example to other similar procurement projects.

The usability axiom of medical information systems.

PubMed

Pantazi, Stefan V; Kushniruk, Andre; Moehr, Jochen R

2006-12-01

In this article we begin by connecting the concept of simplicity of user interfaces of information systems with that of usability, and the concept of complexity of the problem-solving in information systems with the concept of usefulness. We continue by stating "the usability axiom" of medical information technology: information systems must be, at the same time, usable and useful. We then try to show why, given existing technology, the axiom is a paradox and we continue with analysing and reformulating it several times, from more fundamental information processing perspectives. We underline the importance of the concept of representation and demonstrate the need for context-dependent representations. By means of thought experiments and examples, we advocate the need for context-dependent information processing and argue for the relevance of algorithmic information theory and case-based reasoning in this context. Further, we introduce the notion of concept spaces and offer a pragmatic perspective on context-dependent representations. We conclude that the efficient management of concept spaces may help with the solution to the medical information technology paradox. Finally, we propose a view of informatics centred on the concepts of context-dependent information processing and management of concept spaces that aligns well with existing knowledge centric definitions of informatics in general and medical informatics in particular. In effect, our view extends M. Musen's proposal and proposes a definition of Medical Informatics as context-dependent medical information processing. The axiom that medical information systems must be, at the same time, useful and usable, is a paradox and its investigation by means of examples and thought experiments leads to the recognition of the crucial importance of context-dependent information processing. On the premise that context-dependent information processing equates to knowledge processing, this view defines Medical Informatics as a context-dependent medical information processing which aligns well with existing knowledge centric definitions of our field.

Engaging Community Stakeholders to Evaluate the Design, Usability, and Acceptability of a Chronic Obstructive Pulmonary Disease Social Media Resource Center

PubMed Central

Chaney, Beth; Chaney, Don; Paige, Samantha; Payne-Purvis, Caroline; Tennant, Bethany; Walsh-Childers, Kim; Sriram, PS; Alber, Julia

2015-01-01

Background Patients with chronic obstructive pulmonary disease (COPD) often report inadequate access to comprehensive patient education resources. Objective The purpose of this study was to incorporate community-engagement principles within a mixed-method research design to evaluate the usability and acceptability of a self-tailored social media resource center for medically underserved patients with COPD. Methods A multiphase sequential design (qual → QUANT → quant + QUAL) was incorporated into the current study, whereby a small-scale qualitative (qual) study informed the design of a social media website prototype that was tested with patients during a computer-based usability study (QUANT). To identify usability violations and determine whether or not patients found the website prototype acceptable for use, each patient was asked to complete an 18-item website usability and acceptability questionnaire, as well as a retrospective, in-depth, semistructured interview (quant + QUAL). Results The majority of medically underserved patients with COPD (n=8, mean 56 years, SD 7) found the social media website prototype to be easy to navigate and relevant to their self-management information needs. Mean responses on the 18-item website usability and acceptability questionnaire were very high on a scale of 1 (strongly disagree) to 5 (strongly agree) (mean 4.72, SD 0.33). However, the majority of patients identified several usability violations related to the prototype’s information design, interactive capabilities, and navigational structure. Specifically, 6 out of 8 (75%) patients struggled to create a log-in account to access the prototype, and 7 out of 8 patients (88%) experienced difficulty posting and replying to comments on an interactive discussion forum. Conclusions Patient perceptions of most social media website prototype features (eg, clickable picture-based screenshots of videos, comment tools) were largely positive. Mixed-method stakeholder feedback was used to make design recommendations, categorize usability violations, and prioritize potential solutions for improving the usability of a social media resource center for COPD patient education. PMID:25630449

Hybrid P300-based brain-computer interface to improve usability for people with severe motor disability: electromyographic signals for error correction during a spelling task.

PubMed

Riccio, Angela; Holz, Elisa Mira; Aricò, Pietro; Leotta, Francesco; Aloise, Fabio; Desideri, Lorenzo; Rimondini, Matteo; Kübler, Andrea; Mattia, Donatella; Cincotti, Febo

2015-03-01

To evaluate the impact of a hybrid control on usability of a P300-based brain-computer interface (BCI) system that was designed to control an assistive technology software and was integrated with an electromyographic channel for error correction. Proof-of-principle study with a convenience sample. Neurologic rehabilitation hospital. Participants (N=11) in this pilot study included healthy (n=8) and severely motor impaired (n=3) persons. The 3 people with severe motor disability were identified as potential candidates to benefit from the proposed hybrid BCI system for communication and environmental interaction. To eventually investigate the improvement in usability, we compared 2 modalities of BCI system control: a P300-based and a hybrid P300 electromyographic-based mode of control. System usability was evaluated according to the following outcome measures within 3 domains: (1) effectiveness (overall system accuracy and P300-based BCI accuracy); (2) efficiency (throughput time and users' workload); and (3) satisfaction (users' satisfaction). We also considered the information transfer rate and time for selection. Findings obtained in healthy participants were in favor of a higher usability of the hybrid control as compared with the nonhybrid. A similar trend was indicated by the observational results gathered from each of the 3 potential end-users. The proposed hybrid BCI control modality could provide end-users with severe motor disability with an option to exploit some residual muscular activity, which could not be fully reliable for properly controlling an assistive technology device. The findings reported in this pilot study encourage the implementation of a clinical trial involving a large cohort of end-users. Copyright © 2015 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.

Evaluating authentication options for mobile health applications in younger and older adults

PubMed Central

Khan, Hassan; Hengartner, Urs; Ong, Stephanie; Logan, Alexander G.; Vogel, Daniel; Gebotys, Robert; Yang, Jilan

2018-01-01

Objective Apps promoting patient self-management may improve health outcomes. However, methods to secure stored information on mobile devices may adversely affect usability. We tested the reliability and usability of common user authentication techniques in younger and older adults. Methodology Usability testing was conducted in two age groups, 18 to 30 years and 50 years and older. After completing a demographic questionnaire, each participant tested four authentication options in random order: four-digit personal identification number (PIN), graphical password (GRAPHICAL), Android pattern-lock (PATTERN), and a swipe-style Android fingerprint scanner (FINGERPRINT). Participants rated each option using the Systems Usability Scale (SUS). Results A total of 59 older and 43 younger participants completed the study. Overall, PATTERN was the fastest option (3.44s), and PIN had the fewest errors per attempt (0.02). Participants were able to login using PIN, PATTERN, and GRAPHICAL at least 98% of the time. FINGERPRINT was the slowest (26.97s), had an average of 1.46 errors per attempt, and had a successful login rate of 85%. Overall, PIN and PATTERN had higher SUS scores than FINGERPRINT and GRAPHICAL. Compared to younger participants, older participants were also less likely to find PATTERN to be tiring, annoying or time consuming and less likely to consider PIN to be time consuming. Younger participants were more likely to rate GRAPHICAL as annoying, time consuming and tiring than older participants. Conclusions On mobile devices, PIN and pattern-lock outperformed graphical passwords and swipe-style fingerprints. All participants took longer to authenticate using the swipe-style fingerprint compared to other options. Older participants also took two to three seconds longer to authenticate using the PIN, pattern and graphical passwords though this did not appear to affect perceived usability. PMID:29300736

Evaluating authentication options for mobile health applications in younger and older adults.

PubMed

Grindrod, Kelly; Khan, Hassan; Hengartner, Urs; Ong, Stephanie; Logan, Alexander G; Vogel, Daniel; Gebotys, Robert; Yang, Jilan

2018-01-01

Apps promoting patient self-management may improve health outcomes. However, methods to secure stored information on mobile devices may adversely affect usability. We tested the reliability and usability of common user authentication techniques in younger and older adults. Usability testing was conducted in two age groups, 18 to 30 years and 50 years and older. After completing a demographic questionnaire, each participant tested four authentication options in random order: four-digit personal identification number (PIN), graphical password (GRAPHICAL), Android pattern-lock (PATTERN), and a swipe-style Android fingerprint scanner (FINGERPRINT). Participants rated each option using the Systems Usability Scale (SUS). A total of 59 older and 43 younger participants completed the study. Overall, PATTERN was the fastest option (3.44s), and PIN had the fewest errors per attempt (0.02). Participants were able to login using PIN, PATTERN, and GRAPHICAL at least 98% of the time. FINGERPRINT was the slowest (26.97s), had an average of 1.46 errors per attempt, and had a successful login rate of 85%. Overall, PIN and PATTERN had higher SUS scores than FINGERPRINT and GRAPHICAL. Compared to younger participants, older participants were also less likely to find PATTERN to be tiring, annoying or time consuming and less likely to consider PIN to be time consuming. Younger participants were more likely to rate GRAPHICAL as annoying, time consuming and tiring than older participants. On mobile devices, PIN and pattern-lock outperformed graphical passwords and swipe-style fingerprints. All participants took longer to authenticate using the swipe-style fingerprint compared to other options. Older participants also took two to three seconds longer to authenticate using the PIN, pattern and graphical passwords though this did not appear to affect perceived usability.

An Evaluation of Understandability of Patient Journey Models in Mental Health

PubMed Central

2016-01-01

Background There is a significant trend toward implementing health information technology to reduce administrative costs and improve patient care. Unfortunately, little awareness exists of the challenges of integrating information systems with existing clinical practice. The systematic integration of clinical processes with information system and health information technology can benefit the patients, staff, and the delivery of care. Objectives This paper presents a comparison of the degree of understandability of patient journey models. In particular, the authors demonstrate the value of a relatively new patient journey modeling technique called the Patient Journey Modeling Architecture (PaJMa) when compared with traditional manufacturing based process modeling tools. The paper also presents results from a small pilot case study that compared the usability of 5 modeling approaches in a mental health care environment. Method Five business process modeling techniques were used to represent a selected patient journey. A mix of both qualitative and quantitative methods was used to evaluate these models. Techniques included a focus group and survey to measure usability of the various models. Results The preliminary evaluation of the usability of the 5 modeling techniques has shown increased staff understanding of the representation of their processes and activities when presented with the models. Improved individual role identification throughout the models was also observed. The extended version of the PaJMa methodology provided the most clarity of information flows for clinicians. Conclusions The extended version of PaJMa provided a significant improvement in the ease of interpretation for clinicians and increased the engagement with the modeling process. The use of color and its effectiveness in distinguishing the representation of roles was a key feature of the framework not present in other modeling approaches. Future research should focus on extending the pilot case study to a more diversified group of clinicians and health care support workers. PMID:27471006

Health Information Technology Usability Evaluation Scale (Health-ITUES) for Usability Assessment of Mobile Health Technology: Validation Study.

PubMed

Schnall, Rebecca; Cho, Hwayoung; Liu, Jianfang

2018-01-05

Mobile technology has become a ubiquitous technology and can be particularly useful in the delivery of health interventions. This technology can allow us to deliver interventions to scale, cover broad geographic areas, and deliver technologies in highly tailored ways based on the preferences or characteristics of users. The broad use of mobile technologies supports the need for usability assessments of these tools. Although there have been a number of usability assessment instruments developed, none have been validated for use with mobile technologies. The goal of this work was to validate the Health Information Technology Usability Evaluation Scale (Health-ITUES), a customizable usability assessment instrument in a sample of community-dwelling adults who were testing the use of a new mobile health (mHealth) technology. A sample of 92 community-dwelling adults living with HIV used a new mobile app for symptom self-management and completed the Health-ITUES to assess the usability of the app. They also completed the Post-Study System Usability Questionnaire (PSSUQ), a widely used and well-validated usability assessment tool. Correlations between these scales and each of the subscales were assessed. The subscales of the Health-ITUES showed high internal consistency reliability (Cronbach alpha=.85-.92). Each of the Health-ITUES subscales and the overall scale was moderately to strongly correlated with the PSSUQ scales (r=.46-.70), demonstrating the criterion validity of the Health-ITUES. The Health-ITUES has demonstrated reliability and validity for use in assessing the usability of mHealth technologies in community-dwelling adults living with a chronic illness. ©Rebecca Schnall, Hwayoung Cho, Jianfang Liu. Originally published in JMIR Mhealth and Uhealth (http://mhealth.jmir.org), 05.01.2018.

Health Information Technology Usability Evaluation Scale (Health-ITUES) for Usability Assessment of Mobile Health Technology: Validation Study

PubMed Central

Cho, Hwayoung; Liu, Jianfang

2018-01-01

Background Mobile technology has become a ubiquitous technology and can be particularly useful in the delivery of health interventions. This technology can allow us to deliver interventions to scale, cover broad geographic areas, and deliver technologies in highly tailored ways based on the preferences or characteristics of users. The broad use of mobile technologies supports the need for usability assessments of these tools. Although there have been a number of usability assessment instruments developed, none have been validated for use with mobile technologies. Objective The goal of this work was to validate the Health Information Technology Usability Evaluation Scale (Health-ITUES), a customizable usability assessment instrument in a sample of community-dwelling adults who were testing the use of a new mobile health (mHealth) technology. Methods A sample of 92 community-dwelling adults living with HIV used a new mobile app for symptom self-management and completed the Health-ITUES to assess the usability of the app. They also completed the Post-Study System Usability Questionnaire (PSSUQ), a widely used and well-validated usability assessment tool. Correlations between these scales and each of the subscales were assessed. Results The subscales of the Health-ITUES showed high internal consistency reliability (Cronbach alpha=.85-.92). Each of the Health-ITUES subscales and the overall scale was moderately to strongly correlated with the PSSUQ scales (r=.46-.70), demonstrating the criterion validity of the Health-ITUES. Conclusions The Health-ITUES has demonstrated reliability and validity for use in assessing the usability of mHealth technologies in community-dwelling adults living with a chronic illness. PMID:29305343

TRAK App Suite: A Web-Based Intervention for Delivering Standard Care for the Rehabilitation of Knee Conditions.

PubMed

Spasić, Irena; Button, Kate; Divoli, Anna; Gupta, Satyam; Pataky, Tamas; Pizzocaro, Diego; Preece, Alun; van Deursen, Robert; Wilson, Chris

2015-10-16

Standard care for the rehabilitation of knee conditions involves exercise programs and information provision. Current methods of rehabilitation delivery struggle to keep up with large volumes of patients and the length of treatment required to maximize the recovery. Therefore, the development of novel interventions to support self-management is strongly recommended. Such interventions need to include information provision, goal setting, monitoring, feedback, and support groups, but the most effective methods of their delivery are poorly understood. The Internet provides a medium for intervention delivery with considerable potential for meeting these needs. The objective of this study was to demonstrate the feasibility of a Web-based app and to conduct a preliminary review of its practicability as part of a complex medical intervention in the rehabilitation of knee disorders. This paper describes the development, implementation, and usability of such an app. An interdisciplinary team of health care professionals and researchers, computer scientists, and app developers developed the TRAK app suite. The key functionality of the app includes information provision, a three-step exercise program based on a standard care for the rehabilitation of knee conditions, self-monitoring with visual feedback, and a virtual support group. There were two types of stakeholders (patients and physiotherapists) that were recruited for the usability study. The usability questionnaire was used to collect both qualitative and quantitative information on computer and Internet usage, task completion, and subjective user preferences. A total of 16 patients and 15 physiotherapists participated in the usability study. Based on the System Usability Scale, the TRAK app has higher perceived usability than 70% of systems. Both patients and physiotherapists agreed that the given Web-based approach would facilitate communication, provide information, help recall information, improve understanding, enable exercise progression, and support self-management in general. The Web app was found to be easy to use and user satisfaction was very high. The TRAK app suite can be accessed at http://apps.facebook.com/kneetrak/. The usability study suggests that a Web-based intervention is feasible and acceptable in supporting self-management of knee conditions.

TRAK App Suite: A Web-Based Intervention for Delivering Standard Care for the Rehabilitation of Knee Conditions

PubMed Central

Divoli, Anna; Gupta, Satyam; Pataky, Tamas; Pizzocaro, Diego; Preece, Alun; van Deursen, Robert; Wilson, Chris

2015-01-01

Background Standard care for the rehabilitation of knee conditions involves exercise programs and information provision. Current methods of rehabilitation delivery struggle to keep up with large volumes of patients and the length of treatment required to maximize the recovery. Therefore, the development of novel interventions to support self-management is strongly recommended. Such interventions need to include information provision, goal setting, monitoring, feedback, and support groups, but the most effective methods of their delivery are poorly understood. The Internet provides a medium for intervention delivery with considerable potential for meeting these needs. Objective The objective of this study was to demonstrate the feasibility of a Web-based app and to conduct a preliminary review of its practicability as part of a complex medical intervention in the rehabilitation of knee disorders. This paper describes the development, implementation, and usability of such an app. Methods An interdisciplinary team of health care professionals and researchers, computer scientists, and app developers developed the TRAK app suite. The key functionality of the app includes information provision, a three-step exercise program based on a standard care for the rehabilitation of knee conditions, self-monitoring with visual feedback, and a virtual support group. There were two types of stakeholders (patients and physiotherapists) that were recruited for the usability study. The usability questionnaire was used to collect both qualitative and quantitative information on computer and Internet usage, task completion, and subjective user preferences. Results A total of 16 patients and 15 physiotherapists participated in the usability study. Based on the System Usability Scale, the TRAK app has higher perceived usability than 70% of systems. Both patients and physiotherapists agreed that the given Web-based approach would facilitate communication, provide information, help recall information, improve understanding, enable exercise progression, and support self-management in general. The Web app was found to be easy to use and user satisfaction was very high. The TRAK app suite can be accessed at http://apps.facebook.com/kneetrak/. Conclusions The usability study suggests that a Web-based intervention is feasible and acceptable in supporting self-management of knee conditions. PMID:26474643

Usability of online psychoeducation for siblings of people with psychosis.

PubMed

Sin, Jacqueline; Henderson, Claire; Norman, Ian

2014-10-01

The E Sibling Project aims to address the needs of siblings of individuals affected by psychosis through provision of a comprehensive online intervention. The online intervention comprises four core elements, including: information on psychosis; various coping and promoting well-being strategies; siblings' blogs and discussion forum with peers; and an "Ask the Experts" function. After the intervention-prototype was developed, we tested its feasibility, usability and acceptability by siblings. We evaluated the usability of the intervention-prototype using a non-randomised usability study with siblings of individuals diagnosed with psychosis. The usability study adapted Poulson et al's framework to collect subjective feedback from participants on ease of use, perceived usefulness and acceptability, together with objective usage data on the intervention. Twenty siblings were recruited to the usability test; 19 tried out the resource-prototype over a 4-week period and 17 completed the online evaluation after using the intervention. In total, 906 page-views were made by the participants and each spent about two hours using the resource. Participants evaluated the intervention as helpful, relevant and useful in terms of content, design and usability. Developments are needed to improve the navigation and intuitiveness of the resource. Using an internet-based information-giving and peer support intervention to promote wellbeing and coping is feasible and acceptable to siblings of people with psychosis.

Evaluation of Nursing Information Systems: Application of Usability Aspects in the Development of Systems.

PubMed

Moghaddasi, Hamid; Rabiei, Reza; Asadi, Farkhondeh; Ostvan, Negin

2017-04-01

As the largest group providing healthcare services, nurses require well-designed information systems in their practice. This study aims to evaluate the usability of nursing information systems (NIS). This cross-sectional survey was conducted in 2015. The settings of the study consisted of four hospitals affiliated with three medical universities in Tehran (Iran). The subjects of the study included nurses who had access to and used a NIS developed by four major software companies. The data were collected using a modified version of a usability questionnaire known as IsoMetrics, based on the International Standard ISO 9241, Part 11. The questionnaire is composed of 35 questions divided into seven general criteria. The validity of the questionnaire was determined by experts in the field, and the reliability was checked using Cronbach's alpha (α = 0.91). The questionnaire was then distributed to 184 nurses. The response rate was 64.6%. Among the seven ISO usability criteria, suitability for the task (3.10 ± 1.24) and suitability for learning (3.10 ± 1.27) had the highest mean value. The lowest mean value (2.37 ± 1.29) was related to the suitability for individualization. Addressing issues related to individualization and self-descriptiveness could improve the usability of nursing systems. Considering usability requirements in the design of a NIS will lead to the efficient and effective use of these systems.

Evaluating the Usability of a Museum Web Site.

ERIC Educational Resources Information Center

Harms, Ilse; Schweibenz, Werner

This paper presents a research project conducted by the Department of Information Science in cooperation with the Saarland Museum, the art museum of the Federal State of Saarland, Germany. The study had two aims. The first was to evaluate some methods of usability engineering for the Web, and the second was to evaluate the usability of the…

A Usability Study of Users' Perceptions toward a Multimedia Computer-Assisted Learning Tool for Neuroanatomy

ERIC Educational Resources Information Center

Gould, Douglas J.; Terrell, Mark A.; Fleming, Jo

2008-01-01

This usability study evaluated users' perceptions of a multimedia prototype for a new e-learning tool: Anatomy of the Central Nervous System: A Multimedia Course. Usability testing is a collection of formative evaluation methods that inform the developmental design of e-learning tools to maximize user acceptance, satisfaction, and adoption.…

Usability Studies in Virtual and Traditional Computer Aided Design Environments for Fault Identification

DTIC Science & Technology

2017-08-08

Usability Studies In Virtual And Traditional Computer Aided Design Environments For Fault Identification Dr. Syed Adeel Ahmed, Xavier University...virtual environment with wand interfaces compared directly with a workstation non-stereoscopic traditional CAD interface with keyboard and mouse. In...the differences in interaction when compared with traditional human computer interfaces. This paper provides analysis via usability study methods

An online network tool for quality information to answer questions about occupational safety and health: usability and applicability.

PubMed

Rhebergen, Martijn D F; Hulshof, Carel T J; Lenderink, Annet F; van Dijk, Frank J H

2010-10-22

Common information facilities do not always provide the quality information needed to answer questions on health or health-related issues, such as Occupational Safety and Health (OSH) matters. Barriers may be the accessibility, quantity and readability of information. Online Question & Answer (Q&A) network tools, which link questioners directly to experts can overcome some of these barriers. When designing and testing online tools, assessing the usability and applicability is essential. Therefore, the purpose of this study is to assess the usability and applicability of a new online Q&A network tool for answers on OSH questions. We applied a cross-sectional usability test design. Eight occupational health experts and twelve potential questioners from the working population (workers) were purposively selected to include a variety of computer- and internet-experiences. During the test, participants were first observed while executing eight tasks that entailed important features of the tool. In addition, they were interviewed. Through task observations and interviews we assessed applicability, usability (effectiveness, efficiency and satisfaction) and facilitators and barriers in use. Most features were usable, though several could be improved. Most tasks were executed effectively. Some tasks, for example searching stored questions in categories, were not executed efficiently and participants were less satisfied with the corresponding features. Participants' recommendations led to improvements. The tool was found mostly applicable for additional information, to observe new OSH trends and to improve contact between OSH experts and workers. Hosting and support by a trustworthy professional organization, effective implementation campaigns, timely answering and anonymity were seen as important use requirements. This network tool is a promising new strategy for offering company workers high quality information to answer OSH questions. Q&A network tools can be an addition to existing information facilities in the field of OSH, but also to other healthcare fields struggling with how to answer questions from people in practice with high quality information. In the near future, we will focus on the use of the tool and its effects on information and knowledge dissemination.

User perspectives on the usability of a regional health information exchange

PubMed Central

Ho, Yun-Xian; Cala, Cather Marie; Blakemore, Dana; Chen, Qingxia; Frisse, Mark E; Johnson, Kevin B

2011-01-01

Objective We assessed the usability of a health information exchange (HIE) in a densely populated metropolitan region. This grant-funded HIE had been deployed rapidly to address the imminent needs of the patient population and the need to draw wider participation from regional entities. Design We conducted a cross-sectional survey of individuals given access to the HIE at participating organizations and examined some of the usability and usage factors related to the technology acceptance model. Measurements We probed user perceptions using the Questionnaire for User Interaction Satisfaction, an author-generated Trust scale, and user characteristic questions (eg, age, weekly system usage time). Results Overall, users viewed the system favorably (ratings for all usability items were greater than neutral (one-sample Wilcoxon test, p<0.0014, Bonferroni-corrected for 35 tests). System usage was regressed on usability, trust, and demographic and user characteristic factors. Three usability factors were positively predictive of system usage: overall reactions (p<0 0.01), learning (p<0.05), and system functionality (p<0.01). Although trust is an important component in collaborative relationships, we did not find that user trust of other participating healthcare entities was significantly predictive of usage. An analysis of respondents' comments revealed ways to improve the HIE. Conclusion We used a rapid deployment model to develop an HIE and found that perceptions of system usability were positive. We also found that system usage was predicted well by some aspects of usability. Results from this study suggest that a rapid development approach may serve as a viable model for developing usable HIEs serving communities with limited resources. PMID:21622933

Why Citizen Science Without Usability Testing Will Underperform

NASA Astrophysics Data System (ADS)

Romano, C.; Gay, P.; Owens, R.; Burlea, G.

2017-12-01

Citizen science projects must undergo usability testing and optimization if they are to meet their stated goals. This presentation will include video of usability tests conducted upon citizen science websites. Usability testing is essential to the success of online interaction, however, citizen science projects have just begun to include this critical activity. Interaction standards in citizen science lag behind those of commercial interests, and published research on this topic is limited. Since online citizen science is by definition, an exchange of information, a clear understanding of how users experience an online project is essential to informed decision-making. Usability testing provides that insight. Usability testing collects data via direct observation of a person while she interacts with a digital product, such as a citizen science website. The test participant verbalizes her thoughts while using the website or application; the moderator follows the participant and captures quantitative measurement of the participant's confidence of success as she advances through the citizen science project. Over 15 years of usability testing, we have observed that users who do not report a consistent sense of progress are likely to abandon a website after as few as three unrewarding interactions. Since citizen science is also a voluntary activity, ensuring seamless interaction for users is mandatory. Usability studies conducted on citizen science websites demonstrate that project teams frequently underestimate a user's need for context and ease of use. Without usability testing, risks to online citizen science projects include high bounce rate (users leave the website without taking any action), abandonment (of the website, tutorials, registration), misunderstanding instructions (causing disorientation and erroneous conclusions), and ultimately, underperforming projects.

Why Organizations Continue to Create Patient Information Leaflets with Readability and Usability Problems: An Exploratory Study

ERIC Educational Resources Information Center

Gal, Iddo; Prigat, Ayelet

2005-01-01

Readability and usability problems with patient information leaflets continue to be reported despite long-standing recognition of their existence and the availability of guidelines for developing health education materials. This exploratory study examined possible causes for such problems, based on interviews with professionals who developed…

Interface Usability Across and Within EHR Vendors and Medical Settings: The Often Unexamined Need for Interface Similarities.

PubMed

Koppel, Ross; Kuziemsky, Craig

2017-01-01

Usability of health information technology (HIT), if considered at all, is usually focused on individual providers, settings and vendors. However, in light of transformative models of healthcare delivery such as collaborative care delivery that crosses providers and settings, we need to think of usability as a collective and constantly emerging process. To address this new reality we develop a matrix of usability that spans several dimensions and contexts, incorporating differing vendors, user, settings, disciplines, and display configurations. The matrix, while conceptual, extends existing work by providing the means for discussion of usability issues and needs beyond one setting and one user type.

Usability and accessibility in consumer health informatics current trends and future challenges.

PubMed

Goldberg, Larry; Lide, Bettijoyce; Lowry, Svetlana; Massett, Holly A; O'Connell, Trisha; Preece, Jennifer; Quesenbery, Whitney; Shneiderman, Ben

2011-05-01

It is a truism that, for innovative eHealth systems to have true value and impact, they must first and foremost be usable and accessible by clinicians, consumers, and other stakeholders. In this paper, current trends and future challenges in the usability and accessibility of consumer health informatics will be described. Consumer expectations of their healthcare providers and healthcare records in this new era of consumer-directed care will be explored, and innovative visualizations, assistive technologies, and other ways that healthcare information is currently being provided and/or shared will be described. Challenges for ensuring the usability of current and future systems will also be discussed. An innovative model for conducting systematic, timely, user-centered research on consumer-facing websites at the National Cancer Institute (NCI) and the ongoing efforts at the National Institute of Standards and Technology (NIST) to promote health information technology (HIT) usability standards and evaluation criteria will also be presented. Copyright © 2011 American Journal of Preventive Medicine. All rights reserved.

Usability: a critical success factor for managing change in the clinical info-structure.

PubMed

Kay, S

2005-06-01

There can be no doubt that the clinical info-structure is being significantly enriched with the deployment of new systems throughout the health sector. From a technological perspective, the initial emphasis has been mainly on functionality and only latterly on the usability of these clinical information systems. However, the large scale and rapid pace of the changes being wrought in the health sector will have a major impact on clinicians and patients, not least in how they interact with the technology. Therefore, it is not only hardware and software but people-ware, too, that needs to be actively managed; not simply a one-off functional specification but an ongoing, complex relationship. Usability is the human factor that encompasses the ethical, educational, and evaluative aspects of design. There is also a strong case for regarding usability of clinical information systems as a key critical success factor for the management of change within the health-care domain. In particular, the relationship between usability, and education and training is examined.

Health websites: accessibility and usability for American sign language users.

PubMed

Kushalnagar, Poorna; Naturale, Joan; Paludneviciene, Raylene; Smith, Scott R; Werfel, Emily; Doolittle, Richard; Jacobs, Stephen; DeCaro, James

2015-01-01

To date, there have been efforts toward creating better health information access for Deaf American Sign Language (ASL) users. However, the usability of websites with access to health information in ASL has not been evaluated. Our article focuses on the usability of four health websites that include ASL videos. We seek to obtain ASL users' perspectives on the navigation of these ASL-accessible websites, finding the health information that they needed, and perceived ease of understanding ASL video content. ASL users (n = 32) were instructed to find specific information on four ASL-accessible websites, and answered questions related to (a) navigation to find the task, (b) website usability, and (c) ease of understanding ASL video content for each of the four websites. Participants also gave feedback on what they would like to see in an ASL health library website, including the benefit of added captioning and/or signer model to medical illustration of health videos. Participants who had lower health literacy had greater difficulty in finding information on ASL-accessible health websites. This article also describes the participants' preferences for an ideal ASL-accessible health website, and concludes with a discussion on the role of accessible websites in promoting health literacy in ASL users.

Pattern mining of user interaction logs for a post-deployment usability evaluation of a radiology PACS client.

PubMed

Jorritsma, Wiard; Cnossen, Fokie; Dierckx, Rudi A; Oudkerk, Matthijs; van Ooijen, Peter M A

2016-01-01

To perform a post-deployment usability evaluation of a radiology Picture Archiving and Communication System (PACS) client based on pattern mining of user interaction log data, and to assess the usefulness of this approach compared to a field study. All user actions performed on the PACS client were logged for four months. A data mining technique called closed sequential pattern mining was used to automatically extract frequently occurring interaction patterns from the log data. These patterns were used to identify usability issues with the PACS. The results of this evaluation were compared to the results of a field study based usability evaluation of the same PACS client. The interaction patterns revealed four usability issues: (1) the display protocols do not function properly, (2) the line measurement tool stays active until another tool is selected, rather than being deactivated after one use, (3) the PACS's built-in 3D functionality does not allow users to effectively perform certain 3D-related tasks, (4) users underuse the PACS's customization possibilities. All usability issues identified based on the log data were also found in the field study, which identified 48 issues in total. Post-deployment usability evaluation based on pattern mining of user interaction log data provides useful insights into the way users interact with the radiology PACS client. However, it reveals few usability issues compared to a field study and should therefore not be used as the sole method of usability evaluation. Copyright © 2015 Elsevier Ireland Ltd. All rights reserved.

Sociotechnical Human Factors Involved in Remote Online Usability Testing of Two eHealth Interventions.

PubMed

Wozney, Lori M; Baxter, Pamela; Fast, Hilary; Cleghorn, Laura; Hundert, Amos S; Newton, Amanda S

2016-02-03

Research in the fields of human performance technology and human computer interaction are challenging the traditional macro focus of usability testing arguing for methods that help test moderators assess "use in context" (ie, cognitive skills, usability understood over time) and in authentic "real world" settings. Human factors in these complex test scenarios may impact on the quality of usability results being derived yet there is a lack of research detailing moderator experiences in these test environments. Most comparative research has focused on the impact of the physical environment on results, and rarely on how the sociotechnical elements of the test environment affect moderator and test user performance. Improving our understanding of moderator roles and experiences with conducting "real world" usability testing can lead to improved techniques and strategies To understand moderator experiences of using Web-conferencing software to conduct remote usability testing of 2 eHealth interventions. An exploratory case study approach was used to study 4 moderators' experiences using Blackboard Collaborate for remote testing sessions of 2 different eHealth interventions. Data collection involved audio-recording iterative cycles of test sessions, collecting summary notes taken by moderators, and conducting 2 90-minute focus groups via teleconference. A direct content analysis with an inductive coding approach was used to explore personal accounts, assess the credibility of data interpretation, and generate consensus on the thematic structure of the results. Following the convergence of data from the various sources, 3 major themes were identified: (1) moderators experienced and adapted to unpredictable changes in cognitive load during testing; (2) moderators experienced challenges in creating and sustaining social presence and untangling dialogue; and (3) moderators experienced diverse technical demands, but were able to collaboratively troubleshoot with test users. Results highlight important human-computer interactions and human factor qualities that impact usability testing processes. Moderators need an advanced skill and knowledge set to address the social interaction aspects of Web-based usability testing and technical aspects of conferencing software during test sessions. Findings from moderator-focused studies can inform the design of remote testing platforms and real-time usability evaluation processes that place less cognitive burden on moderators and test users.

Using Internet Search Engines to Obtain Medical Information: A Comparative Study

PubMed Central

Wang, Liupu; Wang, Juexin; Wang, Michael; Li, Yong; Liang, Yanchun

2012-01-01

Background The Internet has become one of the most important means to obtain health and medical information. It is often the first step in checking for basic information about a disease and its treatment. The search results are often useful to general users. Various search engines such as Google, Yahoo!, Bing, and Ask.com can play an important role in obtaining medical information for both medical professionals and lay people. However, the usability and effectiveness of various search engines for medical information have not been comprehensively compared and evaluated. Objective To compare major Internet search engines in their usability of obtaining medical and health information. Methods We applied usability testing as a software engineering technique and a standard industry practice to compare the four major search engines (Google, Yahoo!, Bing, and Ask.com) in obtaining health and medical information. For this purpose, we searched the keyword breast cancer in Google, Yahoo!, Bing, and Ask.com and saved the results of the top 200 links from each search engine. We combined nonredundant links from the four search engines and gave them to volunteer users in an alphabetical order. The volunteer users evaluated the websites and scored each website from 0 to 10 (lowest to highest) based on the usefulness of the content relevant to breast cancer. A medical expert identified six well-known websites related to breast cancer in advance as standards. We also used five keywords associated with breast cancer defined in the latest release of Systematized Nomenclature of Medicine-Clinical Terms (SNOMED CT) and analyzed their occurrence in the websites. Results Each search engine provided rich information related to breast cancer in the search results. All six standard websites were among the top 30 in search results of all four search engines. Google had the best search validity (in terms of whether a website could be opened), followed by Bing, Ask.com, and Yahoo!. The search results highly overlapped between the search engines, and the overlap between any two search engines was about half or more. On the other hand, each search engine emphasized various types of content differently. In terms of user satisfaction analysis, volunteer users scored Bing the highest for its usefulness, followed by Yahoo!, Google, and Ask.com. Conclusions Google, Yahoo!, Bing, and Ask.com are by and large effective search engines for helping lay users get health and medical information. Nevertheless, the current ranking methods have some pitfalls and there is room for improvement to help users get more accurate and useful information. We suggest that search engine users explore multiple search engines to search different types of health information and medical knowledge for their own needs and get a professional consultation if necessary. PMID:22672889

Using Internet search engines to obtain medical information: a comparative study.

PubMed

Wang, Liupu; Wang, Juexin; Wang, Michael; Li, Yong; Liang, Yanchun; Xu, Dong

2012-05-16

The Internet has become one of the most important means to obtain health and medical information. It is often the first step in checking for basic information about a disease and its treatment. The search results are often useful to general users. Various search engines such as Google, Yahoo!, Bing, and Ask.com can play an important role in obtaining medical information for both medical professionals and lay people. However, the usability and effectiveness of various search engines for medical information have not been comprehensively compared and evaluated. To compare major Internet search engines in their usability of obtaining medical and health information. We applied usability testing as a software engineering technique and a standard industry practice to compare the four major search engines (Google, Yahoo!, Bing, and Ask.com) in obtaining health and medical information. For this purpose, we searched the keyword breast cancer in Google, Yahoo!, Bing, and Ask.com and saved the results of the top 200 links from each search engine. We combined nonredundant links from the four search engines and gave them to volunteer users in an alphabetical order. The volunteer users evaluated the websites and scored each website from 0 to 10 (lowest to highest) based on the usefulness of the content relevant to breast cancer. A medical expert identified six well-known websites related to breast cancer in advance as standards. We also used five keywords associated with breast cancer defined in the latest release of Systematized Nomenclature of Medicine-Clinical Terms (SNOMED CT) and analyzed their occurrence in the websites. Each search engine provided rich information related to breast cancer in the search results. All six standard websites were among the top 30 in search results of all four search engines. Google had the best search validity (in terms of whether a website could be opened), followed by Bing, Ask.com, and Yahoo!. The search results highly overlapped between the search engines, and the overlap between any two search engines was about half or more. On the other hand, each search engine emphasized various types of content differently. In terms of user satisfaction analysis, volunteer users scored Bing the highest for its usefulness, followed by Yahoo!, Google, and Ask.com. Google, Yahoo!, Bing, and Ask.com are by and large effective search engines for helping lay users get health and medical information. Nevertheless, the current ranking methods have some pitfalls and there is room for improvement to help users get more accurate and useful information. We suggest that search engine users explore multiple search engines to search different types of health information and medical knowledge for their own needs and get a professional consultation if necessary.

Development of a Prototype Continuity of Care Record with Context-Specific Links to Meet the Information Needs of Case Managers for Persons Living with HIV

PubMed Central

Cimino, James J.; Bakken, Suzanne

2012-01-01

Objectives (1) To develop a prototype Continuity of Care Record (CCR) with context-specific links to electronic HIV information resources; and (2) to assess case managers’ perceptions regarding the usability of the prototype. Methods We integrated context-specific links to HIV case management information resources into a prototype CCR using the Infobutton Manager and Librarian Infobutton Tailoring Environment (LITE). Case managers (N=9) completed a think-aloud protocol and the Computer System Usability Questionnaire (CSUQ) to evaluate the usability of the prototype. Verbalizations from the think-aloud protocol were summarized using thematic analysis. CSUQ data were analyzed with descriptive statistics. Results Although participants expressed positive comments regarding the usability of the prototype, the think-aloud protocol also identified the need for improvement in resource labels and for additional resources. On a scale ranging from 1 (strongly agree) to 7 (strongly disagree), the average CSUQ overall satisfaction was 2.25 indicating that users (n=9) were generally satisfied with the system. Mean CSUQ factor scores were: System Usefulness (M=2.13), Information Quality (M=2.46), and Interface Quality (M=2.26). Conclusion Our novel application of the Infobutton Manager and LITE in the context of case management for persons living with HIV in community-based settings resulted in a prototype CCR with infobuttons that met the majority of case managers’ information needs and received relatively positive usability ratings. Findings from this study inform future integration of context-specific links into CCRs and electronic health records and support their use for meeting end-users information needs. PMID:22632821

Informational content, literacy demands, and usability of websites offering health-related genetic tests directly to consumers.

PubMed

Lachance, Christina R; Erby, Lori A H; Ford, Beth M; Allen, Vincent C; Kaphingst, Kimberly A

2010-05-01

As direct-to-consumer genetic testing becomes more available, a diverse group of consumers, including those with limited health literacy, may consider testing. In light of concerns raised about direct-to-consumer genetic testing, this study sought to critically examine whether the informational content, literacy demands, and usability of health-related direct-to-consumer websites met existing recommendations. A content analysis was performed on 29 health-related direct-to-consumer websites. Two coders independently evaluated each website for informational content (e.g., benefits, limitations), literacy demands (e.g., reading level), and usability (e.g., ease of navigation). Most sites presented health conditions and some markers for which they tested, benefits of testing, a description of the testing process, and their privacy policy. Fewer cited scientific literature, explained test limitations, or provided an opportunity to consult a health professional. Key informational content was difficult to locate on most sites. Few sites gave sample disease risk estimates or used common language and explained technical terms consistently. Average reading level was grade 15. The quality of informational content, literacy demands, and usability across health-related direct-to-consumer websites varied widely. Many users would struggle to find and understand the important information. For consumers to better understand the content on these sites and evaluate the meaning of the tests for their health, sites should lower the demands placed on users by distilling and prioritizing the key informational content while simultaneously attending to the reading level and usability elements. In the absence of regulation compelling such changes, government agencies or professional organizations may need to increase consumer and provider awareness of these issues.

Does the use of structured reporting improve usability? A comparative evaluation of the usability of two approaches for findings reporting in a large-scale telecardiology context.

PubMed

Lacerda, Thaisa Cardoso; von Wangenheim, Christiane Gresse; von Wangenheim, Aldo; Giuliano, Isabela

2014-12-01

One of the main reasons that leads to a low adoption rate of telemedicine systems is poor usability. An aspect that influences usability during the reporting of findings is the input mode, e.g., if a free-text (FT) or a structured report (SR) interface is employed. The objective of our study is to compare the usability of FT and ST telemedicine systems, specifically in terms of user satisfaction, efficiency and general usability. We comparatively evaluate the usability of these two input modes in a telecardiology system for issuing electrocardiography reports in the context of a statewide telemedicine system in Brazil with more than 350.000 performed tele-electrocardiography examinations. We adopted a multiple method research strategy, applying three different kinds of usability evaluations: user satisfaction was evaluated through interviews with seven medical professionals using the System Usability Scale (SUS) questionnaire and specific questions related to adequacy and user experience. Efficiency was evaluated by estimating execution time using the Keystroke-Level Model (KLM). General usability was assessed based on the conformity of the systems to a set of e-health specific usability heuristics. The results of this comparison provide a first indication that a structured report (SR) input mode for such a system is more satisfactory and efficient with a larger conformity to usability heuristics than free-text (FT) input. User satisfaction using the SUS questionnaire has been scored in average with 58.8 and 77.5 points for the FT and SR system, respectively, which means that the SR system was rated 18.65 points higher than the FT system. In terms of efficiency, the completion of a findings report using the SR mode is estimated to take 8.5s, 3.74 times faster than using the FT system (31.8s). The SR system also demonstrated less violations to usability heuristics (8 points) in comparison to 14 points observed in the FT system. These results provide a first indication that the usage of structured reporting as an input mode in telecardiology systems may enhance usability. This also seems to confirm the advantages of the usage of structured reporting, as already described in the literature for other areas such as teleradiology. Copyright © 2014 Elsevier Inc. All rights reserved.

75 FR 17204 - Submission for OMB Review; Comment Request

Federal Register 2010, 2011, 2012, 2013, 2014

2010-04-05

...--Application Website Content and Usability. Description: Information will be collected on a voluntary basis from new Treasury hires for the purpose of assessing the content and usability of the application Web...

Usability problems do not heal by themselves: National survey on physicians' experiences with EHRs in Finland.

PubMed

Kaipio, Johanna; Lääveri, Tinja; Hyppönen, Hannele; Vainiomäki, Suvi; Reponen, Jarmo; Kushniruk, Andre; Borycki, Elizabeth; Vänskä, Jukka

2017-01-01

Survey studies of health information systems use tend to focus on availability of functionalities, adoption and intensity of use. Usability surveys have not been systematically conducted by any healthcare professional groups on a national scale on a repeated basis. This paper presents results from two cross-sectional surveys of physicians' experiences with the usability of currently used EHR systems in Finland. The research questions were: To what extent has the overall situation improved between 2010 and 2014? What differences are there between healthcare sectors? In the spring of 2014, a survey was conducted in Finland using a questionnaire that measures usability and respondents' user experiences with electronic health record (EHR) systems. The survey was targeted to physicians who were actively doing clinical work. Twenty-four usability-related statements, that were identical in 2010 and 2014, were analysed from the survey. The respondents were also asked to give an overall rating of the EHR system they used. The study data comprised responses from 3081 physicians from the year 2014 and from 3223 physicians in the year 2010, who were using the nine most commonly used EHR system brands in Finland. Physicians' assessments of the usability of their EHR system remain as critical as they were in 2010. On a scale from 1 ('fail') to 7 ('excellent') the average of overall ratings of their principally used EHR systems varied from 3.2 to 4.4 in 2014 (and in 2010 from 2.5 to 4.3). The results show some improvements in the following EHR functionalities and characteristics: summary view of patient's health status, prevention of errors associated with medication ordering, patient's medication list as well as support for collaboration and information exchange between the physician and the nurses. Even so, support for cross-organizational collaboration between physicians and for physician-patient collaboration were still considered inadequate. Satisfaction with technical features had not improved in four years. The results show marked differences between the EHR system brands as well as between healthcare sectors (private sector, public hospitals, primary healthcare). Compared to responses from the public sector, physicians working in the private sector were more satisfied with their EHR systems with regards to statements about user interface characteristics and support for routine tasks. Overall, the study findings are similar to our previous study conducted in 2010. Surveys about the usability of EHR systems are needed to monitor their development at regional and national levels. To our knowledge, this study is the first national eHealth observatory questionnaire that focuses on usability and is used to monitor the long-term development of EHRs. The results do not show notable improvements in physician's ratings for their EHRs between the years 2010 and 2014 in Finland. Instead, the results indicate the existence of serious problems and deficiencies which considerably hinder the efficiency of EHR use and physician's routine work. The survey results call for considerable amount of development work in order to achieve the expected benefits of EHR systems and to avoid technology-induced errors which may endanger patient safety. The findings of repeated surveys can be used to inform healthcare providers, decision makers and politicians about the current state of EHR usability and differences between brands as well as for improvements of EHR usability. This survey will be repeated in 2017 and there is a plan to include other healthcare professional groups in future surveys. Copyright © 2016 The Authors. Published by Elsevier Ireland Ltd.. All rights reserved.

Using Heuristic Evaluation to Improve Sepsis Alert Usability.

PubMed

Pertiwi, Ariani Arista Putri; Fraczkowski, Dan; Stogis, Sheryl L; Lopez, Karen Dunn

2018-06-01

Sepsis, life-threatening organ dysfunction in response to infection, is an alarmingly common and aggressive illness in US hospitals, especially for intensive care patients. Preventing sepsis deaths rests on the clinicians' ability to promptly recognize and treat sepsis. To aid early recognition, many organizations have employed clinician-facing electronic sepsis alert systems. However, the effectiveness of the alert relies on heavily on the visual interface, textual information, and overall usability. This article reports a usability inspection of a sepsis alert system. The authors found violations in 12 of the 14 usability principles and promote use of this method in practice to systematically identify usability problems. Copyright © 2018 Elsevier Inc. All rights reserved.

Evaluation of expert system application based on usability aspects

NASA Astrophysics Data System (ADS)

Munaiseche, C. P. C.; Liando, O. E. S.

2016-04-01

Usability usually defined as a point of human acceptance to a product or a system based on understands and right reaction to an interface. The performance of web application has been influence by the quality of the interface of that web to supporting information transfer process. Preferably, before the applications of expert systems were installed in the operational environment, these applications must be evaluated first by usability testing. This research aimed to measure the usability of the expert system application using tasks as interaction media. This study uses an expert system application to diagnose skin disease in human using questionnaire method which utilize the tasks as interaction media in measuring the usability. Certain tasks were executed by the participants in observing usability value of the application. The usability aspects observed were learnability, efficiency, memorability, errors, and satisfaction. Each questionnaire question represent aspects of usability. The results present the usability value for each aspect and the total average merit for all the five-usability aspect was 4.28, this indicated that the tested expert system application is in the range excellent for the usability level, so the application can be implemented as the operated system by user. The main contribution of the study is the research became the first step in using task model in the usability evaluation for the expert system application software.

Useful to Usable (U2U): Transforming climate information into usable tools to support Midwestern agricultural production

NASA Astrophysics Data System (ADS)

Prokopy, L. S.; Widhalm, M.

2014-12-01

There is a close connection between weather and climate patterns and successful agricultural production. Therefore, incorporating climate information into farm management is likely to reduce the risk of economic losses and increase profitability. While weather and climate information is becoming ever more abundant and accessible, the use of such information in the agricultural community remains limited. Useful to Usable (U2U): Transforming Climate Variability and Change Information for Cereal Crop Producers is a USDA-NIFA funded research and extension project focused on improving the use of climate information for agricultural production in the Midwestern United States by developing user-driven decision tools and training resources. The U2U team is a diverse and uniquely qualified group of climatologists, crop modelers, agronomists, and social scientists from 9 Midwestern universities and two NOAA Regional Climate Centers. Together, we strive to help producers make better long-term plans on what, when and where to plant and also how to manage crops for maximum yields and minimum environmental damage. To ensure relevance and usability of U2U products, our social science team is using a number of techniques including surveys and focus groups to integrate stakeholder interests, needs, and concerns into all aspects of U2U research. It is through this coupling of physical and social science disciplines that we strive to transform existing climate information into actionable knowledge.

A Grounded Theory Approach to Examining Design and Usability Guidelines for Four-Year Tribal College Web Sites

ERIC Educational Resources Information Center

Broberg, Loretta L.

2011-01-01

With the increasing awareness of design and usability issues in regards to websites, in this case tribal college websites, there is an increasing desire to have a set of guidelines to assist in determining design and usability for academic websites. Though there is an overwhelming amount of information available to researchers in this subject area…

Advanced methods for displays and remote control of robots.

PubMed

Eliav, Ami; Lavie, Talia; Parmet, Yisrael; Stern, Helman; Edan, Yael

2011-11-01

An in-depth evaluation of the usability and situation awareness performance of different displays and destination controls of robots are presented. In two experiments we evaluate the way information is presented to the operator and assess different means for controlling the robot. Our study compares three types of displays: a "blocks" display, a HUD (head-up display), and a radar display, and two types of controls: touch screen and hand gestures. The HUD demonstrated better performance when compared to the blocks display and was perceived to have greater usability compared to the radar display. The HUD was also found to be more useful when the operation of the robot was more difficult, i.e., when using the hand-gesture method. The experiments also pointed to the importance of using a wide viewing angle to minimize distortion and for easier coping with the difficulties of locating objects in the field of view margins. The touch screen was found to be superior in terms of both objective performance and its perceived usability. No differences were found between the displays and the controllers in terms of situation awareness. This research sheds light on the preferred display type and controlling method for operating robots from a distance, making it easier to cope with the challenges of operating such systems. Copyright © 2011 Elsevier Ltd and The Ergonomics Society. All rights reserved.

75 FR 14145 - Agency Information Collection Activities: Proposed Collection; Comment Request

Federal Register 2010, 2011, 2012, 2013, 2014

2010-03-24

... made in response to usability testing as well as internal review. Changes have also been made to... burden of reporting using the electronic software and improve usability. The affected questions can be...

Evaluating Usability of Radiology Information Systems in Hospitals of Tabriz University of Medical Sciences.

PubMed

Rezaei-Hachesu, Peyman; Pesianian, Esmaeil; Mohammadian, Mohsen

2016-02-01

Radiology information system (RIS) in order to reduce workload and improve the quality of services must be well-designed. Heuristic evaluation is one of the methods that understand usability problems with the least time, cost and resources. The aim of present study is to evaluate the usability of RISs in hospitals. This is a cross-sectional descriptive study (2015) that uses heuristic evaluation method to evaluate the usability of RIS used in 3 hospitals of Tabriz city. The data are collected using a standard checklist based on 13 principles of Nielsen Heuristic evaluation method. Usability of RISs was investigated based on the number of components observed from Nielsen principles and problems of usability based on the number of non-observed components as well as non-existent or unrecognizable components. by evaluation of RISs in each of the hospitals 1, 2 and 3, total numbers of observed components were obtained as 173, 202 and 196, respectively. It was concluded that the usability of RISs in the studied population, on average and with observing 190 components of the 291 components related to the 13 principles of Nielsen is 65.41 %. Furthermore, problems of usability were obtained as 26.35%. The established and visible nature of some components such as response time of application, visual feedbacks, colors, view and design and arrangement of software objects cause more attention to these components as principal components in designing UI software. Also, incorrect analysis before system design leads to a lack of attention to secondary needs like Help software and security issues.

Reliability, Validity, and Usability of Data Extraction Programs for Single-Case Research Designs.

PubMed

Moeyaert, Mariola; Maggin, Daniel; Verkuilen, Jay

2016-11-01

Single-case experimental designs (SCEDs) have been increasingly used in recent years to inform the development and validation of effective interventions in the behavioral sciences. An important aspect of this work has been the extension of meta-analytic and other statistical innovations to SCED data. Standard practice within SCED methods is to display data graphically, which requires subsequent users to extract the data, either manually or using data extraction programs. Previous research has examined issues of reliability and validity of data extraction programs in the past, but typically at an aggregate level. Little is known, however, about the coding of individual data points. We focused on four different software programs that can be used for this purpose (i.e., Ungraph, DataThief, WebPlotDigitizer, and XYit), and examined the reliability of numeric coding, the validity compared with real data, and overall program usability. This study indicates that the reliability and validity of the retrieved data are independent of the specific software program, but are dependent on the individual single-case study graphs. Differences were found in program usability in terms of user friendliness, data retrieval time, and license costs. Ungraph and WebPlotDigitizer received the highest usability scores. DataThief was perceived as unacceptable and the time needed to retrieve the data was double that of the other three programs. WebPlotDigitizer was the only program free to use. As a consequence, WebPlotDigitizer turned out to be the best option in terms of usability, time to retrieve the data, and costs, although the usability scores of Ungraph were also strong. © The Author(s) 2016.

Digital casts in orthodontics: a comparison of 4 software systems.

PubMed

Westerlund, Anna; Tancredi, Weronika; Ransjö, Maria; Bresin, Andrea; Psonis, Spyros; Torgersson, Olof

2015-04-01

The introduction of digital cast models is inevitable in the otherwise digitized everyday life of orthodontics. The introduction of this new technology, however, is not straightforward, and selecting an appropriate system can be difficult. The aim of the study was to compare 4 orthodontic digital software systems regarding service, features, and usability. Information regarding service offered by the companies was obtained from questionnaires and Web sites. The features of each software system were collected by exploring the user manuals and the software programs. Replicas of pretreatment casts were sent to Cadent (OrthoCAD; Cadent, Carlstadt, NJ), OthoLab (O3DM; OrthoLab, Poznan, Poland), OrthoProof (DigiModel; OrthoProof, Nieuwegein, The Netherlands), and 3Shape (OrthoAnalyzer; 3Shape, Copenhagen, Denmark). The usability of the programs was assessed by experts in interaction design and usability using the "enhanced cognitive walkthrough" method: 4 tasks were defined and performed by a group of domain experts while they were observed by usability experts. The services provided by the companies were similar. Regarding the features, all 4 systems were able to perform basic measurements; however, not all provided the peer assessment rating index or the American Board of Orthodontics analysis, simulation of the treatment with braces, or digital articulation of the casts. All systems demonstrated weaknesses in usability. However, OrthoCAD and 03DM were considered to be easier to learn for first-time users. In general, the usability of these programs was poor and needs to be further developed. Hands-on training supervised by the program experts is recommended for beginners. Copyright © 2015 American Association of Orthodontists. Published by Elsevier Inc. All rights reserved.

Health Websites: Accessibility and Usability for American Sign Language Users

PubMed Central

Kushalnagar, Poorna; Naturale, Joan; Paludneviciene, Raylene; Smith, Scott R.; Werfel, Emily; Doolittle, Richard; Jacobs, Stephen; DeCaro, James

2015-01-01

To date, there have been efforts towards creating better health information access for Deaf American Sign Language (ASL) users. However, the usability of websites with access to health information in ASL has not been evaluated. Our paper focuses on the usability of four health websites that include ASL videos. We seek to obtain ASL users’ perspectives on the navigation of these ASL-accessible websites, finding the health information that they needed, and perceived ease of understanding ASL video content. ASL users (N=32) were instructed to find specific information on four ASL-accessible websites, and answered questions related to: 1) navigation to find the task, 2) website usability, and 3) ease of understanding ASL video content for each of the four websites. Participants also gave feedback on what they would like to see in an ASL health library website, including the benefit of added captioning and/or signer model to medical illustration of health videos. Participants who had lower health literacy had greater difficulty in finding information on ASL-accessible health websites. This paper also describes the participants’ preferences for an ideal ASL-accessible health website, and concludes with a discussion on the role of accessible websites in promoting health literacy in ASL users. PMID:24901350

An information management system for patients with tuberculosis: usability assessment with end-users.

PubMed

Darby, Jonathan; Black, Jim; Morrison, David; Buising, Kirsty

2012-01-01

Information systems with clinical decision support (CDS) offer great potential to assist the co-ordination of patients with chronic diseases and to improve patient care. Despite this, few have entered routine clinical use. Tuberculosis (TB) is an infection of public health importance. It has complex interactions with many comorbid conditions, requires close supervised care and prolonged treatment for effective cure. These features make it suitable for use with an information management system with CDS features. In close consultation with key stakeholders, a clinical application was developed for the management of TB patients in Victoria. A formal usability assessment using semi-structured case-scenario based exercises was performed. Subjects were 12 individuals closely involved in the care of TB patients, including Infectious Diseases and Respiratory Physicians, and Public Health Nurses. Two researchers conducted the sessions, independently analysed responses and discrepancies compared to the voice record for validity. Despite varied computer experience, responses were positive regarding user interface and content. Data location was not always intuitive, however this improved with familiarity of the program. Decision support was considered valuable, with useful suggestions for expansion of these features. Automated reporting for correspondence and notification to the Health Department were felt worth the initial investment in data entry. An important workflow-based issue regarding dismissal of alerts and several errors were detected. Usability assessment validated many design elements of the system, provided a unique insight into workflow issues faced by users and hopefully will impact on its ultimate clinical utility.

OPTIMIZING USABILITY OF AN ECONOMIC DECISION SUPPORT TOOL: PROTOTYPE OF THE EQUIPT TOOL.

PubMed

Cheung, Kei Long; Hiligsmann, Mickaël; Präger, Maximilian; Jones, Teresa; Józwiak-Hagymásy, Judit; Muñoz, Celia; Lester-George, Adam; Pokhrel, Subhash; López-Nicolás, Ángel; Trapero-Bertran, Marta; Evers, Silvia M A A; de Vries, Hein

2018-01-01

Economic decision-support tools can provide valuable information for tobacco control stakeholders, but their usability may impact the adoption of such tools. This study aims to illustrate a mixed-method usability evaluation of an economic decision-support tool for tobacco control, using the EQUIPT ROI tool prototype as a case study. A cross-sectional mixed methods design was used, including a heuristic evaluation, a thinking aloud approach, and a questionnaire testing and exploring the usability of the Return of Investment tool. A total of sixty-six users evaluated the tool (thinking aloud) and completed the questionnaire. For the heuristic evaluation, four experts evaluated the interface. In total twenty-one percent of the respondents perceived good usability. A total of 118 usability problems were identified, from which twenty-six problems were categorized as most severe, indicating high priority to fix them before implementation. Combining user-based and expert-based evaluation methods is recommended as these were shown to identify unique usability problems. The evaluation provides input to optimize usability of a decision-support tool, and may serve as a vantage point for other developers to conduct usability evaluations to refine similar tools before wide-scale implementation. Such studies could reduce implementation gaps by optimizing usability, enhancing in turn the research impact of such interventions.

A health literacy and usability heuristic evaluation of a mobile consumer health application.

PubMed

Monkman, Helen; Kushniruk, Andre

2013-01-01

Usability and health literacy are two critical factors in the design and evaluation of consumer health information systems. However, methods for evaluating these two factors in conjunction remain limited. This study adapted a set of existing guidelines for the design of consumer health Web sites into evidence-based evaluation heuristics tailored specifically for mobile consumer health applications. In order to test the approach, a mobile consumer health application (app) was then evaluated using these heuristics. In addition to revealing ways to improve the usability of the system, this analysis identified opportunities to augment the content to make it more understandable by users with limited health literacy. This study successfully demonstrated the utility of converting existing design guidelines into heuristics for the evaluation of usability and health literacy. The heuristics generated could be applied for assessing and revising other existing consumer health information systems.

Getting a Technology-based Diabetes Intervention Ready for Primetime: A Review of Usability Testing Studies

PubMed Central

Lyles, Courtney R.; Sarkar, Urmimala; Osborn, Chandra Y.

2014-01-01

Consumer health technologies can educate patients about diabetes and support their self-management, yet usability evidence is rarely published even though it determines patient engagement, optimal benefit of any intervention, and an understanding of generalizability. Therefore, we conducted a narrative review of peer-reviewed articles published from 2009–2013 that tested the usability of a web- or mobile-delivered system/application designed to educate and support patients with diabetes. Overall, the 23 papers included in our review used mixed (n=11), descriptive quantitative (n=9), and qualitative methods (n=3) to assess usability, such as documenting which features performed as intended and how patients rated their experiences. More sophisticated usability evaluations combined several complementary approaches to elucidate more aspects of functionality. Future work pertaining to the design and evaluation of technology-delivered diabetes education/support interventions should aim to standardize the usability testing processes, and publish usability findings to inform interpretation of why an intervention succeeded or failed, and for whom. PMID:25173689

Integrating user centered design, universal design and goal, operation, method and selection rules to improve the usability of DAISY player for persons with visual impairments.

PubMed

Huang, Po-Hsin; Chiu, Ming-Chuan

2016-01-01

The Digital Accessible Information SYstem (DAISY) player is an assistive reading tool developed for use by persons with visual impairments. Certain problems have persisted in the operating procedure and interface of DAISY players, especially for their Chinese users. Therefore, the aim of this study was to redesign the DAISY player with increased usability features for use by native Chinese speakers. First, a User Centered Design (UCD) process was employed to analyze the development of the prototype. Next, operation procedures were reorganized according to GOMS (Goals, Operators, Methods, and Selection rules) methodology. Then the user interface was redesigned according to specific Universal Design (UD) principles. Following these revisions, an experiment involving four scenarios was conducted to compare the new prototype to other players, and it was tested by twelve visually impaired participants. Results indicate the prototype had the quickest operating times, the fewest number of operating errors, and the lowest mental workloads of all the compared players, significantly enhancing the prototype's usability. These findings have allowed us to generate suggestions for developing the next generation of DAISY players for people, especially for Chinese audience. Copyright © 2015 Elsevier Ltd and The Ergonomics Society. All rights reserved.

Usability engineering: domain analysis activities for augmented-reality systems

NASA Astrophysics Data System (ADS)

Gabbard, Joseph; Swan, J. E., II; Hix, Deborah; Lanzagorta, Marco O.; Livingston, Mark; Brown, Dennis B.; Julier, Simon J.

2002-05-01

This paper discusses our usability engineering process for the Battlefield Augmented Reality System (BARS). Usability engineering is a structured, iterative, stepwise development process. Like the related disciplines of software and systems engineering, usability engineering is a combination of management principals and techniques, formal and semi- formal evaluation techniques, and computerized tools. BARS is an outdoor augmented reality system that displays heads- up battlefield intelligence information to a dismounted warrior. The paper discusses our general usability engineering process. We originally developed the process in the context of virtual reality applications, but in this work we are adapting the procedures to an augmented reality system. The focus of this paper is our work on domain analysis, the first activity of the usability engineering process. We describe our plans for and our progress to date on our domain analysis for BARS. We give results in terms of a specific urban battlefield use case we have designed.

Usability 101: A Pilot Test of DOE PAGES Beta | OSTI, US Dept of Energy

Science.gov Websites

Office of Scientific and Technical Information skip to main content Sign In Create Account OSTI.GOV title logo U.S. Department of Energy Office of Scientific and Technical Information Search terms News Sign In Create Account This page is being shared by OSTI.GOV. Usability 101: A Pilot Test of DOE

BRD usability requirements

DOE Office of Scientific and Technical Information (OSTI.GOV)

Deshpande, Alina

2015-03-12

This document describes the usability requirements for the Biosurveillance resource directory (BRD); that is, who will be using the tool and what tasks they will be using it for. It does not include information on technical implementation (e.g., whether specific information is contained in the database or pulled on demand from other sources). It also avoids specific design ideas (such as widget descriptions) unless they are necessary to illustrate a requirement.

The Use of an Adapted Health IT Usability Evaluation Model (Health-ITUEM) for Evaluating Consumer Reported Ratings of Diabetes mHealth Applications: Implications for Diabetes Care and Management

PubMed Central

Househ, Mowafa S.; Shubair, Mamdouh M.; Yunus, Faisel; Jamal, Amr; Aldossari, Bakheet

2015-01-01

Background: The aim of this paper is to present a usability analysis of the consumer ratings of key diabetes mHealth applications using an adapted Health IT Usability Evaluation Model (Health-ITUEM). Methods: A qualitative content analysis method was used to analyze publicly available consumer reported data posted on the Android Market and Google Play for four leading diabetes mHealth applications. Health-ITUEM concepts including information needs, flexibility/customizability, learnability, performance speed, and competency guided the categorization and analysis of the data. Health impact was an additional category that was included in the study. A total of 405 consumers’ ratings collected from January 9, 2014 to February 17, 2014 were included in the study. Results: Overall, the consumers’ ratings of the leading diabetes mHealth applications for both usability and health impacts were positive. The performance speed of the mHealth application and the information needs of the consumers were the primary usability factors impacting the use of the diabetes mHealth applications. There was also evidence on the positive health impacts of such applications. Conclusions: Consumers are more likely to use diabetes related mHealth applications that perform well and meet their information needs. Furthermore, there is preliminary evidence that diabetes mHealth applications can have positive impact on the health of patients. PMID:26635437

The Use of an Adapted Health IT Usability Evaluation Model (Health-ITUEM) for Evaluating Consumer Reported Ratings of Diabetes mHealth Applications: Implications for Diabetes Care and Management.

PubMed

Househ, Mowafa S; Shubair, Mamdouh M; Yunus, Faisel; Jamal, Amr; Aldossari, Bakheet

2015-10-01

The aim of this paper is to present a usability analysis of the consumer ratings of key diabetes mHealth applications using an adapted Health IT Usability Evaluation Model (Health-ITUEM). A qualitative content analysis method was used to analyze publicly available consumer reported data posted on the Android Market and Google Play for four leading diabetes mHealth applications. Health-ITUEM concepts including information needs, flexibility/customizability, learnability, performance speed, and competency guided the categorization and analysis of the data. Health impact was an additional category that was included in the study. A total of 405 consumers' ratings collected from January 9, 2014 to February 17, 2014 were included in the study. Overall, the consumers' ratings of the leading diabetes mHealth applications for both usability and health impacts were positive. The performance speed of the mHealth application and the information needs of the consumers were the primary usability factors impacting the use of the diabetes mHealth applications. There was also evidence on the positive health impacts of such applications. Consumers are more likely to use diabetes related mHealth applications that perform well and meet their information needs. Furthermore, there is preliminary evidence that diabetes mHealth applications can have positive impact on the health of patients.

Sociotechnical Human Factors Involved in Remote Online Usability Testing of Two eHealth Interventions

PubMed Central

2016-01-01

Background Research in the fields of human performance technology and human computer interaction are challenging the traditional macro focus of usability testing arguing for methods that help test moderators assess “use in context” (ie, cognitive skills, usability understood over time) and in authentic “real world” settings. Human factors in these complex test scenarios may impact on the quality of usability results being derived yet there is a lack of research detailing moderator experiences in these test environments. Most comparative research has focused on the impact of the physical environment on results, and rarely on how the sociotechnical elements of the test environment affect moderator and test user performance. Improving our understanding of moderator roles and experiences with conducting “real world” usability testing can lead to improved techniques and strategies Objective To understand moderator experiences of using Web-conferencing software to conduct remote usability testing of 2 eHealth interventions. Methods An exploratory case study approach was used to study 4 moderators’ experiences using Blackboard Collaborate for remote testing sessions of 2 different eHealth interventions. Data collection involved audio-recording iterative cycles of test sessions, collecting summary notes taken by moderators, and conducting 2 90-minute focus groups via teleconference. A direct content analysis with an inductive coding approach was used to explore personal accounts, assess the credibility of data interpretation, and generate consensus on the thematic structure of the results. Results Following the convergence of data from the various sources, 3 major themes were identified: (1) moderators experienced and adapted to unpredictable changes in cognitive load during testing; (2) moderators experienced challenges in creating and sustaining social presence and untangling dialogue; and (3) moderators experienced diverse technical demands, but were able to collaboratively troubleshoot with test users. Conclusions Results highlight important human-computer interactions and human factor qualities that impact usability testing processes. Moderators need an advanced skill and knowledge set to address the social interaction aspects of Web-based usability testing and technical aspects of conferencing software during test sessions. Findings from moderator-focused studies can inform the design of remote testing platforms and real-time usability evaluation processes that place less cognitive burden on moderators and test users. PMID:27026291

"Think aloud" and "Near live" usability testing of two complex clinical decision support tools.

PubMed

Richardson, Safiya; Mishuris, Rebecca; O'Connell, Alexander; Feldstein, David; Hess, Rachel; Smith, Paul; McCullagh, Lauren; McGinn, Thomas; Mann, Devin

2017-10-01

Low provider adoption continues to be a significant barrier to realizing the potential of clinical decision support. "Think Aloud" and "Near Live" usability testing were conducted on two clinical decision support tools. Each was composed of an alert, a clinical prediction rule which estimated risk of either group A Streptococcus pharyngitis or pneumonia and an automatic order set based on risk. The objective of this study was to further understanding of the facilitators of usability and to evaluate the types of additional information gained from proceeding to "Near Live" testing after completing "Think Aloud". This was a qualitative observational study conducted at a large academic health care system with 12 primary care providers. During "Think Aloud" testing, participants were provided with written clinical scenarios and asked to verbalize their thought process while interacting with the tool. During "Near Live" testing participants interacted with a mock patient. Morae usability software was used to record full screen capture and audio during every session. Participant comments were placed into coding categories and analyzed for generalizable themes. Themes were compared across usability methods. "Think Aloud" and "Near Live" usability testing generated similar themes under the coding categories visibility, workflow, content, understand-ability and navigation. However, they generated significantly different themes under the coding categories usability, practical usefulness and medical usefulness. During both types of testing participants found the tool easier to use when important text was distinct in its appearance, alerts were passive and appropriately timed, content was up to date, language was clear and simple, and each component of the tool included obvious indicators of next steps. Participant comments reflected higher expectations for usability and usefulness during "Near Live" testing. For example, visit aids, such as automatically generated order sets, were felt to be less useful during "Near-Live" testing because they would not be all inclusive for the visit. These complementary types of usability testing generated unique and generalizable insights. Feedback during "Think Aloud" testing primarily helped to improve the tools' ease of use. The additional feedback from "Near Live" testing, which mimics a real clinical encounter, was helpful for eliciting key barriers and facilitators to provider workflow and adoption. Copyright © 2017 Elsevier B.V. All rights reserved.

Redesign of a computerized clinical reminder for colorectal cancer screening: a human-computer interaction evaluation

PubMed Central

2011-01-01

Background Based on barriers to the use of computerized clinical decision support (CDS) learned in an earlier field study, we prototyped design enhancements to the Veterans Health Administration's (VHA's) colorectal cancer (CRC) screening clinical reminder to compare against the VHA's current CRC reminder. Methods In a controlled simulation experiment, 12 primary care providers (PCPs) used prototypes of the current and redesigned CRC screening reminder in a within-subject comparison. Quantitative measurements were based on a usability survey, workload assessment instrument, and workflow integration survey. We also collected qualitative data on both designs. Results Design enhancements to the VHA's existing CRC screening clinical reminder positively impacted aspects of usability and workflow integration but not workload. The qualitative analysis revealed broad support across participants for the design enhancements with specific suggestions for improving the reminder further. Conclusions This study demonstrates the value of a human-computer interaction evaluation in informing the redesign of information tools to foster uptake, integration into workflow, and use in clinical practice. PMID:22126324

Evaluation of a Telerehabilitation System for Community-Based Rehabilitation

PubMed Central

Schutte, Jamie; Gales, Sara; Filippone, Ashlee; Saptono, Andi; Parmanto, Bambang; McCue, Michael

2012-01-01

The use of web-based portals, while increasing in popularity in the fields of medicine and research, are rarely reported on in community-based rehabilitation programs. A program within the Pennsylvania Office of Vocational Rehabilitation’s Hiram G. Andrews Center, the Cognitive Skills Enhancement Program (CSEP), sought to enhance organization of program and participant information and communication between part- and full-time employees, supervisors and consultants. A telerehabilitation system was developed consisting of (1) a web-based portal to support a variety of clinical activities, and (2) the Versatile Integrated System for Telerehabilitation (VISYTER) video-conferencing system to support the collaboration and delivery of rehabilitation services remotely. This descriptive evaluation examines the usability of the telerehabilitation system incorporating both the portal and VISYTER. Telerehabilitation system users include CSEP staff members from three geographical locations and employed by two institutions. The IBM After-Scenario Questionnaire (ASQ) and Post-Study System Usability Questionnaire (PSSUQ), the Telehealth Usability Questionnaire (TUQ), and two demographic surveys were administered to gather both objective and subjective information. Results showed generally high levels of usability. Users commented that the telerehabilitation system improved communication, increased access to information, improved speed of completing tasks, and had an appealing interface. Areas where users would like to see improvements, including ease of accessing/editing documents and searching for information, are discussed. PMID:25945193

Quality of vascular surgery Web sites on the Internet.

PubMed

Grewal, Perbinder; Williams, Bryn; Alagaratnam, Swethan; Neffendorf, James; Soobrah, Ritish

2012-11-01

This study evaluated the readability, accessibility, usability, and reliability of vascular surgery information on the Internet in the English language. The Google, Yahoo, and MSN/Bing search engines were searched for "carotid endarterectomy," "EVAR or endovascular aneurysm repair," and "varicose veins or varicose veins surgery." The first 50 Web sites from each search engine for each topic were analyzed. The Flesch Reading Ease Score and Gunning Fog Index were calculated to assess readability. The LIDA tool (Minervation Ltd, Oxford, UK) was used to assess accessibility, usability, and reliability. The Web sites were difficult to read and comprehend. The mean Flesch Reading Ease scores were 53.53 for carotid endarterectomy, 50.53 for endovascular aneurysm repair, and 58.59 for varicose veins. The mean Gunning Fog Index scores were 12.3 for carotid endarterectomy, 12.12 for endovascular aneurysm repair, and 10.69 for varicose veins. The LIDA values for accessibility were good, but the results for usability and reliability were poor. Internet information on vascular surgical conditions and procedures is poorly written and unreliable. We suggest that health professionals should recommend Web sites that are easy to read and contain high-quality surgical information. Medical information on the Internet must be readable, accessible, usable, and reliable. Copyright © 2012 Society for Vascular Surgery. Published by Mosby, Inc. All rights reserved.

Development of an interactive social media tool for parents with concerns about vaccines.

PubMed

Shoup, Jo Ann; Wagner, Nicole M; Kraus, Courtney R; Narwaney, Komal J; Goddard, Kristin S; Glanz, Jason M

2015-06-01

Describe a process for designing, building, and evaluating a theory-driven social media intervention tool to help reduce parental concerns about vaccination. We developed an interactive web-based tool using quantitative and qualitative methods (e.g., survey, focus groups, individual interviews, and usability testing). Survey results suggested that social media may represent an effective intervention tool to help parents make informed decisions about vaccination for their children. Focus groups and interviews revealed four main themes for development of the tool: Parents wanted information describing both benefits and risks of vaccination, transparency of sources of information, moderation of the tool by an expert, and ethnic and racial diversity in the visual display of people. Usability testing showed that parents were satisfied with the usability of the tool but had difficulty with performing some of the informational searches. Based on focus groups, interviews, and usability evaluations, we made additional revisions to the tool's content, design, functionality, and overall look and feel. Engaging parents at all stages of development is critical when designing a tool to address concerns about childhood vaccines. Although this can be both resource- and time-intensive, the redesigned tool is more likely to be accepted and used by parents. Next steps involve a formal evaluation through a randomized trial. © 2014 Society for Public Health Education.

Evaluation of the reliability, usability, and applicability of AMSTAR, AMSTAR 2, and ROBIS: protocol for a descriptive analytic study.

PubMed

Gates, Allison; Gates, Michelle; Duarte, Gonçalo; Cary, Maria; Becker, Monika; Prediger, Barbara; Vandermeer, Ben; Fernandes, Ricardo M; Pieper, Dawid; Hartling, Lisa

2018-06-13

Systematic reviews (SRs) of randomised controlled trials (RCTs) can provide the best evidence to inform decision-making, but their methodological and reporting quality varies. Tools exist to guide the critical appraisal of quality and risk of bias in SRs, but evaluations of their measurement properties are limited. We will investigate the interrater reliability (IRR), usability, and applicability of A MeaSurement Tool to Assess systematic Reviews (AMSTAR), AMSTAR 2, and Risk Of Bias In Systematic reviews (ROBIS) for SRs in the fields of biomedicine and public health. An international team of researchers at three collaborating centres will undertake the study. We will use a random sample of 30 SRs of RCTs investigating therapeutic interventions indexed in MEDLINE in February 2014. Two reviewers at each centre will appraise the quality and risk of bias in each SR using AMSTAR, AMSTAR 2, and ROBIS. We will record the time to complete each assessment and for the two reviewers to reach consensus for each SR. We will extract the descriptive characteristics of each SR, the included studies, participants, interventions, and comparators. We will also extract the direction and strength of the results and conclusions for the primary outcome. We will summarise the descriptive characteristics of the SRs using means and standard deviations, or frequencies and proportions. To test for interrater reliability between reviewers and between the consensus agreements of reviewer pairs, we will use Gwet's AC 1 statistic. For comparability to previous evaluations, we will also calculate weighted Cohen's kappa and Fleiss' kappa statistics. To estimate usability, we will calculate the mean time to complete the appraisal and to reach consensus for each tool. To inform applications of the tools, we will test for statistical associations between quality scores and risk of bias judgments, and the results and conclusions of the SRs. Appraising the methodological and reporting quality of SRs is necessary to determine the trustworthiness of their conclusions. Which tool may be most reliably applied and how the appraisals should be used is uncertain; the usability of newly developed tools is unknown. This investigation of common (AMSTAR) and newly developed (AMSTAR 2, ROBIS) tools will provide empiric data to inform their application, interpretation, and refinement.

Establishing best practices to improve usability of web interfaces providing atmospheric data

NASA Astrophysics Data System (ADS)

Oakley, N.; Daudert, B.

2014-12-01

Accessing scientific data through an online portal can be a frustrating task. The concept of making web interfaces easy to use known as "usability" has been thoroughly researched in the field of e-commerce but has not been explicitly addressed in the atmospheric sciences. As more observation stations are installed, satellite missions flown, models run, and field campaigns performed, large amounts of data are produced. Portals on the Internet have become the favored mechanisms to share this information and are ever increasing in number. Portals are often created without being tested for usability with the target audience though the expenses of testing are low and the returns high. To remain competitive and relevant in the provision of atmospheric data, it is imperative that developers understand design elements of a successful portal to make their product stand out among others. This presentation informs the audience of the benefits and basic principles of usability for web pages presenting atmospheric data. We will also share some of the best practices and recommendations we have formulated from the results of usability testing performed on two data provision web sites hosted by the Western Regional Climate Center.

Applying usability testing techniques to improve a health promotion website.

PubMed

Hinchliffe, Anetta; Mummery, W Kerry

2008-04-01

Use of the Internet for health promotion is increasing; however, the lack of published research regarding website usability suggests that health promotion websites are being developed without consultation with their users or formal evaluation. This study conducted usability testing of an existing health promotion website to inform modifications and to identify common usability themes that should be addressed by organisations developing or maintaining a health promotion website. A combination of qualitative and quantitative techniques were implemented during the usability testing sessions to gather data from users while completing tasks on the website. Techniques included performance measures (time taken), direct observation (participant observation) and subjective user preferences (questionnaire and interview). Improvements to the website were measured in terms of reduced problems reported, reduced time taken to complete tasks and increased subjective reports. Seven usability themes emerged from the data: design, feedback, format, instructions, navigation, terminology and learnability. This study demonstrates the application of usability testing to the design and modification of a health promotion website and illustrates the areas or themes that can be used as a framework for testing and modification.

Virtually Usable: A Test of the Information Gardens

ERIC Educational Resources Information Center

Johnson, Megan; Ochoa, Louise; Purpur, Geraldine

2007-01-01

This paper presents the results of a usability study conducted to determine the functionality of a desktop, three-dimensional virtual library designed and supported by the Appalachian State University Distance Learning Library Services team. Formative evaluations were performed with representative students utilizing Morae software. Results…

Enhancing patient safety and quality of care by improving the usability of electronic health record systems: recommendations from AMIA.

PubMed

Middleton, Blackford; Bloomrosen, Meryl; Dente, Mark A; Hashmat, Bill; Koppel, Ross; Overhage, J Marc; Payne, Thomas H; Rosenbloom, S Trent; Weaver, Charlotte; Zhang, Jiajie

2013-06-01

In response to mounting evidence that use of electronic medical record systems may cause unintended consequences, and even patient harm, the AMIA Board of Directors convened a Task Force on Usability to examine evidence from the literature and make recommendations. This task force was composed of representatives from both academic settings and vendors of electronic health record (EHR) systems. After a careful review of the literature and of vendor experiences with EHR design and implementation, the task force developed 10 recommendations in four areas: (1) human factors health information technology (IT) research, (2) health IT policy, (3) industry recommendations, and (4) recommendations for the clinician end-user of EHR software. These AMIA recommendations are intended to stimulate informed debate, provide a plan to increase understanding of the impact of usability on the effective use of health IT, and lead to safer and higher quality care with the adoption of useful and usable EHR systems.

Enhancing patient safety and quality of care by improving the usability of electronic health record systems: recommendations from AMIA

PubMed Central

Middleton, Blackford; Bloomrosen, Meryl; Dente, Mark A; Hashmat, Bill; Koppel, Ross; Overhage, J Marc; Payne, Thomas H; Rosenbloom, S Trent; Weaver, Charlotte; Zhang, Jiajie

2013-01-01

In response to mounting evidence that use of electronic medical record systems may cause unintended consequences, and even patient harm, the AMIA Board of Directors convened a Task Force on Usability to examine evidence from the literature and make recommendations. This task force was composed of representatives from both academic settings and vendors of electronic health record (EHR) systems. After a careful review of the literature and of vendor experiences with EHR design and implementation, the task force developed 10 recommendations in four areas: (1) human factors health information technology (IT) research, (2) health IT policy, (3) industry recommendations, and (4) recommendations for the clinician end-user of EHR software. These AMIA recommendations are intended to stimulate informed debate, provide a plan to increase understanding of the impact of usability on the effective use of health IT, and lead to safer and higher quality care with the adoption of useful and usable EHR systems. PMID:23355463

The quality of orthodontic practice websites.

PubMed

Parekh, J; Gill, D S

2014-05-01

To evaluate orthodontic practice websites for the reliability of information presented, accessibility, usability for patients and compliance to General Dental Council (GDC) regulations on ethical advertising. World Wide Web. The term 'orthodontic practice' was entered into three separate search engines. The 30 websites from the UK were selected and graded according to the LIDA tool (a validated method of evaluating healthcare websites) for accessibility, usability of the website and reliability of information on orthodontic treatment. The websites were then evaluated against the GDC's Principles for ethical advertising in nine different criteria. On average, each website fulfilled six out of nine points of the GDC's criteria, with inclusion of a complaints policy being the most poorly fulfilled criteria. The mean LIDA score (a combination of usability, reliability and accessibility) was 102/144 (standard deviation 8.38). The websites scored most poorly on reliability (average 43% SD 11.7), with no single website reporting a clear, reliable method of content production. Average accessibility was 81% and usability 73%. In general, websites did not comply with GDC guidelines on ethical advertising. Furthermore, practitioners should consider reporting their method of information production, particularly when making claims about efficiency and speed of treatment in order to improve reliability.

How Do Clinical Information Systems Affect the Cognitive Demands of General Practitioners?: Usability Study with a Focus on Cognitive Workload.

PubMed

Ariza, Ferran; Kalra, Dipak; Potts, Henry Ww

2015-11-20

Clinical information systems in the National Health Service do not need to conform to any explicit usability requirements. Poor usability can increase the mental workload experienced by clinicians and cause fatigue, increase error rates and impact the overall patient safety. Mental workload can be used as a measure of usability. To assess the subjective cognitive workload experienced by general practitioners (GPs) with their systems. To raise awareness of the importance of usability in system design among users, designers, developers and policymakers. We used a modified version of the NASA Task Load Index, adapted for web. We developed a set of common clinical scenarios and computer tasks on an online survey. We emailed the study link to 199 clinical commissioning groups and 1,646 GP practices in England. Sixty-seven responders completed the survey. The respondents had spent an average of 17 years in general practice, had experience of using a mean of 1.5 GP computer systems and had used their current system for a mean time of 6.7 years. The mental workload score was not different among systems. There were significant differences among the task scores, but these differences were not specific to particular systems. The overall score and task scores were related to the length of experience with their present system. Four tasks imposed a higher mental workload on GPs: 'repeat prescribing', 'find episode', 'drug management' and 'overview records'. Further usability studies on GP systems should focus on these tasks. Users, policymakers, designers and developers should remain aware of the importance of usability in system design.What does this study add?• Current GP systems in England do not need to conform to explicit usability requirements. Poor usability can increase the mental workload of clinicians and lead to errors.• Some clinical computer tasks incur more cognitive workload than others and should be considered carefully during the design of a system.• GPs did not report overall very high levels of subjective cognitive workload when undertaking common clinical tasks with their systems.• Further usability studies on GP systems should focus on the tasks incurring higher cognitive workload.• Users, policymakers, and designers and developers should remain aware of the importance of usability in system design.

Isolating the Effects of a Mobile Phone on the Usability and Safety of eHealth Software Applications.

PubMed

Borycki, Elizabeth M; Griffith, Janessa; Monkman, Helen; Reid-Haughian, Cheryl

2017-01-01

Mobile phones are used in conjunction with mobile eHealth software applications. These mobile software applications can be used to access, review and document clinical information. The objective of this research was to explore the relationship between mobile phones, usability and safety. Clinical simulations and semi-structured interviews were used to investigate this relationship. The findings revealed that mobile phones may lead to specific types of usability issues that may introduce some types of errors.

End-Users' Voice in EHR Selection: Development of a Usability Questionnaire for Demonstrations in Procurement (DPUQ).

PubMed

Tyllinen, Mari; Kaipio, Johanna; Lääveri, Tinja; Nieminen, Marko

2017-01-01

This paper describes the development of a questionnaire for evaluating usability during EHR system procurement (DPUQ). Established usability questionnaires can be used to gather user feedback after using the systems. However, during procurement, experimenting with real system use is practical only with a limited number of system candidates. There is a need for less resource-demanding usability evaluation in the early stages of procurement in cases with several vendors. DPUQ has been designed for usability evaluation by end-users during special scenario-based vendor demonstrations. The questionnaire includes three sets of questions to be used during and after the vendor demonstration. DPUQ delivers specific usability scores and can be used to compare system candidates in procurement complementing other evaluation methods.

Usability evaluation of the interactive Personal Patient Profile-Prostate decision support system with African American men.

PubMed

Jaja, Cheedy; Pares-Avila, Jose; Wolpin, Seth; Berry, Donna

2010-04-01

The Personal Patient Profile-Prostate (P4) program is an interactive Web-based decision support system that provides men with localized prostate cancer customized education and coaching with which to make the best personal treatment decision. This study assessed functionality and usability of the P4 program and identified problems in user-computer interaction in a sample of African American men. Usability testing was conducted with 12 community-dwelling African American adult men. The health status of participants was not known or collected by the research team. Each participant worked with the P4 program and provided simultaneous feedback using the "think aloud" technique. Handwritten field notes were collated and assigned to 3 standard coded categories. Aspects of P4 program usability was made based on common issues in the assigned categories. Summary statistics were derived for types and frequency of usability issues noted in the coded data. Twelve participants reported a total of 122 usability comments, with a mean of 9 usability comments. The most common usability issue by participant was completeness of information content, which comprised 53 (43%) of the total issues. Comprehensibility of text and graphics was second, comprising 51 (42%) of the total issues. This study provided initial inventory of usability issues for community African American men that may potentially interfere with application of the P4 system in the community setting and overall system usability, confirming the need for usability testing of a culturally appropriate Internet-based decision support system before community application.

Graphical Weather Information System Evaluation: Usability, Perceived Utility, and Preferences from General Aviation Pilots

NASA Technical Reports Server (NTRS)

Latorella, Kara A.; Chamberlain, James P.

2002-01-01

Weather is a significant factor in General Aviation (GA) accidents and fatality rates. Graphical Weather Information Systems (GWISs) for the flight deck are appropriate technologies for mitigating the difficulties GA pilots have with current aviation weather information sources. This paper describes usability evaluations of a prototype GWIS by 12 GA pilots after using the system in flights towards convective weather. We provide design guidance for GWISs and discuss further research required to support weather situation awareness and in-flight decision making for GA pilots.

Post-deployment usability evaluation of a radiology workstation.

PubMed

Jorritsma, Wiard; Cnossen, Fokie; Dierckx, Rudi A; Oudkerk, Matthijs; Van Ooijen, Peter M A

2016-01-01

To determine the number, nature and severity of usability issues radiologists encounter while using a commercially available radiology workstation in clinical practice, and to assess how well the results of a pre-deployment usability evaluation of this workstation generalize to clinical practice. The usability evaluation consisted of semi-structured interviews and observations of twelve users using the workstation during their daily work. Usability issues and positive usability findings were documented. Each issue was given a severity rating and its root cause was determined. Results were compared to the results of a pre-deployment usability evaluation of the same workstation. Ninety-two usability issues were identified, ranging from issues that cause minor frustration or delay, to issues that cause significant delays, prevent users from completing tasks, or even pose a potential threat to patient safety. The results of the pre-deployment usability evaluation had limited generalizability to clinical practice. This study showed that radiologists encountered a large number and a wide variety of usability issues when using a commercially available radiology workstation in clinical practice. This underlines the need for effective usability engineering in radiology. Given the limitations of pre-deployment usability evaluation in radiology, which were confirmed by our finding that the results of a pre-deployment usability evaluation of this workstation had limited generalizability to clinical practice, it is vital that radiology workstation vendors devote significant resources to usability engineering efforts before deployment of their workstation, and to continue these efforts after the workstation is deployed in a hospital. Copyright © 2015 Elsevier Ireland Ltd. All rights reserved.

77 FR 8217 - Evaluating the Usability of Electronic Health Record (EHR) Systems

Federal Register 2010, 2011, 2012, 2013, 2014

2012-02-14

... interface design guidelines for EHRs. Manufacturers interested in participating in this research will be... the usability of health information technology (HIT) systems. NIST research is designed to: (1... develop performance-oriented user interface design guidelines for EHRs, and a framework for assessing the...

Low-Cost Rapid Usability Testing: Its Application in Both Product Development and System Implementation.

PubMed

Kushniruk, Andre; Borycki, Elizabeth

2017-01-01

In recent years there has been considerable discussion around the need for certification and regulation of healthcare information technology (IT). In particular, the usability of the products being developed needs to be evaluated. This has included the application of standards designed to ensure the process of system development is user-centered and takes usability into consideration while a product is being developed. In addition to this, in healthcare, organizations in the United States and Europe have also addressed the need and requirement for product certification. However, despite these efforts there are continued reports of unusable and unsafe implementations. In this paper we discuss the need to not only include (and require) usability testing in the one-time development process of health IT products (such as EHRs), but we also argue for the need to additionally develop specific usability standards and requirements for usability testing during the implementation of vendor products (i.e. post product development) in healthcare settings. It is further argued that health IT products that may have been certified regarding their development process will still require application of usability testing in the process of implementing them in real hospital settings in order to ensure usability and safety. This is needed in order to ensure that the final result of both product development and implementation processes take into account and apply the latest usability principles and methods.

Usability in the real world: assessing medical information technologies in patients' homes.

PubMed

Kaufman, David R; Patel, Vimla L; Hilliman, Charlyn; Morin, Philip C; Pevzner, Jenia; Weinstock, Ruth S; Goland, Robin; Shea, Steven; Starren, Justin

2003-01-01

This paper presents an approach to usability evaluation of computer-based health care systems designed for patient use in their homes. Although such devices are becoming more prevalent, there is very little known about their usability. The theoretical foundations for the methods are discussed. The approach incorporates a cognitive walkthrough usability evaluation and new methods for usability testing that can be conducted in patient's homes. The method was applied to the IDEATel intervention, a multi-institution randomized controlled trial of the feasibility, acceptability, and clinical utility of a home-based telemedicine system for diabetic Medicare population. The usability study was designed to assess barriers to optimal use of the system. The focus was both on dimensions of the interface and on dimensions of patient skills and competency. The usability field research involved testing 25 patients in their homes using the system. The analysis included a range of video-analytic methods of varying levels of granularity. The usability evaluation revealed aspects of the interface that were sub-optimal and impeded the performance of certain tasks. It also found a range of patient-related factors such as numeracy and psychomotor skills that constituted barriers to productive use. A multifaceted usability approach provided important insight regarding use of technology by an elderly chronic-care patient population and more generally, for understanding how home health initiatives can more effectively use such technology.

Addressing critical issues in the development of an Oncology Information System.

PubMed

Urda, D; Ribelles, N; Subirats, J L; Franco, L; Alba, E; Jerez, J M

2013-05-01

This paper presents the experience on the design and implementation of a user-centered Oncology Information System developed for the Medical Oncology Department at the "Hospital Universitario Virgen de la Victoria", in Málaga, Spain. The project focused on the aspects considered in the literature as critical factors for a successful deployment and usage of a health information system. System usability, adequate technology, integration of clinical routines, real-time statistical analysis of data, information confidentiality and standard protocol-based external interconnection were the key aspects considered. The developed system is based on a web application with a modular and layered architecture accounting for usability, ease of maintenance and further system development. Evaluation of system usability was carried at three and fifteen months after system deployment to analyze the advantages/disadvantages experienced by the end-users. A thorough prior analysis of clinical activities and workflows, the use of the adequate technology, and the availability of data analysis tools will almost guarantee success in the deployment of an Oncology Information System. Copyright © 2012 Elsevier Ireland Ltd. All rights reserved.

Information quality measurement of medical encoding support based on usability.

PubMed

Puentes, John; Montagner, Julien; Lecornu, Laurent; Cauvin, Jean-Michel

2013-12-01

Medical encoding support systems for diagnoses and medical procedures are an emerging technology that begins to play a key role in billing, reimbursement, and health policies decisions. A significant problem to exploit these systems is how to measure the appropriateness of any automatically generated list of codes, in terms of fitness for use, i.e. their quality. Until now, only information retrieval performance measurements have been applied to estimate the accuracy of codes lists as quality indicator. Such measurements do not give the value of codes lists for practical medical encoding, and cannot be used to globally compare the quality of multiple codes lists. This paper defines and validates a new encoding information quality measure that addresses the problem of measuring medical codes lists quality. It is based on a usability study of how expert coders and physicians apply computer-assisted medical encoding. The proposed measure, named ADN, evaluates codes Accuracy, Dispersion and Noise, and is adapted to the variable length and content of generated codes lists, coping with limitations of previous measures. According to the ADN measure, the information quality of a codes list is fully represented by a single point, within a suitably constrained feature space. Using one scheme, our approach is reliable to measure and compare the information quality of hundreds of codes lists, showing their practical value for medical encoding. Its pertinence is demonstrated by simulation and application to real data corresponding to 502 inpatient stays in four clinic departments. Results are compared to the consensus of three expert coders who also coded this anonymized database of discharge summaries, and to five information retrieval measures. Information quality assessment applying the ADN measure showed the degree of encoding-support system variability from one clinic department to another, providing a global evaluation of quality measurement trends. Copyright © 2013 Elsevier Ireland Ltd. All rights reserved.

Development and usability testing of a web-based cancer symptom and quality-of-life support intervention.

PubMed

Wolpin, S E; Halpenny, B; Whitman, G; McReynolds, J; Stewart, M; Lober, W B; Berry, D L

2015-03-01

The feasibility and acceptability of computerized screening and patient-reported outcome measures have been demonstrated in the literature. However, patient-centered management of health information entails two challenges: gathering and presenting data using "patient-tailored" methods and supporting "patient-control" of health information. The design and development of many symptom and quality-of-life information systems have not included opportunities for systematically collecting and analyzing user input. As part of a larger clinical trial, the Electronic Self-Report Assessment for Cancer-II project, participatory design approaches were used to build and test new features and interfaces for patient/caregiver users. The research questions centered on patient/caregiver preferences with regard to the following: (a) content, (b) user interface needs, (c) patient-oriented summary, and (d) patient-controlled sharing of information with family, caregivers, and clinicians. Mixed methods were used with an emphasis on qualitative approaches; focus groups and individual usability tests were the primary research methods. Focus group data were content analyzed, while individual usability sessions were assessed with both qualitative and quantitative methods. We identified 12 key patient/caregiver preferences through focus groups with 6 participants. We implemented seven of these preferences during the iterative design process. We deferred development for some of the preferences due to resource constraints. During individual usability testing (n = 8), we were able to identify 65 usability issues ranging from minor user confusion to critical errors that blocked task completion. The participatory development model that we used led to features and design revisions that were patient centered. We are currently evaluating new approaches for the application interface and for future research pathways. We encourage other researchers to adopt user-centered design approaches when building patient-centered technologies. © The Author(s) 2014.

Improved usability of a multi-infusion setup using a centralized control interface: A task-based usability test

PubMed Central

Cnossen, Fokie; Dieperink, Willem; Bult, Wouter; de Smet, Anne Marie; Touw, Daan J.; Nijsten, Maarten W.

2017-01-01

The objective of this study was to assess the usability benefits of adding a bedside central control interface that controls all intravenous (IV) infusion pumps compared to the conventional individual control of multiple infusion pumps. Eighteen dedicated ICU nurses volunteered in a between-subjects task-based usability test. A newly developed central control interface was compared to conventional control of multiple infusion pumps in a simulated ICU setting. Task execution time, clicks, errors and questionnaire responses were evaluated. Overall the central control interface outperformed the conventional control in terms of fewer user actions (40±3 vs. 73±20 clicks, p<0.001) and fewer user errors (1±1 vs. 3±2 errors, p<0.05), with no difference in task execution times (421±108 vs. 406±119 seconds, not significant). Questionnaires indicated a significant preference for the central control interface. Despite being novice users of the central control interface, ICU nurses displayed improved performance with the central control interface compared to the conventional interface they were familiar with. We conclude that the new user interface has an overall better usability than the conventional interface. PMID:28800617

Improved usability of a multi-infusion setup using a centralized control interface: A task-based usability test.

PubMed

Doesburg, Frank; Cnossen, Fokie; Dieperink, Willem; Bult, Wouter; de Smet, Anne Marie; Touw, Daan J; Nijsten, Maarten W

2017-01-01

The objective of this study was to assess the usability benefits of adding a bedside central control interface that controls all intravenous (IV) infusion pumps compared to the conventional individual control of multiple infusion pumps. Eighteen dedicated ICU nurses volunteered in a between-subjects task-based usability test. A newly developed central control interface was compared to conventional control of multiple infusion pumps in a simulated ICU setting. Task execution time, clicks, errors and questionnaire responses were evaluated. Overall the central control interface outperformed the conventional control in terms of fewer user actions (40±3 vs. 73±20 clicks, p<0.001) and fewer user errors (1±1 vs. 3±2 errors, p<0.05), with no difference in task execution times (421±108 vs. 406±119 seconds, not significant). Questionnaires indicated a significant preference for the central control interface. Despite being novice users of the central control interface, ICU nurses displayed improved performance with the central control interface compared to the conventional interface they were familiar with. We conclude that the new user interface has an overall better usability than the conventional interface.

Discovering How Students Search a University Web Site: A Comparative Usability Case Study for PC and Mobile Devices

ERIC Educational Resources Information Center

Sengel, Erhan

2014-01-01

This study aims to investigate the usability level of web site of a university by observing 10 participants who are required to complete 11 tasks, which have been defined by the researchers before to gather data about effectiveness, efficiency and satisfaction. System Usability Scale was used to collect data about satisfaction. The research…

Improving Accessibility for Seniors in a Life-Long Learning Network: A Usability Study of Learning Websites

ERIC Educational Resources Information Center

Gu, Xiaoqing; Ding, Rui; Fu, Shirong

2011-01-01

Senior citizens are comparatively vulnerable in accessing learning opportunities offered on the Internet due to usability problems in current web design. In an effort to build a senior-friendly learning web as a part of the Life-long Learning Network in Shanghai, usability studies of two websites currently available to Shanghai senior citizens…

The value of usability testing for Internet-based adolescent self-management interventions: "Managing Hemophilia Online".

PubMed

Breakey, Vicky R; Warias, Ashley V; Ignas, Danial M; White, Meghan; Blanchette, Victor S; Stinson, Jennifer N

2013-10-04

As adolescents with hemophilia approach adulthood, they are expected to assume responsibility for their disease management. A bilingual (English and French) Internet-based self-management program, "Teens Taking Charge: Managing Hemophilia Online," was developed to support adolescents with hemophilia in this transition. This study explored the usability of the website and resulted in refinement of the prototype. A purposive sample (n=18; age 13-18; mean age 15.5 years) was recruited from two tertiary care centers to assess the usability of the program in English and French. Qualitative observations using a "think aloud" usability testing method and semi-structured interviews were conducted in four iterative cycles, with changes to the prototype made as necessary following each cycle. This study was approved by research ethics boards at each site. Teens responded positively to the content and appearance of the website and felt that it was easy to navigate and understand. The multimedia components (videos, animations, quizzes) were felt to enrich the experience. Changes to the presentation of content and the website user-interface were made after the first, second and third cycles of testing in English. Cycle four did not result in any further changes. Overall, teens found the website to be easy to use. Usability testing identified end-user concerns that informed improvements to the program. Usability testing is a crucial step in the development of Internet-based self-management programs to ensure information is delivered in a manner that is accessible and understood by users.

Review of health information technology usability study methodologies

PubMed Central

Bakken, Suzanne

2011-01-01

Usability factors are a major obstacle to health information technology (IT) adoption. The purpose of this paper is to review and categorize health IT usability study methods and to provide practical guidance on health IT usability evaluation. 2025 references were initially retrieved from the Medline database from 2003 to 2009 that evaluated health IT used by clinicians. Titles and abstracts were first reviewed for inclusion. Full-text articles were then examined to identify final eligibility studies. 629 studies were categorized into the five stages of an integrated usability specification and evaluation framework that was based on a usability model and the system development life cycle (SDLC)-associated stages of evaluation. Theoretical and methodological aspects of 319 studies were extracted in greater detail and studies that focused on system validation (SDLC stage 2) were not assessed further. The number of studies by stage was: stage 1, task-based or user–task interaction, n=42; stage 2, system–task interaction, n=310; stage 3, user–task–system interaction, n=69; stage 4, user–task–system–environment interaction, n=54; and stage 5, user–task–system–environment interaction in routine use, n=199. The studies applied a variety of quantitative and qualitative approaches. Methodological issues included lack of theoretical framework/model, lack of details regarding qualitative study approaches, single evaluation focus, environmental factors not evaluated in the early stages, and guideline adherence as the primary outcome for decision support system evaluations. Based on the findings, a three-level stratified view of health IT usability evaluation is proposed and methodological guidance is offered based upon the type of interaction that is of primary interest in the evaluation. PMID:21828224

Improving a Counselor Education Web Site through Usability Testing: The Bibliotherapy Education Project

ERIC Educational Resources Information Center

McMillen, Paula S.; Pehrsson, Dale-Elizabeth

2009-01-01

Technology proficiency expectations have proliferated in counselor education; however, limited information in the counseling literature details how to effectively evaluate or refine online resources from a design/utility standpoint. This description of a small-scale usability study demonstrates a cost-effective strategy for improving counselor…

77 FR 28853 - Proposed Information Collection; Comment Request; Generic Clearance for Usability Data Collections

Federal Register 2010, 2011, 2012, 2013, 2014

2012-05-16

... the Department of Commerce, proposes to conduct a number of data collection efforts--both quantitative and qualitative. The data collections will be designed to determine requirement and evaluate the usability and utility of NIST research for measurement and standardization work. These data collections...

Quantum Information Science

DTIC Science & Technology

2012-02-01

group velocity matched temporal compensator crystal assembly to increase the usable range of entangled photon sources, and (vi) the development and...characterization of a new multipli- entangled photon source that increased the usable number of photon pairs by a factor of six. 15. SUBJECT TERMS...compensated crystal assembly ....................................................................................... 17 3.7 Entangled photon sources

Evaluation of Web-Based Consumer Medication Information: Content and Usability of 4 Australian Websites.

PubMed

Raban, Magdalena Z; Tariq, Amina; Richardson, Lauren; Byrne, Mary; Robinson, Maureen; Li, Ling; Westbrook, Johanna I; Baysari, Melissa T

2016-07-21

Medication is the most common intervention in health care, and written medication information can affect consumers' medication-related behavior. Research has shown that a large proportion of Australians search for medication information on the Internet. To evaluate the medication information content, based on consumer medication information needs, and usability of 4 Australian health websites: Better Health Channel, myDr, healthdirect, and NPS MedicineWise . To assess website content, the most common consumer medication information needs were identified using (1) medication queries to the healthdirect helpline (a telephone helpline available across most of Australia) and (2) the most frequently used medications in Australia. The most frequently used medications were extracted from Australian government statistics on use of subsidized medicines in the community and the National Census of Medicines Use. Each website was assessed to determine whether it covered or partially covered information and advice about these medications. To assess website usability, 16 consumers participated in user testing wherein they were required to locate 2 pieces of medication information on each website. Brief semistructured interviews were also conducted with participants to gauge their opinions of the websites. Information on prescription medication was more comprehensively covered on all websites (3 of 4 websites covered 100% of information) than nonprescription medication (websites covered 0%-67% of information). Most websites relied on consumer medicines information leaflets to convey prescription medication information to consumers. Information about prescription medication classes was less comprehensive, with no website providing all information examined about antibiotics and antidepressants. Participants (n=16) were able to locate medication information on websites in most cases (accuracy ranged from 84% to 91%). However, a number of usability issues relating to website navigation and information display were identified. For example, websites not allowing combinations of search terms to be entered in search boxes and continuous blocks of text without subheadings. Of the 4 Australian health information websites tested, none provided consumers with comprehensive medication information on both prescription and nonprescription medications in a user-friendly way. Using data on consumer information needs and user testing to guide medication information content and website design is a useful approach to inform consumer website development.

Usability Assessment of the Missouri Cancer Registry's Published Interactive Mapping Reports: Round One.

PubMed

Ben Ramadan, Awatef Ahmed; Jackson-Thompson, Jeannette; Schmaltz, Chester Lee

2017-08-04

 Many users of spatial data have difficulty interpreting information in health-related spatial reports. The Missouri Cancer Registry and Research Center (MCR-ARC) has produced interactive reports for several years. These reports have never been tested for usability.  The aims of this study were to: (1) conduct a multi-approach usability testing study to understand ease of use (user friendliness) and user satisfaction; and (2) evaluate the usability of MCR-ARC's published InstantAtlas reports.   An institutional review board (IRB) approved mixed methodology usability testing study using a convenience sample of health professionals. A recruiting email was sent to faculty in the Master of Public Health program and to faculty and staff in the Department of Health Management and Informatics at the University of Missouri-Columbia. The study included 7 participants. The test included a pretest questionnaire, a multi-task usability test, and the System Usability Scale (SUS). Also, the researchers collected participants' comments about the tested maps immediately after every trial. Software was used to record the computer screen during the trial and the participants' spoken comments. Several performance and usability metrics were measured to evaluate the usability of MCR-ARC's published mapping reports. Of the 10 assigned tasks, 6 reached a 100% completion success rate, and this outcome was relative to the complexity of the tasks. The simple tasks were handled more efficiently than the complicated tasks. The SUS score ranged between 20-100 points, with an average of 62.7 points and a median of 50.5 points. The tested maps' effectiveness outcomes were better than the efficiency and satisfaction outcomes. There was a statistically significant relationship between the subjects' performance on the study test and the users' previous experience with geographic information system (GIS) tools (P=.03). There were no statistically significant relationships between users' performance and satisfaction and their education level, work type, or previous experience in health care (P>.05). There were strong positive correlations between the three measured usability elements. The tested maps should undergo an extensive refining and updating to overcome all the discovered usability issues and meet the perspectives and needs of the tested maps' potential users. The study results might convey the perspectives of academic health professionals toward GIS health data. We need to conduct a second-round usability study with public health practitioners and cancer professionals who use GIS tools on a routine basis. Usability testing should be conducted before and after releasing MCR-ARC's maps in the future. ©Awatef Ahmed Ben Ramadan, Jeannette Jackson-Thompson, Chester Lee Schmaltz. Originally published in JMIR Human Factors (http://humanfactors.jmir.org), 04.08.2017.

Usability Assessment of the Missouri Cancer Registry’s Published Interactive Mapping Reports: Round One

PubMed Central

Jackson-Thompson, Jeannette; Schmaltz, Chester Lee

2017-01-01

Background  Many users of spatial data have difficulty interpreting information in health-related spatial reports. The Missouri Cancer Registry and Research Center (MCR-ARC) has produced interactive reports for several years. These reports have never been tested for usability. Objective  The aims of this study were to: (1) conduct a multi-approach usability testing study to understand ease of use (user friendliness) and user satisfaction; and (2) evaluate the usability of MCR-ARC’s published InstantAtlas reports. Methods   An institutional review board (IRB) approved mixed methodology usability testing study using a convenience sample of health professionals. A recruiting email was sent to faculty in the Master of Public Health program and to faculty and staff in the Department of Health Management and Informatics at the University of Missouri-Columbia. The study included 7 participants. The test included a pretest questionnaire, a multi-task usability test, and the System Usability Scale (SUS). Also, the researchers collected participants’ comments about the tested maps immediately after every trial. Software was used to record the computer screen during the trial and the participants’ spoken comments. Several performance and usability metrics were measured to evaluate the usability of MCR-ARC’s published mapping reports. Results Of the 10 assigned tasks, 6 reached a 100% completion success rate, and this outcome was relative to the complexity of the tasks. The simple tasks were handled more efficiently than the complicated tasks. The SUS score ranged between 20-100 points, with an average of 62.7 points and a median of 50.5 points. The tested maps’ effectiveness outcomes were better than the efficiency and satisfaction outcomes. There was a statistically significant relationship between the subjects’ performance on the study test and the users’ previous experience with geographic information system (GIS) tools (P=.03). There were no statistically significant relationships between users’ performance and satisfaction and their education level, work type, or previous experience in health care (P>.05). There were strong positive correlations between the three measured usability elements. Conclusions The tested maps should undergo an extensive refining and updating to overcome all the discovered usability issues and meet the perspectives and needs of the tested maps’ potential users. The study results might convey the perspectives of academic health professionals toward GIS health data. We need to conduct a second-round usability study with public health practitioners and cancer professionals who use GIS tools on a routine basis. Usability testing should be conducted before and after releasing MCR-ARC’s maps in the future. PMID:28778842

The E-health Literacy Demands of Australia's My Health Record: A Heuristic Evaluation of Usability.

PubMed

Walsh, Louisa; Hemsley, Bronwyn; Allan, Meredith; Adams, Natalie; Balandin, Susan; Georgiou, Andrew; Higgins, Isabel; McCarthy, Shaun; Hill, Sophie

2017-01-01

My Health Record is Australia's electronic personal health record system, which was introduced in July 2012. As of August 2017, approximately 21 percent of Australia's total population was registered to use My Health Record. Internationally, usability issues have been shown to negatively influence the uptake and use of electronic health record systems, and this scenario may particularly affect people who have low e-health literacy. It is likely that usability issues are negatively affecting the uptake and use of My Health Record in Australia. To identify potential e-health literacy-related usability issues within My Health Record through a heuristic evaluation method. Between September 14 and October 12, 2016, three of the authors conducted a heuristic evaluation of the two consumer-facing components of My Health Record-the information website and the electronic health record itself. These two components were evaluated against two sets of heuristics-the Health Literacy Online checklist and the Monkman Heuristics. The Health Literacy Online checklist and Monkman Heuristics are evidence-based checklists of web design elements with a focus on design for audiences with low health literacy. During this heuristic evaluation, the investigators individually navigated through the consumer-facing components of My Health Record, recording instances where the My Health Record did not conform to the checklist criteria. After the individual evaluations were completed, the investigators conferred and aggregated their results. From this process, a list of usability violations was constructed. When evaluated against the Health Literacy Online Checklist, the information website demonstrated violations in 12 of 35 criteria, and the electronic health record demonstrated violations in 16 of 35 criteria. When evaluated against the Monkman Heuristics, the information website demonstrated violations in 7 of 11 criteria, and the electronic health record demonstrated violations in 9 of 11 criteria. The identified violations included usability issues with the reading levels used within My Health Record, the graphic design elements, the layout of web pages, and a lack of images and audiovisual tools to support learning. Other important usability issues included a lack of translated resources, difficulty using accessibility tools, and complexity of the registration processes. My Health Record is an important piece of technology that has the potential to facilitate better communication between consumers and their health providers. However, this heuristic evaluation demonstrated that many usability-related elements of My Health Record cater poorly to users at risk of having low e-health literacy. Usability issues have been identified as an important barrier to use of personal health records internationally, and the findings of this heuristic evaluation demonstrate that usability issues may be substantial barriers to the uptake and use of My Health Record.

The E-health Literacy Demands of Australia's My Health Record: A Heuristic Evaluation of Usability

PubMed Central

Walsh, Louisa; Hemsley, Bronwyn; Allan, Meredith; Adams, Natalie; Balandin, Susan; Georgiou, Andrew; Higgins, Isabel; McCarthy, Shaun; Hill, Sophie

2017-01-01

Background My Health Record is Australia's electronic personal health record system, which was introduced in July 2012. As of August 2017, approximately 21 percent of Australia's total population was registered to use My Health Record. Internationally, usability issues have been shown to negatively influence the uptake and use of electronic health record systems, and this scenario may particularly affect people who have low e-health literacy. It is likely that usability issues are negatively affecting the uptake and use of My Health Record in Australia. Objective To identify potential e-health literacy–related usability issues within My Health Record through a heuristic evaluation method. Methods Between September 14 and October 12, 2016, three of the authors conducted a heuristic evaluation of the two consumer-facing components of My Health Record—the information website and the electronic health record itself. These two components were evaluated against two sets of heuristics—the Health Literacy Online checklist and the Monkman Heuristics. The Health Literacy Online checklist and Monkman Heuristics are evidence-based checklists of web design elements with a focus on design for audiences with low health literacy. During this heuristic evaluation, the investigators individually navigated through the consumer-facing components of My Health Record, recording instances where the My Health Record did not conform to the checklist criteria. After the individual evaluations were completed, the investigators conferred and aggregated their results. From this process, a list of usability violations was constructed. Results When evaluated against the Health Literacy Online Checklist, the information website demonstrated violations in 12 of 35 criteria, and the electronic health record demonstrated violations in 16 of 35 criteria. When evaluated against the Monkman Heuristics, the information website demonstrated violations in 7 of 11 criteria, and the electronic health record demonstrated violations in 9 of 11 criteria. The identified violations included usability issues with the reading levels used within My Health Record, the graphic design elements, the layout of web pages, and a lack of images and audiovisual tools to support learning. Other important usability issues included a lack of translated resources, difficulty using accessibility tools, and complexity of the registration processes. Conclusion My Health Record is an important piece of technology that has the potential to facilitate better communication between consumers and their health providers. However, this heuristic evaluation demonstrated that many usability-related elements of My Health Record cater poorly to users at risk of having low e-health literacy. Usability issues have been identified as an important barrier to use of personal health records internationally, and the findings of this heuristic evaluation demonstrate that usability issues may be substantial barriers to the uptake and use of My Health Record. PMID:29118683

Evidence-based Heuristics for Evaluating Demands on eHealth Literacy and Usability in a Mobile Consumer Health Application.

PubMed

Monkman, Helen; Griffith, Janessa; Kushniruk, Andre W

2015-01-01

Heuristic evaluations have proven to be valuable for identifying usability issues in systems. Commonly used sets of heuritics exist; however, they may not always be the most suitable, given the specific goal of the analysis. One such example is seeking to evaluate the demands on eHealth literacy and usability of consumer health information systems. In this study, eight essential heuristics and three optional heuristics subsumed from the evidence on eHealth/health literacy and usability were tested for their utility in assessing a mobile blood pressure tracking application (app). This evaluation revealed a variety of ways the design of the app could both benefit and impede users with limited eHealth literacy. This study demonstrated the utility of a low-cost, single evaluation approach for identifying both eHealth literacy and usability issues based on existing evidence in the literature.

Bus use and older people: a literature review applying the Person-Environment-Occupation model in macro practice.

PubMed

Broome, Kieran; McKenna, Kryss; Fleming, Jennifer; Worrall, Linda

2009-03-01

The same reasons that prompt older people to give up driving can also result in difficulties with accessing public transport. Difficulties using public transport can limit older people's participation in society, thereby impacting negatively on their health. Focusing on public buses, this review explicates the link between bus usability and the health of older people and frames existing evidence on bus usability issues. The Person-Environment-Occupation (PEO) model offers a framework by which bus usability can be assessed. A combination of person-centred, environmental, and occupation-related factors, including bus design, service provision and performance, information, and the attitudes of staff and the community, impact on older people's ability to catch buses. More systematic research needs to take place in order to develop a comprehensive understanding of bus usability. Occupational therapy has a key role to play in conceptualizing, implementing, and evaluating improvements in bus usability for older people.

Integrating Low-Cost Rapid Usability Testing into Agile System Development of Healthcare IT: A Methodological Perspective.

PubMed

Kushniruk, Andre W; Borycki, Elizabeth M

2015-01-01

The development of more usable and effective healthcare information systems has become a critical issue. In the software industry methodologies such as agile and iterative development processes have emerged to lead to more effective and usable systems. These approaches highlight focusing on user needs and promoting iterative and flexible development practices. Evaluation and testing of iterative agile development cycles is considered an important part of the agile methodology and iterative processes for system design and re-design. However, the issue of how to effectively integrate usability testing methods into rapid and flexible agile design cycles has remained to be fully explored. In this paper we describe our application of an approach known as low-cost rapid usability testing as it has been applied within agile system development in healthcare. The advantages of the integrative approach are described, along with current methodological considerations.

APRN Usability Testing of a Tailored Computer-Mediated Health Communication Program

PubMed Central

Lin, Carolyn A.; Neafsey, Patricia J.; Anderson, Elizabeth

2010-01-01

This study tested the usability of a touch-screen enabled “Personal Education Program” (PEP) with Advanced Practice Registered Nurses (APRN). The PEP is designed to enhance medication adherence and reduce adverse self-medication behaviors in older adults with hypertension. An iterative research process was employed, which involved the use of: (1) pre-trial focus groups to guide the design of system information architecture, (2) two different cycles of think-aloud trials to test the software interface, and (3) post-trial focus groups to gather feedback on the think-aloud studies. Results from this iterative usability testing process were utilized to systematically modify and improve the three PEP prototype versions—the pilot, Prototype-1 and Prototype-2. Findings contrasting the two separate think-aloud trials showed that APRN users rated the PEP system usability, system information and system-use satisfaction at a moderately high level between trials. In addition, errors using the interface were reduced by 76 percent and the interface time was reduced by 18.5 percent between the two trials. The usability testing processes employed in this study ensured an interface design adapted to APRNs' needs and preferences to allow them to effectively utilize the computer-mediated health-communication technology in a clinical setting. PMID:19940619

Naive (commonsense) geography and geobrowser usability after ten years of Google Earth

NASA Astrophysics Data System (ADS)

Hamerlinck, J. D.

2016-04-01

In 1995, the concept of ‘naive geography’ was formally introduced as an area of cognitive geographic information science representing ‘the body of knowledge that people have about the surrounding geographic world’ and reflecting ‘the way people think and reason about geographic space and time, both consciously and subconsciously’. The need to incorporate such commonsense knowledge and reasoning into design of geospatial technologies was identified but faced challenges in formalizing these relationships and processes in software implementation. Ten years later, the Google Earth geobrowser was released, marking the beginning of a new era of open access to, and application of, geographic data and information in society. Fast-forward to today, and the opportunity presents itself to take stock of twenty years of naive geography and a decade of the ubiquitous virtual globe. This paper introduces an ongoing research effort to explore the integration of naive (or commonsense) geography concepts in the Google Earth geobrowser virtual globe and their possible impact on Google Earth's usability, utility, and usefulness. A multi-phase methodology is described, combining usability reviews and usability testing with use-case scenarios involving the U.S.-Canadian Yellowstone to Yukon Initiative. Initial progress on a usability review combining cognitive walkthroughs and heuristics evaluation is presented.

Proposing Electronic Health Record Usability Requirements Based on Enriched ISO 9241 Metric Usability Model

PubMed Central

Farzandipour, Mehrdad; Riazi, Hossein; Jabali, Monireh Sadeqi

2018-01-01

Introduction: System usability assessment is among the important aspects in assessing the quality of clinical information technology, especially when the end users of the system are concerned. This study aims at providing a comprehensive list of system usability. Methods: This research is a descriptive cross-sectional one conducted using Delphi technique in three phases in 2013. After experts’ ideas were concluded, the final version of the questionnaire including 163 items in three phases was presented to 40 users of information systems in hospitals. The grading ranged from 0-4. Data analysis was conducted using SPSS software. Those requirements with a mean point of three or higher were finally confirmed. Results: The list of system usability requirements for electronic health record was designed and confirmed in nine areas including suitability for the task (24 items), self-descriptiveness (22 items), controllability (19 questions), conformity with user expectations (25 items), error tolerance (21 items), suitability for individualization (7 items), suitability for learning (19 items), visual clarity (18 items) and auditory presentation (8 items). Conclusion: A relatively comprehensive model including useful requirements for using EHR was presented which can increase functionality, effectiveness and users’ satisfaction. Thus, it is suggested that the present model be adopted by system designers and healthcare system institutions to assess those systems. PMID:29719310

Designing Telemedicine Systems for Geriatric Patients: A Review of the Usability Studies.

PubMed

Narasimha, Shraddhaa; Madathil, Kapil Chalil; Agnisarman, Sruthy; Rogers, Hunter; Welch, Brandon; Ashok, Aparna; Nair, Aswathi; McElligott, James

2017-06-01

One area where telemedicine may prove to be highly effective is in providing medical care to the geriatric population, an age group predicted to account for 20% of the population in the near future. However, even though telemedicine has certain advantages, the usability of these systems with this population merits investigation. This article reviews the literature published from 2000 to 2016 with the goal of analyzing the characteristics of usability-related studies conducted using geriatric participants and the subsequent usability challenges identified. Articles were found using Web of Knowledge and PubMed citation indexing portals using the keywords (1) Telemedicine* AND Geriatrics* (2) Telemedicine* AND Usability* (3) Telemedicine* AND Usability* AND Older Adults*. A total of 297 articles were obtained from the initial search. After further detailed screening, 16 articles were selected for review based on the inclusion criteria. Of these, 60% of the studies focused on the overall usability of telemedicine systems; 6.25% focused on the usability of a telepresence robot; 12.5% compared a face-to-face medical consultation with the use of telemedicine systems, and 25% focused on the study of other aspects of telemedicine in addition to its usability. Findings reported in the studies included high patient satisfaction with telemedicine in 31.25%, whereas another 31.25% indicated a high acceptance of this method of medical consultation. Care coordination in 6.25% of the studies; confidence in telemedicine in 6.25%; trust, privacy, and reliability in 6.25%; and increased convenience when compared to personal visits in 18.75% were also reported. This review suggests limited research providing scientifically valid and reproducible usability evaluation at various stages of telemedicine system development. Telemedicine system designers need to consider the age-related issues in cognition, perception, and behavior of geriatric patients while designing telemedicine applications. Future directions for research were developed based on the limitations as well as other results found in this systematic review.

Psychological Usability of Layered Application Software Platforms

NASA Technical Reports Server (NTRS)

Uhiarik, John

1999-01-01

This grant provided Graduate Research Fellowship Program support to James Michael Herold to obtain a graduate degree from the Department of Psychology at Kansas State University and conduct usability testing of graphical user interfaces the Kennedy Space Center. The student independently took an additional internship at Boll Laboratories without informing his graduate advisor or the Department of Psychology. Because he was NOT making progress toward his degree, he elected not to pursue his graduate studies at Kansas State University and self-terminated from the program (spin without informing his advisor or the Department of Psychology]. What he accomplished for NASA in terms of usability testing at the Kennedy Space Center is unclear. NASA terminated support for the project: 07/30/99, including a $4,000 commitment to provide infrastructure support to the Department of Psychology.

A Comparison of What Is Part of Usability Testing in Three Countries

NASA Astrophysics Data System (ADS)

Clemmensen, Torkil

The cultural diversity of users of technology challenges our methods for usability evaluation. In this paper we report and compare three ethnographic interview studies of what is a part of a standard (typical) usability test in a company in Mumbai, Beijing and Copenhagen. At each of these three locations, we use structural and contrast questions do a taxonomic and paradigm analysis of a how a company performs a usability test. We find similar parts across the three locations. We also find different results for each location. In Mumbai, most parts of the usability test are not related to the interactive application that is tested, but to differences in user characteristics, test preparation, method, and location. In Copenhagen, considerations about the client's needs are part of a usability test. In Beijing, the only varying factor is the communication pattern and relation to the user. These results are then contrasted in a cross cultural matrix to identify cultural themes that can help interpret results from existing laboratory research in usability test methods.

A Brief Report of the Diagnostic Accuracy of Oral Reading Fluency and Reading Inventory Levels for Reading Failure Risk among Second- and Third-Grade Students

ERIC Educational Resources Information Center

Parker, David C.; Zaslofsky, Anne F.; Burns, Matthew K.; Kanive, Rebecca; Hodgson, Jennifer; Scholin, Sarah E.; Klingbeil, David A.

2015-01-01

The availability of psychometrically sound and usable universal screeners is a key component to successful early identification within a response-to-intervention model. The purpose of this study was to compare the diagnostic accuracy of oral reading fluency (ORF) and an informal reading inventory for identifying students considered at risk for…

Interface design recommendations for computerised clinical audit and feedback: Hybrid usability evidence from a research-led system.

PubMed

Brown, Benjamin; Balatsoukas, Panos; Williams, Richard; Sperrin, Matthew; Buchan, Iain

2016-10-01

Audit and Feedback (A&F) is a widely used quality improvement technique that measures clinicians' clinical performance and reports it back to them. Computerised A&F (e-A&F) system interfaces may consist of four key components: (1) Summaries of clinical performance; (2) Patient lists; (3) Patient-level data; (4) Recommended actions. There is a lack of evidence regarding how to best design e-A&F interfaces; establishing such evidence is key to maximising usability, and in turn improving patient safety. To evaluate the usability of a novel theoretically-informed and research-led e-A&F system for primary care (the Performance Improvement plaN GeneratoR: PINGR). (1) Describe PINGR's design, rationale and theoretical basis; (2) Identify usability issues with PINGR; (3) Understand how these issues may interfere with the cognitive goals of end-users; (4) Translate the issues into recommendations for the user-centred design of e-A&F systems. Eight experienced health system evaluators performed a usability inspection using an innovative hybrid approach consisting of five stages: (1) Development of representative user tasks, Goals, and Actions; (2) Combining Heuristic Evaluation and Cognitive Walkthrough methods into a single protocol to identify usability issues; (3) Consolidation of issues; (4) Severity rating of consolidated issues; (5) Analysis of issues according to usability heuristics, interface components, and Goal-Action structure. A final list of 47 issues were categorised into 8 heuristic themes. The most error-prone heuristics were 'Consistency and standards' (13 usability issues; 28% of the total) and 'Match between system and real world' (n=10, 21%). The recommended actions component of the PINGR interface had the most usability issues (n=21, 45%), followed by patient-level data (n=5, 11%), patient lists (n=4, 9%), and summaries of clinical performance (n=4, 9%). The most error-prone Actions across all user Goals were: (1) Patient selection from a list; (2) Data identification from a figure (both population-level and patient-level); (3) Disagreement with a system recommendation. By contextualising our findings within the wider literature on health information system usability, we provide recommendations for the design of e-A&F system interfaces relating to their four key components, in addition to how they may be integrated within a system. Copyright © 2016. Published by Elsevier Ireland Ltd.

Evaluating a Modular Decision Support Application for Colorectal Cancer Screening

PubMed Central

Diiulio, Julie B.; Borders, Morgan R.; Sushereba, Christen E.; Saleem, Jason J.; Haverkamp, Donald; Imperiale, Thomas F.

2017-01-01

Summary Background There is a need for health information technology evaluation that goes beyond randomized controlled trials to include consideration of usability, cognition, feedback from representative users, and impact on efficiency, data quality, and clinical workflow. This article presents an evaluation illustrating one approach to this need using the Decision-Centered Design framework. Objective To evaluate, through a Decision-Centered Design framework, the ability of the Screening and Surveillance App to support primary care clinicians in tracking and managing colorectal cancer testing. Methods We leveraged two evaluation formats, online and in-person, to obtain feedback from a range primary care clinicians and obtain comparative data. Both the online and in-person evaluations used mock patient data to simulate challenging patient scenarios. Primary care clinicians responded to a series of colorectal cancer-related questions about each patient and made recommendations for screening. We collected data on performance, perceived workload, and usability. Key elements of Decision-Centered Design include evaluation in the context of realistic, challenging scenarios and measures designed to explore impact on cognitive performance. Results Comparison of means revealed increases in accuracy, efficiency, and usability and decreases in perceived mental effort and workload when using the Screening and Surveillance App. Conclusion The results speak to the benefits of using the Decision-Centered Design approach in the analysis, design, and evaluation of Health Information Technology. Furthermore, the Screening and Surveillance App shows promise for filling decision support gaps in current electronic health records. PMID:28197619

A framework for reporting on human factor/usability studies of health information technologies.

PubMed

Peute, Linda W; Driest, Keiko F; Marcilly, Romaric; Bras Da Costa, Sabrina; Beuscart-Zephir, Marie-Catherine; Jaspers, Monique W M

2013-01-01

Increasingly, studies are being published on the potential negative effect of introducing poor designed Health Information Technology (HIT) into clinical settings, relating to technology-induced errors and adverse events. Academic research on HIT design and evaluation is an extremely important source of information in providing new insights into factors contributing to successful system (re)design efforts, system user-friendliness and usability issues and safety critical aspects of HIT design. However, these studies have been inconsistent and incomprehensive in their reporting, complicating the appraisal of outcomes, generalizability of study findings, meta-analysis and harmonization of the available evidence. To improve identification of type of use errors and safety related issues regarding design and implementation of HIT, consensus on issues to be reported on in scientific publications is a necessary step forward. This study presents the first approach to a framework providing a set of principles to follow for comprehensive and unambiguous reporting of HIT design and usability evaluation studies with the objective to reduce variation, improve on the publication reporting quality and proper indexation of these studies. This framework may be helpful in expanding the knowledge base not only concerning the application of Human Factors (HF)/Usability studies of HIT but also improve the knowledge base of how to (re)design and implement effective, efficient and safe HIT.

Conferences as Information Grounds: Web Site Evaluation with a Mobile Usability Laboratory

ERIC Educational Resources Information Center

Bossaller, Jenny S.; Paul, Anindita; Hill, Heather; Wang, Jiazhen; Erdelez, Sanda

2008-01-01

This article describes an "on-the-road" usability study and explains the study's methodological challenges, solutions, and recommendations. The study concerned a library-consortium website, which is a communication and educational tool for librarians who are physically dispersed throughout the state, and an intranet for remote users.…

Toward a User-Centered Academic Library Home Page

ERIC Educational Resources Information Center

McHale, Nina

2008-01-01

In the past decade, academic libraries have struggled with the design of an effective library home page. Since librarians' mental models of information architecture differ from those of their patrons, usability assessments are necessary in designing a user-centered home page. This study details a usability sequence of card sort and paper and…

The Cultural Evolution of Human Communication Systems in Different Sized Populations: Usability Trumps Learnability

PubMed Central

Fay, Nicolas; Ellison, T. Mark

2013-01-01

This study examines the intergenerational transfer of human communication systems. It tests if human communication systems evolve to be easy to learn or easy to use (or both), and how population size affects learnability and usability. Using an experimental-semiotic task, we find that human communication systems evolve to be easier to use (production efficiency and reproduction fidelity), but harder to learn (identification accuracy) for a second generation of naïve participants. Thus, usability trumps learnability. In addition, the communication systems that evolve in larger populations exhibit distinct advantages over those that evolve in smaller populations: the learnability loss (from the Initial signs) is more muted and the usability benefits are more pronounced. The usability benefits for human communication systems that evolve in a small and large population is explained through guided variation reducing sign complexity. The enhanced performance of the communication systems that evolve in larger populations is explained by the operation of a content bias acting on the larger pool of competing signs. The content bias selects for information-efficient iconic signs that aid learnability and enhance usability. PMID:23967243

The cultural evolution of human communication systems in different sized populations: usability trumps learnability.

PubMed

Fay, Nicolas; Ellison, T Mark

2013-01-01

This study examines the intergenerational transfer of human communication systems. It tests if human communication systems evolve to be easy to learn or easy to use (or both), and how population size affects learnability and usability. Using an experimental-semiotic task, we find that human communication systems evolve to be easier to use (production efficiency and reproduction fidelity), but harder to learn (identification accuracy) for a second generation of naïve participants. Thus, usability trumps learnability. In addition, the communication systems that evolve in larger populations exhibit distinct advantages over those that evolve in smaller populations: the learnability loss (from the Initial signs) is more muted and the usability benefits are more pronounced. The usability benefits for human communication systems that evolve in a small and large population is explained through guided variation reducing sign complexity. The enhanced performance of the communication systems that evolve in larger populations is explained by the operation of a content bias acting on the larger pool of competing signs. The content bias selects for information-efficient iconic signs that aid learnability and enhance usability.

Using a fuzzy comprehensive evaluation method to determine product usability: A test case

PubMed Central

Zhou, Ronggang; Chan, Alan H. S.

2016-01-01

BACKGROUND: In order to take into account the inherent uncertainties during product usability evaluation, Zhou and Chan [1] proposed a comprehensive method of usability evaluation for products by combining the analytic hierarchy process (AHP) and fuzzy evaluation methods for synthesizing performance data and subjective response data. This method was designed to provide an integrated framework combining the inevitable vague judgments from the multiple stages of the product evaluation process. OBJECTIVE AND METHODS: In order to illustrate the effectiveness of the model, this study used a summative usability test case to assess the application and strength of the general fuzzy usability framework. To test the proposed fuzzy usability evaluation framework [1], a standard summative usability test was conducted to benchmark the overall usability of a specific network management software. Based on the test data, the fuzzy method was applied to incorporate both the usability scores and uncertainties involved in the multiple components of the evaluation. Then, with Monte Carlo simulation procedures, confidence intervals were used to compare the reliabilities among the fuzzy approach and two typical conventional methods combining metrics based on percentages. RESULTS AND CONCLUSIONS: This case study showed that the fuzzy evaluation technique can be applied successfully for combining summative usability testing data to achieve an overall usability quality for the network software evaluated. Greater differences of confidence interval widths between the method of averaging equally percentage and weighted evaluation method, including the method of weighted percentage averages, verified the strength of the fuzzy method. PMID:28035942

Using a fuzzy comprehensive evaluation method to determine product usability: A test case.

PubMed

Zhou, Ronggang; Chan, Alan H S

2017-01-01

In order to take into account the inherent uncertainties during product usability evaluation, Zhou and Chan [1] proposed a comprehensive method of usability evaluation for products by combining the analytic hierarchy process (AHP) and fuzzy evaluation methods for synthesizing performance data and subjective response data. This method was designed to provide an integrated framework combining the inevitable vague judgments from the multiple stages of the product evaluation process. In order to illustrate the effectiveness of the model, this study used a summative usability test case to assess the application and strength of the general fuzzy usability framework. To test the proposed fuzzy usability evaluation framework [1], a standard summative usability test was conducted to benchmark the overall usability of a specific network management software. Based on the test data, the fuzzy method was applied to incorporate both the usability scores and uncertainties involved in the multiple components of the evaluation. Then, with Monte Carlo simulation procedures, confidence intervals were used to compare the reliabilities among the fuzzy approach and two typical conventional methods combining metrics based on percentages. This case study showed that the fuzzy evaluation technique can be applied successfully for combining summative usability testing data to achieve an overall usability quality for the network software evaluated. Greater differences of confidence interval widths between the method of averaging equally percentage and weighted evaluation method, including the method of weighted percentage averages, verified the strength of the fuzzy method.

Usability testing of existing type 2 diabetes mellitus websites.

PubMed

Davis, Dorian; Jiang, Steven

2016-08-01

Given the significant increase in the use of the internet as an educational tool for diabetes, very little research has been published on the usability of healthcare websites, even though it is a determining factor for user satisfaction. The aim of this study is to evaluate and critique the interfaces of existing diabetes websites for usability concerns and provide design solutions for improvement. Emphasis is placed on Type 2 Diabetes Mellitus since it is the most common and life threatening form of diabetes. A usability test was performed on the interfaces of three existing diabetes websites, American Diabetes Association (www.diabetes.org), WebMD (www.webmd.com) and the National Diabetes Education Program (ndep.nih.gov). The goal was to collect qualitative and quantitative data to determine: (1) if participants are able to complete specified tasks successfully; (2) the length of time it takes participants to complete the specified tasks and; (3) participants' satisfaction with the three websites. Twenty adults, 18 years of age and older participated in the study. The results from the MANOVA test revealed a significant difference between the three websites for number of clicks, number of errors and completion time when analyzed simultaneously. The ANOVA tests revealed a significant difference for all three variables. The Student-Newman-Keuls (SNK) test shows a significant difference for completion time between American Diabetes Association and WebMD. A significant difference was found for the number of clicks for the National Diabetes Education Program compared to the American Diabetes Association and WebMD. However, no significant difference was found for the number of clicks between American Diabetes Association and WebMD. Lastly, a significant difference was found between each interface for number of errors. Although, the American Diabetes Association web-interface was most favorable, there were many positive design elements for each interface. On the other hand, the significant amount of information overload experienced for each website left participants feeling perplexed. Thus, innovative solutions are needed to reduce information overload and ensure users are engaged and empowered to make informed decisions about their healthcare. Copyright © 2016 Elsevier Ireland Ltd. All rights reserved.

Clinical guideline representation in a CDS: a human information processing method.

PubMed

Kilsdonk, Ellen; Riezebos, Rinke; Kremer, Leontien; Peute, Linda; Jaspers, Monique

2012-01-01

The Dutch Childhood Oncology Group (DCOG) has developed evidence-based guidelines for screening childhood cancer survivors for possible late complications of treatment. These paper-based guidelines appeared to not suit clinicians' information retrieval strategies; it was thus decided to communicate the guidelines through a Computerized Decision Support (CDS) tool. To ensure high usability of this tool, an analysis of clinicians' cognitive strategies in retrieving information from the paper-based guidelines was used as requirements elicitation method. An information processing model was developed through an analysis of think aloud protocols and used as input for the design of the CDS user interface. Usability analysis of the user interface showed that the navigational structure of the CDS tool fitted well with the clinicians' mental strategies employed in deciding on survivors screening protocols. Clinicians were more efficient and more complete in deciding on patient-tailored screening procedures when supported by the CDS tool than by the paper-based guideline booklet. The think-aloud method provided detailed insight into users' clinical work patterns that supported the design of a highly usable CDS system.

A Usability Study of Users’ Perceptions Toward a Multimedia Computer-Assisted Learning Tool for Neuroanatomy

PubMed Central

Gould, Douglas J.; Terrell, Mark A.; Fleming, Jo

2015-01-01

This usability study evaluated users’ perceptions of a multimedia prototype for a new e-learning tool: Anatomy of the Central Nervous System: A Multimedia Course. Usability testing is a collection of formative evaluation methods that inform the developmental design of e-learning tools to maximize user acceptance, satisfaction, and adoption. Sixty-two study participants piloted the prototype and completed a usability questionnaire designed to measure two usability properties: program need and program applicability. Statistical analyses were used to test the hypothesis that the multimedia prototype was well designed and highly usable, it was perceived as: 1) highly needed across a spectrum of educational contexts, 2) highly applicable in supporting the pedagogical processes of teaching and learning neuroanatomy, and 3) was highly usable by all types of users. Three independent variables represented user differences: level of expertise (faculty vs. student), age, and gender. Analysis of the results supports the research hypotheses that the prototype was designed well for different types of users in various educational contexts and for supporting the pedagogy of neuroanatomy. In addition, the results suggest that the multimedia program will be most useful as a neuroanatomy review tool for health-professions students preparing for licensing or board exams. This study demonstrates the importance of integrating quality properties of usability with principles of human learning during the instructional design process for multimedia products. PMID:19177405

Usability and Safety in Electronic Medical Records Interface Design: A Review of Recent Literature and Guideline Formulation.

PubMed

Zahabi, Maryam; Kaber, David B; Swangnetr, Manida

2015-08-01

The objectives of this study were to (a) review electronic medical record (EMR) and related electronic health record (EHR) interface usability issues, (b) review how EMRs have been evaluated with safety analysis techniques along with any hazard recognition, and (c) formulate design guidelines and a concept for enhanced EMR interfaces with a focus on diagnosis and documentation processes. A major impact of information technology in health care has been the introduction of EMRs. Although numerous studies indicate use of EMRs to increase health care quality, there remain concerns with usability issues and safety. A literature search was conducted using Compendex, PubMed, CINAHL, and Web of Science databases to find EMR research published since 2000. Inclusion criteria included relevant English-language papers with subsets of keywords and any studies (manually) identified with a focus on EMR usability. Fifty studies met the inclusion criteria. Results revealed EMR and EHR usability problems to include violations of natural dialog, control consistency, effective use of language, effective information presentation, and customization principles as well as a lack of error prevention, minimization of cognitive load, and feedback. Studies focusing on EMR system safety made no objective assessments and applied only inductive reasoning methods for hazard recognition. On the basis of the identified usability problems and structure of safety analysis techniques, we provide EMR design guidelines and a design concept focused on the diagnosis process and documentation. The design guidelines and new interface concept can be used for prototyping and testing enhanced EMRs. © 2015, Human Factors and Ergonomics Society.

The value of usability testing for Internet-based adolescent self-management interventions: “Managing Hemophilia Online”

PubMed Central

2013-01-01

Background As adolescents with hemophilia approach adulthood, they are expected to assume responsibility for their disease management. A bilingual (English and French) Internet-based self-management program, “Teens Taking Charge: Managing Hemophilia Online,” was developed to support adolescents with hemophilia in this transition. This study explored the usability of the website and resulted in refinement of the prototype. Methods A purposive sample (n=18; age 13–18; mean age 15.5 years) was recruited from two tertiary care centers to assess the usability of the program in English and French. Qualitative observations using a “think aloud” usability testing method and semi-structured interviews were conducted in four iterative cycles, with changes to the prototype made as necessary following each cycle. This study was approved by research ethics boards at each site. Results Teens responded positively to the content and appearance of the website and felt that it was easy to navigate and understand. The multimedia components (videos, animations, quizzes) were felt to enrich the experience. Changes to the presentation of content and the website user-interface were made after the first, second and third cycles of testing in English. Cycle four did not result in any further changes. Conclusions Overall, teens found the website to be easy to use. Usability testing identified end-user concerns that informed improvements to the program. Usability testing is a crucial step in the development of Internet-based self-management programs to ensure information is delivered in a manner that is accessible and understood by users. PMID:24094082

Initial Usability and Feasibility Evaluation of a Personal Health Record-Based Self-Management System for Older Adults.

PubMed

Sheehan, Barbara; Lucero, Robert J

2015-01-01

Electronic personal health record-based (ePHR-based) self-management systems can improve patient engagement and have an impact on health outcomes. In order to realize the benefits of these systems, there is a need to develop and evaluate heath information technology from the same theoretical underpinnings. Using an innovative usability approach based in human-centered distributed information design (HCDID), we tested an ePHR-based falls-prevention self-management system-Self-Assessment via a Personal Health Record (i.e., SAPHeR)-designed using HCDID principles in a laboratory. And we later evaluated SAPHeR's use by community-dwelling older adults at home. The innovative approach used in this study supported the analysis of four components: tasks, users, representations, and functions. Tasks were easily learned and features such as text-associated images facilitated task completion. Task performance times were slow, however user satisfaction was high. Nearly seven out of every ten features desired by design participants were evaluated in our usability testing of the SAPHeR system. The in vivo evaluation suggests that older adults could improve their confidence in performing indoor and outdoor activities after using the SAPHeR system. We have applied an innovative consumer-usability evaluation. Our approach addresses the limitations of other usability testing methods that do not utilize consistent theoretically based methods for designing and testing technology. We have successfully demonstrated the utility of testing consumer technology use across multiple components (i.e., task, user, representational, functional) to evaluate the usefulness, usability, and satisfaction of an ePHR-based self-management system.

ASIST 2003: Part II: Panels.

ERIC Educational Resources Information Center

Proceedings of the ASIST Annual Meeting, 2003

2003-01-01

Forty-six panels address topics including women in information science; users and usability; information studies; reference services; information policies; standards; interface design; information retrieval; information networks; metadata; shared access; e-commerce in libraries; knowledge organization; information science theories; digitization;…

User Experiences of the McMaster Optimal Aging Portal’s Evidence Summaries and Blog Posts: Usability Study

PubMed Central

M Barbara, Angela; Dobbins, Maureen; Haynes, R Brian; Iorio, Alfonso; Lavis, John N

2016-01-01

Background Evidence summaries and blogs can support evidence-informed healthy aging, by presenting high-quality health research evidence in plain language for a nonprofessional (citizen) audience. Objective Our objective was to explore citizens’ perceptions about the usability of evidence summaries and blog posts on the Web-based McMaster Optimal Aging Portal. Methods Twenty-two citizens (aged 50 years and older) and informal caregivers participated in a qualitative study using a think-aloud method and semistructured interviews. Eleven interviews were conducted in person, 7 over the telephone, and 4 by Skype. Results We identified themes that fell under 4 user-experience categories: (1) desirability: personal relevance, (2) understandability: language comprehension, grasping the message, dealing with uncertainty, (3) usability: volume of information, use of numbers, and (4) usefulness: intention to use, facility for sharing. Conclusions Participants recognized that high-quality evidence on aging was valuable. Their intended use of the information was influenced by how much it applied to their own health circumstances or those of a loved one. Some specific formatting features that were preferred included consistent layout, content organized by subheadings, catchy titles, numerical information summarized in a table, and inclusion of a glossary. PMID:27542995

Sign language Web pages.

PubMed

Fels, Deborah I; Richards, Jan; Hardman, Jim; Lee, Daniel G

2006-01-01

The WORLD WIDE WEB has changed the way people interact. It has also become an important equalizer of information access for many social sectors. However, for many people, including some sign language users, Web accessing can be difficult. For some, it not only presents another barrier to overcome but has left them without cultural equality. The present article describes a system that allows sign language-only Web pages to be created and linked through a video-based technique called sign-linking. In two studies, 14 Deaf participants examined two iterations of signlinked Web pages to gauge the usability and learnability of a signing Web page interface. The first study indicated that signing Web pages were usable by sign language users but that some interface features required improvement. The second study showed increased usability for those features; users consequently couldnavigate sign language information with ease and pleasure.

How you spend your pennies ... factors affecting the efficiency of human waste disposal systems (re-usable and disposable) and their cost.

PubMed

Rollnick, M

1991-05-01

Both re-usable and disposable systems have their merits and problems. The disposable system, being fully integrated, appears to be steadily gaining market share compared with the re-usable system. Since its introduction, the success of the re-usable system has been limited by the use of pans not designed for automatic processing. Where the 'perfection' pan has been superseded by 'open' shaped receptacles and those used in commode chairs, cleaning effectiveness can be improved by a factor of 10. For this and other reasons, nursing involvement in the re-usable system can be high while the 'perfection' pan is in use. A work study exercise to compare nursing involvement in re-usable and disposable systems is under way. When selecting a human waste disposal system for any site, it is vital that all disciplines discuss and decide objectives. The equipment usage, space, site conditions, availability and quality of supplies (eg water, electricity), the costs of maintenance, nursing time and other expenditure must be considered. The disposable system is capable of high process rates (more than double that of the fastest re-usable system). Its capital cost is currently about 1,000 pounds less than an average re-usable system, but in the busiest wards, revenue costs may be higher. In such wards the space for disposable receptacle storage can be as much as five to ten times machine volume. The design of macerators is generally simpler (having less components) than washer-disinfectors. Monitoring and maintenance involvement are likewise expected to be lower, particularly in hospitals with modern drainage systems.(ABSTRACT TRUNCATED AT 250 WORDS)

The STEP database through the end-users eyes--USABILITY STUDY.

PubMed

Salunke, Smita; Tuleu, Catherine

2015-08-15

The user-designed database of Safety and Toxicity of Excipients for Paediatrics ("STEP") is created to address the shared need of drug development community to access the relevant information of excipients effortlessly. Usability testing was performed to validate if the database satisfies the need of the end-users. Evaluation framework was developed to assess the usability. The participants performed scenario based tasks and provided feedback and post-session usability ratings. Failure Mode Effect Analysis (FMEA) was performed to prioritize the problems and improvements to the STEP database design and functionalities. The study revealed several design vulnerabilities. Tasks such as limiting the results, running complex queries, location of data and registering to access the database were challenging. The three critical attributes identified to have impact on the usability of the STEP database included (1) content and presentation (2) the navigation and search features (3) potential end-users. Evaluation framework proved to be an effective method for evaluating database effectiveness and user satisfaction. This study provides strong initial support for the usability of the STEP database. Recommendations would be incorporated into the refinement of the database to improve its usability and increase user participation towards the advancement of the database. Copyright © 2015 Elsevier B.V. All rights reserved.

Development of the UTAUT2 model to measure the acceptance of medical laboratory portals by patients in Shiraz.

PubMed

Ravangard, Ramin; Kazemi, Zhila; Abbasali, Somaye Zaker; Sharifian, Roxana; Monem, Hossein

2017-02-01

One of the main stages for achieving the success is acceptance of technology by its users. Hence, identifying the effective factors in successful acceptance of information technology is necessary and vital. One such factor is usability. This study aimed to investigate the software usability in the "Unified Theory of Acceptance and Use of Technology 2 (UTAUT2)" model in patients' use of medical diagnosis laboratories' electronic portals in 2015. This cross-sectional study was carried out on 170 patients in 2015. A 27-item questionnaire adopted from previous research and the Usability Evaluation questionnaire were used for data collection. Data were analyzed using Structural Equation Modeling (SEM), with Partial Least Squares approach by SPSS 20.0 and Smart-PLS V3.0. The results showed that the construct of intention to use had significant associations with price value (t-value=2.77), hedonic motivation (t-value=4.46), habit (t-value=1.99) and usability (t-value=5.2), as well as the construct of usage behavior with usability (t-value=3.45) and intention to use (t-value=2.03). Considering the results of this study, the following recommendations can be made in order for the higher use of portals by the patients: informing patients about the advantages of using these portals, designing portals in a simple and understandable form, increasing the portals' attractiveness, etc.

Usability Testing of the Indiana University Education Faculty Web Forms.

ERIC Educational Resources Information Center

Tuzun, Hakan; Lee, Sun Myung; Graham, Charles; Sluder, Kirk Job

The usability test team examined design problems that limit the ability of instructors at the Indiana University to use data entry forms on the School of Education Web site. The forms permit instructors to publish information about themselves and about courses they teach on the School of Education Web site. Faculty and graduate student instructors…

Digital Resource Exchange About Music (DREAM): Phase 2 Usability Testing

ERIC Educational Resources Information Center

Upitis, Rena; Boese, Karen; Abrami, Philip C.; Anwar, Zaeem

2015-01-01

The Digital Resource Exchange About Music (DREAM) is a virtual space for exchanging information about digital learning tools. The purpose of the present study was to determine how users responded to DREAM in the first four months after its public release. This study is the second phase of usability research on DREAM, and was conducted to guide…

Beyond qualitative and subjective techniques to assess usability of banking interfaces for senior citizens.

PubMed

Laparra-Hernández, José; Medina, Enric; Sancho, María; Soriano, Carolina; Durá, Juanvi; Barberà-Guillem, Ricard; Poveda-Puente, Rakel

2015-01-01

Senior citizens can benefit from banking services but the lack of usability hampers this possibility. New approaches based on physiological response, eye tracking and user movement analysis can provide more information during interface interaction. This research shows the differences depending on user knowledge and use of technology, gender and type of interface.

ICT Accessibility and Usability to Support Learning of Visually-Impaired Students in Tanzania

ERIC Educational Resources Information Center

Eligi, Innosencia; Mwantimwa, Kelefa

2017-01-01

The main objective of this study was to assess the accessibility and usability of Information and Communication Technology facilities to facilitate learning among visually-impaired students at the University of Dar es Salaam (UDSM). The study employed a mixed methods design in gathering, processing and analysing quantitative and qualitative data.…

Usability of a Web-Based School Experience System: Opinions of IT Teachers and Teacher Candidates

ERIC Educational Resources Information Center

Genç, Zülfü

2015-01-01

With advances in information and communication technologies, the classical nature of educational institutions has changed. One innovative effort within teacher training is the Web-Based School Experience System (WBSES) developed by the researcher. In this study, the usability of an existing WBSES is evaluated from both teachers' (n = 13) and…

Towards an Understanding of Mobile Website Contextual Usability and Its Impact on Mobile Commerce

ERIC Educational Resources Information Center

Hyman, Jack Alan

2012-01-01

An increasing number of technologies and applications have begun to focus on mobile computing and the wireless Web as a way to conduct commerce-oriented transactions. M-commerce Websites that are usability friendly must emphasize information quality, system quality, and service quality, as these are proxy measures to mobile commerce user…

User-oriented evaluation of mechanical single-channel axial pipettes.

PubMed

Sormunen, Erja; Nevala, Nina

2013-09-01

Hand tools should be designed so that they are comfortable to use, fit the hand and are user-oriented. Six different manual, single-channel axial pipettes were evaluated for such objective outcomes as muscular activity, wrist postures and efficiency, as well as for subjective outcomes concerning self-assessed features of pipette usability and musculoskeletal strain. Ten experienced laboratory employees volunteered for the study. The results showed that light and short pipettes with better tool comfort resulted in reduced muscular activity and perceived musculoskeletal strain when they were compared with a long and heavy pipette. There were no differences in the efficiency between the different pipettes. Combining both the objective and subjective measures enabled a broader evaluation of product usability. The results of this study can be used both in product development and as information on which to base the purchase of new pipettes for laboratory work. Copyright © 2012 Elsevier Ltd and The Ergonomics Society. All rights reserved.

Bridging the Science/Policy Gap through Boundary Chain Partnerships and Communities of Practice

NASA Astrophysics Data System (ADS)

Kalafatis, S.

2014-12-01

Generating the capacity to facilitate the informed usage of climate change science by decision makers on a large scale is fast becoming an area of great concern. While research demonstrates that sustained interactions between producers of such information and potential users can overcome barriers to information usage, it also demonstrates the high resource demand of these efforts. Our social science work at Great Lakes Integrated Sciences and Assessments (GLISA) sheds light on scaling up the usability of climate science through two research areas. The first focuses on partnerships with other boundary organizations that GLISA has leveraged - the "boundary chains" approach. These partnerships reduce the transaction costs involved with outreach and have enhanced the scope of GLISA's climate service efforts to encompass new users such as First Nations groups in Wisconsin and Michigan and underserved neighborhoods in St. Paul, Minnesota. The second research area looks at the development of information usability across the regional scale of the eight Great Lakes states. It has identified the critical role that communities of practice are playing in making information usable to large groups of users who work in similar contexts and have similar information needs. Both these research areas demonstrate the emerging potential of flexible knowledge networks to enhance society's ability to prepare for the impacts of climate change.

Evaluation of Home Health Care Devices: Remote Usability Assessment.

PubMed

Kortum, Philip; Peres, S Camille

2015-06-05

An increasing amount of health care is now performed in a home setting, away from the hospital. While there is growing anecdotal evidence about the difficulty patients and caregivers have using increasingly complex health care devices in the home, there has been little systematic scientific study to quantify the global nature of home health care device usability in the field. Research has tended to focus on a handful of devices, making it difficult to gain a broad view of the usability of home-care devices in general. The objective of this paper is to describe a remote usability assessment method using the System Usability Scale (SUS), and to report on the usability of a broad range of health care devices using this metric. A total of 271 participants selected and rated up to 10 home health care devices of their choice using the SUS, which scores usability from 0 (unusable) to 100 (highly usable). Participants rated a total of 455 devices in their own home without an experimenter present. Usability scores ranged from 98 (oxygen masks) to 59 (home hormone test kits). An analysis conducted on devices that had at least 10 ratings showed that the effect of device on SUS scores was significant (P<.001), and that the usability of these devices was on the low end when compared with other commonly used items in the home, such as microwave ovens and telephones. A large database of usability scores for home health care devices collected using this remote methodology would be beneficial for physicians, patients, and their caregivers.

Evaluation of a BCMA’s Electronic Medication Administration Record

PubMed Central

Staggers, Nancy; Iribarren, Sarah; Guo, Jia-Wen; Weir, Charlene

2015-01-01

Barcode medication administration (BCMA) systems can reduce medication errors, but sociotechnical issues are quite common. Although crucial to nurses’ work, few usability evaluations are available for electronic medication administration record screens (eMARs). The purpose of this research was to identify current usability problems in the VA’s eMAR/BCMA system and explore how these might impact nurses’ situation awareness. Three expert evaluators used 10 tasks/elements, heuristic evaluation techniques and explored potential impacts using a situation awareness perspective. The results yielded 99 usability problems categorized into 440 heuristic violations with the largest volume in the category of Match with the Real World. Fifteen usability issues were rated as catastrophic with the Administer/Chart medications task having the most. Situational awareness was impacted at all levels, especially at Level 2, Comprehension. Usability problems point to important areas for improvement because these issues have the potential to impact nurses’ situation awareness, “at a glance” information, nurse productivity and patient safety. PMID:25601936

A usability study of CPOE's medication administration functions: impact on physician-nurse cooperation.

PubMed

Beuscart-Zéphir, Marie Catherine; Pelayo, Sylvia; Degoulet, Patrice; Anceaux, Françoise; Guerlinger, Sandra; Meaux, Jean-Jacques

2004-01-01

Implementation of CPOE systems in Healthcare Institutions has proven efficient in reducing medication errors but it also induces hidden side-effects on Doctor-Nurse cooperation. We propose a usability engineering approach to this problem. An extensive activity analysis of the medication ordering and administration process was performed in several departments of 3 different hospitals. Two of these hospitals are still using paper-based orders, while the 3rd one is in the roll-out phase of medication functions of its CPOE system. We performed a usability assessment of this CPOE system. The usability assessment uncovered usability problems for the entry of medication administration time scheduling by the physician and revealed that the information can be ambiguous for the nurse. The comparison of cooperation models in both situation shows that users tend to adopt a distributed decision making paradigm in the paper-based situation, while the CPOE system supports a centralized decision making process. This analysis can support recommendation for the re-engineering of the Human-Computer Interface.

Measurement of Usability for Multimedia Interactive Learning Based on Website in Mathematics for SMK

NASA Astrophysics Data System (ADS)

Sukardjo, Moch.; Sugiyanta, Lipur

2018-04-01

Web usability, if evaluation done correctly, can significantly improve the quality of the website. Website containing multimedia for education shoud apply user interfaces that are both easy to learn and easy to use. Multimedia has big role in changing the mindset of a person in learning. Using multimedia, learners get easy to obtain information, adjust information and empower information. Therefore, multimedia is utilized by teachers in developing learning techniques to improve student learning outcomes. For students with self-directed learning, multimedia provides the ease and completeness of the courses in such a way that students can complete the learning independently both at school and at home without the guidance of teachers. The learning independence takes place in how students choose, absorb information, and follow the evaluation quickly and efficiently. The 2013 Curriculum 2013 for Vocational High School (SMK) requires teachers to create engaging teaching and learning activities that students enjoy in the classroom (also called invitation learning environment). The creation of learning activity environment is still problem for most teachers. Various researches reveal that teaching and learning activities will be more effective and easy when assisted by visual tools. Using multimedia, learning material can be presented more attractively that help students understand the material easily. The opposite is found in the learning activity environment who only rely on ordinary lectures. Usability is a quality level of multimedia with easy to learn, easy to use and encourages users to use it. The website Multimedia Interactive Learning for Mathematics SMK Class X is targeted object. Usability website in Multimedia Interactive Learning for Mathematics SMK Class X is important indicators to measure effectiveness, efficiency, and student satisfaction to access the functionality of website. This usability measurement should be done carefully before the design is implemented thoroughly. The only way to get test with high quality results is to start testing at the beginning of the design process and continuously testing each of the next steps. This research performs usability testing on of website by using WAMMI criterion (Website Analysis and Measurement Inventory) and will be focused on how convenience using the website application. Components of Attractiveness, Controllability, Efficiency, Helpfulness, and Learnability are applied. The website in Multimedia Interactive Learning for Mathematics SMK Class X can be in accordance with the purpose to be accepted by student to improve student learning outcomes. The results show that WAMMI method show the usability value of Multimedia Mathematics SMK Class X is about from 70% to 90%.

Evaluation of Web-Based Consumer Medication Information: Content and Usability of 4 Australian Websites

PubMed Central

Tariq, Amina; Richardson, Lauren; Byrne, Mary; Robinson, Maureen; Li, Ling; Westbrook, Johanna I; Baysari, Melissa T

2016-01-01

Background Medication is the most common intervention in health care, and written medication information can affect consumers’ medication-related behavior. Research has shown that a large proportion of Australians search for medication information on the Internet. Objective To evaluate the medication information content, based on consumer medication information needs, and usability of 4 Australian health websites: Better Health Channel, myDr, healthdirect, and NPS MedicineWise . Methods To assess website content, the most common consumer medication information needs were identified using (1) medication queries to the healthdirect helpline (a telephone helpline available across most of Australia) and (2) the most frequently used medications in Australia. The most frequently used medications were extracted from Australian government statistics on use of subsidized medicines in the community and the National Census of Medicines Use. Each website was assessed to determine whether it covered or partially covered information and advice about these medications. To assess website usability, 16 consumers participated in user testing wherein they were required to locate 2 pieces of medication information on each website. Brief semistructured interviews were also conducted with participants to gauge their opinions of the websites. Results Information on prescription medication was more comprehensively covered on all websites (3 of 4 websites covered 100% of information) than nonprescription medication (websites covered 0%-67% of information). Most websites relied on consumer medicines information leaflets to convey prescription medication information to consumers. Information about prescription medication classes was less comprehensive, with no website providing all information examined about antibiotics and antidepressants. Participants (n=16) were able to locate medication information on websites in most cases (accuracy ranged from 84% to 91%). However, a number of usability issues relating to website navigation and information display were identified. For example, websites not allowing combinations of search terms to be entered in search boxes and continuous blocks of text without subheadings. Conclusions Of the 4 Australian health information websites tested, none provided consumers with comprehensive medication information on both prescription and nonprescription medications in a user-friendly way. Using data on consumer information needs and user testing to guide medication information content and website design is a useful approach to inform consumer website development. PMID:27443680

Optimal use of electrophysiological indicators of muscular effort and fatigue

NASA Technical Reports Server (NTRS)

Updike, O. L.

1981-01-01

Electromyograms (EMG) from working muscles convey information on effort and fatigue. Their application, e.g., to assess the demands of vehicle control tasks, is complicated by the cooperative action of sets of muscles, by both intrinsic and imposed filtering, and by numerous other sources of variation. Fourier analyses of these noise like signals offer one approach to interpretation; downward spectral shifts accompany fatigue. Techniques are being sought (in both time and frequency domains) for further condensing the wideband EMG signals, while retaining essential information, into a concise 'state vector' usable in comparing control system designs.

User-centered design and usability testing of an innovative health-related quality of life module.

PubMed

Nagykaldi, Z J; Jordan, M; Quitoriano, J; Ciro, C A; Mold, J W

2014-01-01

Various computerized health risk appraisals (HRAs) are available, but few of them assess health-related quality of life (HRQoL) in a goal-directed framework. This study describes the user-centered development and usability testing of an innovative HRQoL module that extends a validated HRA tool in primary care settings. Systematic user-centered design, usability testing, and qualitative methods were used to develop the HRQoL module in primary care practices. Twenty two patients and 5 clinicians participated in two rounds of interactive technology think-out-loud sessions (TOLs) and semi-structured interviews (SSIs) to iteratively develop a four-step, computerized process that collects information on patient goals for meaningful life activities and current level of disability and presents a personalized and prioritized list of preventive recommendations linked to online resources. Analysis of TOLs and SSIs generated 5 categories and 11 sub-categories related to facilitators and barriers to usability and human-technology interaction. The categories included: Understanding the Purpose, Usability, Perceived Value, Literacy, and Participant Motivation. Some categories were inter-connected. The technology was continually and iteratively improved between sessions until saturation of positive feedback was achieved in 4 categories (addressing motivation will require more research). Usability of all screen units of the module was improved substantially. Clinician feedback emphasized the importance of the module's ability to translate the patient-centered HRQoL Report into actionable items for clinicians to facilitate shared decision-making. Complete integration of the HRQoL module into the existing HRA will require further development and testing. Systematic application of user-centered design and human factors principles in technology development and testing may significantly improve the usability and clinical value of health information systems. This more sophisticated approach helped us translate complex clinical concepts, goal-setting steps, and decision-support processes into an accepted and value-added technology.

The UX of amila pregnancy on mobile device

NASA Astrophysics Data System (ADS)

Hussain, Azham; Mkpojiogu, Emmanuel O. C.; Fadzil, Najdawati Mohd; Hassan, Norhasizasuriati Mohd

2017-10-01

The increased use of mobile devices has led to an upsurge in the number of mobile applications. This makes the usability of these applications a very crucial and critical issue. The Amila Pregnancy mobile app is revolutionizing the delivery of healthcare services to pregnancy woman across the globe and is increasingly becoming beneficial in their daily life. Only a few digital interventions have been developed for pregnant woman, and little is known about the acceptability and usability of such mobile apps that provide assistance to pregnant women. Usability comprises everything that is connected with the intuitive and efficient handling of user interaction with human-made devices. This paper reports the result of a usability evaluation for Amila Pregnancy mobile application. In the study five attributes of perceived usability was measured following Jakob Nielsen principles, namely: effectiveness, efficiency, learnability, memorability and satisfaction. In addition, performance metrics were also captured. The results reveal the difficulty users had in interpreting displayed icon, locating the information provided, re-finding it and in navigating through the mobile app. The study suggests that the main menu of the app need to be further improved upon to enhance its usability.

Impact of design features upon perceived tool usability and safety

NASA Astrophysics Data System (ADS)

Wiker, Steven F.; Seol, Mun-Su

2005-11-01

While injuries from powered hand tools are caused by a number of factors, this study looks specifically at the impact of the tools design features on perceived tool usability and safety. The tools used in this study are circular saws, power drills and power nailers. Sixty-nine males and thirty-two females completed an anonymous web-based questionnaire that provided orthogonal view photographs of the various tools. Subjects or raters provided: 1) description of the respondents or raters, 2) description of the responses from the raters, and 3) analysis of the interrelationships among respondent ratings of tool safety and usability, physical metrics of the tool, and rater demographic information. The results of the study found that safety and usability were dependent materially upon rater history of use and experience, but not upon training in safety and usability, or quality of design features of the tools (e.g., grip diameters, trigger design, guards, etc.). Thus, positive and negative transfer of prior experience with use of powered hand tools is far more important than any expectancy that may be driven by prior safety and usability training, or from the visual cues that are provided by the engineering design of the tool.

Adapting Nielsen’s Design Heuristics to Dual Processing for Clinical Decision Support

PubMed Central

Taft, Teresa; Staes, Catherine; Slager, Stacey; Weir, Charlene

2016-01-01

The study objective was to improve the applicability of Nielson’s standard design heuristics for evaluating electronic health record (EHR) alerts and linked ordering support by integrating them with Dual Process theory. Through initial heuristic evaluation and a user study of 7 physicians, usability problems were identified. Through independent mapping of specific usability criteria to support for each of the Dual Cognitive processes (S1 and S2) and deliberation, agreement was reached on mapping criteria. Finally, usability errors from the heuristic and user study were mapped to S1 and S2. Adding a dual process perspective to specific heuristic analysis increases the applicability and relevance of computerized health information design evaluations. This mapping enables designers to measure that their systems are tailored to support attention allocation. System 1 will be supported by improving pattern recognition and saliency, and system 2 through efficiency and control of information access. PMID:28269915

Adapting Nielsen's Design Heuristics to Dual Processing for Clinical Decision Support.

PubMed

Taft, Teresa; Staes, Catherine; Slager, Stacey; Weir, Charlene

2016-01-01

The study objective was to improve the applicability of Nielson's standard design heuristics for evaluating electronic health record (EHR) alerts and linked ordering support by integrating them with Dual Process theory. Through initial heuristic evaluation and a user study of 7 physicians, usability problems were identified. Through independent mapping of specific usability criteria to support for each of the Dual Cognitive processes (S1 and S2) and deliberation, agreement was reached on mapping criteria. Finally, usability errors from the heuristic and user study were mapped to S1 and S2. Adding a dual process perspective to specific heuristic analysis increases the applicability and relevance of computerized health information design evaluations. This mapping enables designers to measure that their systems are tailored to support attention allocation. System 1 will be supported by improving pattern recognition and saliency, and system 2 through efficiency and control of information access.

Iterative User Interface Design for Automated Sequential Organ Failure Assessment Score Calculator in Sepsis Detection

PubMed Central

Herasevich, Vitaly

2017-01-01

Background The new sepsis definition has increased the need for frequent sequential organ failure assessment (SOFA) score recalculation and the clerical burden of information retrieval makes this score ideal for automated calculation. Objective The aim of this study was to (1) estimate the clerical workload of manual SOFA score calculation through a time-motion analysis and (2) describe a user-centered design process for an electronic medical record (EMR) integrated, automated SOFA score calculator with subsequent usability evaluation study. Methods First, we performed a time-motion analysis by recording time-to-task-completion for the manual calculation of 35 baseline and 35 current SOFA scores by 14 internal medicine residents over a 2-month period. Next, we used an agile development process to create a user interface for a previously developed automated SOFA score calculator. The final user interface usability was evaluated by clinician end users with the Computer Systems Usability Questionnaire. Results The overall mean (standard deviation, SD) time-to-complete manual SOFA score calculation time was 61.6 s (33). Among the 24% (12/50) usability survey respondents, our user-centered user interface design process resulted in >75% favorability of survey items in the domains of system usability, information quality, and interface quality. Conclusions Early stakeholder engagement in our agile design process resulted in a user interface for an automated SOFA score calculator that reduced clinician workload and met clinicians’ needs at the point of care. Emerging interoperable platforms may facilitate dissemination of similarly useful clinical score calculators and decision support algorithms as “apps.” A user-centered design process and usability evaluation should be considered during creation of these tools. PMID:28526675

Iterative User Interface Design for Automated Sequential Organ Failure Assessment Score Calculator in Sepsis Detection.

PubMed

Aakre, Christopher Ansel; Kitson, Jaben E; Li, Man; Herasevich, Vitaly

2017-05-18

The new sepsis definition has increased the need for frequent sequential organ failure assessment (SOFA) score recalculation and the clerical burden of information retrieval makes this score ideal for automated calculation. The aim of this study was to (1) estimate the clerical workload of manual SOFA score calculation through a time-motion analysis and (2) describe a user-centered design process for an electronic medical record (EMR) integrated, automated SOFA score calculator with subsequent usability evaluation study. First, we performed a time-motion analysis by recording time-to-task-completion for the manual calculation of 35 baseline and 35 current SOFA scores by 14 internal medicine residents over a 2-month period. Next, we used an agile development process to create a user interface for a previously developed automated SOFA score calculator. The final user interface usability was evaluated by clinician end users with the Computer Systems Usability Questionnaire. The overall mean (standard deviation, SD) time-to-complete manual SOFA score calculation time was 61.6 s (33). Among the 24% (12/50) usability survey respondents, our user-centered user interface design process resulted in >75% favorability of survey items in the domains of system usability, information quality, and interface quality. Early stakeholder engagement in our agile design process resulted in a user interface for an automated SOFA score calculator that reduced clinician workload and met clinicians' needs at the point of care. Emerging interoperable platforms may facilitate dissemination of similarly useful clinical score calculators and decision support algorithms as "apps." A user-centered design process and usability evaluation should be considered during creation of these tools. ©Christopher Ansel Aakre, Jaben E Kitson, Man Li, Vitaly Herasevich. Originally published in JMIR Human Factors (http://humanfactors.jmir.org), 18.05.2017.

A Concise and Practical Framework for the Development and Usability Evaluation of Patient Information Websites.

PubMed

Peute, L W; Knijnenburg, S L; Kremer, L C; Jaspers, M W M

2015-01-01

The Website Developmental Model for the Healthcare Consumer (WDMHC) is an extensive and successfully evaluated framework that incorporates user-centered design principles. However, due to its extensiveness its application is limited. In the current study we apply a subset of the WDMHC framework in a case study concerning the development and evaluation of a website aimed at childhood cancer survivors (CCS). To assess whether the implementation of a limited subset of the WDMHC-framework is sufficient to deliver a high-quality website with few usability problems, aimed at a specific patient population. The website was developed using a six-step approach divided into three phases derived from the WDMHC: 1) information needs analysis, mock-up creation and focus group discussion; 2) website prototype development; and 3) heuristic evaluation (HE) and think aloud analysis (TA). The HE was performed by three double experts (knowledgeable both in usability engineering and childhood cancer survivorship), who assessed the site using the Nielsen heuristics. Eight end-users were invited to complete three scenarios covering all functionality of the website by TA. The HE and TA were performed concurrently on the website prototype. The HE resulted in 29 unique usability issues; the end-users performing the TA encountered eleven unique problems. Four issues specifically revealed by HE concerned cosmetic design flaws, whereas two problems revealed by TA were related to website content. Based on the subset of the WDMHC framework we were able to deliver a website that closely matched the expectancy of the end-users and resulted in relatively few usability problems during end-user testing. With the successful application of this subset of the WDMHC, we provide developers with a clear and easily applicable framework for the development of healthcare websites with high usability aimed at specific medical populations.

Evaluating input device usability as a function of task difficulty in a tracking task.

PubMed

Rupp, Michael A; Oppold, Paul; McConnell, Daniel S

2015-01-01

Game controllers are emerging as a preferred choice for the manual control of unmanned vehicles, but an understanding of their usability characteristics has yet to emerge. We compared the usability of an Xbox 360 game controller in a dual task situation using MATB II to the traditional joystick and keyboard interface in two experiments. In the first experiment, performance with the game controller was associated with fewer tracking errors. In a second experiment, we trained users on the devices, and found that even after training the game controller was still associated with fewer tracking errors as well as higher usability and lower workload ratings. These results are consistent with the idea that game controllers are highly usable input devices and do not require high mental workload to operate, thus making them suitable for complex control tasks.

Evaluating Nurses' Satisfaction With Two Nursing Information Systems.

PubMed

Khajouei, Reza; Abbasi, Reza

2017-06-01

Evaluating user satisfaction is one of the methods to ensure the usability of information systems. Considering the importance of nursing information systems in patient health, the objective of this study is to evaluate nurses' satisfaction with two widely used nursing information systems (Peyvand Dadeh and Tirazhe) in Iran. This descriptive-analytical study was done on 230 nurses in all teaching hospitals of Kerman University of Medical Sciences in 2015. Data were collected using an augmented version of a questionnaire developed by IBM. Data were analyzed by SPSS.16 using descriptive and analytical statistical methods including t test, analysis of variance, and Pearson correlation coefficient. The mean of overall satisfaction with the two systems was 61 ± 2.2 and 74 ± 2.4, respectively. The mean of satisfaction with different systems dimensions, that is, ease of use, information quality, and interface quality, was, respectively, 24 ± 1.9, 26 ± 9.7, and 12 ± 4.7 for Tirazhe and 29 ± 1.1, 39 ± 1.04 and 13 ± 5.3 for Peyvand Dadeh system. Nurses' satisfaction with both systems was at a medium level. The majority of nurses were relatively satisfied with the information quality and user interface quality of these systems. The results suggest that designing nursing information systems in accordance with their users' need improves usability. Hence, policy and decision makers of healthcare institutions should invest on usability when purchasing such systems.

Why We Are Not Google: Lessons from a Library Web Site Usability Study

ERIC Educational Resources Information Center

Swanson, Troy A.; Green, Jeremy

2011-01-01

In the Fall of 2009, the Moraine Valley Community College Library, using guidelines developed by Jakob Nielsen, conducted a usability study to determine how students were using the library Web site and to inform the redesign of the Web site. The authors found that Moraine Valley's current gateway design was a more effective access point to library…

An assessment of the usability of undergraduate healthcare management program websites.

PubMed

Roggenkamp, Susan D

2005-01-01

Prospective students in higher education programs increasingly use the Internet as a source of information to assist in the selection of both university and major programs of study. Therefore, having an informative and well designed website is now an integral component of a higher education program's marketing mix. This article attempts to inform undergraduate health administration programs about the elements of good website design, namely content that is important and relevant to users, site layout appeal, and ease of navigation. Content analyses of undergraduate health administration program websites in 2002 and 2005 assessed both the extent of content from a standard list of twenty-five information elements and usability features of the sites. Implications for improvements to program websites are discussed.

Development of a text messaging system to improve receipt of survivorship care in adolescent and young adult survivors of childhood cancer.

PubMed

Casillas, Jacqueline; Goyal, Anju; Bryman, Jason; Alquaddoomi, Faisal; Ganz, Patricia A; Lidington, Emma; Macadangdang, Joshua; Estrin, Deborah

2017-08-01

This study aimed to develop and examine the acceptability, feasibility, and usability of a text messaging, or Short Message Service (SMS), system for improving the receipt of survivorship care for adolescent and young adult (AYA) survivors of childhood cancer. Researchers developed and refined the text messaging system based on qualitative data from AYA survivors in an iterative three-stage process. In stage 1, a focus group (n = 4) addressed acceptability; in stage 2, key informant interviews (n = 10) following a 6-week trial addressed feasibility; and in stage 3, key informant interviews (n = 23) following a 6-week trial addressed usability. Qualitative data were analyzed using a constant comparative analytic approach exploring in-depth themes. The final system includes programmed reminders to schedule and attend late effect screening appointments, tailored suggestions for community resources for cancer survivors, and messages prompting participant feedback regarding the appointments and resources. Participants found the text messaging system an acceptable form of communication, the screening reminders and feedback prompts feasible for improving the receipt of survivorship care, and the tailored suggestions for community resources usable for connecting survivors to relevant services. Participants suggested supplementing survivorship care visits and forming AYA survivor social networks as future implementations for the text messaging system. The text messaging system may assist AYA survivors by coordinating late effect screening appointments, facilitating a partnership with the survivorship care team, and connecting survivors with relevant community resources. The text messaging system has the potential to improve the receipt of survivorship care.

Simulated Prosthetic Vision: The Benefits of Computer-Based Object Recognition and Localization.

PubMed

Macé, Marc J-M; Guivarch, Valérian; Denis, Grégoire; Jouffrais, Christophe

2015-07-01

Clinical trials with blind patients implanted with a visual neuroprosthesis showed that even the simplest tasks were difficult to perform with the limited vision restored with current implants. Simulated prosthetic vision (SPV) is a powerful tool to investigate the putative functions of the upcoming generations of visual neuroprostheses. Recent studies based on SPV showed that several generations of implants will be required before usable vision is restored. However, none of these studies relied on advanced image processing. High-level image processing could significantly reduce the amount of information required to perform visual tasks and help restore visuomotor behaviors, even with current low-resolution implants. In this study, we simulated a prosthetic vision device based on object localization in the scene. We evaluated the usability of this device for object recognition, localization, and reaching. We showed that a very low number of electrodes (e.g., nine) are sufficient to restore visually guided reaching movements with fair timing (10 s) and high accuracy. In addition, performance, both in terms of accuracy and speed, was comparable with 9 and 100 electrodes. Extraction of high level information (object recognition and localization) from video images could drastically enhance the usability of current visual neuroprosthesis. We suggest that this method-that is, localization of targets of interest in the scene-may restore various visuomotor behaviors. This method could prove functional on current low-resolution implants. The main limitation resides in the reliability of the vision algorithms, which are improving rapidly. Copyright © 2015 International Center for Artificial Organs and Transplantation and Wiley Periodicals, Inc.

Relationship Between Evidence Requirements, User Expectations, and Actual Experiences: Usability Evaluation of the Twazon Arabic Weight Loss App

PubMed Central

Kyle, Janet; Alkhalifah, Abdulrahman; Marais, Debbi

2018-01-01

Background Saudi Arabia has faced a steady growth in the prevalence of obesity. The concurrent and ubiquitous use of mobile technology, such as smartphones and apps, provides an opportunity for the implementation of mHealth technology, a method for delivering behavioral interventions. Despite their effectiveness in promoting lifestyle and diet modification, culturally adapted weight loss apps and related interventions are lacking in Gulf Cooperation Council countries. Objective The objective of our study was to identify the relationship between adherence to evidence-informed practices, potential user expectations, and actual user experiences in order to enhance the understanding of the overall usability of the Twazon Arabic weight loss app. Methods In 2 previous studies, 39 Saudi women were recruited for focus group discussions and 240 Saudi women were recruited for an app-based weight loss intervention. Usability of the Twazon Arabic weight loss app was evaluated by analyzing the opinions and experiences of 26 participants who engaged with the Twazon app for 4 months; the System Usability Scale (SUS) and word clouds were used. The results were triangulated with potential user expectations obtained in the focus group discussion and with the findings from an Arabic app screening for evidence-informed practices. Results The average reported SUS score was 69.3. The most favored features were the calorie counter, step counter, and physical activity calorie counter. The features in need of improvement were the social network, notifications, and the Twazon Saudi Food Database. Twazon users preferred and found useful 7 of the 13 evidence-informed weight loss practices that were integrated into the features of the app. Conclusions Triangulation identified the most notable relationship to be the disparity between user experience and 2 of the evidence-informed practices, namely a minimum weight loss goal of 0.5 to 1 kg/week and social support; no relationship was found between user expectations and evidence-informed weight loss practices. The overall usability of the Twazon Arabic weight loss app ranged between high marginal and acceptable, indicating that some improvements to the app should be considered for implementation in future app-based weight loss interventions of this kind. PMID:29666042

A new image enhancement algorithm with applications to forestry stand mapping

NASA Technical Reports Server (NTRS)

Kan, E. P. F. (Principal Investigator); Lo, J. K.

1975-01-01

The author has identified the following significant results. Results show that the new algorithm produced cleaner classification maps in which holes of small predesignated sizes were eliminated and significant boundary information was preserved. These cleaner post-processed maps better resemble true life timber stand maps and are thus more usable products than the pre-post-processing ones: Compared to an accepted neighbor-checking post-processing technique, the new algorithm is more appropriate for timber stand mapping.

Usability evaluation of pharmacogenomics clinical decision support aids and clinical knowledge resources in a computerized provider order entry system: a mixed methods approach.

PubMed

Devine, Emily Beth; Lee, Chia-Ju; Overby, Casey L; Abernethy, Neil; McCune, Jeannine; Smith, Joe W; Tarczy-Hornoch, Peter

2014-07-01

Pharmacogenomics (PGx) is positioned to have a widespread impact on the practice of medicine, yet physician acceptance is low. The presentation of context-specific PGx information, in the form of clinical decision support (CDS) alerts embedded in a computerized provider order entry (CPOE) system, can aid uptake. Usability evaluations can inform optimal design, which, in turn, can spur adoption. The study objectives were to: (1) evaluate an early prototype, commercial CPOE system with PGx-CDS alerts in a simulated environment, (2) identify potential improvements to the system user interface, and (3) understand the contexts under which PGx knowledge embedded in an electronic health record is useful to prescribers. Using a mixed methods approach, we presented seven cardiologists and three oncologists with five hypothetical clinical case scenarios. Each scenario featured a drug for which a gene encoding drug metabolizing enzyme required consideration of dosage adjustment. We used Morae(®) to capture comments and on-screen movements as participants prescribed each drug. In addition to PGx-CDS alerts, 'Infobutton(®)' and 'Evidence' icons provided participants with clinical knowledge resources to aid decision-making. Nine themes emerged. Five suggested minor improvements to the CPOE user interface; two suggested presenting PGx information through PGx-CDS alerts using an 'Infobutton' or 'Evidence' icon. The remaining themes were strong recommendations to provide succinct, relevant guidelines and dosing recommendations of phenotypic information from credible and trustworthy sources; any more information was overwhelming. Participants' median rating of PGx-CDS system usability was 2 on a Likert scale ranging from 1 (strongly agree) to 7 (strongly disagree). Usability evaluation results suggest that participants considered PGx information important for improving prescribing decisions; and that they would incorporate PGx-CDS when information is presented in relevant and useful ways. Copyright © 2014 Elsevier Ireland Ltd. All rights reserved.

CUE: counterfeit-resistant usable eye movement-based authentication via oculomotor plant characteristics and complex eye movement patterns

NASA Astrophysics Data System (ADS)

Komogortsev, Oleg V.; Karpov, Alexey; Holland, Corey D.

2012-06-01

The widespread use of computers throughout modern society introduces the necessity for usable and counterfeit-resistant authentication methods to ensure secure access to personal resources such as bank accounts, e-mail, and social media. Current authentication methods require tedious memorization of lengthy pass phrases, are often prone to shouldersurfing, and may be easily replicated (either by counterfeiting parts of the human body or by guessing an authentication token based on readily available information). This paper describes preliminary work toward a counterfeit-resistant usable eye movement-based (CUE) authentication method. CUE does not require any passwords (improving the memorability aspect of the authentication system), and aims to provide high resistance to spoofing and shoulder-surfing by employing the combined biometric capabilities of two behavioral biometric traits: 1) oculomotor plant characteristics (OPC) which represent the internal, non-visible, anatomical structure of the eye; 2) complex eye movement patterns (CEM) which represent the strategies employed by the brain to guide visual attention. Both OPC and CEM are extracted from the eye movement signal provided by an eye tracking system. Preliminary results indicate that the fusion of OPC and CEM traits is capable of providing a 30% reduction in authentication error when compared to the authentication accuracy of individual traits.

Evaluation of an integrated graphical display to promote acute change detection in ICU patients

PubMed Central

Anders, Shilo; Albert, Robert; Miller, Anne; Weinger, Matthew B.; Doig, Alexa K.; Behrens, Michael; Agutter, Jim

2012-01-01

Objective The purpose of this study was to evaluate ICU nurses’ ability to detect patient change using an integrated graphical information display (IGID) versus a conventional tabular ICU patient information display (i.e. electronic chart). Design Using participants from two different sites, we conducted a repeated measures simulator-based experiment to assess ICU nurses’ ability to detect abnormal patient variables using a novel IGID versus a conventional tabular information display. Patient scenarios and display presentations were fully counterbalanced. Measurements We measured percent correct detection of abnormal patient variables, nurses’ perceived workload (NASA-TLX), and display usability ratings. Results 32 ICU nurses (87% female, median age of 29 years, and median ICU experience of 2.5 years) using the IGID detected more abnormal variables compared to the tabular display [F (1,119)=13.0, p < 0.05]. There was a significant main effect of site [F (1, 119)=14.2], with development site participants doing better. There were no significant differences in nurses’ perceived workload. The IGID display was rated as more usable than the conventional display, [F (1, 60)=31.7]. Conclusion Overall, nurses reported more important physiological information with the novel IGID than tabular display. Moreover, the finding of site differences may reflect local influences in work practice and involvement in iterative display design methodology. Information displays developed using user-centered design should accommodate the full diversity of the intended user population across use sites. PMID:22534099

Assessing the quality of online information for patients with carotid disease.

PubMed

Keogh, C J; McHugh, S M; Clarke Moloney, M; Hannigan, A; Healy, D A; Burke, P E; Kavanagh, E G; Grace, P A; Walsh, S R

2014-01-01

Controversy exists relating to carotid endarterectomy (CEA) versus carotid artery stenting (CAS). We aimed to assess the quality of online patient information relating to both. The Google search engine was searched for "carotid endarterectomy" and "carotid stenting". The first 50 webpages returned were assessed. The Gunning Fog Index (GFI) and Flesch Reading Ease Score (FRES) were calculated to assess readability. The LIDA tool (Minervation Ltd., Oxford, U.K.) was used to assess accessibility, usability and reliability. 20% (n = 10) of the webpages returned for CEA were from peer reviewed sources with 34% (n = 17) posted by hospitals or health services. Comparatively, for CAS, 40% (n = 20) were peer reviewed with 16% (n = 8) posted by hospitals or health services. GFI and FRES scores indicated webpages for both CEA and CAS had poor general readability. Webpages for CEA were easier to read than those for CAS (mean FRES difference of 6.7 (95% CI 0.51 to 12.93, p = 0.03). Median LIDA scores demonstrated acceptable reliability, accessibility and usability of information for both CEA and CAS webpages. The more readable webpages were not associated with higher LIDA scores for either CEA or CAS webpages. Webpages providing information on carotid disease management must be made more readable. Online information currently available to patients regarding CAS is more difficult to read and comprehend than CEA. Copyright © 2014 Surgical Associates Ltd. Published by Elsevier Ltd. All rights reserved.

Usability in product development practice; an exploratory case study comparing four markets.

PubMed

van Kuijk, Jasper; van Driel, Liesbeth; van Eijk, Daan

2015-03-01

This study explored how usability was dealt with in four product development organizations active in different sectors: high-end automotive, professional printers and copiers, office coffee makers and fast moving consumer goods. The primary differentiators of the selected cases were whether they were targeting businesses or consumers and the degree of product complexity. Interviews with 19 product development practitioners were conducted, focussing on three topics: 1) the product development process and the integration of user involvement, 2) multidisciplinary teamwork, and 3) organizational attitude towards usability. Based on the interviews, context descriptions of the companies were created and barriers and enablers for usability were identified. To verify the findings and to discuss remaining issues a feedback workshop was held in which the primary contact from each company participated. The results indicate that differences in product-market combination lead to differences in organizational attitude towards usability. The prioritization of usability in an organization seems to be influenced by the degree of product complexity (complex products are more prone to suffer from usability issues) and whether developers think that usability is a purchase consideration for their clients. The product-market combination a company targets also affects the methods for user-centred design that a company can apply and that are relevant. What methods for user-centred design are used also seems to be influenced by the attitude towards usability: if usability is considered more important, methods that require more resources can be applied. Copyright © 2014 Elsevier Ltd and The Ergonomics Society. All rights reserved.

Effect of font size, italics, and colour count on web usability.

PubMed

Bhatia, Sanjiv K; Samal, Ashok; Rajan, Nithin; Kiviniemi, Marc T

2011-04-01

Web usability measures the ease of use of a website. This study attempts to find the effect of three factors - font size, italics, and colour count - on web usability. The study was performed using a set of tasks and developing a survey questionnaire. We performed the study using a set of human subjects, selected from the undergraduate students taking courses in psychology. The data computed from the tasks and survey questionnaire were statistically analysed to find if there was any effect of font size, italics, and colour count on the three web usability dimensions. We found that for the student population considered, there was no significant effect of font size on usability. However, the manipulation of italics and colour count did influence some aspects of usability. The subjects performed better for pages with no italics and high italics compared to moderate italics. The subjects rated the pages that contained only one colour higher than the web pages with four or six colours. This research will help web developers better understand the effect of font size, italics, and colour count on web usability in general, and for young adults, in particular.

Mobile Health Applications, in the Absence of an Authentic Regulation, Does the Usability Score Correlate with a Better Medical Reliability?

PubMed

Yasini, Mobin; Marchand, Guillaume

2015-01-01

Health-related mobile applications (apps) have been shown to improve the quality of health and patient care. Their use in clinical and health-related environments is becoming more considerable. The number of health-related apps available for download has considerably increased, while the regulatory position of this new industry is not well known. Despite this lack of regulation, measuring the usability score of these apps is not difficult. We compared two samples of twenty health-related applications each. One of the samples contained the apps with top-rated usability scores, and the other contained the apps with lowest-rated usability scores. We found that a good usability score correlates with a better medical reliability of the app's content (p<0.005). In the period in which a valid regulation is still lacking, calculation and attribution of usability scores to mobile applications could be used to identify apps with better medical quality. However, the usability score method ought to be rigorous and should not be rounded off with a simple five stars rating (as is the case in the classic app stores).

Measuring the Usability of Augmented Reality e-Learning Systems: A User-Centered Evaluation Approach

NASA Astrophysics Data System (ADS)

Pribeanu, Costin; Balog, Alexandru; Iordache, Dragoş Daniel

The development of Augmented Reality (AR) systems is creating new challenges and opportunities for the designers of e-learning systems. The mix of real and virtual requires appropriate interaction techniques that have to be evaluated with users in order to avoid usability problems. Formative usability aims at finding usability problems as early as possible in the development life cycle and is suitable to support the development of such novel interactive systems. This work presents an approach to the user-centered usability evaluation of an e-learning scenario for Biology developed on an Augmented Reality educational platform. The evaluation has been carried on during and after a summer school held within the ARiSE research project. The basic idea was to perform usability evaluation twice. In this respect, we conducted user testing with a small number of students during the summer school in order to get a fast feedback from users having good knowledge in Biology. Then, we repeated the user testing in different conditions and with a relatively larger number of representative users. In this paper we describe both experiments and compare the usability evaluation results.

Effect of font size, italics, and colour count on web usability

PubMed Central

Samal, Ashok; Rajan, Nithin; Kiviniemi, Marc T.

2013-01-01

Web usability measures the ease of use of a website. This study attempts to find the effect of three factors – font size, italics, and colour count – on web usability. The study was performed using a set of tasks and developing a survey questionnaire. We performed the study using a set of human subjects, selected from the undergraduate students taking courses in psychology. The data computed from the tasks and survey questionnaire were statistically analysed to find if there was any effect of font size, italics, and colour count on the three web usability dimensions. We found that for the student population considered, there was no significant effect of font size on usability. However, the manipulation of italics and colour count did influence some aspects of usability. The subjects performed better for pages with no italics and high italics compared to moderate italics. The subjects rated the pages that contained only one colour higher than the web pages with four or six colours. This research will help web developers better understand the effect of font size, italics, and colour count on web usability in general, and for young adults, in particular. PMID:24358055

The Hype over Hyperbolic Browsers.

ERIC Educational Resources Information Center

Allen, Maryellen Mott

2002-01-01

Considers complaints about the usability in the human-computer interaction aspect of information retrieval and discusses information visualization, the Online Library of Information Visualization Environments, hyperbolic information structure, subject searching, real-world applications, relational databases and hyperbolic trees, and the future of…

Development of the UTAUT2 model to measure the acceptance of medical laboratory portals by patients in Shiraz

PubMed Central

Ravangard, Ramin; Kazemi, Zhila; Abbasali, Somaye Zaker; Sharifian, Roxana; Monem, Hossein

2017-01-01

Introduction One of the main stages for achieving the success is acceptance of technology by its users. Hence, identifying the effective factors in successful acceptance of information technology is necessary and vital. One such factor is usability. This study aimed to investigate the software usability in the “Unified Theory of Acceptance and Use of Technology 2 (UTAUT2)” model in patients’ use of medical diagnosis laboratories’ electronic portals in 2015. Methods This cross-sectional study was carried out on 170 patients in 2015. A 27-item questionnaire adopted from previous research and the Usability Evaluation questionnaire were used for data collection. Data were analyzed using Structural Equation Modeling (SEM), with Partial Least Squares approach by SPSS 20.0 and Smart-PLS V3.0. Results The results showed that the construct of intention to use had significant associations with price value (t-value=2.77), hedonic motivation (t-value=4.46), habit (t-value=1.99) and usability (t-value=5.2), as well as the construct of usage behavior with usability (t-value=3.45) and intention to use (t-value=2.03). Conclusion Considering the results of this study, the following recommendations can be made in order for the higher use of portals by the patients: informing patients about the advantages of using these portals, designing portals in a simple and understandable form, increasing the portals’ attractiveness, etc. PMID:28465819

Evaluation of Smartphone Applications for Cardiopulmonary Resuscitation Training in South Korea

PubMed Central

Cho, Yongtak; Song, Yeongtak; Lim, Tae Ho; Kang, Hyunggoo

2016-01-01

Objective. There are many smartphone-based applications (apps) for cardiopulmonary resuscitation (CPR) training. We investigated the conformity and the learnability/usability of these apps for CPR training and real-life supports. Methods. We conducted a mixed-method, sequential explanatory study to assess CPR training apps downloaded on two apps stores in South Korea. Apps were collected with inclusion criteria as follows, Korean-language instruction, training features, and emergency supports for real-life incidents, and analyzed with two tests; 15 medical experts evaluated the apps' contents according to current Basic Life Support guidelines in conformity test, and 15 nonmedical individuals examined the apps using System Usability Scale (SUS) in the learnability/usability test. Results. Out of 79 selected apps, five apps were included and analyzed. For conformity (ICC, 0.95, p < 0.001), means of all apps were greater than 12 of 20 points, indicating that they were well designed according to current guidelines. Three of the five apps yielded acceptable level (greater than 68 of 100 points) for learnability/usability. Conclusion. All the included apps followed current BLS guidelines and a majority offered acceptable learnability/usability for layperson. Current and developmental smartphone-based CPR training apps should include accurate CPR information and be easy to use for laypersons that are potential rescuers in real-life incidents. For Clinical Trials. This is a clinical trial, registered at the Clinical Research Information Service (CRIS, cris.nih.go.kr), number KCT0001840. PMID:27668257

Usability testing in medical informatics: cognitive approaches to evaluation of information systems and user interfaces.

PubMed Central

Kushniruk, A. W.; Patel, V. L.; Cimino, J. J.

1997-01-01

This paper describes an approach to the evaluation of health care information technologies based on usability engineering and a methodological framework from the study of medical cognition. The approach involves collection of a rich set of data including video recording of health care workers as they interact with systems, such as computerized patient records and decision support tools. The methodology can be applied in the laboratory setting, typically involving subjects "thinking aloud" as they interact with a system. A similar approach to data collection and analysis can also be extended to study of computer systems in the "live" environment of hospital clinics. Our approach is also influenced from work in the area of cognitive task analysis, which aims to characterize the decision making and reasoning of subjects of varied levels of expertise as they interact with information technology in carrying out representative tasks. The stages involved in conducting cognitively-based usability analyses are detailed and the application of such analysis in the iterative process of system and interface development is discussed. PMID:9357620

Participatory interaction design in user requirements specification in healthcare.

PubMed

Martikainen, Susanna; Ikävalko, Pauliina; Korpela, Mikko

2010-01-01

Healthcare information systems are accused of poor usability even in the popular media in Finland. Doctors especially have been very critical and actively expressed their opinions in public. User involvement and user-centered design methods are seen as the key solution to usability problems. In this paper we describe a research case where participatory methods were experimented within healthcare information systems development in medicinal care in a hospital. The study was part of a larger research project on Activity-driven Information Systems Development in healthcare. The study started by finding out about and modeling the present state of medicinal care in the hospital. After that it was important to define and model the goal state. The goal state, facilitated by the would-be software package, was modeled with the help of user interface drawings as one way of prototyping. Traditional usability methods were extended during the study. According to the health professionals' feedback, the use of participatory and user-centered interaction design methods, particularly user interface drawings enabled them to describe their requirements and create common understanding with the system developers.

Evaluation of English Websites on Dental Caries by Using Consumer Evaluation Tools.

PubMed

Blizniuk, Anastasiya; Furukawa, Sayaka; Ueno, Masayuki; Kawaguchi, Yoko

2016-01-01

To evaluate the quality of patient-oriented online information about dental caries using existing consumer evaluation tools and to judge the efficacy of these tools in quality assessment. The websites for the evaluation were pooled by using two general search engines (Google and Yahoo!). The search terms were: 'dental caries', 'tooth decay' and 'tooth cavity'. Three assessment tools (LIDA, DISCERN and FRES) were used to evaluate the quality of the information in the areas of accessibility, usability, reliability and readability. In total, 77 websites were analysed. The median scores of LIDA accessibility and usability were 45.0 and 8.0, respectively, which corresponded to a medium level of quality. The median reliability scores for LIDA (12.0) and DISCERN (20.0) both corresponded to low level of quality. The readability was high with the median FRES score 59.7. The websites on caries had good accessibility, usability and readability, while reliability of the information was poor. The LIDA instrument was found to be more convenient than DISCERN and can be recommended to lay people for quick quality assessment.

VRUSE--a computerised diagnostic tool: for usability evaluation of virtual/synthetic environment systems.

PubMed

Kalawsky, R S

1999-02-01

A special questionnaire (VRUSE) has been designed to measure the usability of a VR system according to the attitude and perception of its users. Important aspects of VR systems were carefully derived to produce key usability factors for the questionnaire. Unlike questionnaires designed for generic interfaces VRUSE is specifically designed to cater for evaluating virtual environments, being a diagnostic tool providing a wealth of information about a user's viewpoint of the interface. VRUSE can be used to great effect with other evaluation techniques to pinpoint problematical areas of a VR interface. Other applications include bench-marking of competitor VR systems.

Universally-Usable Interactive Electronic Physics Instructional And Educational Materials

NASA Astrophysics Data System (ADS)

Gardner, John

2000-03-01

Recent developments of technologies that promote full accessibility of electronic information by future generations of people with print disabilities will be described. ("Print disabilities" include low vision, blindness, and dyslexia.) The guiding philosophy of these developments is that information should be created and transmitted in a form that is as display-independent as possible, and that the user should have maximum freedom over how that information is to be displayed. This philosophy leads to maximum usability by everybody and is, in the long run, the only way to assure truly equal access. Research efforts to be described include access to mathematics and scientific notation and to graphs, tables, charts, diagrams, and general object-oriented graphics.

Overhead drilling: Comparing three bases for aligning a drilling jig to vertical

PubMed Central

Rempel, David; Star, Demetra; Barr, Alan; Janowitz, Ira

2010-01-01

Problem Drilling overhead into concrete or metal ceilings is a strenuous task done by construction workers to hang ductwork, piping, and electrical equipment. The task is associated with upper body pain and musculoskeletal disorders. Previously, we described a field usability evaluation of a foot lever and inverted drill press intervention devices that were compared to the usual method for overhead drilling. Both interventions were rated as inferior to the usual method based on poor setup time and mobility. Method Three new interventions, which differed on the design used for aligning the drilling column to vertical, were compared to the usual method for overhead drilling by commercial construction workers (n=16). Results The usual method was associated with the highest levels of regional body fatigue and the poorest usability ratings when compared to the three interventions. Conclusion Overall, the ‘Collar Base’ intervention design received the best usability ratings. Impact on Industry Intervention designs developed for overhead drilling may reduce shoulder fatigue and prevent subsequent musculoskeletal disorders. These designs may also be useful for other overhead work such as lifting and supporting materials (e.g., piping, ducts) that are installed near the ceiling. Workplace health and safety interventions may require multiple rounds of field-testing prior to achieving acceptable usability ratings by the end users. PMID:20630276

Applying heuristic evaluation to improve the usability of a telemedicine system.

PubMed

Tang, Zhihua; Johnson, Todd R; Tindall, R Douglas; Zhang, Jiajie

2006-02-01

The development of a telemedicine system should not only take advantage of technological advances but also pay close attention to users and the human issues involved. In this paper we examine the utility of heuristic evaluation in improving the usability of a digital emergency medical services (EMS) system equipped on an ambulance. The digital EMS system used advanced communication technologies to help remotely located trauma specialists gain access to patient data in real-time and direct life-saving measures in a timely fashion. To improve its usability, three experts inspected prototypes of the system according to 14 software usability heuristics. The analyses revealed information on the prevalence, severity, and nature of heuristic violations in the user interface design. The results were subsequently utilized to guide the iterative software design process. A comparison between two consecutive prototypes showed that the second design had only half as many usability violations as the first prototype and had considerable improvement in a number of usability heuristic categories. The validity of heuristic evaluation was examined in an ethnographic study of paramedics using a prototype of the system in their work environment. Users' task performances partially verified heuristic evaluation results. However, they also revealed problems that were not identified in heuristic evaluation but only became prominent during field observation. In conclusion, we argue that usability should be given high priority in the development of a telemedicine system, and that heuristic evaluation can be an effective and efficient way to identify usability problems in the early stage of software development.

Promoting Higher Order Thinking Skills via IPTEACES e-Learning Framework in the Learning of Information Systems Units

ERIC Educational Resources Information Center

Isaias, Pedro; Issa, Tomayess; Pena, Nuno

2014-01-01

When developing and working with various types of devices from a supercomputer to an iPod Mini, it is essential to consider the issues of Human Computer Interaction (HCI) and Usability. Developers and designers must incorporate HCI, Usability and user satisfaction in their design plans to ensure that systems are easy to learn, effective,…

The Post-Dam System. Volume 5. Harvard Project Manager (HPM).

DTIC Science & Technology

1992-10-01

cQllected and analyzed to determine structural integrity and usability. From this analysis, a repair schedule is developed. This is currently a time...information on mission-critical facility damage is collected and analyzed to determine structural integrity and usability. From this analysis, a repair...to determine repair strategies with an expert system, keep track of materials and equipment with a relational database management system, and

Quality of online information on type 2 diabetes: a cross-sectional study.

PubMed

Weymann, Nina; Härter, Martin; Dirmaier, Jörg

2015-12-01

Evidence-based health information is a prerequisite for patients with type 2 diabetes to engage in self-management and to make informed medical decisions. The Internet is an important source of health information. In the present study, we systematically assessed formal quality, quality of decision support and usability of German and English language websites on type 2 diabetes. The search term 'type 2 diabetes' was entered in the two most popular search engines. Descriptive data on website quality are presented. Additionally, associations between website quality and affiliation (commercial vs. non-commercial), presence of the HON code quality seal and website traffic were explored. Forty-six websites were included. Most websites provided basic information necessary for decision-making, while only one website also provided decision support. Websites with a HON code had significantly better formal quality than websites without HON code. We found a highly significant correlation between usability and website traffic and a significant correlation between formal quality and website traffic. Most websites do not provide sufficient information to support patients in medical decision-making. Our finding that usability and website traffic are tightly associated is consistent with previous research indicating that design is the most important cue for users assessing website credibility. © The Author (2014). Published by Oxford University Press. All rights reserved. For Permissions, please email: journals.permissions@oup.com.

Age-sensitive design of online health information: comparative usability study.

PubMed

Pak, Richard; Price, Margaux M; Thatcher, Jason

2009-11-16

Older adults' health maintenance may be enhanced by having access to online health information. However, usability issues may prevent older adults from easily accessing such information. Prior research has shown that aging is associated with a unique pattern of cognitive changes, and knowledge of these changes may be used in the design of health websites for older adults. The goal of the current study was to examine whether older adults use of a health information website was affected by an alternative information architecture and access interface (hierarchical versus tag-based). Fifty younger adults (aged 18-23) and 50 older adults (aged 60-80) navigated a health information website, which was organized hierarchically or used tags/keywords, to find answers to health-related questions while their performance was tracked. We hypothesized that older adults would perform better in the tag-based health information website because it placed greater demands on abilities that remain intact with aging (verbal ability and vocabulary). The pattern of age-related differences in computer use was consistent with prior research with older adults. We found that older adults had been using computers for less time (F(1,98)= 10.6, P= .002) and used them less often (F(1,98)= 11.3, P= .001) than younger adults. Also consistent with the cognitive aging literature, younger adults had greater spatial visualization and orientation abilities (F(1,98)= 34.6, P< .001 and F(1,98)= 6.8, P= .01) and a larger memory span (F(1,98)= 5.7, P= .02) than older adults, but older adults had greater vocabulary (F(1,98)= 11.4, P= .001). Older adults also took significantly more medications than younger adults (F(1,98)= 57.7, P< .001). In the information search task, older adults performed worse than younger adults (F(1,96)= 18.0, P< .001). However, there was a significant age x condition interaction indicating that while younger adults outperformed older adults in the hierarchical condition (F(1,96)= 25.2, P< .001), there were no significant age-related differences in the tag-based condition, indicating that older adults performed as well as younger adults in this condition. Access to online health information is increasing in popularity and can lead to a more informed health consumer. However, usability barriers may differentially affect older adults. The results of the current study suggest that the design of health information websites that take into account age-related changes in cognition can enhance older adults' access to such information.

Farmers' climate information needs for long-term adaptive decisions: A case study of almonds in CA

NASA Astrophysics Data System (ADS)

Jagannathan, K. A.; Jones, A. D.; Pathak, T. B.; Kerr, A. C.; Doll, D.

2016-12-01

Despite advances in climate modeling and projections, several sources report that current tools and models are not widely used in the agriculture sector. Farmers, depending on their local context, require information on very specific climatic metrics such as start of rains during the planting season, number of low temperature days during the growing season, etc. However, such specific climatic information is either not available, and/or is not synthesized and communicated in a manner that is accessible to these decision-makers. This research aims to bridge the gap between climate information and decision-making needs, by providing an improved understanding of what farmers' consider as relevant climate information, and how these needs compare with current modeling capabilities. Almond is a perennial crop, so any changes in climate within its 25-30 year lifetime can have an adverse impact on crop yield. This makes almond growers vulnerable to medium and long-term climate change. Hence, providing appropriate information on future climate projections can help guide their decisions on crop types & varieties, as well as management practices that are better adapted to future climatic conditions. Semi-structured exploratory interviews have been conducted with almond growers, farm advisors, and other industry stakeholders, with three goals: (1) to understand how growers have used climate information in the past; (2) to identify key climatic variables that are relevant - including appropriate temporal scales and acceptable uncertainty levels; and (3) to understand communication methods that could improve the usability of climate information for farm-level decision-making. The interviews showcased a great diversity amongst growers in terms of how they used weather/climate information. Discussions also indicated that there was a potential for climate information to impact long-term decisions, but only if it is provided within the right context, terminology, and communication channels. The findings offer valuable bottom-up insights into farmers' perspectives on relevance of climate information. These results will also be compared with current modeling capabilities in order to synthesize conclusions for improving the usability of climate science for agricultural decision-makers.

Human Factors for Nursing: From In-Situ Testing to Mobile Usability Engineering.

PubMed

Kushniruk, Andre W; Borycki, Elizabeth M; Solvoll, Terje; Hullin, Carola

2016-01-01

The tutorial goal is to familiarize participants with human aspects of health informatics and human-centered approaches to the design, evaluation and deployment of both usable and safe healthcare information systems. The focus will be on demonstrating and teaching practical and low-cost methods for evaluating mobile applications in nursing. Basic background to testing methods will be provided, followed by live demonstration of the methods. Then the audience will break into small groups to explore the application of the methods to applications of interest (there will be a number of possible applications that will be available for applications in areas such as electronic health records and decision support, however, if the groups have applications of specific interest to them that will be possible). The challenges of conducting usability testing, and in particular mobile usability testing will be discussed along with practical solutions. The target audience includes practicing nurses and nurse researchers, nursing informatics specialists, nursing students, nursing managers and health informatics professionals interested in improving the usability and safety of healthcare applications.

Adequate number of clinicians on usability tests lacking, says study.

PubMed

2015-12-01

A new study reveals that some of the largest EMR vendors failed to meet certification standards, specifying that they state their user-centered design processes, and that they include at least 15 representative end-user participants in their usability tests. It is not clear why these vendors were certified despite not meeting the standards established by Office of the National Coordinator for Health Information Technology (ONC), but investigators suggest that emergency clinicians and administrators should engage with vendors early on, querying them about their user-centered processes. An analysis of the usability tests performed by 41 of some the largest EMR vendors found that 34% of them did not meet certification standards, specifying that they state their user-centered design process. Also, 63% of the vendors failed to include at least 15 representative end-users in their usability tests. Only 15% of the vendors used at least 15 participants who had clinical backgrounds in their usability tests. Experts urge clinicians to engage with EMR user groups to share best practices for optimizing specific EMR products.

Evaluating the usability of speech recognition to create clinical documentation using a commercial electronic health record.

PubMed

Hodgson, Tobias; Magrabi, Farah; Coiera, Enrico

2018-05-01

To conduct a usability study exploring the value of using speech recognition (SR) for clinical documentation tasks within an electronic health record (EHR) system. Thirty-five emergency department clinicians completed a system usability scale (SUS) questionnaire. The study was undertaken after participants undertook randomly allocated clinical documentation tasks using keyboard and mouse (KBM) or SR. SUS scores were analyzed and the results with KBM were compared to SR results. Significant difference in SUS scores between EHR system use with and without SR were observed (KBM 67, SR 61; P = 0.045; CI, 0.1 to 12.0). Nineteen of 35 participants scored higher for EHR with KBM, 11 higher for EHR with SR and 5 gave the same score for both. Factor analysis showed no significant difference in scores for the sub-element of usability (EHR with KBM 65, EHR with SR 62; P = 0.255; CI, -2.6 to 9.5). Scores for the sub-element of learnability were significantly different (KBM 72, SR 55; P < 0.001; CI, 9.8 to 23.5). A significant correlation was found between the perceived usability of the two system configurations (EHR with KBM or SR) and the efficiency of documentation (time to document) (P = 0.002; CI, 10.5 to -0.1) but not with safety (number of errors) (P = 0.90; CI, -2.3 to 2.6). SR was associated with significantly reduced overall usability scores, even though it is often positioned as ease of use technology. SR was perceived to impose larger costs in terms of learnability via training and support requirements for EHR based documentation when compared to using KBM. Lower usability scores were significantly associated with longer documentation times. The usability of EHR systems with any input modality is an area that requires continued development. The addition of an SR component to an EHR system may cause a significant reduction in terms of perceived usability by clinicians. Copyright © 2018 Elsevier B.V. All rights reserved.

Usability Evaluation of an Unstructured Clinical Document Query Tool for Researchers.

PubMed

Hultman, Gretchen; McEwan, Reed; Pakhomov, Serguei; Lindemann, Elizabeth; Skube, Steven; Melton, Genevieve B

2018-01-01

Natural Language Processing - Patient Information Extraction for Researchers (NLP-PIER) was developed for clinical researchers for self-service Natural Language Processing (NLP) queries with clinical notes. This study was to conduct a user-centered analysis with clinical researchers to gain insight into NLP-PIER's usability and to gain an understanding of the needs of clinical researchers when using an application for searching clinical notes. Clinical researcher participants (n=11) completed tasks using the system's two existing search interfaces and completed a set of surveys and an exit interview. Quantitative data including time on task, task completion rate, and survey responses were collected. Interviews were analyzed qualitatively. Survey scores, time on task and task completion proportions varied widely. Qualitative analysis indicated that participants found the system to be useful and usable in specific projects. This study identified several usability challenges and our findings will guide the improvement of NLP-PIER 's interfaces.

A review of privacy and usability issues in mobile health systems: Role of external factors.

PubMed

Katusiime, Jane; Pinkwart, Niels

2017-10-01

The increased penetration of mobile devices has created opportunities in the health sector and led to emerging of mobile health systems. As much as the mobile health systems have registered tremendous progress, they have been faced with privacy and usability issues. Due to the sensitivity of health information, there is an ethical need to equip mobile health systems with adequate privacy measures. However, these systems should also be useable by the intended users. Even though many researchers are working on solutions, the issues still persist. External factors such as cultural differences have also contributed to the issues, yet they have been under researched. In this article, we conduct a systematic literature review of 22 articles, categorize and present privacy and usability issues and possible solutions. We then discuss the relevance and implications of external factors to the findings on privacy and usability. We end with recommendations to address these external factors.

The design and evaluation of an activity monitoring user interface for people with stroke.

PubMed

Hart, Phil; Bierwirth, Rebekah; Fulk, George; Sazonov, Edward

2014-01-01

Usability is an important topic in the field of telerehabilitation research. Older users with disabilities in particular, present age-related and disability-related challenges that should be accommodated for in the design of a user interface for a telerehabilitation system. This paper describes the design, implementation, and assessment of a telerehabilitation system user interface that tries to maximize usability for an elderly user who has experienced a stroke. An Internet-connected Nintendo(®) Wii™ gaming system is selected as a hardware platform, and a server and website are implemented to process and display the feedback information. The usability of the interface is assessed with a trial consisting of 18 subjects: 10 healthy Doctor of Physical Therapy students and 8 people with a stroke. Results show similar levels of usability and high satisfaction with the gaming system interface from both groups of subjects.

36 CFR 1193.33 - Information, documentation, and training.

Code of Federal Regulations, 2010 CFR

2010-07-01

... 36 Parks, Forests, and Public Property 3 2010-07-01 2010-07-01 false Information, documentation... Accessibility and Usability § 1193.33 Information, documentation, and training. (a) Manufacturers shall ensure access to information and documentation it provides to its customers. Such information and documentation...

Does Branding Need Web Usability? A Value-Oriented Empirical Study

NASA Astrophysics Data System (ADS)

Bolchini, Davide; Garzotto, Franca; Sorce, Fabio

Does usability of a web-based communication artifact affect brand, i.e., the set of beliefs, emotions, attitudes, or qualities that people mentally associate to the entity behind that artifact? Intuitively, the answer is “yes”: usability is a fundamental aspect of the quality of the experience with a website, and a “good” experience with a “product” or its reifications tends to translate into “good” brand perception. To date, however, the existence of a connection between web usability and brand perception is shown through anecdotic arguments, and is not supported by published systematic research. This paper discusses a study that empirically investigates this correlation in a more rigorous, analytical, and replicable way. Our main contribution is twofold: on the one hand, we provide empirical evidence to the heuristic principle that web usability influences branding, and we do that through four between subjects controlled experiments that involved 120 subjects. On the other hand, we inform the study with a systematic value-oriented approach to the user experience, and thus provide a conceptual framework that can be reused in other experimental settings, either for replicating our study, or for designing similar studies focusing on the correlation of web branding vs. design factors other than usability.

Evaluation of patient satisfaction with tailored online patient education information.

PubMed

Atack, Lynda; Luke, Robert; Chien, Elise

2008-01-01

Patients are using the Internet for access to standardized health information in ever-growing numbers. Although increased access to health information can be helpful, the quality of information varies widely. All too often, the information retrieved is incomplete, inaccurate, or inappropriate. An interdisciplinary team of clinicians, librarians, software engineers, and multimedia designers developed an online patient education system that enables clinicians to "prescribe" tailored, evidence-based health information. The system provides access to text and video that patients can adapt for language, vision, and hearing preferences. Usability testing was conducted with eight patients in a usability laboratory using the "think-aloud" method, surveys, and interviews. Results indicated that patients were highly satisfied and that the site has the potential to become a valuable resource in disease management. Patients made several recommendations regarding system appearance, function, and content that will have application for other groups developing online patient education systems.

Pilot climate data system

NASA Technical Reports Server (NTRS)

1985-01-01

A usable data base, the Pilot climate Data System (PCDS) is described. The PCDS is designed to be an interactive, easy-to-use, on-line generalized scientific information system. It efficiently provides uniform data catalogs; inventories, and access method, as well as manipulation and display tools for a large assortment of Earth, ocean and atmospheric data for the climate-related research community. Researchers can employ the PCDS to scan, manipulate, compare, display, and study climate parameters from diverse data sets. Software features, and applications of the PCDS are highlighted.

Evaluation of the Digital Alzheimer Center: Testing Usability and Usefulness of an Online Portal for Patients with Dementia and Their Carers.

PubMed

Hattink, Bart; Droes, Rose-Marie; Sikkes, Sietske; Oostra, Ellen; Lemstra, Afina W

2016-07-21

Dementia is a progressive and highly disabling neurodegenerative disease that will likely become highly prevalent in the future due to the globally aging population. To improve health care efficiency and quality for dementia care, eHealth could help with, for example, an online portal, such as the Digital Alzheimer Center (DAC) of the Vrije Universiteit Medical Center Amsterdam. It provides up-to-date disease information, peer-to-peer contact, and methods for contacting the hospital and health professionals. We aimed to investigate the usability and usefulness of the DAC for patients with dementia and carers to get insight into the feasibility and value of this eHealth app in dementia care and to recommend potential improvements. A descriptive study among patients, carers, and health care professionals was performed. Mixed methods were used, consisting of observations (n=10, 4 people with dementia, 6 carers), an online survey (n=287; 88 patients, 199 carers), and semistructured interviews (n=18; 6 patients, 6 carers, 6 health care professionals). During the observations, participants performed a set of five different prescribed tasks on the portal. Speed, number of errors, and navigation were noted. The online survey aimed to assess users' opinions on the portal's usability and usefulness. Semistructured interviews were conducted in a subsample of patients, carers, and health care professionals to gain more in-depth information. In the usability assessment, eight categories of errors were distinguished, of which three were of critical, two of medium, and three of low severity. In the survey, 45% (40/88) of the patients and 53% (105/199) of the carers indicated they used the portal. In all, 33% (12/36) of patients and 61% (62/102) of carers found it easy to learn to work with the portal. Most considered the DAC generally useful: 65% (17/26) of patients and 78% (67/86) of carers found the DAC useful, especially for understanding dementia (patients: 64%, 16/25; carers: 62%, 53/86). In the semistructured interviews, the site was generally rated positively on usability and usefulness and being well designed. People with dementia and carers indicated it helped them to understand and deal with dementia. To our knowledge, this is the first study investigating the usability and usefulness of an Internet portal especially designed for people with dementia and their carers. An online patient portal could be a useful means to help to support patients and carers in dealing with dementia: the majority of users positively evaluated usability and usefulness of the portal, and appreciated the information on it. However, only a minority of patients found it easy to work with the portal. Good design and frequent usability testing is essential to offer a good online portal.

Navigation in the electronic health record: A review of the safety and usability literature.

PubMed

Roman, Lisette C; Ancker, Jessica S; Johnson, Stephen B; Senathirajah, Yalini

2017-03-01

Inefficient navigation in electronic health records has been shown to increase users' cognitive load, which may increase potential for errors, reduce efficiency, and increase fatigue. However, navigation has received insufficient recognition and attention in the electronic health record (EHR) literature as an independent construct and contributor to overall usability. Our aims in this literature review were to (1) assess the prevalence of navigation-related topics within the EHR usability and safety research literature, (2) categorize types of navigation actions within the EHR, (3) capture relationships between these navigation actions and usability principles, and (4) collect terms and concepts related to EHR navigation. Our goal was to improve access to navigation-related research in usability. We applied scoping literature review search methods with the assistance of a reference librarian to identify articles published since 1996 that reported evaluation of the usability or safety of an EHR user interface via user test, analytic methods, or inspection methods. The 4336 references collected from MEDLINE, EMBASE, Engineering Village, and expert referrals were de-duplicated and screened for relevance, and navigation-related concepts were abstracted from the 21 articles eligible for review using a standard abstraction form. Of the 21 eligible articles, 20 (95%) mentioned navigation in results and discussion of usability evaluations. Navigation between pages of the EHR was the more frequently documented type of navigation (86%) compared to navigation within a single page (14%). Navigation actions (e.g., scrolling through a medication list) were frequently linked to specific usability heuristic violations, among which flexibility and efficiency of use, recognition rather than recall, and error prevention were most common. Discussion of navigation was prevalent in results across all types of evaluation methods among the articles reviewed. Navigating between multiple screens was frequently identified as a usability barrier. The lack of standard terminology created some challenges to identifying and comparing articles. We observed that usability researchers are frequently capturing navigation-related issues even in articles that did not explicitly state navigation as a focus. Capturing and synthesizing the literature on navigation is challenging because of the lack of uniform vocabulary. Navigation is a potential target for normative recommendations for improved interaction design for safer systems. Future research in this domain, including development of normative recommendations for usability design and evaluation, will be facilitated by development of a standard terminology for describing EHR navigation. Copyright © 2017 Elsevier Inc. All rights reserved.

Using the Retrospective Pretest to Get Usable, Indirect Evidence of Student Learning

ERIC Educational Resources Information Center

Coulter, Shannon E.

2012-01-01

Minimal evidence exists regarding the retrospective pretest's effectiveness as a tool to obtain usable, indirect evidence of student learning in open admissions institutions. The researcher conducted this study to determine if a retrospective pretest more accurately detected a change in students' knowledge compared to a conventional…

Evaluating patient-reported outcome measurement comparability between paper and alternate versions, using the lung function questionnaire as an example.

PubMed

Dalal, Anand A; Nelson, Lauren; Gilligan, Theresa; McLeod, Lori; Lewis, Sandy; DeMuro-Mercon, Carla

2011-01-01

The goal of this study was to provide recommended steps to assess measurement comparability using a crossover study design and to demonstrate these steps using a short patient-reported outcome (PRO) instrument as an example. The example PRO instrument was administered via paper, Web, interactive voice response system, and interview; a randomized crossover design was used to gather data across the multiple administration types. Participants completed the PRO instrument, demographic and health questions, and a short preference questionnaire. Evaluation included comparisons of the item-level responses and agreement, comparison of mean scale scores, score classifications, and questions designed to collect usability and administration preference. Here the authors provide a four-step evaluation guide to evaluate measurement comparability and illustrate these steps using a case-finding tool. In the example, item-level kappa statistics between the paper and the alternate versions ranged from good to excellent, intraclass correlation coefficient for mean scores were above 0.70, and the rate of disagreement ranged from 2% to 14%. In addition, although participants had an administration preference, they reported few difficulties with the versions they were assigned. The steps described in this article provide a guide for evaluating whether to combine scores across administration versions to simplify analyses and interpretation under a crossover design. The guide recommends the investigation of item-level responses, summary scores, and participant usability/preference when comparing versions, with each step providing unique information to support comprehensive evaluation and informed decisions regarding whether to combine data. Copyright © 2011 International Society for Pharmacoeconomics and Outcomes Research (ISPOR). Published by Elsevier Inc. All rights reserved.

A Hypermedia Representation of a Taxonomy of Usability Characteristics in Virtual Environments

DTIC Science & Technology

2003-03-01

user, organization, and social workflow; needs analysis; and user modeling. A user task analysis generates critical information used throughout all...exist specific to VE user interaction [Gabbard and others, 1999]. Typically more than one person performs guidelines-based evaluations, since it’s...unlikely that any one person could identify all if not most of an interaction design’s usability problems. Nielsen [1994] recommends three to five

A Study on the Usability of a University Registrar's Office Website through the Methods of Authentic Tasks and Eye-Tracking

ERIC Educational Resources Information Center

Tuzun, Hakan; Akinci, Ahmet; Kurtoglu, Meltem; Atal, Deniz; Pala, Ferkat Kadir

2013-01-01

Universities are one of the most important institutions that offer online services. It is observed that one of the most used web pages by university students is the registrar's office website, since students can access a great deal of information they need through this page. In this study, the usability of the registrar's office website, which can…

Enabling the Usability of Earth Science Data Products and Services by Evaluating, Describing, and Improving Data Quality throughout the Data Lifecycle

NASA Astrophysics Data System (ADS)

Downs, R. R.; Peng, G.; Wei, Y.; Ramapriyan, H.; Moroni, D. F.

2015-12-01

Earth science data products and services are being used by representatives of various science and social science disciplines, by planning and decision-making professionals, by educators and learners ranging from primary through graduate and informal education, and by the general public. The diversity of users and uses of Earth science data is gratifying and offers new challenges for enabling the usability of these data by audiences with various purposes and levels of expertise. Users and other stakeholders need capabilities to efficiently find, explore, select, and determine the applicability and suitability of data products and services to meet their objectives and information needs. Similarly, they need to be able to understand the limitations of Earth science data, which can be complex, especially when considering combined or simultaneous use of multiple data products and services. Quality control efforts of stakeholders, throughout the data lifecycle, can contribute to the usability of Earth science data to meet the needs of diverse users. Such stakeholders include study design teams, data producers, data managers and curators, archives, systems professionals, data distributors, end-users, intermediaries, sponsoring organizations, hosting institutions, and others. Opportunities for engaging stakeholders to review, describe, and improve the quality of Earth science data products and services throughout the data lifecycle are identified and discussed. Insight is shared from the development of guidelines for implementing the Group on Earth Observations (GEO) Data Management Principles, the recommendations from the Earth Science Data System Working Group (ESDSWG) on Data Quality, and the efforts of the Information Quality Cluster of the Federation of Earth Science Information Partners (ESIP). Examples and outcomes from quality control efforts of data facilities, such as scientific data centers, that contribute to the usability of Earth science data also are offered.

Computerized Management Information and Reporting Systems for Sponsored Projects.

ERIC Educational Resources Information Center

Rodman, John A.; Peters, Carl M.

1980-01-01

The effective management of the university depends on the research office providing usable, accurate, timely, and accessible information regarding sponsored programs. The utilization of automated systems to store, access, and manage information is seen as essential. (MLW)

Mobile applications for diabetics: a systematic review and expert-based usability evaluation considering the special requirements of diabetes patients age 50 years or older.

PubMed

Arnhold, Madlen; Quade, Mandy; Kirch, Wilhelm

2014-04-09

A multitude of mhealth (mobile health) apps have been developed in recent years to support effective self-management of patients with diabetes mellitus type 1 or 2. We carried out a systematic review of all currently available diabetes apps for the operating systems iOS and Android. We considered the number of newly released diabetes apps, range of functions, target user groups, languages, acquisition costs, user ratings, available interfaces, and the connection between acquisition costs and user ratings. Additionally, we examined whether the available applications serve the special needs of diabetes patients aged 50 or older by performing an expert-based usability evaluation. We identified relevant keywords, comparative categories, and their specifications. Subsequently, we performed the app review based on the information given in the Google Play Store, the Apple App Store, and the apps themselves. In addition, we carried out an expert-based usability evaluation based on a representative 10% sample of diabetes apps. In total, we analyzed 656 apps finding that 355 (54.1%) offered just one function and 348 (53.0%) provided a documentation function. The dominating app language was English (85.4%, 560/656), patients represented the main user group (96.0%, 630/656), and the analysis of the costs revealed a trend toward free apps (53.7%, 352/656). The median price of paid apps was €1.90. The average user rating was 3.6 stars (maximum 5). Our analyses indicated no clear differences in the user rating between free and paid apps. Only 30 (4.6%) of the 656 available diabetes apps offered an interface to a measurement device. We evaluated 66 apps within the usability evaluation. On average, apps were rated best regarding the criterion "comprehensibility" (4.0 out of 5.0), while showing a lack of "fault tolerance" (2.8 out of 5.0). Of the 66 apps, 48 (72.7%) offered the ability to read the screen content aloud. The number of functions was significantly negative correlated with usability. The presence of documentation and analysis functions reduced the usability score significantly by 0.36 and 0.21 points. A vast number of diabetes apps already exist, but the majority offer similar functionalities and combine only one to two functions in one app. Patients and physicians alike should be involved in the app development process to a greater extent. We expect that the data transmission of health parameters to physicians will gain more importance in future applications. The usability of diabetes apps for patients aged 50 or older was moderate to good. But this result applied mainly to apps offering a small range of functions. Multifunctional apps performed considerably worse in terms of usability. Moreover, the presence of a documentation or analysis function resulted in significantly lower usability scores. The operability of accessibility features for diabetes apps was quite limited, except for the feature "screen reader".

Applying Human Factors Principles to Mitigate Usability Issues Related to Embedded Assumptions in Health Information Technology Design

PubMed Central

Lowry, Svetlana Z; Patterson, Emily S

2014-01-01

Background There is growing recognition that design flaws in health information technology (HIT) lead to increased cognitive work, impact workflows, and produce other undesirable user experiences that contribute to usability issues and, in some cases, patient harm. These usability issues may in turn contribute to HIT utilization disparities and patient safety concerns, particularly among “non-typical” HIT users and their health care providers. Health care disparities are associated with poor health outcomes, premature death, and increased health care costs. HIT has the potential to reduce these disparate outcomes. In the computer science field, it has long been recognized that embedded cultural assumptions can reduce the usability, usefulness, and safety of HIT systems for populations whose characteristics differ from “stereotypical” users. Among these non-typical users, inappropriate embedded design assumptions may contribute to health care disparities. It is unclear how to address potentially inappropriate embedded HIT design assumptions once detected. Objective The objective of this paper is to explain HIT universal design principles derived from the human factors engineering literature that can help to overcome potential usability and/or patient safety issues that are associated with unrecognized, embedded assumptions about cultural groups when designing HIT systems. Methods Existing best practices, guidance, and standards in software usability and accessibility were subjected to a 5-step expert review process to identify and summarize those best practices, guidance, and standards that could help identify and/or address embedded design assumptions in HIT that could negatively impact patient safety, particularly for non-majority HIT user populations. An iterative consensus-based process was then used to derive evidence-based design principles from the data to address potentially inappropriate embedded cultural assumptions. Results Design principles that may help identify and address embedded HIT design assumptions are available in the existing literature. Conclusions Evidence-based HIT design principles derived from existing human factors and informatics literature can help HIT developers identify and address embedded cultural assumptions that may underlie HIT-associated usability and patient safety concerns as well as health care disparities. PMID:27025349

Applying Human Factors Principles to Mitigate Usability Issues Related to Embedded Assumptions in Health Information Technology Design.

PubMed

Gibbons, Michael C; Lowry, Svetlana Z; Patterson, Emily S

2014-12-18

There is growing recognition that design flaws in health information technology (HIT) lead to increased cognitive work, impact workflows, and produce other undesirable user experiences that contribute to usability issues and, in some cases, patient harm. These usability issues may in turn contribute to HIT utilization disparities and patient safety concerns, particularly among "non-typical" HIT users and their health care providers. Health care disparities are associated with poor health outcomes, premature death, and increased health care costs. HIT has the potential to reduce these disparate outcomes. In the computer science field, it has long been recognized that embedded cultural assumptions can reduce the usability, usefulness, and safety of HIT systems for populations whose characteristics differ from "stereotypical" users. Among these non-typical users, inappropriate embedded design assumptions may contribute to health care disparities. It is unclear how to address potentially inappropriate embedded HIT design assumptions once detected. The objective of this paper is to explain HIT universal design principles derived from the human factors engineering literature that can help to overcome potential usability and/or patient safety issues that are associated with unrecognized, embedded assumptions about cultural groups when designing HIT systems. Existing best practices, guidance, and standards in software usability and accessibility were subjected to a 5-step expert review process to identify and summarize those best practices, guidance, and standards that could help identify and/or address embedded design assumptions in HIT that could negatively impact patient safety, particularly for non-majority HIT user populations. An iterative consensus-based process was then used to derive evidence-based design principles from the data to address potentially inappropriate embedded cultural assumptions. Design principles that may help identify and address embedded HIT design assumptions are available in the existing literature. Evidence-based HIT design principles derived from existing human factors and informatics literature can help HIT developers identify and address embedded cultural assumptions that may underlie HIT-associated usability and patient safety concerns as well as health care disparities.

The Accessibility, Usability, and Reliability of Chinese Web-Based Information on HIV/AIDS.

PubMed

Niu, Lu; Luo, Dan; Liu, Ying; Xiao, Shuiyuan

2016-08-20

The present study was designed to assess the quality of Chinese-language Internet-based information on HIV/AIDS. We entered the following search terms, in Chinese, into Baidu and Sogou: "HIV/AIDS", "symptoms", and "treatment", and evaluated the first 50 hits of each query using the Minervation validation instrument (LIDA tool) and DISCERN instrument. Of the 900 hits identified, 85 websites were included in this study. The overall score of the LIDA tool was 63.7%; the mean score of accessibility, usability, and reliability was 82.2%, 71.5%, and 27.3%, respectively. Of the top 15 sites according to the LIDA score, the mean DISCERN score was calculated at 43.1 (95% confidence intervals (CI) = 37.7-49.5). Noncommercial websites showed higher DISCERN scores than commercial websites; whereas commercial websites were more likely to be found in the first 20 links obtained from each search engine than the noncommercial websites. In general, the HIV/AIDS related Chinese-language websites have poor reliability, although their accessibility and usability are fair. In addition, the treatment information presented on Chinese-language websites is far from sufficient. There is an imperative need for professionals and specialized institutes to improve the comprehensiveness of web-based information related to HIV/AIDS.

The Accessibility, Usability, and Reliability of Chinese Web-Based Information on HIV/AIDS

PubMed Central

Niu, Lu; Luo, Dan; Liu, Ying; Xiao, Shuiyuan

2016-01-01

Objective: The present study was designed to assess the quality of Chinese-language Internet-based information on HIV/AIDS. Methods: We entered the following search terms, in Chinese, into Baidu and Sogou: “HIV/AIDS”, “symptoms”, and “treatment”, and evaluated the first 50 hits of each query using the Minervation validation instrument (LIDA tool) and DISCERN instrument. Results: Of the 900 hits identified, 85 websites were included in this study. The overall score of the LIDA tool was 63.7%; the mean score of accessibility, usability, and reliability was 82.2%, 71.5%, and 27.3%, respectively. Of the top 15 sites according to the LIDA score, the mean DISCERN score was calculated at 43.1 (95% confidence intervals (CI) = 37.7–49.5). Noncommercial websites showed higher DISCERN scores than commercial websites; whereas commercial websites were more likely to be found in the first 20 links obtained from each search engine than the noncommercial websites. Conclusions: In general, the HIV/AIDS related Chinese-language websites have poor reliability, although their accessibility and usability are fair. In addition, the treatment information presented on Chinese-language websites is far from sufficient. There is an imperative need for professionals and specialized institutes to improve the comprehensiveness of web-based information related to HIV/AIDS. PMID:27556475

Applying User-Centered Design Methods to the Development of an mHealth Application for Use in the Hospital Setting by Patients and Care Partners.

PubMed

Couture, Brittany; Lilley, Elizabeth; Chang, Frank; DeBord Smith, Ann; Cleveland, Jessica; Ergai, Awatef; Katsulis, Zachary; Benneyan, James; Gershanik, Esteban; Bates, David W; Collins, Sarah A

2018-04-01

 Developing an optimized and user-friendly mHealth application for patients and family members in the hospital environment presents unique challenges given the diverse patient population and patients' various states of well-being.  This article describes user-centered design methods and results for developing the patient and family facing user interface and functionality of MySafeCare, a safety reporting tool for hospitalized patients and their family members.  Individual and group usability sessions were conducted with specific testing scenarios for participants to follow to test the usability and functionality of the tool. Participants included patients, family members, and Patient and Family Advisory Council (PFAC) members. Engagement rounds were also conducted on study units and lessons learned provided additional information to the usability work. Usability results were aligned with Nielsen's Usability Heuristics.  Eleven patients and family members and 25 PFAC members participated in usability testing and over 250 patients and family members were engaged during research team rounding. Specific themes resulting from the usability testing sessions influenced the changes made to the user interface design, workflow functionality, and terminology.  User-centered design should focus on workflow functionality, terminology, and user interface issues for mHealth applications. These themes illustrated issues aligned with four of Nielsen's Usability Heuristics: match between system and the real world, consistency and standards, flexibility and efficiency of use, and aesthetic and minimalist design. We identified workflow and terminology issues that may be specific to the use of an mHealth application focused on safety and used by hospitalized patients and their families. Schattauer GmbH Stuttgart.

Quantifying usability: an evaluation of a diabetes mHealth system on effectiveness, efficiency, and satisfaction metrics with associated user characteristics.

PubMed

Georgsson, Mattias; Staggers, Nancy

2016-01-01

Mobile health (mHealth) systems are becoming more common for chronic disease management, but usability studies are still needed on patients' perspectives and mHealth interaction performance. This deficiency is addressed by our quantitative usability study of a mHealth diabetes system evaluating patients' task performance, satisfaction, and the relationship of these measures to user characteristics. We used metrics in the International Organization for Standardization (ISO) 9241-11 standard. After standardized training, 10 patients performed representative tasks and were assessed on individual task success, errors, efficiency (time on task), satisfaction (System Usability Scale [SUS]) and user characteristics. Tasks of exporting and correcting values proved the most difficult, had the most errors, the lowest task success rates, and consumed the longest times on task. The average SUS satisfaction score was 80.5, indicating good but not excellent system usability. Data trends showed males were more successful in task completion, and younger participants had higher performance scores. Educational level did not influence performance, but a more recent diabetes diagnosis did. Patients with more experience in information technology (IT) also had higher performance rates. Difficult task performance indicated areas for redesign. Our methods can assist others in identifying areas in need of improvement. Data about user background and IT skills also showed how user characteristics influence performance and can provide future considerations for targeted mHealth designs. Using the ISO 9241-11 usability standard, the SUS instrument for satisfaction and measuring user characteristics provided objective measures of patients' experienced usability. These could serve as an exemplar for standardized, quantitative methods for usability studies on mHealth systems. © The Author 2015. Published by Oxford University Press on behalf of the American Medical Informatics Association.

Towards Usable E-Health. A Systematic Review of Usability Questionnaires.

PubMed

Sousa, Vanessa E C; Dunn Lopez, Karen

2017-05-10

The use of e-health can lead to several positive outcomes. However, the potential for e-health to improve healthcare is partially dependent on its ease of use. In order to determine the usability for any technology, rigorously developed and appropriate measures must be chosen. To identify psychometrically tested questionnaires that measure usability of e-health tools, and to appraise their generalizability, attributes coverage, and quality. We conducted a systematic review of studies that measured usability of e-health tools using four databases (Scopus, PubMed, CINAHL, and HAPI). Non-primary research, studies that did not report measures, studies with children or people with cognitive limitations, and studies about assistive devices or medical equipment were systematically excluded. Two authors independently extracted information including: questionnaire name, number of questions, scoring method, item generation, and psychometrics using a data extraction tool with pre-established categories and a quality appraisal scoring table. Using a broad search strategy, 5,558 potentially relevant papers were identified. After removing duplicates and applying exclusion criteria, 35 articles remained that used 15 unique questionnaires. From the 15 questionnaires, only 5 were general enough to be used across studies. Usability attributes covered by the questionnaires were: learnability (15), efficiency (12), and satisfaction (11). Memorability (1) was the least covered attribute. Quality appraisal showed that face/content (14) and construct (7) validity were the most frequent types of validity assessed. All questionnaires reported reliability measurement. Some questionnaires scored low in the quality appraisal for the following reasons: limited validity testing (7), small sample size (3), no reporting of user centeredness (9) or feasibility estimates of time, effort, and expense (7). Existing questionnaires provide a foundation for research on e-health usability. However, future research is needed to broaden the coverage of the usability attributes and psychometric properties of the available questionnaires.

Usability and feasibility of health IT interventions to enhance Self-Care for Lymphedema Symptom Management in breast cancer survivors.

PubMed

Fu, Mei R; Axelrod, Deborah; Guth, Amber A; Wang, Yao; Scagliola, Joan; Hiotis, Karen; Rampertaap, Kavita; El-Shammaa, Nardin

2016-09-01

The-Optimal-Lymph-Flow health IT system (TOLF) is a patient-centered, web-and-mobile-based educational and behavioral health IT system focusing on safe, innovative, and pragmatic self-care strategies for lymphedema symptom management. The purpose of this study was to evaluate usability, feasibility, and acceptability of TOLF among the end-user of breast cancer survivors. Two types of usability testing were completed with 30 breast cancer survivors: heuristic evaluation and end-user testing. Each participant was asked to think aloud while completing a set of specified tasks designed to explicate and freely explore the system features. A heuristic evaluation checklist, the Perceived Ease of Use and Usefulness Questionnaire, and The Post Study System Usability Questionnaire were used to evaluate usability of the system. Open-ended questions were used to gather qualitative data. Quantitative data were analyzed using descriptive statistics and qualitative data were summarized thematically. Breast cancer survivors were very satisfied with the system: 90% (n = 27) rated the system having no usability problems; 10% (n = 3) noted minor cosmetic problems: spelling errors or text font size. The majority of participants 96.6% (n = 29) strongly agreed that the system was easy to use and effective in helping to learn about lymphedema, symptoms and self-care strategies. Themes from the qualitative data included empowerment, high quality information, loving avatar simulation videos, easy accessibility, and user-friendliness. This usability study provided evidence on breast cancer survivor's acceptance and highly positive evaluation of TOLF's usability as well as feasibility of using technologically-driven delivery model to enhance self-care strategies for lymphedema symptom management.

Quantifying usability: an evaluation of a diabetes mHealth system on effectiveness, efficiency, and satisfaction metrics with associated user characteristics

PubMed Central

Staggers, Nancy

2016-01-01

Objective Mobile health (mHealth) systems are becoming more common for chronic disease management, but usability studies are still needed on patients’ perspectives and mHealth interaction performance. This deficiency is addressed by our quantitative usability study of a mHealth diabetes system evaluating patients’ task performance, satisfaction, and the relationship of these measures to user characteristics. Materials and Methods We used metrics in the International Organization for Standardization (ISO) 9241-11 standard. After standardized training, 10 patients performed representative tasks and were assessed on individual task success, errors, efficiency (time on task), satisfaction (System Usability Scale [SUS]) and user characteristics. Results Tasks of exporting and correcting values proved the most difficult, had the most errors, the lowest task success rates, and consumed the longest times on task. The average SUS satisfaction score was 80.5, indicating good but not excellent system usability. Data trends showed males were more successful in task completion, and younger participants had higher performance scores. Educational level did not influence performance, but a more recent diabetes diagnosis did. Patients with more experience in information technology (IT) also had higher performance rates. Discussion Difficult task performance indicated areas for redesign. Our methods can assist others in identifying areas in need of improvement. Data about user background and IT skills also showed how user characteristics influence performance and can provide future considerations for targeted mHealth designs. Conclusion Using the ISO 9241-11 usability standard, the SUS instrument for satisfaction and measuring user characteristics provided objective measures of patients’ experienced usability. These could serve as an exemplar for standardized, quantitative methods for usability studies on mHealth systems. PMID:26377990

Development and usability testing of a web-based decision support for users and health professionals in psychiatric services.

PubMed

Grim, Katarina; Rosenberg, David; Svedberg, Petra; Schön, Ulla-Karin

2017-09-01

Shared decision making (SMD) related to treatment and rehabilitation is considered a central component in recovery-oriented practice. Although decision aids are regarded as an essential component for successfully implementing SDM, these aids are often lacking within psychiatric services. The aim of this study was to use a participatory design to facilitate the development of a user-generated, web-based decision aid for individuals receiving psychiatric services. The results of this effort as well as the lessons learned during the development and usability processes are reported. The participatory design included 4 iterative cycles of development. Various qualitative methods for data collection were used with potential end users participating as informants in focus group and individual interviews and as usability and pilot testers. Interviewing and testing identified usability problems that then led to refinements and making the subsequent prototypes increasingly user-friendly and relevant. In each phase of the process, feedback from potential end-users provided guidance in developing the formation of the web-based decision aid that strengthens the position of users by integrating access to information regarding alternative supports, interactivity between staff and users, and user preferences as a continual focus in the tool. This web-based decision aid has the potential to strengthen service users' experience of self-efficacy and control as well as provide staff access to user knowledge and preferences. Studies employing participatory models focusing on usability have potential to significantly contribute to the development and implementation of tools that reflect user perspectives. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

The effect of touch-key size on the usability of In-Vehicle Information Systems and driving safety during simulated driving.

PubMed

Kim, Heejin; Kwon, Sunghyuk; Heo, Jiyoon; Lee, Hojin; Chung, Min K

2014-05-01

Investigating the effect of touch-key size on usability of In-Vehicle Information Systems (IVISs) is one of the most important research issues since it is closely related to safety issues besides its usability. This study investigated the effects of the touch-key size of IVISs with respect to safety issues (the standard deviation of lane position, the speed variation, the total glance time, the mean glance time, the mean time between glances, and the mean number of glances) and the usability of IVISs (the task completion time, error rate, subjective preference, and NASA-TLX) through a driving simulation. A total of 30 drivers participated in the task of entering 5-digit numbers with various touch-key sizes while performing simulated driving. The size of the touch-key was 7.5 mm, 12.5 mm, 17.5 mm, 22.5 mm and 27.5 mm, and the speed of driving was set to 0 km/h (stationary state), 50 km/h and 100 km/h. As a result, both the driving safety and the usability of the IVISs increased as the touch-key size increased up to a certain size (17.5 mm in this study), at which they reached asymptotes. We performed Fitts' law analysis of our data, and this revealed that the data from the dual task experiment did not follow Fitts' law. Copyright © 2013 Elsevier Ltd and The Ergonomics Society. All rights reserved.

Usability Assessment of Secure Messaging for Clinical Document Sharing between Health Care Providers and Patients.

PubMed

Jahn, Michelle A; Porter, Brian W; Patel, Himalaya; Zillich, Alan J; Simon, Steven R; Russ, Alissa L

2018-04-01

 Web-based patient portals feature secure messaging systems that enable health care providers and patients to communicate information. However, little is known about the usability of these systems for clinical document sharing.  This article evaluates the usability of a secure messaging system for providers and patients in terms of its ability to support sharing of electronic clinical documents.  We conducted usability testing with providers and patients in a human-computer interaction laboratory at a Midwestern U.S. hospital. Providers sent a medication list document to a fictitious patient via secure messaging. Separately, patients retrieved the clinical document from a secure message and returned it to a fictitious provider. We collected use errors, task completion, task time, and satisfaction.  Twenty-nine individuals participated: 19 providers (6 physicians, 6 registered nurses, and 7 pharmacists) and 10 patients. Among providers, 11 (58%) attached and sent the clinical document via secure messaging without requiring assistance, in a median (range) of 4.5 (1.8-12.7) minutes. No patients completed tasks without moderator assistance. Patients accessed the secure messaging system within 3.6 (1.2-15.0) minutes; retrieved the clinical document within 0.8 (0.5-5.7) minutes; and sent the attached clinical document in 6.3 (1.5-18.1) minutes. Although median satisfaction ratings were high, with 5.8 for providers and 6.0 for patients (scale, 0-7), we identified 36 different use errors. Physicians and pharmacists requested additional features to support care coordination via health information technology, while nurses requested features to support efficiency for their tasks.  This study examined the usability of clinical document sharing, a key feature of many secure messaging systems. Our results highlight similarities and differences between provider and patient end-user groups, which can inform secure messaging design to improve learnability and efficiency. The observations suggest recommendations for improving the technical aspects of secure messaging for clinical document sharing. Schattauer GmbH Stuttgart.

From expert-derived user needs to user-perceived ease of use and usefulness: a two-phase mixed-methods evaluation framework.

PubMed

Boland, Mary Regina; Rusanov, Alexander; So, Yat; Lopez-Jimenez, Carlos; Busacca, Linda; Steinman, Richard C; Bakken, Suzanne; Bigger, J Thomas; Weng, Chunhua

2014-12-01

Underspecified user needs and frequent lack of a gold standard reference are typical barriers to technology evaluation. To address this problem, this paper presents a two-phase evaluation framework involving usability experts (phase 1) and end-users (phase 2). In phase 1, a cross-system functionality alignment between expert-derived user needs and system functions was performed to inform the choice of "the best available" comparison system to enable a cognitive walkthrough in phase 1 and a comparative effectiveness evaluation in phase 2. During phase 2, five quantitative and qualitative evaluation methods are mixed to assess usability: time-motion analysis, software log, questionnaires - System Usability Scale and the Unified Theory of Acceptance of Use of Technology, think-aloud protocols, and unstructured interviews. Each method contributes data for a unique measure (e.g., time motion analysis contributes task-completion-time; software log contributes action transition frequency). The measures are triangulated to yield complementary insights regarding user-perceived ease-of-use, functionality integration, anxiety during use, and workflow impact. To illustrate its use, we applied this framework in a formative evaluation of a software called Integrated Model for Patient Care and Clinical Trials (IMPACT). We conclude that this mixed-methods evaluation framework enables an integrated assessment of user needs satisfaction and user-perceived usefulness and usability of a novel design. This evaluation framework effectively bridges the gap between co-evolving user needs and technology designs during iterative prototyping and is particularly useful when it is difficult for users to articulate their needs for technology support due to the lack of a baseline. Copyright © 2013 Elsevier Inc. All rights reserved.

Analysis of the Quality of Information Obtained About Uterine Artery Embolization From the Internet

DOE Office of Scientific and Technical Information (OSTI.GOV)

Tavare, Aniket N.; Alsafi, Ali, E-mail: ali.alsafi03@imperial.ac.uk; Hamady, Mohamad S.

Purpose: The Internet is widely used by patients to source health care-related information. We sought to analyse the quality of information available on the Internet about uterine artery embolization (UAE). Materials and Methods: We searched three major search engines for the phrase 'uterine artery embolization' and compiled the top 50 results from each engine. After excluding repeated sites, scientific articles, and links to documents, the remaining 50 sites were assessed using the LIDA instrument, which scores sites across the domains of accessibility, usability, and reliability. The Fleisch reading ease score (FRES) was calculated for each of the sites. Finally, wemore » checked the country of origin and the presence of certification by the Health On the Net Foundation (HONcode) as well as their effect on LIDA and FRES scores.ResultsThe following mean scores were obtained: accessibility 48/60 (80%), usability 42/54 (77%), reliability 20/51 (39%), total LIDA 110/165 (67%), and FRES 42/100 (42%). Nine sites had HONcode certification, and this was associated with significantly greater (p < 0.05) reliability and total LIDA and FRES scores. When comparing sites between United Kingdom and United States, there was marked variation in the quality of results obtained when searching for information on UAE (p < 0.05). Conclusion: In general, sites were well designed and easy to use. However, many scored poorly on the reliability of their information either because they were produced in a non-evidence-based way or because they lacking currency. It is important that patients are guided to reputable, location-specific sources of information online, especially because prominent search engine rank does not guarantee reliability of information.« less

The usability of ventilators: a comparative evaluation of use safety and user experience.

PubMed

Morita, Plinio P; Weinstein, Peter B; Flewwelling, Christopher J; Bañez, Carleene A; Chiu, Tabitha A; Iannuzzi, Mario; Patel, Aastha H; Shier, Ashleigh P; Cafazzo, Joseph A

2016-08-20

The design complexity of critical care ventilators (CCVs) can lead to use errors and patient harm. In this study, we present the results of a comparison of four CCVs from market leaders, using a rigorous methodology for the evaluation of use safety and user experience of medical devices. We carried out a comparative usability study of four CCVs: Hamilton G5, Puritan Bennett 980, Maquet SERVO-U, and Dräger Evita V500. Forty-eight critical care respiratory therapists participated in this fully counterbalanced, repeated measures study. Participants completed seven clinical scenarios composed of 16 tasks on each ventilator. Use safety was measured by percentage of tasks with use errors or close calls (UE/CCs). User experience was measured by system usability and workload metrics, using the Post-Study System Usability Questionnaire (PSSUQ) and the National Aeronautics and Space Administration Task Load Index (NASA-TLX). Nine of 18 post hoc contrasts between pairs of ventilators were significant after Bonferroni correction, with effect sizes between 0.4 and 1.09 (Cohen's d). There were significantly fewer UE/CCs with SERVO-U when compared to G5 (p = 0.044) and V500 (p = 0.020). Participants reported higher system usability for G5 when compared to PB980 (p = 0.035) and higher system usability for SERVO-U when compared to G5 (p < 0.001), PB980 (p < 0.001), and V500 (p < 0.001). Participants reported lower workload for G5 when compared to PB980 (p < 0.001) and lower workload for SERVO-U when compared to PB980 (p < 0.001) and V500 (p < 0.001). G5 scored better on two of nine possible comparisons; SERVO-U scored better on seven of nine possible comparisons. Aspects influencing participants' performance and perception include the low sensitivity of G5's touchscreen and the positive effect from the quality of SERVO-U's user interface design. This study provides empirical evidence of how four ventilators from market leaders compare and highlights the importance of medical technology design. Within the boundaries of this study, we can infer that SERVO-U demonstrated the highest levels of use safety and user experience, followed by G5. Based on qualitative data, differences in outcomes could be explained by interaction design, quality of hardware components used in manufacturing, and influence of consumer product technology on users' expectations.

ServAR: An augmented reality tool to guide the serving of food.

PubMed

Rollo, Megan E; Bucher, Tamara; Smith, Shamus P; Collins, Clare E

2017-05-12

Accurate estimation of food portion size is a difficult task. Visual cues are important mediators of portion size and therefore technology-based aids may assist consumers when serving and estimating food portions. The current study evaluated the usability and impact on estimation error of standard food servings of a novel augmented reality food serving aid, ServAR. Participants were randomised into one of three groups: 1) no information/aid (control); 2) verbal information on standard serving sizes; or 3) ServAR, an aid which overlayed virtual food servings over a plate using a tablet computer. Participants were asked to estimate the standard serving sizes of nine foods (broccoli, carrots, cauliflower, green beans, kidney beans, potato, pasta, rice, and sweetcorn) using validated food replicas. Wilcoxon signed-rank tests compared median served weights of each food to reference standard serving size weights. Percentage error was used to compare the estimation of serving size accuracy between the three groups. All participants also performed a usability test using the ServAR tool to guide the serving of one randomly selected food. Ninety adults (78.9% female; a mean (95%CI) age 25.8 (24.9-26.7) years; BMI 24.2 (23.2-25.2) kg/m 2 ) completed the study. The median servings were significantly different to the reference portions for five foods in the ServAR group, compared to eight foods in the information only group and seven foods for the control group. The cumulative proportion of total estimations per group within ±10%, ±25% and ±50% of the reference portion was greater for those using ServAR (30.7, 65.2 and 90.7%; respectively), compared to the information only group (19.6, 47.4 and 77.4%) and control group (10.0, 33.7 and 68.9%). Participants generally found the ServAR tool easy to use and agreed that it showed potential to support optimal portion size selection. However, some refinements to the ServAR tool are required to improve the user experience. Use of the augmented reality tool improved accuracy and consistency of estimating standard serve sizes compared to the information only and control conditions. ServAR demonstrates potential as a practical tool to guide the serving of food. Further evaluation across a broad range of foods, portion sizes and settings is warranted.

A study of topics for distance education-A survey of U.S. Fish and Wildlife Service employees

USGS Publications Warehouse

Ratz, Joan M.; Schuster, Rudy M.; Marcy, Ann H.

2011-01-01

The purpose of this study was to identify training topics and distance education technologies preferred by U.S. Fish and Wildlife Service employees. This study was conducted on behalf of the National Conservation Training Center to support their distance education strategy planning and implementation. When selecting survey recipients, we focused on employees in positions involving conservation and environmental education and outreach programming. We conducted the study in two phases. First, we surveyed 72 employees to identify useful training topics. The response rate was 61 percent; respondents were from all regions and included supervisors and nonsupervisors. Five topics for training were identified: creating and maintaining partnerships (partnerships), technology, program planning and development (program planning), outreach methods to engage the community (outreach methods), and evaluation methods. In the second phase, we surveyed 1,488 employees to assess preferences for training among the five topics identified in the first survey and preferences among six distance education technologies: satellite television, video conferencing, audio conferencing, computer mediated training, written resources, and audio resources. Two types of instructor-led training were included on the survey to compare to the technology options. Respondents were asked what types of information, such as basic facts or problem solving skills, were needed for each of the five topics. The adjusted response rate was 64 percent; respondents were from all regions and included supervisors and nonsupervisors. The results indicated clear preferences among respondents for certain training topics and technologies. All five training topics were valued, but the topics of partnerships and technology were given equal value and were valued more than the other three topics. Respondents indicated a desire for training on the topics of partnerships, technology, program planning, and outreach methods. For the six distance education technologies, respondents indicated different levels of usability and access. Audio conferencing and written resources were reported to be most usable and accessible. The ratings of technology usability/access differed according to region; respondents in region 9 rated most technologies higher on usability/access. Respondents indicated they would take courses through either onsite or distance education approaches, but they prefer onsite training for most topics and most types of information.

Older Adults' Acceptance of Information Technology

ERIC Educational Resources Information Center

Wang, Lin; Rau, Pei-Luen Patrick; Salvendy, Gavriel

2011-01-01

This study investigated variables contributing to older adults' information technology acceptance through a survey, which was used to find factors explaining and predicting older adults' information technology acceptance behaviors. Four factors, including needs satisfaction, perceived usability, support availability, and public acceptance, were…

Biofeedback in Partial Weight Bearing: Usability of Two Different Devices from a Patient's and Physical Therapist's Perspective.

PubMed

van Lieshout, Remko; Pisters, Martijn F; Vanwanseele, Benedicte; de Bie, Rob A; Wouters, Eveline J; Stukstette, Mirelle J

2016-01-01

Partial weight bearing is frequently instructed by physical therapists in patients after lower-limb trauma or surgery. The use of biofeedback devices seems promising to improve the patient's compliance with weight-bearing instructions. SmartStep and OpenGo-Science are biofeedback devices that provide real-time feedback. For a successful implementation, usability of the devices is a critical aspect and should be tested from a user's perspective. To describe the usability from the physical therapists' and a patients' perspective of Smartstep and OpenGo-Science to provide feedback on partial weight bearing during supervised rehabilitation of patients after lower-limb trauma or surgery. In a convergent mixed-methods design, qualitative and quantitative data were collected. Usability was subdivided into user performance, satisfaction and acceptability. Patients prescribed with partial weight bearing and their physical therapists were asked to use SmartStep and OpenGo-Science during supervised rehabilitation. Usability was qualitatively tested by a think-aloud method and a semi-structured interview and quantitatively tested by the System-Usability-Scale (SUS) and closed questions. For the qualitative data thematic content analyses were used. Nine pairs of physical therapists and their patients participated. The mean SUS scores for patients and physical therapists were for SmartStep 70 and 53, and for OpenGo-Science 79 and 81, respectively. Scores were interpreted with the Curved Grading Scale. The qualitative data showed that there were mixed views and perceptions from patients and physical therapists on satisfaction and acceptability. This study gives insight in the usability of two biofeedback devices from the patient's and physical therapist's perspective. The overall usability from both perspectives seemed to be acceptable for OpenGo-Science. For SmartStep, overall usability seemed only acceptable from the patient's perspective. The study findings could help clinicians to decide which biofeedback device is appropriate for their given situation and provide information for future development of biofeedback devices.

SU-F-T-249: Application of Human Factors Methods: Usability Testing in the Radiation Oncology Environment

DOE Office of Scientific and Technical Information (OSTI.GOV)

Warkentin, H; Bubric, K; Giovannetti, H

2016-06-15

Purpose: As a quality improvement measure, we undertook this work to incorporate usability testing into the implementation procedures for new electronic documents and forms used by four affiliated radiation therapy centers. Methods: A human factors specialist provided training in usability testing for a team of medical physicists, radiation therapists, and radiation oncologists from four radiotherapy centers. A usability testing plan was then developed that included controlled scenarios and standardized forms for qualitative and quantitative feedback from participants, including patients. Usability tests were performed by end users using the same hardware and viewing conditions that are found in the clinical environment.more » A pilot test of a form used during radiotherapy CT simulation was performed in a single department; feedback informed adaptive improvements to the electronic form, hardware requirements, resource accessibility and the usability testing plan. Following refinements to the testing plan, usability testing was performed at three affiliated cancer centers with different vault layouts and hardware. Results: Feedback from the testing resulted in the detection of 6 critical errors (omissions and inability to complete task without assistance), 6 non-critical errors (recoverable), and multiple suggestions for improvement. Usability problems with room layout were detected at one center and problems with hardware were detected at one center. Upon amalgamation and summary of the results, three key recommendations were presented to the document’s authors for incorporation into the electronic form. Documented inefficiencies and patient safety concerns related to the room layout and hardware were presented to administration along with a request for funding to purchase upgraded hardware and accessories to allow a more efficient workflow within the simulator vault. Conclusion: By including usability testing as part of the process when introducing any new document or procedure into clinical use, associated risks can be identified and mitigated before patient care and clinical workflow are impacted.« less

An efficient approach to improve the usability of e-learning resources: the role of heuristic evaluation.

PubMed

Davids, Mogamat Razeen; Chikte, Usuf M E; Halperin, Mitchell L

2013-09-01

Optimizing the usability of e-learning materials is necessary to maximize their potential educational impact, but this is often neglected when time and other resources are limited, leading to the release of materials that cannot deliver the desired learning outcomes. As clinician-teachers in a resource-constrained environment, we investigated whether heuristic evaluation of our multimedia e-learning resource by a panel of experts would be an effective and efficient alternative to testing with end users. We engaged six inspectors, whose expertise included usability, e-learning, instructional design, medical informatics, and the content area of nephrology. They applied a set of commonly used heuristics to identify usability problems, assigning severity scores to each problem. The identification of serious problems was compared with problems previously found by user testing. The panel completed their evaluations within 1 wk and identified a total of 22 distinct usability problems, 11 of which were considered serious. The problems violated the heuristics of visibility of system status, user control and freedom, match with the real world, intuitive visual layout, consistency and conformity to standards, aesthetic and minimalist design, error prevention and tolerance, and help and documentation. Compared with user testing, heuristic evaluation found most, but not all, of the serious problems. Combining heuristic evaluation and user testing, with each involving a small number of participants, may be an effective and efficient way of improving the usability of e-learning materials. Heuristic evaluation should ideally be used first to identify the most obvious problems and, once these are fixed, should be followed by testing with typical end users.

Sentiment of Search: KM and IT for User Expectations

NASA Technical Reports Server (NTRS)

Berndt, Sarah Ann; Meza, David

2014-01-01

User perceived value is the number one indicator of a successful implementation of KM and IT collaborations. The system known as "Search" requires more strategy and workflow that a mere data dump or ungoverned infrastructure can provide. Monitoring of user sentiment can be a driver for providing objective measures of success and justifying changes to the user interface. The dynamic nature of information technology makes traditional usability metrics difficult to identify, yet easy to argue against. There is little disagreement, however, on the criticality of adapting to user needs and expectations. The Systems Usability Scale (SUS), developed by John Brook in 1986 has become an industry standard for usability engineering. The first phase of a modified SUS, polls the sentiment of representative users of the JSC Search system. This information can be used to correlate user determined value with types of information sought and how the system is (or is not) meeting expectations. Sentiment analysis by way of the SUS assists an organization in identification and prioritization of the KM and IT variables impacting user perceived value. A secondary, user group focused analysis is the topic of additional work that demonstrates the impact of specific changes dictated by user sentiment.

Approaches for Evaluating the Usability of Assistive Technology Product Prototypes

ERIC Educational Resources Information Center

Choi, Young Mi; Sprigle, Stephen H.

2011-01-01

User input is an important component to help guide designers in producing a more usable product. Evaluation of prototypes is one method of obtaining this input, but methods for evaluating assistive technology prototypes during design have not been adequately described or evaluated. This project aimed to compare different methods of evaluating…

A Concise and Practical Framework for the Development and Usability Evaluation of Patient Information Websites

PubMed Central

Knijnenburg, S.L.; Kremer, L.C.; Jaspers, M.W.M.

2015-01-01

Summary Background The Website Developmental Model for the Healthcare Consumer (WDMHC) is an extensive and successfully evaluated framework that incorporates user-centered design principles. However, due to its extensiveness its application is limited. In the current study we apply a subset of the WDMHC framework in a case study concerning the development and evaluation of a website aimed at childhood cancer survivors (CCS). Objective To assess whether the implementation of a limited subset of the WDMHC-framework is sufficient to deliver a high-quality website with few usability problems, aimed at a specific patient population. Methods The website was developed using a six-step approach divided into three phases derived from the WDMHC: 1) information needs analysis, mock-up creation and focus group discussion; 2) website prototype development; and 3) heuristic evaluation (HE) and think aloud analysis (TA). The HE was performed by three double experts (knowledgeable both in usability engineering and childhood cancer survivorship), who assessed the site using the Nielsen heuristics. Eight end-users were invited to complete three scenarios covering all functionality of the website by TA. Results The HE and TA were performed concurrently on the website prototype. The HE resulted in 29 unique usability issues; the end-users performing the TA encountered eleven unique problems. Four issues specifically revealed by HE concerned cosmetic design flaws, whereas two problems revealed by TA were related to website content. Conclusion Based on the subset of the WDMHC framework we were able to deliver a website that closely matched the expectancy of the end-users and resulted in relatively few usability problems during end-user testing. With the successful application of this subset of the WDMHC, we provide developers with a clear and easily applicable framework for the development of healthcare websites with high usability aimed at specific medical populations. PMID:26171083

Usability study of a novel, self-lighted, disposable speculum: military applications.

PubMed

Jones, Christina L; Gruber, Daniel D; Warner, William; Buller, Jerome L

2013-04-01

Data collected from a postutilization questionnaire were used to evaluate the usability of the OfficeSPEC disposable vaginal speculum, specifically the effectiveness, efficiency, and acceptability, in clinical, hospital, and austere environments. Usability data analysis showed the OfficeSPEC speculum had an effectiveness rating of 4.6/5, efficiency rating of 4.5/5, and acceptability rating of 4.6/5; overall usability in deployed environments was favorable. The overall rankings were 3.4 for plastic, 4.2 for metal (p < 0.001), and 4.5 for OfficeSPEC (p < 0.001). Cost analysis of the OfficeSPEC placed the disposable speculum as a reasonable alternative with yearly cost of $129,200, compared to traditional metal ($209,100) and plastic ($319,175). By evaluating the OfficeSPEC speculum within a usability framework, it proved to be practical, viable alternative in all environments, particularly in the forward deployed environment. Reprint & Copyright © 2013 Association of Military Surgeons of the U.S.

Usability Testing of Two Ambulatory EHR Navigators.

PubMed

Hultman, Gretchen; Marquard, Jenna; Arsoniadis, Elliot; Mink, Pamela; Rizvi, Rubina; Ramer, Tim; Khairat, Saif; Fickau, Keri; Melton, Genevieve B

2016-01-01

Despite widespread electronic health record (EHR) adoption, poor EHR system usability continues to be a significant barrier to effective system use for end users. One key to addressing usability problems is to employ user testing and user-centered design. To understand if redesigning an EHR-based navigation tool with clinician input improved user performance and satisfaction. A usability evaluation was conducted to compare two versions of a redesigned ambulatory navigator. Participants completed tasks for five patient cases using the navigators, while employing a think-aloud protocol. The tasks were based on Meaningful Use (MU) requirements. The version of navigator did not affect perceived workload, and time to complete tasks was longer in the redesigned navigator. A relatively small portion of navigator content was used to complete the MU-related tasks, though navigation patterns were highly variable across participants for both navigators. Preferences for EHR navigation structures appeared to be individualized. This study demonstrates the importance of EHR usability assessments to evaluate group and individual performance of different interfaces and preferences for each design.

Learning to Be an Information Architect

ERIC Educational Resources Information Center

Wusteman, Judith

2013-01-01

This article describes a recently introduced module at University College Dublin School of Information and Library Studies (SILS), entitled "Information Architecture: Designing the Web." The module provides students with a realistic experience of how information architects apply their skills to produce usable web sites, via a project to…

Visualization of usability and functionality of a professional website through web-mining.

PubMed

Jones, Josette F; Mahoui, Malika; Gopa, Venkata Devi Pragna

2007-10-11

Functional interface design requires understanding of the information system structure and the user. Web logs record user interactions with the interface, and thus provide some insight into user search behavior and efficiency of the search process. The present study uses a data-mining approach with techniques such as association rules, clustering and classification, to visualize the usability and functionality of a digital library through in depth analyses of web logs.

ODMSummary: A Tool for Automatic Structured Comparison of Multiple Medical Forms Based on Semantic Annotation with the Unified Medical Language System.

PubMed

Storck, Michael; Krumm, Rainer; Dugas, Martin

2016-01-01

Medical documentation is applied in various settings including patient care and clinical research. Since procedures of medical documentation are heterogeneous and developed further, secondary use of medical data is complicated. Development of medical forms, merging of data from different sources and meta-analyses of different data sets are currently a predominantly manual process and therefore difficult and cumbersome. Available applications to automate these processes are limited. In particular, tools to compare multiple documentation forms are missing. The objective of this work is to design, implement and evaluate the new system ODMSummary for comparison of multiple forms with a high number of semantically annotated data elements and a high level of usability. System requirements are the capability to summarize and compare a set of forms, enable to estimate the documentation effort, track changes in different versions of forms and find comparable items in different forms. Forms are provided in Operational Data Model format with semantic annotations from the Unified Medical Language System. 12 medical experts were invited to participate in a 3-phase evaluation of the tool regarding usability. ODMSummary (available at https://odmtoolbox.uni-muenster.de/summary/summary.html) provides a structured overview of multiple forms and their documentation fields. This comparison enables medical experts to assess multiple forms or whole datasets for secondary use. System usability was optimized based on expert feedback. The evaluation demonstrates that feedback from domain experts is needed to identify usability issues. In conclusion, this work shows that automatic comparison of multiple forms is feasible and the results are usable for medical experts.

Improving brain injury cognitive rehabilitation by personalized telerehabilitation services: Guttmann neuropersonal trainer.

PubMed

Solana, Javier; Cáceres, César; García-Molina, Alberto; Opisso, Eloy; Roig, Teresa; Tormos, José M; Gómez, Enrique J

2015-01-01

Cognitive rehabilitation aims to remediate or alleviate the cognitive deficits appearing after an episode of acquired brain injury (ABI). The purpose of this work is to describe the telerehabilitation platform called Guttmann Neuropersonal Trainer (GNPT) which provides new strategies for cognitive rehabilitation, improving efficiency and access to treatments, and to increase knowledge generation from the process. A cognitive rehabilitation process has been modeled to design and develop the system, which allows neuropsychologists to configure and schedule rehabilitation sessions, consisting of set of personalized computerized cognitive exercises grounded on neuroscience and plasticity principles. It provides remote continuous monitoring of patient's performance, by an asynchronous communication strategy. An automatic knowledge extraction method has been used to implement a decision support system, improving treatment customization. GNPT has been implemented in 27 rehabilitation centers and in 83 patients' homes, facilitating the access to the treatment. In total, 1660 patients have been treated. Usability and cost analysis methodologies have been applied to measure the efficiency in real clinical environments. The usability evaluation reveals a system usability score higher than 70 for all target users. The cost efficiency study results show a relation of 1-20 compared to face-to-face rehabilitation. GNPT enables brain-damaged patients to continue and further extend rehabilitation beyond the hospital, improving the efficiency of the rehabilitation process. It allows customized therapeutic plans, providing information to further development of clinical practice guidelines.

The development of an online decision aid to support persons having a genetic predisposition to cancer and their partners during reproductive decision-making: a usability and pilot study.

PubMed

Reumkens, Kelly; Tummers, Marly H E; Gietel-Habets, Joyce J G; van Kuijk, Sander M J; Aalfs, Cora M; van Asperen, Christi J; Ausems, Margreet G E M; Collée, Margriet; Dommering, Charlotte J; Kets, C Marleen; van der Kolk, Lizet E; Oosterwijk, Jan C; Tjan-Heijnen, Vivianne C G; van der Weijden, Trudy; de Die-Smulders, Christine E M; van Osch, Liesbeth A D M

2018-05-30

An online decision aid to support persons having a genetic predisposition to cancer and their partners during reproductive decision-making was developed. A two-phase usability test was conducted among 12 couples (N = 22; 2 persons participated without their partner) at risk for hereditary cancer and 15 health care providers. Couples and health care providers expressed similar suggestions for improvements, and evaluated the modified decision aid as acceptable, easy to use, and comprehensible. The final decision aid was pilot tested (N = 16) with paired sample t tests comparing main outcomes (decisional conflict, knowledge, realistic expectations regarding the reproductive options and decision self-efficacy) before (T0), immediately (T1) and 2 weeks after (T2) use of the decision aid. Pilot testing indicated decreased decisional conflict scores, increased knowledge, and improved realistic expectations regarding the reproductive options, at T1 and T2. No effect was found for couples' decision self-efficacy. The positive findings during usability testing were thus reflected in the pilot study. The decision aid will be further evaluated in a nationwide pretest-posttest study to facilitate implementation in the onco-genetic counselling setting. Ultimately, it is expected that the decision aid will enable end-users to make an informed decision.

Safety status system for operating room devices.

PubMed

Guédon, Annetje C P; Wauben, Linda S G L; Overvelde, Marlies; Blok, Joleen H; van der Elst, Maarten; Dankelman, Jenny; van den Dobbelsteen, John J

2014-01-01

Since the increase of the number of technological aids in the operating room (OR), equipment-related incidents have come to be a common kind of adverse events. This underlines the importance of adequate equipment management to improve the safety in the OR. A system was developed to monitor the safety status (periodic maintenance and registered malfunctions) of OR devices and to facilitate the notification of malfunctions. The objective was to assess whether the system is suitable for use in an busy OR setting and to analyse its effect on the notification of malfunctions. The system checks automatically the safety status of OR devices through constant communication with the technical facility management system, informs the OR staff real-time and facilitates notification of malfunctions. The system was tested for a pilot period of six months in four ORs of a Dutch teaching hospital and 17 users were interviewed on the usability of the system. The users provided positive feedback on the usability. For 86.6% of total time, the localisation of OR devices was accurate. 62 malfunctions of OR devices were reported, an increase of 12 notifications compared to the previous year. The safety status system was suitable for an OR complex, both from a usability and technical point of view, and an increase of reported malfunctions was observed. The system eases monitoring the safety status of equipment and is a promising tool to improve the safety related to OR devices.

Usability inspection to improve an electronic provincial medication repository.

PubMed

Kitson, Nicole A; Price, Morgan; Bowen, Michael; Lau, Francis

2013-01-01

Medication errors are a significant source of actual and potential harm for patients. Community medication records have the potential to reduce medication errors, but they can also introduce unintended consequences when there is low fit to task (low cognitive fit). PharmaNet is a provincially managed electronic repository that contains the records for community-based pharmacy-dispensed medications in British Columbia. This research explores the usability of PharmaNet, as a representative community-based medication repository. We completed usability inspections of PharmaNet through vendor applications. Vendor participants were asked to complete activity-driven scenarios, which highlighted aspects of medication management workflow. Screen recording was later reviewed. Heuristics were applied to explore usability issues and improvement opportunities. Usability inspection was conducted with four PharmaNet applications. Ninety-six usability issues were identified; half of these had potential implications for patient safety. These were primarily related to login and logout procedures; display of patient name; display of medications; update and display of alert information; and the changing or discontinuation of medications. PharmaNet was designed primarily to support medication dispensing and billing activities by community pharmacies, but is also used to support care providers with monitoring and prescribing activities. As such, some of the features do not have a strong fit for other clinical activities. To improve fit, we recommend: having a Current Medications List and Displaying Medication Utilization Charts.

Evaluating the Usability of a Professional Modeling Tool Repurposed for Middle School Learning

NASA Astrophysics Data System (ADS)

Peters, Vanessa L.; Songer, Nancy Butler

2013-10-01

This paper reports the results of a three-stage usability test of a modeling tool designed to support learners' deep understanding of the impacts of climate change on ecosystems. The design process involved repurposing an existing modeling technology used by professional scientists into a learning tool specifically designed for middle school students. To evaluate usability, we analyzed students' task performance and task completion time as they worked on an activity with the repurposed modeling technology. In stage 1, we conducted remote testing of an early modeling prototype with urban middle school students (n = 84). In stages 2 and 3, we used screencasting software to record students' mouse and keyboard movements during collaborative think-alouds (n = 22) and conducted a qualitative analysis of their peer discussions. Taken together, the study findings revealed two kinds of usability issues that interfered with students' productive use of the tool: issues related to the use of data and information, and issues related to the use of the modeling technology. The study findings resulted in design improvements that led to stronger usability outcomes and higher task performance among students. In this paper, we describe our methods for usability testing, our research findings, and our design solutions for supporting students' use of the modeling technology and use of data. The paper concludes with implications for the design and study of modeling technologies for science learning.

Usability of a mobile electronic medical record prototype: a verbal protocol analysis.

PubMed

Wu, Robert C; Orr, M Scott; Chignell, Mark; Straus, Sharon E

2008-06-01

Point of care access to electronic medical records may provide clinicians with the information they want when they need it and may in turn improve patient safety. Yet providing an electronic medical record on handheld devices presents many usability challenges, and it is unclear whether clinicians will use them. An iterative design process for the development and evaluation of a prototype of a mobile electronic medical record was performed. Usability sessions were conducted in which physicians were asked to 'think aloud' while working through clinical scenarios using the prototype. Verbal protocol analysis, which consists of coding utterances, was conducted on the transcripts from the sessions and common themes were extracted. Usability sessions were held with five family physicians and four internists with varying levels of computer expertise. Physicians were able to use the device to complete 52 of 54 required tasks. Users commented that it was intuitive (9/9), would increase accessibility (5/9) but for them to use it, it would need the system to be fast and time-saving (5/9). Users had difficulty entering information (5/9) and reading the screen (4/9). In terms of functionality, users had concerns about completeness of information (6/9), details of ordering (5/9) and desired billing functionality (5/9) and integration with other systems (4/9). While physicians can use mobile electronic medical records in realistic scenarios, certain requirements likely need to be met including a fast system with easy data selection, easy data entry and improved display before widespread adoption occurs.

Addressing security, collaboration, and usability with tactical edge mobile devices and strategic cloud-based systems

NASA Astrophysics Data System (ADS)

Graham, Christopher J.

2012-05-01

Success in the future battle space is increasingly dependent on rapid access to the right information. Faced with a shrinking budget, the Government has a mandate to improve intelligence productivity, quality, and reliability. To achieve increased ISR effectiveness, leverage of tactical edge mobile devices via integration with strategic cloud-based infrastructure is the single, most likely candidate area for dramatic near-term impact. This paper discusses security, collaboration, and usability components of this evolving space. These three paramount tenets outlined below, embody how mission information is exchanged securely, efficiently, with social media cooperativeness. Tenet 1: Complete security, privacy, and data integrity, must be ensured within the net-centric battle space. This paper discusses data security on a mobile device, data at rest on a cloud-based system, authorization and access control, and securing data transport between entities. Tenet 2: Lack of collaborative information sharing and content reliability jeopardizes mission objectives and limits the end user capability. This paper discusses cooperative pairing of mobile devices and cloud systems, enabling social media style interaction via tagging, meta-data refinement, and sharing of pertinent data. Tenet 3: Fielded mobile solutions must address usability and complexity. Simplicity is a powerful paradigm on mobile platforms, where complex applications are not utilized, and simple, yet powerful, applications flourish. This paper discusses strategies for ensuring mobile applications are streamlined and usable at the tactical edge through focused features sets, leveraging the power of the back-end cloud, minimization of differing HMI concepts, and directed end-user feedback.teInput=

Information Architecture: Notes toward a New Curriculum.

ERIC Educational Resources Information Center

Latham, Don

2002-01-01

Considers the evolution of information architectures as a field of professional education. Topics include the need for an interdisciplinary approach; balancing practical skills with theoretical concepts; and key content areas, including information organization, graphic design, computer science, user and usability studies, and communication.…

Mind the Gap: The Effect of Keyboard Key Gap and Pitch on Typing Speed, Accuracy, and Usability, Part 3.

PubMed

Madison, Heather; Pereira, Anna; Korshøj, Mette; Taylor, Laura; Barr, Alan; Rempel, David

2015-11-01

The aim of this study was to evaluate the effects of key gap (distance between edges of keys) on computer keyboards on typing speed, percentage error, preference, and usability. In Parts 1 and 2 of this series, a small key pitch (center-to-center distance between keys) was found to reduce productivity and usability, but the findings were confounded by gap. In this study, key gap was varied while holding key pitch constant. Participants (N = 25) typed on six keyboards, which differed in gap between keys (1, 3, or 5 mm) and pitch (16 or 17 mm; distance between centers of keys), while typing speed, accuracy, usability, and preference were measured. There was no statistical interaction between gap and pitch. Accuracy was better for keyboards with a gap of 5 mm compared to a 1-mm gap (p = .04). Net typing speed (p = .02), accuracy (p = .002), and most usability measures were better for keyboards with a pitch of 17 mm compared to a 16-mm pitch. The study findings support keyboard designs with a gap between keys of 5 mm over 1 mm and a key pitch of 17 mm over 16 mm. These findings may influence keyboard standards and design, especially the design of small keyboards used with portable devices, such as tablets and laptops. © 2015, Human Factors and Ergonomics Society.

19 CFR 163.1 - Definitions.

Code of Federal Regulations, 2011 CFR

2011-04-01

... following: Statements; declarations; documents; electronically generated or machine readable data; electronically stored or transmitted information or data; books; papers; correspondence; accounts; financial accounting data; technical data; computer programs necessary to retrieve information in a usable form; and...

A study in usability: redesigning a health sciences library's mobile site.

PubMed

Rosario, Jovy-Anne; Ascher, Marie T; Cunningham, Diana J

2012-01-01

A mobile site redesign was conducted at a medium-sized academic health sciences library with the goal of creating a site that meets the mobile information needs of its users. The redesign phases included (1) needs assessment, (2) usability testing, and (3) site design. The survey results showed that Apple devices were the most prevalent; the most desirable activities performed on a mobile site were searching for articles, accessing full-text articles and e-books, searching databases, and searching the catalog. These activities guided the development of the usability testing tasks and the redesign. All phases were completed within six months, and the total project cost was $50 for incentive purchases. Copyright © Taylor & Francis Group, LLC

Using qualitative studies to improve the usability of an EMR.

PubMed

Rose, Alan F; Schnipper, Jeffrey L; Park, Elyse R; Poon, Eric G; Li, Qi; Middleton, Blackford

2005-02-01

The adoption of electronic medical records (EMRs) and user satisfaction are closely associated with the system's usability. To improve the usability of a results management module of a widely deployed web-based EMR, we conducted two qualitative studies that included multiple focus group and field study sessions. Qualitative research can help focus attention on user tasks and goals and identify patterns of care that can be visualized through task modeling exercises. Findings from both studies raised issues with the amount and organization of information in the display, interference with workflow patterns of primary care physicians, and the availability of visual cues and feedback. We used the findings of these studies to recommend design changes to the user interface of the results management module.

Information and Knowledge: An Evolutionary Framework for Information Science

ERIC Educational Resources Information Center

Bates, Marcia J.

2005-01-01

Background: Many definitions of information, knowledge, and data have been suggested throughout the history of information science. In this article, the objective is to provide definitions that are usable for the physical, biological, and social meanings of the terms, covering the various senses important to our field. Argument: Information 1 is…

The Information Architecture of E-Commerce: An Experimental Study on User Performance and Preference

NASA Astrophysics Data System (ADS)

Wan Mohd, Wan Abdul Rahim; Md Noor, Nor Laila; Mehad, Shafie

Too often, designers of e-commerce web sites use models, concepts, guidelines, and designs that focus on the artifacts while ignoring the context in which the artifacts will be used. Furthermore, the link between culture and usability in web site IA phenomenon is still considered as uncharted area, as it lacks much theoretical consideration. In an effort toward addressing the aforementioned issues, our study provides a theoretical and empirical link between cultural and usability through the application of ‘Venustas' (Delight) drawn from the architectural field and Hofstede's cultural dimensions. We use Islamic culture as the case study and report on the experiment to investigate the effect of the IA designs based on the cultural dimensions on e-commerce web sites. The result provides partial empirical support to the theorized link between culture and usability based on the usability measurement on user performance and preference. In addition, practical web site IA cultural design prescriptions are also provided.

Designing an Educational Website to Improve Quality of Supportive Oncology Care for Women with Ovarian Cancer: An Expert Usability Review and Analysis.

PubMed

McClellan, Molly A; Karumur, Raghav Pavan; Vogel, Rachel Isaksson; Petzel, Sue V; Cragg, Julie; Chan, Daniel; Jacko, Julie A; Sainfort, François; Geller, Melissa A

A broad-based research team developed a Health Insurance Portability and Accountability Act (HIPAA)-compliant educational website for women with ovarian cancer to improve the quality of supportive oncology care. Prior to a randomized clinical trial of the website, initial usability testing was implemented to evaluate the website. The initial review found that 165/247 checklist items had sufficient information to allow for evaluation with the website achieving an overall score of 63%. By category, lowest scores were for the Home Page, Task Orientation, Page Layout & Visual Design, and Help, Feedback & Error Tolerance. Major issues thought to potentially impede actual usage were prioritized in redevelopment and the second usability review, conducted by the same expert, saw an improvement in scores. Incorporating usability concepts from the start of development, fulfilling the positive expectations of end-users and identifying technical and personal factors that optimize use may greatly enhance usage of health websites.

Consumers' Patient Portal Preferences and Health Literacy: A Survey Using Crowdsourcing.

PubMed

Zide, Mary; Caswell, Kaitlyn; Peterson, Ellen; Aberle, Denise R; Bui, Alex At; Arnold, Corey W

2016-06-08

eHealth apps have the potential to meet the information needs of patient populations and improve health literacy rates. However, little work has been done to document perceived usability of portals and health literacy of specific topics. Our aim was to establish a baseline of lung cancer health literacy and perceived portal usability. A survey based on previously validated instruments was used to assess a baseline of patient portal usability and health literacy within the domain of lung cancer. The survey was distributed via Amazon's Mechanical Turk to 500 participants. Our results show differences in preferences and literacy by demographic cohorts, with a trend of chronically ill patients having a more positive reception of patient portals and a higher health literacy rate of lung cancer knowledge (P<.05). This article provides a baseline of usability needs and health literacy that suggests that chronically ill patients have a greater preference for patient portals and higher level of health literacy within the domain of lung cancer.

Designing an Educational Website to Improve Quality of Supportive Oncology Care for Women with Ovarian Cancer: An Expert Usability Review and Analysis

PubMed Central

McClellan, Molly A.; Karumur, Raghav Pavan; Vogel, Rachel Isaksson; Petzel, Sue V.; Cragg, Julie; Chan, Daniel; Jacko, Julie A.; Sainfort, François; Geller, Melissa A.

2016-01-01

A broad-based research team developed a Health Insurance Portability and Accountability Act (HIPAA)-compliant educational website for women with ovarian cancer to improve the quality of supportive oncology care. Prior to a randomized clinical trial of the website, initial usability testing was implemented to evaluate the website. The initial review found that 165/247 checklist items had sufficient information to allow for evaluation with the website achieving an overall score of 63%. By category, lowest scores were for the Home Page, Task Orientation, Page Layout & Visual Design, and Help, Feedback & Error Tolerance. Major issues thought to potentially impede actual usage were prioritized in redevelopment and the second usability review, conducted by the same expert, saw an improvement in scores. Incorporating usability concepts from the start of development, fulfilling the positive expectations of end-users and identifying technical and personal factors that optimize use may greatly enhance usage of health websites. PMID:27110082

Usability testing of an mHealth device for swallowing therapy in head and neck cancer survivors.

PubMed

Constantinescu, Gabriela; Kuffel, Kristina; King, Ben; Hodgetts, William; Rieger, Jana

2018-04-01

The objective of this study was to conduct the first patient usability testing of a mobile health (mHealth) system for in-home swallowing therapy. Five participants with a history of head and neck cancer evaluated the mHealth system. After completing an in-application (app) tutorial with the clinician, participants were asked to independently complete five tasks: pair the device to the smartphone, place the device correctly, exercise, interpret progress displays, and close the system. Quantitative and qualitative methods were used to evaluate the effectiveness, efficiency, and satisfaction with the system. Critical changes to the app were found in three of the tasks, resulting in recommendations for the next iteration. These issues were related to ease of Bluetooth pairing, placement of device, and interpretation of statistics. Usability testing with patients identified issues that were essential to address prior to implementing the mHealth system in subsequent clinical trials. Of the usability methods used, video observation (synced screen capture with videoed gestures) revealed the most information.

Transparency, usability, and reproducibility: Guiding principles for improving comparative databases using primates as examples.

PubMed

Borries, Carola; Sandel, Aaron A; Koenig, Andreas; Fernandez-Duque, Eduardo; Kamilar, Jason M; Amoroso, Caroline R; Barton, Robert A; Bray, Joel; Di Fiore, Anthony; Gilby, Ian C; Gordon, Adam D; Mundry, Roger; Port, Markus; Powell, Lauren E; Pusey, Anne E; Spriggs, Amanda; Nunn, Charles L

2016-09-01

Recent decades have seen rapid development of new analytical methods to investigate patterns of interspecific variation. Yet these cutting-edge statistical analyses often rely on data of questionable origin, varying accuracy, and weak comparability, which seem to have reduced the reproducibility of studies. It is time to improve the transparency of comparative data while also making these improved data more widely available. We, the authors, met to discuss how transparency, usability, and reproducibility of comparative data can best be achieved. We propose four guiding principles: 1) data identification with explicit operational definitions and complete descriptions of methods; 2) inclusion of metadata that capture key characteristics of the data, such as sample size, geographic coordinates, and nutrient availability (for example, captive versus wild animals); 3) documentation of the original reference for each datum; and 4) facilitation of effective interactions with the data via user friendly and transparent interfaces. We urge reviewers, editors, publishers, database developers and users, funding agencies, researchers publishing their primary data, and those performing comparative analyses to embrace these standards to increase the transparency, usability, and reproducibility of comparative studies. © 2016 Wiley Periodicals, Inc.

Evaluation of the Digital Alzheimer Center: Testing Usability and Usefulness of an Online Portal for Patients with Dementia and Their Carers

PubMed Central

Droes, Rose-Marie; Sikkes, Sietske; Oostra, Ellen; Lemstra, Afina W

2016-01-01

Background Dementia is a progressive and highly disabling neurodegenerative disease that will likely become highly prevalent in the future due to the globally aging population. To improve health care efficiency and quality for dementia care, eHealth could help with, for example, an online portal, such as the Digital Alzheimer Center (DAC) of the Vrije Universiteit Medical Center Amsterdam. It provides up-to-date disease information, peer-to-peer contact, and methods for contacting the hospital and health professionals. Objective We aimed to investigate the usability and usefulness of the DAC for patients with dementia and carers to get insight into the feasibility and value of this eHealth app in dementia care and to recommend potential improvements. Methods A descriptive study among patients, carers, and health care professionals was performed. Mixed methods were used, consisting of observations (n=10, 4 people with dementia, 6 carers), an online survey (n=287; 88 patients, 199 carers), and semistructured interviews (n=18; 6 patients, 6 carers, 6 health care professionals). During the observations, participants performed a set of five different prescribed tasks on the portal. Speed, number of errors, and navigation were noted. The online survey aimed to assess users’ opinions on the portal’s usability and usefulness. Semistructured interviews were conducted in a subsample of patients, carers, and health care professionals to gain more in-depth information. Results In the usability assessment, eight categories of errors were distinguished, of which three were of critical, two of medium, and three of low severity. In the survey, 45% (40/88) of the patients and 53% (105/199) of the carers indicated they used the portal. In all, 33% (12/36) of patients and 61% (62/102) of carers found it easy to learn to work with the portal. Most considered the DAC generally useful: 65% (17/26) of patients and 78% (67/86) of carers found the DAC useful, especially for understanding dementia (patients: 64%, 16/25; carers: 62%, 53/86). In the semistructured interviews, the site was generally rated positively on usability and usefulness and being well designed. People with dementia and carers indicated it helped them to understand and deal with dementia. Conclusions To our knowledge, this is the first study investigating the usability and usefulness of an Internet portal especially designed for people with dementia and their carers. An online patient portal could be a useful means to help to support patients and carers in dealing with dementia: the majority of users positively evaluated usability and usefulness of the portal, and appreciated the information on it. However, only a minority of patients found it easy to work with the portal. Good design and frequent usability testing is essential to offer a good online portal. PMID:27444209

Design and Usability Testing of an Audio Platform Game for Players with Visual Impairments

ERIC Educational Resources Information Center

Oren, Michael; Harding, Chris; Bonebright, Terri L.

2008-01-01

This article reports on the evaluation of a novel audio platform game that creates a spatial, interactive experience via audio cues. A pilot study with players with visual impairments, and usability testing comparing the visual and audio game versions using both sighted players and players with visual impairments, revealed that all the…

Effect of improving the usability of an e-learning resource: a randomized trial.

PubMed

Davids, Mogamat Razeen; Chikte, Usuf M E; Halperin, Mitchell L

2014-06-01

Optimizing the usability of e-learning materials is necessary to reduce extraneous cognitive load and maximize their potential educational impact. However, this is often neglected, especially when time and other resources are limited. We conducted a randomized trial to investigate whether a usability evaluation of our multimedia e-learning resource, followed by fixing of all problems identified, would translate into improvements in usability parameters and learning by medical residents. Two iterations of our e-learning resource [version 1 (V1) and version 2 (V2)] were compared. V1 was the first fully functional version and V2 was the revised version after all identified usability problems were addressed. Residents in internal medicine and anesthesiology were randomly assigned to one of the versions. Usability was evaluated by having participants complete a user satisfaction questionnaire and by recording and analyzing their interactions with the application. The effect on learning was assessed by questions designed to test the retention and transfer of knowledge. Participants reported high levels of satisfaction with both versions, with good ratings on the System Usability Scale and adjective rating scale. In contrast, analysis of video recordings revealed significant differences in the occurrence of serious usability problems between the two versions, in particular in the interactive HandsOn case with its treatment simulation, where there was a median of five serious problem instances (range: 0-50) recorded per participant for V1 and zero instances (range: 0-1) for V2 (P < 0.001). There were no differences in tests of retention or transfer of knowledge between the two versions. In conclusion, usability evaluation followed by a redesign of our e-learning resource resulted in significant improvements in usability. This is likely to translate into improved motivation and willingness to engage with the learning material. In this population of relatively high-knowledge participants, learning scores were similar across the two versions. Copyright © 2014 The American Physiological Society.

Effect of improving the usability of an e-learning resource: a randomized trial

PubMed Central

Chikte, Usuf M. E.; Halperin, Mitchell L.

2014-01-01

Optimizing the usability of e-learning materials is necessary to reduce extraneous cognitive load and maximize their potential educational impact. However, this is often neglected, especially when time and other resources are limited. We conducted a randomized trial to investigate whether a usability evaluation of our multimedia e-learning resource, followed by fixing of all problems identified, would translate into improvements in usability parameters and learning by medical residents. Two iterations of our e-learning resource [version 1 (V1) and version 2 (V2)] were compared. V1 was the first fully functional version and V2 was the revised version after all identified usability problems were addressed. Residents in internal medicine and anesthesiology were randomly assigned to one of the versions. Usability was evaluated by having participants complete a user satisfaction questionnaire and by recording and analyzing their interactions with the application. The effect on learning was assessed by questions designed to test the retention and transfer of knowledge. Participants reported high levels of satisfaction with both versions, with good ratings on the System Usability Scale and adjective rating scale. In contrast, analysis of video recordings revealed significant differences in the occurrence of serious usability problems between the two versions, in particular in the interactive HandsOn case with its treatment simulation, where there was a median of five serious problem instances (range: 0–50) recorded per participant for V1 and zero instances (range: 0–1) for V2 (P < 0.001). There were no differences in tests of retention or transfer of knowledge between the two versions. In conclusion, usability evaluation followed by a redesign of our e-learning resource resulted in significant improvements in usability. This is likely to translate into improved motivation and willingness to engage with the learning material. In this population of relatively high-knowledge participants, learning scores were similar across the two versions. PMID:24913451

Locating and Searching Electronic Documents: A User Study of Supply Publications in the United States Marine Corps

DTIC Science & Technology

2007-12-01

Boyle, “Important issues in hypertext documentation usability,” In Proceedings of the 9th Annual international Conference on Systems Documentation...Tufte’s principles of information design to creating effective Web sites.” In Proceedings of the 15th Annual international Conference on Computer...usability,” In Proceedings of the 9th Annual international Conference on Systems Documentation (Chicago, Illinois, 1991). SIGDOC 󈨟. ACM, New York, NY

Managing cognitive difficulties after traumatic brain injury: a review of online resources for families.

PubMed

Poulin, Valérie; Dawson, Deirdre R; Bottari, Carolina; Verreault, Cynthia; Turcotte, Samantha; Jean, Alexandra

2018-03-22

To identify and critically appraise the content, readability, reliability and usability of websites providing information for managing cognitive difficulties in everyday life for the families of adults with moderate to severe traumatic brain injury. Systematic searches on the Internet for relevant websites were conducted using five search engines, and through consultation of the lists of resources published on websites of traumatic brain injury organizations. Two team members assessed eligibility of the websites. To be included, they had to provide information related to management of cognitive difficulties following moderate to severe traumatic brain injury, to be in English or French and available free of charge. Two reviewers evaluated each website according to: (1) its readability using Flesch-Kincaid Grade Level; (2) the quality of its content using a checklist of eight recommendations for managing memory, attention and executive function problems; (3) its usability (e.g., clear design) and reliability (e.g., currency of information) using the Minervation Validation Instrument for Health Care Web Sites. Of the 38 websites included, 10 provide specific tips for families that cover several domains of cognitive function, including memory, attention and executive function. The most frequent recommendations focused on the use of environmental supports for memory problems (n = 33 websites). The readability of information is below the recommended grade 7 for only nine of the websites. All sites show acceptable usability, but their quality is variable in terms of reliability of the information. This review provides useful information for selecting online resources to educate families about the management of cognitive difficulties following moderate to severe traumatic brain injury, as a complement to information and training provided by the rehabilitation team. Implications for rehabilitation This review describes standardized criteria for the evaluation of the content, readability, reliability and usability of websites for family education post-TBI. Given the variability in the content, the readability and the reliability of websites providing information for families about the management of cognitive difficulties post-TBI, careful attention to the selection of appropriate resources is required. Findings from this review may facilitate clinicians' identification of relevant websites to educate families about the management of cognitive difficulties post-TBI, as a complement to other information and training from the rehabilitation team.

Mental workload during brain-computer interface training.

PubMed

Felton, Elizabeth A; Williams, Justin C; Vanderheiden, Gregg C; Radwin, Robert G

2012-01-01

It is not well understood how people perceive the difficulty of performing brain-computer interface (BCI) tasks, which specific aspects of mental workload contribute the most, and whether there is a difference in perceived workload between participants who are able-bodied and disabled. This study evaluated mental workload using the NASA Task Load Index (TLX), a multi-dimensional rating procedure with six subscales: Mental Demands, Physical Demands, Temporal Demands, Performance, Effort, and Frustration. Able-bodied and motor disabled participants completed the survey after performing EEG-based BCI Fitts' law target acquisition and phrase spelling tasks. The NASA-TLX scores were similar for able-bodied and disabled participants. For example, overall workload scores (range 0-100) for 1D horizontal tasks were 48.5 (SD = 17.7) and 46.6 (SD 10.3), respectively. The TLX can be used to inform the design of BCIs that will have greater usability by evaluating subjective workload between BCI tasks, participant groups, and control modalities. Mental workload of brain-computer interfaces (BCI) can be evaluated with the NASA Task Load Index (TLX). The TLX is an effective tool for comparing subjective workload between BCI tasks, participant groups (able-bodied and disabled), and control modalities. The data can inform the design of BCIs that will have greater usability.

Comprehensive analysis of a medication dosing error related to CPOE.

PubMed

Horsky, Jan; Kuperman, Gilad J; Patel, Vimla L

2005-01-01

This case study of a serious medication error demonstrates the necessity of a comprehensive methodology for the analysis of failures in interaction between humans and information systems. The authors used a novel approach to analyze a dosing error related to computer-based ordering of potassium chloride (KCl). The method included a chronological reconstruction of events and their interdependencies from provider order entry usage logs, semistructured interviews with involved clinicians, and interface usability inspection of the ordering system. Information collected from all sources was compared and evaluated to understand how the error evolved and propagated through the system. In this case, the error was the product of faults in interaction among human and system agents that methods limited in scope to their distinct analytical domains would not identify. The authors characterized errors in several converging aspects of the drug ordering process: confusing on-screen laboratory results review, system usability difficulties, user training problems, and suboptimal clinical system safeguards that all contributed to a serious dosing error. The results of the authors' analysis were used to formulate specific recommendations for interface layout and functionality modifications, suggest new user alerts, propose changes to user training, and address error-prone steps of the KCl ordering process to reduce the risk of future medication dosing errors.

Evaluating the Usability of Authoring Environments for Serious Games.

PubMed

Slootmaker, Aad; Hummel, Hans; Koper, Rob

2017-08-01

Background . The EMERGO method and online platform enable the development and delivery of scenario-based serious games that foster students to acquire professional competence. One of the main goals of the platform is to provide a user-friendly authoring environment for creating virtual environments where students can perform authentic tasks. Aim . We present the findings of an in-depth qualitative case study of the platform's authoring environment and compare our findings on usability with those found for comparable environments in literature. Method . We carried out semi-structured interviews, with two experienced game developers who have authored a game for higher education, and a literature review of comparable environments. Findings . The analysis shows that the usability of the authoring environment is problematic, especially regarding understandability and learnability , which is in line with findings of comparable environments. Other findings are that authoring is well integrated with the EMERGO method and that functionality and reliability of the authoring environment are valued. Practical implications . The lessons learned are presented in the form of general guidelines to improve the understandability and learnability of authoring environments for serious games .

Evaluating the Usability of Authoring Environments for Serious Games

PubMed Central

Slootmaker, Aad; Hummel, Hans; Koper, Rob

2017-01-01

Background. The EMERGO method and online platform enable the development and delivery of scenario-based serious games that foster students to acquire professional competence. One of the main goals of the platform is to provide a user-friendly authoring environment for creating virtual environments where students can perform authentic tasks. Aim. We present the findings of an in-depth qualitative case study of the platform’s authoring environment and compare our findings on usability with those found for comparable environments in literature. Method. We carried out semi-structured interviews, with two experienced game developers who have authored a game for higher education, and a literature review of comparable environments. Findings. The analysis shows that the usability of the authoring environment is problematic, especially regarding understandability and learnability, which is in line with findings of comparable environments. Other findings are that authoring is well integrated with the EMERGO method and that functionality and reliability of the authoring environment are valued. Practical implications. The lessons learned are presented in the form of general guidelines to improve the understandability and learnability of authoring environments for serious games. PMID:29081638

The Consumer Health Information System Adoption Model.

PubMed

Monkman, Helen; Kushniruk, Andre W

2015-01-01

Derived from overlapping concepts in consumer health, a consumer health information system refers to any of the broad range of applications, tools, and educational resources developed to empower consumers with knowledge, techniques, and strategies, to manage their own health. As consumer health information systems become increasingly popular, it is important to explore the factors that impact their adoption and success. Accumulating evidence indicates a relationship between usability and consumers' eHealth Literacy skills and the demands consumer HISs place on their skills. Here, we present a new model called the Consumer Health Information System Adoption Model, which depicts both consumer eHealth literacy skills and system demands on eHealth literacy as moderators with the potential to affect the strength of relationship between usefulness and usability (predictors of usage) and adoption, value, and successful use (actual usage outcomes). Strategies for aligning these two moderating factors are described.

Does user-centred design affect the efficiency, usability and safety of CPOE order sets?

PubMed

Chan, Julie; Shojania, Kaveh G; Easty, Anthony C; Etchells, Edward E

2011-05-01

Application of user-centred design principles to Computerized provider order entry (CPOE) systems may improve task efficiency, usability or safety, but there is limited evaluative research of its impact on CPOE systems. We evaluated the task efficiency, usability, and safety of three order set formats: our hospital's planned CPOE order sets (CPOE Test), computer order sets based on user-centred design principles (User Centred Design), and existing pre-printed paper order sets (Paper). 27 staff physicians, residents and medical students. Sunnybrook Health Sciences Centre, an academic hospital in Toronto, Canada. Methods Participants completed four simulated order set tasks with three order set formats (two CPOE Test tasks, one User Centred Design, and one Paper). Order of presentation of order set formats and tasks was randomized. Users received individual training for the CPOE Test format only. Completion time (efficiency), requests for assistance (usability), and errors in the submitted orders (safety). 27 study participants completed 108 order sets. Mean task times were: User Centred Design format 273 s, Paper format 293 s (p=0.73 compared to UCD format), and CPOE Test format 637 s (p<0.0001 compared to UCD format). Users requested assistance in 31% of the CPOE Test format tasks, whereas no assistance was needed for the other formats (p<0.01). There were no significant differences in number of errors between formats. The User Centred Design format was more efficient and usable than the CPOE Test format even though training was provided for the latter. We conclude that application of user-centred design principles can enhance task efficiency and usability, increasing the likelihood of successful implementation.

Does user-centred design affect the efficiency, usability and safety of CPOE order sets?

PubMed Central

Chan, Julie; Shojania, Kaveh G; Easty, Anthony C

2011-01-01

Background Application of user-centred design principles to Computerized provider order entry (CPOE) systems may improve task efficiency, usability or safety, but there is limited evaluative research of its impact on CPOE systems. Objective We evaluated the task efficiency, usability, and safety of three order set formats: our hospital's planned CPOE order sets (CPOE Test), computer order sets based on user-centred design principles (User Centred Design), and existing pre-printed paper order sets (Paper). Participants 27staff physicians, residents and medical students. Setting Sunnybrook Health Sciences Centre, an academic hospital in Toronto, Canada. Methods Participants completed four simulated order set tasks with three order set formats (two CPOE Test tasks, one User Centred Design, and one Paper). Order of presentation of order set formats and tasks was randomized. Users received individual training for the CPOE Test format only. Main Measures Completion time (efficiency), requests for assistance (usability), and errors in the submitted orders (safety). Results 27 study participants completed 108 order sets. Mean task times were: User Centred Design format 273 s, Paper format 293 s (p=0.73 compared to UCD format), and CPOE Test format 637 s (p<0.0001 compared to UCD format). Users requested assistance in 31% of the CPOE Test format tasks, whereas no assistance was needed for the other formats (p<0.01). There were no significant differences in number of errors between formats. Conclusions The User Centred Design format was more efficient and usable than the CPOE Test format even though training was provided for the latter. We conclude that application of user-centred design principles can enhance task efficiency and usability, increasing the likelihood of successful implementation. PMID:21486886

Usage and Usability of a Web-based Program for Family Caregivers of Older People in Three European Countries: A Mixed-Methods Evaluation.

PubMed

Barbabella, Francesco; Poli, Arianna; Hanson, Elizabeth; Andréasson, Frida; Salzmann, Benjamin; Döhner, Hanneli; Papa, Roberta; Efthymiou, Areti; Valenza, Silvia; Pelliccioni, Giuseppe; Lamura, Giovanni

2018-05-01

InformCare is a European Web platform that supports informal caregivers of older people by providing access to online information and professional and peer support. The aim of this study was to assess the usage and usability of a psychosocial Web-based program carried out in three European countries (Italy, Sweden, and Germany). A mixed-methods sequential explanatory design was adopted, comprising baseline and postintervention assessments, as well as combined thematic content analysis of results and focus group findings. A convenience sample of 118 caregivers was enrolled, of whom 94 used the services offered by the program at least once. The subsamples in the three countries used the platform in different ways, with a predominance of passive strategies (eg, seeking information and reading other people's comments) for Italian caregivers, and more active usage by Swedish and German caregivers. The usability assessment showed that the platform was perceived well by Italian and German caregivers, whereas technical problems affected the Swedish sample's experiences. Focus group data highlighted user satisfaction with the online support and reliability of the environment. Recommendations for practitioners are to ensure digital training for caregivers who have lower confidence in use of the Internet, to involve different healthcare professionals in the provision of professional support, and to adequately manage online community building.

Colorectal cancer screening patient education materials-how effective is online health information?

PubMed

John, Elizabeth Sheena; John, Ann M; Hansberry, David R; Thomas, Prashant J; Agarwal, Prateek; Deitch, Christopher; Chokhavatia, Sita

2016-12-01

Patients screened for colorectal cancer (CRC) frequently turn to the Internet to improve their understanding of tests used for detection, including colonoscopy, flexible sigmoidoscopy, fecal occult blood test (FOBT), and CT colonography. It was of interest to determine the quality and readability levels of online health information. The screening tools were googled, and the top 20 results of each test were analyzed for readability, accessibility, usability, and reliability. The 80 articles excluded scientific literature and blogs. We used ten validated readability scales to measure grade levels, and one-way ANOVA and Tukey's honestly statistical different (HSD) post hoc analyses to determine any statistically significant differences among the four diagnostic tests. The LIDA tool assessed overall quality by measuring accessibility, usability, and reliability. The 80 articles were written at an 11.7 grade level, with CT colonography articles written at significantly higher levels than FOBT articles, F(3, 75) = 3.07, p = 0.033. LIDA showed moderate percentages in accessibility (83.9 %), usability (73.0 %), and reliability (75.9 %). Online health information about CRC screening tools are written at higher levels than the National Institute of Health (NIH) and American Medical Association (AMA) recommended third to seventh grade levels. More patients could benefit from this modality of information if it were written at a level and quality that would better facilitate understanding.

Mobile Applications for Diabetics: A Systematic Review and Expert-Based Usability Evaluation Considering the Special Requirements of Diabetes Patients Age 50 Years or Older

PubMed Central

Quade, Mandy; Kirch, Wilhelm

2014-01-01

Background A multitude of mhealth (mobile health) apps have been developed in recent years to support effective self-management of patients with diabetes mellitus type 1 or 2. Objective We carried out a systematic review of all currently available diabetes apps for the operating systems iOS and Android. We considered the number of newly released diabetes apps, range of functions, target user groups, languages, acquisition costs, user ratings, available interfaces, and the connection between acquisition costs and user ratings. Additionally, we examined whether the available applications serve the special needs of diabetes patients aged 50 or older by performing an expert-based usability evaluation. Methods We identified relevant keywords, comparative categories, and their specifications. Subsequently, we performed the app review based on the information given in the Google Play Store, the Apple App Store, and the apps themselves. In addition, we carried out an expert-based usability evaluation based on a representative 10% sample of diabetes apps. Results In total, we analyzed 656 apps finding that 355 (54.1%) offered just one function and 348 (53.0%) provided a documentation function. The dominating app language was English (85.4%, 560/656), patients represented the main user group (96.0%, 630/656), and the analysis of the costs revealed a trend toward free apps (53.7%, 352/656). The median price of paid apps was €1.90. The average user rating was 3.6 stars (maximum 5). Our analyses indicated no clear differences in the user rating between free and paid apps. Only 30 (4.6%) of the 656 available diabetes apps offered an interface to a measurement device. We evaluated 66 apps within the usability evaluation. On average, apps were rated best regarding the criterion “comprehensibility” (4.0 out of 5.0), while showing a lack of “fault tolerance” (2.8 out of 5.0). Of the 66 apps, 48 (72.7%) offered the ability to read the screen content aloud. The number of functions was significantly negative correlated with usability. The presence of documentation and analysis functions reduced the usability score significantly by 0.36 and 0.21 points. Conclusions A vast number of diabetes apps already exist, but the majority offer similar functionalities and combine only one to two functions in one app. Patients and physicians alike should be involved in the app development process to a greater extent. We expect that the data transmission of health parameters to physicians will gain more importance in future applications. The usability of diabetes apps for patients aged 50 or older was moderate to good. But this result applied mainly to apps offering a small range of functions. Multifunctional apps performed considerably worse in terms of usability. Moreover, the presence of a documentation or analysis function resulted in significantly lower usability scores. The operability of accessibility features for diabetes apps was quite limited, except for the feature “screen reader”. PMID:24718852

ODMSummary: A Tool for Automatic Structured Comparison of Multiple Medical Forms Based on Semantic Annotation with the Unified Medical Language System

PubMed Central

Krumm, Rainer; Dugas, Martin

2016-01-01

Introduction Medical documentation is applied in various settings including patient care and clinical research. Since procedures of medical documentation are heterogeneous and developed further, secondary use of medical data is complicated. Development of medical forms, merging of data from different sources and meta-analyses of different data sets are currently a predominantly manual process and therefore difficult and cumbersome. Available applications to automate these processes are limited. In particular, tools to compare multiple documentation forms are missing. The objective of this work is to design, implement and evaluate the new system ODMSummary for comparison of multiple forms with a high number of semantically annotated data elements and a high level of usability. Methods System requirements are the capability to summarize and compare a set of forms, enable to estimate the documentation effort, track changes in different versions of forms and find comparable items in different forms. Forms are provided in Operational Data Model format with semantic annotations from the Unified Medical Language System. 12 medical experts were invited to participate in a 3-phase evaluation of the tool regarding usability. Results ODMSummary (available at https://odmtoolbox.uni-muenster.de/summary/summary.html) provides a structured overview of multiple forms and their documentation fields. This comparison enables medical experts to assess multiple forms or whole datasets for secondary use. System usability was optimized based on expert feedback. Discussion The evaluation demonstrates that feedback from domain experts is needed to identify usability issues. In conclusion, this work shows that automatic comparison of multiple forms is feasible and the results are usable for medical experts. PMID:27736972

The quality of information on the Internet on orthodontic retainer wear: a cross-sectional study.

PubMed

Doğramacı, Esma J; Rossi-Fedele, Giampiero

2016-03-01

The objectives of this study were to assess the accessibility, usability, reliability and quality of information on the Internet written for the lay public about orthodontic retainers, and to elucidate the different retention protocols encouraged. A cross-sectional, observational study. Online, using a computer connected to the Internet in Australia. Two search terms; 'orthodontic retainer' and 'how long should someone wear a retainer after their braces are removed?' were entered alternatively into five search engines. Twenty results for each search term per search engine that fulfilled the inclusion criteria were evaluated in terms of accessibility, usability, reliability and quality of information using the LIDA and DISCERN instruments, ensuring there were no internal or cross-search engine duplicates. Any information about frequency and duration of retainer wear was also collected. Two hundred different websites were identified and assessed. The median overall LIDA score was 72%, corresponding to a moderate quality level. The median total DISCERN score was 47%. Twenty-two websites recommended patients adhere to the specific protocol prescribed to them by their practitioner. There were 45 (22.5%) and 28 (14%) websites advising indefinite use of removable and bonded retainers respectively. Information about retainers on the Internet is easily accessible and usable, though the quality of the content is generally of a moderate level. However, the information is not always accurate and reliable. Both full-time and part-time wear of removable retainers was suggested over greatly varying time periods. Indefinite wear of removable and bonded retainers was also advocated.

Axiomatic Evaluation Method and Content Structure for Information Appliances

ERIC Educational Resources Information Center

Guo, Yinni

2010-01-01

Extensive studies have been conducted to determine how best to present information in order to enhance usability, but not what information is needed to be presented for effective decision making. Hence, this dissertation addresses the factor structure of the nature of information needed for presentation and proposes a more effective method than…

76 FR 51345 - On Behalf of the Accessibility Committee of the Federal Chief Information Officers Council...

Federal Register 2010, 2011, 2012, 2013, 2014

2011-08-18

... usability of government information and data for persons with disabilities. Input from private industry is sought on the following questions: What is private industry doing to implement information technology (IT...? What are state and local governments doing to implement information technology accessibility that the...

Prevention and treatment of hand oedema after stroke.

PubMed

Kuppens, Stefanie P M; Pijlman, Hanneke C P; Hitters, Minou W M G C; van Heugten, Caroline M

2014-01-01

As there is no evidence for a specific treatment for post-stroke-induced hand oedema, rehabilitation centre Blixembosch formalized a best practice protocol. We investigated whether the Blixembosch hand oedema protocol is usable in daily practice and leads to lower incidence (prevention) and shorter duration (treatment) compared with care as usual. In a non-randomised comparative trial, we investigated 206 post-stroke patients admitted to two Dutch rehabilitation centres. Hand volumes were measured at least bi-weekly using a volumeter. Treatment was started according the protocol (Blixembosch) or following care as usual (Leijpark). Usability was assessed with a survey among professionals. In the Blixembosch group, 16% developed oedema after admission, compared with 21% in the control group (p = 0.019). Average duration of oedema (both developed before and after admission) was 6.5 weeks in the Blixembosch group compared with 3.1 weeks in the control group (p = 0.000). Professionals were positive about the protocol. The study showed that the protocol is usable in daily practice and has a small beneficial effect on hand oedema incidence rates compared with care as usual. The negative effect on duration of hand oedema could also be caused by the difference in prognosis between the two groups.

Improving the Interoperability and Usability of NASA Earth Observation Data

NASA Astrophysics Data System (ADS)

Walter, J.; Berrick, S. W.; Murphy, K. J.; Mitchell, A. E.; Tilmes, C.

2014-12-01

NASA's Earth Science Data and Information System Project (ESDIS) is charged with managing, maintaining, and evolving NASA's Earth Observing System Data and Information System (EOSDIS) and is responsible for processing, archiving, and distributing NASA Earth Science data. The system supports a multitude of missions and serves diverse science research and other user communities. While NASA has made, and continues to make, great strides in the discoverability and accessibility of its earth observation data holdings, issues associated with data interoperability and usability still present significant challenges to realizing the full scientific and societal benefits of these data. This concern has been articulated by multiple government agencies, both U.S. and international, as well as other non-governmental organizations around the world. Among these is the White House Office of Science and Technology Policy who, in response, has launched the Big Earth Data Initiative and the Climate Data Initiative to address these concerns for U.S. government agencies. This presentation will describe NASA's approach for addressing data interoperability and usability issues with our earth observation data.

Development of a web-based executive functioning intervention for adolescents with epilepsy: The Epilepsy Journey.

PubMed

Modi, Avani C; Schmidt, Matthew; Smith, Aimee W; Turnier, Luke; Glaser, Noah; Wade, Shari L

2017-07-01

Youth with epilepsy exhibit significant deficits in executive functioning (EF), yet there are few interventions to improve EF for adolescents. The aims of the current study were to develop an individually-tailored intervention, called Epilepsy Journey, to improve aspects of EF through an iterative, patient-centered process including focus groups and usability testing. Five adolescents and caregivers participated in focus groups. This input was used to develop ten learning modules based on subscales of the Behavioral Rating Inventory of Executive Functions and key issues that may impact EF in adolescents. Six adolescents participated in usability testing and a usability expert conducted a heuristic evaluation. Demographic information, chart reviews and measures of EF were also completed. Focus group participants and their parents reported difficulties with memory, attention, organization, monitoring, initiation, impulsivity, emotional control, sleep, awareness in schools and managing stress. They also identified successful strategies to address memory and organizational difficulties. Usability testing of the resultant Epilepsy Journey modules revealed problems with navigation and identified features that promoted usability, including progress bars and interactive modules. Program modifications were made after each usability trial resulting in a relatively brief, interactive and readily navigable program. Perceived utility was high with all but one participant. Participants rated the content as helpful and indicated they would recommend Epilepsy Journey to others. Feedback from the focus group and usability testing yielded a feasible, acceptable, relevant and user-friendly web-based intervention for adolescents with epilepsy. The Epilepsy Journey program will be further tested in an open pilot with adolescents with epilepsy and associated EF deficits. Copyright © 2017 Elsevier Inc. All rights reserved.

Bryophytes for Beginners: The Usability of a Printed Dichotomous Key versus a Multi-Access Computer-Based Key for Bryophyte Identification

ERIC Educational Resources Information Center

Stagg, Bethan C.; Donkin, Maria E.; Smith, Alison M.

2015-01-01

Bryophytes are a rewarding study group in field biology and the UK bryophyte flora has international importance to biodiversity conservation. We designed an identification key to common woodland moss species and compared the usability of two formats, web-based multi-access and printed dichotomous key, with undergraduate students. The rate of…

Traffic records needs of local governments in Virginia.

DOT National Transportation Integrated Search

1975-01-01

The state of Virginia has a unilateral traffic records system whereby localities are compelled by law to provide law enforcement information to the state without any assurance that usable information will be returned to the localities. This situation...

Quality of online health information about oral contraceptives from Hebrew-language websites.

PubMed

Neumark, Yehuda; Flum, Lior; Lopez-Quintero, Catalina; Shtarkshall, Ronny

2012-09-24

The Internet is a frequently used source of health information. Adolescents in particular seem to be receptive to online health information (OHI) and often incorporate such information in their decision-making processes. Yet, OHI is often incomplete, inaccurate, or unreliable. This study assessed the quality of Hebrew online (non-user-generated) content on oral contraceptives (OC), with regard to accuracy/completeness, credibility, and usability. Twenty-nine websites in Hebrew, including those of the four Israeli HMOs, were identified and evaluated. The websites were categorized as: HMO, health portal, contraception-specific, promotional-commercial, and life style and women's health. A set of established content parameters was selected by a family planning expert to assess accuracy/completeness. The Health on the Net Foundation Code of Conduct (HONcode) principles were used to assess the websites' reliability. Usability was assessed by applying items selected from the Minervation Validation and the University of Michigan's 'Website Evaluation checklist' scale. Mean scores, standard deviations (SD), and ranges were calculated for all websites and for category-specific websites. Correlation between dimensions and Inter-rater reliability were also examined. The mean score for accuracy/completeness was 50.9% for all websites (SD=30.1%, range 8-100%). Many websites failed to provide complete information, or provided inaccurate information regarding what to do when a pill is missed and when to use back-up methods. The average credibility score for all websites was 70.6% (SD=15.1, range=38=98%). The credibility parameters that were most commonly absent were funding source, authoring, date of content creation and last modification, explicit reference to evidence-based information, and references and citations. The average usability score for all websites was 94.5% (SD=6.9%, range 79-100%). A weak correlation was found between the three quality parameters assessed. Wide variation was noted in the quality of Hebrew-language OC websites. HMOs' websites scored highest on credibility and usability, and contraceptive-specific websites exhibited the greatest accuracy/completeness. The findings highlight the need to establish quality guidelines for health website content, train health care providers in assisting their patients to seek high quality OHI, and strengthen e-health literacy skills among online-information seekers, including perhaps health professionals.

Quality of online health information about oral contraceptives from Hebrew-language websites

PubMed Central

2012-01-01

Background The Internet is a frequently used source of health information. Adolescents in particular seem to be receptive to online health information (OHI) and often incorporate such information in their decision-making processes. Yet, OHI is often incomplete, inaccurate, or unreliable. This study assessed the quality of Hebrew online (non-user-generated) content on oral contraceptives (OC), with regard to accuracy/completeness, credibility, and usability. Methods Twenty-nine websites in Hebrew, including those of the four Israeli HMOs, were identified and evaluated. The websites were categorized as: HMO, health portal, contraception-specific, promotional-commercial, and life style and women’s health. A set of established content parameters was selected by a family planning expert to assess accuracy/completeness. The Health on the Net Foundation Code of Conduct (HONcode) principles were used to assess the websites’ reliability. Usability was assessed by applying items selected from the Minervation Validation and the University of Michigan’s ′Website Evaluation checklist′ scale. Mean scores, standard deviations (SD), and ranges were calculated for all websites and for category-specific websites. Correlation between dimensions and Inter-rater reliability were also examined. Results The mean score for accuracy/completeness was 50.9% for all websites (SD=30.1%, range 8–100%). Many websites failed to provide complete information, or provided inaccurate information regarding what to do when a pill is missed and when to use back–up methods. The average credibility score for all websites was 70.6% (SD=15.1, range=38=98%). The credibility parameters that were most commonly absent were funding source, authoring, date of content creation and last modification, explicit reference to evidence-based information, and references and citations. The average usability score for all websites was 94.5% (SD=6.9%, range 79–100%). A weak correlation was found between the three quality parameters assessed. Conclusions Wide variation was noted in the quality of Hebrew-language OC websites. HMOs’ websites scored highest on credibility and usability, and contraceptive-specific websites exhibited the greatest accuracy/completeness. The findings highlight the need to establish quality guidelines for health website content, train health care providers in assisting their patients to seek high quality OHI, and strengthen e-health literacy skills among online-information seekers, including perhaps health professionals. PMID:23006798

Exploring Pacific Northwest ecosystem resilience: packaging climate change science for federal managers

NASA Astrophysics Data System (ADS)

Bachelet, D. M.

2014-12-01

Climate change is projected to jeopardize ecosystems in the Pacific Northwest. Managing ecosystems for future resilience requires collaboration, innovation and communication. The abundance of data and documents describing the uncertainty around both climate change projections and impacts has become challenging to managers who have little funding and limited time to digest and incorporate these materials into planning and implementation documents. We worked with US Forest Service and BLM managers to help them develop vulnerability assessments and identify on-the-ground strategies to address climate change challenges on the federal lands in northwest Oregon (Siuslaw, Willamette and Mt. Hood National Forests; Eugene and Salem BLM Districts). We held workshops to promote dialogue about climate change, which were particularly effective in fostering discussions between the managers who often do not have the time to share their knowledge and compare experiences across administrative boundaries. We used the Adaptation for Conservation Targets (ACT) framework to identify measurable management objectives and rapidly assess local vulnerabilities. We used databasin.org to centralize usable information, including state-of-the-art CMIP5 climate projections, for the mandated assessments of vulnerability and resilience. We introduced participants to a decision support framework providing opportunities to develop more effective adaptation strategies. We built a special web page to hold the information gathered at the workshops and provide easy access to climate change information. We are now working with several Landscape Conservation Cooperatives (LCCs) to design gateways - conservation atlases - to their relevant data repositories on databasin.org and working with them to develop web tools that can provide usable information for their own vulnerability assessments.

Usability evaluation of a medication reconciliation tool: Embedding safety probes to assess users' detection of medication discrepancies.

PubMed

Russ, Alissa L; Jahn, Michelle A; Patel, Himalaya; Porter, Brian W; Nguyen, Khoa A; Zillich, Alan J; Linsky, Amy; Simon, Steven R

2018-06-01

An electronic medication reconciliation tool was previously developed by another research team to aid provider-patient communication for medication reconciliation. To evaluate the usability of this tool, we integrated artificial safety probes into standard usability methods. The objective of this article is to describe this method of using safety probes, which enabled us to evaluate how well the tool supports users' detection of medication discrepancies. We completed a mixed-method usability evaluation in a simulated setting with 30 participants: 20 healthcare professionals (HCPs) and 10 patients. We used factual scenarios but embedded three artificial safety probes: (1) a missing medication (i.e., omission); (2) an extraneous medication (i.e., commission); and (3) an inaccurate dose (i.e., dose discrepancy). We measured users' detection of each probe to estimate the probability that a HCP or patient would detect these discrepancies. Additionally, we recorded participants' detection of naturally occurring discrepancies. Each safety probe was detected by ≤50% of HCPs. Patients' detection rates were generally higher. Estimates indicate that a HCP and patient, together, would detect 44.8% of these medication discrepancies. Additionally, HCPs and patients detected 25 and 45 naturally-occurring discrepancies, respectively. Overall, detection of medication discrepancies was low. Findings indicate that more advanced interface designs are warranted. Future research is needed on how technologies can be designed to better aid HCPs' and patients' detection of medication discrepancies. This is one of the first studies to evaluate the usability of a collaborative medication reconciliation tool and assess HCPs' and patients' detection of medication discrepancies. Results demonstrate that embedded safety probes can enhance standard usability methods by measuring additional, clinically-focused usability outcomes. The novel safety probes we used may serve as an initial, standard set for future medication reconciliation research. More prevalent use of safety probes could strengthen usability research for a variety of health information technologies. Published by Elsevier Inc.

Intraoperative ablation of atrial fibrillation - replication of the Cox's maze III procedure with re-usable radiofrequency and cryoablation devices.

PubMed

Patwardhan, Anil

2010-01-01

The cut and sew Cox's maze III procedure is time-consuming. Therefore, various energy sources have been used for ablation, to replace the cut and sew technique. We have used the bipolar radiofrequency output of a standard electrosurgical generator with re-usable forceps for replicating the Cox's maze III procedure from August 1996. In addition, re-usable nitrous oxide based cryoprobe has been used at the atrioventricular valve annuli and on the coronary sinus. The 85.7% cure rate at one year compares with that for surgical ablation of atrial fibrillation using alternative energy sources.

Usability evaluation of the digital anger thermometer app.

PubMed

Mattson, Donald C

2017-09-01

The digital anger thermometer is a prototype for a mobile application (app) for use with adults in anger management treatment. The digital anger thermometer incorporates standards of software development in addition to anger management resources from the Substance Abuse and Mental Health Services Administration. The digital anger thermometer underwent a usability study conducted by five expert reviewers. The results indicate that it is easy to learn, efficient, and ergonomically sound. However, it does not offer support features or user-error tolerance. The digital anger thermometer prototype requires additional usability studies and comparative research in order for it to become an actual mental health app.

Metadata squared: enhancing its usability for volunteered geographic information and the GeoWeb

USGS Publications Warehouse

Poore, Barbara S.; Wolf, Eric B.; Sui, Daniel Z.; Elwood, Sarah; Goodchild, Michael F.

2013-01-01

The Internet has brought many changes to the way geographic information is created and shared. One aspect that has not changed is metadata. Static spatial data quality descriptions were standardized in the mid-1990s and cannot accommodate the current climate of data creation where nonexperts are using mobile phones and other location-based devices on a continuous basis to contribute data to Internet mapping platforms. The usability of standard geospatial metadata is being questioned by academics and neogeographers alike. This chapter analyzes current discussions of metadata to demonstrate how the media shift that is occurring has affected requirements for metadata. Two case studies of metadata use are presented—online sharing of environmental information through a regional spatial data infrastructure in the early 2000s, and new types of metadata that are being used today in OpenStreetMap, a map of the world created entirely by volunteers. Changes in metadata requirements are examined for usability, the ease with which metadata supports coproduction of data by communities of users, how metadata enhances findability, and how the relationship between metadata and data has changed. We argue that traditional metadata associated with spatial data infrastructures is inadequate and suggest several research avenues to make this type of metadata more interactive and effective in the GeoWeb.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Adam, J. C.; Stephens, J. C.; Chung, Serena

As managers of agricultural and natural resources are confronted with uncertainties in global change impacts, the complexities associated with the interconnected cycling of nitrogen, carbon, and water present daunting management challenges. Existing models provide detailed information on specific sub-systems (land, air, water, economics, etc). An increasing awareness of the unintended consequences of management decisions resulting from interconnectedness of these sub-systems, however, necessitates coupled regional earth system models (EaSMs). Decision makers’ needs and priorities can be integrated into the model design and development processes to enhance decision-making relevance and "usability" of EaSMs. BioEarth is a current research initiative with a focusmore » on the U.S. Pacific Northwest region that explores the coupling of multiple stand-alone EaSMs to generate usable information for resource decision-making. Direct engagement between model developers and non-academic stakeholders involved in resource and environmental management decisions throughout the model development process is a critical component of this effort. BioEarth utilizes a "bottom-up" approach, upscaling a catchment-scale model to basin and regional scales, as opposed to the "top-down" approach of downscaling global models utilized by most other EaSM efforts. This paper describes the BioEarth initiative and highlights opportunities and challenges associated with coupling multiple stand-alone models to generate usable information for agricultural and natural resource decision-making.« less

Usability of EFBs for Viewing NOTAMs and AIS/MET Data Link Messages

NASA Technical Reports Server (NTRS)

Evans, Emory T.; Young, Steven D.; Daniels, Tammi S.; Myer, Robert R.

2014-01-01

Electronic Flight Bags (EFB) are increasingly integral to flight deck information management. A piloted simulation study was conducted at NASA Langley Research Center, one aspect of which was to evaluate the usability and acceptability of EFBs for viewing and managing Notices to Airmen (NOTAMs) and data linked aeronautical information services (AIS) and meteorological information (MET). The study simulated approaches and landings at Memphis International Airport (KMEM) using various flight scenarios and weather conditions. Ten two-pilot commercial airline crews participated, utilizing the Cockpit Motion Facility's Research Flight Deck (CMF/RFD) simulator. Each crew completed approximately two dozen flights over a two day period. Two EFBs were installed, one for each pilot. Study data were collected in the form of questionnaire/interview responses, audio/video recordings, oculometer recordings, and aircraft/system state data. Preliminary usability results are reported primarily based on pilot interviews and responses to questions focused on ease of learning, ease of use, usefulness, satisfaction, and acceptability. Analysis of the data from the other objective measures (e.g., oculometer) is ongoing and will be reported in a future publication. This paper covers how the EFB functionality was set up for the study; the NOTAM, AIS/MET data link, and weather messages that were presented; questionnaire results; selected pilot observations; and conclusions.

A personal health information toolkit for health intervention research.

PubMed

Kizakevich, Paul N; Eckhoff, Randall; Weger, Stacey; Weeks, Adam; Brown, Janice; Bryant, Stephanie; Bakalov, Vesselina; Zhang, Yuying; Lyden, Jennifer; Spira, James

2014-01-01

With the emergence of mobile health (mHealth) apps, there is a growing demand for better tools for developing and evaluating mobile health interventions. Recently we developed the Personal Health Intervention Toolkit (PHIT), a software framework which eases app implementation and facilitates scientific evaluation. PHIT integrates self-report and physiological sensor instruments, evidence-based advisor logic, and self-help interventions such as meditation, health education, and cognitive behavior change. PHIT can be used to facilitate research, interventions for chronic diseases, risky behaviors, sleep, medication adherence, environmental monitoring, momentary data collection health screening, and clinical decision support. In a series of usability evaluations, participants reported an overall usability score of 4.5 on a 1-5 Likert scale and an 85 score on the System Usability Scale, indicating a high percentile rank of 95%.

Human experience and product usability: principles to assist the design of user-product interactions.

PubMed

Chamorro-Koc, Marianella; Popovic, Vesna; Emmison, Michael

2009-07-01

This paper introduces research that investigates how human experience influences people's understandings of product usability. It describes an experiment that employs visual representation of concepts to elicit participants' ideas of a product's use. Results from the experiment lead to the identification of relationships between human experience, knowledge, and context-of-use--relationships that influence designers' and users' concepts of product usability. These relationships are translated into design principles that inform the design activity with respect to the aspects of experience that trigger people's understanding of a product's use. A design tool (ECEDT) is devised to aid designers in the application of these principles. This tool is then trialled in the context of a design task in order to verify applicability of the findings.

Usability Study of Two Collocated Prototype System Displays

NASA Technical Reports Server (NTRS)

Trujillo, Anna C.

2007-01-01

Currently, most of the displays in control rooms can be categorized as status screens, alerts/procedures screens (or paper), or control screens (where the state of a component is changed by the operator). The primary focus of this line of research is to determine which pieces of information (status, alerts/procedures, and control) should be collocated. Two collocated displays were tested for ease of understanding in an automated desktop survey. This usability study was conducted as a prelude to a larger human-in-the-loop experiment in order to verify that the 2 new collocated displays were easy to learn and usable. The results indicate that while the DC display was preferred and yielded better performance than the MDO display, both collocated displays can be easily learned and used.

A Modified User-Oriented Heuristic Evaluation of a Mobile Health System for Diabetes Self-management Support

PubMed Central

Georgsson, Mattias; Staggers, Nancy; Weir, Charlene

2016-01-01

Mobile health platforms offer significant opportunities for improving diabetic self-care, but only if adequate usability exists. Expert evaluations such as heuristic evaluation can provide distinct usability information about systems. The purpose of this study was to complete a usability evaluation of a mobile health system for diabetes patients using a modified heuristic evaluation technique of (1) dual-domain experts (healthcare professionals, usability experts), (2) validated scenarios and user tasks related to patients’ self-care, and (3) in-depth severity factor ratings. Experts identified 129 usability problems with 274 heuristic violations for the system. The categories Consistency and Standards dominated at 24.1% (n = 66), followed by Match Between System and Real World at 22.3% (n = 61). Average severity ratings across system views were 2.8 (of 4), with 9.3% (n = 12) rated as catastrophic and 53.5% (n = 69) as major. The large volume of violations with severe ratings indicated clear priorities for redesign. The modified heuristic approach allowed evaluators to identify unique and important issues, including ones related to self-management and patient safety. This article provides a template for one type of expert evaluation adding to the informaticists’ toolbox when needing to conduct a fast, resource-efficient and user-oriented heuristic evaluation. PMID:26657618

A Modified User-Oriented Heuristic Evaluation of a Mobile Health System for Diabetes Self-management Support.

PubMed

Georgsson, Mattias; Staggers, Nancy; Weir, Charlene

2016-02-01

Mobile health platforms offer significant opportunities for improving diabetic self-care, but only if adequate usability exists. Expert evaluations such as heuristic evaluation can provide distinct usability information about systems. The purpose of this study was to complete a usability evaluation of a mobile health system for diabetes patients using a modified heuristic evaluation technique of (1) dual-domain experts (healthcare professionals, usability experts), (2) validated scenarios and user tasks related to patients' self-care, and (3) in-depth severity factor ratings. Experts identified 129 usability problems with 274 heuristic violations for the system. The categories Consistency and Standards dominated at 24.1% (n = 66), followed by Match Between System and Real World at 22.3% (n = 61). Average severity ratings across system views were 2.8 (of 4), with 9.3% (n = 12) rated as catastrophic and 53.5% (n = 69) as major. The large volume of violations with severe ratings indicated clear priorities for redesign. The modified heuristic approach allowed evaluators to identify unique and important issues, including ones related to self-management and patient safety. This article provides a template for one type of expert evaluation adding to the informaticists' toolbox when needing to conduct a fast, resource-efficient and user-oriented heuristic evaluation.

A usability study of a mobile health application for rural Ghanaian midwives.

PubMed

Vélez, Olivia; Okyere, Portia Boakye; Kanter, Andrew S; Bakken, Suzanne

2014-01-01

Midwives in rural Ghana work at the frontline of the health care system, where they have access to essential data about the patient population. However, current methods of data capture, primarily pen and paper, make the data neither accessible nor usable for monitoring patient care or program evaluation. Electronic health (eHealth) systems present a potential mechanism for enhancing the roles of midwives by providing tools for collecting, exchanging, and viewing patient data as well as offering midwives the possibility for receiving information and decision support. Introducing such technology in low-resource settings has been challenging because of low levels of user acceptance, software design that does not match the end-user environment, and/or unforeseen challenges such as irregular power availability. These challenges are often attributable to a lack of understanding by the software developers of the end users' needs and work environment. A mobile health (mHealth) application known as mClinic was designed to support midwife access to the Millennium Village-Global Network, an eHealth delivery platform that captures data for managing patient care as well as program evaluation and monitoring, decision making, and management. We conducted a descriptive usability study composed of 3 phases to evaluate an mClinic prototype: 1) hybrid lab-live software evaluation of mClinic to identify usability issues; 2) completion of a usability questionnaire; and 3) interviews that included low-fidelity prototyping of new functionality proposed by midwives. The heuristic evaluation identified usability problems related to 4 of 8 usability categories. Analysis of usability questionnaire data indicated that the midwives perceived mClinic as useful but were more neutral about the ease of use. Analysis of midwives' reactions to low-fidelity prototypes during the interview process supported the applicability of mClinic to midwives' work and identified the need for additional functionality. User acceptance is essential for the success of any mHealth implementation. Usability testing identified mClinic development flaws and needed software enhancements. © 2014 by the American College of Nurse-Midwives.

Biofeedback in Partial Weight Bearing: Usability of Two Different Devices from a Patient’s and Physical Therapist’s Perspective

PubMed Central

van Lieshout, Remko; Pisters, Martijn F.; Vanwanseele, Benedicte; de Bie, Rob A.; Wouters, Eveline J.; Stukstette, Mirelle J.

2016-01-01

Background Partial weight bearing is frequently instructed by physical therapists in patients after lower-limb trauma or surgery. The use of biofeedback devices seems promising to improve the patient’s compliance with weight-bearing instructions. SmartStep and OpenGo-Science are biofeedback devices that provide real-time feedback. For a successful implementation, usability of the devices is a critical aspect and should be tested from a user’s perspective. Aim To describe the usability from the physical therapists’ and a patients’ perspective of Smartstep and OpenGo-Science to provide feedback on partial weight bearing during supervised rehabilitation of patients after lower-limb trauma or surgery. Methods In a convergent mixed-methods design, qualitative and quantitative data were collected. Usability was subdivided into user performance, satisfaction and acceptability. Patients prescribed with partial weight bearing and their physical therapists were asked to use SmartStep and OpenGo-Science during supervised rehabilitation. Usability was qualitatively tested by a think-aloud method and a semi-structured interview and quantitatively tested by the System-Usability-Scale (SUS) and closed questions. For the qualitative data thematic content analyses were used. Results Nine pairs of physical therapists and their patients participated. The mean SUS scores for patients and physical therapists were for SmartStep 70 and 53, and for OpenGo-Science 79 and 81, respectively. Scores were interpreted with the Curved Grading Scale. The qualitative data showed that there were mixed views and perceptions from patients and physical therapists on satisfaction and acceptability. Conclusion This study gives insight in the usability of two biofeedback devices from the patient’s and physical therapist’s perspective. The overall usability from both perspectives seemed to be acceptable for OpenGo-Science. For SmartStep, overall usability seemed only acceptable from the patient’s perspective. Implication The study findings could help clinicians to decide which biofeedback device is appropriate for their given situation and provide information for future development of biofeedback devices. PMID:27798674

Can Visualizing Document Space Improve Users' Information Foraging?

ERIC Educational Resources Information Center

Song, Min

1998-01-01

This study shows how users access relevant information in a visualized document space and determine whether BiblioMapper, a visualization tool, strengthens an information retrieval (IR) system and makes it more usable. BiblioMapper, developed for a CISI collection, was evaluated by accuracy, time, and user satisfaction. Users' navigation…

Alabama Vocational Management Information System. Final Report.

ERIC Educational Resources Information Center

Patterson, Douglas; And Others

A project was developed to design and implement a management information system (MIS) to provide decision makers with accurate, usable, and timely data and information concerning input, output, and impact of vocational education. The objectives were to (1) design an MIS embracing student accounting, fiscal accounting, manpower analysis, and…

Quality of information available on the World Wide Web for patients undergoing thyroidectomy: review.

PubMed

Muthukumarasamy, S; Osmani, Z; Sharpe, A; England, R J A

2012-02-01

This study aimed to assess the quality of information available on the World Wide Web for patients undergoing thyroidectomy. The first 50 web-links generated by internet searches using the five most popular search engines and the key word 'thyroidectomy' were evaluated using the Lida website validation instrument (assessing accessibility, usability and reliability) and the Flesch Reading Ease Score. We evaluated 103 of a possible 250 websites. Mean scores (ranges) were: Lida accessibility, 48/63 (27-59); Lida usability, 36/54 (21-50); Lida reliability, 21/51 (4-38); and Flesch Reading Ease, 43.9 (2.6-77.6). The quality of internet health information regarding thyroidectomy is variable. High ranking and popularity are not good indicators of website quality. Overall, none of the websites assessed achieved high Lida scores. In order to prevent the dissemination of inaccurate or commercially motivated information, we recommend independent labelling of medical information available on the World Wide Web.

Developing a Security Metrics Scorecard for Healthcare Organizations.

PubMed

Elrefaey, Heba; Borycki, Elizabeth; Kushniruk, Andrea

2015-01-01

In healthcare, information security is a key aspect of protecting a patient's privacy and ensuring systems availability to support patient care. Security managers need to measure the performance of security systems and this can be achieved by using evidence-based metrics. In this paper, we describe the development of an evidence-based security metrics scorecard specific to healthcare organizations. Study participants were asked to comment on the usability and usefulness of a prototype of a security metrics scorecard that was developed based on current research in the area of general security metrics. Study findings revealed that scorecards need to be customized for the healthcare setting in order for the security information to be useful and usable in healthcare organizations. The study findings resulted in the development of a security metrics scorecard that matches the healthcare security experts' information requirements.

Clinical pathways for primary care: current use, interest and perceived usability.

PubMed

Waters, Richard C; Toy, Jennifer M; Drechsler, Adam

2018-02-26

Translating clinical evidence to daily practice remains a challenge and may improve with clinical pathways. We assessed interest in and usability of clinical pathways by primary care professionals. An online survey was created. Interest in pathways for patient care and learning was assessed at start and finish. Participants completed baseline questions then pathway-associated question sets related to management of 2 chronic diseases. Perceived pathway usability was assessed using the system usability scale. Accuracy and confidence of answers was compared for baseline and pathway-assisted questions. Of 115 participants, 17.4% had used clinical pathways, the lowest of decision support tool types surveyed. Accuracy and confidence in answers significantly improved for all pathways. Interest in using pathways daily or weekly was above 75% for the respondents. There is low utilization of, but high interest in, clinical pathways by primary care clinicians. Pathways improve accuracy and confidence in answering written clinical questions.

Assessment of the quality of patient-oriented information over internet on testicular cancer.

PubMed

Prasanth, Anton S; Jayarajah, Umesh; Mohanappirian, Ranganathan; Seneviratne, Sanjeewa A

2018-05-02

This study aimed to assess the quality and readability of patient education information available on the internet on testicular cancer. Internet searches were performed using the keywords 'testicular cancer', 'testicular tumour', 'testicular tumor', 'testicular malignancy', 'germ cell tumour' and 'germ cell tumor' using Google, Yahoo! And Bing search engines with default settings. The first 50 web links appeared in each search engine were evaluated for their readability by using the validated Flesch Reading Ease Score (FRES) while accessibility, usability and reliability were assessed using the LIDA tool. The quality was assessed using DISCERN instrument. Non-parametric tests were used for statistical analysis. Overall, 900 websites were assessed and 62 websites were included in the analysis. Twenty two (22) websites (35.5%) were certified by Health on the Net Foundation code of conduct (HON code). The majority (n = 57, 91.9%) were non-governmental websites. The median FRES score was 51.6 (range: 28.1-74.1), the overall median LIDA score was 115 (range: 81-147); accessibility 55 (range: 46-61), reliability 22 (range: 8-45) and usability 38.5 (range: 21-50), while the median DISCERN score was 43.5 (range: 16-69). The DISCERN score was significantly associated with the overall LIDA score and usability and reliability components of the LIDA score (p < 0.001). However, no significant associations were observed between readability and accessibility. A significant correlation was noted between usability and reliability components of the LIDA score (Spearman's rho: 0.789, p < 0.001). In this study, the readability, reliability and quality scores of most websites were found to be suboptimal and hence, there is potential for improvement. As the internet is expanding rapidly as a readily available source of information to the public, it is essential to implement steps to ensure that highest quality information is provided without any commercial motivation or bias.

36 CFR 1193.37 - Information pass through.

Code of Federal Regulations, 2011 CFR

2011-07-01

... 36 Parks, Forests, and Public Property 3 2011-07-01 2011-07-01 false Information pass through. 1193.37 Section 1193.37 Parks, Forests, and Public Property ARCHITECTURAL AND TRANSPORTATION BARRIERS COMPLIANCE BOARD TELECOMMUNICATIONS ACT ACCESSIBILITY GUIDELINES Requirements for Accessibility and Usability...

36 CFR 1193.37 - Information pass through.

Code of Federal Regulations, 2010 CFR

2010-07-01

... 36 Parks, Forests, and Public Property 3 2010-07-01 2010-07-01 false Information pass through. 1193.37 Section 1193.37 Parks, Forests, and Public Property ARCHITECTURAL AND TRANSPORTATION BARRIERS COMPLIANCE BOARD TELECOMMUNICATIONS ACT ACCESSIBILITY GUIDELINES Requirements for Accessibility and Usability...

Traveler information services in rural tourism areas : appendix C, observations at tourist interactions with kiosks

DOT National Transportation Integrated Search

2000-06-30

This report presents a series of observations of tourists' experiences with kiosks providing traveler information services at rural tourism areas. The kiosks were assessed in five areas: reliability visibility, usability, usefulness, and adaptability...

36 CFR 1193.37 - Information pass through.

Code of Federal Regulations, 2012 CFR

2012-07-01

... 36 Parks, Forests, and Public Property 3 2012-07-01 2012-07-01 false Information pass through. 1193.37 Section 1193.37 Parks, Forests, and Public Property ARCHITECTURAL AND TRANSPORTATION BARRIERS COMPLIANCE BOARD TELECOMMUNICATIONS ACT ACCESSIBILITY GUIDELINES Requirements for Accessibility and Usability...

36 CFR 1193.37 - Information pass through.

Code of Federal Regulations, 2014 CFR

2014-07-01

... 36 Parks, Forests, and Public Property 3 2014-07-01 2014-07-01 false Information pass through. 1193.37 Section 1193.37 Parks, Forests, and Public Property ARCHITECTURAL AND TRANSPORTATION BARRIERS COMPLIANCE BOARD TELECOMMUNICATIONS ACT ACCESSIBILITY GUIDELINES Requirements for Accessibility and Usability...

Validating the usability of an interactive Earth Observation based web service for landslide investigation

NASA Astrophysics Data System (ADS)

Albrecht, Florian; Weinke, Elisabeth; Eisank, Clemens; Vecchiotti, Filippo; Hölbling, Daniel; Friedl, Barbara; Kociu, Arben

2017-04-01

Regional authorities and infrastructure maintainers in almost all mountainous regions of the Earth need detailed and up-to-date landslide inventories for hazard and risk management. Landslide inventories usually are compiled through ground surveys and manual image interpretation following landslide triggering events. We developed a web service that uses Earth Observation (EO) data to support the mapping and monitoring tasks for improving the collection of landslide information. The planned validation of the EO-based web service does not only cover the analysis of the achievable landslide information quality but also the usability and user friendliness of the user interface. The underlying validation criteria are based on the user requirements and the defined tasks and aims in the work description of the FFG project Land@Slide (EO-based landslide mapping: from methodological developments to automated web-based information delivery). The service will be validated in collaboration with stakeholders, decision makers and experts. Users are requested to test the web service functionality and give feedback with a web-based questionnaire by following the subsequently described workflow. The users will operate the web-service via the responsive user interface and can extract landslide information from EO data. They compare it to reference data for quality assessment, for monitoring changes and for assessing landslide-affected infrastructure. An overview page lets the user explore a list of example projects with resulting landslide maps and mapping workflow descriptions. The example projects include mapped landslides in several test areas in Austria and Northern Italy. Landslides were extracted from high resolution (HR) and very high resolution (VHR) satellite imagery, such as Landsat, Sentinel-2, SPOT-5, WorldView-2/3 or Pléiades. The user can create his/her own project by selecting available satellite imagery or by uploading new data. Subsequently, a new landslide extraction workflow can be initiated through the functionality that the web service provides: (1) a segmentation of the image into spectrally homogeneous objects, (2) a classification of the objects into landslide and non-landslide areas and (3) an editing tool for the manual refinement of extracted landslide boundaries. In addition, the user interface of the web service provides tools that enable the user (4) to perform a monitoring that identifies changes between landslide maps of different points in time, (5) to perform a validation of the landslide maps by comparing them to reference data, and (6) to perform an assessment of affected infrastructure by comparing the landslide maps to respective infrastructure data. After exploring the web service functionality, the users are asked to fill in the online validation protocol in form of a questionnaire in order to provide their feedback. Concerning usability, we evaluate how intuitive the web service functionality can be operated, how well the integrated help information guides the users, and what kind of background information, e.g. remote sensing concepts and theory, is necessary for a practitioner to fully exploit the value of EO data. The feedback will be used for improving the user interface and for the implementation of additional functionality.

Knowledge transfer: what drug information would specialist doctors need to support their clinical practice? Results of a survey and of three focus groups in Italy.

PubMed

Formoso, Giulio; Rizzini, Paolo; Bassi, Maurizio; Bonfanti, Paolo; Rizzardini, Giuliano; Campomori, Annalisa; Mosconi, Paola

2016-09-01

The wide offer of information on pharmaceuticals does not often fulfill physicians' needs: problems of relevance, access, quality and applicability are widely recognized, and doctors often rely on their own experience and expert opinions rather than on available evidence. A quali-quantitative research was carried out in Italy to provide an overview on information seeking behavior and information needs of doctors, in particular of infectious disease specialists, and to suggest an action plan for improving relevance, quality and usability of scientific information. We did a quantitative survey and three focus groups. Two hundred infectious disease specialists answered a 24-item questionnaire aimed at investigating features of scientific information they receive and their ratings about its completeness, quality and usability. Subsequent focus groups, each involving eight specialists, investigated their opinions on information sources and materials, and their suggestions on how these could better support their information needs. The quantitative survey indicated doctors' appreciation of traditional channels (especially drug representatives) and information materials (brochures), but also their attitude to autonomous search of information and their wish to have more digital channels available. Focus groups provided more depth and, not surprisingly, revealed that physicians consider critical to get complete, comparative and specific information quickly, but also that they would like to discuss their doubts with expert colleagues. Quite strikingly, limited concerns were expressed on information validity, potential biases and conflicts of interests, as scientific validity seems to be related to the perceived authoritativeness of information sources rather than to the availability of a transparent evaluation framework. Although this research investigated views of infectious disease specialists, we believe that their opinions and perceived needs should not substantially differ from those of other clinicians, either in primary or in secondary care. In participants' view, the ideal information framework should provide quick and tailored answers through available evidence and favor the exchange of information between practitioners and trusted experts. The general consensus existing within the scientific and medical community on the need for integrating available evidence and experience is confirmed, although the issues of information validity and conflicts of interests seem definitely overlooked.

Usability Studies In Virtual And Traditional Computer Aided Design Environments For Spatial Awareness

DTIC Science & Technology

2017-08-08

Usability Studies In Virtual And Traditional Computer Aided Design Environments For Spatial Awareness Dr. Syed Adeel Ahmed, Xavier University of...virtual environment with wand interfaces compared directly with a workstation non-stereoscopic traditional CAD interface with keyboard and mouse. In...navigate through a virtual environment. The wand interface provides a significantly improved means of interaction. This study quantitatively measures the

Assessment of diet and physical activity of brazilian schoolchildren: usability testing of a web-based questionnaire.

PubMed

da Costa, Filipe Ferreira; Schmoelz, Camilie Pacheco; Davies, Vanessa Fernandes; Di Pietro, Patrícia Faria; Kupek, Emil; de Assis, Maria Alice Altenburg

2013-08-19

Information and communication technology (ICT) has been used with increasing frequency for the assessment of diet and physical activity in health surveys. A number of Web-based questionnaires have been developed for children and adolescents. However, their usability characteristics have scarcely been reported, despite their potential importance for improving the feasibility and validity of ICT-based methods. The objective of this study was to describe the usability evaluation of the Consumo Alimentar e Atividade Física de Escolares (CAAFE) questionnaire (Food Consumption and Physical Activity Questionnaire for schoolchildren), a new Web-based survey tool for the self-assessment of diet and physical activity by schoolchildren. A total of 114 schoolchildren aged 6 to 12 years took part in questionnaire usability testing carried out in computer classrooms at five elementary schools in the city of Florianopolis, Brazil. Schoolchildren used a personal computer (PC) equipped with software for recording what is on the computer screen and the children's speech during usability testing. Quantitative and qualitative analyses took into account objective usability metrics such as error counts and time to complete a task. Data on the main difficulties in accomplishing the task and the level of satisfaction expressed by the children were assessed by the observers using a standardized form and interviews with the children. Descriptive statistics and content analysis were used to summarize both the quantitative and the qualitative aspects of the data obtained. The mean time for completing the questionnaire was 13.7 minutes (SD 3.68). Compared to the children in 2nd or 3rd grades, those in 4th or 5th grades spent less time completing the questionnaire (median 12.4 vs 13.3 minutes, P=.022), asked for help less frequently (median 0 vs 1.0 count, P=.005), had a lower error count (median 2.0 vs 8.0 count, P<.001), and obtained a higher overall performance score (median 73.0 vs 68.0, P=.005). Children with a PC at home spent less time completing the questionnaire (median 12.3 vs 14.9 minutes, P<.001), had a lower overall error count (median 2.0 vs 9.0 count, P=.03), and had a higher performance score (median 72.0 vs 64.0, P=.005) compared to the children without a PC at home. The most common difficulty in completing the questionnaire was in using the scroll bar. The majority of children reported a positive evaluation (liked a lot or liked) for the four design elements, which were evaluated. The results of the present study provided feedback to improve the final version of the CAAFE questionnaire. Quantitative data showed minor errors and system failures, while qualitative data indicated that, overall, the children enjoyed the CAAFE questionnaire. Grade levels and PC use must be taken into account in Web-based tools designed for children.

Assessment of the usability and impact of the Idaho Health Data Exchange (IHDE).

PubMed

Reis, Janet; MacKenzie, Lisa; Soelberg, Terri; Smith, Jennifer

2016-04-01

Eighty four health care professionals participated in an online survey assessing the usability, and clinical and administrative impact of the Idaho Health Data Exchange's (IHDE) Virtual Health Record (VHR). The IHDE VHR allows authorized users to use a secure web interface to view lab, radiology and transcribed reports from multiple facilities and view medical histories on patients in the data exchange. Results indicate the usability of the IHDE VHR was almost universally positively rated with the Software Usability Measurement Inventory (SUMI) utilized as the assessment method. Medical providers however had the lowest rating of the exchange, raising concerns about the need for additional training and support. The addition of other Idaho health care organizations to the health data exchange was most widely desired, with the most frequently cited benefit being more comprehensive access to patients' records. In contrast to other published evaluations of health data exchanges in the U.S., few of the concerns emerged about cost of implementation of the data exchange or trust in the quality of information contained therein.

Usability and Acceptability of a Web-Based Program for Chemotherapy-Induced Peripheral Neuropathy.

PubMed

Tofthagen, Cindy; Kip, Kevin E; Passmore, Denise; Loy, Ian; Berry, Donna L

2016-07-01

Chemotherapy-induced neuropathy is a painful and debilitating adverse effect of certain chemotherapy drugs. There have not been any patient-centered, easily accessible Web-based interventions to assist with self-management of chemotherapy-induced neuropathy. The aims of this study were to evaluate usability and acceptability and to estimate an effect size of a Web-based intervention for assessing and managing chemotherapy-induced neuropathy. Participants (N = 14) were instructed to complete the Creativity, Optimism, Planning, and Expert Information for Chemotherapy-Induced Peripheral Neuropathy program and provide verbal responses to the program. Participants completed the Chemotherapy Induced Peripheral Neuropathy Assessment Tool and Post-Study System Usability Questionnaire. Iterative changes were made to the COPE-CIPN. Participants were asked to provide feedback on the revised COPE-CIPN, repeat the Chemotherapy Induced Peripheral Neuropathy Assessment Tool, and evaluate acceptability using the Acceptability e-Scale. The COPE-CIPN demonstrated high usability (mean, 1.98 [SD, 1.12]) and acceptability (mean, 4.40 [SD, 0.52]). Comments indicated that the interface was easy to use, and the information was helpful. While neuropathy symptoms continued to increase in this group of patients receiving neurotoxic chemotherapy, there was a decrease in mean level of interference with activities from 53.71 to 39.29 over 3 to 4 months, which indicated a moderate effect (d = 0.39) size. The COPE-CIPN may be a useful intervention to support self-management of chemotherapy-induced neuropathy.

Usability of a CKD educational website targeted to patients and their family members.

PubMed

Diamantidis, Clarissa J; Zuckerman, Marni; Fink, Wanda; Hu, Peter; Yang, Shiming; Fink, Jeffrey C

2012-10-01

Web-based technology is critical to the future of healthcare. As part of the Safe Kidney Care cohort study evaluating patient safety in CKD, this study determined how effectively a representative sample of patients with CKD or family members could interpret and use the Safe Kidney Care website (www.safekidneycare.org), an informational website on safety in CKD. Between November of 2011 and January of 2012, persons with CKD or their family members underwent formal usability testing administered by a single interviewer with a second recording observer. Each participant was independently provided a list of 21 tasks to complete, with each task rated as either easily completed/noncritical error or critical error (user cannot complete the task without significant interviewer intervention). Twelve participants completed formal usability testing. Median completion time for all tasks was 17.5 minutes (range=10-44 minutes). In total, 10 participants had greater than or equal to one critical error. There were 55 critical errors in 252 tasks (22%), with the highest proportion of critical errors occurring when participants were asked to find information on treatments that may damage kidneys, find the website on the internet, increase font size, and scroll to the bottom of the webpage. Participants were generally satisfied with the content and usability of the website. Web-based educational materials for patients with CKD should target a wide range of computer literacy levels and anticipate variability in competency in use of the computer and internet.

Assessing the usability and potential value of seasonal climate forecasts in land management decisions in the southwest UK: challenges and reflections

NASA Astrophysics Data System (ADS)

Soares, Marta Bruno

2017-06-01

The potential usability and benefits of seasonal climate forecasts (SCF) to help inform decision-making processes is widely accepted. However, the practical use of SCF in Europe is still fairly recent and, as such, current knowledge of the added benefits of SCF in supporting and improving decision-making is limited. This study is based on research conducted to co-develop a semi-operational climate service prototype - the Land Management Tool (LMTool) - with farmers in South West regions of the UK. The value of the SCF provided to the farmers was examined to help us understand the usability and (potential) value of these forecasts in farmers' decisions during the winter months of 2015/2016. The findings from the study point to the need to explore and develop (new) research methods capable of addressing the complexity of the decision-making processes, such as those in the farming sector. The farmers who used the SCF perceived it as useful and usable as it helped them change and adapt their decision-making and thus, avoid unnecessary costs. However, to fully grasp the potential value of using SCF, farmers emphasised the need for the provision of SCF for longer periods of time to allow them to build trust and confidence in the information provided. This paper contributes to ongoing discussions about how to assess the use and value of SCF in decision-making processes in a meaningful and effective way.

Evacuation support system for improved medical documentation and information flow in the field.

PubMed

Walderhaug, Ståle; Meland, Per Håkon; Mikalsen, Marius; Sagen, Terje; Brevik, John Ivar

2008-02-01

Documentation of medical treatment and observation of patients during evacuation from the point of injury to definitive treatment is important both for optimizing patient treatment and managing the evacuation process. The current practice in military medical field documentation uses paper forms and voice communication. There are many shortcomings associated with this approach, especially with respect to information capture and sharing processes. Current research addresses the use of new technology for civilian ambulance-to-hospital communication. The research work presented in this article addresses information capture and sharing in extreme military conditions by evaluating a targeted computerized information system called EvacSys during a military exercise in northern Norway in December 2003. EvacSys was designed and implemented in close cooperation with military medical personnel in both Norway and the USA. The system was evaluated and compared to the traditional paper-based documentation method during a military exercise. The on-site evaluation was conducted in a military medical platoon in the Norwegian Armed Forces, using questionnaires, semi-structured interviews, observation and video recording to capture the users' system acceptance. A prototype software system running on a commercial off-the-shelf hardware platform was successfully developed. The evaluation of this system shows that the usability of digital information capturing and sharing are perceived to be at least as good as the traditional paper-based method. The medics found the new digital method to be more viable than the old one. No technical problems were encountered. Our research shows that it is feasible to utilize digital information systems for medical documentation in extreme outdoor environments. The usability concern is of utmost importance, and more research should be put into the design and alignment with existing workflow. Successful digitalization of information at the point of care will provide accurate and timely information for the management of resources during disaster response.

A literature review on optimum and preferred joint angles in automotive sitting posture.

PubMed

Schmidt, Susanne; Amereller, Maximilian; Franz, Matthias; Kaiser, Ralf; Schwirtz, Ansgar

2014-03-01

In this study, a survey of the scientific literature in the field of optimum and preferred human joint angles in automotive sitting posture was conducted by referring to thirty different sources published between 1940 and today. The strategy was to use only sources with numerical angle data in combination with keywords. The aim of the research was to detect commonly used joint angles in interior car design. The main analysis was on data measurement, usability and comparability of the different studies. In addition, the focus was on the reasons for the differently described results. It was found that there is still a lack of information in methodology and description of background. Due to these reasons published data is not always usable to design a modern ergonomic car environment. As a main result of our literature analysis we suggest undertaking further research in the field of biomechanics and ergonomics to work out scientific based and objectively determined "optimum" joint angles in automotive sitting position. Copyright © 2013 Elsevier Ltd and The Ergonomics Society. All rights reserved.

InformedTogether: Usability Evaluation of a Web-Based Decision Aid to Facilitate Shared Advance Care Planning for Severe Chronic Obstructive Pulmonary Disease

PubMed Central

Uhler, Lauren M; Pérez Figueroa, Rafael E; Dickson, Mark; McCullagh, Lauren; Kushniruk, Andre; Monkman, Helen; Witteman, Holly O

2015-01-01

Background Advance care planning may help patients receive treatments that better align with their goals for care. We developed a Web-based decision aid called InformedTogether to facilitate shared advance care planning between chronic obstructive pulmonary disease (COPD) patients and their doctors. Objective Our objective was to assess the usability of the InformedTogether decision aid, including whether users could interact with the decision aid to engage in tasks required for shared decision making, whether users found the decision aid acceptable, and implications for redesign. Methods We conducted an observational study with 15 patients and 8 doctors at two ethnically and socioeconomically diverse outpatient clinics. Data included quantitative and qualitative observations of patients and doctors using the decision aid on tablet or laptop computers and data from semistructured interviews. Patients were shown the decision aid by a researcher acting as the doctor. Pulmonary doctors were observed using the decision aid independently and asked to think aloud (ie, verbalize their thoughts). A thematic analysis was implemented to explore key issues related to decision aid usability. Results Although patients and doctors found InformedTogether acceptable and would recommend that doctors use the decision aid with COPD patients, many patients had difficulty understanding the icon arrays that were used to communicate estimated prognoses and could not articulate the definitions of the two treatment choices—Full Code and Do Not Resuscitate (DNR). Minor usability problems regarding content, links, layout, and consistency were also identified and corresponding recommendations were outlined. In particular, participants suggested including more information about potential changes in quality of life resulting from the alternative advance directives. Some doctor participants thought the decision aid was too long and some thought it may cause nervousness among patients due to the topic area. Conclusions A decision aid for shared advance care planning for severe COPD was found acceptable to most COPD patients and their doctors. However, many patient participants did not demonstrate understanding of the treatment options or prognostic estimates. Many participants endorsed the use of the decision aid between doctors and their patients with COPD, although they desired more information about quality of life. The design must optimize comprehensibility, including revising the presentation of statistical information in the icon array, and feasibility of integration into clinical workflow, including shortening the decision aid. PMID:27025896

Development and preliminary user testing of the DCIDA (Dynamic computer interactive decision application) for 'nudging' patients towards high quality decisions.

PubMed

Bansback, Nick; Li, Linda C; Lynd, Larry; Bryan, Stirling

2014-08-01

Patient decision aids (PtDA) are developed to facilitate informed, value-based decisions about health. Research suggests that even when informed with necessary evidence and information, cognitive errors can prevent patients from choosing the option that is most congruent with their own values. We sought to utilize principles of behavioural economics to develop a computer application that presents information from conventional decision aids in a way that reduces these errors, subsequently promoting higher quality decisions. The Dynamic Computer Interactive Decision Application (DCIDA) was developed to target four common errors that can impede quality decision making with PtDAs: unstable values, order effects, overweighting of rare events, and information overload. Healthy volunteers were recruited to an interview to use three PtDAs converted to the DCIDA on a computer equipped with an eye tracker. Participants were first used a conventional PtDA, and then subsequently used the DCIDA version. User testing was assessed based on whether respondents found the software both usable: evaluated using a) eye-tracking, b) the system usability scale, and c) user verbal responses from a 'think aloud' protocol; and useful: evaluated using a) eye-tracking, b) whether preferences for options were changed, and c) and the decisional conflict scale. Of the 20 participants recruited to the study, 11 were male (55%), the mean age was 35, 18 had at least a high school education (90%), and 8 (40%) had a college or university degree. Eye-tracking results, alongside a mean system usability scale score of 73 (range 68-85), indicated a reasonable degree of usability for the DCIDA. The think aloud study suggested areas for further improvement. The DCIDA also appeared to be useful to participants wherein subjects focused more on the features of the decision that were most important to them (21% increase in time spent focusing on the most important feature). Seven subjects (25%) changed their preferred option when using DCIDA. Preliminary results suggest that DCIDA has potential to improve the quality of patient decision-making. Next steps include larger studies to test individual components of DCIDA and feasibility testing with patients making real decisions.

Assessing and comparing the usability of Chinese EHRs used in two Peking University hospitals to EHRs used in the US: A method of RUA.

PubMed

Xu, Lufei; Wen, Dong; Zhang, Xingting; Lei, Jianbo

2016-05-01

The objective of this study was to investigate the usability level of Chinese hospital Electronic Health Records (EHRs) by assessing the completion times of EHRs for seven "meaningful use (MU)" relevant tasks conducted at two Chinese tertiary hospitals and comparing the results to those of relevant research conducted in US EHRs. Using Rapid Usability Assessment (RUA) developed by the National Center for Cognitive Informatics and Decision Making (NCCD), the usability of EHRs from two Peking University hospitals was assessed using a three-step Keystroke Level Model (KLM) in a laboratory environment. (1) The total EHR task completion time for 7 MU relevant test tasks showed no significant differences between the two Chinese EHRs and their US counterparts, in which the time for thinking was relatively large and comprised 35.6% of the total time. The time for the electronic physician order was the largest. (2) For specific tasks, the mean completion times of the 2 hospital EHR systems spent on recording, modifying and searching (RMS) the medication orders were similar to those for the RMS radioactive tests; the mean time spent on the RMS laboratory test orders were much less. (3) There were 85 usability problems identified in the 2 hospital EHR systems. In Chinese EHRs, a substantial amount of time is required to complete tasks relevant to MU targets and many preventable usability problems can be discovered. The task completion time of the 2 Chinese EHR systems was a little shorter than in the 5 reported US EHR systems, while the differences in smoking status and CPOE tasks were obvious; one main reason for these differences was the use of structured data entry. The efficiency of Chinese and US EHRs was not significantly different. The key to improving the efficiency of both systems lies in expediting the Computerized physician order entry (CPOE) task. Many usability problems can be identified using heuristic assessments and improved by corresponding actions. Copyright © 2016 Elsevier Ireland Ltd. All rights reserved.

Strong Similarity Measures for Ordered Sets of Documents in Information Retrieval.

ERIC Educational Resources Information Center

Egghe, L.; Michel, Christine

2002-01-01

Presents a general method to construct ordered similarity measures in information retrieval based on classical similarity measures for ordinary sets. Describes a test of some of these measures in an information retrieval system that extracted ranked document sets and discuses the practical usability of the ordered similarity measures. (Author/LRW)

Evaluation of the usability of a serious game aiming to teach facial expressions to schizophrenic patients.

PubMed

Isleyen, Filiz; Gulkesen, K Hakan; Cinemre, Buket; Samur, M Kemal; Zayim, Nese; Sen Kaya, Semiha

2014-01-01

In some psychological disorders such as autism and schizophrenia, loss of facial expression recognition skill may complicate patient's daily life. Information technology may help to develop facial expression recognition skill by educational software and games. We designed and developed an interactive web-based educational program with which we performed a usability study before investigating its effectiveness on the schizophrenia patients' ability of emotion perception. The purpose of this study is to describe the usability evaluation for a web-based game set that has been designed to teach facial expressions to schizophrenic patients. The usability study was done at two steps; first, we applied heuristic evaluation and the violations were rated in a scale from most to least severe and the major problems were solved. In the second step, think-aloud method was used and the web site was assessed by five schizophrenic patients. Eight experts participated in the heuristic evaluation, in which a total of 60 violations were identified with a mean severity of 2.77 (range: 0-4). All of the major problems (severity over 2.5) were listed and the usability problems were solved by the development team. After solving the problems, five users with a diagnosis of schizophrenia used the web site with the same scenario. They reported to have experienced minor, but different problems. In conclusion, we suggest that a combination of heuristic evaluation and think-aloud method may be an effective and efficient way for usability evaluations for the serious games that have been designed for special patient groups.

A Mobile App (BEDSide Mobility) to Support Nurses’ Tasks at the Patient's Bedside: Usability Study

PubMed Central

Weinhold, Thomas; Joe, Jonathan; Lovis, Christian; Blondon, Katherine

2018-01-01

Background The introduction of clinical information systems has increased the amount of clinical documentation. Although this documentation generally improves patient safety, it has become a time-consuming task for nurses, which limits their time with the patient. On the basis of a user-centered methodology, we have developed a mobile app named BEDSide Mobility to support nurses in their daily workflow and to facilitate documentation at the bedside. Objective The aim of the study was to assess the usability of the BEDSide Mobility app in terms of the navigation and interaction design through usability testing. Methods Nurses were asked to complete a scenario reflecting their daily work with patients. Their interactions with the app were captured with eye-tracking glasses and by using the think aloud protocol. After completing the tasks, participants filled out the system usability scale questionnaire. Descriptive statistics were used to summarize task completion rates and the users’ performance. Results A total of 10 nurses (aged 21-50) participated in the study. Overall, they were satisfied with the navigation, layout, and interaction design of the app, with the exception of one user who was unfamiliar with smartphones. The problems identified were related to the ambiguity of some icons, the navigation logic, and design inconsistency. Conclusions Besides the usability issues identified in the app, the participants’ results do indicate good usability, high acceptance, and high satisfaction with the developed app. However, the results must be taken with caution because of the poor ecological validity of the experimental setting. PMID:29563074

Reprint of: environmental information for military planning.

PubMed

Doherty, Victoria; Croft, Darryl; Knight, Ashley

2013-11-01

A study was conducted to consider the implications of presenting Environmental Information (EI; information on current environmental features including weather, topography and visibility maps) for military planning to the growing audience of non-technical users; to provide guidance for ensuring usability and for development of a suitable EI interface, and to produce an EI concept interface mock-up to demonstrate initial design ideas. Knowledge was elicited from current EI users and providers regarding anticipated use of EI by non-specialists. This was combined with human factors and cognition expertise to produce guidance for data usability and development of an EI interface. A simple mock-up of an EI concept interface was developed. Recommendations for further development were made including application of the guidance derived, identification of a user test-bed and development of business processes. Copyright © 2012 Elsevier Ltd and The Ergonomics Society. All rights reserved.

Environmental information for military planning.

PubMed

Doherty, Victoria; Croft, Darryl; Knight, Ashley

2013-07-01

A study was conducted to consider the implications of presenting Environmental Information (EI; information on current environmental features including weather, topography and visibility maps) for military planning to the growing audience of non-technical users; to provide guidance for ensuring usability and for development of a suitable EI interface, and to produce an EI concept interface mock-up to demonstrate initial design ideas. Knowledge was elicited from current EI users and providers regarding anticipated use of EI by non-specialists. This was combined with human factors and cognition expertise to produce guidance for data usability and development of an EI interface. A simple mock-up of an EI concept interface was developed. Recommendations for further development were made including application of the guidance derived, identification of a user test-bed and development of business processes. Copyright © 2012 Elsevier Ltd and The Ergonomics Society. All rights reserved.

Heuristic Evaluation on Mobile Interfaces: A New Checklist

PubMed Central

Yáñez Gómez, Rosa; Cascado Caballero, Daniel; Sevillano, José-Luis

2014-01-01

The rapid evolution and adoption of mobile devices raise new usability challenges, given their limitations (in screen size, battery life, etc.) as well as the specific requirements of this new interaction. Traditional evaluation techniques need to be adapted in order for these requirements to be met. Heuristic evaluation (HE), an Inspection Method based on evaluation conducted by experts over a real system or prototype, is based on checklists which are desktop-centred and do not adequately detect mobile-specific usability issues. In this paper, we propose a compilation of heuristic evaluation checklists taken from the existing bibliography but readapted to new mobile interfaces. Selecting and rearranging these heuristic guidelines offer a tool which works well not just for evaluation but also as a best-practices checklist. The result is a comprehensive checklist which is experimentally evaluated as a design tool. This experimental evaluation involved two software engineers without any specific knowledge about usability, a group of ten users who compared the usability of a first prototype designed without our heuristics, and a second one after applying the proposed checklist. The results of this experiment show the usefulness of the proposed checklist for avoiding usability gaps even with nontrained developers. PMID:25295300

Facilitating energy savings with programmable thermostats: evaluation and guidelines for the thermostat user interface.

PubMed

Peffer, Therese; Perry, Daniel; Pritoni, Marco; Aragon, Cecilia; Meier, Alan

2013-01-01

Thermostats control heating and cooling in homes - representing a major part of domestic energy use - yet, poor ergonomics of these devices has thwarted efforts to reduce energy consumption. Theoretically, programmable thermostats can reduce energy by 5-15%, but in practice little to no savings compared to manual thermostats are found. Several studies have found that programmable thermostats are not installed properly, are generally misunderstood and have poor usability. After conducting a usability study of programmable thermostats, we reviewed several guidelines from ergonomics, general device usability, computer-human interfaces and building control sources. We analysed the characteristics of thermostats that enabled or hindered successfully completing tasks and in a timely manner. Subjects had higher success rates with thermostat displays with positive examples of guidelines, such as visibility of possible actions, consistency and standards, and feedback. We suggested other guidelines that seemed missing, such as navigation cues, clear hierarchy and simple decision paths. Our evaluation of a usability test of five residential programmable thermostats led to the development of a comprehensive set of specific guidelines for thermostat design including visibility of possible actions, consistency, standards, simple decision paths and clear hierarchy. Improving the usability of thermostats may facilitate energy savings.

Field Evaluation of Programmable Thermostats

DOE Office of Scientific and Technical Information (OSTI.GOV)

Sachs, O.; Tiefenbeck, V.; Duvier, C.

2012-12-01

Prior research suggests that poor programmable thermostats usability may prevent their effective use to save energy. The Fraunhofer team hypothesized that home occupants with high-usability thermostats would be more likely to use them to save energy than people with a basic thermostats. In this report, the team discusses results of a project in which the team monitored and compared programmable thermostats with basic thermostats in an affordable housing apartment complex.

A novel computerized surgeon-machine interface for robot-assisted laser phonomicrosurgery.

PubMed

Mattos, Leonardo S; Deshpande, Nikhil; Barresi, Giacinto; Guastini, Luca; Peretti, Giorgio

2014-08-01

To introduce a novel computerized surgical system for improved usability, intuitiveness, accuracy, and controllability in robot-assisted laser phonomicrosurgery. Pilot technology assessment. The novel system was developed involving a newly designed motorized laser micromanipulator, a touch-screen display, and a graphics stylus. The system allows the control of a CO2 laser through interaction between the stylus and the live video of the surgical area. This empowers the stylus with the ability to have actual effect on the surgical site. Surgical enhancements afforded by this system were established through a pilot technology assessment using randomized trials comparing its performance with a state-of-the-art laser microsurgery system. Resident surgeons and medical students were chosen as subjects in performing sets of trajectory-following exercises. Image processing-based techniques were used for an objective performance assessment. A System Usability Scale-based questionnaire was used for the qualitative assessment. The computerized interface demonstrated superiority in usability, accuracy, and controllability over the state-of-the-art system. Significant ease of use and learning experienced by the subjects were demonstrated by the usability score assigned to the two compared interfaces: computerized interface = 83.96% versus state-of-the-art = 68.02%. The objective analysis showed a significant enhancement in accuracy and controllability: computerized interface = 90.02% versus state-of-the-art = 75.59%. The novel system significantly enhances the accuracy, usability, and controllability in laser phonomicrosurgery. The design provides an opportunity to improve the ergonomics and safety of current surgical setups. © 2014 The American Laryngological, Rhinological and Otological Society, Inc.

Placing wireless tablets in clinical settings for patient education.

PubMed

Stribling, Judy C; Richardson, Joshua E

2016-04-01

The authors explored the feasibility and possible benefit of tablet-based educational materials for patients in clinic waiting areas. We distributed eight tablets preloaded with diagnosis-relevant information in two clinic waiting areas. Patients were surveyed about satisfaction, usability, and effects on learning. Technical issues were resolved. Thirty-seven of forty patients completed the survey. On average, the patients were satisfied in all categories. Placing tablet-based educational materials in clinic waiting areas is relatively easy to implement. Patients using tablets reported satisfaction across three domains: usability, education, and satisfaction.

Usability, Quality, Value and E-Learning Continuance Decisions

ERIC Educational Resources Information Center

Chiu, Chao-Min; Hsu, Meng-Hsiang; Sun, Szu-Yuan; Lin, Tung-Ching; Sun, Pei-Chen

2005-01-01

Previous research suggests that an eventual information technology (IT) success depend on both its initial adoption (acceptance) and subsequent continued usage (continuance). Expectancy disconfirmation theory (EDT) has been successfully used to predict users' intention to continue using information technologies. This study proposed a decomposed…

Seamless recording of glucometer measurements among older experienced diabetic patients - A study of perception and usability.

PubMed

Rasche, Peter; Mertens, Alexander; Miron-Shatz, Talya; Berzon, Corinne; Schlick, Christopher M; Jahn, Michael; Becker, Stefan

2018-01-01

Self-measurement and documentation of blood-glucose are critical elements of diabetes management, particularly in regimes including insulin. In this study, we analyze the usability of iBG-STAR, the first blood glucose meter connectable to a smartphone. This technology records glucometer measurements, removing the burden of documentation from diabetic patients. This study assesses the potential for implementation of iBG-STAR in routine care. Twelve long-term diabetic patients (4 males; median age of 66.5 years) were enrolled in the study. N = 4/12 reported diabetic polyneuropathy. Reported subjective mental workload for all tasks related to iBG-STAR was on average lower than 12 points, corresponding to the verbal code 'nearly no effort needed'. A "Post Study System Usability Questionnaire", evaluated the glucometer at an average value of 2.06 (SD = 1.02) on a 7-Likert-scale (1 = 'I fully agree' to 7 = 'I completely disagree') for usability. These results represent a positive user-experience. Patients with polyneuropathy may experience physical difficulties in completing the tasks, thereby affecting usability. Technologically savvy patients (n = 6) with a positive outlook on diabetes assessed the product as a suitable tool for themselves and would recommend to other diabetic patients. The main barrier to regular use was treating physicians' inability to retrieve digitally recorded data. This barrier was due to a shortcoming in interoperability of mobile devices and medical information systems.

A usability evaluation exploring the design of American Nurses Association state web sites.

PubMed

Alexander, Gregory L; Wakefield, Bonnie J; Anbari, Allison B; Lyons, Vanessa; Prentice, Donna; Shepherd, Marilyn; Strecker, E Bradley; Weston, Marla J

2014-08-01

National leaders are calling for opportunities to facilitate the Future of Nursing. Opportunities can be encouraged through state nurses association Web sites, which are part of the American Nurses Association, that are well designed, with appropriate content, and in a language professional nurses understand. The American Nurses Association and constituent state nurses associations provide information about nursing practice, ethics, credentialing, and health on Web sites. We conducted usability evaluations to determine compliance with heuristic and ethical principles for Web site design. We purposefully sampled 27 nursing association Web sites and used 68 heuristic and ethical criteria to perform systematic usability assessments of nurse association Web sites. Web site analysis included seven double experts who were all RNs trained in usability analysis. The extent to which heuristic and ethical criteria were met ranged widely from one state that met 0% of the criteria for "help and documentation" to states that met greater than 92% of criteria for "visibility of system status" and "aesthetic and minimalist design." Suggested improvements are simple yet make an impact on a first-time visitor's impression of the Web site. For example, adding internal navigation and tracking features and providing more details about the application process through help and frequently asked question documentation would facilitate better use. Improved usability will improve effectiveness, efficiency, and consumer satisfaction with these Web sites.

Rapid Evidence Review of Mobile Applications for Self-management of Diabetes.

PubMed

Veazie, Stephanie; Winchell, Kara; Gilbert, Jennifer; Paynter, Robin; Ivlev, Ilya; Eden, Karen B; Nussbaum, Kerri; Weiskopf, Nicole; Guise, Jeanne-Marie; Helfand, Mark

2018-05-08

Patients with diabetes lack information on which commercially available applications (apps) improve diabetes-related outcomes. We conducted a rapid evidence review to examine features, clinical efficacy, and usability of apps for self-management of type 1 and type 2 diabetes in adults. Ovid/Medline and the Cochrane Database of Systematic Reviews were searched for systematic reviews and technology assessments. Reference lists of relevant systematic reviews were examined for primary studies. Additional searches for primary studies were conducted online, through Ovid/Medline, Embase, CINAHL, and ClinicalTrials.gov . Studies were evaluated for eligibility based on predetermined criteria, data were extracted, study quality was assessed using a risk of bias tool, information on app features was collected, and app usability was assessed. Results are summarized qualitatively. Fifteen articles evaluating 11 apps were identified: six apps for type 1 and five apps for type 2 diabetes. Common features of apps included setting reminders and tracking blood glucose and hemoglobin A1c (HbA1c), medication use, physical activity, and weight. Compared with controls, use of eight apps, when paired with support from a healthcare provider or study staff, improved at least one outcome, most often HbA1c. Patients did not experience improvements in quality of life, blood pressure, or weight, regardless of app used or type of diabetes. Study quality was variable. Of the eight apps available for usability testing, two were scored "acceptable," three were "marginal," and three were "not acceptable." Limited evidence suggests that use of some commercially available apps, when combined with additional support from a healthcare provider or study staff, may improve some short-term diabetes-related outcomes. The impact of these apps on longer-term outcomes is unclear. More rigorous and longer-term studies of apps are needed. This review was funded by the Agency for Healthcare Research and Quality (AHRQ). The protocol is available at: http://www.effectivehealthcare.ahrq.gov/topics/diabetes-mobile-devices/research-protocol .

Development of the Lupus Interactive Navigator as an Empowering Web-Based eHealth Tool to Facilitate Lupus Management: Users Perspectives on Usability and Acceptability.

PubMed

Neville, Carolyn; Da Costa, Deborah; Rochon, Murray; Peschken, Christine A; Pineau, Christian A; Bernatsky, Sasha; Keeling, Stephanie; Avina-Zubieta, Antonio; Lye, Elizabeth; Eng, Davy; Fortin, Paul R

2016-05-30

Systemic Lupus Erythematosus (SLE) is a serious, complex, and chronic illness. Similar to most other chronic illness states, there is great interest in helping persons with SLE engage in their disease management. The objectives of this study were to (1) develop the Lupus Interactive Navigator (LIN), a web-based self-management program for persons with SLE, and (2) test the LIN for usability and acceptability. The LIN development platform was based on the results of preliminary comprehensive needs assessments and adapted from the Oncology Interactive Navigator, a web-based tool developed for persons with cancer. Medical researchers, writers, designers, and programmers worked with clinical experts and persons with SLE to develop content for the LIN. Usability and acceptability of the LIN was tested on individuals with SLE meeting American College of Rheumatology criteria, who were recruited from five Canadian SLE clinics. Participants were provided with access to the LIN and were asked to use it over a two-week period. Following the testing period, participants were contacted for a 30-minute telephone interview to assess usability and acceptability. The content for the LIN was subdivided into six primary information topics with interview videos featuring rheumatologists, allied health professionals, and persons with SLE. Usability and acceptability of the LIN was tested on 43 females with SLE. Of these, 37 (86%) completed telephone interviews. The average age was 43.6 (SD 15.9) years and disease duration averaged 14.1 (SD 10.8) years. Median time spent on LIN was 16.3 (interquartile range [IQR]:13.7, 53.5) minutes and median number of sessions was 2 (IQR: 1, 3). Overall, Likert ratings (0=strongly disagree; 7=strongly agree) of website usability and content were very high, with 75% scoring >6 out of 7 on all items. All participants agreed that LIN was easy to use, would recommend it to others with SLE, and would refer to it for future questions about SLE. Very high ratings were also given to relevancy, credibility, and usefulness of the information provided. Overall, 73% of the participants rated all topics helpful to very helpful. Participants who reported more prior knowledge about SLE rated items regarding improvement in knowledge and helpfulness relatively lower than persons with less prior knowledge. Most participants commented that the LIN would be very useful to those newly diagnosed with SLE. Minor revisions were recommended. This study furthers the understanding of the needs in the SLE community and delivers a unique eHealth tool to promote self-management in persons with SLE. The LIN was found to be highly acceptable in content and usability. The information provided on LIN may be most helpful for individuals with less experience with the disease, such as those newly diagnosed, indicating the need to tailor the content for persons with more SLE experience.

Optimization of infobutton design and Implementation: A systematic review.

PubMed

Teixeira, Miguel; Cook, David A; Heale, Bret S E; Del Fiol, Guilherme

2017-10-01

Infobuttons are clinical decision tools embedded in the electronic health record that attempt to link clinical data with context sensitive knowledge resources. We systematically reviewed technical approaches that contribute to improved infobutton design, implementation and functionality. We searched databases including MEDLINE, EMBASE, and the Cochrane Library database from inception to March 1, 2016 for studies describing the use of infobuttons. We selected full review comparative studies, usability studies, and qualitative studies examining infobutton design and implementation. We abstracted usability measures such as user satisfaction, impact, and efficiency, as well as prediction accuracy of infobutton content retrieval algorithms and infobutton adoption/interoperability. We found 82 original research studies on infobuttons. Twelve studies met criteria for detailed abstraction. These studies investigated infobutton interoperability (1 study); tools to help tailor infobutton functionality (1 study); interventions to improve user experience (7 studies); and interventions to improve content retrieval by improving prediction of relevant knowledge resources and information needs (3 studies). In-depth interviews with implementers showed the Health Level Seven (HL7) Infobutton standard to be simple and easy to implement. A usability study demonstrated the feasibility of a tool to help medical librarians tailor infobutton functionality. User experience studies showed that access to resources with which users are familiar increased user satisfaction ratings; and that links to specific subsections of drug monographs increased information seeking efficiency. However, none of the user experience improvements led to increased usage uptake. Recommender systems based on machine learning algorithms outperformed hand-crafted rules in the prediction of relevant resources and clinicians' information needs in a laboratory setting, but no studies were found using these techniques in clinical settings. Improved content indexing in one study led to improved content retrieval across three health care organizations. Best practice technical approaches to ensure optimal infobutton functionality, design and implementation remain understudied. The HL7 Infobutton standard has supported wide adoption of infobutton functionality among clinical information systems and knowledge resources. Limited evidence supports infobutton enhancements such as links to specific subtopics, configuration of optimal resources for specific tasks and users, and improved indexing and content coverage. Further research is needed to investigate user experience improvements to increase infobutton use and effectiveness. Copyright © 2017 Elsevier Inc. All rights reserved.

Older Cancer Patients’ User Experiences With Web-Based Health Information Tools: A Think-Aloud Study

PubMed Central

Romijn, Geke; Smets, Ellen M A; Loos, Eugene F; Kunneman, Marleen; van Weert, Julia C M

2016-01-01

Background Health information is increasingly presented on the Internet. Several Web design guidelines for older Web users have been proposed; however, these guidelines are often not applied in website development. Furthermore, although we know that older individuals use the Internet to search for health information, we lack knowledge on how they use and evaluate Web-based health information. Objective This study evaluates user experiences with existing Web-based health information tools among older (≥ 65 years) cancer patients and survivors and their partners. The aim was to gain insight into usability issues and the perceived usefulness of cancer-related Web-based health information tools. Methods We conducted video-recorded think-aloud observations for 7 Web-based health information tools, specifically 3 websites providing cancer-related information, 3 Web-based question prompt lists (QPLs), and 1 values clarification tool, with colorectal cancer patients or survivors (n=15) and their partners (n=8) (median age: 73; interquartile range 70-79). Participants were asked to think aloud while performing search, evaluation, and application tasks using the Web-based health information tools. Results Overall, participants perceived Web-based health information tools as highly useful and indicated a willingness to use such tools. However, they experienced problems in terms of usability and perceived usefulness due to difficulties in using navigational elements, shortcomings in the layout, a lack of instructions on how to use the tools, difficulties with comprehensibility, and a large amount of variety in terms of the preferred amount of information. Although participants frequently commented that it was easy for them to find requested information, we observed that the large majority of the participants were not able to find it. Conclusions Overall, older cancer patients appreciate and are able to use cancer information websites. However, this study shows the importance of maintaining awareness of age-related problems such as cognitive and functional decline and navigation difficulties with this target group in mind. The results of this study can be used to design usable and useful Web-based health information tools for older (cancer) patients. PMID:27457709

Knowledge translation of the HELPinKIDS clinical practice guideline for managing childhood vaccination pain: usability and knowledge uptake of educational materials directed to new parents.

PubMed

Taddio, Anna; Shah, Vibhuti; Leung, Eman; Wang, Jane; Parikh, Chaitya; Smart, Sarah; Hetherington, Ross; Ipp, Moshe; Riddell, Rebecca Pillai; Sgro, Michael; Jovicic, Aleksandra; Franck, Linda

2013-02-08

Although numerous evidence-based and feasible interventions are available to treat pain from childhood vaccine injections, evidence indicates that children are not benefitting from this knowledge. Unrelieved vaccination pain puts children at risk for significant long-term harms including the development of needle fears and subsequent health care avoidance behaviours. Parents report that while they want to mitigate vaccination pain in their children, they lack knowledge about how to do so. An evidence-based clinical practice guideline for managing vaccination pain was recently developed in order to address this knowledge-to-care gap. Educational tools (pamphlet and video) for parents were included to facilitate knowledge transfer at the point of care. The objectives of this study were to evaluate usability and effectiveness in terms of knowledge acquisition from the pamphlet and video in parents of newly born infants. Mixed methods design. Following heuristic usability evaluation of the pamphlet and video, parents of newborn infants reviewed revised versions of both tools and participated in individual and group interviews and individual knowledge testing. The knowledge test comprised of 10 true/false questions about the effectiveness of various pain management interventions, and was administered at three time points: at baseline, after review of the pamphlet, and after review of the video. Three overarching themes were identified from the interviews regarding usability of these educational tools: receptivity to learning, accessibility to information, and validity of information. Parents' performance on the knowledge test improved (p≤0.001) from the baseline phase to after review of the pamphlet, and again from the pamphlet review phase to after review of the video. Using a robust testing process, we demonstrated usability and conceptual knowledge acquisition from a parent-directed educational pamphlet and video about management of vaccination pain. Future studies are planned to determine the impact of these educational tools when introduced in clinical settings on parent behaviors during infant vaccinations.

Usability of a Culturally Informed mHealth Intervention for Symptoms of Anxiety and Depression: Feedback From Young Sexual Minority Men

PubMed Central

Hill, Yvette N; Burns, Michelle Nicole

2017-01-01

Background To date, we are aware of no interventions for anxiety and depression developed as mobile phone apps and tailored to young sexual minority men, a group especially at risk of anxiety and depression. We developed TODAY!, a culturally informed mobile phone intervention for young men who are attracted to men and who have clinically significant symptoms of anxiety or depression. The core of the intervention consists of daily psychoeducation informed by transdiagnostic cognitive behavioral therapy (CBT) and a set of tools to facilitate putting these concepts into action, with regular mood ratings that result in tailored feedback (eg, tips for current distress and visualizations of mood by context). Objective The aim of this study was to conduct usability testing to understand how young sexual minority men interact with the app, to inform later stages of intervention development. Methods Participants (n=9) were young sexual minority men aged 18-20 years (Mean=19.00, standard deviation [SD]=0.71; 44% black, 44% white, and 11.1% Latino), who endorsed at least mild depression and anxiety symptoms. Participants were recruited via flyers, emails to college lesbian, gay, bisexual, and transgender (LGBT) organizations, Web-based advertisements, another researcher’s database of sexual minority youth interested in research participation, and word of mouth. During recorded interviews, participants were asked to think out loud while interacting with the TODAY! app on a mobile phone or with paper prototypes. Feedback identified from these recordings and from associated field notes were subjected to thematic analysis using a general inductive approach. To aid interpretation of results, methods and results are reported according to the consolidated criteria for reporting qualitative research (COREQ). Results Thematic analysis of usability feedback revealed a theme of general positive feedback, as well as six recurring themes that informed continued development: (1) functionality (eg, highlight new material when available), (2) personalization (eg, more tailored feedback), (3) presentation (eg, keep content brief), (4) aesthetics (eg, use brighter colors), (5) LGBT or youth content (eg, add content about coming out), and (6) barriers to use (eg, perceiving psychoeducation as homework). Conclusions Feedback from usability testing was vital to understanding what young sexual minority men desire from a mobile phone intervention for symptoms of anxiety and depression and was used to inform the ongoing development of such an intervention. PMID:28842389

Redesigning printed educational materials for primary care physicians: design improvements increase usability.

PubMed

Grudniewicz, Agnes; Bhattacharyya, Onil; McKibbon, K Ann; Straus, Sharon E

2015-11-04

Printed educational materials (PEMs) are a frequently used tool to disseminate clinical information and attempt to change behavior within primary care. However, their effect on clinician behavior is limited. In this study, we explored how PEMs can be redesigned to better meet the needs of primary care physicians (PCPs) and whether usability and selection can be increased when design principles and user preferences are used. We redesigned a publicly available PEM using physician preferences, design principles, and graphic designer support. We invited PCPs to select their preferred document between the redesigned and original versions in a discrete choice experiment, followed by an assessment of usability with the System Usability Scale and a think aloud process. We conducted this study in both a controlled and opportunistic setting to determine whether usability testing results vary by study location. Think aloud data was thematically analyzed, and results were interpreted using the Technology Acceptance Model. One hundred and eighty four PCPs participated in the discrete choice experiment at the 2014 Family Medicine Forum, a large Canadian conference for family physicians. Of these, 87.7 % preferred the redesigned version. Follow-up interviews were held with a randomly selected group of seven participants. We repeated this in a controlled setting in Toronto, Canada, with a set of 14 participants. Using the System Usability Scale, we found that usability scores were significantly increased with the redesign (p < 0.001). We also found that when PCPs were given the choice between the two versions, they selected the redesigned version as their preferred PEM more often than the original (p < 0.001). Results did not appear to differ between the opportunistic and controlled setting. We used the results of the think aloud process to add to a list of end user preferences developed in a previous study. We found that redesigning a PEM with user preferences and design principles can improve its usability and result in the PEM being selected more often than the original. We feel this finding supports the involvement of the user, application of design principles, and the assistance of a graphic designer in the development of PEMs.

Usability test of KNRC self-feeding robot.

PubMed

Song, Won-Kyung; Song, Won-Jin; Kim, Yale; Kim, Jongbae

2013-06-01

Various assistive robots for supporting the activities of daily living have been developed. However, not many of these have been introduced into the market because they were found to be impractical in actual scenarios. In this paper, we report on the usability test results of an assistive robot designed for self-feeding for people having disabilities, which includes those having spinal cord injury, cerebral palsy, and traumatic brain injury. First, we present three versions of a novel self-feeding robot (KNRC self-feeding robot), which is suitable for use with Korean food, including sticky rice. These robots have been improved based on participatory action design over a period of three years. Next, we discuss the usability tests of the KNRC self-feeding robots. People with disabilities participated in comparative tests between the KNRC self-feeding robot and the commercialized product named My Spoon. The KNRC self-feeding robot showed positive results in relation to satisfaction and performance compared to the commercialized robot when users ate Korean food, including sticky rice.

Measuring Law Library Catalog Web Site Usability: A Web Analytic Approach

ERIC Educational Resources Information Center

Fang, Wei; Crawford, Marjorie E.

2008-01-01

Although there is a proliferation of information available on the Web, and law professors, students, and other users have a variety of channels to locate information and complete their research activities, the law library catalog still remains an important source for offering users access to information that has been evaluated and cataloged by…

Design and Formative Evaluation of an Information Kiosk on Cattle Health for Landless Cattle Owners

ERIC Educational Resources Information Center

Ramkumar, S.; Garforth, C.; Rao, S. V. N.; Heffernan, C.

2007-01-01

This paper describes and analyses the experience of designing, installing and evaluating a farmer-usable touch screen information kiosk on cattle health in a veterinary institution in Pondicherry. The contents of the kiosk were prepared based on identified demands for information on cattle health, arrived at through various stakeholders meetings.…

Towards viable, useful and usable human factors design guidance.

PubMed

Burns, C M; Vicente, K J; Christoffersen, K; Pawlak, W S

1997-01-01

This paper investigates the factors relevant to producing effective human factors design guidance, using the Engineering Data Compendium (EDC) as a research vehicle. A series of three exploratory experiments focusing on the factors that affect the usability, usefulness and viability of human factors handbooks was conducted. The results of these studies were interpreted in the context of the process by which the EDC was developed, leading to the following recommendations: (a) human factors guidance should be organized in a manner that is stepped in context; (b) human factors guidance should be based on an explicit requirements analysis; (c) the calibration of designers' perceptions of the cost of obtaining human factors information must be improved; (d) organizational policies must be changed to induce more effective information search behaviour.

Web-Based Communication Strategies Designed to Improve Intention to Minimize Risk for Colorectal Cancer: Randomized Controlled Trial

PubMed Central

Flight, Ingrid; Zajac, Ian T; Turnbull, Deborah; Young, Graeme P; Olver, Ian

2018-01-01

Background People seek information on the Web for managing their colorectal cancer (CRC) risk but retrieve much personally irrelevant material. Targeting information pertinent to this cohort via a frequently asked question (FAQ) format could improve outcomes. Objective We identified and prioritized colorectal cancer information for men and women aged 35 to 74 years (study 1) and built a website containing FAQs ordered by age and gender. In study 2, we conducted a randomized controlled trial (RCT) to test whether targeted FAQs were more influential on intention to act on CRC risk than the same information accessed via a generic topic list. Secondary analyses compared preference for information delivery, usability, relevance, and likelihood of recommendation of FAQ and LIST websites. Methods Study 1 determined the colorectal cancer information needs of Australians (N=600) by sex and age group (35-49, 50-59, 60-74) through a Web-based survey. Free-text responses were categorized as FAQs: the top 5 issues within each of the 6 cohorts were identified. Study 2 (N=240) compared the impact of presentation as targeted FAQ links to information with links presented as a generic list (LIST) and a CONTROL (no information) condition. We also tested preference for presentation of access to information as FAQ or LIST by adding a CHOICE condition (a self-selected choice of FAQs or a list of information topics). Results Study 1 showed considerable consistency in information priorities among all 6 cohorts with 2 main concerns: treatment of CRC and risk factors. Some differences included a focus on general risk factors, excluding diet and lifestyle, in the younger cohort, and on the existence of a test for CRC in the older cohorts. Study 2 demonstrated that, although respondents preferred information access ordered by FAQs over a list, presentation in this format had limited impact on readiness to act on colorectal cancer risk compared with the list or a no-information control (P=.06). Both FAQ and LIST were evaluated as equally usable. Those aged 35 to 49 years rated the information less relevant to them and others in their age group, and information ordered by FAQs was rated, across all age groups and both sexes, as less relevant to people outside the age group targeted within the FAQs. Conclusions FAQs are preferred over a list as a strategy for presenting access to information about CRC. They may improve intention to act on risk, although further research is required. Future research should aim to identify better the characteristics of information content and presentation that optimize perceived relevance and fully engage the target audience. Trial Registration Australian New Zealand Clinical Trials Registry: ACTRN12618000137291; https://www.anzctr.org. au/Trial/Registration/TrialReview.aspx?id=374129 (Archived by WebCite at http://www.webcitation.org/6x2Mr6rPC) PMID:29434013

Assessing the vulnerability of economic sectors to climate variability to improve the usability of seasonal to decadal climate forecasts in Europe - a preliminary concept

NASA Astrophysics Data System (ADS)

Funk, Daniel

2015-04-01

Climate variability poses major challenges for decision-makers in climate-sensitive sectors. Seasonal to decadal (S2D) forecasts provide potential value for management decisions especially in the context of climate change where information from present or past climatology loses significance. However, usable and decision-relevant tailored climate forecasts are still sparse for Europe and successful examples of application require elaborate and individual producer-user interaction. The assessment of sector-specific vulnerabilities to critical climate conditions at specific temporal scale will be a great step forward to increase the usability and efficiency of climate forecasts. A concept for a sector-specific vulnerability assessment (VA) to climate variability is presented. The focus of this VA is on the provision of usable vulnerability information which can be directly incorporated in decision-making processes. This is done by developing sector-specific climate-impact-decision-pathways and the identification of their specific time frames using data from both bottom-up and top-down approaches. The structure of common VA's for climate change related issues is adopted which envisages the determination of exposure, sensitivity and coping capacity. However, the application of the common vulnerability components within the context of climate service application poses some fundamental considerations: Exposure - the effect of climate events on the system of concern may be modified and delayed due to interconnected systems (e.g. catchment). The critical time-frame of a climate event or event sequence is dependent on system-internal thresholds and initial conditions. But also on decision-making processes which require specific lead times of climate information to initiate respective coping measures. Sensitivity - in organizational systems climate may pose only one of many factors relevant for decision making. The scope of "sensitivity" in this concept comprises both the potential physical response of the system of concern as well as the criticality of climate-related decision-making processes. Coping capacity - in an operational context coping capacity can only reduce vulnerability if it can be applied purposeful. With respect to climate vulnerabilities this refers to the availability of suitable, usable and skillful climate information. The focus for this concept is on existing S2D climate service products and their match with user needs. The outputs of the VA are climate-impact-decision-pathways which characterize critical climate conditions, estimate the role of climate in decision-making processes and evaluate the availability and potential usability of S2D climate forecast products. A classification scheme is developed for each component of the impact-pathway to assess its specific significance. The systemic character of these schemes enables a broad application of this VA across sectors where quantitative data is limited. This concept is developed and will be tested within the context of the EU-FP7 project "European Provision Of Regional Impacts Assessments on Seasonal and Decadal Timescales" EUPORIAS.

Non-visual Web Browsing: Beyond Web Accessibility

PubMed Central

Ramakrishnan, I.V.; Ashok, Vikas

2017-01-01

People with vision impairments typically use screen readers to browse the Web. To facilitate non-visual browsing, web sites must be made accessible to screen readers, i.e., all the visible elements in the web site must be readable by the screen reader. But even if web sites are accessible, screen-reader users may not find them easy to use and/or easy to navigate. For example, they may not be able to locate the desired information without having to listen to a lot of irrelevant contents. These issues go beyond web accessibility and directly impact web usability. Several techniques have been reported in the accessibility literature for making the Web usable for screen reading. This paper is a review of these techniques. Interestingly, the review reveals that understanding the semantics of the web content is the overarching theme that drives these techniques for improving web usability. PMID:29202137

Non-visual Web Browsing: Beyond Web Accessibility.

PubMed

Ramakrishnan, I V; Ashok, Vikas; Billah, Syed Masum

2017-07-01

People with vision impairments typically use screen readers to browse the Web. To facilitate non-visual browsing, web sites must be made accessible to screen readers, i.e., all the visible elements in the web site must be readable by the screen reader. But even if web sites are accessible, screen-reader users may not find them easy to use and/or easy to navigate. For example, they may not be able to locate the desired information without having to listen to a lot of irrelevant contents. These issues go beyond web accessibility and directly impact web usability. Several techniques have been reported in the accessibility literature for making the Web usable for screen reading. This paper is a review of these techniques. Interestingly, the review reveals that understanding the semantics of the web content is the overarching theme that drives these techniques for improving web usability.

Location-based social networking media for restaurant promotion and food review using mobile application

NASA Astrophysics Data System (ADS)

Luhur, H. S.; Widjaja, N. D.

2014-03-01

This paper is focusing on the development of a mobile application for searching restaurants and promotions with location based and social networking features. The main function of the application is to search restaurant information. Other functions are also available in this application such as add restaurant, add promotion, add photo, add food review, and other features including social networking features. The restaurant and promotion searching application will be developed under Android platform. Upon completion of this paper, heuristic evaluation and usability testing have been conducted. The result of both testing shows that the application is highly usable. Even though there are some usability problems discovered, the problems can be eliminated immediately by implementing the recommendations from the expert evaluators and the users as the testers of the application. Further improvement made to the application will ensure that the application can really be beneficial for the users of the application.

Impact relevance and usability of high resolution climate modeling and data

DOE Office of Scientific and Technical Information (OSTI.GOV)

Arnott, James C.

2016-10-30

The Aspen Global Change Institute hosted a technical science workshop entitled, “Impact Relevance and Usability of High-Resolution Climate Modeling and Datasets,” on August 2-7, 2015 in Aspen, CO. Kate Calvin (Pacific Northwest National Laboratory), Andrew Jones (Lawrence Berkeley National Laboratory) and Jean-François Lamarque (NCAR) served as co-chairs for the workshop. The meeting included the participation of 29 scientists for a total of 145 participant days. Following the workshop, workshop co-chairs authored a meeting report published in Eos on April 27, 2016. Insights from the workshop directly contributed to the formation of a new DOE-supported project co-led by workshop co-chair Andymore » Jones. A subset of meeting participants continue to work on a publication on institutional innovations that can support the usability of high resolution modeling, among other sources of climate information.« less

Usability of a CKD Educational Website Targeted to Patients and Their Family Members

PubMed Central

Zuckerman, Marni; Fink, Wanda; Hu, Peter; Yang, Shiming; Fink, Jeffrey C.

2012-01-01

Summary Background and objectives Web-based technology is critical to the future of healthcare. As part of the Safe Kidney Care cohort study evaluating patient safety in CKD, this study determined how effectively a representative sample of patients with CKD or family members could interpret and use the Safe Kidney Care website (www.safekidneycare.org), an informational website on safety in CKD. Design, setting, participants, & measurements Between November of 2011 and January of 2012, persons with CKD or their family members underwent formal usability testing administered by a single interviewer with a second recording observer. Each participant was independently provided a list of 21 tasks to complete, with each task rated as either easily completed/noncritical error or critical error (user cannot complete the task without significant interviewer intervention). Results Twelve participants completed formal usability testing. Median completion time for all tasks was 17.5 minutes (range=10–44 minutes). In total, 10 participants had greater than or equal to one critical error. There were 55 critical errors in 252 tasks (22%), with the highest proportion of critical errors occurring when participants were asked to find information on treatments that may damage kidneys, find the website on the internet, increase font size, and scroll to the bottom of the webpage. Participants were generally satisfied with the content and usability of the website. Conclusions Web-based educational materials for patients with CKD should target a wide range of computer literacy levels and anticipate variability in competency in use of the computer and internet. PMID:22798537

Are We There Yet? Human Factors Knowledge and Health Information Technology - the Challenges of Implementation and Impact.

PubMed

Turner, P; Kushniruk, A; Nohr, C

2017-08-01

Objective: To review the developments in human factors (HF) research on the challenges of health information technology (HIT) implementation and impact given the continuing incidence of usability problems and unintended consequences from HIT development and use. Methods: A search of PubMed/Medline and Web of Science® identified HF research published in 2015 and 2016. Electronic health records (EHRs) and patient-centred HIT emerged as significant foci of recent HF research. The authors selected prominent papers highlighting ongoing HF and usability challenges in these areas. This selective rather than systematic review of recent HF research highlights these key challenges and reflects on their implications on the future impact of HF research on HIT. Results: Research provides evidence of continued poor design, implementation, and usability of HIT, as well as technology-induced errors and unintended consequences. The paper highlights support for: (i) strengthening the evidence base on the benefits of HF approaches; (ii) improving knowledge translation in the implementation of HF approaches during HIT design, implementation, and evaluation; (iii) increasing transparency, governance, and enforcement of HF best practices at all stages of the HIT system development life cycle. Discussion and Conclusion: HF and usability approaches are yet to become embedded as integral components of HIT development, implementation, and impact assessment. As HIT becomes ever-more pervasive including with patients as end-users, there is a need to expand our conceptualisation of the problems to be addressed and the suite of tactics and strategies to be used to calibrate our pro-active involvement in its improvement. Georg Thieme Verlag KG Stuttgart.

Heuristic evaluation of online COPD respiratory therapy and education video resource center.

PubMed

Stellefson, Michael; Chaney, Beth; Chaney, Don

2014-10-01

Abstract Purpose: Because of limited accessibility to pulmonary rehabilitation programs, patients with chronic obstructive pulmonary disease (COPD) are infrequently provided with patient education resources. To help educate patients with COPD on how to live a better life with diminished breathing capacity, we developed a novel social media resource center containing COPD respiratory therapy and education videos called "COPDFlix." A heuristic evaluation of COPDFlix was conducted as part of a larger study to determine whether the prototype was successful in adhering to formal Web site usability guidelines for older adults. A purposive sample of three experts, with expertise in Web design and health communications technology, was recruited (a) to identify usability violations and (b) to propose solutions to improve the functionality of the COPDFlix prototype. Each expert evaluated 18 heuristics in four categories of task-based criteria (i.e., interaction and navigation, information architecture, presentation design, and information design). Seventy-six subcriteria across these four categories were assessed. Quantitative ratings and qualitative comments from each expert were compiled into a single master list, noting the violated heuristic and type/location of problem(s). Sixty-one usability violations were identified across the 18 heuristics. Evaluators rated the majority of heuristic subcriteria as either a "minor hindrance" (n=32) or "no problem" (n=132). Moreover, only 2 of the 18 heuristic categories were noted as "major" violations, with mean severity scores of ≥3. Mixed-methods data analysis helped the multidisciplinary research team to categorize and prioritize usability problems and solutions, leading to 26 discrete design modifications within the COPDFlix prototype.

An Adaptable Seismic Data Format

NASA Astrophysics Data System (ADS)

Krischer, Lion; Smith, James; Lei, Wenjie; Lefebvre, Matthieu; Ruan, Youyi; de Andrade, Elliott Sales; Podhorszki, Norbert; Bozdağ, Ebru; Tromp, Jeroen

2016-11-01

We present ASDF, the Adaptable Seismic Data Format, a modern and practical data format for all branches of seismology and beyond. The growing volume of freely available data coupled with ever expanding computational power opens avenues to tackle larger and more complex problems. Current bottlenecks include inefficient resource usage and insufficient data organization. Properly scaling a problem requires the resolution of both these challenges, and existing data formats are no longer up to the task. ASDF stores any number of synthetic, processed or unaltered waveforms in a single file. A key improvement compared to existing formats is the inclusion of comprehensive meta information, such as event or station information, in the same file. Additionally, it is also usable for any non-waveform data, for example, cross-correlations, adjoint sources or receiver functions. Last but not least, full provenance information can be stored alongside each item of data, thereby enhancing reproducibility and accountability. Any data set in our proposed format is self-describing and can be readily exchanged with others, facilitating collaboration. The utilization of the HDF5 container format grants efficient and parallel I/O operations, integrated compression algorithms and check sums to guard against data corruption. To not reinvent the wheel and to build upon past developments, we use existing standards like QuakeML, StationXML, W3C PROV and HDF5 wherever feasible. Usability and tool support are crucial for any new format to gain acceptance. We developed mature C/Fortran and Python based APIs coupling ASDF to the widely used SPECFEM3D_GLOBE and ObsPy toolkits.

Debunking Health IT Usability Myths

PubMed Central

Staggers, N.; Xiao, Y.; Chapman, L.

2013-01-01

Poor usability is a threat to patient safety and linked to productivity loss, workflow disruption, user frustration, sub-optimal product use and system de-installations. Although usability is receiving more attention nationally and internationally, myths about usability persist. This editorial debunks five common myths about usability (1) usability only concerns the look and feel of a product and is, therefore, only a minor concern, (2) usability is not measurable, (3) usability stifles innovation, (4) vendors are solely responsible for product usability, and (5) usability methods are not practical for use in healthcare. PMID:23874361

Understanding Response Rates to Surveys About Family Members' Psychological Symptoms After Patients' Critical Illness.

PubMed

Long, Ann C; Downey, Lois; Engelberg, Ruth A; Nielsen, Elizabeth; Ciechanowski, Paul; Curtis, J Randall

2017-07-01

Achieving adequate response rates from family members of critically ill patients can be challenging, especially when assessing psychological symptoms. To identify factors associated with completion of surveys about psychological symptoms among family members of critically ill patients. Using data from a randomized trial of an intervention to improve communication between clinicians and families of critically ill patients, we examined patient-level and family-level predictors of the return of usable surveys at baseline, three months, and six months (n = 181, 171, and 155, respectively). Family-level predictors included baseline symptoms of psychological distress, decisional independence preference, and attachment style. We hypothesized that family with fewer symptoms of psychological distress, a preference for less decisional independence, and secure attachment style would be more likely to return questionnaires. We identified several predictors of the return of usable questionnaires. Better self-assessed family member health status was associated with a higher likelihood and stronger agreement with a support-seeking attachment style with a lower likelihood, of obtaining usable baseline surveys. At three months, family-level predictors of return of usable surveys included having usable baseline surveys, status as the patient's legal next of kin, and stronger agreement with a secure attachment style. The only predictor of receipt of surveys at six months was the presence of usable surveys at three months. We identified several predictors of the receipt of surveys assessing psychological symptoms in family of critically ill patients, including family member health status and attachment style. Using these characteristics to inform follow-up mailings and reminders may enhance response rates. Copyright © 2017 American Academy of Hospice and Palliative Medicine. Published by Elsevier Inc. All rights reserved.

Developing an Android-Based Patient Decision Aid Based on Ottawa Standards for Patients After Kidney Transplant and Its Usability Evaluation.

PubMed

Zare Moayedi, Mahboobeh; Aslani, Azam; Fakhrahmad, Mostafa; Ezzatzadegan J, Shahrokh

2018-01-01

This study was conducted to develop an android based patient decision aid (PDA) as a self-care instrument for patients after kidney transplant and its usability evaluation. In this study, the systematic development process of Android-based self-care application for patients after kidney transplant based on Ottawa standard was included: scoping, assemble steering group, analysis of requirements, designing, develop of a prototype and system evaluation. The PDA is a self-triage system that will help early identification of risk symptoms in patients, and help manage them. System recommendations for risk signs are: Refer to the nearest hospital or healthcare center without delay, refer to the doctor and tell your doctor in the next visit. To identify patient care needs, a semi-structured interview with members of steering group, including patients and clinical experts, was conducted by the researchers. A prototype of the decision aid was made according to identified needs in the previous step. Finally, in order to evaluate its usability rate by using the System Usability Scale (SUS) questionnaire, it was used by exerts and patients. This study identified information needs, risk signs and steps that patients need to make appropriate decisions about them. The main capabilities of the decision aid are features such as reminders for appointment/test, time of taking medication, registration of symptoms, weight, blood pressure, body temperature, advising to patient in case of signs of risk, weight, blood pressure, body temperature and test results which were reported in the diagram. The mean score of system's usability evaluated by medical informatics specialists, clinicians, and patients were 88.33, 95, and 91. PDAs was usable and desirable from the point of view of medical informatics specialists, clinicians and patients.

A Mobile App (BEDSide Mobility) to Support Nurses' Tasks at the Patient's Bedside: Usability Study.

PubMed

Ehrler, Frederic; Weinhold, Thomas; Joe, Jonathan; Lovis, Christian; Blondon, Katherine

2018-03-21

The introduction of clinical information systems has increased the amount of clinical documentation. Although this documentation generally improves patient safety, it has become a time-consuming task for nurses, which limits their time with the patient. On the basis of a user-centered methodology, we have developed a mobile app named BEDSide Mobility to support nurses in their daily workflow and to facilitate documentation at the bedside. The aim of the study was to assess the usability of the BEDSide Mobility app in terms of the navigation and interaction design through usability testing. Nurses were asked to complete a scenario reflecting their daily work with patients. Their interactions with the app were captured with eye-tracking glasses and by using the think aloud protocol. After completing the tasks, participants filled out the system usability scale questionnaire. Descriptive statistics were used to summarize task completion rates and the users' performance. A total of 10 nurses (aged 21-50) participated in the study. Overall, they were satisfied with the navigation, layout, and interaction design of the app, with the exception of one user who was unfamiliar with smartphones. The problems identified were related to the ambiguity of some icons, the navigation logic, and design inconsistency. Besides the usability issues identified in the app, the participants' results do indicate good usability, high acceptance, and high satisfaction with the developed app. However, the results must be taken with caution because of the poor ecological validity of the experimental setting. ©Frederic Ehrler, Thomas Weinhold, Jonathan Joe, Christian Lovis, Katherine Blondon. Originally published in JMIR Mhealth and Uhealth (http://mhealth.jmir.org), 21.03.2018.

Nurses' perceptions and problems in the usability of a medication safety app.

PubMed

Ankem, Kalyani; Cho, Sookyung; Simpson, Diana

2017-10-16

The majority of medication apps support medication adherence. Equally, if not more important, is medication safety. Few apps report on medication safety, and fewer studies have been conducted with these apps. The usability of a medication safety app was tested with nurses to reveal their perceptions of the graphical user interface and to discover problems they encountered in using the app. Usability testing of the app was conducted with RN-BSN students and informatics students (n = 18). Perceptions of the graphical components were gathered in pretest and posttest questionnaires, and video recordings of the usability testing were transcribed. The significance of the difference in mean performance time for 8 tasks was tested, and qualitative analysis was deployed to identify problems encountered and to rate the severity of each problem. While all participants perceived the graphical user interface as easy to understand, nurses took significantly more time to complete certain tasks. More nurses found the medication app to be lacking in intuitiveness of user interface design, in capability to match real-world data, and in providing optimal information architecture. To successfully integrate mobile devices in healthcare, developers must address the problems that nurses encountered in use of the app.

How Information Visualization Systems Change Users' Understandings of Complex Data

ERIC Educational Resources Information Center

Allendoerfer, Kenneth Robert

2009-01-01

User-centered evaluations of information systems often focus on the usability of the system rather its usefulness. This study examined how a using an interactive knowledge-domain visualization (KDV) system affected users' understanding of a domain. Interactive KDVs allow users to create graphical representations of domains that depict important…

A Survey of Registered Nurses in New York State.

ERIC Educational Resources Information Center

New York State Education Dept., Albany. Bureau of Postsecondary Research and Information Systems.

As part of the 1989 triennial registration of registered nurses (RNs) in New York State, a survey of professional, personal, and practice characteristics of nurses was conducted. Basic information from this survey is enhanced by information from earlier surveys to illustrate significant trends. Usable survey questionnaires were received from…

The Federation of Earth Science Information Partners ESIP

NASA Technical Reports Server (NTRS)

Tilmes, Curt

2013-01-01

A broad-based, distributed community of science, data and information technology practitioners. With over 150 member organizations, the ESIP Federation brings together public, academic, commercial, and nongovernmental organizations to share knowledge, expertise, technology and best practices to improve opportunities for increasing access, discovery, integration and usability of Earth science data.

'How to know what you need to do': a cross-country comparison of maternal health guidelines in Burkina Faso, Ghana and Tanzania.

PubMed

Baker, Ulrika; Tomson, Göran; Somé, Mathias; Kouyaté, Bocar; Williams, John; Mpembeni, Rose; Massawe, Siriel; Blank, Antje; Gustafsson, Lars L; Eriksen, Jaran

2012-04-13

Initiatives to raise the quality of care provided to mothers need to be given priority in Sub Saharan Africa (SSA). The promotion of clinical practice guidelines (CPGs) is a common strategy, but their implementation is often challenging, limiting their potential impact. Through a cross-country perspective, this study explored CPGs for maternal health in Burkina Faso, Ghana, and Tanzania. The objectives were to compare factors related to CPG use including their content compared with World Health Organization (WHO) guidelines, their format, and their development processes. Perceptions of their availability and use in practice were also explored. The overall purpose was to further the understanding of how to increase CPGs' potential to improve quality of care for mothers in SSA. The study was a multiple case study design consisting of cross-country comparisons using document review and key informant interviews. A conceptual framework to aid analysis and discussion of results was developed, including selected domains related to guidelines' implementability and use by health workers in practice in terms of usability, applicability, and adaptability. The study revealed few significant differences in content between the national guidelines for maternal health and WHO recommendations. There were, however, marked variations in the format of CPGs between the three countries. Apart from the Ghanaian and one of the Tanzanian CPGs, the levels of both usability and applicability were assessed as low or medium. In all three countries, the use of CPGs by health workers in practice was perceived to be limited. Our cross-country study suggests that it is not poor quality of content or lack of evidence base that constitute the major barrier for CPGs to positively impact on quality improvement in maternal care in SSA. It rather emphasises the need to prioritise the format of guidelines to increase their usability and applicability and to consider these attributes together with implementation strategies as integral to their development processes.

Development of a tailored strategy to improve postpartum hemorrhage guideline adherence.

PubMed

de Visser, Suzan M; Woiski, Mallory D; Grol, Richard P; Vandenbussche, Frank P H A; Hulscher, Marlies E J L; Scheepers, Hubertina C J; Hermens, Rosella P M G

2018-02-08

Despite the introduction of evidence based guidelines and practical courses, the incidence of postpartum hemorrhage shows an increasing trend in developed countries. Substandard care is often found, which implies an inadequate implementation in high resource countries. We aimed to reduce the gap between evidence-based guidelines and clinical application, by developing a strategy, tailored to current barriers for implementation. The development of the implementation strategy consisted of three phases, supervised by a multidisciplinary expert panel. In the first phase a framework of the strategy was created, based on barriers to optimal adherence identified among professionals and patients together with evidence on effectiveness of strategies found in literature. In the second phase, the tools within the framework were developed, leading to a first draft. In the third phase the strategy was evaluated among professionals and patients. The professionals were asked to give written feedback on tool contents, clinical usability and inconsistencies with current evidence care. Patients evaluated the tools on content and usability. Based on the feedback of both professionals and patients the tools were adjusted. We developed a tailored strategy to improve guideline adherence, covering the trajectory of the third trimester of pregnancy till the end of the delivery. The strategy, directed at professionals, comprehending three stop moments includes a risk assessment checklist, care bundle and time-out procedure. As patient empowerment tools, a patient passport and a website with patient information was developed. The evaluation among the expert panel showed all professionals to be satisfied with the content and usability and no discrepancies or inconsistencies with current evidence was found. Patients' evaluation revealed that the information they received through the tools was incomplete. The tools were adjusted accordingly to the missing information. A usable, tailored strategy to implement PPH guidelines and practical courses was developed. The next step is the evaluation of the strategy in a feasibility trial. Clinical trial registration: The Fluxim study, registration number: NCT00928863 .

75 FR 32426 - Notice of Proposed Information Collection Requests

Federal Register 2010, 2011, 2012, 2013, 2014

2010-06-08

..., experiments with questionnaire design, and usability testing of electronic data collection instruments... this effect include but are not limited to experiments with levels of incentives for various types of...

Update on Genomic Databases and Resources at the National Center for Biotechnology Information.

PubMed

Tatusova, Tatiana

2016-01-01

The National Center for Biotechnology Information (NCBI), as a primary public repository of genomic sequence data, collects and maintains enormous amounts of heterogeneous data. Data for genomes, genes, gene expressions, gene variation, gene families, proteins, and protein domains are integrated with the analytical, search, and retrieval resources through the NCBI website, text-based search and retrieval system, provides a fast and easy way to navigate across diverse biological databases.Comparative genome analysis tools lead to further understanding of evolution processes quickening the pace of discovery. Recent technological innovations have ignited an explosion in genome sequencing that has fundamentally changed our understanding of the biology of living organisms. This huge increase in DNA sequence data presents new challenges for the information management system and the visualization tools. New strategies have been designed to bring an order to this genome sequence shockwave and improve the usability of associated data.

On vertical seismic profile processing

DOE Office of Scientific and Technical Information (OSTI.GOV)

Tariel, P.; Michon, D.

1984-10-01

From the wealth of information which can be deduced from VSP, the information most directly comparable to well logs is considered: P-wave and S-wave interval velocity, acoustic impedance, and the velocity ratio ..gamma.. = V /SUB s/ /V /SUB p/ . This information not only allows better interpretation of surface seismic sections but also improves processing. For these results to be usable a number of precautions must be taken during acquisition and processing; the sampling in depth should be chosen in such a way that aliasing phenomena do not unnecessarily limit the spectra during the separation of upwards and downwardsmore » travelling waves. True amplitudes should be respected and checked by recording of signatures, and the interference of upwards and downwards travelling waves should be taken into account for the picking of first arrivals. The different steps in processing and the combination of results in the interpretation of surface seismic results are described with actual records.« less

WMC Database Evaluation. Case Study Report

DOE Office of Scientific and Technical Information (OSTI.GOV)

Palounek, Andrea P. T

The WMC Database is ultimately envisioned to hold a collection of experimental data, design information, and information from computational models. This project was a first attempt at using the Database to access experimental data and extract information from it. This evaluation shows that the Database concept is sound and robust, and that the Database, once fully populated, should remain eminently usable for future researchers.

An Evaluation Methodology for the Usability and Security of Cloud-based File Sharing Technologies

DTIC Science & Technology

2012-09-01

FISMA, ISO 27001 , FIPS 140-2, and ISO 270001) indicate a cloud-based service’s compliance with industry standard security controls, management and...Information Assurance IEEE Institute of Electrical and Electronics Engineers IT Information Technology ITS Insider Threat Study ISO International...effectively, efficiently and with satisfaction” (International Organization for Standardization [ ISO ], 1998). Alternately, information security

Evaluation of a Framework to Implement Electronic Health Record Systems Based on the openEHR Standard

NASA Astrophysics Data System (ADS)

Orellana, Diego A.; Salas, Alberto A.; Solarz, Pablo F.; Medina Ruiz, Luis; Rotger, Viviana I.

2016-04-01

The production of clinical information about each patient is constantly increasing, and it is noteworthy that the information is created in different formats and at diverse points of care, resulting in fragmented, incomplete, inaccurate and isolated, health information. The use of health information technology has been promoted as having a decisive impact to improve the efficiency, cost-effectiveness, quality and safety of medical care delivery. However in developing countries the utilization of health information technology is insufficient and lacking of standards among other situations. In the present work we evaluate the framework EHRGen, based on the openEHR standard, as mean to reach generation and availability of patient centered information. The framework has been evaluated through the provided tools for final users, that is, without intervention of computer experts. It makes easier to adopt the openEHR ideas and provides an open source basis with a set of services, although some limitations in its current state conspire against interoperability and usability. However, despite the described limitations respect to usability and semantic interoperability, EHRGen is, at least regionally, a considerable step toward EHR adoption and interoperability, so that it should be supported from academic and administrative institutions.

Content and Usability Evaluation of Patient Oriented Drug-Drug Interaction Websites.

PubMed

Adam, Terrence J; Vang, Joseph

Drug-Drug Interactions (DDI) are an important source of preventable adverse drug events and a common reason for hospitalization among patients on multiple drug therapy regimens. DDI information systems are important patient safety tools with the capacity to identify and warn health professionals of clinically significant DDI risk. While substantial research has been completed on DDI information systems in professional settings such as community, hospital, and independent pharmacies; there has been limited research on DDI systems offered through online websites directly for use by ambulatory patients. The focus of this project is to test patient oriented website capacity to correctly identify drug interactions among well established and clinically significant medication combinations and convey clinical risk data to patients. The patient education capability was assessed by evaluating website Information Capacity, Patient Usability and Readability. The study results indicate that the majority of websites identified which met the inclusion and exclusion criteria operated similarly, but vary in risk severity assessment and are not optimally patient oriented to effectively deliver risk information. The limited quality of information and complex medical term content complicate DDI risk data conveyance and the sites may not provide optimal information delivery to allow medication consumers to understand and manage their medication regimens.

Development and testing of painometer: a smartphone app to assess pain intensity.

PubMed

de la Vega, Rocío; Roset, Roman; Castarlenas, Elena; Sánchez-Rodríguez, Elisabet; Solé, Ester; Miró, Jordi

2014-10-01

Electronic and information technologies are increasingly being used to assess pain. This study aims to 1) introduce Painometer, a smartphone app that helps users to assess pain intensity, and 2) report on its usability (ie, user performance and satisfaction) and acceptability (ie, the willingness to use it) when it is made available to health care professionals and nonprofessionals. Painometer includes 4 well-known pain intensity scales: the Faces Pain Scale-Revised, the numerical rating scale-11, the Coloured Analogue Scale, and the visual analog scale. Scores reported with these scales, when used in their traditional format, have shown to be valid and reliable. The app was tested in a sample of 24 health care professionals and 30 nonprofessionals. Two iterative usability cycles were conducted with a qualitative usability testing approach and a semistructured interview. The participants had an average of 10 years' experience in using computers. The domains measured were ease of use, errors in usage, most popular characteristics, suggested changes, and acceptability. Adding instructions and changing format and layout details solved the usability problems reported in cycle 1. No further problems were reported in cycle 2. Painometer has been found to be a useful, user-friendly app that may help to improve the accuracy of pain intensity assessment. Painometer, a smartphone app to assess pain intensity, shows good usability and acceptability properties when used by health care professionals and nonprofessionals. Copyright © 2014 American Pain Society. Published by Elsevier Inc. All rights reserved.

Development and preliminary user testing of the DCIDA (Dynamic computer interactive decision application) for ‘nudging’ patients towards high quality decisions

PubMed Central

2014-01-01

Background Patient decision aids (PtDA) are developed to facilitate informed, value-based decisions about health. Research suggests that even when informed with necessary evidence and information, cognitive errors can prevent patients from choosing the option that is most congruent with their own values. We sought to utilize principles of behavioural economics to develop a computer application that presents information from conventional decision aids in a way that reduces these errors, subsequently promoting higher quality decisions. Method The Dynamic Computer Interactive Decision Application (DCIDA) was developed to target four common errors that can impede quality decision making with PtDAs: unstable values, order effects, overweighting of rare events, and information overload. Healthy volunteers were recruited to an interview to use three PtDAs converted to the DCIDA on a computer equipped with an eye tracker. Participants were first used a conventional PtDA, and then subsequently used the DCIDA version. User testing was assessed based on whether respondents found the software both usable: evaluated using a) eye-tracking, b) the system usability scale, and c) user verbal responses from a ‘think aloud’ protocol; and useful: evaluated using a) eye-tracking, b) whether preferences for options were changed, and c) and the decisional conflict scale. Results Of the 20 participants recruited to the study, 11 were male (55%), the mean age was 35, 18 had at least a high school education (90%), and 8 (40%) had a college or university degree. Eye-tracking results, alongside a mean system usability scale score of 73 (range 68–85), indicated a reasonable degree of usability for the DCIDA. The think aloud study suggested areas for further improvement. The DCIDA also appeared to be useful to participants wherein subjects focused more on the features of the decision that were most important to them (21% increase in time spent focusing on the most important feature). Seven subjects (25%) changed their preferred option when using DCIDA. Conclusion Preliminary results suggest that DCIDA has potential to improve the quality of patient decision-making. Next steps include larger studies to test individual components of DCIDA and feasibility testing with patients making real decisions. PMID:25084808

Research-IQ: Development and Evaluation of an Ontology-anchored Integrative Query Tool

PubMed Central

Borlawsky, Tara B.; Lele, Omkar; Payne, Philip R. O.

2011-01-01

Investigators in the translational research and systems medicine domains require highly usable, efficient and integrative tools and methods that allow for the navigation of and reasoning over emerging large-scale data sets. Such resources must cover a spectrum of granularity from bio-molecules to population phenotypes. Given such information needs, we report upon the initial design and evaluation of an ontology-anchored integrative query tool, Research-IQ, which employs a combination of conceptual knowledge engineering and information retrieval techniques to enable the intuitive and rapid construction of queries, in terms of semi-structured textual propositions, that can subsequently be applied to integrative data sets. Our initial results, based upon both quantitative and qualitative evaluations of the efficacy and usability of Research-IQ, demonstrate its potential to increase clinical and translational research throughput. PMID:21821150

Human interaction with wearable computer systems: a look at glasses-mounted displays

NASA Astrophysics Data System (ADS)

Revels, Allen R.; Quill, Laurie L.; Kancler, David E.; Masquelier, Barbara L.

1998-09-01

With the advancement of technology and the information explosion, integration of the two into performance aiding systems can have a significant impact on operational and maintenance environments. The Department of Defense and commercial industry have made great strides in digitizing and automating technical manuals and data to be presented on performance aiding systems. These performance aides are computerized interactive systems that provide procedures on how to operate and maintain fielded systems. The idea is to provide the end-user a system which is compatible with their work environment. The purpose of this paper is to show, historically, the progression of wearable computer aiding systems for maintenance environments, and then highlight the work accomplished in the design and development of glasses- mounted displays (GMD). The paper reviews work performed over the last seven years, then highlights, through review of a usability study, the advances made with GMDs. The use of portable computing systems, such as laptop and notebook, computers, does not necessarily increase the accessibility of the displayed information while accomplishing a given task in a hands-busy, mobile work environment. The use of a GMD increases accessibility of the information by placing it in eye sight of the user without obstructing the surrounding environment. Although the potential utility for this type of display is great, hardware and human integration must be refined. Results from the usability study show the usefulness and usability of the GMD in a mobile, hands-free environment.

User Interface Requirements for Web-Based Integrated Care Pathways: Evidence from the Evaluation of an Online Care Pathway Investigation Tool.

PubMed

Balatsoukas, Panos; Williams, Richard; Davies, Colin; Ainsworth, John; Buchan, Iain

2015-11-01

Integrated care pathways (ICPs) define a chronological sequence of steps, most commonly diagnostic or treatment, to be followed in providing care for patients. Care pathways help to ensure quality standards are met and to reduce variation in practice. Although research on the computerisation of ICP progresses, there is still little knowledge on what are the requirements for designing user-friendly and usable electronic care pathways, or how users (normally health care professionals) interact with interfaces that support design, analysis and visualisation of ICPs. The purpose of the study reported in this paper was to address this gap by evaluating the usability of a novel web-based tool called COCPIT (Collaborative Online Care Pathway Investigation Tool). COCPIT supports the design, analysis and visualisation of ICPs at the population level. In order to address the aim of this study, an evaluation methodology was designed based on heuristic evaluations and a mixed method usability test. The results showed that modular visualisation and direct manipulation of information related to the design and analysis of ICPs is useful for engaging and stimulating users. However, designers should pay attention to issues related to the visibility of the system status and the match between the system and the real world, especially in relation to the display of statistical information about care pathways and the editing of clinical information within a care pathway. The paper concludes with recommendations for interface design.

Public health information and statistics dissemination efforts for Indonesia on the Internet.

PubMed

Hanani, Febiana; Kobayashi, Takashi; Jo, Eitetsu; Nakajima, Sawako; Oyama, Hiroshi

2011-01-01

To elucidate current issues related to health statistics dissemination efforts on the Internet in Indonesia and to propose a new dissemination website as a solution. A cross-sectional survey was conducted. Sources of statistics were identified using link relationship and Google™ search. Menu used to locate statistics, mode of presentation and means of access to statistics, and available statistics were assessed for each site. Assessment results were used to derive design specification; a prototype system was developed and evaluated with usability test. 49 sources were identified on 18 governmental, 8 international and 5 non-government websites. Of 49 menus identified, 33% used non-intuitive titles and lead to inefficient search. 69% of them were on government websites. Of 31 websites, only 39% and 23% used graph/chart and map for presentation. Further, only 32%, 39% and 19% provided query, export and print feature. While >50% sources reported morbidity, risk factor and service provision statistics, <40% sources reported health resource and mortality statistics. Statistics portal website was developed using Joomla!™ content management system. Usability test demonstrated its potential to improve data accessibility. In this study, government's efforts to disseminate statistics in Indonesia are supported by non-governmental and international organizations and existing their information may not be very useful because it is: a) not widely distributed, b) difficult to locate, and c) not effectively communicated. Actions are needed to ensure information usability, and one of such actions is the development of statistics portal website.

Usability Testing of a Complex Clinical Decision Support Tool in the Emergency Department: Lessons Learned.

PubMed

Press, Anne; McCullagh, Lauren; Khan, Sundas; Schachter, Andy; Pardo, Salvatore; McGinn, Thomas

2015-09-10

As the electronic health record (EHR) becomes the preferred documentation tool across medical practices, health care organizations are pushing for clinical decision support systems (CDSS) to help bring clinical decision support (CDS) tools to the forefront of patient-physician interactions. A CDSS is integrated into the EHR and allows physicians to easily utilize CDS tools. However, often CDSS are integrated into the EHR without an initial phase of usability testing, resulting in poor adoption rates. Usability testing is important because it evaluates a CDSS by testing it on actual users. This paper outlines the usability phase of a study, which will test the impact of integration of the Wells CDSS for pulmonary embolism (PE) diagnosis into a large urban emergency department, where workflow is often chaotic and high stakes decisions are frequently made. We hypothesize that conducting usability testing prior to integration of the Wells score into an emergency room EHR will result in increased adoption rates by physicians. The objective of the study was to conduct usability testing for the integration of the Wells clinical prediction rule into a tertiary care center's emergency department EHR. We conducted usability testing of a CDS tool in the emergency department EHR. The CDS tool consisted of the Wells rule for PE in the form of a calculator and was triggered off computed tomography (CT) orders or patients' chief complaint. The study was conducted at a tertiary hospital in Queens, New York. There were seven residents that were recruited and participated in two phases of usability testing. The usability testing employed a "think aloud" method and "near-live" clinical simulation, where care providers interacted with standardized patients enacting a clinical scenario. Both phases were audiotaped, video-taped, and had screen-capture software activated for onscreen recordings. Phase I: Data from the "think-aloud" phase of the study showed an overall positive outlook on the Wells tool in assessing a patient for a PE diagnosis. Subjects described the tool as "well-organized" and "better than clinical judgment". Changes were made to improve tool placement into the EHR to make it optimal for decision-making, auto-populating boxes, and minimizing click fatigue. Phase II: After incorporating the changes noted in Phase 1, the participants noted tool improvements. There was less toggling between screens, they had all the clinical information required to complete the tool, and were able to complete the patient visit efficiently. However, an optimal location for triggering the tool remained controversial. This study successfully combined "think-aloud" protocol analysis with "near-live" clinical simulations in a usability evaluation of a CDS tool that will be implemented into the emergency room environment. Both methods proved useful in the assessment of the CDS tool and allowed us to refine tool usability and workflow.

Towards a virtual health record for mobile home care of elderly citizens.

PubMed

Koch, Sabine; Hägglund, Maria; Scandurra, Isabella; Moström, Dennis

2004-01-01

Mobile work situations within home care of the elderly require immediate and ubiquitous access to patient-oriented data. The ongoing Swedish research project "Technical support for Mobile CloseCare" focuses on the development and evaluation of work-scenario oriented ICT support for enhanced home care of elderly citizens. The aim of the project is to provide a seamless and consistent information flow between different health care providers and to give intuitive access to information services for the elderly and their relatives. For that purpose, different independent software components are connected through a mobile communication platform. Flexible access to prioritized information for different users in different work situations will be given through a virtual health record. In order to obtain both usable and clinically relevant results, a user centered system development approach is followed. Evaluation of the project results will be based on usability tests and quasi-experimental studies on how system implementation influences quality of care and job- and life satisfaction for care providers, patients and relatives.

Web-Based Mapping Puts the World at Your Fingertips

NASA Technical Reports Server (NTRS)

2008-01-01

NASA's award-winning Earth Resources Laboratory Applications Software (ELAS) package was developed at Stennis Space Center. Since 1978, ELAS has been used worldwide for processing satellite and airborne sensor imagery data of the Earth's surface into readable and usable information. DATASTAR Inc., of Picayune, Mississippi, has used ELAS software in the DATASTAR Image Processing Exploitation (DIPEx) desktop and Internet image processing, analysis, and manipulation software. The new DIPEx Version III includes significant upgrades and improvements compared to its esteemed predecessor. A true World Wide Web application, this product evolved with worldwide geospatial dimensionality and numerous other improvements that seamlessly support the World Wide Web version.

Final Report: Summary of Findings and Recommendations for Suction Devices for Management of Prehospital Combat Casualty Care Injuries

DTIC Science & Technology

2017-11-13

information and proposes a series of findings and recommendations to improved airway management in the prehospital combat environment. The key...Airway Final Report: Summary of Findings and Recommendations for Suction Devices for Management of Prehospital Combat Casualty Care Injuries...75 General Information and Device Usability

Information Design: A New Approach to Teaching Technical Writing Service Courses

ERIC Educational Resources Information Center

McKee, Candie DeLane

2012-01-01

This study used a needs assessment, process analysis, process design, and textbook design to develop a new process and new textbook, based on Cargile-Cook's layered literacies, Quesenbery's five qualities of usability, and Carliner's information design theories, for use in technical writing service learning courses. The needs assessment was based…

Usability Issues in the User Interfaces of Privacy-Enhancing Technologies

ERIC Educational Resources Information Center

LaTouche, Lerone W.

2013-01-01

Privacy on the Internet has become one of the leading concerns for Internet users. These users are not wrong in their concerns if personally identifiable information is not protected and under their control. To minimize the collection of Internet users' personal information and help solve the problem of online privacy, a number of…

Data-Driven Decision-Making: Data Pioneers

ERIC Educational Resources Information Center

Briggs, Linda L.

2006-01-01

Everyone on your campus needs information, and if your institution is like most schools, you have plenty of it to share. But which types of data warehousing and business intelligence systems you choose, and how accessible, usable, and meaningful those tools make all of that information, remain the big questions for many technologists and…

Infographics And Public Policy: Using Data Visualization To Convey Complex Information.

PubMed

Otten, Jennifer J; Cheng, Karen; Drewnowski, Adam

2015-11-01

Data visualization combines principles from psychology, usability, graphic design, and statistics to highlight important data in accessible and appealing formats. Doing so helps bridge knowledge producers with knowledge users, who are often inundated with information and increasingly pressed for time. Project HOPE—The People-to-People Health Foundation, Inc.

A Holistic Theoretical Approach to Intellectual Disability: Going beyond the Four Current Perspectives

ERIC Educational Resources Information Center

Schalock, Robert L.; Luckasson, Ruth; Tassé, Marc J.; Verdugo, Miguel Angel

2018-01-01

This article describes a holistic theoretical framework that can be used to explain intellectual disability (ID) and organize relevant information into a usable roadmap to guide understanding and application. Developing the framework involved analyzing the four current perspectives on ID and synthesizing this information into a holistic…

Usability evaluation of in-housed developed ERP system

NASA Astrophysics Data System (ADS)

Faisal, Chaudhry Muhammad Nadeem; Shakeel Faridi, Muhammad; Javed, Zahid

2011-10-01

Enterprise Resource Planning systems are the combination of different business IS (Information System) applications that are designed according to the organization requirements. Generally ERP systems are suffering from complex user interface issues. Recent research shows that there is a need for improvement concerning, the user interface from their perspectives. In order to design the software applications that are easy to use, memorize and apply to new problems, we must know the users philosophy and something about learning, reminiscence and problems solving. The Usability engineering is the only way to study the deeds of users while interacting with ERP (Enterprise Resource & Planning). This paper will focus on the users' experiences view of financial module in ERP system. The HCI research method, explicitly survey questionnaire method was adopted to gather users understanding in order to evaluate the selected modules for in-housed ERP system. The study involved group of users from two industries, the results can not be generalized as a whole. The study was first time successfully applied Usability evaluation on in-housed ERP in local industry (Masood Textile Mills, Interloop Ltd) in Pakistan. The results may hopefully opened-up an area of research and methodology that could provide considerable further benefits to Industry in developments of Industrial information systems.

Mobile Applications for Participation at the Shopping Mall: Content Analysis and Usability for Persons with Physical Disabilities and Communication or Cognitive Limitations

PubMed Central

Auger, Claudine; Leduc, Emilie; Labbé, Delphine; Guay, Cassioppée; Fillion, Brigitte; Bottari, Carolina; Swaine, Bonnie

2014-01-01

The aim of this exploratory study was to determine the important features in content and usability of existing mobile applications evaluating environmental barriers and facilitators (EBF) to participation for persons with physical disabilities presenting mild communication or cognitive limitations. A rigorous process based on a user-centered design approach led to the identification of two relevant mobile applications to evaluate the EBF. An accessibility expert, the research team as well as five users then tested the mobile applications in a shopping mall. A thematic content analysis of the research team’s and users’ comments established 10 categories of key features that adequately respond to the needs of the clientele targeted in this study. In terms of content, granularity and contextualization of the information provided were considered important. With respect to usability, relevant features were place finding, rating system, presentation of results, compatibility, user-friendliness, aesthetics, credibility of the information as well as connectivity/interactiveness. The research team and the users agreed on some aspects such as aesthetics, but had different perspectives on features such as the rating system or the connectivity/interactiveness of the application. The users proposed new features suggesting that the existing mobile applications did not correspond to all their needs. PMID:25513999

Development and Usability Testing of a Web-based Self-management Intervention for Oral Cancer Survivors and their Family Caregivers

PubMed Central

Badr, Hoda; Lipnick, Daniella; Diefenbach, Michael A; Posner, Marshall; Kotz, Tamar; Miles, Brett; Genden, Eric

2016-01-01

Oral cancer (OC) survivors experience debilitating side effects that affect their quality of life (QOL) and that of their caregivers. This study aimed to develop and evaluate a dyadic, web-based intervention to improve survivor self-management and survivor/caregiver QOL. A qualitative needs assessment (semi-structured interviews) with 13 OC survivors and 12 caregivers was conducted to discern information and support needs as well as preferences regarding website features and tools. Results using Grounded Theory analysis showed that OC survivors and caregivers: 1) want and need practical advice about managing side effects; 2) want to reach out to other survivors/caregivers for information and support; and, 3) have both overlapping and unique needs and preferences regarding website features. Usability testing (N=6 survivors; 5 caregivers) uncovered problems with the intuitiveness, navigation, and design of the website that were subsequently addressed. Users rated the website favorably on the dimensions of attractiveness, controllability, efficiency, intuitiveness, and learnability, and gave it a total usability score of 80/100. Overall, this study demonstrates that OC survivors and caregivers are interested in using an online program to improve QOL, and that providing tailored website content and features based on the person’s role as survivor or caregiver is important in this population. PMID:26507369

Mobile applications for participation at the shopping mall: content analysis and usability for persons with physical disabilities and communication or cognitive limitations.

PubMed

Auger, Claudine; Leduc, Emilie; Labbé, Delphine; Guay, Cassioppée; Fillion, Brigitte; Bottari, Carolina; Swaine, Bonnie

2014-12-01

The aim of this exploratory study was to determine the important features in content and usability of existing mobile applications evaluating environmental barriers and facilitators (EBF) to participation for persons with physical disabilities presenting mild communication or cognitive limitations. A rigorous process based on a user-centered design approach led to the identification of two relevant mobile applications to evaluate the EBF. An accessibility expert, the research team as well as five users then tested the mobile applications in a shopping mall. A thematic content analysis of the research team's and users' comments established 10 categories of key features that adequately respond to the needs of the clientele targeted in this study. In terms of content, granularity and contextualization of the information provided were considered important. With respect to usability, relevant features were place finding, rating system, presentation of results, compatibility, user-friendliness, aesthetics, credibility of the information as well as connectivity/interactiveness. The research team and the users agreed on some aspects such as aesthetics, but had different perspectives on features such as the rating system or the connectivity/interactiveness of the application. The users proposed new features suggesting that the existing mobile applications did not correspond to all their needs.

Theory-based design and field-testing of an intervention to support women choosing surgery for breast cancer: BresDex.

PubMed

Sivell, Stephanie; Marsh, William; Edwards, Adrian; Manstead, Antony S R; Clements, Alison; Elwyn, Glyn

2012-02-01

Design and undertake usability and field-testing evaluation of a theory-guided decision aid (BresDex) in supporting women choosing surgery for early breast cancer. An extended Theory of Planned Behavior (TPB) and the Common Sense Model of Illness Representations (CSM) guided the design of BresDex. BresDex was evaluated and refined across 3 cycles by interviewing 6 women without personal history of breast cancer, 8 women with personal history of breast cancer who had completed treatment and 11 women newly diagnosed with breast cancer. Participants were interviewed for views on content, presentation (usability) and perceived usefulness towards deciding on treatment (utility). Framework analysis was used, guided by the extended TPB and the CSM. BresDex was positively received in content and presentation (usability). It appeared an effective support to decision-making and useful source for further information, particularly in clarifying attitudes, social norms and perceived behavioral control, and presenting consequences of decisions (utility). This study illustrates the potential benefit of the extended TPB and CSM in designing a decision aid to support women choosing breast cancer surgery. BresDex could provide decision-making support and serve as an additional source of information, to complement the care received from the clinical team. Copyright © 2011 Elsevier Ireland Ltd. All rights reserved.

A continuous usability evaluation of an electronic medication administration record application.

PubMed

Vicente Oliveros, Noelia; Gramage Caro, Teresa; Pérez Menéndez-Conde, Covadonga; Álvarez-Diaz, Ana María; Martín-Aragón Álvarez, Sagrario; Bermejo Vicedo, Teresa; Delgado Silveira, Eva

2017-12-01

The complexity of an electronic medication administration record (eMAR) has been underestimated by most designers in the past. Usability issues, such as poorly designed user application flow in eMAR, are therefore of vital importance, since they can have a negative impact on nursing activities and result in poor outcomes. The purpose of this study was to evaluate the usability of an eMAR application during its development. A usability evaluation was conducted during the development of the eMAR application. Two usability methods were used: a heuristic evaluation complemented by usability testing. Each eMAR application version provided by the vendor was evaluated by 2 hospital pharmacists, who applied the heuristic method. They reviewed the eMAR tasks, detected usability problems and their heuristic violations, and rated the severity of the usability problems. Usability testing was used to assess the final application version by observing how 3 nurses interacted with the application. Thirty-four versions were assessed before the eMAR application was considered usable. During the heuristic evaluation, the usability problems decreased from 46 unique usability problems in version 1 (V1) to 9 in version 34 (V34). In V1, usability problems were categorized into 154 heuristic violations, which decreased to 27 in V34. The average severity rating also decreased from major usability problem (2.96) to no problem (0.23). During usability testing, the 3 nurses did not encounter new usability problems. A thorough heuristic evaluation is a good method for obtaining a usable eMAR application. This evaluation points key areas for improvement and decreases usability problems and their severity. © 2017 John Wiley & Sons, Ltd.

Usability of a patient education and motivation tool using heuristic evaluation.

PubMed

Joshi, Ashish; Arora, Mohit; Dai, Liwei; Price, Kathleen; Vizer, Lisa; Sears, Andrew

2009-11-06

Computer-mediated educational applications can provide a self-paced, interactive environment to deliver educational content to individuals about their health condition. These programs have been used to deliver health-related information about a variety of topics, including breast cancer screening, asthma management, and injury prevention. We have designed the Patient Education and Motivation Tool (PEMT), an interactive computer-based educational program based on behavioral, cognitive, and humanistic learning theories. The tool is designed to educate users and has three key components: screening, learning, and evaluation. The objective of this tutorial is to illustrate a heuristic evaluation using a computer-based patient education program (PEMT) as a case study. The aims were to improve the usability of PEMT through heuristic evaluation of the interface; to report the results of these usability evaluations; to make changes based on the findings of the usability experts; and to describe the benefits and limitations of applying usability evaluations to PEMT. PEMT was evaluated by three usability experts using Nielsen's usability heuristics while reviewing the interface to produce a list of heuristic violations with severity ratings. The violations were sorted by heuristic and ordered from most to least severe within each heuristic. A total of 127 violations were identified with a median severity of 3 (range 0 to 4 with 0 = no problem to 4 = catastrophic problem). Results showed 13 violations for visibility (median severity = 2), 38 violations for match between system and real world (median severity = 2), 6 violations for user control and freedom (median severity = 3), 34 violations for consistency and standards (median severity = 2), 11 violations for error severity (median severity = 3), 1 violation for recognition and control (median severity = 3), 7 violations for flexibility and efficiency (median severity = 2), 9 violations for aesthetic and minimalist design (median severity = 2), 4 violations for help users recognize, diagnose, and recover from errors (median severity = 3), and 4 violations for help and documentation (median severity = 4). We describe the heuristic evaluation method employed to assess the usability of PEMT, a method which uncovers heuristic violations in the interface design in a quick and efficient manner. Bringing together usability experts and health professionals to evaluate a computer-mediated patient education program can help to identify problems in a timely manner. This makes this method particularly well suited to the iterative design process when developing other computer-mediated health education programs. Heuristic evaluations provided a means to assess the user interface of PEMT.

Usability of a Patient Education and Motivation Tool Using Heuristic Evaluation

PubMed Central

Arora, Mohit; Dai, Liwei; Price, Kathleen; Vizer, Lisa; Sears, Andrew

2009-01-01

Background Computer-mediated educational applications can provide a self-paced, interactive environment to deliver educational content to individuals about their health condition. These programs have been used to deliver health-related information about a variety of topics, including breast cancer screening, asthma management, and injury prevention. We have designed the Patient Education and Motivation Tool (PEMT), an interactive computer-based educational program based on behavioral, cognitive, and humanistic learning theories. The tool is designed to educate users and has three key components: screening, learning, and evaluation. Objective The objective of this tutorial is to illustrate a heuristic evaluation using a computer-based patient education program (PEMT) as a case study. The aims were to improve the usability of PEMT through heuristic evaluation of the interface; to report the results of these usability evaluations; to make changes based on the findings of the usability experts; and to describe the benefits and limitations of applying usability evaluations to PEMT. Methods PEMT was evaluated by three usability experts using Nielsen’s usability heuristics while reviewing the interface to produce a list of heuristic violations with severity ratings. The violations were sorted by heuristic and ordered from most to least severe within each heuristic. Results A total of 127 violations were identified with a median severity of 3 (range 0 to 4 with 0 = no problem to 4 = catastrophic problem). Results showed 13 violations for visibility (median severity = 2), 38 violations for match between system and real world (median severity = 2), 6 violations for user control and freedom (median severity = 3), 34 violations for consistency and standards (median severity = 2), 11 violations for error severity (median severity = 3), 1 violation for recognition and control (median severity = 3), 7 violations for flexibility and efficiency (median severity = 2), 9 violations for aesthetic and minimalist design (median severity = 2), 4 violations for help users recognize, diagnose, and recover from errors (median severity = 3), and 4 violations for help and documentation (median severity = 4). Conclusion We describe the heuristic evaluation method employed to assess the usability of PEMT, a method which uncovers heuristic violations in the interface design in a quick and efficient manner. Bringing together usability experts and health professionals to evaluate a computer-mediated patient education program can help to identify problems in a timely manner. This makes this method particularly well suited to the iterative design process when developing other computer-mediated health education programs. Heuristic evaluations provided a means to assess the user interface of PEMT. PMID:19897458

Mind the Gap. A systematic review to identify usability and safety challenges and practices during electronic health record implementation.

PubMed

Ratwani, Raj; Fairbanks, Terry; Savage, Erica; Adams, Katie; Wittie, Michael; Boone, Edna; Hayden, Andrew; Barnes, Janey; Hettinger, Zach; Gettinger, Andrew

2016-11-16

Decisions made during electronic health record (EHR) implementations profoundly affect usability and safety. This study aims to identify gaps between the current literature and key stakeholders' perceptions of usability and safety practices and the challenges encountered during the implementation of EHRs. Two approaches were used: a literature review and interviews with key stakeholders. We performed a systematic review of the literature to identify usability and safety challenges and best practices during implementation. A total of 55 articles were reviewed through searches of PubMed, Web of Science and Scopus. We used a qualitative approach to identify key stakeholders' perceptions; semi-structured interviews were conducted with a diverse set of health IT stakeholders to understand their current practices and challenges related to usability during implementation. We used a grounded theory approach: data were coded, sorted, and emerging themes were identified. Conclusions from both sources of data were compared to identify areas of misalignment. We identified six emerging themes from the literature and stakeholder interviews: cost and resources, risk assessment, governance and consensus building, customization, clinical workflow and usability testing, and training. Across these themes, there were misalignments between the literature and stakeholder perspectives, indicating major gaps. Major gaps identified from each of six emerging themes are discussed as critical areas for future research, opportunities for new stakeholder initiatives, and opportunities to better disseminate resources to improve the implementation of EHRs. Our analysis identified practices and challenges across six different emerging themes, illustrated important gaps, and results suggest critical areas for future research and dissemination to improve EHR implementation.

Usability of a real-time tracked augmented reality display system in musculoskeletal injections

NASA Astrophysics Data System (ADS)

Baum, Zachary; Ungi, Tamas; Lasso, Andras; Fichtinger, Gabor

2017-03-01

PURPOSE: Image-guided needle interventions are seldom performed with augmented reality guidance in clinical practice due to many workspace and usability restrictions. We propose a real-time optically tracked image overlay system to make image-guided musculoskeletal injections more efficient and assess its usability in a bed-side clinical environment. METHODS: An image overlay system consisting of an optically tracked viewbox, tablet computer, and semitransparent mirror allows users to navigate scanned patient volumetric images in real-time using software built on the open-source 3D Slicer application platform. A series of experiments were conducted to evaluate the latency and screen refresh rate of the system using different image resolutions. To assess the usability of the system and software, five medical professionals were asked to navigate patient images while using the overlay and completed a questionnaire to assess the system. RESULTS: In assessing the latency of the system with scanned images of varying size, screen refresh rates were approximately 5 FPS. The study showed that participants found using the image overlay system easy, and found the table-mounted system was significantly more usable and effective than the handheld system. CONCLUSION: It was determined that the system performs comparably with scanned images of varying size when assessing the latency of the system. During our usability study, participants preferred the table-mounted system over the handheld. The participants also felt that the system itself was simple to use and understand. With these results, the image overlay system shows promise for use in a clinical environment.

Heuristic Evaluation of Online COPD Respiratory Therapy and Education Video Resource Center

PubMed Central

Chaney, Beth; Chaney, Don

2014-01-01

Abstract Purpose: Because of limited accessibility to pulmonary rehabilitation programs, patients with chronic obstructive pulmonary disease (COPD) are infrequently provided with patient education resources. To help educate patients with COPD on how to live a better life with diminished breathing capacity, we developed a novel social media resource center containing COPD respiratory therapy and education videos called “COPDFlix.” Methodology: A heuristic evaluation of COPDFlix was conducted as part of a larger study to determine whether the prototype was successful in adhering to formal Web site usability guidelines for older adults. A purposive sample of three experts, with expertise in Web design and health communications technology, was recruited (a) to identify usability violations and (b) to propose solutions to improve the functionality of the COPDFlix prototype. Each expert evaluated 18 heuristics in four categories of task-based criteria (i.e., interaction and navigation, information architecture, presentation design, and information design). Seventy-six subcriteria across these four categories were assessed. Quantitative ratings and qualitative comments from each expert were compiled into a single master list, noting the violated heuristic and type/location of problem(s). Results: Sixty-one usability violations were identified across the 18 heuristics. Evaluators rated the majority of heuristic subcriteria as either a “minor hindrance” (n=32) or “no problem” (n=132). Moreover, only 2 of the 18 heuristic categories were noted as “major” violations, with mean severity scores of ≥3. Conclusions: Mixed-methods data analysis helped the multidisciplinary research team to categorize and prioritize usability problems and solutions, leading to 26 discrete design modifications within the COPDFlix prototype. PMID:24650318

Facilitating Secure Sharing of Personal Health Data in the Cloud.

PubMed

Thilakanathan, Danan; Calvo, Rafael A; Chen, Shiping; Nepal, Surya; Glozier, Nick

2016-05-27

Internet-based applications are providing new ways of promoting health and reducing the cost of care. Although data can be kept encrypted in servers, the user does not have the ability to decide whom the data are shared with. Technically this is linked to the problem of who owns the data encryption keys required to decrypt the data. Currently, cloud service providers, rather than users, have full rights to the key. In practical terms this makes the users lose full control over their data. Trust and uptake of these applications can be increased by allowing patients to feel in control of their data, generally stored in cloud-based services. This paper addresses this security challenge by providing the user a way of controlling encryption keys independently of the cloud service provider. We provide a secure and usable system that enables a patient to share health information with doctors and specialists. We contribute a secure protocol for patients to share their data with doctors and others on the cloud while keeping complete ownership. We developed a simple, stereotypical health application and carried out security tests, performance tests, and usability tests with both students and doctors (N=15). We developed the health application as an app for Android mobile phones. We carried out the usability tests on potential participants and medical professionals. Of 20 participants, 14 (70%) either agreed or strongly agreed that they felt safer using our system. Using mixed methods, we show that participants agreed that privacy and security of health data are important and that our system addresses these issues. We presented a security protocol that enables patients to securely share their eHealth data with doctors and nurses and developed a secure and usable system that enables patients to share mental health information with doctors.

Web-Based Intervention for Nutritional Management in Cystic Fibrosis: Development, Usability, and Pilot Trial.

PubMed

Stark, Lori J; Opipari-Arrigan, Lisa; Filigno, Stephanie S; Simon, Stacey L; Leonard, Amanda; Mogayzel, Peter J; Rausch, Joseph; Zion, Cynthia; Powers, Scott W

2016-06-01

Usability and pilot testing of a web intervention (BeInCharge.org [BIC]) of behavior plus nutrition intervention for children with cystic fibrosis (CF) ages 4-9 years. Think Aloud methodology was used with five mothers to assess usability and refine the intervention. A pilot trial was then conducted with 10 mothers of children with CF ages 4-9 years randomized to the web-based BIC or a Standard Care Control (STC). Change in weight gain for each group was compared in a pre-to-post design. Mothers rated the usability and clarity of BIC highly. The pilot trial showed children of mothers who received BIC had a significant change in weight pre-to-post-treatment (0.67 kg, p = .04). Change for the STC was not significant (0.41 kg, p = .10). A web-based behavior plus nutrition intervention appears promising in increasing weight gain in children with CF. © The Author 2015. Published by Oxford University Press on behalf of the Society of Pediatric Psychology. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

Usability of stereoscopic view in teleoperation

NASA Astrophysics Data System (ADS)

Boonsuk, Wutthigrai

2015-03-01

Recently, there are tremendous growths in the area of 3D stereoscopic visualization. The 3D stereoscopic visualization technology has been used in a growing number of consumer products such as the 3D televisions and the 3D glasses for gaming systems. This technology refers to the idea that human brain develops depth of perception by retrieving information from the two eyes. Our brain combines the left and right images on the retinas and extracts depth information. Therefore, viewing two video images taken at slightly distance apart as shown in Figure 1 can create illusion of depth [8]. Proponents of this technology argue that the stereo view of 3D visualization increases user immersion and performance as more information is gained through the 3D vision as compare to the 2D view. However, it is still uncertain if additional information gained from the 3D stereoscopic visualization can actually improve user performance in real world situations such as in the case of teleoperation.

A Novel Information Retrieval Tool to Find Hospital Care Team Members: Development and Usability Study.

PubMed

Morawski, Kyle; Monsen, Craig; Takhar, Sukhjit; Landman, Adam

2018-04-16

Hospital communication among members of a patient's care team is a central part of clinical workflow and consumes a large amount of a health care provider's time. Oftentimes the complexity of hospital care leads to difficulty in finding the appropriate contact, which can lead to inefficiencies and frustration. Squire is a Web-based information retrieval app created to improve the speed and efficiency in reaching the appropriate team member during the care of a hospitalized patient. The objective of the study was to design and develop Squire and to evaluate the usage, usability, and perceived effect of the app on finding the correct contact within a hospital. We used a mixed-methods design using a before-after survey methodology combined with one-on-one interviews to understand the perceived effect of Squire. The study took place at an academic medical center with internal medicine resident physicians. We surveyed residents on demographics, as well as time and efficiency of hospital communication before and after the use of Squire. After using Squire, participants were also asked to evaluate Squire's Net Promoter Score (NPS). A subset of voluntary participants participated in one-on-one interviews and completed the System Usability Scale (SUS). We performed descriptive statistics on participant characteristics, app usage data, and responses to surveys. Survey results were compared before and after Squire adoption using the Wilcoxon rank-sum test and a general linear model. Interview data were analyzed using content analysis with a qualitative description approach to review and categorize feedback from participants. There was a 67.9% (74/109) response rate to the pre-Squire survey and 89.9% (98/109) response rate to the post-Squire survey. At baseline, there was an average of 22.2 (95% CI 18.4-26.0) minutes/day spent searching for the right contact, and this decreased to 16.3 (95% CI 13.9-18.7) minutes/day after Squire was launched (P=.01). There were favorable usability scores, with an average SUS of 84.7, and a marginal NPS of +6.1. Overall, the use of Squire included 22,283 page views, most commonly to contact the admissions office or portable chest x-ray technician. Interviews highlighted common benefits of Squire, including decreased perceived time spent on hold with operators and improvement in connecting with the appropriate contact in specialized, complex departments. Future opportunities were also identified to improve Squire including adding a two-way communication between physician and nursing staff and providing offline access. Squire decreased the perceived time required to find an appropriate contact and had a favorable usability score; however, the NPS was marginal and several opportunities were identified to improve Squire for future use. ©Kyle Morawski, Craig Monsen, Sukhjit Takhar, Adam Landman. Originally published in JMIR Human Factors (http://humanfactors.jmir.org), 16.04.2018.

A diabetes dashboard and physician efficiency and accuracy in accessing data needed for high-quality diabetes care.

PubMed

Koopman, Richelle J; Kochendorfer, Karl M; Moore, Joi L; Mehr, David R; Wakefield, Douglas S; Yadamsuren, Borchuluun; Coberly, Jared S; Kruse, Robin L; Wakefield, Bonnie J; Belden, Jeffery L

2011-01-01

We compared use of a new diabetes dashboard screen with use of a conventional approach of viewing multiple electronic health record (EHR) screens to find data needed for ambulatory diabetes care. We performed a usability study, including a quantitative time study and qualitative analysis of information-seeking behaviors. While being recorded with Morae Recorder software and "think-aloud" interview methods, 10 primary care physicians first searched their EHR for 10 diabetes data elements using a conventional approach for a simulated patient, and then using a new diabetes dashboard for another. We measured time, number of mouse clicks, and accuracy. Two coders analyzed think-aloud and interview data using grounded theory methodology. The mean time needed to find all data elements was 5.5 minutes using the conventional approach vs 1.3 minutes using the diabetes dashboard (P <.001). Physicians correctly identified 94% of the data requested using the conventional method, vs 100% with the dashboard (P <.01). The mean number of mouse clicks was 60 for conventional searching vs 3 clicks with the diabetes dashboard (P <.001). A common theme was that in everyday practice, if physicians had to spend too much time searching for data, they would either continue without it or order a test again. Using a patient-specific diabetes dashboard improves both the efficiency and accuracy of acquiring data needed for high-quality diabetes care. Usability analysis tools can provide important insights into the value of optimizing physician use of health information technologies.

Exploring user experience and technology acceptance for a fall prevention system: results from a randomized clinical trial and a living lab.

PubMed

Vaziri, Daryoush D; Aal, Konstantin; Ogonowski, Corinna; Von Rekowski, Thomas; Kroll, Michael; Marston, Hannah R; Poveda, Rakel; Gschwind, Yves J; Delbaere, Kim; Wieching, Rainer; Wulf, Volker

2016-01-01

Falls are common in older adults and can result in serious injuries. Due to demographic changes, falls and related healthcare costs are likely to increase over the next years. Participation and motivation of older adults in fall prevention measures remain a challenge. The iStoppFalls project developed an information and communication technology (ICT)-based system for older adults to use at home in order to reduce common fall risk factors such as impaired balance and muscle weakness. The system aims at increasing older adults' motivation to participate in ICT-based fall prevention measures. This article reports on usability, user-experience and user-acceptance aspects affecting the use of the iStoppFalls system by older adults. In the course of a 16-week international multicenter study, 153 community-dwelling older adults aged 65+ participated in the iStoppFalls randomized controlled trial, of which half used the system in their home to exercise and assess their risk of falling. During the study, 60 participants completed questionnaires regarding the usability, user experience and user acceptance of the iStoppFalls system. Usability was measured with the System Usability Scale (SUS). For user experience the Physical Activity Enjoyment Scale (PACES) was applied. User acceptance was assessed with the Dynamic Acceptance Model for the Re-evaluation of Technologies (DART). To collect more detailed data on usability, user experience and user acceptance, additional qualitative interviews and observations were conducted with participants. Participants evaluated the usability of the system with an overall score of 62 (Standard Deviation, SD 15.58) out of 100, which suggests good usability. Most users enjoyed the iStoppFalls games and assessments, as shown by the overall PACES score of 31 (SD 8.03). With a score of 0.87 (SD 0.26), user acceptance results showed that participants accepted the iStoppFalls system for use in their own home. Interview data suggested that certain factors such as motivation, complexity or graphical design were different for gender and age. The results suggest that the iStoppFalls system has good usability, user experience and user acceptance. It will be important to take these along with factors such as motivation, gender and age into consideration when designing and further developing ICT-based fall prevention systems.

Water Quality Indicators Data Usability Improvement Project ...

EPA Pesticide Factsheets

ECHO, Enforcement and Compliance History Online, provides compliance and enforcement information for approximately 800,000 EPA-regulated facilities nationwide. ECHO includes permit, inspection, violation, enforcement action, and penalty information about facilities regulated under the Clean Air Act (CAA) Stationary Source Program, Clean Water Act (CWA) National Pollutant Elimination Discharge System (NPDES), and/or Resource Conservation and Recovery Act (RCRA). Information also is provided on surrounding demographics when available.

Comparing usability testing outcomes and functions of six electronic nursing record systems.

PubMed

Cho, Insook; Kim, Eunman; Choi, Woan Heui; Staggers, Nancy

2016-04-01

This study examined the usability of six differing electronic nursing record (ENR) systems on the efficiency, proficiency and available functions for documenting nursing care and subsequently compared the results to nurses' perceived satisfaction from a previous study. The six hospitals had different ENR systems, all with narrative nursing notes in use for more than three years. Stratified by type of nursing unit, 54 staff nurses were digitally recorded during on-site usability testing by employing validated patient care scenarios and think-aloud protocols. The time to complete specific tasks was also measured. Qualitative performance data were converted into scores on efficiency (relevancy), proficiency (accuracy), and a competency index using scoring schemes described by McGuire and Babbott. Six nurse managers and the researchers completed assessments of available ENR functions and examined computerized nursing process components including the linkages among them. For the usability test, participants' mean efficiency score was 94.2% (95% CI, 91.4-96.9%). The mean proficiency was 60.6% (95% CI, 54.3-66.8%), and the mean competency index was 59.5% (95% CI, 52.9-66.0). Efficiency scores were significantly different across ENRs as was the time to complete tasks, ranging from 226.3 to 457.2s (χ(2)=12.3, P=0.031; χ(2)=11.2, P=0.048). No significant differences were seen for proficiency scores. The coverage of the various ENRs' nursing process ranged from 67% to 100%, but only two systems had complete integration of nursing components. Two systems with high efficiency and proficiency scores had much lower usability test scores and perceived user satisfaction along with more complex navigation patterns. In terms of system usability and functions, different levels of sophistication of and interaction performance with ENR systems exist in practice. This suggests that ENRs may have variable impacts on clinical outcomes and care quality. Future studies are needed to explore ENR impact on nursing care quality, efficiency, and safety. Copyright © 2016 Elsevier Ireland Ltd. All rights reserved.

An experiment with content distribution methods in touchscreen mobile devices.

PubMed

Garcia-Lopez, Eva; Garcia-Cabot, Antonio; de-Marcos, Luis

2015-09-01

This paper compares the usability of three different content distribution methods (scrolling, paging and internal links) in touchscreen mobile devices as means to display web documents. Usability is operationalized in terms of effectiveness, efficiency and user satisfaction. These dimensions are then measured in an experiment (N = 23) in which users are required to find words in regular-length web documents. Results suggest that scrolling is statistically better in terms of efficiency and user satisfaction. It is also found to be more effective but results were not significant. Our findings are also compared with existing literature to propose the following guideline: "try to use vertical scrolling in web pages for mobile devices instead of paging or internal links, except when the content is too large, then paging is recommended". With an ever increasing number of touchscreen web-enabled mobile devices, this new guideline can be relevant for content developers targeting the mobile web as well as institutions trying to improve the usability of their content for mobile platforms. Copyright © 2015 Elsevier Ltd and The Ergonomics Society. All rights reserved.

Workload measurement in a communication application operated through a P300-based brain-computer interface

NASA Astrophysics Data System (ADS)

Riccio, A.; Leotta, F.; Bianchi, L.; Aloise, F.; Zickler, C.; Hoogerwerf, E.-J.; Kübler, A.; Mattia, D.; Cincotti, F.

2011-04-01

Advancing the brain-computer interface (BCI) towards practical applications in technology-based assistive solutions for people with disabilities requires coping with problems of accessibility and usability to increase user acceptance and satisfaction. The main objective of this study was to introduce a usability-oriented approach in the assessment of BCI technology development by focusing on evaluation of the user's subjective workload and satisfaction. The secondary aim was to compare two applications for a P300-based BCI. Eight healthy subjects were asked to use an assistive technology solution which integrates the P300-based BCI with commercially available software under two conditions—visual stimuli needed to evoke the P300 response were either overlaid onto the application's graphical user interface or presented on a separate screen. The two conditions were compared for effectiveness (level of performance), efficiency (subjective workload measured by means of NASA-TXL) and satisfaction of the user. Although no significant difference in usability could be detected between the two conditions, the methodology proved to be an effective tool to highlight weaknesses in the technical solution.

Of Coaches and Researchers

ERIC Educational Resources Information Center

Groves, Richard

1977-01-01

Research information in sports physiology must be compiled in usable form, and coaches must incorporate the results into their coaching tactics and methods if American athletes are to be able to compete on equal terms in foreign competition. (MB)

Protecting the Privacy and Security of Your Health Information

MedlinePlus

... Access to Medical Records Privacy, Security, and HIPAA Laws, Regulation, and Policy Scientific Initiatives Standards & Technology Usability ... care providers and professionals, and the government. Federal laws require many of the key persons and organizations ...

Safety and usability evaluation of a web-based insulin self-titration system for patients with type 2 diabetes mellitus.

PubMed

Simon, Airin C R; Holleman, Frits; Gude, Wouter T; Hoekstra, Joost B L; Peute, Linda W; Jaspers, Monique W M; Peek, Niels

2013-09-01

The rising incidence of type 2 diabetes mellitus (T2DM) induces severe challenges for the health care system. Our research group developed a web-based system named PANDIT that provides T2DM patients with insulin dosing advice using state of the art clinical decision support technology. The PANDIT interface resembles a glucose diary and provides advice through pop-up messages. Diabetes nurses (DNs) also have access to the system, allowing them to intervene when needed. The objective of this study was to establish whether T2DM patients can safely use PANDIT at home. To this end, we assessed whether patients experience usability problems with a high risk of compromising patient safety when interacting with the system, and whether PANDIT's insulin dosing advice are clinically safe. The study population consisted of patients with T2DM (aged 18-80) who used a once daily basal insulin as well as DNs from a university hospital. The usability evaluation consisted of think-aloud sessions with four patients and three DNs. Video data, audio data and verbal utterances were analyzed for usability problems encountered during PANDIT interactions. Usability problems were rated by a physician and a usability expert according to their potential impact on patient safety. The usability evaluation was followed by an implementation with a duration of four weeks. This implementation took place at the patients' homes with ten patients to evaluate clinical safety of PANDIT advice. PANDIT advice were systematically compared with DN advice. Deviating advice were evaluated with respect to patient safety by a panel of experienced physicians, which specialized in diabetes care. We detected seventeen unique usability problems, none of which was judged to have a high risk of compromising patient safety. Most usability problems concerned the lay-out of the diary, which did not clearly indicate which data entry fields had to be entered in order to obtain an advice. 27 out of 74 (36.5%) PANDIT advice differed from those provided by DNs. However, only one of these (1.4%) was considered unsafe by the panel. T2DM patients with no prior experience with the web-based self-management system were capable of consulting the system without encountering significant usability problems. Furthermore, the large majority of PANDIT advice were considered clinically safe according to the expert panel. One advice was considered unsafe. This could however easily be corrected by implementing a small modification to the system's knowledge base. Copyright © 2013 Elsevier B.V. All rights reserved.

Interactivity Centered Usability Evaluation (ICUE) for Course Management Systems

ERIC Educational Resources Information Center

Yoon, Sangil

2010-01-01

ICUE (Interactivity Centered Usability Evaluation) is an enhanced usability testing protocol created by the researcher. ICUE augments the facilitator's role for usability testing, and offers strategies in developing and presenting usability tasks during a testing session. ICUE was designed to address weaknesses found in the usability evaluation of…