Combining usability evaluations to highlight the chain that leads from usability flaws to usage problems and then negative outcomes.

PubMed

Watbled, Ludivine; Marcilly, Romaric; Guerlinger, Sandra; Bastien, J-M Christian; Beuscart-Zéphir, Marie-Catherine; Beuscart, Régis

2018-02-01

Poor usability of health technology is thought to diminish work system performance, increase error rates and, potentially, harm patients. The present study (i) used a combination of usability evaluation methods to highlight the chain that leads from usability flaws to usage problems experienced by users and, ultimately, to negative patient outcomes, and (ii) validated this approach by studying two different discharge summary production systems. To comply with quality guidelines, the process of drafting and sending discharge summaries is increasingly being automated. However, the usability of these systems may modify their impact (or the absence thereof) in terms of production times and quality, and must therefore be evaluated. Here, we applied three successive techniques for usability evaluation (heuristic evaluation, user testing and field observation) to two discharge summary production systems (underpinned by different technologies). The systems' main usability flaws led respectively to an increase in the time need to produce a discharge summary and the risk of patient misidentification. Our results are discussed with regard to the possibility of linking the usability flaws, usage problems and the negative outcomes by successively applying three methods for evaluating usability (heuristic evaluation, user testing and in situ observations) throughout the system development life cycle. Copyright © 2018 Elsevier Inc. All rights reserved.

Usability Evaluation of a Web-Based Learning System

ERIC Educational Resources Information Center

Nguyen, Thao

2012-01-01

The paper proposes a contingent, learner-centred usability evaluation method and a prototype tool of such systems. This is a new usability evaluation method for web-based learning systems using a set of empirically-supported usability factors and can be done effectively with limited resources. During the evaluation process, the method allows for…

Using a fuzzy comprehensive evaluation method to determine product usability: A proposed theoretical framework.

PubMed

Zhou, Ronggang; Chan, Alan H S

2017-01-01

In order to compare existing usability data to ideal goals or to that for other products, usability practitioners have tried to develop a framework for deriving an integrated metric. However, most current usability methods with this aim rely heavily on human judgment about the various attributes of a product, but often fail to take into account of the inherent uncertainties in these judgments in the evaluation process. This paper presents a universal method of usability evaluation by combining the analytic hierarchical process (AHP) and the fuzzy evaluation method. By integrating multiple sources of uncertain information during product usability evaluation, the method proposed here aims to derive an index that is structured hierarchically in terms of the three usability components of effectiveness, efficiency, and user satisfaction of a product. With consideration of the theoretical basis of fuzzy evaluation, a two-layer comprehensive evaluation index was first constructed. After the membership functions were determined by an expert panel, the evaluation appraisals were computed by using the fuzzy comprehensive evaluation technique model to characterize fuzzy human judgments. Then with the use of AHP, the weights of usability components were elicited from these experts. Compared to traditional usability evaluation methods, the major strength of the fuzzy method is that it captures the fuzziness and uncertainties in human judgments and provides an integrated framework that combines the vague judgments from multiple stages of a product evaluation process.

Distributed usability evaluation of the Pennsylvania Cancer Atlas

PubMed Central

Bhowmick, Tanuka; Robinson, Anthony C; Gruver, Adrienne; MacEachren, Alan M; Lengerich, Eugene J

2008-01-01

Background The Pennsylvania Cancer Atlas (PA-CA) is an interactive online atlas to help policy-makers, program managers, and epidemiologists with tasks related to cancer prevention and control. The PA-CA includes maps, graphs, tables, that are dynamically linked to support data exploration and decision-making with spatio-temporal cancer data. Our Atlas development process follows a user-centered design approach. To assess the usability of the initial versions of the PA-CA, we developed and applied a novel strategy for soliciting user feedback through multiple distributed focus groups and surveys. Our process of acquiring user feedback leverages an online web application (e-Delphi). In this paper we describe the PA-CA, detail how we have adapted e-Delphi web application to support usability and utility evaluation of the PA-CA, and present the results of our evaluation. Results We report results from four sets of users. Each group provided structured individual and group assessments of the PA-CA as well as input on the kinds of users and applications for which it is best suited. Overall reactions to the PA-CA are quite positive. Participants did, however, provide a range of useful suggestions. Key suggestions focused on improving interaction functions, enhancing methods of temporal analysis, addressing data issues, and providing additional data displays and help functions. These suggestions were incorporated in each design and implementation iteration for the PA-CA and used to inform a set of web-atlas design principles. Conclusion For the Atlas, we find that a design that utilizes linked map, graph, and table views is understandable to and perceived to be useful by the target audience of cancer prevention and control professionals. However, it is clear that considerable variation in experience using maps and graphics exists and for those with less experience, integrated tutorials and help features are needed. In relation to our usability assessment strategy, we find that our distributed, web-based method for soliciting user input is generally effective. Advantages include the ability to gather information from users distributed in time and space and the relative anonymity of the participants while disadvantages include less control over when and how often participants provide input and challenges for obtaining rich input. PMID:18620565

Usability Evaluation of An Electronic Medication Administration Record (eMAR) Application

PubMed Central

Guo, J.; Iribarren, S.; Kapsandoy, S.; Perri, S.; Staggers, N.

2011-01-01

Background Electronic medication administration records (eMARs) have been widely used in recent years. However, formal usability evaluations are not yet available for these vendor applications, especially from the perspective of nurses, the largest group of eMAR users. Objective To conduct a formal usability evaluation of an implemented eMAR. Methods Four evaluators examined a commercial vendor eMAR using heuristic evaluation techniques. The evaluators defined seven tasks typical of eMAR use and independently evaluated the application. Consensus techniques were used to obtain 100% agreement of identified usability problems and severity ratings. Findings were reviewed with 5 clinical staff nurses and the Director of Clinical Informatics who verified findings with a small group of clinical nurses. Results Evaluators found 60 usability problems categorized into 233 heuristic violations. Match, Error, and Visibility heuristics were the most frequently violated. Administer Medication and Order and Modify Medications tasks had the highest number of heuristic violations and usability problems rated as major or catastrophic. Conclusion The high number of usability problems could impact the effectiveness, efficiency and satisfaction of nurses’ medication administration activities and may include concerns about patient safety. Usability is a joint responsibility between sites and vendors. We offer a call to action for usability evaluations at all sites and eMAR application redesign as necessary to improve the user experience and promote patient safety. PMID:23616871

Using a fuzzy comprehensive evaluation method to determine product usability: A proposed theoretical framework

PubMed Central

Zhou, Ronggang; Chan, Alan H. S.

2016-01-01

BACKGROUND: In order to compare existing usability data to ideal goals or to that for other products, usability practitioners have tried to develop a framework for deriving an integrated metric. However, most current usability methods with this aim rely heavily on human judgment about the various attributes of a product, but often fail to take into account of the inherent uncertainties in these judgments in the evaluation process. OBJECTIVE: This paper presents a universal method of usability evaluation by combining the analytic hierarchical process (AHP) and the fuzzy evaluation method. By integrating multiple sources of uncertain information during product usability evaluation, the method proposed here aims to derive an index that is structured hierarchically in terms of the three usability components of effectiveness, efficiency, and user satisfaction of a product. METHODS: With consideration of the theoretical basis of fuzzy evaluation, a two-layer comprehensive evaluation index was first constructed. After the membership functions were determined by an expert panel, the evaluation appraisals were computed by using the fuzzy comprehensive evaluation technique model to characterize fuzzy human judgments. Then with the use of AHP, the weights of usability components were elicited from these experts. RESULTS AND CONCLUSIONS: Compared to traditional usability evaluation methods, the major strength of the fuzzy method is that it captures the fuzziness and uncertainties in human judgments and provides an integrated framework that combines the vague judgments from multiple stages of a product evaluation process. PMID:28035943

Usability Evaluation of a Private Social Network on Mental Health for Relatives.

PubMed

Toribio-Guzmán, José Miguel; García-Holgado, Alicia; Soto Pérez, Felipe; García-Peñalvo, Francisco J; Franco Martín, Manuel

2017-09-01

Usability is one of the most prominent criteria that must be fulfilled by a software product. This study aims to evaluate the usability of SocialNet, a private social network for monitoring the daily progress of patients by their relatives, using a mixed usability approach: heuristic evaluation conducted by experts and user testing. A double heuristic evaluation with one expert evaluator identified the issues related to consistency, design, and privacy. User testing was conducted on 20 users and one evaluator using observation techniques and questionnaires. The main usability problems were found to be related to the structure of SocialNet, and the users presented some difficulties in locating the buttons or links. The results show a high level of usability and satisfaction with the product. This evaluation provides data on the usability of SocialNet based on the difficulties experienced by the users and the expert. The results help in redesigning the tool to resolve the identified problems as part of an iterative process.

A human reliability based usability evaluation method for safety-critical software

DOE Office of Scientific and Technical Information (OSTI.GOV)

Boring, R. L.; Tran, T. Q.; Gertman, D. I.

2006-07-01

Boring and Gertman (2005) introduced a novel method that augments heuristic usability evaluation methods with that of the human reliability analysis method of SPAR-H. By assigning probabilistic modifiers to individual heuristics, it is possible to arrive at the usability error probability (UEP). Although this UEP is not a literal probability of error, it nonetheless provides a quantitative basis to heuristic evaluation. This method allows one to seamlessly prioritize and identify usability issues (i.e., a higher UEP requires more immediate fixes). However, the original version of this method required the usability evaluator to assign priority weights to the final UEP, thusmore » allowing the priority of a usability issue to differ among usability evaluators. The purpose of this paper is to explore an alternative approach to standardize the priority weighting of the UEP in an effort to improve the method's reliability. (authors)« less

Comparison of two heuristic evaluation methods for evaluating the usability of health information systems.

PubMed

Khajouei, Reza; Hajesmaeel Gohari, Sadrieh; Mirzaee, Moghaddameh

2018-04-01

In addition to following the usual Heuristic Evaluation (HE) method, the usability of health information systems can also be evaluated using a checklist. The objective of this study is to compare the performance of these two methods in identifying usability problems of health information systems. Eight evaluators independently evaluated different parts of a Medical Records Information System using two methods of HE (usual and with a checklist). The two methods were compared in terms of the number of problems identified, problem type, and the severity of identified problems. In all, 192 usability problems were identified by two methods in the Medical Records Information System. This was significantly higher than the number of usability problems identified by the checklist and usual method (148 and 92, respectively) (p < 0.0001). After removing the duplicates, the difference between the number of unique usability problems identified by the checklist method (n = 100) and usual method (n = 44) was significant (p < 0.0001). Differences between the mean severity of the real usability problems (1.83) and those identified by only one of the methods (usual = 2.05, checklist = 1.74) were significant (p = 0.001). This study revealed the potential of the two HE methods for identifying usability problems of health information systems. The results demonstrated that the checklist method had significantly better performance in terms of the number of identified usability problems; however, the performance of the usual method for identifying problems of higher severity was significantly better. Although the checklist method can be more efficient for less experienced evaluators, wherever usability is critical, the checklist should be used with caution in usability evaluations. Copyright © 2018 Elsevier Inc. All rights reserved.

Advancing Usability Evaluation through Human Reliability Analysis

DOE Office of Scientific and Technical Information (OSTI.GOV)

Ronald L. Boring; David I. Gertman

2005-07-01

This paper introduces a novel augmentation to the current heuristic usability evaluation methodology. The SPAR-H human reliability analysis method was developed for categorizing human performance in nuclear power plants. Despite the specialized use of SPAR-H for safety critical scenarios, the method also holds promise for use in commercial off-the-shelf software usability evaluations. The SPAR-H method shares task analysis underpinnings with human-computer interaction, and it can be easily adapted to incorporate usability heuristics as performance shaping factors. By assigning probabilistic modifiers to heuristics, it is possible to arrive at the usability error probability (UEP). This UEP is not a literal probabilitymore » of error but nonetheless provides a quantitative basis to heuristic evaluation. When combined with a consequence matrix for usability errors, this method affords ready prioritization of usability issues.« less

Usability Prediction & Ranking of SDLC Models Using Fuzzy Hierarchical Usability Model

NASA Astrophysics Data System (ADS)

Gupta, Deepak; Ahlawat, Anil K.; Sagar, Kalpna

2017-06-01

Evaluation of software quality is an important aspect for controlling and managing the software. By such evaluation, improvements in software process can be made. The software quality is significantly dependent on software usability. Many researchers have proposed numbers of usability models. Each model considers a set of usability factors but do not cover all the usability aspects. Practical implementation of these models is still missing, as there is a lack of precise definition of usability. Also, it is very difficult to integrate these models into current software engineering practices. In order to overcome these challenges, this paper aims to define the term `usability' using the proposed hierarchical usability model with its detailed taxonomy. The taxonomy considers generic evaluation criteria for identifying the quality components, which brings together factors, attributes and characteristics defined in various HCI and software models. For the first time, the usability model is also implemented to predict more accurate usability values. The proposed system is named as fuzzy hierarchical usability model that can be easily integrated into the current software engineering practices. In order to validate the work, a dataset of six software development life cycle models is created and employed. These models are ranked according to their predicted usability values. This research also focuses on the detailed comparison of proposed model with the existing usability models.

A usability evaluation toolkit for In-Vehicle Information Systems (IVISs).

PubMed

Harvey, Catherine; Stanton, Neville A; Pickering, Carl A; McDonald, Mike; Zheng, Pengjun

2011-05-01

Usability must be defined specifically for the context of use of the particular system under investigation. This specific context of use should also be used to guide the definition of specific usability criteria and the selection of appropriate evaluation methods. There are four principles which can guide the selection of evaluation methods, relating to the information required in the evaluation, the stage at which to apply methods, the resources required and the people involved in the evaluation. This paper presents a framework for the evaluation of usability in the context of In-Vehicle Information Systems (IVISs). This framework guides designers through defining usability criteria for an evaluation, selecting appropriate evaluation methods and applying those methods. These stages form an iterative process of design-evaluation-redesign with the overall aim of improving the usability of IVISs and enhancing the driving experience, without compromising the safety of the driver. Copyright © 2010 Elsevier Ltd and The Ergonomics Society. All rights reserved.

Applying usability methods to identify health literacy issues: an example using a Personal Health Record.

PubMed

Monkman, Helen; Kushniruk, Andre

2013-01-01

The prevalence of consumer health information systems is increasing. However, usability and health literacy impact both the value and adoption of these systems. Health literacy and usability are closely related in that systems may not be used accurately if users cannot understand the information therein. Thus, it is imperative to focus on mitigating the demands on health literacy in consumer health information systems. This study modified two usability evaluation methods (heuristic evaluation and usability testing) to incorporate the identification of potential health literacy issues in a Personal Health Record (PHR). Heuristic evaluation is an analysis of a system performed by a usability specialist who evaluates how well the system abides by usability principles. In contrast, a usability test involves a post hoc analysis of a representative user interacting with the system. These two methods revealed several health literacy issues and suggestions to ameliorate them were made. Thus, it was demonstrated that usability methods could be successfully augmented for the purpose of investigating health literacy issues. To improve users' health knowledge, the adoption of consumer health information systems, and the accuracy of the information contained therein, it is encouraged that usability methods be applied with an added focus on health literacy.

A Framework for Usability Evaluation in EHR Procurement.

PubMed

Tyllinen, Mari; Kaipio, Johanna; Lääveri, Tinja

2018-01-01

Usability should be considered already by the procuring organizations when selecting future systems. In this paper, we present a framework for usability evaluation during electronic health record (EHR) system procurement. We describe the objectives of the evaluation, the procedure, selected usability attributes and the evaluation methods to measure them. We also present the emphasis usability had in the selection process. We do not elaborate on the details of the results, the application of methods or gathering of data. Instead we focus on the components of the framework to inform and give an example to other similar procurement projects.

Usability study of a computer-based self-management system for older adults with chronic diseases.

PubMed

Or, Calvin; Tao, Da

2012-11-08

Usability can influence patients' acceptance and adoption of a health information technology. However, little research has been conducted to study the usability of a self-management health care system, especially one geared toward elderly patients. This usability study evaluated a new computer-based self-management system interface for older adults with chronic diseases, using a paper prototype approach. Fifty older adults with different chronic diseases participated. Two usability evaluation methods were involved: (1) a heuristics evaluation and (2) end-user testing with a think-aloud testing method, audio recording, videotaping, and interviewing. A set of usability metrics was employed to determine the overall system usability, including task incompletion rate, task completion time, frequency of error, frequency of help, satisfaction, perceived usefulness, and perceived ease of use. Interviews were used to elicit participants' comments on the system design. The quantitative data were analyzed using descriptive statistics and the qualitative data were analyzed for content. The participants were able to perform the predesigned self-management tasks with the current system design and they expressed mostly positive responses about the perceived usability measures regarding the system interface. However, the heuristics evaluation, performance measures, and interviews revealed a number of usability problems related to system navigation, information search and interpretation, information presentation, and readability. Design recommendations for further system interface modifications were discussed. This study verified the usability of the self-management system developed for older adults with chronic diseases. Also, we demonstrated that our usability evaluation approach could be used to quickly and effectively identify usability problems in a health care information system at an early stage of the system development process using a paper prototype. Conducting a usability evaluation is an essential step in system development to ensure that the system features match the users' true needs, expectations, and characteristics, and also to minimize the likelihood of the users committing user errors and having difficulties using the system.

Usability Study of a Computer-Based Self-Management System for Older Adults with Chronic Diseases

PubMed Central

Tao, Da

2012-01-01

Background Usability can influence patients’ acceptance and adoption of a health information technology. However, little research has been conducted to study the usability of a self-management health care system, especially one geared toward elderly patients. Objective This usability study evaluated a new computer-based self-management system interface for older adults with chronic diseases, using a paper prototype approach. Methods Fifty older adults with different chronic diseases participated. Two usability evaluation methods were involved: (1) a heuristics evaluation and (2) end-user testing with a think-aloud testing method, audio recording, videotaping, and interviewing. A set of usability metrics was employed to determine the overall system usability, including task incompletion rate, task completion time, frequency of error, frequency of help, satisfaction, perceived usefulness, and perceived ease of use. Interviews were used to elicit participants’ comments on the system design. The quantitative data were analyzed using descriptive statistics and the qualitative data were analyzed for content. Results The participants were able to perform the predesigned self-management tasks with the current system design and they expressed mostly positive responses about the perceived usability measures regarding the system interface. However, the heuristics evaluation, performance measures, and interviews revealed a number of usability problems related to system navigation, information search and interpretation, information presentation, and readability. Design recommendations for further system interface modifications were discussed. Conclusions This study verified the usability of the self-management system developed for older adults with chronic diseases. Also, we demonstrated that our usability evaluation approach could be used to quickly and effectively identify usability problems in a health care information system at an early stage of the system development process using a paper prototype. Conducting a usability evaluation is an essential step in system development to ensure that the system features match the users’ true needs, expectations, and characteristics, and also to minimize the likelihood of the users committing user errors and having difficulties using the system. PMID:23612015

Usability Evaluation of Multimedia Courseware (MEL-SindD)

NASA Astrophysics Data System (ADS)

Yussof, Rahmah Lob; Badioze Zaman, Halimah

Constructive evaluations on any software are needed to ensure the effectiveness and usability of the software. This assesment on the multimedia courseware is part of the researcher's study towards the development and usability of the early reading software for students with Down Syndrome (MEL-SindD). This paper will discuss the usability assesment of this courseware, the methods used for the evaluation as well as suitable approaches that can be deployed to evaluate the courseware effectiveness to disabled children.

End-Users' Voice in EHR Selection: Development of a Usability Questionnaire for Demonstrations in Procurement (DPUQ).

PubMed

Tyllinen, Mari; Kaipio, Johanna; Lääveri, Tinja; Nieminen, Marko

2017-01-01

This paper describes the development of a questionnaire for evaluating usability during EHR system procurement (DPUQ). Established usability questionnaires can be used to gather user feedback after using the systems. However, during procurement, experimenting with real system use is practical only with a limited number of system candidates. There is a need for less resource-demanding usability evaluation in the early stages of procurement in cases with several vendors. DPUQ has been designed for usability evaluation by end-users during special scenario-based vendor demonstrations. The questionnaire includes three sets of questions to be used during and after the vendor demonstration. DPUQ delivers specific usability scores and can be used to compare system candidates in procurement complementing other evaluation methods.

Beyond Effectiveness: A Pragmatic Evaluation Framework for Learning and Continuous Quality Improvement of e-Learning Interventions in Healthcare.

PubMed

Dafalla, Tarig Dafalla Mohamed; Kushniruk, Andre W; Borycki, Elizabeth M

2015-01-01

A pragmatic evaluation framework for evaluating the usability and usefulness of an e-learning intervention for a patient clinical information scheduling system is presented in this paper. The framework was conceptualized based on two different but related concepts (usability and usefulness) and selection of appropriate and valid methods of data collection and analysis that included: (1) Low-Cost Rapid Usability Engineering (LCRUE), (2) Cognitive Task Analysis (CTA), (3) Heuristic Evaluation (HE) criteria for web-based learning, and (4) Software Usability Measurement Inventory (SUMI). The results of the analysis showed some areas where usability that were related to General Interface Usability (GIU), instructional design and content was problematic; some of which might account for the poorly rated aspects of usability when subjectively measured. This paper shows that using a pragmatic framework can be a useful way, not only for measuring the usability and usefulness, but also for providing a practical objective evidences for learning and continuous quality improvement of e-learning systems. The findings should be of interest to educators, developers, designers, researchers, and usability practitioners involved in the development of e-learning systems in healthcare. This framework could be an appropriate method for assessing the usability, usefulness and safety of health information systems both in the laboratory and in the clinical context.

Distributed Collaborative Homework Activities in a Problem-Based Usability Engineering Course

ERIC Educational Resources Information Center

Carroll, John M.; Jiang, Hao; Borge, Marcela

2015-01-01

Teams of students in an upper-division undergraduate Usability Engineering course used a collaborative environment to carry out a series of three distributed collaborative homework assignments. Assignments were case-based analyses structured using a jigsaw design; students were provided a collaborative software environment and introduced to a…

User Interface Problems of a Nationwide Inpatient Information System: A Heuristic Evaluation.

PubMed

Atashi, Alireza; Khajouei, Reza; Azizi, Amirabbas; Dadashi, Ali

2016-01-01

While studies have shown that usability evaluation could uncover many design problems of health information systems, the usability of health information systems in developing countries using their native language is poorly studied. The objective of this study was to evaluate the usability of a nationwide inpatient information system used in many academic hospitals in Iran. Three trained usability evaluators independently evaluated the system using Nielsen's 10 usability heuristics. The evaluators combined identified problems in a single list and independently rated the severity of the problems. We statistically compared the number and severity of problems identified by HIS experienced and non-experienced evaluators. A total of 158 usability problems were identified. After removing duplications 99 unique problems were left. The highest mismatch with usability principles was related to "Consistency and standards" heuristic (25%) and the lowest related to "Flexibility and efficiency of use" (4%). The average severity of problems ranged from 2.4 (Major problem) to 3.3 (Catastrophe problem). The experienced evaluator with HIS identified significantly more problems and gave higher severities to problems (p<0.02). Heuristic Evaluation identified a high number of usability problems in a widely used inpatient information system in many academic hospitals. These problems, if remain unsolved, may waste users' and patients' time, increase errors and finally threaten patient's safety. Many of them can be fixed with simple redesign solutions such as using clear labels and better layouts. This study suggests conducting further studies to confirm the findings concerning effect of evaluator experience on the results of Heuristic Evaluation.

User Interface Problems of a Nationwide Inpatient Information System: A Heuristic Evaluation

PubMed Central

Atashi, Alireza; Azizi, Amirabbas; Dadashi, Ali

2016-01-01

Summary Introduction While studies have shown that usability evaluation could uncover many design problems of health information systems, the usability of health information systems in developing countries using their native language is poorly studied. The objective of this study was to evaluate the usability of a nationwide inpatient information system used in many academic hospitals in Iran. Material and Methods Three trained usability evaluators independently evaluated the system using Nielsen’s 10 usability heuristics. The evaluators combined identified problems in a single list and independently rated the severity of the problems. We statistically compared the number and severity of problems identified by HIS experienced and non-experienced evaluators. Results A total of 158 usability problems were identified. After removing duplications 99 unique problems were left. The highest mismatch with usability principles was related to “Consistency and standards” heuristic (25%) and the lowest related to “Flexibility and efficiency of use” (4%). The average severity of problems ranged from 2.4 (Major problem) to 3.3 (Catastrophe problem). The experienced evaluator with HIS identified significantly more problems and gave higher severities to problems (p<0.02). Discussion Heuristic Evaluation identified a high number of usability problems in a widely used inpatient information system in many academic hospitals. These problems, if remain unsolved, may waste users’ and patients’ time, increase errors and finally threaten patient’s safety. Many of them can be fixed with simple redesign solutions such as using clear labels and better layouts. This study suggests conducting further studies to confirm the findings concerning effect of evaluator experience on the results of Heuristic Evaluation. PMID:27081409

Training Software Developers and Designers to Conduct Usability Evaluations

ERIC Educational Resources Information Center

Skov, Mikael Brasholt; Stage, Jan

2012-01-01

Many efforts to improve the interplay between usability evaluation and software development rely either on better methods for conducting usability evaluations or on better formats for presenting evaluation results in ways that are useful for software designers and developers. Both of these approaches depend on a complete division of work between…

From Usability Engineering to Evidence-based Usability in Health IT.

PubMed

Marcilly, Romaric; Peute, Linda; Beuscart-Zephir, Marie-Catherine

2016-01-01

Usability is a critical factor in the acceptance, safe use, and success of health IT. The User-Centred Design process is widely promoted to improve usability. However, this traditional case by case approach that is rooted in the sound understanding of users' needs is not sufficient to improve technologies' usability and prevent usability-induced use-errors that may harm patients. It should be enriched with empirical evidence. This evidence is on design elements (what are the most valuable design principles, and the worst usability mistakes), and on the usability evaluation methods (which combination of methods is most suitable in which context). To achieve this evidence, several steps must be fulfilled and challenges must be overcome. Some attempts to search evidence for designing elements of health IT and for usability evaluation methods exist and are summarized. A concrete instance of evidence-based usability design principles for medication-related alerting systems is briefly described.

The use of think-aloud and instant data analysis in evaluation research: Exemplar and lessons learned.

PubMed

Joe, Jonathan; Chaudhuri, Shomir; Le, Thai; Thompson, Hilaire; Demiris, George

2015-08-01

While health information technologies have become increasingly popular, many have not been formally tested to ascertain their usability. Traditional rigorous methods take significant amounts of time and manpower to evaluate the usability of a system. In this paper, we evaluate the use of instant data analysis (IDA) as developed by Kjeldskov et al. to perform usability testing on a tool designed for older adults and caregivers. The IDA method is attractive because it takes significantly less time and manpower than the traditional usability testing methods. In this paper we demonstrate how IDA was used to evaluate usability of a multifunctional wellness tool, discuss study results and lessons learned while using this method. We also present findings from an extension of the method which allows the grouping of similar usability problems in an efficient manner. We found that the IDA method is a quick, relatively easy approach to identifying and ranking usability issues among health information technologies. Copyright © 2015 Elsevier Inc. All rights reserved.

Usability evaluation of Laboratory and Radiology Information Systems integrated into a hospital information system.

PubMed

Nabovati, Ehsan; Vakili-Arki, Hasan; Eslami, Saeid; Khajouei, Reza

2014-04-01

This study was conducted to evaluate the usability of widely used laboratory and radiology information systems. Three usability experts independently evaluated the user interfaces of Laboratory and Radiology Information Systems using heuristic evaluation method. They applied Nielsen's heuristics to identify and classify usability problems and Nielsen's severity rating to judge their severity. Overall, 116 unique heuristic violations were identified as usability problems. In terms of severity, 67 % of problems were rated as major and catastrophic. Among 10 heuristics, "consistency and standards" was violated most frequently. Moreover, mean severity of problems concerning "error prevention" and "help and documentation" heuristics was higher than of the others. Despite widespread use of specific healthcare information systems, they suffer from usability problems. Improving the usability of systems by following existing design standards and principles from the early phased of system development life cycle is recommended. Especially, it is recommended that the designers design systems that inhibit the initiation of erroneous actions and provide sufficient guidance to users.

Reusable Software Usability Specifications for mHealth Applications.

PubMed

Cruz Zapata, Belén; Fernández-Alemán, José Luis; Toval, Ambrosio; Idri, Ali

2018-01-25

One of the key factors for the adoption of mobile technologies, and in particular of mobile health applications, is usability. A usable application will be easier to use and understand by users, and will improve user's interaction with it. This paper proposes a software requirements catalog for usable mobile health applications, which can be used for the development of new applications, or the evaluation of existing ones. The catalog is based on the main identified sources in literature on usability and mobile health applications. Our catalog was organized according to the ISO/IEC/IEEE 29148:2011 standard and follows the SIREN methodology to create reusable catalogs. The applicability of the catalog was verified by the creation of an audit method, which was used to perform the evaluation of a real app, S Health, application created by Samsung Electronics Co. The usability requirements catalog, along with the audit method, identified several usability flaws on the evaluated app, which scored 83%. Some flaws were detected in the app related to the navigation pattern. Some more issues related to the startup experience, empty screens or writing style were also found. The way a user navigates through an application improves or deteriorates user's experience with the application. We proposed a reusable usability catalog and an audit method. This proposal was used to evaluate a mobile health application. An audit report was created with the usability issues identified on the evaluated application.

Measuring the Usability of Augmented Reality e-Learning Systems: A User-Centered Evaluation Approach

NASA Astrophysics Data System (ADS)

Pribeanu, Costin; Balog, Alexandru; Iordache, Dragoş Daniel

The development of Augmented Reality (AR) systems is creating new challenges and opportunities for the designers of e-learning systems. The mix of real and virtual requires appropriate interaction techniques that have to be evaluated with users in order to avoid usability problems. Formative usability aims at finding usability problems as early as possible in the development life cycle and is suitable to support the development of such novel interactive systems. This work presents an approach to the user-centered usability evaluation of an e-learning scenario for Biology developed on an Augmented Reality educational platform. The evaluation has been carried on during and after a summer school held within the ARiSE research project. The basic idea was to perform usability evaluation twice. In this respect, we conducted user testing with a small number of students during the summer school in order to get a fast feedback from users having good knowledge in Biology. Then, we repeated the user testing in different conditions and with a relatively larger number of representative users. In this paper we describe both experiments and compare the usability evaluation results.

Evaluating Web Usability

ERIC Educational Resources Information Center

Snider, Jean; Martin, Florence

2012-01-01

Web usability focuses on design elements and processes that make web pages easy to use. A website for college students was evaluated for underutilization. One-on-one testing, focus groups, web analytics, peer university review and marketing focus group and demographic data were utilized to conduct usability evaluation. The results indicated that…

Evaluation of expert system application based on usability aspects

NASA Astrophysics Data System (ADS)

Munaiseche, C. P. C.; Liando, O. E. S.

2016-04-01

Usability usually defined as a point of human acceptance to a product or a system based on understands and right reaction to an interface. The performance of web application has been influence by the quality of the interface of that web to supporting information transfer process. Preferably, before the applications of expert systems were installed in the operational environment, these applications must be evaluated first by usability testing. This research aimed to measure the usability of the expert system application using tasks as interaction media. This study uses an expert system application to diagnose skin disease in human using questionnaire method which utilize the tasks as interaction media in measuring the usability. Certain tasks were executed by the participants in observing usability value of the application. The usability aspects observed were learnability, efficiency, memorability, errors, and satisfaction. Each questionnaire question represent aspects of usability. The results present the usability value for each aspect and the total average merit for all the five-usability aspect was 4.28, this indicated that the tested expert system application is in the range excellent for the usability level, so the application can be implemented as the operated system by user. The main contribution of the study is the research became the first step in using task model in the usability evaluation for the expert system application software.

An Online Social Constructivist Course: Toward a Framework for Usability Evaluations

ERIC Educational Resources Information Center

Phillips, Alana S.; Sheffield, Anneliese; Moore, Michelle; Robinson, Heather A.

2016-01-01

There is a need for a holistic usability evaluation framework that accommodates social constructivist online courses. Social knowledge construction may not be adequately evaluated using current frameworks. This qualitative research study examined the usability needs of a social constructivist online course. Data from an online course were analyzed…

Determining the Number of Participants Needed for the Usability Evaluation of E-Learning Resources: A Monte Carlo Simulation

ERIC Educational Resources Information Center

Davids, Mogamat Razeen; Harvey, Justin; Halperin, Mitchell L.; Chikte, Usuf M. E.

2015-01-01

The usability of computer interfaces has a major influence on learning. Optimising the usability of e-learning resources is therefore essential. However, this may be neglected because of time and monetary constraints. User testing is a common approach to usability evaluation and involves studying typical end-users interacting with the application…

Pattern mining of user interaction logs for a post-deployment usability evaluation of a radiology PACS client.

PubMed

Jorritsma, Wiard; Cnossen, Fokie; Dierckx, Rudi A; Oudkerk, Matthijs; van Ooijen, Peter M A

2016-01-01

To perform a post-deployment usability evaluation of a radiology Picture Archiving and Communication System (PACS) client based on pattern mining of user interaction log data, and to assess the usefulness of this approach compared to a field study. All user actions performed on the PACS client were logged for four months. A data mining technique called closed sequential pattern mining was used to automatically extract frequently occurring interaction patterns from the log data. These patterns were used to identify usability issues with the PACS. The results of this evaluation were compared to the results of a field study based usability evaluation of the same PACS client. The interaction patterns revealed four usability issues: (1) the display protocols do not function properly, (2) the line measurement tool stays active until another tool is selected, rather than being deactivated after one use, (3) the PACS's built-in 3D functionality does not allow users to effectively perform certain 3D-related tasks, (4) users underuse the PACS's customization possibilities. All usability issues identified based on the log data were also found in the field study, which identified 48 issues in total. Post-deployment usability evaluation based on pattern mining of user interaction log data provides useful insights into the way users interact with the radiology PACS client. However, it reveals few usability issues compared to a field study and should therefore not be used as the sole method of usability evaluation. Copyright © 2015 Elsevier Ireland Ltd. All rights reserved.

Usability in Mobile Electronic Data Collection Tools: Form Developers' Views.

PubMed

Mugisha, Alice; Babic, Ankica; Wakholi, Peter; Nankabirwa, Victoria; Tylleskar, Thorkild

2017-01-01

Mobile Electronic Data Collection Tools (MEDCTs) are created by form developers to collect data. Usability being one of the top quality attributes is of great concern to developers of any interactive applications. However, little is known about the form developers' understanding of usability, how they measure usability and their limitations in designing for usability. We conducted an empirical study where we aimed at getting the developers' views on usability by interviewing 8 form developers. These are creators of forms used for data collection. We found that developers knew about usability, but it was not their main focus during form development. Challenges included constraining deadlines, software limitations and the insufficient communication with the field users to establish the usability needs. Furthermore, the methods used to evaluate the usability of created forms varied amongst developers and these included in-house evaluations and feedback from piloting sessions with end users.

Usability Evaluation of Electronic Health Record System around Clinical Notes Usage-An Ethnographic Study.

PubMed

Rizvi, Rubina F; Marquard, Jenna L; Hultman, Gretchen M; Adam, Terrence J; Harder, Kathleen A; Melton, Genevieve B

2017-10-01

Background A substantial gap exists between current Electronic Health Record (EHR) usability and potential optimal usability. One of the fundamental reasons for this discrepancy is poor incorporation of a User-Centered Design (UCD) approach during the Graphical User Interface (GUI) development process. Objective To evaluate usability strengths and weaknesses of two widely implemented EHR GUIs for critical clinical notes usage tasks. Methods Twelve Internal Medicine resident physicians interacting with one of the two EHR systems (System-1 at Location-A and System-2 at Location-B) were observed by two usability evaluators employing an ethnographic approach. User comments and observer findings were analyzed for two critical tasks: (1) clinical notes entry and (2) related information-seeking tasks. Data were analyzed from two standpoints: (1) usability references categorized by usability evaluators as positive, negative, or equivocal and (2) usability impact of each feature measured through a 7-point severity rating scale. Findings were also validated by user responses to a post observation questionnaire. Results For clinical notes entry, System-1 surpassed System-2 with more positive (26% vs. 12%) than negative (12% vs. 34%) usability references. Greatest impact features on EHR usability (severity score pertaining to each feature) for clinical notes entry were: autopopulation (6), screen options (5.5), communication (5), copy pasting (4.5), error prevention (4.5), edit ability (4), and dictation and transcription (3.5). Both systems performed equally well on information-seeking tasks and features with greatest impacts on EHR usability were navigation for notes (7) and others (e.g., looking for ancillary data; 5.5). Ethnographic observations were supported by follow-up questionnaire responses. Conclusion This study provides usability-specific insights to inform future, improved, EHR interface that is better aligned with UCD approach.

Evaluating Usability of Radiology Information Systems in Hospitals of Tabriz University of Medical Sciences.

PubMed

Rezaei-Hachesu, Peyman; Pesianian, Esmaeil; Mohammadian, Mohsen

2016-02-01

Radiology information system (RIS) in order to reduce workload and improve the quality of services must be well-designed. Heuristic evaluation is one of the methods that understand usability problems with the least time, cost and resources. The aim of present study is to evaluate the usability of RISs in hospitals. This is a cross-sectional descriptive study (2015) that uses heuristic evaluation method to evaluate the usability of RIS used in 3 hospitals of Tabriz city. The data are collected using a standard checklist based on 13 principles of Nielsen Heuristic evaluation method. Usability of RISs was investigated based on the number of components observed from Nielsen principles and problems of usability based on the number of non-observed components as well as non-existent or unrecognizable components. by evaluation of RISs in each of the hospitals 1, 2 and 3, total numbers of observed components were obtained as 173, 202 and 196, respectively. It was concluded that the usability of RISs in the studied population, on average and with observing 190 components of the 291 components related to the 13 principles of Nielsen is 65.41 %. Furthermore, problems of usability were obtained as 26.35%. The established and visible nature of some components such as response time of application, visual feedbacks, colors, view and design and arrangement of software objects cause more attention to these components as principal components in designing UI software. Also, incorrect analysis before system design leads to a lack of attention to secondary needs like Help software and security issues.

Evaluating the Usability of a Museum Web Site.

ERIC Educational Resources Information Center

Harms, Ilse; Schweibenz, Werner

This paper presents a research project conducted by the Department of Information Science in cooperation with the Saarland Museum, the art museum of the Federal State of Saarland, Germany. The study had two aims. The first was to evaluate some methods of usability engineering for the Web, and the second was to evaluate the usability of the…

Comparison of heuristic and cognitive walkthrough usability evaluation methods for evaluating health information systems.

PubMed

Khajouei, Reza; Zahiri Esfahani, Misagh; Jahani, Yunes

2017-04-01

There are several user-based and expert-based usability evaluation methods that may perform differently according to the context in which they are used. The objective of this study was to compare 2 expert-based methods, heuristic evaluation (HE) and cognitive walkthrough (CW), for evaluating usability of health care information systems. Five evaluators independently evaluated a medical office management system using HE and CW. We compared the 2 methods in terms of the number of identified usability problems, their severity, and the coverage of each method. In total, 156 problems were identified using the 2 methods. HE identified a significantly higher number of problems related to the "satisfaction" attribute ( P  = .002). The number of problems identified using CW concerning the "learnability" attribute was significantly higher than those identified using HE ( P  = .005). There was no significant difference between the number of problems identified by HE, based on different usability attributes ( P  = .232). Results of CW showed a significant difference between the number of problems related to usability attributes ( P  < .0001). The average severity of problems identified using CW was significantly higher than that of HE ( P  < .0001). This study showed that HE and CW do not differ significantly in terms of the number of usability problems identified, but they differ based on the severity of problems and the coverage of some usability attributes. The results suggest that CW would be the preferred method for evaluating systems intended for novice users and HE for users who have experience with similar systems. However, more studies are needed to support this finding. © The Author 2016. Published by Oxford University Press on behalf of the American Medical Informatics Association. All rights reserved. For Permissions, please email: journals.permissions@oup.com

A usability evaluation of a SNOMED CT based compositional interface terminology for intensive care.

PubMed

Bakhshi-Raiez, F; de Keizer, N F; Cornet, R; Dorrepaal, M; Dongelmans, D; Jaspers, M W M

2012-05-01

To evaluate the usability of a large compositional interface terminology based on SNOMED CT and the terminology application for registration of the reasons for intensive care admission in a Patient Data Management System. Observational study with user-based usability evaluations before and 3 months after the system was implemented and routinely used. Usability was defined by five aspects: effectiveness, efficiency, learnability, overall user satisfaction, and experienced usability problems. Qualitative (the Think-Aloud user testing method) and quantitative (the System Usability Scale questionnaire and Time-on-Task analyses) methods were used to examine these usability aspects. The results of the evaluation study revealed that the usability of the interface terminology fell short (SUS scores before and after implementation of 47.2 out of 100 and 37.5 respectively out of 100). The qualitative measurements revealed a high number (n=35) of distinct usability problems, leading to ineffective and inefficient registration of reasons for admission. The effectiveness and efficiency of the system did not change over time. About 14% (n=5) of the revealed usability problems were related to the terminology content based on SNOMED CT, while the remaining 86% (n=30) was related to the terminology application. The problems related to the terminology content were more severe than the problems related to the terminology application. This study provides a detailed insight into how clinicians interact with a controlled compositional terminology through a terminology application. The extensiveness, complexity of the hierarchy, and the language usage of an interface terminology are defining for its usability. Carefully crafted domain-specific subsets and a well-designed terminology application are needed to facilitate the use of a complex compositional interface terminology based on SNOMED CT. Copyright © 2011 Elsevier Ireland Ltd. All rights reserved.

Evidence-based Heuristics for Evaluating Demands on eHealth Literacy and Usability in a Mobile Consumer Health Application.

PubMed

Monkman, Helen; Griffith, Janessa; Kushniruk, Andre W

2015-01-01

Heuristic evaluations have proven to be valuable for identifying usability issues in systems. Commonly used sets of heuritics exist; however, they may not always be the most suitable, given the specific goal of the analysis. One such example is seeking to evaluate the demands on eHealth literacy and usability of consumer health information systems. In this study, eight essential heuristics and three optional heuristics subsumed from the evidence on eHealth/health literacy and usability were tested for their utility in assessing a mobile blood pressure tracking application (app). This evaluation revealed a variety of ways the design of the app could both benefit and impede users with limited eHealth literacy. This study demonstrated the utility of a low-cost, single evaluation approach for identifying both eHealth literacy and usability issues based on existing evidence in the literature.

Using Eye Trackers for Usability Evaluation of Health Information Technology: A Systematic Literature Review

PubMed Central

Yang, Yushi

2015-01-01

Background Eye-tracking technology has been used to measure human cognitive processes and has the potential to improve the usability of health information technology (HIT). However, it is still unclear how the eye-tracking method can be integrated with other traditional usability methodologies to achieve its full potential. Objective The objective of this study was to report on HIT evaluation studies that have used eye-tracker technology, and to envision the potential use of eye-tracking technology in future research. Methods We used four reference databases to initially identify 5248 related papers, which resulted in only 9 articles that met our inclusion criteria. Results Eye-tracking technology was useful in finding usability problems in many ways, but is still in its infancy for HIT usability evaluation. Limited types of HITs have been evaluated by eye trackers, and there has been a lack of evaluation research in natural settings. Conclusions More research should be done in natural settings to discover the real contextual-based usability problems of clinical and mobile HITs using eye-tracking technology with more standardized methodologies and guidance. PMID:27026079

Does the use of structured reporting improve usability? A comparative evaluation of the usability of two approaches for findings reporting in a large-scale telecardiology context.

PubMed

Lacerda, Thaisa Cardoso; von Wangenheim, Christiane Gresse; von Wangenheim, Aldo; Giuliano, Isabela

2014-12-01

One of the main reasons that leads to a low adoption rate of telemedicine systems is poor usability. An aspect that influences usability during the reporting of findings is the input mode, e.g., if a free-text (FT) or a structured report (SR) interface is employed. The objective of our study is to compare the usability of FT and ST telemedicine systems, specifically in terms of user satisfaction, efficiency and general usability. We comparatively evaluate the usability of these two input modes in a telecardiology system for issuing electrocardiography reports in the context of a statewide telemedicine system in Brazil with more than 350.000 performed tele-electrocardiography examinations. We adopted a multiple method research strategy, applying three different kinds of usability evaluations: user satisfaction was evaluated through interviews with seven medical professionals using the System Usability Scale (SUS) questionnaire and specific questions related to adequacy and user experience. Efficiency was evaluated by estimating execution time using the Keystroke-Level Model (KLM). General usability was assessed based on the conformity of the systems to a set of e-health specific usability heuristics. The results of this comparison provide a first indication that a structured report (SR) input mode for such a system is more satisfactory and efficient with a larger conformity to usability heuristics than free-text (FT) input. User satisfaction using the SUS questionnaire has been scored in average with 58.8 and 77.5 points for the FT and SR system, respectively, which means that the SR system was rated 18.65 points higher than the FT system. In terms of efficiency, the completion of a findings report using the SR mode is estimated to take 8.5s, 3.74 times faster than using the FT system (31.8s). The SR system also demonstrated less violations to usability heuristics (8 points) in comparison to 14 points observed in the FT system. These results provide a first indication that the usage of structured reporting as an input mode in telecardiology systems may enhance usability. This also seems to confirm the advantages of the usage of structured reporting, as already described in the literature for other areas such as teleradiology. Copyright © 2014 Elsevier Inc. All rights reserved.

Accessibility and usability OCW data: The UTPL OCW.

PubMed

Rodríguez, Germania; Perez, Jennifer; Cueva, Samanta; Torres, Rommel

2017-08-01

This data article provides a data description on article entitled "A framework for improving web accessibility and usability of Open Course Ware sites" [3] This Data in Brief presents the data obtained from the accessibility and usability evaluation of the UTPL OCW. The data obtained from the framework evaluation consists of the manual evaluation of the standards criteria and the automatic evaluation of the tools Google PageSpeed and Google Analytics. In addition, this article presents the synthetized tables from standards that are used by the framework to evaluate the accessibility and usability of OCW, and the questionnaires required to extract the data. As a result, the article also provides the data required to reproduce the evaluation of other OCW.

Example of a Human Factors Engineering approach to a medication administration work system: potential impact on patient safety.

PubMed

Beuscart-Zéphir, Marie-Catherine; Pelayo, Sylvia; Bernonville, Stéphanie

2010-04-01

The objectives of this paper are: In this approach, the implementation of such a complex IT solution is considered a major redesign of the work system. The paper describes the Human Factor (HF) tasks embedded in the project lifecycle: (1) analysis and modelling of the current work system and usability assessment of the medication CPOE solution; (2) HF recommendations for work re-design and usability recommendations for IT system re-engineering both aiming at a safer and more efficient work situation. Standard ethnographic methods were used to support the analysis of the current work system and work situations, coupled with cognitive task analysis methods and documents review. Usability inspection (heuristic evaluation) and both in-lab (simulated tasks) and on-site (real tasks) usability tests were performed for the evaluation of the CPOE candidate. Adapted software engineering models were used in combination with usual textual descriptions, tasks models and mock-ups to support the recommendations for work and product re-design. The analysis of the work situations identified different work organisations and procedures across the hospital's departments. The most important differences concerned the doctor-nurse communications and cooperation modes and the procedures for preparing and administering the medications. The assessment of the medication CPOE functions uncovered a number of usability problems including severe ones leading to impossible to detect or to catch errors. Models of the actual and possible distribution of tasks and roles were used to support decision making in the work design process. The results of the usability assessment were translated into requirements to support the necessary re-engineering of the IT application. The HFE approach to medication CPOE efficiently identifies and distinguishes currently unsafe or uncomfortable work situations that could obviously benefit from an IT solution from other work situations incorporating efficient work procedures that might be impaired by the implementation of the CPOE. In this context, a careful redesign of the work situation and of the entire work system is necessary to actually benefit from the installation of the product in terms of patient safety and human performances. In parallel, a usability assessment of the product to be implemented is mandatory to identify potentially dangerous usability flaws and to fix them before the installation. (c) 2009 Elsevier Ireland Ltd. All rights reserved.

Applying heuristic evaluation to improve the usability of a telemedicine system.

PubMed

Tang, Zhihua; Johnson, Todd R; Tindall, R Douglas; Zhang, Jiajie

2006-02-01

The development of a telemedicine system should not only take advantage of technological advances but also pay close attention to users and the human issues involved. In this paper we examine the utility of heuristic evaluation in improving the usability of a digital emergency medical services (EMS) system equipped on an ambulance. The digital EMS system used advanced communication technologies to help remotely located trauma specialists gain access to patient data in real-time and direct life-saving measures in a timely fashion. To improve its usability, three experts inspected prototypes of the system according to 14 software usability heuristics. The analyses revealed information on the prevalence, severity, and nature of heuristic violations in the user interface design. The results were subsequently utilized to guide the iterative software design process. A comparison between two consecutive prototypes showed that the second design had only half as many usability violations as the first prototype and had considerable improvement in a number of usability heuristic categories. The validity of heuristic evaluation was examined in an ethnographic study of paramedics using a prototype of the system in their work environment. Users' task performances partially verified heuristic evaluation results. However, they also revealed problems that were not identified in heuristic evaluation but only became prominent during field observation. In conclusion, we argue that usability should be given high priority in the development of a telemedicine system, and that heuristic evaluation can be an effective and efficient way to identify usability problems in the early stage of software development.

Usability Evaluation of a Clinical Decision Support System for Geriatric ED Pain Treatment.

PubMed

Genes, Nicholas; Kim, Min Soon; Thum, Frederick L; Rivera, Laura; Beato, Rosemary; Song, Carolyn; Soriano, Jared; Kannry, Joseph; Baumlin, Kevin; Hwang, Ula

2016-01-01

Older adults are at risk for inadequate emergency department (ED) pain care. Unrelieved acute pain is associated with poor outcomes. Clinical decision support systems (CDSS) hold promise to improve patient care, but CDSS quality varies widely, particularly when usability evaluation is not employed. To conduct an iterative usability and redesign process of a novel geriatric abdominal pain care CDSS. We hypothesized this process would result in the creation of more usable and favorable pain care interventions. Thirteen emergency physicians familiar with the Electronic Health Record (EHR) in use at the study site were recruited. Over a 10-week period, 17 1-hour usability test sessions were conducted across 3 rounds of testing. Participants were given 3 patient scenarios and provided simulated clinical care using the EHR, while interacting with the CDSS interventions. Quantitative System Usability Scores (SUS), favorability scores and qualitative narrative feedback were collected for each session. Using a multi-step review process by an interdisciplinary team, positive and negative usability issues in effectiveness, efficiency, and satisfaction were considered, prioritized and incorporated in the iterative redesign process of the CDSS. Video analysis was used to determine the appropriateness of the CDS appearances during simulated clinical care. Over the 3 rounds of usability evaluations and subsequent redesign processes, mean SUS progressively improved from 74.8 to 81.2 to 88.9; mean favorability scores improved from 3.23 to 4.29 (1 worst, 5 best). Video analysis revealed that, in the course of the iterative redesign processes, rates of physicians' acknowledgment of CDS interventions increased, however most rates of desired actions by physicians (such as more frequent pain score updates) decreased. The iterative usability redesign process was instrumental in improving the usability of the CDSS; if implemented in practice, it could improve geriatric pain care. The usability evaluation process led to improved acknowledgement and favorability. Incorporating usability testing when designing CDSS interventions for studies may be effective to enhance clinician use.

Evaluating Usability in a Distance Digital Systems Laboratory Class

ERIC Educational Resources Information Center

Kostaras, N.; Xenos, M.; Skodras, A. N.

2011-01-01

This paper presents the usability evaluation of a digital systems laboratory class offered to distance-learning students. It details the way in which students can participate remotely in such a laboratory, the methodology employed in the usability assessment of the laboratory infrastructure (hardware and software), and also outlines the main…

A Usability Evaluation of Academic Virtual Reference Services

ERIC Educational Resources Information Center

Chow, Anthony S.; Croxton, Rebecca A.

2014-01-01

This study examined the usability of five virtual reference services--instant messenger chat, e-mail, telephone, text messaging, and Skype videoconferencing--by having 31 undergraduate and graduate students evaluate the usability of the virtual reference services of two different universities. The study's results suggest that user preference and…

Usability Assessment of E-Café Operational Management Simulation Game

ERIC Educational Resources Information Center

Chang, Chiung-sui; Huang, Ya-Ping

2013-01-01

To ensure the quality of digital simulation game, we utilized the usability evaluation heuristic in the design and development processes of e-café operational management game-based learning material for students. The application of usability evaluations during this study is described. Additionally, participant selection, data collection and…

Usability Study and Heuristic Evaluation of the Applied Robotics for Installations and Base Operations (ARIBO) Driverless Vehicle Reservation Application ARIBO Mobile

DTIC Science & Technology

2017-03-01

ARL-TN-0814 ● MAR 2017 US Army Research Laboratory Usability Study and Heuristic Evaluation of the Applied Robotics for...ARL-TN-0814 ● MAR 2017 US Army Research Laboratory Usability Study and Heuristic Evaluation of the Applied Robotics for...Heuristic Evaluation of the Applied Robotics for Installations and Base Operations (ARIBO) Driverless Vehicle Reservation Application ARIBO Mobile 5a

Evaluation of Usability Utilizing Markov Models

ERIC Educational Resources Information Center

Penedo, Janaina Rodrigues; Diniz, Morganna; Ferreira, Simone Bacellar Leal; Silveira, Denis S.; Capra, Eliane

2012-01-01

Purpose: The purpose of this paper is to analyze the usability of a remote learning system in its initial development phase, using a quantitative usability evaluation method through Markov models. Design/methodology/approach: The paper opted for an exploratory study. The data of interest of the research correspond to the possible accesses of users…

Review of health information technology usability study methodologies

PubMed Central

Bakken, Suzanne

2011-01-01

Usability factors are a major obstacle to health information technology (IT) adoption. The purpose of this paper is to review and categorize health IT usability study methods and to provide practical guidance on health IT usability evaluation. 2025 references were initially retrieved from the Medline database from 2003 to 2009 that evaluated health IT used by clinicians. Titles and abstracts were first reviewed for inclusion. Full-text articles were then examined to identify final eligibility studies. 629 studies were categorized into the five stages of an integrated usability specification and evaluation framework that was based on a usability model and the system development life cycle (SDLC)-associated stages of evaluation. Theoretical and methodological aspects of 319 studies were extracted in greater detail and studies that focused on system validation (SDLC stage 2) were not assessed further. The number of studies by stage was: stage 1, task-based or user–task interaction, n=42; stage 2, system–task interaction, n=310; stage 3, user–task–system interaction, n=69; stage 4, user–task–system–environment interaction, n=54; and stage 5, user–task–system–environment interaction in routine use, n=199. The studies applied a variety of quantitative and qualitative approaches. Methodological issues included lack of theoretical framework/model, lack of details regarding qualitative study approaches, single evaluation focus, environmental factors not evaluated in the early stages, and guideline adherence as the primary outcome for decision support system evaluations. Based on the findings, a three-level stratified view of health IT usability evaluation is proposed and methodological guidance is offered based upon the type of interaction that is of primary interest in the evaluation. PMID:21828224

Design and validation of a questionnaire to evaluate the usability of computerized critical care information systems.

PubMed

von Dincklage, Falk; Lichtner, Gregor; Suchodolski, Klaudiusz; Ragaller, Maximilian; Friesdorf, Wolfgang; Podtschaske, Beatrice

2017-08-01

The implementation of computerized critical care information systems (CCIS) can improve the quality of clinical care and staff satisfaction, but also holds risks of disrupting the workflow with consecutive negative impacts. The usability of CCIS is one of the key factors determining their benefits and weaknesses. However, no tailored instrument exists to measure the usability of such systems. Therefore, the aim of this study was to design and validate a questionnaire that measures the usability of CCIS. Following a mixed-method design approach, we developed a questionnaire comprising two evaluation models to assess the usability of CCIS: (1) the task-specific model rates the usability individually for several tasks which CCIS could support and which we derived by analyzing work processes in the ICU; (2) the characteristic-specific model rates the different aspects of the usability, as defined by the international standard "ergonomics of human-system interaction". We tested validity and reliability of the digital version of the questionnaire in a sample population. In the sample population of 535 participants both usability evaluation models showed a strong correlation with the overall rating of the system (multiple correlation coefficients ≥0.80) as well as a very high internal consistency (Cronbach's alpha ≥0.93). The novel questionnaire is a valid and reliable instrument to measure the usability of CCIS and can be used to study the influence of the usability on their implementation benefits and weaknesses.

Usability in the real world: assessing medical information technologies in patients' homes.

PubMed

Kaufman, David R; Patel, Vimla L; Hilliman, Charlyn; Morin, Philip C; Pevzner, Jenia; Weinstock, Ruth S; Goland, Robin; Shea, Steven; Starren, Justin

2003-01-01

This paper presents an approach to usability evaluation of computer-based health care systems designed for patient use in their homes. Although such devices are becoming more prevalent, there is very little known about their usability. The theoretical foundations for the methods are discussed. The approach incorporates a cognitive walkthrough usability evaluation and new methods for usability testing that can be conducted in patient's homes. The method was applied to the IDEATel intervention, a multi-institution randomized controlled trial of the feasibility, acceptability, and clinical utility of a home-based telemedicine system for diabetic Medicare population. The usability study was designed to assess barriers to optimal use of the system. The focus was both on dimensions of the interface and on dimensions of patient skills and competency. The usability field research involved testing 25 patients in their homes using the system. The analysis included a range of video-analytic methods of varying levels of granularity. The usability evaluation revealed aspects of the interface that were sub-optimal and impeded the performance of certain tasks. It also found a range of patient-related factors such as numeracy and psychomotor skills that constituted barriers to productive use. A multifaceted usability approach provided important insight regarding use of technology by an elderly chronic-care patient population and more generally, for understanding how home health initiatives can more effectively use such technology.

Task-specific usability requirements of electronic medical records systems: Lessons learned from a national survey of end-users.

PubMed

Farzandipour, Mehrdad; Meidani, Zahra; Riazi, Hossein; Sadeqi Jabali, Monireh

2018-09-01

There are various approaches to evaluating the usability of electronic medical record (EMR) systems. User perspectives are an integral part of evaluation. Usability evaluations efficiently and effectively contribute to user-centered design and supports tasks and increase user satisfaction. This study determined the main usability requirements for EMRs by means of an end-user survey. A mixed-method strategy was conducted in three phases. A qualitative approach was employed to collect and formulate EMR usability requirements using the focus group method and the modified Delphi technique. Classic Delphi technique was used to evaluate the proposed requirements among 380 end-users in Iran. The final list of EMR usability requirements was verified and included 163 requirements divided into nine groups. The highest rates of end-user agreement relate to EMR visual clarity (3.65 ± 0.61), fault tolerance (3.58 ± 0.56), and suitability for learning (3.55 ± 0.54). The lowest end-user agreement was for auditory presentation (3.18 ± 0.69). The highest and lowest agreement among end-users was for visual clarity and auditory presentation by EMRs, respectively. This suggests that user priorities in determination of EMR usability and their understanding of the importance of the types of individual tasks and context characteristics differ.

Usability study of the EduMod eLearning Program for contouring nodal stations of the head and neck.

PubMed

Deraniyagala, Rohan; Amdur, Robert J; Boyer, Arthur L; Kaylor, Scott

2015-01-01

A major strategy for improving radiation oncology education and competence evaluation is to develop eLearning programs that reproduce the real work environment. A valuable measure of the quality of an eLearning program is "usability," which is a multidimensional endpoint defined from the end user's perspective. The gold standard for measuring usability is the Software Usability Measurement Inventory (SUMI). The purpose of this study is to use the SUMI to measure usability of an eLearning course that uses innovative software to teach and test contouring of nodal stations of the head and neck. This is a prospective institutional review board-approved study in which all participants gave written informed consent. The study population was radiation oncology residents from 8 different programs across the United States. The subjects had to pass all sections of the same 2 eLearning modules and then complete the SUMI usability evaluation instrument. We reached the accrual goal of 25 participants. Usability results for the EduMod eLearning course, "Nodal Stations of the Head and Neck," were compared with a large database of scores of other major software programs. Results were evaluated in 5 domains: Affect, Helpfulness, Control, Learnability, and Global Usability. In all 5 domains, usability scores for the study modules were higher than the database mean and statistically superior in 4 domains. This is the first study to evaluate usability of an eLearning program related to radiation oncology. Usability of 2 representative modules related to contouring nodal stations of the head and neck was highly favorable, with scores that were superior to the industry standard in multiple domains. These results support the continued development of this type of eLearning program for teaching and testing radiation oncology technical skills. Copyright © 2015 American Society for Radiation Oncology. Published by Elsevier Inc. All rights reserved.

The value of Retrospective and Concurrent Think Aloud in formative usability testing of a physician data query tool.

PubMed

Peute, Linda W P; de Keizer, Nicolette F; Jaspers, Monique W M

2015-06-01

To compare the performance of the Concurrent (CTA) and Retrospective (RTA) Think Aloud method and to assess their value in a formative usability evaluation of an Intensive Care Registry-physician data query tool designed to support ICU quality improvement processes. Sixteen representative intensive care physicians participated in the usability evaluation study. Subjects were allocated to either the CTA or RTA method by a matched randomized design. Each subject performed six usability-testing tasks of varying complexity in the query tool in a real-working context. Methods were compared with regard to number and type of problems detected. Verbal protocols of CTA and RTA were analyzed in depth to assess differences in verbal output. Standardized measures were applied to assess thoroughness in usability problem detection weighted per problem severity level and method overall effectiveness in detecting usability problems with regard to the time subjects spent per method. The usability evaluation of the data query tool revealed a total of 43 unique usability problems that the intensive care physicians encountered. CTA detected unique usability problems with regard to graphics/symbols, navigation issues, error messages, and the organization of information on the query tool's screens. RTA detected unique issues concerning system match with subjects' language and applied terminology. The in-depth verbal protocol analysis of CTA provided information on intensive care physicians' query design strategies. Overall, CTA performed significantly better than RTA in detecting usability problems. CTA usability problem detection effectiveness was 0.80 vs. 0.62 (p<0.05) respectively, with an average difference of 42% less time spent per subject compared to RTA. In addition, CTA was more thorough in detecting usability problems of a moderate (0.85 vs. 0.7) and severe nature (0.71 vs. 0.57). In this study, the CTA is more effective in usability-problem detection and provided clarification of intensive care physician query design strategies to inform redesign of the query tool. However, CTA does not outperform RTA. The RTA additionally elucidated unique usability problems and new user requirements. Based on the results of this study, we recommend the use of CTA in formative usability evaluation studies of health information technology. However, we recommend further research on the application of RTA in usability studies with regard to user expertise and experience when focusing on user profile customized (re)design. Copyright © 2015 Elsevier Inc. All rights reserved.

Sensor-oriented feature usability evaluation in fingerprint segmentation

NASA Astrophysics Data System (ADS)

Li, Ying; Yin, Yilong; Yang, Gongping

2013-06-01

Existing fingerprint segmentation methods usually process fingerprint images captured by different sensors with the same feature or feature set. We propose to improve the fingerprint segmentation result in view of an important fact that images from different sensors have different characteristics for segmentation. Feature usability evaluation, which means to evaluate the usability of features to find the personalized feature or feature set for different sensors to improve the performance of segmentation. The need for feature usability evaluation for fingerprint segmentation is raised and analyzed as a new issue. To address this issue, we present a decision-tree-based feature-usability evaluation method, which utilizes a C4.5 decision tree algorithm to evaluate and pick the best suitable feature or feature set for fingerprint segmentation from a typical candidate feature set. We apply the novel method on the FVC2002 database of fingerprint images, which are acquired by four different respective sensors and technologies. Experimental results show that the accuracy of segmentation is improved, and time consumption for feature extraction is dramatically reduced with selected feature(s).

Usability and acceptability of balance exergames in older adults: A scoping review.

PubMed

Nawaz, Ather; Skjæret, Nina; Helbostad, Jorunn Lægdheim; Vereijken, Beatrix; Boulton, Elisabeth; Svanaes, Dag

2016-12-01

Serious games (exergames) have the potential to be effective for postural balance and increasing muscle strength. Several games have been developed to increase physical fitness and balance among older adults. However, it is unclear to which degree usability and acceptability of exergames for older adults have been evaluated. The aim of this study was to summarize usability evaluation and acceptability of studies in older adults. We conducted a scoping review on studies focusing on usability of exergames for older adults. The result shows that older adults consider usability and acceptability of exercise video games good. The review shows that longitudinal studies mainly use off-the-shelf exergame and evaluated game effectiveness and acceptability, whereas cross-sectional studies focus on interactional experience. Studies varied in their approaches to measure usability and acceptability of exergames for older adults. There is a need for a systematic developmental approach to involve older adults in development of exergames for longitudinal studies. © The Author(s) 2015.

Heuristic Evaluation on Mobile Interfaces: A New Checklist

PubMed Central

Yáñez Gómez, Rosa; Cascado Caballero, Daniel; Sevillano, José-Luis

2014-01-01

The rapid evolution and adoption of mobile devices raise new usability challenges, given their limitations (in screen size, battery life, etc.) as well as the specific requirements of this new interaction. Traditional evaluation techniques need to be adapted in order for these requirements to be met. Heuristic evaluation (HE), an Inspection Method based on evaluation conducted by experts over a real system or prototype, is based on checklists which are desktop-centred and do not adequately detect mobile-specific usability issues. In this paper, we propose a compilation of heuristic evaluation checklists taken from the existing bibliography but readapted to new mobile interfaces. Selecting and rearranging these heuristic guidelines offer a tool which works well not just for evaluation but also as a best-practices checklist. The result is a comprehensive checklist which is experimentally evaluated as a design tool. This experimental evaluation involved two software engineers without any specific knowledge about usability, a group of ten users who compared the usability of a first prototype designed without our heuristics, and a second one after applying the proposed checklist. The results of this experiment show the usefulness of the proposed checklist for avoiding usability gaps even with nontrained developers. PMID:25295300

Applying usability heuristics to radiotherapy systems.

PubMed

Chan, Alvita J; Islam, Mohammad K; Rosewall, Tara; Jaffray, David A; Easty, Anthony C; Cafazzo, Joseph A

2012-01-01

Heuristic evaluations have been used to evaluate safety of medical devices by identifying and assessing usability issues. Since radiotherapy treatment delivery systems often consist of multiple complex user-interfaces, a heuristic evaluation was conducted to assess the potential safety issues of such a system. A heuristic evaluation was conducted to evaluate the treatment delivery system at Princess Margaret Hospital (Toronto, Canada). Two independent evaluators identified usability issues with the user-interfaces and rated the severity of each issue. The evaluators identified 75 usability issues in total. Eighteen of them were rated as high severity, indicating the potential to have a major impact on patient safety. A majority of issues were found on the record and verify system, and many were associated with the patient setup process. While the hospital has processes in place to ensure patient safety, recommendations were developed to further mitigate the risks of potential consequences. Heuristic evaluation is an efficient and inexpensive method that can be successfully applied to radiotherapy delivery systems to identify usability issues and improve patient safety. Although this study was conducted only at one site, the findings may have broad implications for the design of these systems. Copyright © 2011 Elsevier Ireland Ltd. All rights reserved.

Usability Evaluation of the Student Centered e-Learning Environment

ERIC Educational Resources Information Center

Junus, Inas Sofiyah; Santoso, Harry Budi; Isal, R. Yugo K.; Utomo, Andika Yudha

2015-01-01

Student Centered e-Learning Environment (SCeLE) has substantial roles to support learning activities at Faculty of Computer Science, Universitas Indonesia (Fasilkom UI). Although it has been utilized for about 10 years, the usability aspect of SCeLE as an e-Learning system has not been evaluated. Therefore, the usability aspects of SCeLE Fasilkom…

A Usability Study of Users' Perceptions toward a Multimedia Computer-Assisted Learning Tool for Neuroanatomy

ERIC Educational Resources Information Center

Gould, Douglas J.; Terrell, Mark A.; Fleming, Jo

2008-01-01

This usability study evaluated users' perceptions of a multimedia prototype for a new e-learning tool: Anatomy of the Central Nervous System: A Multimedia Course. Usability testing is a collection of formative evaluation methods that inform the developmental design of e-learning tools to maximize user acceptance, satisfaction, and adoption.…

Evaluating a Web-Based Interface for Internet Telemedicine

NASA Technical Reports Server (NTRS)

Lathan, Corinna E.; Newman, Dava J.; Sebrechts, Marc M.; Doarn, Charles R.

1997-01-01

The objective is to introduce the usability engineering methodology, heuristic evaluation, to the design and development of a web-based telemedicine system. Using a set of usability criteria, or heuristics, one evaluator examined the Spacebridge to Russia web-site for usability problems. Thirty-four usability problems were found in this preliminary study and all were assigned a severity rating. The value of heuristic analysis in the iterative design of a system is shown because the problems can be fixed before deployment of a system and the problems are of a different nature than those found by actual users of the system. It was therefore determined that there is potential value of heuristic evaluation paired with user testing as a strategy for optimal system performance design.

Web usability testing with a Hispanic medically underserved population.

PubMed

Moore, Mary; Bias, Randolph G; Prentice, Katherine; Fletcher, Robin; Vaughn, Terry

2009-04-01

Skilled website developers value usability testing to assure user needs are met. When the target audience differs substantially from the developers, it becomes essential to tailor both design and evaluation methods. In this study, researchers carried out a multifaceted usability evaluation of a website (Healthy Texas) designed for Hispanic audiences with lower computer literacy and lower health literacy. METHODS INCLUDED: (1) heuristic evaluation by a usability engineer, (2) remote end-user testing using WebEx software; and (3) face-to-face testing in a community center where use of the website was likely. Researchers found standard usability testing methods needed to be modified to provide interpreters, increased flexibility for time on task, presence of a trusted intermediary such as a librarian, and accommodation for family members who accompanied participants. Participants offered recommendations for website redesign, including simplified language, engaging and relevant graphics, culturally relevant examples, and clear navigation. User-centered design is especially important when website developers are not representative of the target audience. Failure to conduct appropriate usability testing with a representative audience can substantially reduce use and value of the website. This thorough course of usability testing identified improvements that benefit all users but become crucial when trying to reach an underserved audience.

Field Evaluation of Programmable Thermostats

DOE Office of Scientific and Technical Information (OSTI.GOV)

Sachs, O.; Tiefenbeck, V.; Duvier, C.

2012-12-01

Prior research suggests that poor programmable thermostats usability may prevent their effective use to save energy. We hypothesized that home occupants with a high-usability thermostats would be more likely to use them to save energy than people with a basic thermostat. We randomly installed a high-usability thermostat in half the 77 apartments of an affordable housing complex, installing a basic thermostat in the other half. During the heating season, we collected space temperature and furnace on-off data to evaluate occupant interaction with the thermostats, foremost nighttime setbacks. We found that thermostat usability did not influence energy-saving behaviors, finding no significantmore » difference in temperature maintained among apartments with high- and low-usability thermostats.« less

Usability and feasibility of health IT interventions to enhance Self-Care for Lymphedema Symptom Management in breast cancer survivors.

PubMed

Fu, Mei R; Axelrod, Deborah; Guth, Amber A; Wang, Yao; Scagliola, Joan; Hiotis, Karen; Rampertaap, Kavita; El-Shammaa, Nardin

2016-09-01

The-Optimal-Lymph-Flow health IT system (TOLF) is a patient-centered, web-and-mobile-based educational and behavioral health IT system focusing on safe, innovative, and pragmatic self-care strategies for lymphedema symptom management. The purpose of this study was to evaluate usability, feasibility, and acceptability of TOLF among the end-user of breast cancer survivors. Two types of usability testing were completed with 30 breast cancer survivors: heuristic evaluation and end-user testing. Each participant was asked to think aloud while completing a set of specified tasks designed to explicate and freely explore the system features. A heuristic evaluation checklist, the Perceived Ease of Use and Usefulness Questionnaire, and The Post Study System Usability Questionnaire were used to evaluate usability of the system. Open-ended questions were used to gather qualitative data. Quantitative data were analyzed using descriptive statistics and qualitative data were summarized thematically. Breast cancer survivors were very satisfied with the system: 90% (n = 27) rated the system having no usability problems; 10% (n = 3) noted minor cosmetic problems: spelling errors or text font size. The majority of participants 96.6% (n = 29) strongly agreed that the system was easy to use and effective in helping to learn about lymphedema, symptoms and self-care strategies. Themes from the qualitative data included empowerment, high quality information, loving avatar simulation videos, easy accessibility, and user-friendliness. This usability study provided evidence on breast cancer survivor's acceptance and highly positive evaluation of TOLF's usability as well as feasibility of using technologically-driven delivery model to enhance self-care strategies for lymphedema symptom management.

An Iterative, Mixed Usability Approach Applied to the Telekit System from the Danish TeleCare North Trial

PubMed Central

Schaarup, Clara; Hejlesen, Ole Kristian

2016-01-01

Objective. The aim of the present study is to evaluate the usability of the telehealth system, coined Telekit, by using an iterative, mixed usability approach. Materials and Methods. Ten double experts participated in two heuristic evaluations (HE1, HE2), and 11 COPD patients attended two think-aloud tests. The double experts identified usability violations and classified them into Jakob Nielsen's heuristics. These violations were then translated into measurable values on a scale of 0 to 4 indicating degree of severity. In the think-aloud tests, COPD participants were invited to verbalise their thoughts. Results. The double experts identified 86 usability violations in HE1 and 101 usability violations in HE2. The majority of the violations were rated in the 0–2 range. The findings from the think-aloud tests resulted in 12 themes and associated examples regarding the usability of the Telekit system. The use of the iterative, mixed usability approach produced both quantitative and qualitative results. Conclusion. The iterative, mixed usability approach yields a strong result owing to the high number of problems identified in the tests because the double experts and the COPD participants focus on different aspects of Telekit's usability. This trial is registered with Clinicaltrials.gov, NCT01984840, November 14, 2013. PMID:27974888

An Iterative, Mixed Usability Approach Applied to the Telekit System from the Danish TeleCare North Trial.

PubMed

Lilholt, Pernille Heyckendorff; Schaarup, Clara; Hejlesen, Ole Kristian

2016-01-01

Objective . The aim of the present study is to evaluate the usability of the telehealth system, coined Telekit, by using an iterative, mixed usability approach. Materials and Methods . Ten double experts participated in two heuristic evaluations (HE1, HE2), and 11 COPD patients attended two think-aloud tests. The double experts identified usability violations and classified them into Jakob Nielsen's heuristics. These violations were then translated into measurable values on a scale of 0 to 4 indicating degree of severity. In the think-aloud tests, COPD participants were invited to verbalise their thoughts. Results . The double experts identified 86 usability violations in HE1 and 101 usability violations in HE2. The majority of the violations were rated in the 0-2 range. The findings from the think-aloud tests resulted in 12 themes and associated examples regarding the usability of the Telekit system. The use of the iterative, mixed usability approach produced both quantitative and qualitative results. Conclusion . The iterative, mixed usability approach yields a strong result owing to the high number of problems identified in the tests because the double experts and the COPD participants focus on different aspects of Telekit's usability. This trial is registered with Clinicaltrials.gov, NCT01984840, November 14, 2013.

To twist or poke? A method for identifying usability issues with the rotary controller and touch screen for control of in-vehicle information systems.

PubMed

Harvey, Catherine; Stanton, Neville A; Pickering, Carl A; McDonald, Mike; Zheng, Pengjun

2011-07-01

In-vehicle information systems (IVIS) can be controlled by the user via direct or indirect input devices. In order to develop the next generation of usable IVIS, designers need to be able to evaluate and understand the usability issues associated with these two input types. The aim of this study was to investigate the effectiveness of a set of empirical usability evaluation methods for identifying important usability issues and distinguishing between the IVIS input devices. A number of usability issues were identified and their causal factors have been explored. These were related to the input type, the structure of the menu/tasks and hardware issues. In particular, the translation between inputs and on-screen actions and a lack of visual feedback for menu navigation resulted in lower levels of usability for the indirect device. This information will be useful in informing the design of new IVIS, with improved usability. STATEMENT OF RELEVANCE: This paper examines the use of empirical methods for distinguishing between direct and indirect IVIS input devices and identifying usability issues. Results have shown that the characteristics of indirect input devices produce more serious usability issues, compared with direct devices and can have a negative effect on the driver-vehicle interaction.

A health literacy and usability heuristic evaluation of a mobile consumer health application.

PubMed

Monkman, Helen; Kushniruk, Andre

2013-01-01

Usability and health literacy are two critical factors in the design and evaluation of consumer health information systems. However, methods for evaluating these two factors in conjunction remain limited. This study adapted a set of existing guidelines for the design of consumer health Web sites into evidence-based evaluation heuristics tailored specifically for mobile consumer health applications. In order to test the approach, a mobile consumer health application (app) was then evaluated using these heuristics. In addition to revealing ways to improve the usability of the system, this analysis identified opportunities to augment the content to make it more understandable by users with limited health literacy. This study successfully demonstrated the utility of converting existing design guidelines into heuristics for the evaluation of usability and health literacy. The heuristics generated could be applied for assessing and revising other existing consumer health information systems.

Developing a Self-Report-Based Sequential Analysis Method for Educational Technology Systems: A Process-Based Usability Evaluation

ERIC Educational Resources Information Center

Lin, Yi-Chun; Hsieh, Ya-Hui; Hou, Huei-Tse

2015-01-01

The development of a usability evaluation method for educational systems or applications, called the self-report-based sequential analysis, is described herein. The method aims to extend the current practice by proposing self-report-based sequential analysis as a new usability method, which integrates the advantages of self-report in survey…

Evaluation of a BCMA’s Electronic Medication Administration Record

PubMed Central

Staggers, Nancy; Iribarren, Sarah; Guo, Jia-Wen; Weir, Charlene

2015-01-01

Barcode medication administration (BCMA) systems can reduce medication errors, but sociotechnical issues are quite common. Although crucial to nurses’ work, few usability evaluations are available for electronic medication administration record screens (eMARs). The purpose of this research was to identify current usability problems in the VA’s eMAR/BCMA system and explore how these might impact nurses’ situation awareness. Three expert evaluators used 10 tasks/elements, heuristic evaluation techniques and explored potential impacts using a situation awareness perspective. The results yielded 99 usability problems categorized into 440 heuristic violations with the largest volume in the category of Match with the Real World. Fifteen usability issues were rated as catastrophic with the Administer/Chart medications task having the most. Situational awareness was impacted at all levels, especially at Level 2, Comprehension. Usability problems point to important areas for improvement because these issues have the potential to impact nurses’ situation awareness, “at a glance” information, nurse productivity and patient safety. PMID:25601936

An appraisal of published usability evaluations of electronic health records via systematic review.

PubMed

Ellsworth, Marc A; Dziadzko, Mikhail; O'Horo, John C; Farrell, Ann M; Zhang, Jiajie; Herasevich, Vitaly

2017-01-01

In this systematic review, we aimed to evaluate methodological and reporting trends present in the current literature by investigating published usability studies of electronic health records (EHRs). A literature search was conducted for articles published through January 2015 using MEDLINE (Ovid), EMBASE, Scopus, and Web of Science, supplemented by citation and reference list reviews. Studies were included if they tested the usability of hospital and clinic EHR systems in the inpatient, outpatient, emergency department, or operating room setting. A total of 4848 references were identified for title and abstract screening. Full text screening was performed for 197 articles, with 120 meeting the criteria for study inclusion. A review of the literature demonstrates a paucity of quality published studies describing scientifically valid and reproducible usability evaluations at various stages of EHR system development. A lack of formal and standardized reporting of EHR usability evaluation results is a major contributor to this knowledge gap, and efforts to improve this deficiency will be one step of moving the field of usability engineering forward. © The Author 2016. Published by Oxford University Press on behalf of the American Medical Informatics Association. All rights reserved. For Permissions, please email: journals.permissions@oup.com.

A low cost technique to evaluate usable product for small manufacturing companies: a case study on Garcia robot.

PubMed

An, Vatana; Soares, Marcelo

2012-01-01

A usability evaluation technique to evaluate user interfaces is introduces. The technique is effective and affordable for small manufacturing companies. By using this technique, an integration of users' feedbacks and some usability concepts, a product can be 3 times easier to use among potential users and more than 5 times easier to use among motivated users. In addition, the technique can be implemented with the company's employees as participants.

Exploring the Usability of Mobile Apps Supporting Radiologists' Training in Diagnostic Decision Making.

PubMed

Kim, Min Soon; Aro, Michael R; Lage, Kraig J; Ingalls, Kevin L; Sindhwani, Vivek; Markey, Mia K

2016-03-01

The objective of this study was to conduct a usability evaluation of mobile apps for supporting education and training in radiologic diagnostic decision-making processes. Of 381 mobile apps available at two major stores (Google Play and iTunes), eight iOS apps were selected for laboratory-based usability tests. Six staff radiologists completed eight app-specific task sets, using a think-aloud strategy. The triangular methods approach included quantitative performance measures, System Usability Scale (SUS), and qualitative thematic analysis using heuristic usability principles of usability issues. Overall, radiologists achieved higher than 70% success, with favorable SUS scores, in completing the tasks for seven of the eight apps. However, task success rate and SUS score had a weak relation (r = 0.23), indicating that the perceived usability may not reflect the holistic usability of the app. Task analysis and self-report revealed 108 usability issues, which were condensed to 55 unique issues and categorized by nine usability themes and mapped to ten usability heuristics. Nonintuitive functionality (eg, nonintuitive or misleading labels) was the most frequent theme observed, leading to inefficient navigation. These usability findings were consistent with the 13 improvements the radiologists suggested. This study demonstrates the feasibility of usability evaluation of radiology mobile apps and suggests potential improvements in the development of radiology mobile apps. This study also suggests that proficiency with mobile devices may not be equivalent to being an expert user, proficient in using the apps. Copyright © 2016 American College of Radiology. Published by Elsevier Inc. All rights reserved.

Ten factors to consider when developing usability scenarios and tasks for health information technology.

PubMed

Russ, Alissa L; Saleem, Jason J

2018-02-01

The quality of usability testing is highly dependent upon the associated usability scenarios. To promote usability testing as part of electronic health record (EHR) certification, the Office of the National Coordinator (ONC) for Health Information Technology requires that vendors test specific capabilities of EHRs with clinical end-users and report their usability testing process - including the test scenarios used - along with the results. The ONC outlines basic expectations for usability testing, but there is little guidance in usability texts or scientific literature on how to develop usability scenarios for healthcare applications. The objective of this article is to outline key factors to consider when developing usability scenarios and tasks to evaluate computer-interface based health information technologies. To achieve this goal, we draw upon a decade of our experience conducting usability tests with a variety of healthcare applications and a wide range of end-users, to include healthcare professionals as well as patients. We discuss 10 key factors that influence scenario development: objectives of usability testing; roles of end-user(s); target performance goals; evaluation time constraints; clinical focus; fidelity; scenario-related bias and confounders; embedded probes; minimize risks to end-users; and healthcare related outcome measures. For each factor, we present an illustrative example. This article is intended to aid usability researchers and practitioners in their efforts to advance health information technologies. The article provides broad guidance on usability scenario development and can be applied to a wide range of clinical information systems and applications. Published by Elsevier Inc.

Getting a Technology-based Diabetes Intervention Ready for Primetime: A Review of Usability Testing Studies

PubMed Central

Lyles, Courtney R.; Sarkar, Urmimala; Osborn, Chandra Y.

2014-01-01

Consumer health technologies can educate patients about diabetes and support their self-management, yet usability evidence is rarely published even though it determines patient engagement, optimal benefit of any intervention, and an understanding of generalizability. Therefore, we conducted a narrative review of peer-reviewed articles published from 2009–2013 that tested the usability of a web- or mobile-delivered system/application designed to educate and support patients with diabetes. Overall, the 23 papers included in our review used mixed (n=11), descriptive quantitative (n=9), and qualitative methods (n=3) to assess usability, such as documenting which features performed as intended and how patients rated their experiences. More sophisticated usability evaluations combined several complementary approaches to elucidate more aspects of functionality. Future work pertaining to the design and evaluation of technology-delivered diabetes education/support interventions should aim to standardize the usability testing processes, and publish usability findings to inform interpretation of why an intervention succeeded or failed, and for whom. PMID:25173689

Usability evaluation model for mobile e-book applications

NASA Astrophysics Data System (ADS)

Matraf, Munya Saleh Ba; Hussain, Azham

2017-10-01

Evaluation for mobile e-book applications are limited and did not address all the important usability measurements. Hence, this study aimed to identify the characteristics that affect user satisfaction on the usability of mobile e-book applications. Five characteristics that have a significant effect on the user satisfaction of mobile e-book applications have been identified namely readability, effectiveness, accessibility, efficiency, and navigation. A usability evaluation was conducted on three mobile e-book applications namely Adobe Acrobat Reader, Ebook Reader, and Amazon Kindle. 30 students from Universiti Utara Malaysia evaluated the mobile e-book applications and their satisfaction was measured using questionnaire. The outcomes discovered that the five characteristics have a significant positive relationship with user satisfaction. This provides insights into the main characteristics that increase user satisfaction.

A Modified User-Oriented Heuristic Evaluation of a Mobile Health System for Diabetes Self-management Support

PubMed Central

Georgsson, Mattias; Staggers, Nancy; Weir, Charlene

2016-01-01

Mobile health platforms offer significant opportunities for improving diabetic self-care, but only if adequate usability exists. Expert evaluations such as heuristic evaluation can provide distinct usability information about systems. The purpose of this study was to complete a usability evaluation of a mobile health system for diabetes patients using a modified heuristic evaluation technique of (1) dual-domain experts (healthcare professionals, usability experts), (2) validated scenarios and user tasks related to patients’ self-care, and (3) in-depth severity factor ratings. Experts identified 129 usability problems with 274 heuristic violations for the system. The categories Consistency and Standards dominated at 24.1% (n = 66), followed by Match Between System and Real World at 22.3% (n = 61). Average severity ratings across system views were 2.8 (of 4), with 9.3% (n = 12) rated as catastrophic and 53.5% (n = 69) as major. The large volume of violations with severe ratings indicated clear priorities for redesign. The modified heuristic approach allowed evaluators to identify unique and important issues, including ones related to self-management and patient safety. This article provides a template for one type of expert evaluation adding to the informaticists’ toolbox when needing to conduct a fast, resource-efficient and user-oriented heuristic evaluation. PMID:26657618

A Modified User-Oriented Heuristic Evaluation of a Mobile Health System for Diabetes Self-management Support.

PubMed

Georgsson, Mattias; Staggers, Nancy; Weir, Charlene

2016-02-01

Mobile health platforms offer significant opportunities for improving diabetic self-care, but only if adequate usability exists. Expert evaluations such as heuristic evaluation can provide distinct usability information about systems. The purpose of this study was to complete a usability evaluation of a mobile health system for diabetes patients using a modified heuristic evaluation technique of (1) dual-domain experts (healthcare professionals, usability experts), (2) validated scenarios and user tasks related to patients' self-care, and (3) in-depth severity factor ratings. Experts identified 129 usability problems with 274 heuristic violations for the system. The categories Consistency and Standards dominated at 24.1% (n = 66), followed by Match Between System and Real World at 22.3% (n = 61). Average severity ratings across system views were 2.8 (of 4), with 9.3% (n = 12) rated as catastrophic and 53.5% (n = 69) as major. The large volume of violations with severe ratings indicated clear priorities for redesign. The modified heuristic approach allowed evaluators to identify unique and important issues, including ones related to self-management and patient safety. This article provides a template for one type of expert evaluation adding to the informaticists' toolbox when needing to conduct a fast, resource-efficient and user-oriented heuristic evaluation.

The E-health Literacy Demands of Australia's My Health Record: A Heuristic Evaluation of Usability.

PubMed

Walsh, Louisa; Hemsley, Bronwyn; Allan, Meredith; Adams, Natalie; Balandin, Susan; Georgiou, Andrew; Higgins, Isabel; McCarthy, Shaun; Hill, Sophie

2017-01-01

My Health Record is Australia's electronic personal health record system, which was introduced in July 2012. As of August 2017, approximately 21 percent of Australia's total population was registered to use My Health Record. Internationally, usability issues have been shown to negatively influence the uptake and use of electronic health record systems, and this scenario may particularly affect people who have low e-health literacy. It is likely that usability issues are negatively affecting the uptake and use of My Health Record in Australia. To identify potential e-health literacy-related usability issues within My Health Record through a heuristic evaluation method. Between September 14 and October 12, 2016, three of the authors conducted a heuristic evaluation of the two consumer-facing components of My Health Record-the information website and the electronic health record itself. These two components were evaluated against two sets of heuristics-the Health Literacy Online checklist and the Monkman Heuristics. The Health Literacy Online checklist and Monkman Heuristics are evidence-based checklists of web design elements with a focus on design for audiences with low health literacy. During this heuristic evaluation, the investigators individually navigated through the consumer-facing components of My Health Record, recording instances where the My Health Record did not conform to the checklist criteria. After the individual evaluations were completed, the investigators conferred and aggregated their results. From this process, a list of usability violations was constructed. When evaluated against the Health Literacy Online Checklist, the information website demonstrated violations in 12 of 35 criteria, and the electronic health record demonstrated violations in 16 of 35 criteria. When evaluated against the Monkman Heuristics, the information website demonstrated violations in 7 of 11 criteria, and the electronic health record demonstrated violations in 9 of 11 criteria. The identified violations included usability issues with the reading levels used within My Health Record, the graphic design elements, the layout of web pages, and a lack of images and audiovisual tools to support learning. Other important usability issues included a lack of translated resources, difficulty using accessibility tools, and complexity of the registration processes. My Health Record is an important piece of technology that has the potential to facilitate better communication between consumers and their health providers. However, this heuristic evaluation demonstrated that many usability-related elements of My Health Record cater poorly to users at risk of having low e-health literacy. Usability issues have been identified as an important barrier to use of personal health records internationally, and the findings of this heuristic evaluation demonstrate that usability issues may be substantial barriers to the uptake and use of My Health Record.

The E-health Literacy Demands of Australia's My Health Record: A Heuristic Evaluation of Usability

PubMed Central

Walsh, Louisa; Hemsley, Bronwyn; Allan, Meredith; Adams, Natalie; Balandin, Susan; Georgiou, Andrew; Higgins, Isabel; McCarthy, Shaun; Hill, Sophie

2017-01-01

Background My Health Record is Australia's electronic personal health record system, which was introduced in July 2012. As of August 2017, approximately 21 percent of Australia's total population was registered to use My Health Record. Internationally, usability issues have been shown to negatively influence the uptake and use of electronic health record systems, and this scenario may particularly affect people who have low e-health literacy. It is likely that usability issues are negatively affecting the uptake and use of My Health Record in Australia. Objective To identify potential e-health literacy–related usability issues within My Health Record through a heuristic evaluation method. Methods Between September 14 and October 12, 2016, three of the authors conducted a heuristic evaluation of the two consumer-facing components of My Health Record—the information website and the electronic health record itself. These two components were evaluated against two sets of heuristics—the Health Literacy Online checklist and the Monkman Heuristics. The Health Literacy Online checklist and Monkman Heuristics are evidence-based checklists of web design elements with a focus on design for audiences with low health literacy. During this heuristic evaluation, the investigators individually navigated through the consumer-facing components of My Health Record, recording instances where the My Health Record did not conform to the checklist criteria. After the individual evaluations were completed, the investigators conferred and aggregated their results. From this process, a list of usability violations was constructed. Results When evaluated against the Health Literacy Online Checklist, the information website demonstrated violations in 12 of 35 criteria, and the electronic health record demonstrated violations in 16 of 35 criteria. When evaluated against the Monkman Heuristics, the information website demonstrated violations in 7 of 11 criteria, and the electronic health record demonstrated violations in 9 of 11 criteria. The identified violations included usability issues with the reading levels used within My Health Record, the graphic design elements, the layout of web pages, and a lack of images and audiovisual tools to support learning. Other important usability issues included a lack of translated resources, difficulty using accessibility tools, and complexity of the registration processes. Conclusion My Health Record is an important piece of technology that has the potential to facilitate better communication between consumers and their health providers. However, this heuristic evaluation demonstrated that many usability-related elements of My Health Record cater poorly to users at risk of having low e-health literacy. Usability issues have been identified as an important barrier to use of personal health records internationally, and the findings of this heuristic evaluation demonstrate that usability issues may be substantial barriers to the uptake and use of My Health Record. PMID:29118683

45 CFR 155.230 - General standards for Exchange notices.

Code of Federal Regulations, 2014 CFR

2014-10-01

...). (c) Re-evaluation of appropriateness and usability. The Exchange must re-evaluate the appropriateness and usability of applications, forms, and notices. (d) Electronic notices. (1) The individual market...

45 CFR 155.230 - General standards for Exchange notices.

Code of Federal Regulations, 2013 CFR

2013-10-01

...). (c) Re-evaluation of appropriateness and usability. The Exchange must re-evaluate the appropriateness and usability of applications, forms, and notices. (d) Electronic notices. (1) The individual market...

Investigating the effect of m-commerce design usability on customers' trust

NASA Astrophysics Data System (ADS)

Hussain, Azham Bin; Mahmood, Alaa Thamer; Naser, Raed Kamil

2017-10-01

User experience may vary from one user to another based on the design characteristics for processing a certain task. Our review of the literature revealed that there is a noticeable lack of studies on the effect of mobile or m-commerce design usability on customers' trust to perform certain activities. We investigated the effect of m-commerce design usability in terms of navigability, supportability, readability, creditability, and content relevant. A close-ended questionnaire was distributed to 20 customers who were asked to perform some tasks. The result showed that majority of the participants found m-commerce design usability to influence their trust of the app. The mentioned usability elements were found to positively influence customers' trust except for supportability. Our findings provide some insights to the m-commerce designers and developers and extend the current understanding about the potential of design usability in explaining users' usage behavior.

Usability Evaluation at the Point-of-Care: A Method to Identify User Information Needs in CPOE Applications

PubMed Central

Washburn, Jeff; Fiol, Guilherme Del; Rocha, Roberto A.

2006-01-01

Point of care usability evaluation may help identify information needs that occur during the process of providing care. We describe the process of using usability-specific recording software to record Computerized Physician Order Entry (CPOE) ordering sessions on admitted adult and pediatric patients at two urban tertiary hospitals in the Intermountain Healthcare system of hospitals. PMID:17238756

Teaching clinical reasoning and decision-making skills to nursing students: Design, development, and usability evaluation of a serious game.

PubMed

Johnsen, Hege Mari; Fossum, Mariann; Vivekananda-Schmidt, Pirashanthie; Fruhling, Ann; Slettebø, Åshild

2016-10-01

Serious games (SGs) are a type of simulation technology that may provide nursing students with the opportunity to practice their clinical reasoning and decision-making skills in a safe and authentic environment. Despite the growing number of SGs developed for healthcare professionals, few SGs are video based or address the domain of home health care. This paper aims to describe the design, development, and usability evaluation of a video based SG for teaching clinical reasoning and decision-making skills to nursing students who care for patients with chronic obstructive pulmonary disease (COPD) in home healthcare settings. A prototype SG was developed. A unified framework of usability called TURF (Task, User, Representation, and Function) and SG theory were employed to ensure a user-centered design. The educational content was based on the clinical decision-making model, Bloom's taxonomy, and a Bachelor of Nursing curriculum. A purposeful sample of six participants evaluated the SG prototype in a usability laboratory. Cognitive walkthrough evaluations, a questionnaire, and individual interviews were used for the usability evaluation. The data were analyzed using qualitative deductive content analysis based on the TURF framework elements and related usability heuristics. The SG was perceived as being realistic, clinically relevant, and at an adequate level of complexity for the intended users. Usability issues regarding functionality and the user-computer interface design were identified. However, the SG was perceived as being easy to learn, and participants suggested that the SG could serve as a supplement to traditional training in laboratory and clinical settings. Using video based scenarios with an authentic COPD patient and a home healthcare registered nurse as actors contributed to increased realism. Using different theoretical approaches in the SG design was considered an advantage of the design process. The SG was perceived as being useful, usable, and satisfying. The achievement of the desired functionality and the minimization of user-computer interface issues emphasize the importance of conducting a usability evaluation during the SG development process. Copyright © 2016 Elsevier Ireland Ltd. All rights reserved.

Usability Testing of a Multimedia e-Learning Resource for Electrolyte and Acid-Base Disorders

ERIC Educational Resources Information Center

Davids, Mogamat Razeen; Chikte, Usuf; Grimmer-Somers, Karen; Halperin, Mitchell L.

2014-01-01

The usability of computer interfaces may have a major influence on learning. Design approaches that optimize usability are commonplace in the software development industry but are seldom used in the development of e-learning resources, especially in medical education. We conducted a usability evaluation of a multimedia resource for teaching…

47 CFR 6.7 - Product design, development, and evaluation.

Code of Federal Regulations, 2014 CFR

2014-10-01

...) Manufacturers and service providers shall evaluate the accessibility, usability, and compatibility of equipment... identify barriers to accessibility and usability as part of such a product design and development process...

47 CFR 6.7 - Product design, development, and evaluation.

Code of Federal Regulations, 2013 CFR

2013-10-01

...) Manufacturers and service providers shall evaluate the accessibility, usability, and compatibility of equipment... identify barriers to accessibility and usability as part of such a product design and development process...

Usability of a patient education and motivation tool using heuristic evaluation.

PubMed

Joshi, Ashish; Arora, Mohit; Dai, Liwei; Price, Kathleen; Vizer, Lisa; Sears, Andrew

2009-11-06

Computer-mediated educational applications can provide a self-paced, interactive environment to deliver educational content to individuals about their health condition. These programs have been used to deliver health-related information about a variety of topics, including breast cancer screening, asthma management, and injury prevention. We have designed the Patient Education and Motivation Tool (PEMT), an interactive computer-based educational program based on behavioral, cognitive, and humanistic learning theories. The tool is designed to educate users and has three key components: screening, learning, and evaluation. The objective of this tutorial is to illustrate a heuristic evaluation using a computer-based patient education program (PEMT) as a case study. The aims were to improve the usability of PEMT through heuristic evaluation of the interface; to report the results of these usability evaluations; to make changes based on the findings of the usability experts; and to describe the benefits and limitations of applying usability evaluations to PEMT. PEMT was evaluated by three usability experts using Nielsen's usability heuristics while reviewing the interface to produce a list of heuristic violations with severity ratings. The violations were sorted by heuristic and ordered from most to least severe within each heuristic. A total of 127 violations were identified with a median severity of 3 (range 0 to 4 with 0 = no problem to 4 = catastrophic problem). Results showed 13 violations for visibility (median severity = 2), 38 violations for match between system and real world (median severity = 2), 6 violations for user control and freedom (median severity = 3), 34 violations for consistency and standards (median severity = 2), 11 violations for error severity (median severity = 3), 1 violation for recognition and control (median severity = 3), 7 violations for flexibility and efficiency (median severity = 2), 9 violations for aesthetic and minimalist design (median severity = 2), 4 violations for help users recognize, diagnose, and recover from errors (median severity = 3), and 4 violations for help and documentation (median severity = 4). We describe the heuristic evaluation method employed to assess the usability of PEMT, a method which uncovers heuristic violations in the interface design in a quick and efficient manner. Bringing together usability experts and health professionals to evaluate a computer-mediated patient education program can help to identify problems in a timely manner. This makes this method particularly well suited to the iterative design process when developing other computer-mediated health education programs. Heuristic evaluations provided a means to assess the user interface of PEMT.

Usability of a Patient Education and Motivation Tool Using Heuristic Evaluation

PubMed Central

Arora, Mohit; Dai, Liwei; Price, Kathleen; Vizer, Lisa; Sears, Andrew

2009-01-01

Background Computer-mediated educational applications can provide a self-paced, interactive environment to deliver educational content to individuals about their health condition. These programs have been used to deliver health-related information about a variety of topics, including breast cancer screening, asthma management, and injury prevention. We have designed the Patient Education and Motivation Tool (PEMT), an interactive computer-based educational program based on behavioral, cognitive, and humanistic learning theories. The tool is designed to educate users and has three key components: screening, learning, and evaluation. Objective The objective of this tutorial is to illustrate a heuristic evaluation using a computer-based patient education program (PEMT) as a case study. The aims were to improve the usability of PEMT through heuristic evaluation of the interface; to report the results of these usability evaluations; to make changes based on the findings of the usability experts; and to describe the benefits and limitations of applying usability evaluations to PEMT. Methods PEMT was evaluated by three usability experts using Nielsen’s usability heuristics while reviewing the interface to produce a list of heuristic violations with severity ratings. The violations were sorted by heuristic and ordered from most to least severe within each heuristic. Results A total of 127 violations were identified with a median severity of 3 (range 0 to 4 with 0 = no problem to 4 = catastrophic problem). Results showed 13 violations for visibility (median severity = 2), 38 violations for match between system and real world (median severity = 2), 6 violations for user control and freedom (median severity = 3), 34 violations for consistency and standards (median severity = 2), 11 violations for error severity (median severity = 3), 1 violation for recognition and control (median severity = 3), 7 violations for flexibility and efficiency (median severity = 2), 9 violations for aesthetic and minimalist design (median severity = 2), 4 violations for help users recognize, diagnose, and recover from errors (median severity = 3), and 4 violations for help and documentation (median severity = 4). Conclusion We describe the heuristic evaluation method employed to assess the usability of PEMT, a method which uncovers heuristic violations in the interface design in a quick and efficient manner. Bringing together usability experts and health professionals to evaluate a computer-mediated patient education program can help to identify problems in a timely manner. This makes this method particularly well suited to the iterative design process when developing other computer-mediated health education programs. Heuristic evaluations provided a means to assess the user interface of PEMT. PMID:19897458

Qualitative review of usability problems in health information systems for radiology.

PubMed

Dias, Camila Rodrigues; Pereira, Marluce Rodrigues; Freire, André Pimenta

2017-12-01

Radiology processes are commonly supported by Radiology Information System (RIS), Picture Archiving and Communication System (PACS) and other software for radiology. However, these information technologies can present usability problems that affect the performance of radiologists and physicians, especially considering the complexity of the tasks involved. The purpose of this study was to extract, classify and analyze qualitatively the usability problems in PACS, RIS and other software for radiology. A systematic review was performed to extract usability problems reported in empirical usability studies in the literature. The usability problems were categorized as violations of Nielsen and Molich's usability heuristics. The qualitative analysis indicated the causes and the effects of the identified usability problems. From the 431 papers initially identified, 10 met the study criteria. The analysis of the papers identified 90 instances of usability problems, classified into categories corresponding to established usability heuristics. The five heuristics with the highest number of instances of usability problems were "Flexibility and efficiency of use", "Consistency and standards", "Match between system and the real world", "Recognition rather than recall" and "Help and documentation", respectively. These problems can make the interaction time consuming, causing delays in tasks, dissatisfaction, frustration, preventing users from enjoying all the benefits and functionalities of the system, as well as leading to more errors and difficulties in carrying out clinical analyses. Furthermore, the present paper showed a lack of studies performed on systems for radiology, especially usability evaluations using formal methods of evaluation involving the final users. Copyright © 2017 Elsevier Inc. All rights reserved.

A literature review about usability evaluation methods for e-learning platforms.

PubMed

Freire, Luciana Lopes; Arezes, Pedro Miguel; Campos, José Creissac

2012-01-01

The usability analysis of information systems has been the target of several research studies over the past thirty years. These studies have highlighted a great diversity of points of view, including researchers from different scientific areas such as Ergonomics, Computer Science, Design and Education. Within the domain of information ergonomics, the study of tools and methods used for usability evaluation dedicated to E-learning presents evidence that there is a continuous and dynamic evolution of E-learning systems, in many different contexts -academics and corporative. These systems, also known as LMS (Learning Management Systems), can be classified according to their educational goals and their technological features. However, in these systems the usability issues are related with the relationship/interactions between user and system in the user's context. This review is a synthesis of research project about Information Ergonomics and embraces three dimensions, namely the methods, models and frameworks that have been applied to evaluate LMS. The study also includes the main usability criteria and heuristics used. The obtained results show a notorious change in the paradigms of usability, with which it will be possible to discuss about the studies carried out by different researchers that were focused on usability ergonomic principles aimed at E-learning.

Usability of online psychoeducation for siblings of people with psychosis.

PubMed

Sin, Jacqueline; Henderson, Claire; Norman, Ian

2014-10-01

The E Sibling Project aims to address the needs of siblings of individuals affected by psychosis through provision of a comprehensive online intervention. The online intervention comprises four core elements, including: information on psychosis; various coping and promoting well-being strategies; siblings' blogs and discussion forum with peers; and an "Ask the Experts" function. After the intervention-prototype was developed, we tested its feasibility, usability and acceptability by siblings. We evaluated the usability of the intervention-prototype using a non-randomised usability study with siblings of individuals diagnosed with psychosis. The usability study adapted Poulson et al's framework to collect subjective feedback from participants on ease of use, perceived usefulness and acceptability, together with objective usage data on the intervention. Twenty siblings were recruited to the usability test; 19 tried out the resource-prototype over a 4-week period and 17 completed the online evaluation after using the intervention. In total, 906 page-views were made by the participants and each spent about two hours using the resource. Participants evaluated the intervention as helpful, relevant and useful in terms of content, design and usability. Developments are needed to improve the navigation and intuitiveness of the resource. Using an internet-based information-giving and peer support intervention to promote wellbeing and coping is feasible and acceptable to siblings of people with psychosis.

The STEP database through the end-users eyes--USABILITY STUDY.

PubMed

Salunke, Smita; Tuleu, Catherine

2015-08-15

The user-designed database of Safety and Toxicity of Excipients for Paediatrics ("STEP") is created to address the shared need of drug development community to access the relevant information of excipients effortlessly. Usability testing was performed to validate if the database satisfies the need of the end-users. Evaluation framework was developed to assess the usability. The participants performed scenario based tasks and provided feedback and post-session usability ratings. Failure Mode Effect Analysis (FMEA) was performed to prioritize the problems and improvements to the STEP database design and functionalities. The study revealed several design vulnerabilities. Tasks such as limiting the results, running complex queries, location of data and registering to access the database were challenging. The three critical attributes identified to have impact on the usability of the STEP database included (1) content and presentation (2) the navigation and search features (3) potential end-users. Evaluation framework proved to be an effective method for evaluating database effectiveness and user satisfaction. This study provides strong initial support for the usability of the STEP database. Recommendations would be incorporated into the refinement of the database to improve its usability and increase user participation towards the advancement of the database. Copyright © 2015 Elsevier B.V. All rights reserved.

Operating manual-based usability evaluation of medical devices: an effective patient safety screening method.

PubMed

Turley, James P; Johnson, Todd R; Smith, Danielle Paige; Zhang, Jaijie; Brixey, Juliana J

2006-04-01

Use of medical devices often directly contributes to medical errors. Because it is difficult or impossible to change the design of existing devices, the best opportunity for improving medical device safety is during the purchasing process. However, most hospital personnel are not familiar with the usability evaluation methods designed to identify aspects of a user interface that do not support intuitive and safe use. A review of medical device operating manuals is proposed as a more practical method of usability evaluation. Operating manuals for five volumetric infusion pumps from three manufacturers were selected for this study (January-April 2003). Each manual's safety message content was evaluated to determine whether the message indicated a device design characteristic that violated known usability principles (heuristics) or indicated a violation of an affordance of the device. "Minimize memory load," with 65 violations, was the heuristic violated most frequently across pumps. Variations between pumps, including the frequency and severity of violations for each, were noted. Results suggest that manual review can provide a proxy for heuristic evaluation of the actual medical device. This method, intended to be a component of prepurchasing evaluation, can complement more formal usability evaluation methods and be used to select a subset of devices for more extensive and formal testing.

An evaluation of patients' experienced usability of a diabetes mHealth system using a multi-method approach.

PubMed

Georgsson, Mattias; Staggers, Nancy

2016-02-01

mHealth systems are becoming more common to aid patients in their diabetes self-management, but recent studies indicate a need for thorough evaluation of patients' experienced usability. Current evaluations lack a multi-method design for data collection and structured methods for data analyses. The purpose of this study was to provide a feasibility test of a multi-method approach for both data collection and data analyses for patients' experienced usability of a mHealth system for diabetes type 2 self-management. A random sample of 10 users was selected from a larger clinical trial. Data collection methods included user testing with eight representative tasks and Think Aloud protocol, a semi-structured interview and a questionnaire on patients' experiences using the system. The Framework Analysis (FA) method and Usability Problem Taxonomy (UPT) were used to structure, code and analyze the results. A usability severity rating was assigned after classification. The combined methods resulted in a total of 117 problems condensed into 19 usability issues with an average severity rating of 2.47 or serious. The usability test detected 50% of the initial usability problems, followed by the post-interview at 29%. The usability test found 18 of 19 consolidated usability problems while the questionnaire uncovered one unique issue. Patients experienced most usability problems (8) in the Glucose Readings View when performing complex tasks such as adding, deleting, and exporting glucose measurements. The severity ratings were the highest for the Glucose Diary View, Glucose Readings View, and Blood Pressure View with an average severity rating of 3 (serious). Most of the issues were classified under the artifact component of the UPT and primary categories of Visualness (7) and Manipulation (6). In the UPT task component, most issues were in the primary category Task-mapping (12). Multiple data collection methods yielded a more comprehensive set of usability issues. Usability testing uncovered the largest volume of usability issues, followed by interviewing and then the questionnaire. The interview did not surface any unique consolidated usability issues while the questionnaire surfaced one. The FA and UPT were valuable in structuring and classifying problems. The resulting descriptions serve as a communication tool in problem solving and programming. We recommend the usage of multiple methods in data collection and employing the FA and UPT in data analyses for future usability testing. Copyright © 2015 The Authors. Published by Elsevier Inc. All rights reserved.

Approaches for Evaluating the Usability of Assistive Technology Product Prototypes

ERIC Educational Resources Information Center

Choi, Young Mi; Sprigle, Stephen H.

2011-01-01

User input is an important component to help guide designers in producing a more usable product. Evaluation of prototypes is one method of obtaining this input, but methods for evaluating assistive technology prototypes during design have not been adequately described or evaluated. This project aimed to compare different methods of evaluating…

Usability of American Nurses Association State Web Sites: A Follow-up Evaluation.

PubMed

Koch, Gina; Wakefield, Bonnie J; Alexander, Gregory L; Wilson, Melissa A; Becker, Colleen

2016-05-01

The American Nurses Association supports professional nurses through Web sites administered by state nursing associations, providing important information for current and potential members. Optimal usability of these Web sites is critical for nurses to obtain the information they seek. Heuristic evaluations are general criteria used to evaluate the usability of technology such as Web sites. A study published in 2014, using heuristic criteria from Nielsen's 10 principles and Health on The Web, evaluated 27 state nursing Web sites to identify usability concerns that could prevent nurses from obtaining accurate information regarding state nursing practice. The purpose of this study is to conduct a second heuristic evaluation to assess for changes in a subset of 12 Web sites. The analysis comparing the evaluation from 2012 to 2014 found that mean scores increased and variance decreased; however, no statistically significant difference was found between the two studies. Scores increased in 2014 for "help users to diagnose, and recover from errors," "match between the system and real world," and "consistency and standards." Scores decreased due to absence of mission statements and identification of intended audience. Ideally, Web site designers will use the feedback from this study and make changes that improve their usability to provide information to nurses.

Usability evaluation of mobile applications using ISO 9241 and ISO 25062 standards.

PubMed

Moumane, Karima; Idri, Ali; Abran, Alain

2016-01-01

This paper presents an empirical study based on a set of measures to evaluate the usability of mobile applications running on different mobile operating systems, including Android, iOS and Symbian. The aim is to evaluate empirically a framework that we have developed on the use of the Software Quality Standard ISO 9126 in mobile environments, especially the usability characteristic. To do that, 32 users had participated in the experiment and we have used ISO 25062 and ISO 9241 standards for objective measures by working with two widely used mobile applications: Google Apps and Google Maps. The QUIS 7.0 questionnaire have been used to collect measures assessing the users' level of satisfaction when using these two mobile applications. By analyzing the results we highlighted a set of mobile usability issues that are related to the hardware as well as to the software and that need to be taken into account by designers and developers in order to improve the usability of mobile applications.

Usability evaluation of user interface of thesis title review system

NASA Astrophysics Data System (ADS)

Tri, Y.; Erna, A.; Gellysa, U.

2018-03-01

Presentation of programs with user interface that can be accessed online through the website of course greatly provide user benefits. User can easily access the program they need. There are usability values that serve as a benchmark for the success of a user accessible program, ie efficiency, effectiveness, and convenience. These usability values also determine the development of the program for the better use. Therefore, on the review title thesis program that will be implemented in STT Dumai was measured usability evaluation. It aims to see which sides are not yet perfect and need to be improved to improve the performance and utilization of the program. Usability evaluation was measured by using smartPLS software. Database used was the result of respondent questionnaires that include questions about the experience when they used program. The result of a review of thesis title program implemented in STT Dumai has an efficiency value of 22.615, the effectiveness of 20.612, and satisfaction of 33.177.

Usability evaluation of a medication reconciliation tool: Embedding safety probes to assess users' detection of medication discrepancies.

PubMed

Russ, Alissa L; Jahn, Michelle A; Patel, Himalaya; Porter, Brian W; Nguyen, Khoa A; Zillich, Alan J; Linsky, Amy; Simon, Steven R

2018-06-01

An electronic medication reconciliation tool was previously developed by another research team to aid provider-patient communication for medication reconciliation. To evaluate the usability of this tool, we integrated artificial safety probes into standard usability methods. The objective of this article is to describe this method of using safety probes, which enabled us to evaluate how well the tool supports users' detection of medication discrepancies. We completed a mixed-method usability evaluation in a simulated setting with 30 participants: 20 healthcare professionals (HCPs) and 10 patients. We used factual scenarios but embedded three artificial safety probes: (1) a missing medication (i.e., omission); (2) an extraneous medication (i.e., commission); and (3) an inaccurate dose (i.e., dose discrepancy). We measured users' detection of each probe to estimate the probability that a HCP or patient would detect these discrepancies. Additionally, we recorded participants' detection of naturally occurring discrepancies. Each safety probe was detected by ≤50% of HCPs. Patients' detection rates were generally higher. Estimates indicate that a HCP and patient, together, would detect 44.8% of these medication discrepancies. Additionally, HCPs and patients detected 25 and 45 naturally-occurring discrepancies, respectively. Overall, detection of medication discrepancies was low. Findings indicate that more advanced interface designs are warranted. Future research is needed on how technologies can be designed to better aid HCPs' and patients' detection of medication discrepancies. This is one of the first studies to evaluate the usability of a collaborative medication reconciliation tool and assess HCPs' and patients' detection of medication discrepancies. Results demonstrate that embedded safety probes can enhance standard usability methods by measuring additional, clinically-focused usability outcomes. The novel safety probes we used may serve as an initial, standard set for future medication reconciliation research. More prevalent use of safety probes could strengthen usability research for a variety of health information technologies. Published by Elsevier Inc.

A usability study of a mobile health application for rural Ghanaian midwives.

PubMed

Vélez, Olivia; Okyere, Portia Boakye; Kanter, Andrew S; Bakken, Suzanne

2014-01-01

Midwives in rural Ghana work at the frontline of the health care system, where they have access to essential data about the patient population. However, current methods of data capture, primarily pen and paper, make the data neither accessible nor usable for monitoring patient care or program evaluation. Electronic health (eHealth) systems present a potential mechanism for enhancing the roles of midwives by providing tools for collecting, exchanging, and viewing patient data as well as offering midwives the possibility for receiving information and decision support. Introducing such technology in low-resource settings has been challenging because of low levels of user acceptance, software design that does not match the end-user environment, and/or unforeseen challenges such as irregular power availability. These challenges are often attributable to a lack of understanding by the software developers of the end users' needs and work environment. A mobile health (mHealth) application known as mClinic was designed to support midwife access to the Millennium Village-Global Network, an eHealth delivery platform that captures data for managing patient care as well as program evaluation and monitoring, decision making, and management. We conducted a descriptive usability study composed of 3 phases to evaluate an mClinic prototype: 1) hybrid lab-live software evaluation of mClinic to identify usability issues; 2) completion of a usability questionnaire; and 3) interviews that included low-fidelity prototyping of new functionality proposed by midwives. The heuristic evaluation identified usability problems related to 4 of 8 usability categories. Analysis of usability questionnaire data indicated that the midwives perceived mClinic as useful but were more neutral about the ease of use. Analysis of midwives' reactions to low-fidelity prototypes during the interview process supported the applicability of mClinic to midwives' work and identified the need for additional functionality. User acceptance is essential for the success of any mHealth implementation. Usability testing identified mClinic development flaws and needed software enhancements. © 2014 by the American College of Nurse-Midwives.

CUNY+ Web: Usability Study of the Web-Based GUI Version of the Bibliographic Database of the City University of New York (CUNY).

ERIC Educational Resources Information Center

Oulanov, Alexei; Pajarillo, Edmund J. Y.

2002-01-01

Describes the usability evaluation of the CUNY (City University of New York) information system in Web and Graphical User Interface (GUI) versions. Compares results to an earlier usability study of the basic information database available on CUNY's wide-area network and describes the applicability of the previous usability instrument to this…

Assessment of the usability of a digital learning technology prototype for monitoring intracranial pressure 1

PubMed Central

de Carvalho, Lilian Regina; Évora, Yolanda Dora Martinez; Zem-Mascarenhas, Silvia Helena

2016-01-01

ABSTRACT Objective: to assess the usability of a digital learning technology prototype as a new method for minimally invasive monitoring of intracranial pressure. Method: descriptive study using a quantitative approach on assessing the usability of a prototype based on Nielsen's ten heuristics. Four experts in the area of Human-Computer interaction participated in the study. Results: the evaluation delivered eight violated heuristics and 31 usability problems in the 32 screens of the prototype. Conclusion: the suggestions of the evaluators were critical for developing an intuitive, user-friendly interface and will be included in the final version of the digital learning technology. PMID:27579932

Usability and Instructional Design Heuristics for E-Learning Evaluation.

ERIC Educational Resources Information Center

Reeves, Thomas C.; Benson, Lisa; Elliott, Dean; Grant, Michael; Holschuh, Doug; Kim, Beaumie; Kim, Hyeonjin; Lauber, Erick; Loh, Sebastian

Heuristic evaluation is a methodology for investigating the usability of software originally developed by Nielsen (1993, 2000). Nielsen's protocol was modified and refined for evaluating e-learning programs by participants in a doctoral seminar held at the University of Georgia in 2001. The modifications primarily involved expanding Nielsen's…

Systematic Heuristic Evaluation of Computerized Consultation Order Templates: Clinicians' and Human Factors Engineers' Perspectives.

PubMed

Savoy, April; Patel, Himalaya; Flanagan, Mindy E; Weiner, Michael; Russ, Alissa L

2017-08-01

We assessed the usability of consultation order templates and identified problems to prioritize in design efforts for improving referral communication. With a sample of 26 consultation order templates, three evaluators performed a usability heuristic evaluation. The evaluation used 14 domain-independent heuristics and the following three supplemental references: 1 new domain-specific heuristic, 6 usability goals, and coded clinicians' statements regarding ease of use for 10 sampled templates. Evaluators found 201 violations, a mean of 7.7 violations per template. Minor violations outnumbered major violations almost twofold, 115 (57%) to 62 (31%). Approximately 68% of violations were linked to 5 heuristics: aesthetic and minimalist design (17%), error prevention (16%), consistency and standards (14%), recognition rather than recall (11%), and meet referrers' information needs (10%). Severe violations were attributed mostly to meet referrers' information needs and recognition rather than recall. Recorded violations yielded potential negative consequences for efficiency, effectiveness, safety, learnability, and utility. Evaluators and clinicians demonstrated 80% agreement in usability assessment. Based on frequency and severity of usability heuristic violations, the consultation order templates reviewed may impede clinical efficiency and risk patient safety. Results support the following design considerations: communicate consultants' requirements, facilitate information seeking, and support communication. While the most frequent heuristic violations involved interaction design and presentation, the most severe violations lacked information desired by referring clinicians. Violations related to templates' inability to support referring clinicians' information needs had the greatest potential negative impact on efficiency and safety usability goals. Heuristics should be prioritized in future design efforts.

An efficient approach to improve the usability of e-learning resources: the role of heuristic evaluation.

PubMed

Davids, Mogamat Razeen; Chikte, Usuf M E; Halperin, Mitchell L

2013-09-01

Optimizing the usability of e-learning materials is necessary to maximize their potential educational impact, but this is often neglected when time and other resources are limited, leading to the release of materials that cannot deliver the desired learning outcomes. As clinician-teachers in a resource-constrained environment, we investigated whether heuristic evaluation of our multimedia e-learning resource by a panel of experts would be an effective and efficient alternative to testing with end users. We engaged six inspectors, whose expertise included usability, e-learning, instructional design, medical informatics, and the content area of nephrology. They applied a set of commonly used heuristics to identify usability problems, assigning severity scores to each problem. The identification of serious problems was compared with problems previously found by user testing. The panel completed their evaluations within 1 wk and identified a total of 22 distinct usability problems, 11 of which were considered serious. The problems violated the heuristics of visibility of system status, user control and freedom, match with the real world, intuitive visual layout, consistency and conformity to standards, aesthetic and minimalist design, error prevention and tolerance, and help and documentation. Compared with user testing, heuristic evaluation found most, but not all, of the serious problems. Combining heuristic evaluation and user testing, with each involving a small number of participants, may be an effective and efficient way of improving the usability of e-learning materials. Heuristic evaluation should ideally be used first to identify the most obvious problems and, once these are fixed, should be followed by testing with typical end users.

Evaluation of the usability of a serious game aiming to teach facial expressions to schizophrenic patients.

PubMed

Isleyen, Filiz; Gulkesen, K Hakan; Cinemre, Buket; Samur, M Kemal; Zayim, Nese; Sen Kaya, Semiha

2014-01-01

In some psychological disorders such as autism and schizophrenia, loss of facial expression recognition skill may complicate patient's daily life. Information technology may help to develop facial expression recognition skill by educational software and games. We designed and developed an interactive web-based educational program with which we performed a usability study before investigating its effectiveness on the schizophrenia patients' ability of emotion perception. The purpose of this study is to describe the usability evaluation for a web-based game set that has been designed to teach facial expressions to schizophrenic patients. The usability study was done at two steps; first, we applied heuristic evaluation and the violations were rated in a scale from most to least severe and the major problems were solved. In the second step, think-aloud method was used and the web site was assessed by five schizophrenic patients. Eight experts participated in the heuristic evaluation, in which a total of 60 violations were identified with a mean severity of 2.77 (range: 0-4). All of the major problems (severity over 2.5) were listed and the usability problems were solved by the development team. After solving the problems, five users with a diagnosis of schizophrenia used the web site with the same scenario. They reported to have experienced minor, but different problems. In conclusion, we suggest that a combination of heuristic evaluation and think-aloud method may be an effective and efficient way for usability evaluations for the serious games that have been designed for special patient groups.

The Usability of SEEQ in Quality Evaluation of Arabic Secondary Education in Malaysia

ERIC Educational Resources Information Center

al-Muslim, M.; Arifin, Zamri

2015-01-01

Evaluation of the quality of Arabic education in Malaysia needs to be conducted on a continuous basis to achieve the objectives of Arabic education. Student Evaluation of Education Quality (SEEQ) was proposed as one of the evaluation instruments of the quality of Arabic education. This study aimed to evaluate the usability of SEEQ in the context…

'Televaluation' of clinical information systems: an integrative approach to assessing Web-based systems.

PubMed

Kushniruk, A W; Patel, C; Patel, V L; Cimino, J J

2001-04-01

The World Wide Web provides an unprecedented opportunity for widespread access to health-care applications by both patients and providers. The development of new methods for assessing the effectiveness and usability of these systems is becoming a critical issue. This paper describes the distance evaluation (i.e. 'televaluation') of emerging Web-based information technologies. In health informatics evaluation, there is a need for application of new ideas and methods from the fields of cognitive science and usability engineering. A framework is presented for conducting evaluations of health-care information technologies that integrates a number of methods, ranging from deployment of on-line questionnaires (and Web-based forms) to remote video-based usability testing of user interactions with clinical information systems. Examples illustrating application of these techniques are presented for the assessment of a patient clinical information system (PatCIS), as well as an evaluation of use of Web-based clinical guidelines. Issues in designing, prototyping and iteratively refining evaluation components are discussed, along with description of a 'virtual' usability laboratory.

Effect of improving the usability of an e-learning resource: a randomized trial.

PubMed

Davids, Mogamat Razeen; Chikte, Usuf M E; Halperin, Mitchell L

2014-06-01

Optimizing the usability of e-learning materials is necessary to reduce extraneous cognitive load and maximize their potential educational impact. However, this is often neglected, especially when time and other resources are limited. We conducted a randomized trial to investigate whether a usability evaluation of our multimedia e-learning resource, followed by fixing of all problems identified, would translate into improvements in usability parameters and learning by medical residents. Two iterations of our e-learning resource [version 1 (V1) and version 2 (V2)] were compared. V1 was the first fully functional version and V2 was the revised version after all identified usability problems were addressed. Residents in internal medicine and anesthesiology were randomly assigned to one of the versions. Usability was evaluated by having participants complete a user satisfaction questionnaire and by recording and analyzing their interactions with the application. The effect on learning was assessed by questions designed to test the retention and transfer of knowledge. Participants reported high levels of satisfaction with both versions, with good ratings on the System Usability Scale and adjective rating scale. In contrast, analysis of video recordings revealed significant differences in the occurrence of serious usability problems between the two versions, in particular in the interactive HandsOn case with its treatment simulation, where there was a median of five serious problem instances (range: 0-50) recorded per participant for V1 and zero instances (range: 0-1) for V2 (P < 0.001). There were no differences in tests of retention or transfer of knowledge between the two versions. In conclusion, usability evaluation followed by a redesign of our e-learning resource resulted in significant improvements in usability. This is likely to translate into improved motivation and willingness to engage with the learning material. In this population of relatively high-knowledge participants, learning scores were similar across the two versions. Copyright © 2014 The American Physiological Society.

Effect of improving the usability of an e-learning resource: a randomized trial

PubMed Central

Chikte, Usuf M. E.; Halperin, Mitchell L.

2014-01-01

Optimizing the usability of e-learning materials is necessary to reduce extraneous cognitive load and maximize their potential educational impact. However, this is often neglected, especially when time and other resources are limited. We conducted a randomized trial to investigate whether a usability evaluation of our multimedia e-learning resource, followed by fixing of all problems identified, would translate into improvements in usability parameters and learning by medical residents. Two iterations of our e-learning resource [version 1 (V1) and version 2 (V2)] were compared. V1 was the first fully functional version and V2 was the revised version after all identified usability problems were addressed. Residents in internal medicine and anesthesiology were randomly assigned to one of the versions. Usability was evaluated by having participants complete a user satisfaction questionnaire and by recording and analyzing their interactions with the application. The effect on learning was assessed by questions designed to test the retention and transfer of knowledge. Participants reported high levels of satisfaction with both versions, with good ratings on the System Usability Scale and adjective rating scale. In contrast, analysis of video recordings revealed significant differences in the occurrence of serious usability problems between the two versions, in particular in the interactive HandsOn case with its treatment simulation, where there was a median of five serious problem instances (range: 0–50) recorded per participant for V1 and zero instances (range: 0–1) for V2 (P < 0.001). There were no differences in tests of retention or transfer of knowledge between the two versions. In conclusion, usability evaluation followed by a redesign of our e-learning resource resulted in significant improvements in usability. This is likely to translate into improved motivation and willingness to engage with the learning material. In this population of relatively high-knowledge participants, learning scores were similar across the two versions. PMID:24913451

Minimum tailwater flows in relation to habitat suitability and sport-fish harvest

USGS Publications Warehouse

Jacobs, K.E.; Swink, W.D.; Novotny, J.F.

1987-01-01

The instream flow needs of four sport fishes (rainbow trout Salmo gairdneri, channel catfish Ictalurus punctatus, smallmouth bass Micropterus dolomieui, and white crappie Pomoxis annularis) were evaluated in the tailwater below Green River Lake, Kentucky. The Newcombe method, a simple procedure developed in British Columbia that is based on the distribution of water depths and velocities at various flows, was used to predict usable habitat at seven flows. Predicted usable habitat was two to six times greater for rainbow trout than for any of the other species at all flows. Angler harvest corresponded to the predicted abundance for rainbow trout and smallmouth bass, but the catch of channel catfish and white crappies was seasonally greater than expected. The presence of the dam and reservoir apparently disrupted the normal movement and feeding patterns of these species and periodically overrode the relation between usable habitat and abundance assumed in the Newcombe method. The year-round minimum flow of 4.6 m 3/s recommended for the tailwater would generally increase the amount of habitat available in the tailwater from April through October, and the minimum flow of 2.4 m3/s recommended for periods of drought would allow the maintenance of a trout fishery.

INCOMMANDS TDP: Human Factors Evaluation of the Command Decision Support Capability Prototype

DTIC Science & Technology

2009-03-01

CDSC) design with guidelines and principles stipulated in the INCOMMANDS TDP Human Factors Design and Evaluation Guide. 2. Usability and Utility...INCOMMANDS CDSC. The Heuristic Evaluation helps to ensure that the design of system is compliant with HCI best practices. Whereas the Usability and...implemented to confirm compliance with the INCOMMANDS TDP Human Factors Design and Evaluation Guide

Development and evaluation of RAMP I - a practitioner's tool for screening of musculoskeletal disorder risk factors in manual handling.

PubMed

Lind, Carl Mikael; Forsman, Mikael; Rose, Linda Maria

2017-10-16

RAMP I is a screening tool developed to support practitioners in screening for work-related musculoskeletal disorder risk factors related to manual handling. RAMP I, which is part of the RAMP tool, is based on research-based studies combined with expert group judgments. More than 80 practitioners participated in the development of RAMP I. The tool consists of dichotomous assessment items grouped into seven categories. Acceptable reliability was found for a majority of the assessment items for 15 practitioners who were given 1 h of training. The usability evaluation points to RAMP I being usable for screening for musculoskeletal disorder risk factors, i.e., usable for assessing risks, being usable as a decision base, having clear results and that the time needed for an assessment is acceptable. It is concluded that RAMP I is a usable tool for practitioners.

Usability evaluation of an emergency department information system prototype designed using cognitive systems engineering techniques.

PubMed

Clark, Lindsey N; Benda, Natalie C; Hegde, Sudeep; McGeorge, Nicolette M; Guarrera-Schick, Theresa K; Hettinger, A Zachary; LaVergne, David T; Perry, Shawna J; Wears, Robert L; Fairbanks, Rollin J; Bisantz, Ann M

2017-04-01

This article presents an evaluation of novel display concepts for an emergency department information system (EDIS) designed using cognitive systems engineering methods. EDISs assist emergency medicine staff with tracking patient care and ED resource allocation. Participants performed patient planning and orientation tasks using the EDIS displays and rated the display's ability to support various cognitive performance objectives along with the usability, usefulness, and predicted frequency of use for 18 system components. Mean ratings were positive for cognitive performance support objectives, usability, usefulness, and frequency of use, demonstrating the successful application of design methods to create useful and usable EDIS concepts that provide cognitive support for emergency medicine staff. Nurse and provider roles had significantly different perceptions of the usability and usefulness of certain EDIS components, suggesting that they have different information needs while working. Copyright © 2016 Elsevier Ltd. All rights reserved.

Using a medical simulation center as an electronic health record usability laboratory

PubMed Central

Landman, Adam B; Redden, Lisa; Neri, Pamela; Poole, Stephen; Horsky, Jan; Raja, Ali S; Pozner, Charles N; Schiff, Gordon; Poon, Eric G

2014-01-01

Usability testing is increasingly being recognized as a way to increase the usability and safety of health information technology (HIT). Medical simulation centers can serve as testing environments for HIT usability studies. We integrated the quality assurance version of our emergency department (ED) electronic health record (EHR) into our medical simulation center and piloted a clinical care scenario in which emergency medicine resident physicians evaluated a simulated ED patient and documented electronically using the ED EHR. Meticulous planning and close collaboration with expert simulation staff was important for designing test scenarios, pilot testing, and running the sessions. Similarly, working with information systems teams was important for integration of the EHR. Electronic tools are needed to facilitate entry of fictitious clinical results while the simulation scenario is unfolding. EHRs can be successfully integrated into existing simulation centers, which may provide realistic environments for usability testing, training, and evaluation of human–computer interactions. PMID:24249778

Usability evaluation of an emergency department information system prototype designed using cognitive systems engineering techniques

PubMed Central

Clark, Lindsey N.; Benda, Natalie C.; Hegde, Sudeep; McGeorge, Nicolette M.; Guarrera-Schick, Theresa K.; Hettinger, A. Zachary; LaVergne, David T.; Perry, Shawna J.; Wears, Robert L.; Fairbanks, Rollin J.; Bisantz, Ann M.

2017-01-01

This article presents an evaluation of novel display concepts for an emergency department information system (EDIS) designed using cognitive systems engineering methods. EDISs assist emergency medicine staff with tracking patient care and ED resource allocation. Participants performed patient planning and orientation tasks using the EDIS displays and rated the display’s ability to support various cognitive performance objectives along with the usability, usefulness, and predicted frequency of use for 18 system components. Mean ratings were positive for cognitive performance support objectives, usability, usefulness, and frequency of use, demonstrating the successful application of design methods to create useful and usable EDIS concepts that provide cognitive support for emergency medicine staff. Nurse and provider roles had significantly different perceptions of the usability and usefulness of certain EDIS components, suggesting that they have different information needs while working. PMID:28166896

Usability Evaluation Methods for Gesture-Based Games: A Systematic Review.

PubMed

Simor, Fernando Winckler; Brum, Manoela Rogofski; Schmidt, Jaison Dairon Ebertz; Rieder, Rafael; De Marchi, Ana Carolina Bertoletti

2016-10-04

Gestural interaction systems are increasingly being used, mainly in games, expanding the idea of entertainment and providing experiences with the purpose of promoting better physical and/or mental health. Therefore, it is necessary to establish mechanisms for evaluating the usability of these interfaces, which make gestures the basis of interaction, to achieve a balance between functionality and ease of use. This study aims to present the results of a systematic review focused on usability evaluation methods for gesture-based games, considering devices with motion-sensing capability. We considered the usability methods used, the common interface issues, and the strategies adopted to build good gesture-based games. The research was centered on four electronic databases: IEEE, Association for Computing Machinery (ACM), Springer, and Science Direct from September 4 to 21, 2015. Within 1427 studies evaluated, 10 matched the eligibility criteria. As a requirement, we considered studies about gesture-based games, Kinect and/or Wii as devices, and the use of a usability method to evaluate the user interface. In the 10 studies found, there was no standardization in the methods because they considered diverse analysis variables. Heterogeneously, authors used different instruments to evaluate gesture-based interfaces and no default approach was proposed. Questionnaires were the most used instruments (70%, 7/10), followed by interviews (30%, 3/10), and observation and video recording (20%, 2/10). Moreover, 60% (6/10) of the studies used gesture-based serious games to evaluate the performance of elderly participants in rehabilitation tasks. This highlights the need for creating an evaluation protocol for older adults to provide a user-friendly interface according to the user's age and limitations. Through this study, we conclude this field is in need of a usability evaluation method for serious games, especially games for older adults, and that the definition of a methodology and a test protocol may offer the user more comfort, welfare, and confidence.

Usability Evaluation Methods for Gesture-Based Games: A Systematic Review

PubMed Central

Simor, Fernando Winckler; Brum, Manoela Rogofski; Schmidt, Jaison Dairon Ebertz; De Marchi, Ana Carolina Bertoletti

2016-01-01

Background Gestural interaction systems are increasingly being used, mainly in games, expanding the idea of entertainment and providing experiences with the purpose of promoting better physical and/or mental health. Therefore, it is necessary to establish mechanisms for evaluating the usability of these interfaces, which make gestures the basis of interaction, to achieve a balance between functionality and ease of use. Objective This study aims to present the results of a systematic review focused on usability evaluation methods for gesture-based games, considering devices with motion-sensing capability. We considered the usability methods used, the common interface issues, and the strategies adopted to build good gesture-based games. Methods The research was centered on four electronic databases: IEEE, Association for Computing Machinery (ACM), Springer, and Science Direct from September 4 to 21, 2015. Within 1427 studies evaluated, 10 matched the eligibility criteria. As a requirement, we considered studies about gesture-based games, Kinect and/or Wii as devices, and the use of a usability method to evaluate the user interface. Results In the 10 studies found, there was no standardization in the methods because they considered diverse analysis variables. Heterogeneously, authors used different instruments to evaluate gesture-based interfaces and no default approach was proposed. Questionnaires were the most used instruments (70%, 7/10), followed by interviews (30%, 3/10), and observation and video recording (20%, 2/10). Moreover, 60% (6/10) of the studies used gesture-based serious games to evaluate the performance of elderly participants in rehabilitation tasks. This highlights the need for creating an evaluation protocol for older adults to provide a user-friendly interface according to the user’s age and limitations. Conclusions Through this study, we conclude this field is in need of a usability evaluation method for serious games, especially games for older adults, and that the definition of a methodology and a test protocol may offer the user more comfort, welfare, and confidence. PMID:27702737

Usability Evaluation and Implementation of a Health Information Technology Dashboard of Evidence-Based Quality Indicators.

PubMed

Schall, Mark Christopher; Cullen, Laura; Pennathur, Priyadarshini; Chen, Howard; Burrell, Keith; Matthews, Grace

2017-06-01

Health information technology dashboards that integrate evidence-based quality indicators can efficiently and accurately display patient risk information to promote early intervention and improve overall quality of patient care. We describe the process of developing, evaluating, and implementing a dashboard designed to promote quality care through display of evidence-based quality indicators within an electronic health record. Clinician feedback was sought throughout the process. Usability evaluations were provided by three nurse pairs and one physician from medical-surgical areas. Task completion times, error rates, and ratings of system usability were collected to compare the use of quality indicators displayed on the dashboard to the indicators displayed in a conventional electronic health record across eight experimental scenarios. Participants rated the dashboard as "highly usable" following System Usability Scale (mean, 87.5 [SD, 9.6]) and Poststudy System Usability Questionnaire (mean, 1.7 [SD, 0.5]) criteria. Use of the dashboard led to reduced task completion times and error rates in comparison to the conventional electronic health record for quality indicator-related tasks. Clinician responses to the dashboard display capabilities were positive, and a multifaceted implementation plan has been used. Results suggest application of the dashboard in the care environment may lead to improved patient care.

Quality and Usability of Arthritic Pain Self-Management Apps for Older Adults: A Systematic Review.

PubMed

Bhattarai, Priyanka; Newton-John, T R O; Phillips, Jane L

2018-03-01

To appraise the quality and usability of currently available pain applications that could be used by community-dwelling older adults to self-manage their arthritic pain. A systematic review. Searches were conducted in App Store and Google Play to identify pain self-management apps relevant to arthritic pain management. English language pain management apps providing pain assessment and documentation function and pain management education were considered for inclusion. A quality evaluation audit tool based on the Stanford Arthritis Self-Management Program was developed a priori to evaluate app content quality. The usability of included apps was assessed using an established usability evaluation tool. Out of the 373 apps that were identified, four met the inclusion criteria. The included apps all included a pain assessment and documentation function and instructions on medication use, communication with health professionals, cognitive behavioral therapy-based pain management, and physical exercise. Management of mood, depression, anxiety, and sleep were featured in most apps (N = 3). Three-quarters (N = 3) of the apps fell below the acceptable moderate usability score (≥3), while one app obtained a moderate score (3.2). Few of the currently available pain apps offer a comprehensive pain self-management approach incorporating evidence-based strategies in accordance with the Stanford Arthritis Self-Management Program. The moderate-level usability across the included apps indicates a need to consider the usability needs of the older population in future pain self-management app development endeavors.

A framework for evaluating electronic health record vendor user-centered design and usability testing processes.

PubMed

Ratwani, Raj M; Zachary Hettinger, A; Kosydar, Allison; Fairbanks, Rollin J; Hodgkins, Michael L

2017-04-01

Currently, there are few resources for electronic health record (EHR) purchasers and end users to understand the usability processes employed by EHR vendors during product design and development. We developed a framework, based on human factors literature and industry standards, to systematically evaluate the user-centered design processes and usability testing methods used by EHR vendors. We reviewed current usability certification requirements and the human factors literature to develop a 15-point framework for evaluating EHR products. The framework is based on 3 dimensions: user-centered design process, summative testing methodology, and summative testing results. Two vendor usability reports were retrieved from the Office of the National Coordinator's Certified Health IT Product List and were evaluated using the framework. One vendor scored low on the framework (5 pts) while the other vendor scored high on the framework (15 pts). The 2 scored vendor reports demonstrate the framework's ability to discriminate between the variabilities in vendor processes and to determine which vendors are meeting best practices. The framework provides a method to more easily comprehend EHR vendors' usability processes and serves to highlight where EHR vendors may be falling short in terms of best practices. The framework provides a greater level of transparency for both purchasers and end users of EHRs. The framework highlights the need for clearer certification requirements and suggests that the authorized certification bodies that examine vendor usability reports may need to be provided with clearer guidance. © The Author 2016. Published by Oxford University Press on behalf of the American Medical Informatics Association. All rights reserved. For Permissions, please email: journals.permissions@oup.com

Safety and usability evaluation of a web-based insulin self-titration system for patients with type 2 diabetes mellitus.

PubMed

Simon, Airin C R; Holleman, Frits; Gude, Wouter T; Hoekstra, Joost B L; Peute, Linda W; Jaspers, Monique W M; Peek, Niels

2013-09-01

The rising incidence of type 2 diabetes mellitus (T2DM) induces severe challenges for the health care system. Our research group developed a web-based system named PANDIT that provides T2DM patients with insulin dosing advice using state of the art clinical decision support technology. The PANDIT interface resembles a glucose diary and provides advice through pop-up messages. Diabetes nurses (DNs) also have access to the system, allowing them to intervene when needed. The objective of this study was to establish whether T2DM patients can safely use PANDIT at home. To this end, we assessed whether patients experience usability problems with a high risk of compromising patient safety when interacting with the system, and whether PANDIT's insulin dosing advice are clinically safe. The study population consisted of patients with T2DM (aged 18-80) who used a once daily basal insulin as well as DNs from a university hospital. The usability evaluation consisted of think-aloud sessions with four patients and three DNs. Video data, audio data and verbal utterances were analyzed for usability problems encountered during PANDIT interactions. Usability problems were rated by a physician and a usability expert according to their potential impact on patient safety. The usability evaluation was followed by an implementation with a duration of four weeks. This implementation took place at the patients' homes with ten patients to evaluate clinical safety of PANDIT advice. PANDIT advice were systematically compared with DN advice. Deviating advice were evaluated with respect to patient safety by a panel of experienced physicians, which specialized in diabetes care. We detected seventeen unique usability problems, none of which was judged to have a high risk of compromising patient safety. Most usability problems concerned the lay-out of the diary, which did not clearly indicate which data entry fields had to be entered in order to obtain an advice. 27 out of 74 (36.5%) PANDIT advice differed from those provided by DNs. However, only one of these (1.4%) was considered unsafe by the panel. T2DM patients with no prior experience with the web-based self-management system were capable of consulting the system without encountering significant usability problems. Furthermore, the large majority of PANDIT advice were considered clinically safe according to the expert panel. One advice was considered unsafe. This could however easily be corrected by implementing a small modification to the system's knowledge base. Copyright © 2013 Elsevier B.V. All rights reserved.

Reproducibility of tumor motion probability distribution function in stereotactic body radiation therapy of lung cancer.

PubMed

Zhang, Fan; Hu, Jing; Kelsey, Chris R; Yoo, David; Yin, Fang-Fang; Cai, Jing

2012-11-01

To evaluate the reproducibility of tumor motion probability distribution function (PDF) in stereotactic body radiation therapy (SBRT) of lung cancer using cine megavoltage (MV) images. Cine MV images of 20 patients acquired during three-dimensional conformal (6-11 beams) SBRT treatments were retrospectively analyzed to extract tumor motion trajectories. For each patient, tumor motion PDFs were generated per fraction (PDF(n)) using three selected "usable" beams. Patients without at least three usable beams were excluded from the study. Fractional PDF reproducibility (R(n)) was calculated as the Dice similarity coefficient between PDF(n) to a "ground-truth" PDF (PDF(g)), which was generated using the selected beams of all fractions. The mean of R(n), labeled as R(m), was calculated for each patient and correlated to the patient's mean tumor motion rang (A(m)). Change of R(m) during the course of SBRT treatments was also evaluated. Intra- and intersubject coefficient of variation (CV) of R(m) and A(m) were determined. Thirteen patients had at least three usable beams and were analyzed. The mean of R(m) was 0.87 (range, 0.84-0.95). The mean of A(m) was 3.18 mm (range, 0.46-7.80 mm). R(m) was found to decrease as A(m) increases following an equation of R(m) = 0.17e(-0.9Am) + 0.84. R(m) also decreased slightly throughout the course of treatments. Intersubject CV of R(m) (0.05) was comparable to intrasubject CV of R(m) (range, 0.02-0.09); intersubject CV of A(m) (0.73) was significantly greater than intrasubject CV of A(m) (range, 0.09-0.24). Tumor motion PDF can be determined using cine MV images acquired during the treatments. The reproducibility of lung tumor motion PDF decreased exponentially as the tumor motion range increased and decreased slightly throughout the course of the treatments. Copyright © 2012 Elsevier Inc. All rights reserved.

Usability Evaluation of Public Web Mapping Sites

NASA Astrophysics Data System (ADS)

Wang, C.

2014-04-01

Web mapping sites are interactive maps that are accessed via Webpages. With the rapid development of Internet and Geographic Information System (GIS) field, public web mapping sites are not foreign to people. Nowadays, people use these web mapping sites for various reasons, in that increasing maps and related map services of web mapping sites are freely available for end users. Thus, increased users of web mapping sites led to more usability studies. Usability Engineering (UE), for instance, is an approach for analyzing and improving the usability of websites through examining and evaluating an interface. In this research, UE method was employed to explore usability problems of four public web mapping sites, analyze the problems quantitatively and provide guidelines for future design based on the test results. Firstly, the development progress for usability studies were described, and simultaneously several usability evaluation methods such as Usability Engineering (UE), User-Centered Design (UCD) and Human-Computer Interaction (HCI) were generally introduced. Then the method and procedure of experiments for the usability test were presented in detail. In this usability evaluation experiment, four public web mapping sites (Google Maps, Bing maps, Mapquest, Yahoo Maps) were chosen as the testing websites. And 42 people, who having different GIS skills (test users or experts), gender (male or female), age and nationality, participated in this test to complete the several test tasks in different teams. The test comprised three parts: a pretest background information questionnaire, several test tasks for quantitative statistics and progress analysis, and a posttest questionnaire. The pretest and posttest questionnaires focused on gaining the verbal explanation of their actions qualitatively. And the design for test tasks targeted at gathering quantitative data for the errors and problems of the websites. Then, the results mainly from the test part were analyzed. The success rate from different public web mapping sites was calculated and compared, and displayed by the means of diagram. And the answers from questionnaires were also classified and organized in this part. Moreover, based on the analysis, this paper expands the discussion about the layout, map visualization, map tools, search logic and etc. Finally, this paper closed with some valuable guidelines and suggestions for the design of public web mapping sites. Also, limitations for this research stated in the end.

A Usability Study of Users’ Perceptions Toward a Multimedia Computer-Assisted Learning Tool for Neuroanatomy

PubMed Central

Gould, Douglas J.; Terrell, Mark A.; Fleming, Jo

2015-01-01

This usability study evaluated users’ perceptions of a multimedia prototype for a new e-learning tool: Anatomy of the Central Nervous System: A Multimedia Course. Usability testing is a collection of formative evaluation methods that inform the developmental design of e-learning tools to maximize user acceptance, satisfaction, and adoption. Sixty-two study participants piloted the prototype and completed a usability questionnaire designed to measure two usability properties: program need and program applicability. Statistical analyses were used to test the hypothesis that the multimedia prototype was well designed and highly usable, it was perceived as: 1) highly needed across a spectrum of educational contexts, 2) highly applicable in supporting the pedagogical processes of teaching and learning neuroanatomy, and 3) was highly usable by all types of users. Three independent variables represented user differences: level of expertise (faculty vs. student), age, and gender. Analysis of the results supports the research hypotheses that the prototype was designed well for different types of users in various educational contexts and for supporting the pedagogy of neuroanatomy. In addition, the results suggest that the multimedia program will be most useful as a neuroanatomy review tool for health-professions students preparing for licensing or board exams. This study demonstrates the importance of integrating quality properties of usability with principles of human learning during the instructional design process for multimedia products. PMID:19177405

U.S.A.B.I.L.I.T.Y. Framework for Older Adults.

PubMed

Caboral-Stevens, Meriam; Whetsell, Martha V; Evangelista, Lorraine S; Cypress, Brigitte; Nickitas, Donna

2015-01-01

The purpose of the current study was to present a framework to determine potential usability of health websites by older adults. Review of the literature showed paucity of nursing theory related to the use of technology and usability, particularly in older adults. The Roy Adaptation Model, a widely used nursing theory, was chosen to provide framework for the new model. Technology constructs from the Technology Acceptance Model and United Theory of Acceptance and Use of Technology and behavioral control construct from the Theory of Planned Behavior were integrated into the construction of the derived model. The Use of Technology for Adaptation by Older Adults and/or Those With Limited Literacy (U.S.A.B.I.L.I.T.Y.) Model was constructed from the integration of diverse theoretical/conceptual perspectives. The four determinants of usability in the conceptual model include (a) efficiency, (b) learnability, (c) perceived user experience, and (d) perceived control. Because of the lack of well-validated survey questionnaires to measure these determinants, a U.S.A.B.I.L.I.T.Y. Survey was developed. A panel of experts evaluated face and content validity of the new instrument. Internal consistency of the new instrument was 0.96. Usability is key to accepting technology. The derived U.S.A.B.I.L.I.T.Y. framework could serve as a guide for nurses in formative evaluation of technology. Copyright 2015, SLACK Incorporated.

Effect of Improving the Usability of an E-Learning Resource: A Randomized Trial

ERIC Educational Resources Information Center

Davids, Mogamat Razeen; Chikte, Usuf M. E.; Halperin, Mitchell L.

2014-01-01

Optimizing the usability of e-learning materials is necessary to reduce extraneous cognitive load and maximize their potential educational impact. However, this is often neglected, especially when time and other resources are limited. We conducted a randomized trial to investigate whether a usability evaluation of our multimedia e-learning…

Internationalization and localization: evaluating and testing a Website for Asian users.

PubMed

Rau, Pei-Luen Patrick; Liang, Sheau-Farn Max

2003-01-15

The objective of this study was to combine internationalization and localization of Websites and improvement of Website usability with user-centred design methods. This study designed for internationalization and localization of Websites for Asian users, and implemented usability engineering into every phase of Website usability testing, based on the internationalization and localization perspectives of the honeywell.com/your home Website. The first step was to develop the usage scenarios. Three Asian usability specialists carried out one heuristic evaluation session for the current honeywell.com/your home Website. The usability problems were analysed and possible solutions to these problems were discussed. In the next phase, cluster analysis was utilized to test current information architecture. The results provided options for future information architecture development for this Website. Finally, a performance measurement test was conducted to investigate the performance for Asian users. Based on the results, suggestions for improving the Website usability from the localization perspective were provided. The results demonstrate the user-centred design (UCD) approach and stress international and local issues in Website development to Website designers.

PROOF OF CONCEPT FOR A HUMAN RELIABILITY ANALYSIS METHOD FOR HEURISTIC USABILITY EVALUATION OF SOFTWARE

DOE Office of Scientific and Technical Information (OSTI.GOV)

Ronald L. Boring; David I. Gertman; Jeffrey C. Joe

2005-09-01

An ongoing issue within human-computer interaction (HCI) is the need for simplified or “discount” methods. The current economic slowdown has necessitated innovative methods that are results driven and cost effective. The myriad methods of design and usability are currently being cost-justified, and new techniques are actively being explored that meet current budgets and needs. Recent efforts in human reliability analysis (HRA) are highlighted by the ten-year development of the Standardized Plant Analysis Risk HRA (SPAR-H) method. The SPAR-H method has been used primarily for determining humancentered risk at nuclear power plants. The SPAR-H method, however, shares task analysis underpinnings withmore » HCI. Despite this methodological overlap, there is currently no HRA approach deployed in heuristic usability evaluation. This paper presents an extension of the existing SPAR-H method to be used as part of heuristic usability evaluation in HCI.« less

Navigation in the electronic health record: A review of the safety and usability literature.

PubMed

Roman, Lisette C; Ancker, Jessica S; Johnson, Stephen B; Senathirajah, Yalini

2017-03-01

Inefficient navigation in electronic health records has been shown to increase users' cognitive load, which may increase potential for errors, reduce efficiency, and increase fatigue. However, navigation has received insufficient recognition and attention in the electronic health record (EHR) literature as an independent construct and contributor to overall usability. Our aims in this literature review were to (1) assess the prevalence of navigation-related topics within the EHR usability and safety research literature, (2) categorize types of navigation actions within the EHR, (3) capture relationships between these navigation actions and usability principles, and (4) collect terms and concepts related to EHR navigation. Our goal was to improve access to navigation-related research in usability. We applied scoping literature review search methods with the assistance of a reference librarian to identify articles published since 1996 that reported evaluation of the usability or safety of an EHR user interface via user test, analytic methods, or inspection methods. The 4336 references collected from MEDLINE, EMBASE, Engineering Village, and expert referrals were de-duplicated and screened for relevance, and navigation-related concepts were abstracted from the 21 articles eligible for review using a standard abstraction form. Of the 21 eligible articles, 20 (95%) mentioned navigation in results and discussion of usability evaluations. Navigation between pages of the EHR was the more frequently documented type of navigation (86%) compared to navigation within a single page (14%). Navigation actions (e.g., scrolling through a medication list) were frequently linked to specific usability heuristic violations, among which flexibility and efficiency of use, recognition rather than recall, and error prevention were most common. Discussion of navigation was prevalent in results across all types of evaluation methods among the articles reviewed. Navigating between multiple screens was frequently identified as a usability barrier. The lack of standard terminology created some challenges to identifying and comparing articles. We observed that usability researchers are frequently capturing navigation-related issues even in articles that did not explicitly state navigation as a focus. Capturing and synthesizing the literature on navigation is challenging because of the lack of uniform vocabulary. Navigation is a potential target for normative recommendations for improved interaction design for safer systems. Future research in this domain, including development of normative recommendations for usability design and evaluation, will be facilitated by development of a standard terminology for describing EHR navigation. Copyright © 2017 Elsevier Inc. All rights reserved.

Optimizing the user interface of a data entry module for an electronic patient record for cardiac rehabilitation: A mixed method usability approach.

PubMed

van Engen-Verheul, Mariëtte M; Peute, Linda W P; de Keizer, Nicolette F; Peek, Niels; Jaspers, Monique W M

2016-03-01

Cumbersome electronic patient record (EPR) interfaces may complicate data-entry in clinical practice. Completeness of data entered in the EPR determines, among other things, the value of computerized clinical decision support (CCDS). Quantitative usability evaluations can provide insight into mismatches between the system design model of data entry and users' data entry behavior, but not into the underlying causes for these mismatches. Mixed method usability evaluation studies may provide these insights, and thus support generating redesign recommendations for improving an EPR system's data entry interface. To improve the usability of the data entry interface of an EPR system with CCDS in the field of cardiac rehabilitation (CR), and additionally, to assess the value of a mixed method usability approach in this context. Seven CR professionals performed a think-aloud usability evaluation both before (beta-version) and after the redesign of the system. Observed usability problems from both evaluations were analyzed and categorized using Zhang et al.'s heuristic principles of good interface design. We combined the think-aloud usability evaluation of the system's beta-version with the measurement of a new usability construct: users' deviations in action sequence from the system's predefined data entry order sequence. Recommendations for redesign were implemented. We assessed whether the redesign improved CR professionals' (1) task efficacy (with respect to the completeness of data they collected), and (2) task efficiency (with respect to the average number of mouse clicks they needed to complete data entry subtasks). With the system's beta version, 40% of health care professionals' navigation actions through the system deviated from the predefined next system action. The causes for these deviations as revealed by the think-aloud method mostly concerned mismatches between the system design model for data entry action sequences and users expectations of these action sequences, based on their paper-based daily routines. This caused non completion of data entry tasks (31% of main tasks completed), and more navigation actions than minimally required (146% of the minimum required). In the redesigned system the data entry navigational structure was organized in a flexible way around an overview screen to better mimic users' paper-based daily routines of collecting patient data. This redesign resulted in an increased number of completed main tasks (70%) and a decrease in navigation actions (133% of the minimum required). The think-aloud usability evaluation of the redesigned system showed that remaining problems concerned flexibility (e.g., lack of customization options) and consistency (mainly with layout and position of items on the screen). The mixed method usability evaluation was supportive in revealing the magnitude and causes of mismatches between the system design model of data-entry with users' data entry behavior. However, as both task efficacy and efficiency were still not optimal with the redesigned EPR, we advise to perform a cognitive analysis on end users' mental processes and behavior patterns in daily work processes specifically during the requirements analysis phase of development of interactive healthcare information systems. Copyright © 2015 Elsevier Ireland Ltd. All rights reserved.

Audited credential delegation: a usable security solution for the virtual physiological human toolkit.

PubMed

Haidar, Ali N; Zasada, Stefan J; Coveney, Peter V; Abdallah, Ali E; Beckles, Bruce; Jones, Mike A S

2011-06-06

We present applications of audited credential delegation (ACD), a usable security solution for authentication, authorization and auditing in distributed virtual physiological human (VPH) project environments that removes the use of digital certificates from end-users' experience. Current security solutions are based on public key infrastructure (PKI). While PKI offers strong security for VPH projects, it suffers from serious usability shortcomings in terms of end-user acquisition and management of credentials which deter scientists from exploiting distributed VPH environments. By contrast, ACD supports the use of local credentials. Currently, a local ACD username-password combination can be used to access grid-based resources while Shibboleth support is underway. Moreover, ACD provides seamless and secure access to shared patient data, tools and infrastructure, thus supporting the provision of personalized medicine for patients, scientists and clinicians participating in e-health projects from a local to the widest international scale.

Audited credential delegation: a usable security solution for the virtual physiological human toolkit

PubMed Central

Haidar, Ali N.; Zasada, Stefan J.; Coveney, Peter V.; Abdallah, Ali E.; Beckles, Bruce; Jones, Mike A. S.

2011-01-01

We present applications of audited credential delegation (ACD), a usable security solution for authentication, authorization and auditing in distributed virtual physiological human (VPH) project environments that removes the use of digital certificates from end-users' experience. Current security solutions are based on public key infrastructure (PKI). While PKI offers strong security for VPH projects, it suffers from serious usability shortcomings in terms of end-user acquisition and management of credentials which deter scientists from exploiting distributed VPH environments. By contrast, ACD supports the use of local credentials. Currently, a local ACD username–password combination can be used to access grid-based resources while Shibboleth support is underway. Moreover, ACD provides seamless and secure access to shared patient data, tools and infrastructure, thus supporting the provision of personalized medicine for patients, scientists and clinicians participating in e-health projects from a local to the widest international scale. PMID:22670214

VRUSE--a computerised diagnostic tool: for usability evaluation of virtual/synthetic environment systems.

PubMed

Kalawsky, R S

1999-02-01

A special questionnaire (VRUSE) has been designed to measure the usability of a VR system according to the attitude and perception of its users. Important aspects of VR systems were carefully derived to produce key usability factors for the questionnaire. Unlike questionnaires designed for generic interfaces VRUSE is specifically designed to cater for evaluating virtual environments, being a diagnostic tool providing a wealth of information about a user's viewpoint of the interface. VRUSE can be used to great effect with other evaluation techniques to pinpoint problematical areas of a VR interface. Other applications include bench-marking of competitor VR systems.

Assessing the Potential Use of Eye-Tracking Triangulation for Evaluating the Usability of an Online Diabetes Exercise System.

PubMed

Schaarup, Clara; Hartvigsen, Gunnar; Larsen, Lars Bo; Tan, Zheng-Hua; Årsand, Eirik; Hejlesen, Ole Kristian

2015-01-01

The Online Diabetes Exercise System was developed to motivate people with Type 2 diabetes to do a 25 minutes low-volume high-intensity interval training program. In a previous multi-method evaluation of the system, several usability issues were identified and corrected. Despite the thorough testing, it was unclear whether all usability problems had been identified using the multi-method evaluation. Our hypothesis was that adding the eye-tracking triangulation to the multi-method evaluation would increase the accuracy and completeness when testing the usability of the system. The study design was an Eye-tracking Triangulation; conventional eye-tracking with predefined tasks followed by The Post-Experience Eye-Tracked Protocol (PEEP). Six Areas of Interests were the basis for the PEEP-session. The eye-tracking triangulation gave objective and subjective results, which are believed to be highly relevant for designing, implementing, evaluating and optimizing systems in the field of health informatics. Future work should include testing the method on a larger and more representative group of users and apply the method on different system types.

The use of fault reporting of medical equipment to identify latent design flaws.

PubMed

Flewwelling, C J; Easty, A C; Vicente, K J; Cafazzo, J A

2014-10-01

Poor device design that fails to adequately account for user needs, cognition, and behavior is often responsible for use errors resulting in adverse events. This poor device design is also often latent, and could be responsible for "No Fault Found" (NFF) reporting, in which medical devices sent for repair by clinical users are found to be operating as intended. Unresolved NFF reports may contribute to incident under reporting, clinical user frustration, and biomedical engineering technologist inefficacy. This study uses human factors engineering methods to investigate the relationship between NFF reporting frequency and device usability. An analysis of medical equipment maintenance data was conducted to identify devices with a high NFF reporting frequency. Subsequently, semi-structured interviews and heuristic evaluations were performed in order to identify potential usability issues. Finally, usability testing was conducted in order to validate that latent usability related design faults result in a higher frequency of NFF reporting. The analysis of medical equipment maintenance data identified six devices with a high NFF reporting frequency. Semi-structured interviews, heuristic evaluations and usability testing revealed that usability issues caused a significant portion of the NFF reports. Other factors suspected to contribute to increased NFF reporting include accessory issues, intermittent faults and environmental issues. Usability testing conducted on three of the devices revealed 23 latent usability related design faults. These findings demonstrate that latent usability related design faults manifest themselves as an increase in NFF reporting and that devices containing usability related design faults can be identified through an analysis of medical equipment maintenance data. Copyright © 2014 The Authors. Published by Elsevier Inc. All rights reserved.

Health Information Technology Usability Evaluation Scale (Health-ITUES) for Usability Assessment of Mobile Health Technology: Validation Study.

PubMed

Schnall, Rebecca; Cho, Hwayoung; Liu, Jianfang

2018-01-05

Mobile technology has become a ubiquitous technology and can be particularly useful in the delivery of health interventions. This technology can allow us to deliver interventions to scale, cover broad geographic areas, and deliver technologies in highly tailored ways based on the preferences or characteristics of users. The broad use of mobile technologies supports the need for usability assessments of these tools. Although there have been a number of usability assessment instruments developed, none have been validated for use with mobile technologies. The goal of this work was to validate the Health Information Technology Usability Evaluation Scale (Health-ITUES), a customizable usability assessment instrument in a sample of community-dwelling adults who were testing the use of a new mobile health (mHealth) technology. A sample of 92 community-dwelling adults living with HIV used a new mobile app for symptom self-management and completed the Health-ITUES to assess the usability of the app. They also completed the Post-Study System Usability Questionnaire (PSSUQ), a widely used and well-validated usability assessment tool. Correlations between these scales and each of the subscales were assessed. The subscales of the Health-ITUES showed high internal consistency reliability (Cronbach alpha=.85-.92). Each of the Health-ITUES subscales and the overall scale was moderately to strongly correlated with the PSSUQ scales (r=.46-.70), demonstrating the criterion validity of the Health-ITUES. The Health-ITUES has demonstrated reliability and validity for use in assessing the usability of mHealth technologies in community-dwelling adults living with a chronic illness. ©Rebecca Schnall, Hwayoung Cho, Jianfang Liu. Originally published in JMIR Mhealth and Uhealth (http://mhealth.jmir.org), 05.01.2018.

Health Information Technology Usability Evaluation Scale (Health-ITUES) for Usability Assessment of Mobile Health Technology: Validation Study

PubMed Central

Cho, Hwayoung; Liu, Jianfang

2018-01-01

Background Mobile technology has become a ubiquitous technology and can be particularly useful in the delivery of health interventions. This technology can allow us to deliver interventions to scale, cover broad geographic areas, and deliver technologies in highly tailored ways based on the preferences or characteristics of users. The broad use of mobile technologies supports the need for usability assessments of these tools. Although there have been a number of usability assessment instruments developed, none have been validated for use with mobile technologies. Objective The goal of this work was to validate the Health Information Technology Usability Evaluation Scale (Health-ITUES), a customizable usability assessment instrument in a sample of community-dwelling adults who were testing the use of a new mobile health (mHealth) technology. Methods A sample of 92 community-dwelling adults living with HIV used a new mobile app for symptom self-management and completed the Health-ITUES to assess the usability of the app. They also completed the Post-Study System Usability Questionnaire (PSSUQ), a widely used and well-validated usability assessment tool. Correlations between these scales and each of the subscales were assessed. Results The subscales of the Health-ITUES showed high internal consistency reliability (Cronbach alpha=.85-.92). Each of the Health-ITUES subscales and the overall scale was moderately to strongly correlated with the PSSUQ scales (r=.46-.70), demonstrating the criterion validity of the Health-ITUES. Conclusions The Health-ITUES has demonstrated reliability and validity for use in assessing the usability of mHealth technologies in community-dwelling adults living with a chronic illness. PMID:29305343

Web usability evaluation with screen reader users: implementation of the partial concurrent thinking aloud technique.

PubMed

Federici, Stefano; Stefano, Federici; Borsci, Simone; Stamerra, Gianluca

2010-08-01

A verbal protocol technique, adopted for a web usability evaluation, requires that the users are able to perform a double task: surfing and talking. Nevertheless, when blind users surf by using a screen reader and talk about the way they interact with the computer, the evaluation is influenced by a structural interference: users are forced to think aloud and listen to the screen reader at the same time. The aim of this study is to build up a verbal protocol technique for samples of visual impaired users in order to overcome the limits of concurrent and retrospective protocols. The technique we improved, called partial concurrent thinking aloud (PCTA), integrates a modified set of concurrent verbalization and retrospective analysis. One group of 6 blind users and another group of 6 sighted users evaluated the usability of a website using PCTA. By estimating the number of necessary users by the means of an asymptotic test, it was found out that the two groups had an equivalent ability of identifying usability problems, both over 80%. The result suggests that PCTA, while respecting the properties of classic verbal protocols, also allows to overcome the structural interference and the limits of concurrent and retrospective protocols when used with screen reader users. In this way, PCTA reduces the efficiency difference of usability evaluation between blind and sighted users.

Evaluation of user interface and workflow design of a bedside nursing clinical decision support system.

PubMed

Yuan, Michael Juntao; Finley, George Mike; Long, Ju; Mills, Christy; Johnson, Ron Kim

2013-01-31

Clinical decision support systems (CDSS) are important tools to improve health care outcomes and reduce preventable medical adverse events. However, the effectiveness and success of CDSS depend on their implementation context and usability in complex health care settings. As a result, usability design and validation, especially in real world clinical settings, are crucial aspects of successful CDSS implementations. Our objective was to develop a novel CDSS to help frontline nurses better manage critical symptom changes in hospitalized patients, hence reducing preventable failure to rescue cases. A robust user interface and implementation strategy that fit into existing workflows was key for the success of the CDSS. Guided by a formal usability evaluation framework, UFuRT (user, function, representation, and task analysis), we developed a high-level specification of the product that captures key usability requirements and is flexible to implement. We interviewed users of the proposed CDSS to identify requirements, listed functions, and operations the system must perform. We then designed visual and workflow representations of the product to perform the operations. The user interface and workflow design were evaluated via heuristic and end user performance evaluation. The heuristic evaluation was done after the first prototype, and its results were incorporated into the product before the end user evaluation was conducted. First, we recruited 4 evaluators with strong domain expertise to study the initial prototype. Heuristic violations were coded and rated for severity. Second, after development of the system, we assembled a panel of nurses, consisting of 3 licensed vocational nurses and 7 registered nurses, to evaluate the user interface and workflow via simulated use cases. We recorded whether each session was successfully completed and its completion time. Each nurse was asked to use the National Aeronautics and Space Administration (NASA) Task Load Index to self-evaluate the amount of cognitive and physical burden associated with using the device. A total of 83 heuristic violations were identified in the studies. The distribution of the heuristic violations and their average severity are reported. The nurse evaluators successfully completed all 30 sessions of the performance evaluations. All nurses were able to use the device after a single training session. On average, the nurses took 111 seconds (SD 30 seconds) to complete the simulated task. The NASA Task Load Index results indicated that the work overhead on the nurses was low. In fact, most of the burden measures were consistent with zero. The only potentially significant burden was temporal demand, which was consistent with the primary use case of the tool. The evaluation has shown that our design was functional and met the requirements demanded by the nurses' tight schedules and heavy workloads. The user interface embedded in the tool provided compelling utility to the nurse with minimal distraction.

Usability testing of a prototype multi-user telehealth kiosk.

PubMed

Courtney, Karen L; Matthews, Judith T; McMillan, Julie M; Person Mecca, Laurel; Smailagic, Asim; Siewiorek, Daniel

2015-01-01

The overall purpose of this study was to learn how community-dwelling older adults would interact with our prototype multi-user telehealth kiosk and their views about its usability. Seven subjects participated in laboratory-based usability sessions to evaluate the physical design, appearance, functionality and perceived ease of use of a multi-user telehealth kiosk prototype. During usability testing participants recommended 18 new features (29% of comments), identified 15 software errors (23% of comments) and 29 user interface errors (47% of comments).

Experiments to Distribute Map Generalization Processes

NASA Astrophysics Data System (ADS)

Berli, Justin; Touya, Guillaume; Lokhat, Imran; Regnauld, Nicolas

2018-05-01

Automatic map generalization requires the use of computationally intensive processes often unable to deal with large datasets. Distributing the generalization process is the only way to make them scalable and usable in practice. But map generalization is a highly contextual process, and the surroundings of a generalized map feature needs to be known to generalize the feature, which is a problem as distribution might partition the dataset and parallelize the processing of each part. This paper proposes experiments to evaluate the past propositions to distribute map generalization, and to identify the main remaining issues. The past propositions to distribute map generalization are first discussed, and then the experiment hypotheses and apparatus are described. The experiments confirmed that regular partitioning was the quickest strategy, but also the less effective in taking context into account. The geographical partitioning, though less effective for now, is quite promising regarding the quality of the results as it better integrates the geographical context.

Improving the Quality and Effectiveness of Computer-Mediated Instruction Through Usability Evaluations

ERIC Educational Resources Information Center

Crowther, Michael S.; Keller, Chris C.; Waddoups, Gregory L.

2004-01-01

Brigham Young University's Center for Instructional Design (CID) creates online courses and multimedia instructional applications for university faculty. This paper asserts that including usability testing as a part of evaluation improves the quality and effectiveness of computer-mediated instruction. The paper describes the fundamental purpose…

Evaluating the usability of 19 effluents for heterotrophic cultivation of microalgal consortia as biodiesel feedstock

USDA-ARS?s Scientific Manuscript database

A key reason inhibiting commercialization of algal oil as biodiesel feedstock is cultivation cost. For this reason, the usability of 19 readily available industrial effluents (autoclaved and non-autoclaved) to support heterotrophic growth and lipid accumulation was evaluated using six mixed algal cu...

User-Centered Design and Usability Testing of a Web Site: An Illustrative Case Study.

ERIC Educational Resources Information Center

Corry, Michael D.; Frick, Theodore W.; Hansen, Lisa

1997-01-01

Presents an overview of user-centered design and usability testing. Describes a Web site evaluation project at a university, the iterative process of rapid prototyping and usability testing, and how the findings helped to improve the design. Discusses recommendations for university Web site design and reflects on problems faced in usability…

Developing an Android-Based Patient Decision Aid Based on Ottawa Standards for Patients After Kidney Transplant and Its Usability Evaluation.

PubMed

Zare Moayedi, Mahboobeh; Aslani, Azam; Fakhrahmad, Mostafa; Ezzatzadegan J, Shahrokh

2018-01-01

This study was conducted to develop an android based patient decision aid (PDA) as a self-care instrument for patients after kidney transplant and its usability evaluation. In this study, the systematic development process of Android-based self-care application for patients after kidney transplant based on Ottawa standard was included: scoping, assemble steering group, analysis of requirements, designing, develop of a prototype and system evaluation. The PDA is a self-triage system that will help early identification of risk symptoms in patients, and help manage them. System recommendations for risk signs are: Refer to the nearest hospital or healthcare center without delay, refer to the doctor and tell your doctor in the next visit. To identify patient care needs, a semi-structured interview with members of steering group, including patients and clinical experts, was conducted by the researchers. A prototype of the decision aid was made according to identified needs in the previous step. Finally, in order to evaluate its usability rate by using the System Usability Scale (SUS) questionnaire, it was used by exerts and patients. This study identified information needs, risk signs and steps that patients need to make appropriate decisions about them. The main capabilities of the decision aid are features such as reminders for appointment/test, time of taking medication, registration of symptoms, weight, blood pressure, body temperature, advising to patient in case of signs of risk, weight, blood pressure, body temperature and test results which were reported in the diagram. The mean score of system's usability evaluated by medical informatics specialists, clinicians, and patients were 88.33, 95, and 91. PDAs was usable and desirable from the point of view of medical informatics specialists, clinicians and patients.

Evaluating the Functionality and Usability of Two Novel Wheelchair Anti-Rollback Devices for Ramp Ascent in Manual Wheelchair Users With Spinal Cord Injury.

PubMed

Deems-Dluhy, Susan L; Jayaraman, Chandrasekaran; Green, Steve; Albert, Mark V; Jayaraman, Arun

2017-05-01

Difficulty ascending ramps and inclines with a manual wheelchair adversely affects the everyday mobility and overall quality of life of manual wheelchair users. Currently, various anti-rollback devices are available to assist manual wheelchair users to ascend ramps and inclines. However, these devices have 2 main shortcomings: restriction to backward motion limiting recovery from an overturning wheelchair, which is a safety concern; and difficulty in engaging/disengaging the device while on the ramp. To evaluate the functionality and usability of 2 novel wheelchair anti-rollback devices developed to address these shortcomings (prototypes "Wheel" and "Brake"). Cross-sectional. Rehabilitation research facility. Twelve adult participants with chronic spinal cord injury. Participants completed training and tested with both the wheelchair anti-rollback devices on a 7.3-m-long ramp. Number of stops, perceived physical exertion, pain, and ease of use of these devices as participants maneuvered their wheelchairs up a 7.3-m ramp were assessed. Participants also evaluated their satisfaction with the usability of both the devices using the Quebec User Evaluation of Satisfaction With Assistive Technology (QUEST 2.0). Both prototypes evaluated overcame the limitations of the existing anti-rollback devices. Nonparametric statistical tests showed that participants rated both prototypes similarly for the overall functional and usability aspects. However, the participants' satisfactory rating were higher for the prototype "Brake" than for the prototype "Wheel" based on a functional aspect (ie, engaging/disengaging easiness), and higher for Wheel than for Brake, based on a usability aspect (prototype size). The qualitative and quantitative outcomes of this investigation, based on the usability and functional evaluations, provided useful information for the improvement in the design of both anti-rollback devices, which may allow manual wheelchair users to manage ramp ascent more safely and easily. Further evaluations with a different SCI population is recommended. IV. Copyright © 2017 American Academy of Physical Medicine and Rehabilitation. Published by Elsevier Inc. All rights reserved.

Accessibility and usability of parks and playgrounds.

PubMed

Perry, Meredith A; Devan, Hemakumar; Fitzgerald, Harry; Han, Karen; Liu, Li-Ting; Rouse, Jack

2018-04-01

Public parks and playgrounds are an environment for leisure activity, which all generations can enjoy at low or no financial cost. Evaluating the accessibility and usability of parks and playgrounds is crucial because their design, environment (natural and built) and safety could restrict participation of persons with disabilities. To evaluate the accessibility and usability of 21 public parks and playgrounds in three metropolitan cities of New Zealand. Secondary aims were to compare the accessibility and usability by park type (destination or neighborhood) and deprivation level (high and low). Twenty-one parks were evaluated. A stratified random sampling was used to select 18 parks (six from each city). Three additional parks were purposely selected (one from each city) at the request of each respective city council. The parks and playgrounds were evaluated using a customized tool. Data were analyzed using descriptive statistics. None of the parks we evaluated met the national standards and/or international guidelines for park and playground design. We identified potential accessibility and usability issues with car parking spaces, path surfaces and play equipment as well as lack of lighting and fencing. The presence of amenities (e.g. toilets and drinking fountains) was more common in destination parks. Fewer parks in areas of higher deprivation had accessible car parking spaces and main paths wider than 1.5 m. Our evaluation identified potential design, environmental and safety barriers to park and playground based participation for persons with disabilities across the lifespan. A larger, more comprehensive evaluation of parks and playgrounds is required. Copyright © 2017 Elsevier Inc. All rights reserved.

Usability: Human Research Program - Space Human Factors and Habitability

NASA Technical Reports Server (NTRS)

Sandor, Aniko; Holden, Kritina L.

2009-01-01

The Usability project addresses the need for research in the area of metrics and methodologies used in hardware and software usability testing in order to define quantifiable and verifiable usability requirements. A usability test is a human-in-the-loop evaluation where a participant works through a realistic set of representative tasks using the hardware/software under investigation. The purpose of this research is to define metrics and methodologies for measuring and verifying usability in the aerospace domain in accordance with FY09 focus on errors, consistency, and mobility/maneuverability. Usability metrics must be predictive of success with the interfaces, must be easy to obtain and/or calculate, and must meet the intent of current Human Systems Integration Requirements (HSIR). Methodologies must work within the constraints of the aerospace domain, be cost and time efficient, and be able to be applied without extensive specialized training.

Usability of clinical decision support system as a facilitator for learning the assistive technology adaptation process.

PubMed

Danial-Saad, Alexandra; Kuflik, Tsvi; Weiss, Patrice L Tamar; Schreuer, Naomi

2016-01-01

The aim of this study was to evaluate the usability of Ontology Supported Computerized Assistive Technology Recommender (OSCAR), a Clinical Decision Support System (CDSS) for the assistive technology adaptation process, its impact on learning the matching process, and to determine the relationship between its usability and learnability. Two groups of expert and novice clinicians (total, n = 26) took part in this study. Each group filled out system usability scale (SUS) to evaluate OSCAR's usability. The novice group completed a learning questionnaire to assess OSCAR's effect on their ability to learn the matching process. Both groups rated OSCAR's usability as "very good", (M [SUS] = 80.7, SD = 11.6, median = 83.7) by the novices, and (M [SUS] = 81.2, SD = 6.8, median = 81.2) by the experts. The Mann-Whitney results indicated that no significant differences were found between the expert and novice groups in terms of OSCAR's usability. A significant positive correlation existed between the usability of OSCAR and the ability to learn the adaptation process (rs = 0.46, p = 0.04). Usability is an important factor in the acceptance of a system. The successful application of user-centered design principles during the development of OSCAR may serve as a case study that models the significant elements to be considered, theoretically and practically in developing other systems. Implications for Rehabilitation Creating a CDSS with a focus on its usability is an important factor for its acceptance by its users. Successful usability outcomes can impact the learning process of the subject matter in general, and the AT prescription process in particular. The successful application of User-Centered Design principles during the development of OSCAR may serve as a case study that models the significant elements to be considered, theoretically and practically. The study emphasizes the importance of close collaboration between the developers and the end users.

Empirical studies on usability of mHealth apps: a systematic literature review.

PubMed

Zapata, Belén Cruz; Fernández-Alemán, José Luis; Idri, Ali; Toval, Ambrosio

2015-02-01

The release of smartphones and tablets, which offer more advanced communication and computing capabilities, has led to the strong emergence of mHealth on the market. mHealth systems are being used to improve patients' lives and their health, in addition to facilitating communication between doctors and patients. Researchers are now proposing mHealth applications for many health conditions such as dementia, autism, dysarthria, Parkinson's disease, and so on. Usability becomes a key factor in the adoption of these applications, which are often used by people who have problems when using mobile devices and who have a limited experience of technology. The aim of this paper is to investigate the empirical usability evaluation processes described in a total of 22 selected studies related to mHealth applications by means of a Systematic Literature Review. Our results show that the empirical evaluation methods employed as regards usability could be improved by the adoption of automated mechanisms. The evaluation processes should also be revised to combine more than one method. This paper will help researchers and developers to create more usable applications. Our study demonstrates the importance of adapting health applications to users' need.

Usability testing for the rest of us: the application of discount usability principles in the development of an online communications assessment application.

PubMed

Brock, Douglas; Kim, Sara; Palmer, Odawni; Gallagher, Thomas; Holmboe, Eric

2013-01-01

Usability evaluation provides developers and educators with the means to understand user needs, improve overall product utility, and increase user satisfaction. The application of "discount usability" principles developed to make usability testing more practical and useful may improve user experience at minimal cost and require little existing expertise to conduct. We describe an application of discount usability to a high-fidelity online communications assessment application developed by the University of Washington for the American Board of Internal Medicine. Eight internal medicine physicians completed a discount usability test. Sessions were recorded and the videos analyzed for significant usability concerns. Concerns were identified, summarized, discussed, and prioritized by the authors in collaboration with the software developers before implementing any changes to the interface. Thirty-eight significant usability issues were detected and four technical problems were identified. Each issue was responded to through modification of the software, by providing additional instruction, or delayed for a later version to be developed. Discount usability can be easily implemented in academic developmental activities. Our study resulted in the discovery and remediation of significant user problems, in addition to giving important insight into the novel methods built into the application.

36 CFR 1193.23 - Product design, development, and evaluation.

Code of Federal Regulations, 2014 CFR

2014-07-01

..., usability, and compatibility of telecommunications equipment and customer premises equipment and shall... as possible. Manufacturers shall identify barriers to accessibility and usability as part of such a...

Usability Study of a Wireless Monitoring System among Alzheimer's Disease Elderly Population

PubMed Central

Avvenuti, Marco

2014-01-01

Healthcare technologies are slowly entering into our daily lives, replacing old devices and techniques with newer intelligent ones. Although they are meant to help people, the reaction and willingness to use such new devices by the people can be unexpected, especially among the elderly. We conducted a usability study of a fall monitoring system in a long-term nursing home. The subjects were the elderly with advanced Alzheimer's disease. The study presented here highlights some of the challenges faced in the use of wearable devices and the lessons learned. The results gave us useful insights, leading to ergonomics and aesthetics modifications to our wearable systems that significantly improved their usability and acceptance. New evaluating metrics were designed for the performance evaluation of usability and acceptability. PMID:24963289

Usability evaluation of mobile applications; where do we stand?

NASA Astrophysics Data System (ADS)

Zahra, Fatima; Hussain, Azham; Mohd, Haslina

2017-10-01

The range and availability of mobile applications is expanding rapidly. With the increased processing power available on portable devices, developers are increasing the range of services by embracing smartphones in their extensive and diverse practices. While usability testing and evaluations of mobile applications have not yet touched the accuracy level of other web based applications. The existing usability models do not adequately capture the complexities of interacting with applications on a mobile platform. Therefore, this study aims to presents review on existing usability models for mobile applications. These models are in their infancy but with time and more research they may eventually be adopted. Moreover, different categories of mobile apps (medical, entertainment, education) possess different functional and non-functional requirements thus customized models are required for diverse mobile applications.

Usability study of a novel, self-lighted, disposable speculum: military applications.

PubMed

Jones, Christina L; Gruber, Daniel D; Warner, William; Buller, Jerome L

2013-04-01

Data collected from a postutilization questionnaire were used to evaluate the usability of the OfficeSPEC disposable vaginal speculum, specifically the effectiveness, efficiency, and acceptability, in clinical, hospital, and austere environments. Usability data analysis showed the OfficeSPEC speculum had an effectiveness rating of 4.6/5, efficiency rating of 4.5/5, and acceptability rating of 4.6/5; overall usability in deployed environments was favorable. The overall rankings were 3.4 for plastic, 4.2 for metal (p < 0.001), and 4.5 for OfficeSPEC (p < 0.001). Cost analysis of the OfficeSPEC placed the disposable speculum as a reasonable alternative with yearly cost of $129,200, compared to traditional metal ($209,100) and plastic ($319,175). By evaluating the OfficeSPEC speculum within a usability framework, it proved to be practical, viable alternative in all environments, particularly in the forward deployed environment. Reprint & Copyright © 2013 Association of Military Surgeons of the U.S.

Usability Testing of Two Ambulatory EHR Navigators.

PubMed

Hultman, Gretchen; Marquard, Jenna; Arsoniadis, Elliot; Mink, Pamela; Rizvi, Rubina; Ramer, Tim; Khairat, Saif; Fickau, Keri; Melton, Genevieve B

2016-01-01

Despite widespread electronic health record (EHR) adoption, poor EHR system usability continues to be a significant barrier to effective system use for end users. One key to addressing usability problems is to employ user testing and user-centered design. To understand if redesigning an EHR-based navigation tool with clinician input improved user performance and satisfaction. A usability evaluation was conducted to compare two versions of a redesigned ambulatory navigator. Participants completed tasks for five patient cases using the navigators, while employing a think-aloud protocol. The tasks were based on Meaningful Use (MU) requirements. The version of navigator did not affect perceived workload, and time to complete tasks was longer in the redesigned navigator. A relatively small portion of navigator content was used to complete the MU-related tasks, though navigation patterns were highly variable across participants for both navigators. Preferences for EHR navigation structures appeared to be individualized. This study demonstrates the importance of EHR usability assessments to evaluate group and individual performance of different interfaces and preferences for each design.

A usability study of CPOE's medication administration functions: impact on physician-nurse cooperation.

PubMed

Beuscart-Zéphir, Marie Catherine; Pelayo, Sylvia; Degoulet, Patrice; Anceaux, Françoise; Guerlinger, Sandra; Meaux, Jean-Jacques

2004-01-01

Implementation of CPOE systems in Healthcare Institutions has proven efficient in reducing medication errors but it also induces hidden side-effects on Doctor-Nurse cooperation. We propose a usability engineering approach to this problem. An extensive activity analysis of the medication ordering and administration process was performed in several departments of 3 different hospitals. Two of these hospitals are still using paper-based orders, while the 3rd one is in the roll-out phase of medication functions of its CPOE system. We performed a usability assessment of this CPOE system. The usability assessment uncovered usability problems for the entry of medication administration time scheduling by the physician and revealed that the information can be ambiguous for the nurse. The comparison of cooperation models in both situation shows that users tend to adopt a distributed decision making paradigm in the paper-based situation, while the CPOE system supports a centralized decision making process. This analysis can support recommendation for the re-engineering of the Human-Computer Interface.

36 CFR § 1193.23 - Product design, development, and evaluation.

Code of Federal Regulations, 2013 CFR

2013-07-01

..., usability, and compatibility of telecommunications equipment and customer premises equipment and shall... as possible. Manufacturers shall identify barriers to accessibility and usability as part of such a...

Integrated Model for E-Learning Acceptance

NASA Astrophysics Data System (ADS)

Ramadiani; Rodziah, A.; Hasan, S. M.; Rusli, A.; Noraini, C.

2016-01-01

E-learning is not going to work if the system is not used in accordance with user needs. User Interface is very important to encourage using the application. Many theories had discuss about user interface usability evaluation and technology acceptance separately, actually why we do not make it correlation between interface usability evaluation and user acceptance to enhance e-learning process. Therefore, the evaluation model for e-learning interface acceptance is considered important to investigate. The aim of this study is to propose the integrated e-learning user interface acceptance evaluation model. This model was combined some theories of e-learning interface measurement such as, user learning style, usability evaluation, and the user benefit. We formulated in constructive questionnaires which were shared at 125 English Language School (ELS) students. This research statistics used Structural Equation Model using LISREL v8.80 and MANOVA analysis.

Developing and Validation a Usability Evaluation Tools for Distance Education Websites: Persian Version

ERIC Educational Resources Information Center

Hafezi, Soheila; Farahi, Ahmad; Mehri, Soheil Najafi; Mahmoodi, Hosein

2010-01-01

The web is playing a central role in distance education. The word "usability" is usually synonymous with functionality of the system for the user. Also, usability of a website is defined as something that can be used by a specific group of people to carry out specific objectives in an effective way, with efficiency and satisfaction.…

Product design enhancement using apparent usability and affective quality.

PubMed

Seva, Rosemary R; Gosiaco, Katherine Grace T; Santos, Ma Crea Eurice D; Pangilinan, Denise Mae L

2011-03-01

In this study, apparent usability and affective quality were integrated in a design framework called the Usability Perception and Emotion Enhancement Model (UPEEM). The UPEEM was validated using structural equation modeling (SEM). The methodology consists of four phases namely product selection, attribute identification, design alternative generation, and design alternative evaluation. The first stage involved the selection of a product that highly involves the consumer. In the attribute identification stage, design elements of the product were identified. The possible values of these elements were also determined for use in the experimentation process. Design of experiments was used to identify how the attributes will be varied in the design alternative stage and which of the attributes significantly contribute to affective quality, apparent usability, and desirability in the design evaluation stage. Results suggest that product attributes related to form are relevant in eliciting intense affect and perception of usability in mobile phones especially those directly related to functionality and aesthetics. This study considered only four product attributes among so many due to the constraints of the research design employed. Attributes related to aesthetic perception of a product enhance apparent usability such as those related to dimensional ratios. Copyright © 2010 Elsevier Ltd and The Ergonomics Society. All rights reserved.

Usability Evaluation of a Research Repository and Collaboration Web Site

ERIC Educational Resources Information Center

Zhang, Tao; Maron, Deborah J.; Charles, Christopher C.

2013-01-01

This article reports results from an empirical usability evaluation of Human-Animal Bond Research Initiative Central as part of the effort to develop an open access research repository and collaboration platform for human-animal bond researchers. By repurposing and altering key features of the original HUBzero system, Human-Animal Bond Research…

Genomic imputation and evaluation using high density Holstein genotypes

USDA-ARS?s Scientific Manuscript database

Genomic evaluations for 161,341 Holsteins were computed using 311,725 of the 777,962 markers on the Illumina high-density (HD) chip. Initial edits with 1,741 HD genotypes from 5 breeds revealed that 636,967 markers were usable but that half were redundant. Usable Holstein genotypes included 1,510 an...

Usability Level of Distance Education Website (Sakarya University Sample)

ERIC Educational Resources Information Center

Isman, Aytekin; Isbulan, Onur

2010-01-01

The main goal of this research is to determine the usability of Sakarya University Adapazari Vocational Two-Year Community College's Web Site. A scale was developed to the evaluation and applied to 1512 students. From the applied questionnaire only appropriate ones were selected to be evaluated and 1229 questionnaires were analysed. Finally,…

Development of Usability Criteria for E-Learning Content Development Software

ERIC Educational Resources Information Center

Celik, Serkan

2012-01-01

Revolutionary advancements have been observed in e-learning technologies though an amalgamated evaluation methodology for new generation e-learning content development tools is not available. The evaluation of educational software for online use must consider its usability and as well as its pedagogic effectiveness. This study is a first step…

Establishing usability heuristics for heuristics evaluation in a specific domain: Is there a consensus?

PubMed

Hermawati, Setia; Lawson, Glyn

2016-09-01

Heuristics evaluation is frequently employed to evaluate usability. While general heuristics are suitable to evaluate most user interfaces, there is still a need to establish heuristics for specific domains to ensure that their specific usability issues are identified. This paper presents a comprehensive review of 70 studies related to usability heuristics for specific domains. The aim of this paper is to review the processes that were applied to establish heuristics in specific domains and identify gaps in order to provide recommendations for future research and area of improvements. The most urgent issue found is the deficiency of validation effort following heuristics proposition and the lack of robustness and rigour of validation method adopted. Whether domain specific heuristics perform better or worse than general ones is inconclusive due to lack of validation quality and clarity on how to assess the effectiveness of heuristics for specific domains. The lack of validation quality also affects effort in improving existing heuristics for specific domain as their weaknesses are not addressed. Copyright © 2016 Elsevier Ltd. All rights reserved.

The McMaster Optimal Aging Portal: Usability Evaluation of a Unique Evidence-Based Health Information Website.

PubMed

Barbara, Angela M; Dobbins, Maureen; Haynes, R Brian; Iorio, Alfonso; Lavis, John N; Raina, Parminder; Levinson, Anthony J

2016-05-11

Increasingly, older adults and their informal caregivers are using the Internet to search for health-related information. There is a proliferation of health information online, but the quality of this information varies, often based on exaggerated or dramatic findings, and not easily comprehended by consumers. The McMaster Optimal Aging Portal (Portal) was developed to provide Internet users with high-quality evidence about aging and address some of these current limitations of health information posted online. The Portal includes content for health professionals coming from three best-in-class resources (MacPLUS, Health Evidence, and Health Systems Evidence) and four types of content specifically prepared for the general public (Evidence Summaries, Web Resource Ratings, Blog Posts, and Twitter messages). Our objectives were to share the findings of the usability evaluation of the Portal with particular focus on the content features for the general public and to inform designers of health information websites and online resources for older adults about key usability themes. Data analysis included task performance during usability testing and qualitative content analyses of both the usability sessions and interviews to identify core themes. A total of 37 participants took part in 33 usability testing sessions and 21 focused interviews. Qualitative analysis revealed common themes regarding the Portal's strengths and challenges to usability. The strengths of the website were related to credibility, applicability, browsing function, design, and accessibility. The usability challenges included reluctance to register, process of registering, searching, terminology, and technical features. The study reinforced the importance of including end users during the development of this unique, dynamic, evidence-based health information website. The feedback was applied to iteratively improve website usability. Our findings can be applied by designers of health-related websites.

The McMaster Optimal Aging Portal: Usability Evaluation of a Unique Evidence-Based Health Information Website

PubMed Central

Dobbins, Maureen; Haynes, R. Brian; Iorio, Alfonso; Lavis, John N; Raina, Parminder

2016-01-01

Background Increasingly, older adults and their informal caregivers are using the Internet to search for health-related information. There is a proliferation of health information online, but the quality of this information varies, often based on exaggerated or dramatic findings, and not easily comprehended by consumers. The McMaster Optimal Aging Portal (Portal) was developed to provide Internet users with high-quality evidence about aging and address some of these current limitations of health information posted online. The Portal includes content for health professionals coming from three best-in-class resources (MacPLUS, Health Evidence, and Health Systems Evidence) and four types of content specifically prepared for the general public (Evidence Summaries, Web Resource Ratings, Blog Posts, and Twitter messages). Objective Our objectives were to share the findings of the usability evaluation of the Portal with particular focus on the content features for the general public and to inform designers of health information websites and online resources for older adults about key usability themes. Methods Data analysis included task performance during usability testing and qualitative content analyses of both the usability sessions and interviews to identify core themes. Results A total of 37 participants took part in 33 usability testing sessions and 21 focused interviews. Qualitative analysis revealed common themes regarding the Portal’s strengths and challenges to usability. The strengths of the website were related to credibility, applicability, browsing function, design, and accessibility. The usability challenges included reluctance to register, process of registering, searching, terminology, and technical features. Conclusions The study reinforced the importance of including end users during the development of this unique, dynamic, evidence-based health information website. The feedback was applied to iteratively improve website usability. Our findings can be applied by designers of health-related websites. PMID:27170443

An evaluation method of computer usability based on human-to-computer information transmission model.

PubMed

Ogawa, K

1992-01-01

This paper proposes a new evaluation and prediction method for computer usability. This method is based on our two previously proposed information transmission measures created from a human-to-computer information transmission model. The model has three information transmission levels: the device, software, and task content levels. Two measures, called the device independent information measure (DI) and the computer independent information measure (CI), defined on the software and task content levels respectively, are given as the amount of information transmitted. Two information transmission rates are defined as DI/T and CI/T, where T is the task completion time: the device independent information transmission rate (RDI), and the computer independent information transmission rate (RCI). The method utilizes the RDI and RCI rates to evaluate relatively the usability of software and device operations on different computer systems. Experiments using three different systems, in this case a graphical information input task, confirm that the method offers an efficient way of determining computer usability.

Using Heuristic Evaluation to Improve Sepsis Alert Usability.

PubMed

Pertiwi, Ariani Arista Putri; Fraczkowski, Dan; Stogis, Sheryl L; Lopez, Karen Dunn

2018-06-01

Sepsis, life-threatening organ dysfunction in response to infection, is an alarmingly common and aggressive illness in US hospitals, especially for intensive care patients. Preventing sepsis deaths rests on the clinicians' ability to promptly recognize and treat sepsis. To aid early recognition, many organizations have employed clinician-facing electronic sepsis alert systems. However, the effectiveness of the alert relies on heavily on the visual interface, textual information, and overall usability. This article reports a usability inspection of a sepsis alert system. The authors found violations in 12 of the 14 usability principles and promote use of this method in practice to systematically identify usability problems. Copyright © 2018 Elsevier Inc. All rights reserved.

Development and usability of a computer-tailored pedometer-based physical activity advice for breast cancer survivors.

PubMed

De Cocker, K; Charlier, C; Van Hoof, E; Pauwels, E; Lechner, L; Bourgois, J; Spittaels, H; Vandelanotte, C; De Bourdeaudhuij, I

2015-09-01

This observational study aimed to adapt a computer-tailored step advice for the general population into a feasible advice for breast cancer survivors and to test its usability. First, several adaptations were made to the original design (adding cancer-related physical activity (PA) barriers and beliefs, and self-management strategies to improve survivors' personal control). Second, the adapted advice was evaluated in two phases: (1) a usability testing in healthy women (n = 3) and survivors (n = 6); and (2) a process evaluation during 3 weeks in breast cancer survivors (n = 8). Preliminary usability testing revealed no problems during logging-in; however, three survivors misinterpreted some questions. After refining the questionnaire and advice, survivors evaluated the advice as interesting, attractive to read, comprehensible and credible. Inactive survivors found the advice novel, but too long. The process evaluation indicated that the majority of the women (n = 5/8) reported increased steps. Monitoring step counts by using a pedometer was perceived as an important motivator to be more active. To conclude, this study provides initial support for the usability and acceptability of a computer-tailored pedometer-based PA advice for breast cancer survivors. After testing efficacy and effectiveness of this intervention, this tool can broaden the reach of PA promotion in breast cancer survivors. © 2014 John Wiley & Sons Ltd.

A systematic review of hybrid brain-computer interfaces: Taxonomy and usability perspectives

PubMed Central

Lee, Yushin; Yun, Myung Hwan

2017-01-01

A new Brain-Computer Interface (BCI) technique, which is called a hybrid BCI, has recently been proposed to address the limitations of conventional single BCI system. Although some hybrid BCI studies have shown promising results, the field of hybrid BCI is still in its infancy and there is much to be done. Especially, since the hybrid BCI systems are so complicated and complex, it is difficult to understand the constituent and role of a hybrid BCI system at a glance. Also, the complicated and complex systems make it difficult to evaluate the usability of the systems. We systematically reviewed and analyzed the current state-of-the-art hybrid BCI studies, and proposed a systematic taxonomy for classifying the types of hybrid BCIs with multiple taxonomic criteria. After reviewing 74 journal articles, hybrid BCIs could be categorized with respect to 1) the source of brain signals, 2) the characteristics of the brain signal, and 3) the characteristics of operation in each system. In addition, we exhaustively reviewed recent literature on usability of BCIs. To identify the key evaluation dimensions of usability, we focused on task and measurement characteristics of BCI usability. We classified and summarized 31 BCI usability journal articles according to task characteristics (type and description of task) and measurement characteristics (subjective and objective measures). Afterwards, we proposed usability dimensions for BCI and hybrid BCI systems according to three core-constructs: Satisfaction, effectiveness, and efficiency with recommendations for further research. This paper can help BCI researchers, even those who are new to the field, can easily understand the complex structure of the hybrid systems at a glance. Recommendations for future research can also be helpful in establishing research directions and gaining insight in how to solve ergonomics and HCI design issues surrounding BCI and hybrid BCI systems by usability evaluation. PMID:28453547

A systematic review of hybrid brain-computer interfaces: Taxonomy and usability perspectives.

PubMed

Choi, Inchul; Rhiu, Ilsun; Lee, Yushin; Yun, Myung Hwan; Nam, Chang S

2017-01-01

A new Brain-Computer Interface (BCI) technique, which is called a hybrid BCI, has recently been proposed to address the limitations of conventional single BCI system. Although some hybrid BCI studies have shown promising results, the field of hybrid BCI is still in its infancy and there is much to be done. Especially, since the hybrid BCI systems are so complicated and complex, it is difficult to understand the constituent and role of a hybrid BCI system at a glance. Also, the complicated and complex systems make it difficult to evaluate the usability of the systems. We systematically reviewed and analyzed the current state-of-the-art hybrid BCI studies, and proposed a systematic taxonomy for classifying the types of hybrid BCIs with multiple taxonomic criteria. After reviewing 74 journal articles, hybrid BCIs could be categorized with respect to 1) the source of brain signals, 2) the characteristics of the brain signal, and 3) the characteristics of operation in each system. In addition, we exhaustively reviewed recent literature on usability of BCIs. To identify the key evaluation dimensions of usability, we focused on task and measurement characteristics of BCI usability. We classified and summarized 31 BCI usability journal articles according to task characteristics (type and description of task) and measurement characteristics (subjective and objective measures). Afterwards, we proposed usability dimensions for BCI and hybrid BCI systems according to three core-constructs: Satisfaction, effectiveness, and efficiency with recommendations for further research. This paper can help BCI researchers, even those who are new to the field, can easily understand the complex structure of the hybrid systems at a glance. Recommendations for future research can also be helpful in establishing research directions and gaining insight in how to solve ergonomics and HCI design issues surrounding BCI and hybrid BCI systems by usability evaluation.

Assessing the Usability of University Websites: An Empirical Study on Namik Kemal University

ERIC Educational Resources Information Center

Mentes, S. Ahmet; Turan, Aykut H.

2012-01-01

Web sites are emerging as a key component of an organization's survival in our ever globalizing competitive world. Usability of a web site has assumed a great deal of importance in terms of satisfying web site users' needs and expectations. The aim of the study is to evaluate and to explore the usability level of Namik Kemal University (NKU)…

Development of the Telehealth Usability Questionnaire (TUQ).

PubMed

Parmanto, Bambang; Lewis, Allen Nelson; Graham, Kristin M; Bertolet, Marnie H

2016-01-01

Current telehealth usability questionnaires are designed primarily for older technologies, where telehealth interaction is conducted over dedicated videoconferencing applications. However, telehealth services are increasingly conducted over computer-based systems that rely on commercial software and a user supplied computer interface. Therefore, a usability questionnaire that addresses the changes in telehealth service delivery and technology is needed. The Telehealth Usability Questionnaire (TUQ) was developed to evaluate the usability of telehealth implementation and services. This paper addresses: (1) the need for a new measure of telehealth usability, (2) the development of the TUQ, (3) intended uses for the TUQ, and (4) the reliability of the TUQ. Analyses indicate that the TUQ is a solid, robust, and versatile measure that can be used to measure the quality of the computer-based user interface and the quality of the telehealth interaction and services.

Web-based Education for Low-literate Parents in Neonatal Intensive Care Unit: Development of a Website and Heuristic Evaluation and Usability Testing

PubMed Central

Choi, Jeungok; Bakken, Suzanne

2010-01-01

Purpose Low health literacy has been associated with poor health-related outcomes. The purposes are to report the development of a website for low-literate parents in the Neonatal Intensive Care Unit (NICU), and the findings of heuristic evaluation and a usability testing of this website. Methods To address low literacy of NICU parents, multimedia educational Website using visual aids (e.g., pictographs, photographs), voice-recorded text message in addition to a simplified text was developed. The text was created at the 5th grade readability level. The heuristic evaluation was conducted by three usability experts using 10 heuristics. End-users’ performance was measured by counting the time spent completing tasks and number of errors, as well as recording users’ perception of ease of use and usefulness (PEUU) in a sample of 10 NICU parents. Results Three evaluators identified 82 violations across the 10 heuristics. All violations, however, received scores <2, indicating minor usability problems. Participants’ time to complete task varies from 81.2 seconds (SD=30.9) to 2.2 seconds (SD=1.3). Participants rated the Website as easy to use and useful (PEUU Mean= 4.52, SD=0.53). Based on the participants’ comments, appropriate modifications were made. Discussion and Conclusions Different types of visuals on the Website were well accepted by low-literate users and agreement of visuals with text improved understanding of the educational materials over that with text alone. The findings suggest that using concrete and realistic pictures and pictographs with clear captions would maximize the benefit of visuals. One emerging theme was “simplicity” in design (e.g., limited use of colors, one font type and size), content (e.g., avoid lengthy text), and technical features (e.g., limited use of pop-ups). The heuristic evaluation by usability experts and the usability test with actual users provided complementary expertise, which can give a richer assessment of a design for low literacy Website. These results facilitated design modification and implementation of solutions by categorizing and prioritizing the usability problems. PMID:20617546

Web-based education for low-literate parents in Neonatal Intensive Care Unit: development of a website and heuristic evaluation and usability testing.

PubMed

Choi, Jeungok; Bakken, Suzanne

2010-08-01

Low health literacy has been associated with poor health-related outcomes. The purposes are to report the development of a website for low-literate parents in the Neonatal Intensive Care Unit (NICU), and the findings of heuristic evaluation and a usability testing of this website. To address low literacy of NICU parents, multimedia educational Website using visual aids (e.g., pictographs, photographs), voice-recorded text message in addition to a simplified text was developed. The text was created at the 5th grade readability level. The heuristic evaluation was conducted by three usability experts using 10 heuristics. End-users' performance was measured by counting the time spent completing tasks and number of errors, as well as recording users' perception of ease of use and usefulness (PEUU) in a sample of 10 NICU parents. Three evaluators identified 82 violations across the 10 heuristics. All violations, however, received scores <2, indicating minor usability problems. Participants' time to complete task varies from 81.2 s (SD = 30.9) to 2.2 s (SD = 1.3). Participants rated the Website as easy to use and useful (PEUU mean = 4.52, SD = 0.53). Based on the participants' comments, appropriate modifications were made. Different types of visuals on the Website were well accepted by low-literate users and agreement of visuals with text improved understanding of the educational materials over that with text alone. The findings suggest that using concrete and realistic pictures and pictographs with clear captions would maximize the benefit of visuals. One emerging theme was "simplicity" in design (e.g., limited use of colors, one font type and size), content (e.g., avoid lengthy text), and technical features (e.g., limited use of pop-ups). The heuristic evaluation by usability experts and the usability test with actual users provided complementary expertise, which can give a richer assessment of a design for low literacy Website. These results facilitated design modification and implementation of solutions by categorizing and prioritizing the usability problems.

An Evaluation of Learning Objects in Singapore Primary Education: A Case Study Approach

ERIC Educational Resources Information Center

Grace, Tay Pei Lyn; Suan, Ng Peck; Wanzhen, Liaw

2008-01-01

Purpose: The purpose of this paper is to evaluate the usability and interface design of e-learning portal developed for primary schools in Singapore. Design/methodology/approach: Using Singapore-based learning EDvantage (LEAD) portal as a case study, this paper reviews and analyses the usability and usefulness of embedded learning objects (LOs)…

Web Accessibility and Usability of the Homepages from Academy of Human Resource Development Members' Institutions

ERIC Educational Resources Information Center

Zeng, Xiaoming; Sligar, Steven R.

2008-01-01

Human resource development programs in various institutions communicate with their constituencies including persons with disabilities through websites. Web sites need to be accessible for legal, economic and ethical reasons. We used an automated web usability evaluation tool, aDesigner, to evaluate 205 home pages from the organizations of AHRD…

A Concise and Practical Framework for the Development and Usability Evaluation of Patient Information Websites.

PubMed

Peute, L W; Knijnenburg, S L; Kremer, L C; Jaspers, M W M

2015-01-01

The Website Developmental Model for the Healthcare Consumer (WDMHC) is an extensive and successfully evaluated framework that incorporates user-centered design principles. However, due to its extensiveness its application is limited. In the current study we apply a subset of the WDMHC framework in a case study concerning the development and evaluation of a website aimed at childhood cancer survivors (CCS). To assess whether the implementation of a limited subset of the WDMHC-framework is sufficient to deliver a high-quality website with few usability problems, aimed at a specific patient population. The website was developed using a six-step approach divided into three phases derived from the WDMHC: 1) information needs analysis, mock-up creation and focus group discussion; 2) website prototype development; and 3) heuristic evaluation (HE) and think aloud analysis (TA). The HE was performed by three double experts (knowledgeable both in usability engineering and childhood cancer survivorship), who assessed the site using the Nielsen heuristics. Eight end-users were invited to complete three scenarios covering all functionality of the website by TA. The HE and TA were performed concurrently on the website prototype. The HE resulted in 29 unique usability issues; the end-users performing the TA encountered eleven unique problems. Four issues specifically revealed by HE concerned cosmetic design flaws, whereas two problems revealed by TA were related to website content. Based on the subset of the WDMHC framework we were able to deliver a website that closely matched the expectancy of the end-users and resulted in relatively few usability problems during end-user testing. With the successful application of this subset of the WDMHC, we provide developers with a clear and easily applicable framework for the development of healthcare websites with high usability aimed at specific medical populations.

Interface design recommendations for computerised clinical audit and feedback: Hybrid usability evidence from a research-led system.

PubMed

Brown, Benjamin; Balatsoukas, Panos; Williams, Richard; Sperrin, Matthew; Buchan, Iain

2016-10-01

Audit and Feedback (A&F) is a widely used quality improvement technique that measures clinicians' clinical performance and reports it back to them. Computerised A&F (e-A&F) system interfaces may consist of four key components: (1) Summaries of clinical performance; (2) Patient lists; (3) Patient-level data; (4) Recommended actions. There is a lack of evidence regarding how to best design e-A&F interfaces; establishing such evidence is key to maximising usability, and in turn improving patient safety. To evaluate the usability of a novel theoretically-informed and research-led e-A&F system for primary care (the Performance Improvement plaN GeneratoR: PINGR). (1) Describe PINGR's design, rationale and theoretical basis; (2) Identify usability issues with PINGR; (3) Understand how these issues may interfere with the cognitive goals of end-users; (4) Translate the issues into recommendations for the user-centred design of e-A&F systems. Eight experienced health system evaluators performed a usability inspection using an innovative hybrid approach consisting of five stages: (1) Development of representative user tasks, Goals, and Actions; (2) Combining Heuristic Evaluation and Cognitive Walkthrough methods into a single protocol to identify usability issues; (3) Consolidation of issues; (4) Severity rating of consolidated issues; (5) Analysis of issues according to usability heuristics, interface components, and Goal-Action structure. A final list of 47 issues were categorised into 8 heuristic themes. The most error-prone heuristics were 'Consistency and standards' (13 usability issues; 28% of the total) and 'Match between system and real world' (n=10, 21%). The recommended actions component of the PINGR interface had the most usability issues (n=21, 45%), followed by patient-level data (n=5, 11%), patient lists (n=4, 9%), and summaries of clinical performance (n=4, 9%). The most error-prone Actions across all user Goals were: (1) Patient selection from a list; (2) Data identification from a figure (both population-level and patient-level); (3) Disagreement with a system recommendation. By contextualising our findings within the wider literature on health information system usability, we provide recommendations for the design of e-A&F system interfaces relating to their four key components, in addition to how they may be integrated within a system. Copyright © 2016. Published by Elsevier Ireland Ltd.

Usability evaluation with mental health professionals and young people to develop an Internet-based cognitive-behaviour therapy program for adolescents with anxiety disorders.

PubMed

Wozney, Lori; Baxter, Pamela; Newton, Amanda S

2015-12-16

Use of the Internet to deliver cognitive behavioural therapy, a frontline treatment for anxiety disorders, is emerging as an option to increase access to treatment among adolescents with anxiety disorders. This study examined the usability of the Internet-based component of Breathe, a CBT program designed for adolescents with mild to moderate anxiety and impairments. A mixed-method usability testing design with semi-structured interviews, task completion, and survey by trained usability moderators was undertaken with two interactive cycles to determine the usability (ease of use, efficiency, errors, and user satisfaction) of the user interface and content areas of the program. Purposeful sampling was used to recruit mental health clinicians with expertise in treating adolescent anxiety disorders and young people aged 15 to 24 years involved. Testing involved using Web-conferencing software that allowed remote participation through personal computers. Two testing cycles involved participants completing structured 'think aloud' and 'cognitive walkthrough' tasks within the program. At the end of each cycle participants completed a 15-item global usability evaluation survey and were asked a series of open-ended questions. Descriptive and simple content analyses were used to identify and score usability issues for frequency and severity. Five clinicians and four young people (all < 20 years of age) participated. Most participants described their computer skills as 'good' (60% clinicians, 50% young people), and attitudes toward Internet-based health care ranged from negative (75% young people) to positive (60% clinicians, 25% young people). Scores from the global usability evaluation after both testing cycles ranged from 3.5 to 5 out of 5 in strong agreement/support of the program in terms of user performance indicators (i.e., learnability, efficiency and number of errors) and user satisfaction. Participants were able to complete all critical tasks with minimal errors. Errors and issues identified during testing were predominantly around enhancements to the visual design and navigational support. Opinions across usability elements did not differ between young people and clinician participants. A multi-method remote usability approach provided the opportunity to improve the technical interface, therapeutic messaging and user experience of an Internet-based treatment program for adolescent anxiety disorders.

Development and user evaluation of a virtual rehabilitation system for wobble board balance training.

PubMed

Fitzgerald, Diarmaid; Trakarnratanakul, Nanthana; Dunne, Lucy; Smyth, Barry; Caulfield, Brian

2008-01-01

We have developed a prototype virtual reality-based balance training system using a single inertial orientation sensor attached to the upper surface of a wobble board. This input device has been interfaced with Neverball, an open source computer game to create the balance training platform. Users can exercise with the system by standing on the wobble board and tilting it in different directions to control an on-screen environment. We have also developed a customized instruction manual to use when setting up the system. To evaluate the usability our prototype system we undertook a user evaluation study with twelve healthy novice participants. Participants were required to assemble the system using an instruction manual and then perform balance exercises with the system. Following this period of exercise VRUSE, a usability evaluation questionnaire, was completed by participants. Results indicated a high level of usability in all categories evaluated.

Evaluating the usability of a commercial cooling vest in the Hong Kong industries.

PubMed

Chan, Albert P; Yang, Yang; Song, Wen-Fang

2018-03-01

The provision of appropriate personal cooling vests is recognized as an effective measure to combat heat stress. However, personal cooling vests are not widely implemented in the Hong Kong industries. The current study aims to evaluate the usability of a hybrid cooling vest that is associated with the success of its application in industrial settings. A self-administrated questionnaire focusing on 10 subjective attributes of cooling effect, ergonomic design and usability of a hybrid cooling vest was administered with 232 occupational workers in the construction, horticultural and cleaning, airport apron services and kitchen and catering industries. A structural equation model estimated by analysis of moment structures was constructed to evaluate the usability of the cooling vest, as influenced by cooling effect and ergonomic design. Results showed that cooling effect (path coefficient = 0.69, p < 0.001) and ergonomic design (path coefficient = 0.55, p < 0.001) significantly affect the usability of the cooling vest. The structural equation model is feasible to examine the complex nature of the structural relationships among the subjective perceptions of personal cooling vests. The empirical findings furnish sound evidence for further optimization of the hybrid cooling vest in terms of cooling effect and ergonomic design for occupational workers.

Current State of Agile User-Centered Design: A Survey

NASA Astrophysics Data System (ADS)

Hussain, Zahid; Slany, Wolfgang; Holzinger, Andreas

Agile software development methods are quite popular nowadays and are being adopted at an increasing rate in the industry every year. However, these methods are still lacking usability awareness in their development lifecycle, and the integration of usability/User-Centered Design (UCD) into agile methods is not adequately addressed. This paper presents the preliminary results of a recently conducted online survey regarding the current state of the integration of agile methods and usability/UCD. A world wide response of 92 practitioners was received. The results show that the majority of practitioners perceive that the integration of agile methods with usability/UCD has added value to their adopted processes and to their teams; has resulted in the improvement of usability and quality of the product developed; and has increased the satisfaction of the end-users of the product developed. The top most used HCI techniques are low-fidelity prototyping, conceptual designs, observational studies of users, usability expert evaluations, field studies, personas, rapid iterative testing, and laboratory usability testing.

A Comparison of What Is Part of Usability Testing in Three Countries

NASA Astrophysics Data System (ADS)

Clemmensen, Torkil

The cultural diversity of users of technology challenges our methods for usability evaluation. In this paper we report and compare three ethnographic interview studies of what is a part of a standard (typical) usability test in a company in Mumbai, Beijing and Copenhagen. At each of these three locations, we use structural and contrast questions do a taxonomic and paradigm analysis of a how a company performs a usability test. We find similar parts across the three locations. We also find different results for each location. In Mumbai, most parts of the usability test are not related to the interactive application that is tested, but to differences in user characteristics, test preparation, method, and location. In Copenhagen, considerations about the client's needs are part of a usability test. In Beijing, the only varying factor is the communication pattern and relation to the user. These results are then contrasted in a cross cultural matrix to identify cultural themes that can help interpret results from existing laboratory research in usability test methods.

A user experience evaluation of Amazon Kindle mobile application

NASA Astrophysics Data System (ADS)

Hussain, Azham; Mkpojiogu, Emmanuel O. C.; Musa, Ja'afaru; Mortada, Salah

2017-10-01

There is a dramatic increase in the development of mobile applications in recent years. This makes the usability evaluation of these mobile applications an important aspect in the advancement and application of technology. In this paper, a laboratory-based usability evaluation was carried out on the Amazon Kindle app using 15 users who performed 5 tasks on the Kindle e-book mobile app. A post-test questionnaire was administered to elicit users' perception on the usability of the application. The results demonstrate that almost all the participants were satisfied with services provided by the Amazon Kindle e-book mobile app. On all the four user experience factors examined, namely, perceived ease-of-use, perceived visibility, perceived enjoyabilty, and perceived efficiency, the evaluation outcome shows that the participants had a good and rich mobile experience with the application.

Human Factors for Nursing: From In-Situ Testing to Mobile Usability Engineering.

PubMed

Kushniruk, Andre W; Borycki, Elizabeth M; Solvoll, Terje; Hullin, Carola

2016-01-01

The tutorial goal is to familiarize participants with human aspects of health informatics and human-centered approaches to the design, evaluation and deployment of both usable and safe healthcare information systems. The focus will be on demonstrating and teaching practical and low-cost methods for evaluating mobile applications in nursing. Basic background to testing methods will be provided, followed by live demonstration of the methods. Then the audience will break into small groups to explore the application of the methods to applications of interest (there will be a number of possible applications that will be available for applications in areas such as electronic health records and decision support, however, if the groups have applications of specific interest to them that will be possible). The challenges of conducting usability testing, and in particular mobile usability testing will be discussed along with practical solutions. The target audience includes practicing nurses and nurse researchers, nursing informatics specialists, nursing students, nursing managers and health informatics professionals interested in improving the usability and safety of healthcare applications.

Usability Evaluation of NLP-PIER: A Clinical Document Search Engine for Researchers.

PubMed

Hultman, Gretchen; McEwan, Reed; Pakhomov, Serguei; Lindemann, Elizabeth; Skube, Steven; Melton, Genevieve B

2017-01-01

NLP-PIER (Natural Language Processing - Patient Information Extraction for Research) is a self-service platform with a search engine for clinical researchers to perform natural language processing (NLP) queries using clinical notes. We conducted user-centered testing of NLP-PIER's usability to inform future design decisions. Quantitative and qualitative data were analyzed. Our findings will be used to improve the usability of NLP-PIER.

User ratings of prosthetic usability and satisfaction in VA study to optimize DEKA arm.

PubMed

Resnik, Linda; Borgia, Matthew

2014-01-01

The Department of Veterans Affairs study to optimize the DEKA Arm provided feedback to inform optimization of the gen 2 (second-generation) prototype and evaluate the gen 3 (third-generation) prototype. This article summarizes recommendations to improve gen 2 and reports satisfaction and usability ratings of gen 2 and gen 3. Data were collected from 39 subjects; 37 subjects were included in this analysis. Of the subjects, 24 were fit with gen 2 (8 radial configuration [RC], 6 humeral configuration [HC], and 10 shoulder configuration [SC]), 13 were fit with gen 3 (4 RC, 5 HC, and 4 SC), and 5 were fit with both. Usability and satisfaction were evaluated using the Trinity Amputation and Prosthesis Experience Scale (TAPES) and study-specific usability and satisfaction scales. Descriptive statistics were examined and prototypes compared using Wilcoxon rank-sum. Results were stratified by configuration level and outcomes compared by prototype. Satisfaction and usability were greater for gen 3 than gen 2. Overall TAPES scores were similar; however, scores of the TAPES aesthetic satisfaction subscale were higher for gen 3. Compared with gen 2 users, gen 3 users were more satisfied with appearance, grips, and doffing and rated overall usability higher. Features of gen 3, including weight, external cables and wires, hand covering, and fingernails, would benefit from further optimization.

Usability Evaluations of a Wearable Inertial Sensing System and Quality of Movement Metrics for Stroke Survivors by Care Professionals.

PubMed

Klaassen, Bart; van Beijnum, Bert-Jan F; Held, Jeremia P; Reenalda, Jasper; van Meulen, Fokke B; Veltink, Peter H; Hermens, Hermie J

2017-01-01

Inertial motion capture systems are used in many applications such as measuring the movement quality in stroke survivors. The absence of clinical effectiveness and usability evidence in these assistive technologies into rehabilitation has delayed the transition of research into clinical practice. Recently, a new inertial motion capture system was developed in a project, called INTERACTION, to objectively measure the quality of movement (QoM) in stroke survivors during daily-life activity. With INTERACTION, we are to be able to investigate into what happens with patients after discharge from the hospital. Resulting QoM metrics, where a metric is defined as a measure of some property, are subsequently presented to care professionals. Metrics include for example: reaching distance, walking speed, and hand distribution plots. The latter shows a density plot of the hand position in the transversal plane. The objective of this study is to investigate the opinions of care professionals in using these metrics obtained from INTERACTION and its usability. By means of a semi-structured interview, guided by a presentation, presenting two patient reports. Each report includes several QoM metric (like reaching distance, hand position density plots, shoulder abduction) results obtained during daily-life measurements and in clinic and were evaluated by care professionals not related to the project. The results were compared with care professionals involved within the INTERACTION project. Furthermore, two questionnaires (5-point Likert and open questionnaire) were handed over to rate the usability of the metrics and to investigate if they would like such a system in their clinic. Eleven interviews were conducted, where each interview included either two or three care professionals as a group, in Switzerland and The Netherlands. Evaluation of the case reports (CRs) by participants and INTERACTION members showed a high correlation for both lower and upper extremity metrics. Participants were most in favor of hand distribution plots during daily-life activities. All participants mentioned that visualizing QoM of stroke survivors over time during daily-life activities has more possibilities compared to current clinical assessments. They also mentioned that these metrics could be important for self-evaluation of stroke survivors. The results showed that most participants were able to understand the metrics presented in the CRs. For a few metrics, it remained difficult to assess the underlying cause of the QoM. Hence, a combination of metrics is needed to get a better insight of the patient. Furthermore, it remains important to report the state (e.g., how the patient feels), its surroundings (outside, inside the house, on a slippery surface), and detail of specific activities (does the patient grasps a piece of paper or a heavy cooking pan but also dual tasks). Altogether, it remains a questions how to determine what the patient is doing and where the patient is doing his or her activities.

Evaluation of User Interface and Workflow Design of a Bedside Nursing Clinical Decision Support System

PubMed Central

Yuan, Michael Juntao; Finley, George Mike; Mills, Christy; Johnson, Ron Kim

2013-01-01

Background Clinical decision support systems (CDSS) are important tools to improve health care outcomes and reduce preventable medical adverse events. However, the effectiveness and success of CDSS depend on their implementation context and usability in complex health care settings. As a result, usability design and validation, especially in real world clinical settings, are crucial aspects of successful CDSS implementations. Objective Our objective was to develop a novel CDSS to help frontline nurses better manage critical symptom changes in hospitalized patients, hence reducing preventable failure to rescue cases. A robust user interface and implementation strategy that fit into existing workflows was key for the success of the CDSS. Methods Guided by a formal usability evaluation framework, UFuRT (user, function, representation, and task analysis), we developed a high-level specification of the product that captures key usability requirements and is flexible to implement. We interviewed users of the proposed CDSS to identify requirements, listed functions, and operations the system must perform. We then designed visual and workflow representations of the product to perform the operations. The user interface and workflow design were evaluated via heuristic and end user performance evaluation. The heuristic evaluation was done after the first prototype, and its results were incorporated into the product before the end user evaluation was conducted. First, we recruited 4 evaluators with strong domain expertise to study the initial prototype. Heuristic violations were coded and rated for severity. Second, after development of the system, we assembled a panel of nurses, consisting of 3 licensed vocational nurses and 7 registered nurses, to evaluate the user interface and workflow via simulated use cases. We recorded whether each session was successfully completed and its completion time. Each nurse was asked to use the National Aeronautics and Space Administration (NASA) Task Load Index to self-evaluate the amount of cognitive and physical burden associated with using the device. Results A total of 83 heuristic violations were identified in the studies. The distribution of the heuristic violations and their average severity are reported. The nurse evaluators successfully completed all 30 sessions of the performance evaluations. All nurses were able to use the device after a single training session. On average, the nurses took 111 seconds (SD 30 seconds) to complete the simulated task. The NASA Task Load Index results indicated that the work overhead on the nurses was low. In fact, most of the burden measures were consistent with zero. The only potentially significant burden was temporal demand, which was consistent with the primary use case of the tool. Conclusions The evaluation has shown that our design was functional and met the requirements demanded by the nurses’ tight schedules and heavy workloads. The user interface embedded in the tool provided compelling utility to the nurse with minimal distraction. PMID:23612350

Usability of Low-Cost Android Data Collection System for Community-Based Participatory Research.

PubMed

Salihu, Hamisu M; Salinas-Miranda, Abraham; Turner, DeAnne; King, Lindsey; Paothong, Arnut; Austin, Deborah; Berry, Estrellita Lo

2016-01-01

Android tablet computers can be valuable tools for data collection, but their usability has not been evaluated in community-based participatory research (CBPR). This article examines the usability of a low-cost bilingual touchscreen computerized survey system using Android tablets, piloted with a sample of 201 community residents in Tampa, Florida, from November 2013 to March 2014. Needs assessment questions were designed with the droidSURVEY software, and deployed using Android tablet computers. In addition, participants were asked questions about system usability. The mean system usability was 77.57 ± 17.66 (range, 0-100). The mean completion time for taking the 63 survey questions in the needs assessment was 23.11 ± 9.62 minutes. The survey completion rate was optimal (100%), with only 6.34% missingness per variable. We found no sociodemographic differences in usability scores. Our findings indicate that Android tablets could serve as useful tools in CBPR studies.

Usability engineering: domain analysis activities for augmented-reality systems

NASA Astrophysics Data System (ADS)

Gabbard, Joseph; Swan, J. E., II; Hix, Deborah; Lanzagorta, Marco O.; Livingston, Mark; Brown, Dennis B.; Julier, Simon J.

2002-05-01

This paper discusses our usability engineering process for the Battlefield Augmented Reality System (BARS). Usability engineering is a structured, iterative, stepwise development process. Like the related disciplines of software and systems engineering, usability engineering is a combination of management principals and techniques, formal and semi- formal evaluation techniques, and computerized tools. BARS is an outdoor augmented reality system that displays heads- up battlefield intelligence information to a dismounted warrior. The paper discusses our general usability engineering process. We originally developed the process in the context of virtual reality applications, but in this work we are adapting the procedures to an augmented reality system. The focus of this paper is our work on domain analysis, the first activity of the usability engineering process. We describe our plans for and our progress to date on our domain analysis for BARS. We give results in terms of a specific urban battlefield use case we have designed.

Older Adults' Acceptance of Activity Trackers

PubMed Central

Preusse, Kimberly C.; Mitzner, Tracy L.; Fausset, Cara Bailey; Rogers, Wendy A.

2016-01-01

Objective To assess the usability and acceptance of activity tracking technologies by older adults. Method First in our multi-method approach, we conducted heuristic evaluations of two activity trackers that revealed potential usability barriers to acceptance. Next, questionnaires and interviews were administered to 16 older adults (Mage=70, SDage=3.09, rangeage= 65-75) before and after a 28-day field study to understand facilitators and additional barriers to acceptance. These measurements were supplemented with diary and usage data and assessed if and why users overcame usability issues. Results The heuristic evaluation revealed usability barriers in System Status Visibility; Error Prevention; and Consistency and Standards. The field study revealed additional barriers (e.g., accuracy, format), and acceptance-facilitators (e.g., goal-tracking, usefulness, encouragement). Discussion The acceptance of wellness management technologies, such as activity trackers, may be increased by addressing acceptance-barriers during deployment (e.g., providing tutorials on features that were challenging, communicating usefulness). PMID:26753803

Lessons learned from the usability assessment of home-based telemedicine systems.

PubMed

Agnisarman, Sruthy Orozhiyathumana; Chalil Madathil, Kapil; Smith, Kevin; Ashok, Aparna; Welch, Brandon; McElligott, James T

2017-01-01

At-home telemedicine visits are quickly becoming an acceptable alternative for in-person patient visits. However, little work has been done to understand the usability of these home-based telemedicine solutions. It is critical for user acceptance and real-world applicability to evaluate available telemedicine solutions within the context-specific needs of the users of this technology. To address this need, this study evaluated the usability of four home-based telemedicine software platforms: Doxy.me, Vidyo, VSee, and Polycom. Using a within-subjects experimental design, twenty participants were asked to complete a telemedicine session involving several tasks using the four platforms. Upon completion of these tasks for each platform, participants completed the IBM computer system usability questionnaire (CSUQ) and the NASA Task Load Index test. Upon completing the tasks on all four platforms, the participants completed a final post-test subjective questionnaire ranking the platforms based on their preference. Of the twenty participants, 19 completed the study. Statistically significant differences among the telemedicine software platforms were found for task completion time, total workload, mental demand, effort, frustration, preference ranking and computer system usability scores. Usability problems with installation and account creation led to high mental demand and task completion time, suggesting the participants preferred a system without such requirements. Majority of the usability issues were identified at the telemedicine initiation phase. The findings from this study can be used by software developers to develop user-friendly telemedicine systems. Copyright © 2016 Elsevier Ltd. All rights reserved.

Evaluating the usability of an interactive, bi-lingual, touchscreen-enabled breastfeeding educational programme: application of Nielson's heuristics.

PubMed

Joshi, Ashish; Perin, Douglas M Puricelli; Amadi, Chioma; Trout, Kate

2015-03-05

The study purpose was to conduct heuristic evaluation of an interactive, bilingual touchscreen-enabled breastfeeding educational programme for Hispanic women living in rural settings in Nebraska. Three raters conducted the evaluation during May 2013 using principles of Nielson's heuristics. A total of 271 screens were evaluated and included: interface (n = 5), programme sections (n = 223) and educational content (n = 43). A total of 97 heuristic violations were identified and were mostly related to interface (8 violations/5 screens) and programme components (89 violations/266 screens). The most common heuristic violations reported were recognition rather than recall (62%, n = 60), consistency and standards (14%, n = 14) and match between the system and real world (9%, n = 9). Majority of the heuristic violations had minor usability issues (73%, n = 71). The only grade 4 heuristic violation reported was due to the visibility of system status in the assessment modules. The results demonstrated that the system was more consistent with Nielsen's usability heuristics. With Nielsen's usability heuristics, it is possible to identify problems in a timely manner, and help facilitate the identification and prioritisation of problems needing urgent attention at an earlier stage before the final deployment of the system.

Design and evaluation of a software prototype for participatory planning of environmental adaptations.

PubMed

Eriksson, J; Ek, A; Johansson, G

2000-03-01

A software prototype to support the planning process for adapting home and work environments for people with physical disabilities was designed and later evaluated. The prototype exploits low-cost three-dimensional (3-D) graphics products in the home computer market. The essential features of the prototype are: interactive rendering with optional hardware acceleration, interactive walk-throughs, direct manipulation tools for moving objects and measuring distances, and import of 3-D-objects from a library. A usability study was conducted, consisting of two test sessions (three weeks apart) and a final interview. The prototype was then tested and evaluated by representatives of future users: five occupational therapist students, and four persons with physical disability, with no previous experience of the prototype. Emphasis in the usability study was placed on the prototype's efficiency and learnability. We found that it is possible to realise a planning tool for environmental adaptations, both regarding usability and technical efficiency. The usability evaluation confirms our findings from previous case studies, regarding the relevance and positive attitude towards this kind of planning tool. Although the prototype was found to be satisfactorily efficient for the basic tasks, the paper presents several suggestions for improvement of future prototype versions.

User-friendly technology to help family carers cope.

PubMed

Chambers, Mary; Connor, Samantha L

2002-12-01

Increases in the older adult population are occurring simultaneously with a growth in new technology. Modern technology presents an opportunity to enhance the quality of life and independence of older people and their family carers through communication and access to health care information. To evaluate the usability of a multimedia software application designed to provide family carers of the elderly or disabled with information, advice and psychological support to increase their coping capacity. The interactive application consisted of an information-based package that provided carers with advice on the promotion of psychological health, including relaxation and other coping strategies. The software application also included a carer self-assessment instrument, designed to provide both family and professional carers with information to assess how family carers were coping with their care-giving role. Usability evaluation was carried out in two stages. In the first stage (verification), user trials and an evaluation questionnaire were used to refine and develop the content and usability of the multimedia software application. In the second (demonstration), stage evaluation questionnaires were used to appraise the usability of the modified software application. The findings evidenced that the majority of users found the software to be usable and informative. Some areas were highlighted for improvement in the navigation of the software. The authors conclude that with further refinement, the software application has the potential to offer information and support to those who are caring for the elderly and disabled at home.

Heuristic Evaluation and Usability Testing of a Computerized Patient-Reported Outcomes Survey for Headache Sufferers

PubMed Central

Saris-Baglama, Renee N.; Smith, Kevin J.; DeRosa, Michael A.; Paulsen, Christine A.; Hogue, Sarah J.

2011-01-01

Abstract Objective The aim of this study was to evaluate usability of a prototype tablet PC-administered computerized adaptive test (CAT) of headache impact and patient feedback report, referred to as HEADACHE-CAT. Materials and Methods Heuristic evaluation specialists (n = 2) formed a consensus opinion on the application's strengths and areas for improvement based on general usability principles and human factors research. Usability testing involved structured interviews with headache sufferers (n = 9) to assess how they interacted with and navigated through the application, and to gather input on the survey and report interface, content, visual design, navigation, instructions, and user preferences. Results Specialists identified the need for improved instructions and text formatting, increased font size, page setup that avoids scrolling, and simplified presentation of feedback reports. Participants found the tool useful, and indicated a willingness to complete it again and recommend it to their healthcare provider. However, some had difficulty using the onscreen keyboard and autoadvance option; understanding the difference between generic and headache-specific questions; and interpreting score reports. Conclusions Heuristic evaluation and user testing can help identify usability problems in the early stages of application development, and improve the construct validity of electronic assessments such as the HEADACHE-CAT. An improved computerized HEADACHE-CAT measure can offer headache sufferers an efficient tool to increase patient self-awareness, monitor headaches over time, aid patient–provider communications, and improve quality of life. PMID:21214341

A personal health information toolkit for health intervention research.

PubMed

Kizakevich, Paul N; Eckhoff, Randall; Weger, Stacey; Weeks, Adam; Brown, Janice; Bryant, Stephanie; Bakalov, Vesselina; Zhang, Yuying; Lyden, Jennifer; Spira, James

2014-01-01

With the emergence of mobile health (mHealth) apps, there is a growing demand for better tools for developing and evaluating mobile health interventions. Recently we developed the Personal Health Intervention Toolkit (PHIT), a software framework which eases app implementation and facilitates scientific evaluation. PHIT integrates self-report and physiological sensor instruments, evidence-based advisor logic, and self-help interventions such as meditation, health education, and cognitive behavior change. PHIT can be used to facilitate research, interventions for chronic diseases, risky behaviors, sleep, medication adherence, environmental monitoring, momentary data collection health screening, and clinical decision support. In a series of usability evaluations, participants reported an overall usability score of 4.5 on a 1-5 Likert scale and an 85 score on the System Usability Scale, indicating a high percentile rank of 95%.

Quantifying usability: an evaluation of a diabetes mHealth system on effectiveness, efficiency, and satisfaction metrics with associated user characteristics.

PubMed

Georgsson, Mattias; Staggers, Nancy

2016-01-01

Mobile health (mHealth) systems are becoming more common for chronic disease management, but usability studies are still needed on patients' perspectives and mHealth interaction performance. This deficiency is addressed by our quantitative usability study of a mHealth diabetes system evaluating patients' task performance, satisfaction, and the relationship of these measures to user characteristics. We used metrics in the International Organization for Standardization (ISO) 9241-11 standard. After standardized training, 10 patients performed representative tasks and were assessed on individual task success, errors, efficiency (time on task), satisfaction (System Usability Scale [SUS]) and user characteristics. Tasks of exporting and correcting values proved the most difficult, had the most errors, the lowest task success rates, and consumed the longest times on task. The average SUS satisfaction score was 80.5, indicating good but not excellent system usability. Data trends showed males were more successful in task completion, and younger participants had higher performance scores. Educational level did not influence performance, but a more recent diabetes diagnosis did. Patients with more experience in information technology (IT) also had higher performance rates. Difficult task performance indicated areas for redesign. Our methods can assist others in identifying areas in need of improvement. Data about user background and IT skills also showed how user characteristics influence performance and can provide future considerations for targeted mHealth designs. Using the ISO 9241-11 usability standard, the SUS instrument for satisfaction and measuring user characteristics provided objective measures of patients' experienced usability. These could serve as an exemplar for standardized, quantitative methods for usability studies on mHealth systems. © The Author 2015. Published by Oxford University Press on behalf of the American Medical Informatics Association.

Quantifying usability: an evaluation of a diabetes mHealth system on effectiveness, efficiency, and satisfaction metrics with associated user characteristics

PubMed Central

Staggers, Nancy

2016-01-01

Objective Mobile health (mHealth) systems are becoming more common for chronic disease management, but usability studies are still needed on patients’ perspectives and mHealth interaction performance. This deficiency is addressed by our quantitative usability study of a mHealth diabetes system evaluating patients’ task performance, satisfaction, and the relationship of these measures to user characteristics. Materials and Methods We used metrics in the International Organization for Standardization (ISO) 9241-11 standard. After standardized training, 10 patients performed representative tasks and were assessed on individual task success, errors, efficiency (time on task), satisfaction (System Usability Scale [SUS]) and user characteristics. Results Tasks of exporting and correcting values proved the most difficult, had the most errors, the lowest task success rates, and consumed the longest times on task. The average SUS satisfaction score was 80.5, indicating good but not excellent system usability. Data trends showed males were more successful in task completion, and younger participants had higher performance scores. Educational level did not influence performance, but a more recent diabetes diagnosis did. Patients with more experience in information technology (IT) also had higher performance rates. Discussion Difficult task performance indicated areas for redesign. Our methods can assist others in identifying areas in need of improvement. Data about user background and IT skills also showed how user characteristics influence performance and can provide future considerations for targeted mHealth designs. Conclusion Using the ISO 9241-11 usability standard, the SUS instrument for satisfaction and measuring user characteristics provided objective measures of patients’ experienced usability. These could serve as an exemplar for standardized, quantitative methods for usability studies on mHealth systems. PMID:26377990

A usability evaluation of four commercial dental computer-based patient record systems

PubMed Central

Thyvalikakath, Thankam P.; Monaco, Valerie; Thambuganipalle, Hima Bindu; Schleyer, Titus

2008-01-01

Background The usability of dental computer-based patient record (CPR) systems has not been studied, despite early evidence that poor usability is a problem for dental CPR system users at multiple levels. Methods The authors conducted formal usability tests of four dental CPR systems by using a purposive sample of four groups of five novice users. The authors measured task outcomes (correctly completed, incorrectly completed and incomplete) in each CPR system while the participants performed nine clinical documentation tasks, as well as the number of usability problems identified in each CPR system and their potential relationship to task outcomes. The authors reviewed the software application design aspects responsible for these usability problems. Results The range for correctly completed tasks was 16 to 64 percent, for incorrectly completed tasks 18 to 38 percent and for incomplete tasks 9 to 47 percent. The authors identified 286 usability problems. The main types were three unsuccessful attempts, negative affect and task incorrectly completed. They also identified six problematic interface and interaction designs that led to usability problems. Conclusion The four dental CPR systems studied have significant usability problems for novice users, resulting in a steep learning curve and potentially reduced system adoption. Clinical Implications The significant number of data entry errors raises concerns about the quality of documentation in clinical practice. PMID:19047669

Surface operations usability study utilizing Capstone phase I avionics : quick look report

DOT National Transportation Integrated Search

2000-10-07

Evaluate usability, suitability and acceptability of of the surface moving map implemented within Capstone Phase 1 Avionics for surface operations : Task 1: Airport Surface Situational Awareness (ASSA) : Task 2: Surface-Final Approach Runway Occupanc...

Better bioinformatics through usability analysis.

PubMed

Bolchini, Davide; Finkelstein, Anthony; Perrone, Vito; Nagl, Sylvia

2009-02-01

Improving the usability of bioinformatics resources enables researchers to find, interact with, share, compare and manipulate important information more effectively and efficiently. It thus enables researchers to gain improved insights into biological processes with the potential, ultimately, of yielding new scientific results. Usability 'barriers' can pose significant obstacles to a satisfactory user experience and force researchers to spend unnecessary time and effort to complete their tasks. The number of online biological databases available is growing and there is an expanding community of diverse users. In this context there is an increasing need to ensure the highest standards of usability. Using 'state-of-the-art' usability evaluation methods, we have identified and characterized a sample of usability issues potentially relevant to web bioinformatics resources, in general. These specifically concern the design of the navigation and search mechanisms available to the user. The usability issues we have discovered in our substantial case studies are undermining the ability of users to find the information they need in their daily research activities. In addition to characterizing these issues, specific recommendations for improvements are proposed leveraging proven practices from web and usability engineering. The methods and approach we exemplify can be readily adopted by the developers of bioinformatics resources.

Smartphone Apps for Cardiopulmonary Resuscitation Training and Real Incident Support: A Mixed-Methods Evaluation Study

PubMed Central

Felzen, Marc; Rossaint, Rolf; Tabuenca, Bernardo; Specht, Marcus; Skorning, Max

2014-01-01

Background No systematic evaluation of smartphone/mobile apps for resuscitation training and real incident support is available to date. To provide medical, usability, and additional quality criteria for the development of apps, we conducted a mixed-methods sequential evaluation combining the perspective of medical experts and end-users. Objective The study aims to assess the quality of current mobile apps for cardiopulmonary resuscitation (CPR) training and real incident support from expert as well as end-user perspective. Methods Two independent medical experts evaluated the medical content of CPR apps from the Google Play store and the Apple App store. The evaluation was based on pre-defined minimum medical content requirements according to current Basic Life Support (BLS) guidelines. In a second phase, non-medical end-users tested usability and appeal of the apps that had at least met the minimum requirements. Usability was assessed with the System Usability Scale (SUS); appeal was measured with the self-developed ReactionDeck toolkit. Results Out of 61 apps, 46 were included in the experts’ evaluation. A consolidated list of 13 apps resulted for the following layperson evaluation. The interrater reliability was substantial (kappa=.61). Layperson end-users (n=14) had a high interrater reliability (intraclass correlation 1 [ICC1]=.83, P<.001, 95% CI 0.75-0.882 and ICC2=.79, P<.001, 95% CI 0.695-0.869). Their evaluation resulted in a list of 5 recommendable apps. Conclusions Although several apps for resuscitation training and real incident support are available, very few are designed according to current BLS guidelines and offer an acceptable level of usability and hedonic quality for laypersons. The results of this study are intended to optimize the development of CPR mobile apps. The app ranking supports the informed selection of mobile apps for training situations and CPR campaigns as well as for real incident support. PMID:24647361

Smartphone apps for cardiopulmonary resuscitation training and real incident support: a mixed-methods evaluation study.

PubMed

Kalz, Marco; Lenssen, Niklas; Felzen, Marc; Rossaint, Rolf; Tabuenca, Bernardo; Specht, Marcus; Skorning, Max

2014-03-19

No systematic evaluation of smartphone/mobile apps for resuscitation training and real incident support is available to date. To provide medical, usability, and additional quality criteria for the development of apps, we conducted a mixed-methods sequential evaluation combining the perspective of medical experts and end-users. The study aims to assess the quality of current mobile apps for cardiopulmonary resuscitation (CPR) training and real incident support from expert as well as end-user perspective. Two independent medical experts evaluated the medical content of CPR apps from the Google Play store and the Apple App store. The evaluation was based on pre-defined minimum medical content requirements according to current Basic Life Support (BLS) guidelines. In a second phase, non-medical end-users tested usability and appeal of the apps that had at least met the minimum requirements. Usability was assessed with the System Usability Scale (SUS); appeal was measured with the self-developed ReactionDeck toolkit. Out of 61 apps, 46 were included in the experts' evaluation. A consolidated list of 13 apps resulted for the following layperson evaluation. The interrater reliability was substantial (kappa=.61). Layperson end-users (n=14) had a high interrater reliability (intraclass correlation 1 [ICC1]=.83, P<.001, 95% CI 0.75-0.882 and ICC2=.79, P<.001, 95% CI 0.695-0.869). Their evaluation resulted in a list of 5 recommendable apps. Although several apps for resuscitation training and real incident support are available, very few are designed according to current BLS guidelines and offer an acceptable level of usability and hedonic quality for laypersons. The results of this study are intended to optimize the development of CPR mobile apps. The app ranking supports the informed selection of mobile apps for training situations and CPR campaigns as well as for real incident support.

Usability Methods for Ensuring Health Information Technology Safety: Evidence-Based Approaches. Contribution of the IMIA Working Group Health Informatics for Patient Safety.

PubMed

Borycki, E; Kushniruk, A; Nohr, C; Takeda, H; Kuwata, S; Carvalho, C; Bainbridge, M; Kannry, J

2013-01-01

Issues related to lack of system usability and potential safety hazards continue to be reported in the health information technology (HIT) literature. Usability engineering methods are increasingly used to ensure improved system usability and they are also beginning to be applied more widely for ensuring the safety of HIT applications. These methods are being used in the design and implementation of many HIT systems. In this paper we describe evidence-based approaches to applying usability engineering methods. A multi-phased approach to ensuring system usability and safety in healthcare is described. Usability inspection methods are first described including the development of evidence-based safety heuristics for HIT. Laboratory-based usability testing is then conducted under artificial conditions to test if a system has any base level usability problems that need to be corrected. Usability problems that are detected are corrected and then a new phase is initiated where the system is tested under more realistic conditions using clinical simulations. This phase may involve testing the system with simulated patients. Finally, an additional phase may be conducted, involving a naturalistic study of system use under real-world clinical conditions. The methods described have been employed in the analysis of the usability and safety of a wide range of HIT applications, including electronic health record systems, decision support systems and consumer health applications. It has been found that at least usability inspection and usability testing should be applied prior to the widespread release of HIT. However, wherever possible, additional layers of testing involving clinical simulations and a naturalistic evaluation will likely detect usability and safety issues that may not otherwise be detected prior to widespread system release. The framework presented in the paper can be applied in order to develop more usable and safer HIT, based on multiple layers of evidence.

Reproducibility of Tumor Motion Probability Distribution Function in Stereotactic Body Radiation Therapy of Lung Cancer

DOE Office of Scientific and Technical Information (OSTI.GOV)

Zhang Fan; Medical Physics Graduate Program, Duke University, Durham, North Carolina; Hu Jing

2012-11-01

Purpose: To evaluate the reproducibility of tumor motion probability distribution function (PDF) in stereotactic body radiation therapy (SBRT) of lung cancer using cine megavoltage (MV) images. Methods and Materials: Cine MV images of 20 patients acquired during three-dimensional conformal (6-11 beams) SBRT treatments were retrospectively analyzed to extract tumor motion trajectories. For each patient, tumor motion PDFs were generated per fraction (PDF{sub n}) using three selected 'usable' beams. Patients without at least three usable beams were excluded from the study. Fractional PDF reproducibility (R{sub n}) was calculated as the Dice similarity coefficient between PDF{sub n} to a 'ground-truth' PDF (PDF{submore » g}), which was generated using the selected beams of all fractions. The mean of R{sub n}, labeled as R{sub m}, was calculated for each patient and correlated to the patient's mean tumor motion rang (A{sub m}). Change of R{sub m} during the course of SBRT treatments was also evaluated. Intra- and intersubject coefficient of variation (CV) of R{sub m} and A{sub m} were determined. Results: Thirteen patients had at least three usable beams and were analyzed. The mean of R{sub m} was 0.87 (range, 0.84-0.95). The mean of A{sub m} was 3.18 mm (range, 0.46-7.80 mm). R{sub m} was found to decrease as A{sub m} increases following an equation of R{sub m} = 0.17e{sup -0.9Am} + 0.84. R{sub m} also decreased slightly throughout the course of treatments. Intersubject CV of R{sub m} (0.05) was comparable to intrasubject CV of R{sub m} (range, 0.02-0.09); intersubject CV of A{sub m} (0.73) was significantly greater than intrasubject CV of A{sub m} (range, 0.09-0.24). Conclusions: Tumor motion PDF can be determined using cine MV images acquired during the treatments. The reproducibility of lung tumor motion PDF decreased exponentially as the tumor motion range increased and decreased slightly throughout the course of the treatments.« less

Ergonomic Evaluation of the Foot Restraint Equipment Device (FRED)

NASA Technical Reports Server (NTRS)

Whitmore, Mihriban; Chmielewski, Cindy; Qazi, A. S.; Mount, Francis

1999-01-01

Within the scope of the Microgravity Workstation and Restraint Evaluation project, funded by the NASA Headquarters Life Sciences Division, evaluations were proposed to be conducted in ground, KC-135, and/or Shuttle environments to investigate the human factors engineering (HFE) issues concerning confined/unique workstations, including crew restraint requirements. As part of these evaluations, KC-135 flights were conducted to investigate user/ workstation/ restraint integration for microgravity use of the FRED with the RMS workstation. This evaluation was a pre-cursor to Detailed Supplementary Objective (DSO) - 904 on STS-88. On that mission, a small-statured astronaut will be using the FRED restraint while working at the Aft RMS workstation. The DSO will collect video for later posture analyses, as well as subjective data in the form of an electronic questionnaire. This report describes the current FRED KC-135 evaluations. The primary objectives were to evaluate the usability of the FRED and to verify the DSO in-flight setup. The restraint interface evaluation consisted of four basic areas of restraint use: 1) adjustability; 2) general usability and comfort; 3) usability at the RMS workstation; and 4) assembly and disassembly.

Engaging Community Stakeholders to Evaluate the Design, Usability, and Acceptability of a Chronic Obstructive Pulmonary Disease Social Media Resource Center

PubMed Central

Chaney, Beth; Chaney, Don; Paige, Samantha; Payne-Purvis, Caroline; Tennant, Bethany; Walsh-Childers, Kim; Sriram, PS; Alber, Julia

2015-01-01

Background Patients with chronic obstructive pulmonary disease (COPD) often report inadequate access to comprehensive patient education resources. Objective The purpose of this study was to incorporate community-engagement principles within a mixed-method research design to evaluate the usability and acceptability of a self-tailored social media resource center for medically underserved patients with COPD. Methods A multiphase sequential design (qual → QUANT → quant + QUAL) was incorporated into the current study, whereby a small-scale qualitative (qual) study informed the design of a social media website prototype that was tested with patients during a computer-based usability study (QUANT). To identify usability violations and determine whether or not patients found the website prototype acceptable for use, each patient was asked to complete an 18-item website usability and acceptability questionnaire, as well as a retrospective, in-depth, semistructured interview (quant + QUAL). Results The majority of medically underserved patients with COPD (n=8, mean 56 years, SD 7) found the social media website prototype to be easy to navigate and relevant to their self-management information needs. Mean responses on the 18-item website usability and acceptability questionnaire were very high on a scale of 1 (strongly disagree) to 5 (strongly agree) (mean 4.72, SD 0.33). However, the majority of patients identified several usability violations related to the prototype’s information design, interactive capabilities, and navigational structure. Specifically, 6 out of 8 (75%) patients struggled to create a log-in account to access the prototype, and 7 out of 8 patients (88%) experienced difficulty posting and replying to comments on an interactive discussion forum. Conclusions Patient perceptions of most social media website prototype features (eg, clickable picture-based screenshots of videos, comment tools) were largely positive. Mixed-method stakeholder feedback was used to make design recommendations, categorize usability violations, and prioritize potential solutions for improving the usability of a social media resource center for COPD patient education. PMID:25630449

The Use of an Adapted Health IT Usability Evaluation Model (Health-ITUEM) for Evaluating Consumer Reported Ratings of Diabetes mHealth Applications: Implications for Diabetes Care and Management

PubMed Central

Househ, Mowafa S.; Shubair, Mamdouh M.; Yunus, Faisel; Jamal, Amr; Aldossari, Bakheet

2015-01-01

Background: The aim of this paper is to present a usability analysis of the consumer ratings of key diabetes mHealth applications using an adapted Health IT Usability Evaluation Model (Health-ITUEM). Methods: A qualitative content analysis method was used to analyze publicly available consumer reported data posted on the Android Market and Google Play for four leading diabetes mHealth applications. Health-ITUEM concepts including information needs, flexibility/customizability, learnability, performance speed, and competency guided the categorization and analysis of the data. Health impact was an additional category that was included in the study. A total of 405 consumers’ ratings collected from January 9, 2014 to February 17, 2014 were included in the study. Results: Overall, the consumers’ ratings of the leading diabetes mHealth applications for both usability and health impacts were positive. The performance speed of the mHealth application and the information needs of the consumers were the primary usability factors impacting the use of the diabetes mHealth applications. There was also evidence on the positive health impacts of such applications. Conclusions: Consumers are more likely to use diabetes related mHealth applications that perform well and meet their information needs. Furthermore, there is preliminary evidence that diabetes mHealth applications can have positive impact on the health of patients. PMID:26635437

The Use of an Adapted Health IT Usability Evaluation Model (Health-ITUEM) for Evaluating Consumer Reported Ratings of Diabetes mHealth Applications: Implications for Diabetes Care and Management.

PubMed

Househ, Mowafa S; Shubair, Mamdouh M; Yunus, Faisel; Jamal, Amr; Aldossari, Bakheet

2015-10-01

The aim of this paper is to present a usability analysis of the consumer ratings of key diabetes mHealth applications using an adapted Health IT Usability Evaluation Model (Health-ITUEM). A qualitative content analysis method was used to analyze publicly available consumer reported data posted on the Android Market and Google Play for four leading diabetes mHealth applications. Health-ITUEM concepts including information needs, flexibility/customizability, learnability, performance speed, and competency guided the categorization and analysis of the data. Health impact was an additional category that was included in the study. A total of 405 consumers' ratings collected from January 9, 2014 to February 17, 2014 were included in the study. Overall, the consumers' ratings of the leading diabetes mHealth applications for both usability and health impacts were positive. The performance speed of the mHealth application and the information needs of the consumers were the primary usability factors impacting the use of the diabetes mHealth applications. There was also evidence on the positive health impacts of such applications. Consumers are more likely to use diabetes related mHealth applications that perform well and meet their information needs. Furthermore, there is preliminary evidence that diabetes mHealth applications can have positive impact on the health of patients.

A usability evaluation of medical software at an expert conference setting.

PubMed

Bond, Raymond Robert; Finlay, Dewar D; Nugent, Chris D; Moore, George; Guldenring, Daniel

2014-01-01

A usability test was employed to evaluate two medical software applications at an expert conference setting. One software application is a medical diagnostic tool (electrocardiogram [ECG] viewer) and the other is a medical research tool (electrode misplacement simulator [EMS]). These novel applications have yet to be adopted by the healthcare domain, thus, (1) we wanted to determine the potential user acceptance of these applications and (2) we wanted to determine the feasibility of evaluating medical diagnostic and medical research software at a conference setting as opposed to the conventional laboratory setting. The medical diagnostic tool (ECG viewer) was evaluated using seven delegates and the medical research tool (EMS) was evaluated using 17 delegates that were recruited at the 2010 International Conference on Computing in Cardiology. Each delegate/participant was required to use the software and undertake a set of predefined tasks during the session breaks at the conference. User interactions with the software were recorded using screen-recording software. The 'think-aloud' protocol was also used to elicit verbal feedback from the participants whilst they attempted the pre-defined tasks. Before and after each session, participants completed a pre-test and a post-test questionnaire respectively. The average duration of a usability session at the conference was 34.69 min (SD=10.28). However, taking into account that 10 min was dedicated to the pre-test and post-test questionnaires, the average time dedication to user interaction of the medical software was 24.69 min (SD=10.28). Given we have shown that usability data can be collected at conferences, this paper details the advantages of conference-based usability studies over the laboratory-based approach. For example, given delegates gather at one geographical location, a conference-based usability evaluation facilitates recruitment of a convenient sample of international subject experts. This would otherwise be very expensive to arrange. A conference-based approach also allows for data to be collected over a few days as opposed to months by avoiding administration duties normally involved in laboratory based approach, e.g. mailing invitation letters as part of a recruitment campaign. Following analysis of the user video recordings, 41 (previously unknown) use errors were identified in the advanced ECG viewer and 29 were identified in the EMS application. All use errors were given a consensus severity rating from two independent usability experts. Out of a rating scale of 4 (where 1=cosmetic and 4=critical), the average severity rating for the ECG viewer was 2.24 (SD=1.09) and the average severity rating for the EMS application was 2.34 (SD=0.97). We were also able to extract task completion rates and times from the video recordings to determine the effectiveness of the software applications. For example, six out of seven tasks were completed by all participants when using both applications. This statistic alone suggests both applications already have a high degree of usability. As well as extracting data from the video recordings, we were also able to extract data from the questionnaires. Using a semantic differential scale (where 1=poor and 5=excellent), delegates highly rated the 'responsiveness', 'usefulness', 'learnability' and the 'look and feel' of both applications. This study has shown the potential user acceptance and user-friendliness of the novel EMS and the ECG viewer applications within the healthcare domain. It has also shown that both medical diagnostic software and medical research software can be evaluated for their usability at an expert conference setting. The primary advantage of a conference-based usability evaluation over a laboratory-based evaluation is the high concentration of experts at one location, which is convenient, less time consuming and less expensive. Copyright © 2013 Elsevier Ireland Ltd. All rights reserved.

Applying usability testing techniques to improve a health promotion website.

PubMed

Hinchliffe, Anetta; Mummery, W Kerry

2008-04-01

Use of the Internet for health promotion is increasing; however, the lack of published research regarding website usability suggests that health promotion websites are being developed without consultation with their users or formal evaluation. This study conducted usability testing of an existing health promotion website to inform modifications and to identify common usability themes that should be addressed by organisations developing or maintaining a health promotion website. A combination of qualitative and quantitative techniques were implemented during the usability testing sessions to gather data from users while completing tasks on the website. Techniques included performance measures (time taken), direct observation (participant observation) and subjective user preferences (questionnaire and interview). Improvements to the website were measured in terms of reduced problems reported, reduced time taken to complete tasks and increased subjective reports. Seven usability themes emerged from the data: design, feedback, format, instructions, navigation, terminology and learnability. This study demonstrates the application of usability testing to the design and modification of a health promotion website and illustrates the areas or themes that can be used as a framework for testing and modification.

A web-based program for informal caregivers of persons with Alzheimer's disease: an iterative user-centered design.

PubMed

Cristancho-Lacroix, Victoria; Moulin, Florence; Wrobel, Jérémy; Batrancourt, Bénédicte; Plichart, Matthieu; De Rotrou, Jocelyne; Cantegreil-Kallen, Inge; Rigaud, Anne-Sophie

2014-09-15

Web-based programs have been developed for informal caregivers of people with Alzheimer's disease (PWAD). However, these programs can prove difficult to adopt, especially for older people, who are less familiar with the Internet than other populations. Despite the fundamental role of usability testing in promoting caregivers' correct use and adoption of these programs, to our knowledge, this is the first study describing this process before evaluating a program for caregivers of PWAD in a randomized clinical trial. The objective of the study was to describe the development process of a fully automated Web-based program for caregivers of PWAD, aiming to reduce caregivers' stress, and based on the user-centered design approach. There were 49 participants (12 health care professionals, 6 caregivers, and 31 healthy older adults) that were involved in a double iterative design allowing for the adaptation of program content and for the enhancement of website usability. This process included three component parts: (1) project team workshops, (2) a proof of concept, and (3) two usability tests. The usability tests were based on a mixed methodology using behavioral analysis, semistructured interviews, and a usability questionnaire. The user-centered design approach provided valuable guidelines to adapt the content and design of the program, and to improve website usability. The professionals, caregivers (mainly spouses), and older adults considered that our project met the needs of isolated caregivers. Participants underlined that contact between caregivers would be desirable. During usability observations, the mistakes of users were also due to ergonomics issues from Internet browsers and computer interfaces. Moreover, negative self-stereotyping was evidenced, when comparing interviews and results of behavioral analysis. Face-to-face psycho-educational programs may be used as a basis for Web-based programs. Nevertheless, a user-centered design approach involving targeted users (or their representatives) remains crucial for their correct use and adoption. For future user-centered design studies, we recommend to involve end-users from preconception stages, using a mixed research method in usability evaluations, and implementing pilot studies to evaluate acceptability and feasibility of programs.

Using scenarios and personas to enhance the effectiveness of heuristic usability evaluations for older adults and their care team.

PubMed

Kneale, Laura; Mikles, Sean; Choi, Yong K; Thompson, Hilaire; Demiris, George

2017-09-01

Using heuristics to evaluate user experience is a common methodology for human-computer interaction studies. One challenge of this method is the inability to tailor results towards specific end-user needs. This manuscript reports on a method that uses validated scenarios and personas of older adults and care team members to enhance heuristics evaluations of the usability of commercially available personal health records for homebound older adults. Our work extends the Chisnell and Redish heuristic evaluation methodology by using a protocol that relies on multiple expert reviews of each system. It further standardizes the heuristic evaluation process through the incorporation of task-based scenarios. We were able to use the modified version of the Chisnell and Redish heuristic evaluation methodology to identify potential usability challenges of two commercially available personal health record systems. This allowed us to: (1) identify potential usability challenges for specific types of users, (2) describe improvements that would be valuable to all end-users of the system, and (3) better understand how the interactions of different users may vary within a single personal health record. The methodology described in this paper may help designers of consumer health information technology tools, such as personal health records, understand the needs of diverse end-user populations. Such methods may be particularly helpful when designing systems for populations that are difficult to recruit for end-user evaluations through traditional methods. Copyright © 2017 Elsevier Inc. All rights reserved.

Usability evaluation of the SMART application for youth with mTBI.

PubMed

Dexheimer, Judith W; Kurowski, Brad G; Anders, Shilo H; McClanahan, Nicole; Wade, Shari L; Babcock, Lynn

2017-01-01

There is a dearth of evidence-based treatments available to address the significant morbidity associated with mild traumatic brain injury (mTBI). To address this gap, we designed a novel user-friendly, web-based application. We describe the preliminary evaluation of feasibility and usability of the application to promote recovery following mTBI in youth, the Self-Monitoring Activity-Restriction and Relaxation Treatment (SMART). SMART incorporates real-time recommendations for individualized symptom management and activity restriction along with training in cognitive-behavioral coping strategies. We conducted a usability evaluation to assess and modify the SMART system prior to further study and deployment. Children ages 11-18 years presenting to the emergency department were recruited after symptoms resolved. Usability was assessed using a 60-min think-aloud protocol of teens and parents describing their interaction with the application. Upon completion of the tasks, each participant also completed the system usability scale (SUS). We performed tests with 4 parent/child dyads. The average age of the children was 13 years (standard deviation=1.8). The parents were an average of 41.5 years old (standard deviation=6.2). Research revealed that the participants were enthusiastic about the interactive portions of the tool particularly the video based sessions. Parents were concerned about the speed at which their child might move through the program and the children thought that the system required large amounts of reading. Based on user feedback, researchers modified SMART to include an audio file in every module and improved the system's aesthetic properties. The mean SUS score was 85, with high SUS scores (>68) indicating satisfactory usability. High initial usability and favorable user feedback provide a foundation for further iterative development and testing of the SMART application as a tool for managing recovery from concussion. Copyright © 2016 Elsevier Ireland Ltd. All rights reserved.

Evaluating the Usability of a Professional Modeling Tool Repurposed for Middle School Learning

NASA Astrophysics Data System (ADS)

Peters, Vanessa L.; Songer, Nancy Butler

2013-10-01

This paper reports the results of a three-stage usability test of a modeling tool designed to support learners' deep understanding of the impacts of climate change on ecosystems. The design process involved repurposing an existing modeling technology used by professional scientists into a learning tool specifically designed for middle school students. To evaluate usability, we analyzed students' task performance and task completion time as they worked on an activity with the repurposed modeling technology. In stage 1, we conducted remote testing of an early modeling prototype with urban middle school students (n = 84). In stages 2 and 3, we used screencasting software to record students' mouse and keyboard movements during collaborative think-alouds (n = 22) and conducted a qualitative analysis of their peer discussions. Taken together, the study findings revealed two kinds of usability issues that interfered with students' productive use of the tool: issues related to the use of data and information, and issues related to the use of the modeling technology. The study findings resulted in design improvements that led to stronger usability outcomes and higher task performance among students. In this paper, we describe our methods for usability testing, our research findings, and our design solutions for supporting students' use of the modeling technology and use of data. The paper concludes with implications for the design and study of modeling technologies for science learning.

Physician satisfaction with a critical care clinical information system using a multimethod evaluation of usability.

PubMed

Hudson, Darren; Kushniruk, Andre; Borycki, Elizabeth; Zuege, Danny J

2018-04-01

Physician satisfaction with electronic medical records has often been poor. Usability has frequently been identified as a source for decreased satisfaction. While surveys can identify many issues, and are logistically easier to administer, they may miss issues identified using other methods This study sought to understand the level of physician satisfaction and usability issues associated with a critical care clinical information system (eCritical Alberta) implemented throughout the province of Alberta, Canada. All critical care attending physicians using the system were invited to participate in an online survey. Questions included components of the User Acceptance of Information Technology and Usability Questionnaire as well as free text feedback on system components. Physicians were also invited to participate in a think aloud test using simulated scenarios. The transcribed think aloud text and questionnaire were subjected to textual analysis. 82% of all eligible physicians completed the on-line survey (n = 61). Eight physicians were invited and seven completed the think aloud test. Overall satisfaction with the system was moderate. Usability was identified as a significant factor contributing to satisfaction. The major usability factors identified were system response time and layout. The think aloud component identified additional factors beyond those identified in the on-line survey. This study found a modestly high level of physician satisfaction with a province-wide clinical critical care information system. Usability continues to be a significant factor in physician satisfaction. Using multiple methods of evaluation can capture the benefits of a large sample size and deeper understanding of the issues. Copyright © 2018 Elsevier B.V. All rights reserved.

Ensuring quality Website redesign: the University of Maryland's experience.

PubMed

Fuller, D M; Hinegardner, P G

2001-10-01

The Web Redesign Committee at the Health Sciences and Human Services Library (HS/HSL) of the University of Maryland was formed to evaluate its site and oversee the site's redesign. The committee's goal was to design a site that would be functional, be usable, and provide the library with a more current image. Based on a literature review and discussions with colleagues, a usability study was conducted to gain a better understanding of how the Website was used. Volunteers from across the campus participated in the study. A Web-based survey was also used to gather feedback. To complement user input, library staff were asked to review the existing site. A prototype site was developed incorporating suggestions obtained from the evaluation mechanisms. The usability study was particularly useful because it identified problem areas, including terminology, which would have been overlooked by library staff. A second usability study was conducted to refine the prototype. The new site was launched in the spring of 2000. The usability studies were valuable mechanisms in designing the site. Users felt invested in the project, and the committee received valuable feedback. This process led to an improved Website and higher visibility for the library on campus.

Evaluating the parent-adolescent communication toolkit: Usability and preliminary content effectiveness of an online intervention.

PubMed

Toombs, Elaine; Unruh, Anita; McGrath, Patrick

2018-01-01

This study aimed to assess the Parent-Adolescent Communication Toolkit, an online intervention designed to help improve parent communication with their adolescents. Participant preferences for two module delivery systems (sequential and unrestricted module access) were identified. Usability assessment of the PACT intervention was completed using pre-test and posttest comparisons. Usability data, including participant completion and satisfaction ratings were examined. Parents ( N  =   18) of adolescents were randomized to a sequential or unrestricted chapter access group. Parent participants completed pre-test measures, the PACT intervention and posttest measures. Participants provided feedback for the intervention to improve modules and provided usability ratings. Adolescent pre- and posttest ratings were evaluated. Usability ratings were high and parent feedback was positive. The sequential module access groups rated the intervention content higher and completed more content than the unrestricted chapter access group, indicating support for the sequential access design. Parent mean posttest communication scores were significantly higher ( p  <   .05) than pre-test scores. No significant differences were detected for adolescent participants. Findings suggest that the Parent-Adolescent Communication Toolkit has potential to improve parent-adolescent communication but further effectiveness assessment is required.

Facilitating energy savings with programmable thermostats: evaluation and guidelines for the thermostat user interface.

PubMed

Peffer, Therese; Perry, Daniel; Pritoni, Marco; Aragon, Cecilia; Meier, Alan

2013-01-01

Thermostats control heating and cooling in homes - representing a major part of domestic energy use - yet, poor ergonomics of these devices has thwarted efforts to reduce energy consumption. Theoretically, programmable thermostats can reduce energy by 5-15%, but in practice little to no savings compared to manual thermostats are found. Several studies have found that programmable thermostats are not installed properly, are generally misunderstood and have poor usability. After conducting a usability study of programmable thermostats, we reviewed several guidelines from ergonomics, general device usability, computer-human interfaces and building control sources. We analysed the characteristics of thermostats that enabled or hindered successfully completing tasks and in a timely manner. Subjects had higher success rates with thermostat displays with positive examples of guidelines, such as visibility of possible actions, consistency and standards, and feedback. We suggested other guidelines that seemed missing, such as navigation cues, clear hierarchy and simple decision paths. Our evaluation of a usability test of five residential programmable thermostats led to the development of a comprehensive set of specific guidelines for thermostat design including visibility of possible actions, consistency, standards, simple decision paths and clear hierarchy. Improving the usability of thermostats may facilitate energy savings.

Usability evaluation of the interactive Personal Patient Profile-Prostate decision support system with African American men.

PubMed

Jaja, Cheedy; Pares-Avila, Jose; Wolpin, Seth; Berry, Donna

2010-04-01

The Personal Patient Profile-Prostate (P4) program is an interactive Web-based decision support system that provides men with localized prostate cancer customized education and coaching with which to make the best personal treatment decision. This study assessed functionality and usability of the P4 program and identified problems in user-computer interaction in a sample of African American men. Usability testing was conducted with 12 community-dwelling African American adult men. The health status of participants was not known or collected by the research team. Each participant worked with the P4 program and provided simultaneous feedback using the "think aloud" technique. Handwritten field notes were collated and assigned to 3 standard coded categories. Aspects of P4 program usability was made based on common issues in the assigned categories. Summary statistics were derived for types and frequency of usability issues noted in the coded data. Twelve participants reported a total of 122 usability comments, with a mean of 9 usability comments. The most common usability issue by participant was completeness of information content, which comprised 53 (43%) of the total issues. Comprehensibility of text and graphics was second, comprising 51 (42%) of the total issues. This study provided initial inventory of usability issues for community African American men that may potentially interfere with application of the P4 system in the community setting and overall system usability, confirming the need for usability testing of a culturally appropriate Internet-based decision support system before community application.

Evaluation of Home Health Care Devices: Remote Usability Assessment.

PubMed

Kortum, Philip; Peres, S Camille

2015-06-05

An increasing amount of health care is now performed in a home setting, away from the hospital. While there is growing anecdotal evidence about the difficulty patients and caregivers have using increasingly complex health care devices in the home, there has been little systematic scientific study to quantify the global nature of home health care device usability in the field. Research has tended to focus on a handful of devices, making it difficult to gain a broad view of the usability of home-care devices in general. The objective of this paper is to describe a remote usability assessment method using the System Usability Scale (SUS), and to report on the usability of a broad range of health care devices using this metric. A total of 271 participants selected and rated up to 10 home health care devices of their choice using the SUS, which scores usability from 0 (unusable) to 100 (highly usable). Participants rated a total of 455 devices in their own home without an experimenter present. Usability scores ranged from 98 (oxygen masks) to 59 (home hormone test kits). An analysis conducted on devices that had at least 10 ratings showed that the effect of device on SUS scores was significant (P<.001), and that the usability of these devices was on the low end when compared with other commonly used items in the home, such as microwave ovens and telephones. A large database of usability scores for home health care devices collected using this remote methodology would be beneficial for physicians, patients, and their caregivers.

[Method for the evaluation of the stability and usability after opening packages of orally disintegrating tablets: case of amlodipine besilate products].

PubMed

Hori, Katsuhito; Yoshida, Naoko; Okumura, Tomonori; Okamura, Yasufumi; Kawakami, Junichi

2010-08-01

Orally disintegrating (OD) tablets are widely used in clinical practice. However, drug information on the choice and dispensing based on their stability after opening packages and usability in patients and dispensaries is not sufficient. The aim of this study was to investigate possible evaluation methods of the stability and usability of amlodipine OD tablets. Additives of the brand were changed in April 2009, and therefore the previous and current forms and two generics, current and newly marketed (in November 2009) products of different firms, were used. OD tablets were stored at 25 degrees C and 75% relative humidity for 3 months after opening the packages, and their physicochemical properties were evaluated. Their weight, diameter, thickness, and color difference increased slightly from the initial state. The extent of the change in their hardness, disintegration time, and friability was different among products. These physicochemical changes were acceptable in dispensary practice. Storage after opening the packages did not affect their dissolution rate. The dissolution rate at the initial state of the current brand was slower than that of the previous one. All products used were able to be dispensed by an automatic tablet-packing machine and applied to the so-called simple suspension method for intubational administration. Sensory evaluation tests revealed no major difference in the oral disintegration time, taste, impression, and preference among products. In conclusion, the stability and usability of amlodipine OD tablets used in this study were examined using several methods, and they can be used equivalently from the stability and usability viewpoints.

An experiment with content distribution methods in touchscreen mobile devices.

PubMed

Garcia-Lopez, Eva; Garcia-Cabot, Antonio; de-Marcos, Luis

2015-09-01

This paper compares the usability of three different content distribution methods (scrolling, paging and internal links) in touchscreen mobile devices as means to display web documents. Usability is operationalized in terms of effectiveness, efficiency and user satisfaction. These dimensions are then measured in an experiment (N = 23) in which users are required to find words in regular-length web documents. Results suggest that scrolling is statistically better in terms of efficiency and user satisfaction. It is also found to be more effective but results were not significant. Our findings are also compared with existing literature to propose the following guideline: "try to use vertical scrolling in web pages for mobile devices instead of paging or internal links, except when the content is too large, then paging is recommended". With an ever increasing number of touchscreen web-enabled mobile devices, this new guideline can be relevant for content developers targeting the mobile web as well as institutions trying to improve the usability of their content for mobile platforms. Copyright © 2015 Elsevier Ltd and The Ergonomics Society. All rights reserved.

Dimensions for hearing-impaired mobile application usability model

NASA Astrophysics Data System (ADS)

Nathan, Shelena Soosay; Hussain, Azham; Hashim, Nor Laily; Omar, Mohd Adan

2017-10-01

This paper discuss on the dimensions that has been derived for the hearing-impaired mobile applications usability model. General usability model consist of general dimension for evaluating mobile application however requirements for the hearing-impaired are overlooked and often scanted. This led towards mobile application developed for the hearing-impaired are left unused. It is also apparent that these usability models do not consider accessibility dimensions according to the requirement of the special users. This complicates the work of usability practitioners as well as academician that practices research usability when application are developed for the specific user needs. To overcome this issue, dimension chosen for the hearing-impaired are ensured to be align with the real need of the hearing-impaired mobile application. Besides literature studies, requirements for the hearing-impaired mobile application have been identified through interview conducted with hearing-impaired mobile application users that were recorded as video outputs and analyzed using Nvivo. Finally total of 6 out of 15 dimensions gathered are chosen for the proposed model and presented.

Usability and Culture as Two of the Value Criteria for Evaluating the Artifact

NASA Astrophysics Data System (ADS)

Kurosu, Masaaki

In this paper, the conceptual framework of the Artifact Development Analysis (ADA) and its relationship to the usability engineering are outlined. The ADA analyses the significance of all artifacts including hardware, software, humanware and system. Its viewpoint extends both in temporal and spatial dimensions. In short, it deals with the diversity of the artifact and casts the questions "why it is so" and "why it is not so". In this respect, the ADA is related to the usability engineering as one of the value attitudes. The usability engineering puts emphasis on effectiveness and efficiency. The usability is not always the value criterion of highest importance and some people sometimes put more emphasis on other criteria such as the aesthetic aspect, the cost, etc. Based on the findings of ADA, we should focus on the extent where the usability can provide the core satisfaction and we should also summarize the guideline on how the artifact should be designed.

Iterative User Interface Design for Automated Sequential Organ Failure Assessment Score Calculator in Sepsis Detection

PubMed Central

Herasevich, Vitaly

2017-01-01

Background The new sepsis definition has increased the need for frequent sequential organ failure assessment (SOFA) score recalculation and the clerical burden of information retrieval makes this score ideal for automated calculation. Objective The aim of this study was to (1) estimate the clerical workload of manual SOFA score calculation through a time-motion analysis and (2) describe a user-centered design process for an electronic medical record (EMR) integrated, automated SOFA score calculator with subsequent usability evaluation study. Methods First, we performed a time-motion analysis by recording time-to-task-completion for the manual calculation of 35 baseline and 35 current SOFA scores by 14 internal medicine residents over a 2-month period. Next, we used an agile development process to create a user interface for a previously developed automated SOFA score calculator. The final user interface usability was evaluated by clinician end users with the Computer Systems Usability Questionnaire. Results The overall mean (standard deviation, SD) time-to-complete manual SOFA score calculation time was 61.6 s (33). Among the 24% (12/50) usability survey respondents, our user-centered user interface design process resulted in >75% favorability of survey items in the domains of system usability, information quality, and interface quality. Conclusions Early stakeholder engagement in our agile design process resulted in a user interface for an automated SOFA score calculator that reduced clinician workload and met clinicians’ needs at the point of care. Emerging interoperable platforms may facilitate dissemination of similarly useful clinical score calculators and decision support algorithms as “apps.” A user-centered design process and usability evaluation should be considered during creation of these tools. PMID:28526675

Iterative User Interface Design for Automated Sequential Organ Failure Assessment Score Calculator in Sepsis Detection.

PubMed

Aakre, Christopher Ansel; Kitson, Jaben E; Li, Man; Herasevich, Vitaly

2017-05-18

The new sepsis definition has increased the need for frequent sequential organ failure assessment (SOFA) score recalculation and the clerical burden of information retrieval makes this score ideal for automated calculation. The aim of this study was to (1) estimate the clerical workload of manual SOFA score calculation through a time-motion analysis and (2) describe a user-centered design process for an electronic medical record (EMR) integrated, automated SOFA score calculator with subsequent usability evaluation study. First, we performed a time-motion analysis by recording time-to-task-completion for the manual calculation of 35 baseline and 35 current SOFA scores by 14 internal medicine residents over a 2-month period. Next, we used an agile development process to create a user interface for a previously developed automated SOFA score calculator. The final user interface usability was evaluated by clinician end users with the Computer Systems Usability Questionnaire. The overall mean (standard deviation, SD) time-to-complete manual SOFA score calculation time was 61.6 s (33). Among the 24% (12/50) usability survey respondents, our user-centered user interface design process resulted in >75% favorability of survey items in the domains of system usability, information quality, and interface quality. Early stakeholder engagement in our agile design process resulted in a user interface for an automated SOFA score calculator that reduced clinician workload and met clinicians' needs at the point of care. Emerging interoperable platforms may facilitate dissemination of similarly useful clinical score calculators and decision support algorithms as "apps." A user-centered design process and usability evaluation should be considered during creation of these tools. ©Christopher Ansel Aakre, Jaben E Kitson, Man Li, Vitaly Herasevich. Originally published in JMIR Human Factors (http://humanfactors.jmir.org), 18.05.2017.

Evaluating input device usability as a function of task difficulty in a tracking task.

PubMed

Rupp, Michael A; Oppold, Paul; McConnell, Daniel S

2015-01-01

Game controllers are emerging as a preferred choice for the manual control of unmanned vehicles, but an understanding of their usability characteristics has yet to emerge. We compared the usability of an Xbox 360 game controller in a dual task situation using MATB II to the traditional joystick and keyboard interface in two experiments. In the first experiment, performance with the game controller was associated with fewer tracking errors. In a second experiment, we trained users on the devices, and found that even after training the game controller was still associated with fewer tracking errors as well as higher usability and lower workload ratings. These results are consistent with the idea that game controllers are highly usable input devices and do not require high mental workload to operate, thus making them suitable for complex control tasks.

Checking an integrated model of web accessibility and usability evaluation for disabled people.

PubMed

Federici, Stefano; Micangeli, Andrea; Ruspantini, Irene; Borgianni, Stefano; Corradi, Fabrizio; Pasqualotto, Emanuele; Olivetti Belardinelli, Marta

2005-07-08

A combined objective-oriented and subjective-oriented method for evaluating accessibility and usability of web pages for students with disability was tested. The objective-oriented approach is devoted to verifying the conformity of interfaces to standard rules stated by national and international organizations responsible for web technology standardization, such as W3C. Conversely, the subjective-oriented approach allows assessing how the final users interact with the artificial system, accessing levels of user satisfaction based on personal factors and environmental barriers. Five kinds of measurements were applied as objective-oriented and subjective-oriented tests. Objective-oriented evaluations were performed on the Help Desk web page for students with disability, included in the website of a large Italian state university. Subjective-oriented tests were administered to 19 students labeled as disabled on the basis of their own declaration at the University enrolment: 13 students were tested by means of the SUMI test and six students by means of the 'Cooperative evaluation'. Objective-oriented and subjective-oriented methods highlighted different and sometimes conflicting results. Both methods have pointed out much more consistency regarding levels of accessibility than of usability. Since usability is largely affected by individual differences in user's own (dis)abilities, subjective-oriented measures underscored the fact that blind students encountered much more web surfing difficulties.

A Concise and Practical Framework for the Development and Usability Evaluation of Patient Information Websites

PubMed Central

Knijnenburg, S.L.; Kremer, L.C.; Jaspers, M.W.M.

2015-01-01

Summary Background The Website Developmental Model for the Healthcare Consumer (WDMHC) is an extensive and successfully evaluated framework that incorporates user-centered design principles. However, due to its extensiveness its application is limited. In the current study we apply a subset of the WDMHC framework in a case study concerning the development and evaluation of a website aimed at childhood cancer survivors (CCS). Objective To assess whether the implementation of a limited subset of the WDMHC-framework is sufficient to deliver a high-quality website with few usability problems, aimed at a specific patient population. Methods The website was developed using a six-step approach divided into three phases derived from the WDMHC: 1) information needs analysis, mock-up creation and focus group discussion; 2) website prototype development; and 3) heuristic evaluation (HE) and think aloud analysis (TA). The HE was performed by three double experts (knowledgeable both in usability engineering and childhood cancer survivorship), who assessed the site using the Nielsen heuristics. Eight end-users were invited to complete three scenarios covering all functionality of the website by TA. Results The HE and TA were performed concurrently on the website prototype. The HE resulted in 29 unique usability issues; the end-users performing the TA encountered eleven unique problems. Four issues specifically revealed by HE concerned cosmetic design flaws, whereas two problems revealed by TA were related to website content. Conclusion Based on the subset of the WDMHC framework we were able to deliver a website that closely matched the expectancy of the end-users and resulted in relatively few usability problems during end-user testing. With the successful application of this subset of the WDMHC, we provide developers with a clear and easily applicable framework for the development of healthcare websites with high usability aimed at specific medical populations. PMID:26171083

Health figures: an open source JavaScript library for health data visualization.

PubMed

Ledesma, Andres; Al-Musawi, Mohammed; Nieminen, Hannu

2016-03-22

The way we look at data has a great impact on how we can understand it, particularly when the data is related to health and wellness. Due to the increased use of self-tracking devices and the ongoing shift towards preventive medicine, better understanding of our health data is an important part of improving the general welfare of the citizens. Electronic Health Records, self-tracking devices and mobile applications provide a rich variety of data but it often becomes difficult to understand. We implemented the hFigures library inspired on the hGraph visualization with additional improvements. The purpose of the library is to provide a visual representation of the evolution of health measurements in a complete and useful manner. We researched the usefulness and usability of the library by building an application for health data visualization in a health coaching program. We performed a user evaluation with Heuristic Evaluation, Controlled User Testing and Usability Questionnaires. In the Heuristics Evaluation the average response was 6.3 out of 7 points and the Cognitive Walkthrough done by usability experts indicated no design or mismatch errors. In the CSUQ usability test the system obtained an average score of 6.13 out of 7, and in the ASQ usability test the overall satisfaction score was 6.64 out of 7. We developed hFigures, an open source library for visualizing a complete, accurate and normalized graphical representation of health data. The idea is based on the concept of the hGraph but it provides additional key features, including a comparison of multiple health measurements over time. We conducted a usability evaluation of the library as a key component of an application for health and wellness monitoring. The results indicate that the data visualization library was helpful in assisting users in understanding health data and its evolution over time.

Cognitive engineering of film library transition from film medium to digital environment in a Texas teaching hospital.

PubMed

Koperwhats, Martha A; Chang, Wei-Chih; Xiao, Jianguo

2002-01-01

Digital imaging technology promises efficient, economical, and fast service for patient care, but the challenges are great in the transition from film to a filmless (digital) environment. This change has a significant impact on the film library's personnel (film librarians) who play a leading roles in storage, classification, and retrieval of images. The objectives of this project were to study film library errors and the usability of a physical computerized system that could not be changed, while developing an intervention to reduce errors and test the usability of the intervention. Cognitive and human factors analysis were used to evaluate human-computer interaction. A workflow analysis was performed to understand the film and digital imaging processes. User and task analyses were applied to account for all behaviors involved in interaction with the system. A heuristic evaluation was used to probe the usability issues in the picture archiving and communication systems (PACS) modules. Simplified paper-based instructions were designed to familiarize the film librarians with the digital system. A usability survey evaluated the effectiveness of the instruction. The user and task analyses indicated that different users faced challenges based on their computer literacy, education, roles, and frequency of use of diagnostic imaging. The workflow analysis showed that the approaches to using the digital library differ among the various departments. The heuristic evaluation of the PACS modules showed the human-computer interface to have usability issues that prevented easy operation. Simplified instructions were designed for operation of the modules. Usability surveys conducted before and after revision of the instructions showed that performance improved. Cognitive and human factor analysis can help film librarians and other users adapt to the filmless system. Use of cognitive science tools will aid in successful transition of the film library from a film environment to a digital environment.

Low-Cost Rapid Usability Testing: Its Application in Both Product Development and System Implementation.

PubMed

Kushniruk, Andre; Borycki, Elizabeth

2017-01-01

In recent years there has been considerable discussion around the need for certification and regulation of healthcare information technology (IT). In particular, the usability of the products being developed needs to be evaluated. This has included the application of standards designed to ensure the process of system development is user-centered and takes usability into consideration while a product is being developed. In addition to this, in healthcare, organizations in the United States and Europe have also addressed the need and requirement for product certification. However, despite these efforts there are continued reports of unusable and unsafe implementations. In this paper we discuss the need to not only include (and require) usability testing in the one-time development process of health IT products (such as EHRs), but we also argue for the need to additionally develop specific usability standards and requirements for usability testing during the implementation of vendor products (i.e. post product development) in healthcare settings. It is further argued that health IT products that may have been certified regarding their development process will still require application of usability testing in the process of implementing them in real hospital settings in order to ensure usability and safety. This is needed in order to ensure that the final result of both product development and implementation processes take into account and apply the latest usability principles and methods.

Mobile applications for diabetics: a systematic review and expert-based usability evaluation considering the special requirements of diabetes patients age 50 years or older.

PubMed

Arnhold, Madlen; Quade, Mandy; Kirch, Wilhelm

2014-04-09

A multitude of mhealth (mobile health) apps have been developed in recent years to support effective self-management of patients with diabetes mellitus type 1 or 2. We carried out a systematic review of all currently available diabetes apps for the operating systems iOS and Android. We considered the number of newly released diabetes apps, range of functions, target user groups, languages, acquisition costs, user ratings, available interfaces, and the connection between acquisition costs and user ratings. Additionally, we examined whether the available applications serve the special needs of diabetes patients aged 50 or older by performing an expert-based usability evaluation. We identified relevant keywords, comparative categories, and their specifications. Subsequently, we performed the app review based on the information given in the Google Play Store, the Apple App Store, and the apps themselves. In addition, we carried out an expert-based usability evaluation based on a representative 10% sample of diabetes apps. In total, we analyzed 656 apps finding that 355 (54.1%) offered just one function and 348 (53.0%) provided a documentation function. The dominating app language was English (85.4%, 560/656), patients represented the main user group (96.0%, 630/656), and the analysis of the costs revealed a trend toward free apps (53.7%, 352/656). The median price of paid apps was €1.90. The average user rating was 3.6 stars (maximum 5). Our analyses indicated no clear differences in the user rating between free and paid apps. Only 30 (4.6%) of the 656 available diabetes apps offered an interface to a measurement device. We evaluated 66 apps within the usability evaluation. On average, apps were rated best regarding the criterion "comprehensibility" (4.0 out of 5.0), while showing a lack of "fault tolerance" (2.8 out of 5.0). Of the 66 apps, 48 (72.7%) offered the ability to read the screen content aloud. The number of functions was significantly negative correlated with usability. The presence of documentation and analysis functions reduced the usability score significantly by 0.36 and 0.21 points. A vast number of diabetes apps already exist, but the majority offer similar functionalities and combine only one to two functions in one app. Patients and physicians alike should be involved in the app development process to a greater extent. We expect that the data transmission of health parameters to physicians will gain more importance in future applications. The usability of diabetes apps for patients aged 50 or older was moderate to good. But this result applied mainly to apps offering a small range of functions. Multifunctional apps performed considerably worse in terms of usability. Moreover, the presence of a documentation or analysis function resulted in significantly lower usability scores. The operability of accessibility features for diabetes apps was quite limited, except for the feature "screen reader".

Virtually Usable: A Test of the Information Gardens

ERIC Educational Resources Information Center

Johnson, Megan; Ochoa, Louise; Purpur, Geraldine

2007-01-01

This paper presents the results of a usability study conducted to determine the functionality of a desktop, three-dimensional virtual library designed and supported by the Appalachian State University Distance Learning Library Services team. Formative evaluations were performed with representative students utilizing Morae software. Results…

Multi-Section Sensing and Vibrotactile Perception for Walking Guide of Visually Impaired Person.

PubMed

Jeong, Gu-Young; Yu, Kee-Ho

2016-07-12

Electronic Travel Aids (ETAs) improve the mobility of visually-impaired persons, but it is not easy to develop an ETA satisfying all the factors needed for reliable object detection, effective notification, and actual usability. In this study, the authors developed an easy-to-use ETA having the function of reliable object detection and its successful feedback to the user by tactile stimulation. Seven ultrasonic sensors facing in different directions detect obstacles in the walking path, while vibrators in the tactile display stimulate the hand according to the distribution of obstacles. The detection of ground drop-offs activates the electromagnetic brakes linked to the rear wheels. To verify the feasibility of the developed ETA in the outdoor environment, walking tests by blind participants were performed, and the evaluation of safety to ground drop-offs was carried out. From the experiment, the feasibility of the developed ETA was shown to be sufficient if the sensor ranges for hanging obstacle detection is improved and learning time is provided for the ETA. Finally, the light-weight and low cost ETA designed and assembled based on the evaluation of the developed ETA is introduced to show the improvement of portability and usability, and is compared with the previously developed ETAs.

Multi-Section Sensing and Vibrotactile Perception for Walking Guide of Visually Impaired Person

PubMed Central

Jeong, Gu-Young; Yu, Kee-Ho

2016-01-01

Electronic Travel Aids (ETAs) improve the mobility of visually-impaired persons, but it is not easy to develop an ETA satisfying all the factors needed for reliable object detection, effective notification, and actual usability. In this study, the authors developed an easy-to-use ETA having the function of reliable object detection and its successful feedback to the user by tactile stimulation. Seven ultrasonic sensors facing in different directions detect obstacles in the walking path, while vibrators in the tactile display stimulate the hand according to the distribution of obstacles. The detection of ground drop-offs activates the electromagnetic brakes linked to the rear wheels. To verify the feasibility of the developed ETA in the outdoor environment, walking tests by blind participants were performed, and the evaluation of safety to ground drop-offs was carried out. From the experiment, the feasibility of the developed ETA was shown to be sufficient if the sensor ranges for hanging obstacle detection is improved and learning time is provided for the ETA. Finally, the light-weight and low cost ETA designed and assembled based on the evaluation of the developed ETA is introduced to show the improvement of portability and usability, and is compared with the previously developed ETAs. PMID:27420060

Designing an Educational Website to Improve Quality of Supportive Oncology Care for Women with Ovarian Cancer: An Expert Usability Review and Analysis.

PubMed

McClellan, Molly A; Karumur, Raghav Pavan; Vogel, Rachel Isaksson; Petzel, Sue V; Cragg, Julie; Chan, Daniel; Jacko, Julie A; Sainfort, François; Geller, Melissa A

A broad-based research team developed a Health Insurance Portability and Accountability Act (HIPAA)-compliant educational website for women with ovarian cancer to improve the quality of supportive oncology care. Prior to a randomized clinical trial of the website, initial usability testing was implemented to evaluate the website. The initial review found that 165/247 checklist items had sufficient information to allow for evaluation with the website achieving an overall score of 63%. By category, lowest scores were for the Home Page, Task Orientation, Page Layout & Visual Design, and Help, Feedback & Error Tolerance. Major issues thought to potentially impede actual usage were prioritized in redevelopment and the second usability review, conducted by the same expert, saw an improvement in scores. Incorporating usability concepts from the start of development, fulfilling the positive expectations of end-users and identifying technical and personal factors that optimize use may greatly enhance usage of health websites.

Designing an Educational Website to Improve Quality of Supportive Oncology Care for Women with Ovarian Cancer: An Expert Usability Review and Analysis

PubMed Central

McClellan, Molly A.; Karumur, Raghav Pavan; Vogel, Rachel Isaksson; Petzel, Sue V.; Cragg, Julie; Chan, Daniel; Jacko, Julie A.; Sainfort, François; Geller, Melissa A.

2016-01-01

A broad-based research team developed a Health Insurance Portability and Accountability Act (HIPAA)-compliant educational website for women with ovarian cancer to improve the quality of supportive oncology care. Prior to a randomized clinical trial of the website, initial usability testing was implemented to evaluate the website. The initial review found that 165/247 checklist items had sufficient information to allow for evaluation with the website achieving an overall score of 63%. By category, lowest scores were for the Home Page, Task Orientation, Page Layout & Visual Design, and Help, Feedback & Error Tolerance. Major issues thought to potentially impede actual usage were prioritized in redevelopment and the second usability review, conducted by the same expert, saw an improvement in scores. Incorporating usability concepts from the start of development, fulfilling the positive expectations of end-users and identifying technical and personal factors that optimize use may greatly enhance usage of health websites. PMID:27110082

Usability testing of an mHealth device for swallowing therapy in head and neck cancer survivors.

PubMed

Constantinescu, Gabriela; Kuffel, Kristina; King, Ben; Hodgetts, William; Rieger, Jana

2018-04-01

The objective of this study was to conduct the first patient usability testing of a mobile health (mHealth) system for in-home swallowing therapy. Five participants with a history of head and neck cancer evaluated the mHealth system. After completing an in-application (app) tutorial with the clinician, participants were asked to independently complete five tasks: pair the device to the smartphone, place the device correctly, exercise, interpret progress displays, and close the system. Quantitative and qualitative methods were used to evaluate the effectiveness, efficiency, and satisfaction with the system. Critical changes to the app were found in three of the tasks, resulting in recommendations for the next iteration. These issues were related to ease of Bluetooth pairing, placement of device, and interpretation of statistics. Usability testing with patients identified issues that were essential to address prior to implementing the mHealth system in subsequent clinical trials. Of the usability methods used, video observation (synced screen capture with videoed gestures) revealed the most information.

Real-Time Support on IEEE 802.11 Wireless Ad-Hoc Networks: Reality vs. Theory

NASA Astrophysics Data System (ADS)

Kang, Mikyung; Kang, Dong-In; Suh, Jinwoo

The usable throughput of an IEEE 802.11 system for an application is much less than the raw bandwidth. Although 802.11b has a theoretical maximum of 11Mbps, more than half of the bandwidth is consumed by overhead leaving at most 5Mbps of usable bandwidth. Considering this characteristic, this paper proposes and analyzes a real-time distributed scheduling scheme based on the existing IEEE 802.11 wireless ad-hoc networks, using USC/ISI's Power Aware Sensing Tracking and Analysis (PASTA) hardware platform. We compared the distributed real-time scheduling scheme with the real-time polling scheme to meet deadline, and compared a measured real bandwidth with a theoretical result. The theoretical and experimental results show that the distributed scheduling scheme can guarantee real-time traffic and enhances the performance up to 74% compared with polling scheme.

Evaluation of English Websites on Dental Caries by Using Consumer Evaluation Tools.

PubMed

Blizniuk, Anastasiya; Furukawa, Sayaka; Ueno, Masayuki; Kawaguchi, Yoko

2016-01-01

To evaluate the quality of patient-oriented online information about dental caries using existing consumer evaluation tools and to judge the efficacy of these tools in quality assessment. The websites for the evaluation were pooled by using two general search engines (Google and Yahoo!). The search terms were: 'dental caries', 'tooth decay' and 'tooth cavity'. Three assessment tools (LIDA, DISCERN and FRES) were used to evaluate the quality of the information in the areas of accessibility, usability, reliability and readability. In total, 77 websites were analysed. The median scores of LIDA accessibility and usability were 45.0 and 8.0, respectively, which corresponded to a medium level of quality. The median reliability scores for LIDA (12.0) and DISCERN (20.0) both corresponded to low level of quality. The readability was high with the median FRES score 59.7. The websites on caries had good accessibility, usability and readability, while reliability of the information was poor. The LIDA instrument was found to be more convenient than DISCERN and can be recommended to lay people for quick quality assessment.

Consumers' Patient Portal Preferences and Health Literacy: A Survey Using Crowdsourcing.

PubMed

Zide, Mary; Caswell, Kaitlyn; Peterson, Ellen; Aberle, Denise R; Bui, Alex At; Arnold, Corey W

2016-06-08

eHealth apps have the potential to meet the information needs of patient populations and improve health literacy rates. However, little work has been done to document perceived usability of portals and health literacy of specific topics. Our aim was to establish a baseline of lung cancer health literacy and perceived portal usability. A survey based on previously validated instruments was used to assess a baseline of patient portal usability and health literacy within the domain of lung cancer. The survey was distributed via Amazon's Mechanical Turk to 500 participants. Our results show differences in preferences and literacy by demographic cohorts, with a trend of chronically ill patients having a more positive reception of patient portals and a higher health literacy rate of lung cancer knowledge (P<.05). This article provides a baseline of usability needs and health literacy that suggests that chronically ill patients have a greater preference for patient portals and higher level of health literacy within the domain of lung cancer.

Patient safety related to the use of medical devices: a review and investigation of the current status in the medical device industry.

PubMed

Geissler, Norman; Byrnes, Trevor; Lauer, Wolfgang; Radermacher, Klaus; Kotzsch, Susanne; Korb, Werner; Hölscher, Uvo M

2013-02-01

To reduce the risk of application error, the federal legislator has demanded a development process which is oriented towards usability (DIN EN 62366). Therefore, the research question concerns the application of this standard by medical device manufacturers. Questionnaires were filled out by five trained interviewers in fully standardized face-to-face interviews at MEDICA Düsseldorf 2010. The results are based on 65 interviews. Almost all companies evaluated usability as relevant for product development; however, the understanding of usability through companies can still be improved as well as increasing the amount of trained usability experts in the process.

A Human Reliability Based Usability Evaluation Method for Safety-Critical Software

DOE Office of Scientific and Technical Information (OSTI.GOV)

Phillippe Palanque; Regina Bernhaupt; Ronald Boring

2006-04-01

Recent years have seen an increasing use of sophisticated interaction techniques including in the field of safety critical interactive software [8]. The use of such techniques has been required in order to increase the bandwidth between the users and systems and thus to help them deal efficiently with increasingly complex systems. These techniques come from research and innovation done in the field of humancomputer interaction (HCI). A significant effort is currently being undertaken by the HCI community in order to apply and extend current usability evaluation techniques to these new kinds of interaction techniques. However, very little has been donemore » to improve the reliability of software offering these kinds of interaction techniques. Even testing basic graphical user interfaces remains a challenge that has rarely been addressed in the field of software engineering [9]. However, the non reliability of interactive software can jeopardize usability evaluation by showing unexpected or undesired behaviors. The aim of this SIG is to provide a forum for both researchers and practitioners interested in testing interactive software. Our goal is to define a roadmap of activities to cross fertilize usability and reliability testing of these kinds of systems to minimize duplicate efforts in both communities.« less

The quality of orthodontic practice websites.

PubMed

Parekh, J; Gill, D S

2014-05-01

To evaluate orthodontic practice websites for the reliability of information presented, accessibility, usability for patients and compliance to General Dental Council (GDC) regulations on ethical advertising. World Wide Web. The term 'orthodontic practice' was entered into three separate search engines. The 30 websites from the UK were selected and graded according to the LIDA tool (a validated method of evaluating healthcare websites) for accessibility, usability of the website and reliability of information on orthodontic treatment. The websites were then evaluated against the GDC's Principles for ethical advertising in nine different criteria. On average, each website fulfilled six out of nine points of the GDC's criteria, with inclusion of a complaints policy being the most poorly fulfilled criteria. The mean LIDA score (a combination of usability, reliability and accessibility) was 102/144 (standard deviation 8.38). The websites scored most poorly on reliability (average 43% SD 11.7), with no single website reporting a clear, reliable method of content production. Average accessibility was 81% and usability 73%. In general, websites did not comply with GDC guidelines on ethical advertising. Furthermore, practitioners should consider reporting their method of information production, particularly when making claims about efficiency and speed of treatment in order to improve reliability.

77 FR 8217 - Evaluating the Usability of Electronic Health Record (EHR) Systems

Federal Register 2010, 2011, 2012, 2013, 2014

2012-02-14

... interface design guidelines for EHRs. Manufacturers interested in participating in this research will be... the usability of health information technology (HIT) systems. NIST research is designed to: (1... develop performance-oriented user interface design guidelines for EHRs, and a framework for assessing the...

Tree Testing of Hierarchical Menu Structures for Health Applications

PubMed Central

Le, Thai; Chaudhuri, Shomir; Chung, Jane; Thompson, Hilaire J; Demiris, George

2014-01-01

To address the need for greater evidence-based evaluation of Health Information Technology (HIT) systems we introduce a method of usability testing termed tree testing. In a tree test, participants are presented with an abstract hierarchical tree of the system taxonomy and asked to navigate through the tree in completing representative tasks. We apply tree testing to a commercially available health application, demonstrating a use case and providing a comparison with more traditional in-person usability testing methods. Online tree tests (N=54) and in-person usability tests (N=15) were conducted from August to September 2013. Tree testing provided a method to quantitatively evaluate the information structure of a system using various navigational metrics including completion time, task accuracy, and path length. The results of the analyses compared favorably to the results seen from the traditional usability test. Tree testing provides a flexible, evidence-based approach for researchers to evaluate the information structure of HITs. In addition, remote tree testing provides a quick, flexible, and high volume method of acquiring feedback in a structured format that allows for quantitative comparisons. With the diverse nature and often large quantities of health information available, addressing issues of terminology and concept classifications during the early development process of a health information system will improve navigation through the system and save future resources. Tree testing is a usability method that can be used to quickly and easily assess information hierarchy of health information systems. PMID:24582924

Usability Assessment of the Missouri Cancer Registry's Published Interactive Mapping Reports: Round One.

PubMed

Ben Ramadan, Awatef Ahmed; Jackson-Thompson, Jeannette; Schmaltz, Chester Lee

2017-08-04

 Many users of spatial data have difficulty interpreting information in health-related spatial reports. The Missouri Cancer Registry and Research Center (MCR-ARC) has produced interactive reports for several years. These reports have never been tested for usability.  The aims of this study were to: (1) conduct a multi-approach usability testing study to understand ease of use (user friendliness) and user satisfaction; and (2) evaluate the usability of MCR-ARC's published InstantAtlas reports.   An institutional review board (IRB) approved mixed methodology usability testing study using a convenience sample of health professionals. A recruiting email was sent to faculty in the Master of Public Health program and to faculty and staff in the Department of Health Management and Informatics at the University of Missouri-Columbia. The study included 7 participants. The test included a pretest questionnaire, a multi-task usability test, and the System Usability Scale (SUS). Also, the researchers collected participants' comments about the tested maps immediately after every trial. Software was used to record the computer screen during the trial and the participants' spoken comments. Several performance and usability metrics were measured to evaluate the usability of MCR-ARC's published mapping reports. Of the 10 assigned tasks, 6 reached a 100% completion success rate, and this outcome was relative to the complexity of the tasks. The simple tasks were handled more efficiently than the complicated tasks. The SUS score ranged between 20-100 points, with an average of 62.7 points and a median of 50.5 points. The tested maps' effectiveness outcomes were better than the efficiency and satisfaction outcomes. There was a statistically significant relationship between the subjects' performance on the study test and the users' previous experience with geographic information system (GIS) tools (P=.03). There were no statistically significant relationships between users' performance and satisfaction and their education level, work type, or previous experience in health care (P>.05). There were strong positive correlations between the three measured usability elements. The tested maps should undergo an extensive refining and updating to overcome all the discovered usability issues and meet the perspectives and needs of the tested maps' potential users. The study results might convey the perspectives of academic health professionals toward GIS health data. We need to conduct a second-round usability study with public health practitioners and cancer professionals who use GIS tools on a routine basis. Usability testing should be conducted before and after releasing MCR-ARC's maps in the future. ©Awatef Ahmed Ben Ramadan, Jeannette Jackson-Thompson, Chester Lee Schmaltz. Originally published in JMIR Human Factors (http://humanfactors.jmir.org), 04.08.2017.

Usability Assessment of the Missouri Cancer Registry’s Published Interactive Mapping Reports: Round One

PubMed Central

Jackson-Thompson, Jeannette; Schmaltz, Chester Lee

2017-01-01

Background  Many users of spatial data have difficulty interpreting information in health-related spatial reports. The Missouri Cancer Registry and Research Center (MCR-ARC) has produced interactive reports for several years. These reports have never been tested for usability. Objective  The aims of this study were to: (1) conduct a multi-approach usability testing study to understand ease of use (user friendliness) and user satisfaction; and (2) evaluate the usability of MCR-ARC’s published InstantAtlas reports. Methods   An institutional review board (IRB) approved mixed methodology usability testing study using a convenience sample of health professionals. A recruiting email was sent to faculty in the Master of Public Health program and to faculty and staff in the Department of Health Management and Informatics at the University of Missouri-Columbia. The study included 7 participants. The test included a pretest questionnaire, a multi-task usability test, and the System Usability Scale (SUS). Also, the researchers collected participants’ comments about the tested maps immediately after every trial. Software was used to record the computer screen during the trial and the participants’ spoken comments. Several performance and usability metrics were measured to evaluate the usability of MCR-ARC’s published mapping reports. Results Of the 10 assigned tasks, 6 reached a 100% completion success rate, and this outcome was relative to the complexity of the tasks. The simple tasks were handled more efficiently than the complicated tasks. The SUS score ranged between 20-100 points, with an average of 62.7 points and a median of 50.5 points. The tested maps’ effectiveness outcomes were better than the efficiency and satisfaction outcomes. There was a statistically significant relationship between the subjects’ performance on the study test and the users’ previous experience with geographic information system (GIS) tools (P=.03). There were no statistically significant relationships between users’ performance and satisfaction and their education level, work type, or previous experience in health care (P>.05). There were strong positive correlations between the three measured usability elements. Conclusions The tested maps should undergo an extensive refining and updating to overcome all the discovered usability issues and meet the perspectives and needs of the tested maps’ potential users. The study results might convey the perspectives of academic health professionals toward GIS health data. We need to conduct a second-round usability study with public health practitioners and cancer professionals who use GIS tools on a routine basis. Usability testing should be conducted before and after releasing MCR-ARC’s maps in the future. PMID:28778842

Adapting Nielsen’s Design Heuristics to Dual Processing for Clinical Decision Support

PubMed Central

Taft, Teresa; Staes, Catherine; Slager, Stacey; Weir, Charlene

2016-01-01

The study objective was to improve the applicability of Nielson’s standard design heuristics for evaluating electronic health record (EHR) alerts and linked ordering support by integrating them with Dual Process theory. Through initial heuristic evaluation and a user study of 7 physicians, usability problems were identified. Through independent mapping of specific usability criteria to support for each of the Dual Cognitive processes (S1 and S2) and deliberation, agreement was reached on mapping criteria. Finally, usability errors from the heuristic and user study were mapped to S1 and S2. Adding a dual process perspective to specific heuristic analysis increases the applicability and relevance of computerized health information design evaluations. This mapping enables designers to measure that their systems are tailored to support attention allocation. System 1 will be supported by improving pattern recognition and saliency, and system 2 through efficiency and control of information access. PMID:28269915

Adapting Nielsen's Design Heuristics to Dual Processing for Clinical Decision Support.

PubMed

Taft, Teresa; Staes, Catherine; Slager, Stacey; Weir, Charlene

2016-01-01

The study objective was to improve the applicability of Nielson's standard design heuristics for evaluating electronic health record (EHR) alerts and linked ordering support by integrating them with Dual Process theory. Through initial heuristic evaluation and a user study of 7 physicians, usability problems were identified. Through independent mapping of specific usability criteria to support for each of the Dual Cognitive processes (S1 and S2) and deliberation, agreement was reached on mapping criteria. Finally, usability errors from the heuristic and user study were mapped to S1 and S2. Adding a dual process perspective to specific heuristic analysis increases the applicability and relevance of computerized health information design evaluations. This mapping enables designers to measure that their systems are tailored to support attention allocation. System 1 will be supported by improving pattern recognition and saliency, and system 2 through efficiency and control of information access.

Usability Evaluation of Clinical Guidelines on the Web Using Eye-Tracker.

PubMed

Khodambashi, Soudabeh; Gilstad, Heidi; Nytrø, Øystein

2016-01-01

Publishing clinical guidelines (GLs) on the web increases their accessibility. However, evaluating their usability and understanding how users interact with the websites has been neglected. In this study we used Tobii eye-tracker to analyse users' interaction with five commercial and public GL sites popular in Norway (four in Norwegian and one English of US origin (UpToDate)). We measured number of clicks and usage rate for search functions, task completion time, users' objective and perception of task success rate. We also measured learning effect for inexperienced users. We found a direct correlation between participant's satisfaction regarding website usability and the time spent, number of mouse clicks and use of search function to obtain the desired results. Our study showed that users' perceived success rate was not reliable and GL publishers should evaluate their website regarding presentation format, layout, navigation bar and search function.

PERTS: A Prototyping Environment for Real-Time Systems

NASA Technical Reports Server (NTRS)

Liu, Jane W. S.; Lin, Kwei-Jay; Liu, C. L.

1991-01-01

We discuss an ongoing project to build a Prototyping Environment for Real-Time Systems, called PERTS. PERTS is a unique prototyping environment in that it has (1) tools and performance models for the analysis and evaluation of real-time prototype systems, (2) building blocks for flexible real-time programs and the support system software, (3) basic building blocks of distributed and intelligent real time applications, and (4) an execution environment. PERTS will make the recent and future theoretical advances in real-time system design and engineering readily usable to practitioners. In particular, it will provide an environment for the use and evaluation of new design approaches, for experimentation with alternative system building blocks and for the analysis and performance profiling of prototype real-time systems.

A usability evaluation of Lazada mobile application

NASA Astrophysics Data System (ADS)

Hussain, Azham; Mkpojiogu, Emmanuel O. C.; Jamaludin, Nur Hafiza; Moh, Somia T. L.

2017-10-01

This paper reports on a usability evaluation of Lazada mobile application, an online shopping app for mobile devices. The evaluation was conducted using 12 users of ages 18 to 24. Seven (7) were expert users and the other 5 were novice users. The study objectives were to evaluate the perceived effectiveness, efficiency and satisfaction of the mobile application. The result provides a positive feedback and shows that the mobile shopping app is effective, efficient, and satisfying as perceived by the study participants. However, there are some observed usability issues with the main menu and the payment method that necessitates improvements to increase the application's effectiveness, efficiency and satisfaction. The suggested improvements include: 1) the main menu should be capitalized and place on the left side of mobile app and 2) payment method tutorial should be included as a hyperlink in the payment method page. This observation will be helpful to the owners of the application in future version development of the app.

Evaluation of Sensor Configurations for Robotic Surgical Instruments

PubMed Central

Gómez-de-Gabriel, Jesús M.; Harwin, William

2015-01-01

Designing surgical instruments for robotic-assisted minimally-invasive surgery (RAMIS) is challenging due to constraints on the number and type of sensors imposed by considerations such as space or the need for sterilization. A new method for evaluating the usability of virtual teleoperated surgical instruments based on virtual sensors is presented. This method uses virtual prototyping of the surgical instrument with a dual physical interaction, which allows testing of different sensor configurations in a real environment. Moreover, the proposed approach has been applied to the evaluation of prototypes of a two-finger grasper for lump detection by remote pinching. In this example, the usability of a set of five different sensor configurations, with a different number of force sensors, is evaluated in terms of quantitative and qualitative measures in clinical experiments with 23 volunteers. As a result, the smallest number of force sensors needed in the surgical instrument that ensures the usability of the device can be determined. The details of the experimental setup are also included. PMID:26516863

Evaluation of Sensor Configurations for Robotic Surgical Instruments.

PubMed

Gómez-de-Gabriel, Jesús M; Harwin, William

2015-10-27

Designing surgical instruments for robotic-assisted minimally-invasive surgery (RAMIS) is challenging due to constraints on the number and type of sensors imposed by considerations such as space or the need for sterilization. A new method for evaluating the usability of virtual teleoperated surgical instruments based on virtual sensors is presented. This method uses virtual prototyping of the surgical instrument with a dual physical interaction, which allows testing of different sensor configurations in a real environment. Moreover, the proposed approach has been applied to the evaluation of prototypes of a two-finger grasper for lump detection by remote pinching. In this example, the usability of a set of five different sensor configurations, with a different number of force sensors, is evaluated in terms of quantitative and qualitative measures in clinical experiments with 23 volunteers. As a result, the smallest number of force sensors needed in the surgical instrument that ensures the usability of the device can be determined. The details of the experimental setup are also included.

A Facebook-Based Obesity Prevention Program for Korean American Adolescents: Usability Evaluation.

PubMed

Park, Bu Kyung; Nahm, Eun-Shim; Rogers, Valerie E; Choi, Mona; Friedmann, Erika; Wilson, Marisa; Koru, Gunes

Adolescent obesity is one of the most serious global public health challenges. Social networking sites are currently popular among adolescents. Therefore, the obesity prevention program for Korean American adolescents was developed on the most popular social networking site, Facebook. The purpose of this study was to evaluate the usability of a culturally tailored Facebook-based obesity prevention program for Korean American adolescents (Healthy Teens). An explorative descriptive design of usability testing was used. Usability testing employing one-on-one observation, the think-aloud method, audio taping, screen activity capture, and surveys was performed. Twenty participants were recruited from two Korean language schools (mean age, 15.40 ± 1.50 years). Recruitment and user testing was performed between February and April 2014. Content analysis, using the inductive coding approach, was performed by three coders to analyze transcriptions. Descriptive statistics were used to analyze quantitative data including demographic characteristics, perceived usability, eHealth literacy, and health behaviors. Testing revealed several usability issues in content, appearance, and navigation. Participants' comments regarding content were positive. Although the Facebook platform provided limited flexibility with respect to building the site, participants described the program's appearance as appropriate. Most participants did not experience difficulty in navigating the program. Our preliminary findings indicated that participants perceived the Healthy Teens program as usable and useful. This program could be used as a robust platform for the delivery of health education to adolescents. Further research is required to assess the effects of Facebook-based programs on adolescent obesity prevention. Copyright © 2016 National Association of Pediatric Nurse Practitioners. Published by Elsevier Inc. All rights reserved.

Impact of Chromophoric Dissolved Organic Matter on UV Inhibition of Primary Productivity in the Sea

NASA Technical Reports Server (NTRS)

Arrigo, Kevin R.; Brown, Christopher W.

1996-01-01

A model was developed to assess the impact of chromophoric dissolved organic matter (CDOM) on phytoplankton production within the euphotic zone. The rate of depth-integrated daily gross primary productivity within the euphotic zone was evaluated as a function of date, latitude, CDONI absorption characteristics, chlorophyll a (chl a) concentration, vertical stratification, and phytoplankton sensitivity to UV radiation (UVR). Results demonstrated that primary production was enhanced in the upper 30 m of the water column by the presence of CDOM, where predicted increases in production due to the removal of damaging UVR more than offset its reduction resulting from the absorption of photosynthetically usable radiation. At greater depths, where little UVR remained, primary production was always reduced due to removal by CDOM of photosynthetically usable radiation. When CDOM was distributed homogeneously within the euphotic zone, the integral over z [(GPP)(sub ez)], was reduced under most bio-optical (i.e. solar zenith angle, and CDOM absorption, and ozone concentration) and photophysiological production at depth was greater than the enhancement of production at the surface.

Bus use and older people: a literature review applying the Person-Environment-Occupation model in macro practice.

PubMed

Broome, Kieran; McKenna, Kryss; Fleming, Jennifer; Worrall, Linda

2009-03-01

The same reasons that prompt older people to give up driving can also result in difficulties with accessing public transport. Difficulties using public transport can limit older people's participation in society, thereby impacting negatively on their health. Focusing on public buses, this review explicates the link between bus usability and the health of older people and frames existing evidence on bus usability issues. The Person-Environment-Occupation (PEO) model offers a framework by which bus usability can be assessed. A combination of person-centred, environmental, and occupation-related factors, including bus design, service provision and performance, information, and the attitudes of staff and the community, impact on older people's ability to catch buses. More systematic research needs to take place in order to develop a comprehensive understanding of bus usability. Occupational therapy has a key role to play in conceptualizing, implementing, and evaluating improvements in bus usability for older people.

Integrating Low-Cost Rapid Usability Testing into Agile System Development of Healthcare IT: A Methodological Perspective.

PubMed

Kushniruk, Andre W; Borycki, Elizabeth M

2015-01-01

The development of more usable and effective healthcare information systems has become a critical issue. In the software industry methodologies such as agile and iterative development processes have emerged to lead to more effective and usable systems. These approaches highlight focusing on user needs and promoting iterative and flexible development practices. Evaluation and testing of iterative agile development cycles is considered an important part of the agile methodology and iterative processes for system design and re-design. However, the issue of how to effectively integrate usability testing methods into rapid and flexible agile design cycles has remained to be fully explored. In this paper we describe our application of an approach known as low-cost rapid usability testing as it has been applied within agile system development in healthcare. The advantages of the integrative approach are described, along with current methodological considerations.

Evaluation of the acceptability and usability of a decision support system to encourage safe and effective use of opioid therapy for chronic, noncancer pain by primary care providers.

PubMed

Trafton, Jodie; Martins, Susana; Michel, Martha; Lewis, Eleanor; Wang, Dan; Combs, Ann; Scates, Naquell; Tu, Samson; Goldstein, Mary K

2010-04-01

To develop and evaluate a clinical decision support system (CDSS) named Assessment and Treatment in Healthcare: Evidenced-Based Automation (ATHENA)-Opioid Therapy, which encourages safe and effective use of opioid therapy for chronic, noncancer pain. CDSS development and iterative evaluation using the analysis, design, development, implementation, and evaluation process including simulation-based and in-clinic assessments of usability for providers followed by targeted system revisions. Volunteers provided detailed feedback to guide improvements in the graphical user interface, and content and design changes to increase clinical usefulness, understandability, clinical workflow fit, and ease of completing guideline recommended practices. Revisions based on feedback increased CDSS usability ratings over time. Practice concerns outside the scope of the CDSS were also identified. Usability testing optimized the CDSS to better address barriers such as lack of provider education, confusion in dosing calculations and titration schedules, access to relevant patient information, provider discontinuity, documentation, and access to validated assessment tools. It also highlighted barriers to good clinical practice that are difficult to address with CDSS technology in its current conceptualization. For example, clinicians indicated that constraints on time and competing priorities in primary care, discomfort in patient-provider communications, and lack of evidence to guide opioid prescribing decisions impeded their ability to provide effective, guideline-adherent pain management. Iterative testing was essential for designing a highly usable and acceptable CDSS; however, identified barriers may limit the impact of the ATHENA-Opioid Therapy system and other CDSS on clinical practices and outcomes unless CDSS are paired with parallel initiatives to address these issues.

Equity in Assistance? Usability of a U.S. Government Food Assistance Application

ERIC Educational Resources Information Center

Saal, Leah Katherine

2016-01-01

This article focuses on the quantitative phase of a multiphase mixed methods study investigating adults' and families' access to government food assistance. The research evaluates participants' comprehension of, and ability to, adequately complete authentic complex texts--national food assistance application documents. Summative usability testing…

Improving a Counselor Education Web Site through Usability Testing: The Bibliotherapy Education Project

ERIC Educational Resources Information Center

McMillen, Paula S.; Pehrsson, Dale-Elizabeth

2009-01-01

Technology proficiency expectations have proliferated in counselor education; however, limited information in the counseling literature details how to effectively evaluate or refine online resources from a design/utility standpoint. This description of a small-scale usability study demonstrates a cost-effective strategy for improving counselor…

77 FR 28853 - Proposed Information Collection; Comment Request; Generic Clearance for Usability Data Collections

Federal Register 2010, 2011, 2012, 2013, 2014

2012-05-16

... the Department of Commerce, proposes to conduct a number of data collection efforts--both quantitative and qualitative. The data collections will be designed to determine requirement and evaluate the usability and utility of NIST research for measurement and standardization work. These data collections...

User Satisfaction Evaluation of an Educational Website

ERIC Educational Resources Information Center

Akilli, Goknur Kaplan

2005-01-01

This study focuses on one particular aspect of usability, namely, user satisfaction, for an educational website used as a supportive tool for various courses by employing only one specific usability testing technique, a questionnaire. The researcher aimed to find out whether eighth semester undergraduate students of Computer Education and…

Competencies Needed by Seed Production and Distribution Company Employees.

ERIC Educational Resources Information Center

Morrow, Charles Kendall

To determine competencies needed by employees in the seed production and distribution industry, a questionnaire containing 49 competencies was compiled with the assistance of specialists and mailed to 100 company managers and 200 nonmanagerial employees. Returns from the 200 usable questionnaires indicate that the competencies needed most by…

Educational technology "Anatomy and Vital Signs": Evaluation study of content, appearance and usability.

PubMed

de Góes, Fernanda dos Santos Nogueira; Fonseca, Luciana Mara Monti; de Camargo, Rosangela Andrade Aukar; de Oliveira, Gustavo Faria; Felipe, Helena Reche

2015-11-01

The use of new technology has recently grown considerably as an increasing number of college students using Internet. In nursing education, the personal computer and the Internet facilitate teaching theoretical and practical knowledge. Evaluate an educational technology known as "Anatomy and Vital Signs" with respect to content, appearance and usability. This was a first stage evaluation-by specialists to verify content and functioning, prior to a second validation as to learning by students. A methodological study in which instructional technologists (11 participants) and nursing specialists (17 participants) used the technology in an unguided manner and completed three questionnaires. The evaluation was measured by the difference between disagreement and agreement for each statement in the questionnaires. Most of the items were positively evaluated at a level higher than 70% by most of the evaluators except for the following usability criteria: grouping by shape, minimum actions and user control, which did not attain the 70% agreement level among instructional technologists. The evaluation was useful to improve the technology and guarantee suitable product for nursing education. It may be a reliable educational tool for nursing education that applies technological resources. Copyright © 2015 Elsevier Ireland Ltd. All rights reserved.

Usability evaluation of cloud-based mapping tools for the display of very large datasets

NASA Astrophysics Data System (ADS)

Stotz, Nicole Marie

The elasticity and on-demand nature of cloud services have made it easier to create web maps. Users only need access to a web browser and the Internet to utilize cloud based web maps, eliminating the need for specialized software. To encourage a wide variety of users, a map must be well designed; usability is a very important concept in designing a web map. Fusion Tables, a new product from Google, is one example of newer cloud-based distributed GIS services. It allows for easy spatial data manipulation and visualization, within the Google Maps framework. ESRI has also introduced a cloud based version of their software, called ArcGIS Online, built on Amazon's EC2 cloud. Utilizing a user-centered design framework, two prototype maps were created with data from the San Diego East County Economic Development Council. One map was built on Fusion Tables, and another on ESRI's ArcGIS Online. A usability analysis was conducted and used to compare both map prototypes in term so of design and functionality. Load tests were also ran, and performance metrics gathered on both map prototypes. The usability analysis was taken by 25 geography students, and consisted of time based tasks and questions on map design and functionality. Survey participants completed the time based tasks for the Fusion Tables map prototype quicker than those of the ArcGIS Online map prototype. While response was generally positive towards the design and functionality of both prototypes, overall the Fusion Tables map prototype was preferred. For the load tests, the data set was broken into 22 groups for a total of 44 tests. While the Fusion Tables map prototype performed more efficiently than the ArcGIS Online prototype, differences are almost unnoticeable. A SWOT analysis was conducted for each prototype. The results from this research point to the Fusion Tables map prototype. A redesign of this prototype would incorporate design suggestions from the usability survey, while some functionality would need to be dropped. This is a free product and would therefore be the best option if cost is an issue, but this map may not be supported in the future.

Comparing two anesthesia information management system user interfaces: a usability evaluation.

PubMed

Wanderer, Jonathan P; Rao, Anoop V; Rothwell, Sarah H; Ehrenfeld, Jesse M

2012-11-01

Anesthesia information management systems (AIMS) have been developed by multiple vendors and are deployed in thousands of operating rooms around the world, yet not much is known about measuring and improving AIMS usability. We developed a methodology for evaluating AIMS usability in a low-fidelity simulated clinical environment and used it to compare an existing user interface with a revised version. We hypothesized that the revised user interface would be more useable. In a low-fidelity simulated clinical environment, twenty anesthesia providers documented essential anesthetic information for the start of the case using both an existing and a revised user interface. Participants had not used the revised user interface previously and completed a brief training exercise prior to the study task. All participants completed a workload assessment and a satisfaction survey. All sessions were recorded. Multiple usability metrics were measured. The primary outcome was documentation accuracy. Secondary outcomes were perceived workload, number of documentation steps, number of user interactions, and documentation time. The interfaces were compared and design problems were identified by analyzing recorded sessions and survey results. Use of the revised user interface was shown to improve documentation accuracy from 85.1% to 92.4%, a difference of 7.3% (95% confidence interval [CI] for the difference 1.8 to 12.7). The revised user interface decreased the number of user interactions by 6.5 for intravenous documentation (95% CI 2.9 to 10.1) and by 16.1 for airway documentation (95% CI 11.1 to 21.1). The revised user interface required 3.8 fewer documentation steps (95% CI 2.3 to 5.4). Airway documentation time was reduced by 30.5 seconds with the revised workflow (95% CI 8.5 to 52.4). There were no significant time differences noted in intravenous documentation or in total task time. No difference in perceived workload was found between the user interfaces. Two user interface design problems were identified in the revised user interface. The usability of anesthesia information management systems can be evaluated using a low-fidelity simulated clinical environment. User testing of the revised user interface showed improvement in some usability metrics and highlighted areas for further revision. Vendors of AIMS and those who use them should consider adopting methods to evaluate and improve AIMS usability.

Airborne geophysical mapping as an innovative methodology for landslide investigation: evaluation of results from the Gschliefgraben landslide, Austria

NASA Astrophysics Data System (ADS)

Supper, R.; Baroň, I.; Ottowitz, D.; Motschka, K.; Gruber, S.; Winkler, E.; Jochum, B.; Römer, A.

2013-05-01

In September 2009, a complex airborne geophysical survey was performed in the large landslide affected area of the Gschliefgraben valley, Upper Austria, in order to evaluate the usability of this method for landslide detection and mapping. An evaluation of the results, including different remote sensing and ground based methods, proved that airborne geophysics, especially the airborne electromagnetic method, has a high potential for landslide investigation. This is due to its sensitivity to fluid and clay content and porosity, which are parameters showing characteristic values in landslide prone structures. Resistivity distributions in different depth levels as well as depth-slices along selected profiles are presented and compared with ground geoelectrical profiles for the test area of Gschliefgraben. Further interesting results can be derived from the radiometric survey, whereas the naturally occurring radioisotopes 40K and 232Th, as well as the man-made nuclide 137Cs have been considered. While the content of potassium and thorium in the shallow subsurface layer is expressively related to the lithological composition, the distribution of caesium is mainly determined by mass wasting processes.

Public health information and statistics dissemination efforts for Indonesia on the Internet.

PubMed

Hanani, Febiana; Kobayashi, Takashi; Jo, Eitetsu; Nakajima, Sawako; Oyama, Hiroshi

2011-01-01

To elucidate current issues related to health statistics dissemination efforts on the Internet in Indonesia and to propose a new dissemination website as a solution. A cross-sectional survey was conducted. Sources of statistics were identified using link relationship and Google™ search. Menu used to locate statistics, mode of presentation and means of access to statistics, and available statistics were assessed for each site. Assessment results were used to derive design specification; a prototype system was developed and evaluated with usability test. 49 sources were identified on 18 governmental, 8 international and 5 non-government websites. Of 49 menus identified, 33% used non-intuitive titles and lead to inefficient search. 69% of them were on government websites. Of 31 websites, only 39% and 23% used graph/chart and map for presentation. Further, only 32%, 39% and 19% provided query, export and print feature. While >50% sources reported morbidity, risk factor and service provision statistics, <40% sources reported health resource and mortality statistics. Statistics portal website was developed using Joomla!™ content management system. Usability test demonstrated its potential to improve data accessibility. In this study, government's efforts to disseminate statistics in Indonesia are supported by non-governmental and international organizations and existing their information may not be very useful because it is: a) not widely distributed, b) difficult to locate, and c) not effectively communicated. Actions are needed to ensure information usability, and one of such actions is the development of statistics portal website.

From expert-derived user needs to user-perceived ease of use and usefulness: a two-phase mixed-methods evaluation framework.

PubMed

Boland, Mary Regina; Rusanov, Alexander; So, Yat; Lopez-Jimenez, Carlos; Busacca, Linda; Steinman, Richard C; Bakken, Suzanne; Bigger, J Thomas; Weng, Chunhua

2014-12-01

Underspecified user needs and frequent lack of a gold standard reference are typical barriers to technology evaluation. To address this problem, this paper presents a two-phase evaluation framework involving usability experts (phase 1) and end-users (phase 2). In phase 1, a cross-system functionality alignment between expert-derived user needs and system functions was performed to inform the choice of "the best available" comparison system to enable a cognitive walkthrough in phase 1 and a comparative effectiveness evaluation in phase 2. During phase 2, five quantitative and qualitative evaluation methods are mixed to assess usability: time-motion analysis, software log, questionnaires - System Usability Scale and the Unified Theory of Acceptance of Use of Technology, think-aloud protocols, and unstructured interviews. Each method contributes data for a unique measure (e.g., time motion analysis contributes task-completion-time; software log contributes action transition frequency). The measures are triangulated to yield complementary insights regarding user-perceived ease-of-use, functionality integration, anxiety during use, and workflow impact. To illustrate its use, we applied this framework in a formative evaluation of a software called Integrated Model for Patient Care and Clinical Trials (IMPACT). We conclude that this mixed-methods evaluation framework enables an integrated assessment of user needs satisfaction and user-perceived usefulness and usability of a novel design. This evaluation framework effectively bridges the gap between co-evolving user needs and technology designs during iterative prototyping and is particularly useful when it is difficult for users to articulate their needs for technology support due to the lack of a baseline. Copyright © 2013 Elsevier Inc. All rights reserved.

Evaluating the Usability of a Free Electronic Health Record for Training

PubMed Central

Hoyt, Robert; Adler, Kenneth; Ziesemer, Brandy; Palombo, Georgina

2013-01-01

The United States will need to train a large workforce of skilled health information technology (HIT) professionals in order to meet the US government's goal of universal electronic health records (EHRs) for all patients and widespread health information exchange. The Health Information Technology for Economic and Clinical Health (HITECH) Act established several HIT workforce educational programs to accomplish this goal. Recent studies have shown that EHR usability is a significant concern of physicians and is a potential obstacle to EHR adoption. It is important to have a highly usable EHR to train both clinicians and students. In this article, we report a qualitative-quantitative usability analysis of a web-based EHR for training health informatics and health information management students. PMID:23805062

The influence of socio-cultural background and product value in usability testing.

PubMed

Sonderegger, Andreas; Sauer, Juergen

2013-05-01

This article examines the influence of socio-cultural background and product value on different outcomes of usability tests. A study was conducted in two different socio-cultural regions, Switzerland and East Germany, which differed in a number of aspects (e.g. economic power, price sensitivity and culture). Product value (high vs. low) was varied by manipulating the price of the product. Sixty-four test participants were asked to carry out five typical user tasks in the context of coffee machine usage, measuring performance, perceived usability, and emotion. The results showed that in Switzerland, high-value products were rated higher in usability than low-value products whereas in East Germany, high-value products were evaluated lower in usability. A similar interaction effect of socio-cultural background and product value was observed for user emotion. Implications are that the outcomes of usability tests do not allow for a simple transfer across cultures and that the mediating influence of perceived product value needs to be taken into consideration. Copyright © 2012 Elsevier Ltd and The Ergonomics Society. All rights reserved.

A Re-evaluation of Discarded Deceased Donor Kidneys in the UK: Are Usable Organs Still Being Discarded?

PubMed

Mittal, Shruti; Adamusiak, Anna; Horsfield, Catherine; Loukopoulos, Ioannis; Karydis, Nikolaos; Kessaris, Nicos; Drage, Martin; Olsburgh, Jonathon; Watson, Christopher Je; Callaghan, Chris J

2017-07-01

A significant proportion of procured deceased donor kidneys are subsequently discarded. The UK Kidney Fast-Track Scheme (KFTS) was introduced in 2012, enabling kidneys at risk of discard to be simultaneously offered to participating centers. We undertook an analysis of discarded kidneys to determine if unnecessary organ discard was still occurring since the KFTS was introduced. Between April and June 2015, senior surgeons independently inspected 31 consecutive discarded kidneys from throughout the United Kingdom. All kidneys were biopsied. Organs were categorized as usable, possibly usable pending histology, or not usable for implantation. After histology reports were available, final assessments of usability were made. There were 19 donors (6 donations after brain death, 13 donations after circulatory death), with a median (range) donor age of 67 (29-83) years and Kidney Donor Profile Index of 93 (19-100). Reasons for discard were variable. Only 3 discarded kidneys had not entered the KFTS. After initial assessment postdiscard, 11 kidneys were assessed as usable, with 9 kidneys thought to be possibly usable. Consideration of histological data reduced the number of kidneys thought usable to 10 (10/31; 32%). The KFTS scheme is successfully identifying organs at high risk of discard, though potentially transplantable organs are still being discarded. Analyses of discarded organs are essential to identify barriers to organ utilization and develop strategies to reduce unnecessary discard.

Mobile Applications for Diabetics: A Systematic Review and Expert-Based Usability Evaluation Considering the Special Requirements of Diabetes Patients Age 50 Years or Older

PubMed Central

Quade, Mandy; Kirch, Wilhelm

2014-01-01

Background A multitude of mhealth (mobile health) apps have been developed in recent years to support effective self-management of patients with diabetes mellitus type 1 or 2. Objective We carried out a systematic review of all currently available diabetes apps for the operating systems iOS and Android. We considered the number of newly released diabetes apps, range of functions, target user groups, languages, acquisition costs, user ratings, available interfaces, and the connection between acquisition costs and user ratings. Additionally, we examined whether the available applications serve the special needs of diabetes patients aged 50 or older by performing an expert-based usability evaluation. Methods We identified relevant keywords, comparative categories, and their specifications. Subsequently, we performed the app review based on the information given in the Google Play Store, the Apple App Store, and the apps themselves. In addition, we carried out an expert-based usability evaluation based on a representative 10% sample of diabetes apps. Results In total, we analyzed 656 apps finding that 355 (54.1%) offered just one function and 348 (53.0%) provided a documentation function. The dominating app language was English (85.4%, 560/656), patients represented the main user group (96.0%, 630/656), and the analysis of the costs revealed a trend toward free apps (53.7%, 352/656). The median price of paid apps was €1.90. The average user rating was 3.6 stars (maximum 5). Our analyses indicated no clear differences in the user rating between free and paid apps. Only 30 (4.6%) of the 656 available diabetes apps offered an interface to a measurement device. We evaluated 66 apps within the usability evaluation. On average, apps were rated best regarding the criterion “comprehensibility” (4.0 out of 5.0), while showing a lack of “fault tolerance” (2.8 out of 5.0). Of the 66 apps, 48 (72.7%) offered the ability to read the screen content aloud. The number of functions was significantly negative correlated with usability. The presence of documentation and analysis functions reduced the usability score significantly by 0.36 and 0.21 points. Conclusions A vast number of diabetes apps already exist, but the majority offer similar functionalities and combine only one to two functions in one app. Patients and physicians alike should be involved in the app development process to a greater extent. We expect that the data transmission of health parameters to physicians will gain more importance in future applications. The usability of diabetes apps for patients aged 50 or older was moderate to good. But this result applied mainly to apps offering a small range of functions. Multifunctional apps performed considerably worse in terms of usability. Moreover, the presence of a documentation or analysis function resulted in significantly lower usability scores. The operability of accessibility features for diabetes apps was quite limited, except for the feature “screen reader”. PMID:24718852

Evaluating the Acceptability and Usability of EASEL: A Mobile Application That Supports Guided Reflection for Experiential Learning Activities

ERIC Educational Resources Information Center

Schnepp, Jerry; Rogers, Christian

2017-01-01

Aim/Purpose: To examine the early perceptions (acceptability) and usability of EASEL (Education through Application-Supported Experiential Learning), a mobile platform that delivers reflection prompts and content before, during, and after an experiential learning activity. Background: Experiential learning is an active learning approach in which…

General Framework for Evaluating Password Complexity and Strength

DTIC Science & Technology

2015-11-15

stronger password requirements: User attitudes and behaviors,” in Pro- ceedings of the Sixth Symposium on Usable Privacy and Security, ser. SOUPS ’10. New...Proceedings of the Eighth Symposium on Usable Privacy and Security, ser. SOUPS ’12. New York, NY, USA: ACM, 2012, pp. 1–20. [22] P. Kelley, S. Komanduri

"Introduction to Teaching Online": Usability Evaluation of Interactivity in an Online Social Constructivist Course

ERIC Educational Resources Information Center

Robinson, Heather A.; Sheffield, Anneliese; Phillips, Alana S.; Moore, Michelle

2017-01-01

In this study, the usability of a social constructivist online teacher preparation course was examined using a framework developed for asynchronous constructivist courses. In particular, students' approaches to learning through interactivity were examined. Students from around the world participated in the course. Data from weekly feedback were…

Conferences as Information Grounds: Web Site Evaluation with a Mobile Usability Laboratory

ERIC Educational Resources Information Center

Bossaller, Jenny S.; Paul, Anindita; Hill, Heather; Wang, Jiazhen; Erdelez, Sanda

2008-01-01

This article describes an "on-the-road" usability study and explains the study's methodological challenges, solutions, and recommendations. The study concerned a library-consortium website, which is a communication and educational tool for librarians who are physically dispersed throughout the state, and an intranet for remote users.…

Design Rationale Behind the Serious Self-Regulation Game Intervention "Balance It": Overweight Prevention Among Secondary Vocational Education Students in The Netherlands.

PubMed

Spook, Jorinde E; Paulussen, Theo; Paulissen, Rosie; Visschedijk, Gillian; Kok, Gerjo; van Empelen, Pepijn

2015-10-01

This article describes the design rationale behind a serious self-regulation game intervention. The aim of the game is to promote healthy dietary intake and physical activity among secondary vocational educational students in The Netherlands (approximately 16-20 years of age). The game "Balance It" was developed according to an intervention mapping (IM) protocol. Following IM, we specified health promotion and usability objectives and linked these objectives to selected behavior change and persuasive methods. Accordingly, these methods were translated into a coherent intervention program. The health behavior change objectives were derived from the determinants of the behavior and from Self-Regulation Theory (e.g., students are asked to set goals, monitor and evaluate their behavior, and create coping plans). Usability objectives were derived from the RE-AIM model (i.e., Reach, Effectiveness, Adoption, Implementation, and Maintenance). Next, behavior change and persuasive techniques were selected (e.g., goal setting and prompting, respectively) that did fit with the targeted change objectives and were translated in the design of a (mobile) serious self-regulation game intervention. Subsequently, three concept and usability tests were performed to improve intervention usability, and an evaluation plan was developed. The aim of this study was to provide a design rationale for game interventions targeting health-related behaviors. We developed a coherent program design in which both health behavior change and usability factors are addressed. The IM protocol can serve as a useful guide for decision making in program development and evaluation.

An Evaluation of the Design and Usability of a Novel Robotic Bilateral Arm Rehabilitation Device for Patients with Stroke.

PubMed

Pei, Yu-Cheng; Chen, Jean-Lon; Wong, Alice M K; Tseng, Kevin C

2017-01-01

Case series. IV (case series). Robot-assisted therapy for upper limb rehabilitation is an emerging research topic and its design process must integrate engineering, neurological pathophysiology, and clinical needs. This study developed/evaluated the usefulness of a novel rehabilitation device, the MirrorPath , designed for the upper limb rehabilitation of patients with hemiplegic stroke. The process follows Tseng's methodology for innovative product design and development, namely two stages, device development and usability assessment. During the development process, the design was guided by patients' rehabilitation needs as defined by patients and their therapists. The design applied synchronic movement of the bilateral upper limbs, an approach that is compatible with the bilateral movement therapy and proprioceptive neuromuscular facilitation theories. MirrorPath consists of a robotic device that guides upper limb movement linked to a control module containing software controlling the robotic movement. Five healthy subjects were recruited in the pretest, and 4 patients, 4 caregivers, and 4 therapists were recruited in the formal test for usability. All recruited subjects were allocated to the test group, completed the evaluation, and their data were all analyzed. The total system usability scale score obtained from the patients, caregivers, and therapists was 71.8 ± 11.9, indicating a high level of usability and product acceptance. Following a standard development process, we could yield a design that meets clinical needs. This low-cost device provides a feasible platform for carrying out robot-assisted bilateral movement therapy of patients with hemiplegic stroke. identifier NCT02698605.

ODMSummary: A Tool for Automatic Structured Comparison of Multiple Medical Forms Based on Semantic Annotation with the Unified Medical Language System.

PubMed

Storck, Michael; Krumm, Rainer; Dugas, Martin

2016-01-01

Medical documentation is applied in various settings including patient care and clinical research. Since procedures of medical documentation are heterogeneous and developed further, secondary use of medical data is complicated. Development of medical forms, merging of data from different sources and meta-analyses of different data sets are currently a predominantly manual process and therefore difficult and cumbersome. Available applications to automate these processes are limited. In particular, tools to compare multiple documentation forms are missing. The objective of this work is to design, implement and evaluate the new system ODMSummary for comparison of multiple forms with a high number of semantically annotated data elements and a high level of usability. System requirements are the capability to summarize and compare a set of forms, enable to estimate the documentation effort, track changes in different versions of forms and find comparable items in different forms. Forms are provided in Operational Data Model format with semantic annotations from the Unified Medical Language System. 12 medical experts were invited to participate in a 3-phase evaluation of the tool regarding usability. ODMSummary (available at https://odmtoolbox.uni-muenster.de/summary/summary.html) provides a structured overview of multiple forms and their documentation fields. This comparison enables medical experts to assess multiple forms or whole datasets for secondary use. System usability was optimized based on expert feedback. The evaluation demonstrates that feedback from domain experts is needed to identify usability issues. In conclusion, this work shows that automatic comparison of multiple forms is feasible and the results are usable for medical experts.

Usability and feasibility of mobile phone diaries in an experimental physical exercise study.

PubMed

Heinonen, Reetta; Luoto, Riitta; Lindfors, Pirjo; Nygård, Clas-Håkan

2012-03-01

Wireless and mobile phone technology as a method of data collection will increase alongside conventional methods. The aim of the present study was to evaluate the use of a mobile phone application for recording symptoms and physical activity exertion during an experimental physical exercise study. An experimental study on the effects of physical exercise on the well-being of menopausal women included 158 subjects between 44 and 63 years of age. The women were randomized into intervention and control groups. All participants in both groups reported daily symptoms by responding to morning and evening questionnaires via mobile phones. The usability of the mobile phone as a data collector tool was evaluated with the System Usability Scale (SUS) questionnaire 2 months after the intervention. The feasibility evaluation was based on the frequency of responses and open questions. The response rates were about 70% to both morning and evening questionnaires. The average frequency of responses (n =158) to morning questionnaires was 125 (±40)/170 (±14) and to evening questionnaires was 118 (±40)/171 (±14). The response rate did not differ between the intervention and the control groups. The SUS score was on average 75.4 (range, 0-100; n =107). A mobile phone diary is a feasible and usable tool for data collection in clinical trials.

How to Present Evidence-Based Usability Design Principles Dedicated to Medication-Related Alerting Systems to Designers and Evaluators? Results from a Workshop.

PubMed

Marcilly, Romaric; Monkman, Helen; Villumsen, Sidsel; Kaufman, David; Beuscart-Zephir, Marie-Catherine

2016-01-01

Medication alerting system use errors and lack of adoption are often attributed to usability issues. Previous work has used evidence from the literature to reveal usability principles specific to medication alerting systems and identify potential consequences of violating these principles. The current study sought to explore how best to convey these principles to designers and evaluators of these systems to facilitate their work. To this aim, a workshop with 19 participants was used to generate ideas and opinions on how to deliver these topic-specific design principles in a way that would be most helpful for them. Participants generated ideas for how (e.g., a collaborative, continuously updated forum) and what (e.g., illustrations, checklists, evidence sources and strength, consequences of violations) information is most useful to disseminate usability principles for medication alerting systems. Participants, especially designers, expressed desire to use these principles in practice and avoid previously documented mistakes and therefore make design and evaluation of these systems more effective and efficient. Those insights are discussed in terms of feasibility and logistical challenges to developing the proposed documentation). To move this work forward, a more collaborative approach of Human Factors specialists in medical informatics is necessary.

Development of an interactive social media tool for parents with concerns about vaccines.

PubMed

Shoup, Jo Ann; Wagner, Nicole M; Kraus, Courtney R; Narwaney, Komal J; Goddard, Kristin S; Glanz, Jason M

2015-06-01

Describe a process for designing, building, and evaluating a theory-driven social media intervention tool to help reduce parental concerns about vaccination. We developed an interactive web-based tool using quantitative and qualitative methods (e.g., survey, focus groups, individual interviews, and usability testing). Survey results suggested that social media may represent an effective intervention tool to help parents make informed decisions about vaccination for their children. Focus groups and interviews revealed four main themes for development of the tool: Parents wanted information describing both benefits and risks of vaccination, transparency of sources of information, moderation of the tool by an expert, and ethnic and racial diversity in the visual display of people. Usability testing showed that parents were satisfied with the usability of the tool but had difficulty with performing some of the informational searches. Based on focus groups, interviews, and usability evaluations, we made additional revisions to the tool's content, design, functionality, and overall look and feel. Engaging parents at all stages of development is critical when designing a tool to address concerns about childhood vaccines. Although this can be both resource- and time-intensive, the redesigned tool is more likely to be accepted and used by parents. Next steps involve a formal evaluation through a randomized trial. © 2014 Society for Public Health Education.

Placing wireless tablets in clinical settings for patient education.

PubMed

Stribling, Judy C; Richardson, Joshua E

2016-04-01

The authors explored the feasibility and possible benefit of tablet-based educational materials for patients in clinic waiting areas. We distributed eight tablets preloaded with diagnosis-relevant information in two clinic waiting areas. Patients were surveyed about satisfaction, usability, and effects on learning. Technical issues were resolved. Thirty-seven of forty patients completed the survey. On average, the patients were satisfied in all categories. Placing tablet-based educational materials in clinic waiting areas is relatively easy to implement. Patients using tablets reported satisfaction across three domains: usability, education, and satisfaction.

Monitoring dietary intake and physical activity electronically: feasibility, usability, and ecological validity of a mobile-based Ecological Momentary Assessment tool.

PubMed

Spook, Jorinde Eline; Paulussen, Theo; Kok, Gerjo; Van Empelen, Pepijn

2013-09-24

Despite the growing body of research on complex lifestyle behaviors (eg, Dietary Intake [DI] and Physical Activity [PA]), monitoring of these behaviors has been hampered by a lack of suitable methods. A possible solution to this deficiency is mobile-based Ecological Momentary Assessment (mEMA), which enables researchers to collect data on participants' states in real-time by means of a smartphone application. However, feasibility, usability, and ecological validity need to be anticipated and managed in order to enhance the validity of mEMA. To examine the feasibility, usability, and ecological validity of a mEMA application (app) with regard to DI and PA among Dutch vocational education students. The students (n=30) participated in the mEMA study for seven consecutive days. They downloaded the mEMA app on their smartphone. Feasibility and usability of the mEMA app were evaluated by completing an online evaluation after seven days of participation. Ecological validity was measured by assessing the degree to which the content of the mEMA app approximated the real-world setting that was being examined, through several multiple-choice questions. Compliance rates, as registered by the mEMA app, declined 46% over a seven-day period, while self-reported compliance, as measured with an online evaluation questionnaire afterwards, indicated a smaller decrease in compliance (29%). The students evaluated the mEMA app as feasible and usable. Ecological validity analyses showed that all DI and almost all PA multiple-choice options were covered with the compound response categories. The mEMA app offers the opportunity to assess complex health behaviors (eg, DI and PA) in real-time settings, in which specifically routinized behaviors are involved. However, the mEMA app faced several challenges that needed to be overcome in order to improve its validity. Overall, the present study showed that the mEMA app is a usable and ecologically valid tool to measure DI and PA behaviors among vocational education students, but compliance is still limited.

From Usability Testing to Clinical Simulations: Bringing Context into the Design and Evaluation of Usable and Safe Health Information Technologies. Contribution of the IMIA Human Factors Engineering for Healthcare Informatics Working Group.

PubMed

Kushniruk, A; Nohr, C; Jensen, S; Borycki, E M

2013-01-01

The objective of this paper is to explore human factors approaches to understanding the use of health information technology (HIT) by extending usability engineering approaches to include analysis of the impact of clinical context through use of clinical simulations. Methods discussed are considered on a continuum from traditional laboratory-based usability testing to clinical simulations. Clinical simulations can be conducted in a simulation laboratory and they can also be conducted in real-world settings. The clinical simulation approach attempts to bring the dimension of clinical context into stronger focus. This involves testing of systems with representative users doing representative tasks, in representative settings/environments. Application of methods where realistic clinical scenarios are used to drive the study of users interacting with systems under realistic conditions and settings can lead to identification of problems and issues with systems that may not be detected using traditional usability engineering methods. In conducting such studies, careful consideration is needed in creating ecologically valid test scenarios. The evidence obtained from such evaluation can be used to improve both the usability and safety of HIT. In addition, recent work has shown that clinical simulations, in particular those conducted in-situ, can lead to considerable benefits when compared to the costs of running such studies. In order to bring context of use into the testing of HIT, clinical simulation, involving observing representative users carrying out tasks in representative settings, holds considerable promise.

Semantic Indexing of Medical Learning Objects: Medical Students' Usage of a Semantic Network

PubMed Central

Gießler, Paul; Ohnesorge-Radtke, Ursula; Spreckelsen, Cord

2015-01-01

Background The Semantically Annotated Media (SAM) project aims to provide a flexible platform for searching, browsing, and indexing medical learning objects (MLOs) based on a semantic network derived from established classification systems. Primarily, SAM supports the Aachen emedia skills lab, but SAM is ready for indexing distributed content and the Simple Knowledge Organizing System standard provides a means for easily upgrading or even exchanging SAM’s semantic network. There is a lack of research addressing the usability of MLO indexes or search portals like SAM and the user behavior with such platforms. Objective The purpose of this study was to assess the usability of SAM by investigating characteristic user behavior of medical students accessing MLOs via SAM. Methods In this study, we chose a mixed-methods approach. Lean usability testing was combined with usability inspection by having the participants complete four typical usage scenarios before filling out a questionnaire. The questionnaire was based on the IsoMetrics usability inventory. Direct user interaction with SAM (mouse clicks and pages accessed) was logged. Results The study analyzed the typical usage patterns and habits of students using a semantic network for accessing MLOs. Four scenarios capturing characteristics of typical tasks to be solved by using SAM yielded high ratings of usability items and showed good results concerning the consistency of indexing by different users. Long-tail phenomena emerge as they are typical for a collaborative Web 2.0 platform. Suitable but nonetheless rarely used keywords were assigned to MLOs by some users. Conclusions It is possible to develop a Web-based tool with high usability and acceptance for indexing and retrieval of MLOs. SAM can be applied to indexing multicentered repositories of MLOs collaboratively. PMID:27731860

Semantic Indexing of Medical Learning Objects: Medical Students' Usage of a Semantic Network.

PubMed

Tix, Nadine; Gießler, Paul; Ohnesorge-Radtke, Ursula; Spreckelsen, Cord

2015-11-11

The Semantically Annotated Media (SAM) project aims to provide a flexible platform for searching, browsing, and indexing medical learning objects (MLOs) based on a semantic network derived from established classification systems. Primarily, SAM supports the Aachen emedia skills lab, but SAM is ready for indexing distributed content and the Simple Knowledge Organizing System standard provides a means for easily upgrading or even exchanging SAM's semantic network. There is a lack of research addressing the usability of MLO indexes or search portals like SAM and the user behavior with such platforms. The purpose of this study was to assess the usability of SAM by investigating characteristic user behavior of medical students accessing MLOs via SAM. In this study, we chose a mixed-methods approach. Lean usability testing was combined with usability inspection by having the participants complete four typical usage scenarios before filling out a questionnaire. The questionnaire was based on the IsoMetrics usability inventory. Direct user interaction with SAM (mouse clicks and pages accessed) was logged. The study analyzed the typical usage patterns and habits of students using a semantic network for accessing MLOs. Four scenarios capturing characteristics of typical tasks to be solved by using SAM yielded high ratings of usability items and showed good results concerning the consistency of indexing by different users. Long-tail phenomena emerge as they are typical for a collaborative Web 2.0 platform. Suitable but nonetheless rarely used keywords were assigned to MLOs by some users. It is possible to develop a Web-based tool with high usability and acceptance for indexing and retrieval of MLOs. SAM can be applied to indexing multicentered repositories of MLOs collaboratively.

DISTRIBUTED STRUCTURE-SEARCHABLE TOXICITY (DSSTOX) DATABASE NETWORK: MAKING PUBLIC TOXICITY DATA RESOURCES MORE ACCESSIBLE AND USABLE FOR DATA EXPLORATION AND SAR DEVELOPMENT

EPA Science Inventory

Distributed Structure-Searchable Toxicity (DSSTox) Database Network: Making Public Toxicity Data Resources More Accessible and U sable for Data Exploration and SAR Development

Many sources of public toxicity data are not currently linked to chemical structure, are not ...

A support architecture for reliable distributed computing systems

NASA Technical Reports Server (NTRS)

Dasgupta, Partha; Leblanc, Richard J., Jr.

1988-01-01

The Clouds project is well underway to its goal of building a unified distributed operating system supporting the object model. The operating system design uses the object concept of structuring software at all levels of the system. The basic operating system was developed and work is under progress to build a usable system.

Usability and accessibility in consumer health informatics current trends and future challenges.

PubMed

Goldberg, Larry; Lide, Bettijoyce; Lowry, Svetlana; Massett, Holly A; O'Connell, Trisha; Preece, Jennifer; Quesenbery, Whitney; Shneiderman, Ben

2011-05-01

It is a truism that, for innovative eHealth systems to have true value and impact, they must first and foremost be usable and accessible by clinicians, consumers, and other stakeholders. In this paper, current trends and future challenges in the usability and accessibility of consumer health informatics will be described. Consumer expectations of their healthcare providers and healthcare records in this new era of consumer-directed care will be explored, and innovative visualizations, assistive technologies, and other ways that healthcare information is currently being provided and/or shared will be described. Challenges for ensuring the usability of current and future systems will also be discussed. An innovative model for conducting systematic, timely, user-centered research on consumer-facing websites at the National Cancer Institute (NCI) and the ongoing efforts at the National Institute of Standards and Technology (NIST) to promote health information technology (HIT) usability standards and evaluation criteria will also be presented. Copyright © 2011 American Journal of Preventive Medicine. All rights reserved.

Usability: a critical success factor for managing change in the clinical info-structure.

PubMed

Kay, S

2005-06-01

There can be no doubt that the clinical info-structure is being significantly enriched with the deployment of new systems throughout the health sector. From a technological perspective, the initial emphasis has been mainly on functionality and only latterly on the usability of these clinical information systems. However, the large scale and rapid pace of the changes being wrought in the health sector will have a major impact on clinicians and patients, not least in how they interact with the technology. Therefore, it is not only hardware and software but people-ware, too, that needs to be actively managed; not simply a one-off functional specification but an ongoing, complex relationship. Usability is the human factor that encompasses the ethical, educational, and evaluative aspects of design. There is also a strong case for regarding usability of clinical information systems as a key critical success factor for the management of change within the health-care domain. In particular, the relationship between usability, and education and training is examined.

Feasibility and usability of a home monitoring concept based on mobile phones and near field communication (NFC) technology.

PubMed

Morak, Jürgen; Kollmann, Alexander; Schreier, Günter

2007-01-01

Utilization of mobile information and communication technologies in home monitoring applications is becoming more and more common. The mobile phone, acting as a patient terminal for patients suffering from chronic diseases, provides an active link to the caregiver to transmit health status information and receive feedback. In such a concept the usability is still limited by the necessity of entering the values via the mobile phone's small keypad. The near field communication technology (NFC), a touch-based wireless interface that became available recently, may improve the usability level of such applications significantly. The focus of this paper is to describe the development of a prototype application based on this technology embedded in a home monitoring system. The feasibility and usability of this approach are evaluated and compared with concepts used in previous approaches. The high quantifier with respect to overall usability indicates that NFC may be the technology of choice for some tasks in home monitoring applications.

A usability evaluation exploring the design of American Nurses Association state web sites.

PubMed

Alexander, Gregory L; Wakefield, Bonnie J; Anbari, Allison B; Lyons, Vanessa; Prentice, Donna; Shepherd, Marilyn; Strecker, E Bradley; Weston, Marla J

2014-08-01

National leaders are calling for opportunities to facilitate the Future of Nursing. Opportunities can be encouraged through state nurses association Web sites, which are part of the American Nurses Association, that are well designed, with appropriate content, and in a language professional nurses understand. The American Nurses Association and constituent state nurses associations provide information about nursing practice, ethics, credentialing, and health on Web sites. We conducted usability evaluations to determine compliance with heuristic and ethical principles for Web site design. We purposefully sampled 27 nursing association Web sites and used 68 heuristic and ethical criteria to perform systematic usability assessments of nurse association Web sites. Web site analysis included seven double experts who were all RNs trained in usability analysis. The extent to which heuristic and ethical criteria were met ranged widely from one state that met 0% of the criteria for "help and documentation" to states that met greater than 92% of criteria for "visibility of system status" and "aesthetic and minimalist design." Suggested improvements are simple yet make an impact on a first-time visitor's impression of the Web site. For example, adding internal navigation and tracking features and providing more details about the application process through help and frequently asked question documentation would facilitate better use. Improved usability will improve effectiveness, efficiency, and consumer satisfaction with these Web sites.

A methodological approach for designing a usable ontology-based GUI in healthcare.

PubMed

Lasierra, N; Kushniruk, A; Alesanco, A; Borycki, E; García, J

2013-01-01

This paper presents a methodological approach to the design and evaluation of an interface for an ontology-based system used for designing care plans for monitoring patients at home. In order to define the care plans, physicians need a tool for creating instances of the ontology and configuring some rules. Our purpose is to develop an interface to allow clinicians to interact with the ontology. Although ontology-driven applications do not necessarily present the ontology in the user interface, it is our hypothesis that showing selected parts of the ontology in a "usable" way could enhance clinician's understanding and make easier the definition of the care plans. Based on prototyping and iterative testing, this methodology combines visualization techniques and usability methods. Preliminary results obtained after a formative evaluation indicate the effectiveness of suggested combination.

Knowledge management impact of information technology Web 2.0/3.0. The case study of agent software technology usability in knowledge management system

NASA Astrophysics Data System (ADS)

Sołtysik-Piorunkiewicz, Anna

2015-02-01

How we can measure the impact of internet technology Web 2.0/3.0 for knowledge management? How we can use the Web 2.0/3.0 technologies for generating, evaluating, sharing, organizing knowledge in knowledge-based organization? How we can evaluate it from user-centered perspective? Article aims to provide a method for evaluate the usability of web technologies to support knowledge management in knowledge-based organizations of the various stages of the cycle knowledge management, taking into account: generating knowledge, evaluating knowledge, sharing knowledge, etc. for the modern Internet technologies based on the example of agent technologies. The method focuses on five areas of evaluation: GUI, functional structure, the way of content publication, organizational aspect, technological aspect. The method is based on the proposed indicators relating respectively to assess specific areas of evaluation, taking into account the individual characteristics of the scoring. Each of the features identified in the evaluation is judged first point wise, then this score is subject to verification and clarification by means of appropriate indicators of a given feature. The article proposes appropriate indicators to measure the impact of Web 2.0/3.0 technologies for knowledge management and verification them in an example of agent technology usability in knowledge management system.

Evaluation of the functional performance and technical quality of an Electronic Documentation System of the Nursing Process.

PubMed

de Oliveira, Neurilene Batista; Peres, Heloisa Helena Ciqueto

2015-01-01

To evaluate the functional performance and the technical quality of the Electronic Documentation System of the Nursing Process of the Teaching Hospital of the University of São Paulo. exploratory-descriptive study. The Quality Model of regulatory standard 25010 and the Evaluation Process defined under regulatory standard 25040, both of the International Organization for Standardization/International Electrotechnical Commission. The quality characteristics evaluated were: functional suitability, reliability, usability, performance efficiency, compatibility, security, maintainability and portability. The sample was made up of 37 evaluators. in the evaluation of the specialists in information technology, only the characteristic of usability obtained a rate of positive responses of less than 70%. For the nurse lecturers, all the quality characteristics obtained a rate of positive responses of over 70%. The staff nurses of the medical and surgical clinics with experience in using the system) and staff nurses from other units of the hospital and from other health institutions (without experience in using the system) obtained rates of positive responses of more than 70% referent to the functional suitability, usability, and security. However, performance efficiency, reliability and compatibility all obtained rates below the parameter established. the software achieved rates of positive responses of over 70% for the majority of the quality characteristics evaluated.

Evaluating the Usability of a Professional Modeling Tool Repurposed for Middle School Learning

ERIC Educational Resources Information Center

Peters, Vanessa L.; Songer, Nancy Butler

2013-01-01

This paper reports the results of a three-stage usability test of a modeling tool designed to support learners' deep understanding of the impacts of climate change on ecosystems. The design process involved repurposing an existing modeling technology used by professional scientists into a learning tool specifically designed for middle school…

Design and Usability Testing of an Audio Platform Game for Players with Visual Impairments

ERIC Educational Resources Information Center

Oren, Michael; Harding, Chris; Bonebright, Terri L.

2008-01-01

This article reports on the evaluation of a novel audio platform game that creates a spatial, interactive experience via audio cues. A pilot study with players with visual impairments, and usability testing comparing the visual and audio game versions using both sighted players and players with visual impairments, revealed that all the…

Usability of a Web-Based School Experience System: Opinions of IT Teachers and Teacher Candidates

ERIC Educational Resources Information Center

Genç, Zülfü

2015-01-01

With advances in information and communication technologies, the classical nature of educational institutions has changed. One innovative effort within teacher training is the Web-Based School Experience System (WBSES) developed by the researcher. In this study, the usability of an existing WBSES is evaluated from both teachers' (n = 13) and…

Mobile Learning Analytics in Higher Education: Usability Testing and Evaluation of an APP Prototype

ERIC Educational Resources Information Center

Kuhnel, Matthias; Seiler, Luisa; Honal, Andrea; Ifenthaler, Dirk

2017-01-01

This study aims to test the usability of MyLA (My Learning Analytics), an application for students at two German universities: The Cooperative State University Mannheim and University of Mannheim. The participating universities focus on the support of personalized and self-regulated learning. MyLA collects data such as learning behavior and…

Evaluating CSL/CFL Website Usability: A User-Centered Design Approach

ERIC Educational Resources Information Center

Huang, Chung-Kai; Hsin, Ching-O; Chiu, Chiung-Hui

2010-01-01

With the widespread availability of Internet and computer technology, on-line web-based learning has become prevalent in the field of teaching Chinese as a second/foreign language (CSL/CFL). This study examined the concepts of usability and types of design elements that help construct an effective web-based learning environment, as well as their…

An Efficient Approach to Improve the Usability of e-Learning Resources: The Role of Heuristic Evaluation

ERIC Educational Resources Information Center

Davids, Mogamat Razeen; Chikte, Usuf M. E.; Halperin, Mitchell L.

2013-01-01

Optimizing the usability of e-learning materials is necessary to maximize their potential educational impact, but this is often neglected when time and other resources are limited, leading to the release of materials that cannot deliver the desired learning outcomes. As clinician-teachers in a resource-constrained environment, we investigated…

Popular Mobile Phone Apps for Diet and Weight Loss: A Content Analysis.

PubMed

Zaidan, Sarah; Roehrer, Erin

2016-07-11

A review of the literature has revealed that the rates of overweight and obesity have been increasing in Australia over the last two decades and that wellness mobile phone apps play a significant role in monitoring and managing individuals' weight. Although mobile phone app markets (iTunes and Google Play) list thousands of mobile phone health apps, it is not always clear whether those apps are supported by credible sources. Likewise, despite the prevailing use of mobile phone apps to aid with weight management, the usability features of these apps are not well characterized. The research explored how usability taxonomy could inform the popularity of downloaded, socially focused wellness mobile phone apps, in particular weight loss and diet apps. The aim of the study was to investigate the Australian mobile phone app stores (iTunes and Google Play) in order to examine the usability features of the most popular (ie, most downloaded) wellness apps. The design of this study comprises 3 main stages: stage 1, identifying apps; stage 2, development of weight loss and diet evaluation framework; and stage 3, application of the evaluation framework. Each stage includes specific data collection, analysis tools, and techniques. The study has resulted in the development of a justified evaluation framework for weight loss and diet mobile phone apps. Applying the evaluation framework to the identified apps has shown that the most downloaded iTunes and Google Play apps are not necessarily the most usable or effective. In addition, the research found that search algorithms for iTunes and Google Play are biased toward apps' titles and keywords that do not accurately define the real functionality of the app. Moreover, the study has also analyzed the apps' user reviews, which served as justification for the developed evaluation framework. The analysis has shown that ease of use, reminder, bar code scanning, motivation, usable for all, and synchronization are significant attributes that should be included in weight loss and diet mobile phone apps and ultimately in potential weight loss and diet evaluation frameworks.

Popular Mobile Phone Apps for Diet and Weight Loss: A Content Analysis

PubMed Central

Roehrer, Erin

2016-01-01

Background A review of the literature has revealed that the rates of overweight and obesity have been increasing in Australia over the last two decades and that wellness mobile phone apps play a significant role in monitoring and managing individuals’ weight. Although mobile phone app markets (iTunes and Google Play) list thousands of mobile phone health apps, it is not always clear whether those apps are supported by credible sources. Likewise, despite the prevailing use of mobile phone apps to aid with weight management, the usability features of these apps are not well characterized. Objective The research explored how usability taxonomy could inform the popularity of downloaded, socially focused wellness mobile phone apps, in particular weight loss and diet apps. The aim of the study was to investigate the Australian mobile phone app stores (iTunes and Google Play) in order to examine the usability features of the most popular (ie, most downloaded) wellness apps. Methods The design of this study comprises 3 main stages: stage 1, identifying apps; stage 2, development of weight loss and diet evaluation framework; and stage 3, application of the evaluation framework. Each stage includes specific data collection, analysis tools, and techniques. Results The study has resulted in the development of a justified evaluation framework for weight loss and diet mobile phone apps. Applying the evaluation framework to the identified apps has shown that the most downloaded iTunes and Google Play apps are not necessarily the most usable or effective. In addition, the research found that search algorithms for iTunes and Google Play are biased toward apps’ titles and keywords that do not accurately define the real functionality of the app. Moreover, the study has also analyzed the apps’ user reviews, which served as justification for the developed evaluation framework. Conclusions The analysis has shown that ease of use, reminder, bar code scanning, motivation, usable for all, and synchronization are significant attributes that should be included in weight loss and diet mobile phone apps and ultimately in potential weight loss and diet evaluation frameworks. PMID:27400806

The UX of amila pregnancy on mobile device

NASA Astrophysics Data System (ADS)

Hussain, Azham; Mkpojiogu, Emmanuel O. C.; Fadzil, Najdawati Mohd; Hassan, Norhasizasuriati Mohd

2017-10-01

The increased use of mobile devices has led to an upsurge in the number of mobile applications. This makes the usability of these applications a very crucial and critical issue. The Amila Pregnancy mobile app is revolutionizing the delivery of healthcare services to pregnancy woman across the globe and is increasingly becoming beneficial in their daily life. Only a few digital interventions have been developed for pregnant woman, and little is known about the acceptability and usability of such mobile apps that provide assistance to pregnant women. Usability comprises everything that is connected with the intuitive and efficient handling of user interaction with human-made devices. This paper reports the result of a usability evaluation for Amila Pregnancy mobile application. In the study five attributes of perceived usability was measured following Jakob Nielsen principles, namely: effectiveness, efficiency, learnability, memorability and satisfaction. In addition, performance metrics were also captured. The results reveal the difficulty users had in interpreting displayed icon, locating the information provided, re-finding it and in navigating through the mobile app. The study suggests that the main menu of the app need to be further improved upon to enhance its usability.

Usability Testing of a National Substance Use Screening Tool Embedded in Electronic Health Records.

PubMed

Press, Anne; DeStio, Catherine; McCullagh, Lauren; Kapoor, Sandeep; Morley, Jeanne; Conigliaro, Joseph

2016-07-08

Screening, brief intervention, and referral to treatment (SBIRT) is currently being implemented into health systems nationally via paper and electronic methods. The purpose of this study was to evaluate the integration of an electronic SBIRT tool into an existing paper-based SBIRT clinical workflow in a patient-centered medical home. Usability testing was conducted in an academic ambulatory clinic. Two rounds of usability testing were done with medical office assistants (MOAs) using a paper and electronic version of the SBIRT tool, with two and four participants, respectively. Qualitative and quantitative data was analyzed to determine the impact of both tools on clinical workflow. A second round of usability testing was done with the revised electronic version and compared with the first version. Personal workflow barriers cited in the first round of testing were that the electronic health record (EHR) tool was disruptive to patient's visits. In Round 2 of testing, MOAs reported favoring the electronic version due to improved layout and the inclusion of an alert system embedded in the EHR. For example, using the system usability scale (SUS), MOAs reported a grade "1" for the statement, "I would like to use this system frequently" during the first round of testing but a "5" during the second round of analysis. The importance of testing usability of various mediums of tools used in health care screening is highlighted by the findings of this study. In the first round of testing, the electronic tool was reported as less user friendly, being difficult to navigate, and time consuming. Many issues faced in the first generation of the tool were improved in the second generation after usability was evaluated. This study demonstrates how usability testing of an electronic SBRIT tool can help to identify challenges that can impact clinical workflow. However, a limitation of this study was the small sample size of MOAs that participated. The results may have been biased to Northwell Health workers' perceptions of the SBIRT tool and their specific clinical workflow.

Effects and effectiveness of dynamic arm supports: a technical review.

PubMed

van der Heide, Loek A; Gelderblom, Gert Jan; de Witte, Luc P

2015-01-01

Numerous dynamic arm supports have been developed in recent decades to increase independence in the performance of activities of daily living. Much effort and money have been spent on their development and prescription, yet insight into their effects and effectiveness is lacking. This article is a systematic review of evaluations of dynamic arm supports. The 8 technical evaluations, 12 usability evaluations, and 27 outcome studies together make 47 evaluations. Technical evaluations were often used as input for new developments and directed at balancing quality, forces and torques, and range of motion of prototypes. Usability studies were mostly single-measure designs that had varying results as to whether devices were usable for potential users. An increased ability to perform activities of daily living and user satisfaction were reported in outcome studies. However, the use of dynamic arm supports in the home situation was reported to be low. Gaining insight into why devices are not used when their developers believe them to be effective seems crucial for every new dynamic arm support developed. The methodological quality of the outcome studies was often low, so it is important that this is improved in the future.

Evaluation of the geologic and hydrologic factors related to the waste-storage potential of Mesozoic aquifers in the southern part of the Atlantic Coastal Plain, South Carolina and Georgia

USGS Publications Warehouse

Brown, Philip M.; Brown, D.L.; Reid, M.S.; Lloyd, O.B.

1979-01-01

The report describes the subsurface distribution of rocks of Cretaceous to Late Jurassic( ) age in the Atlantic Coastal Plain , South Carolina, and Georgia, and examines their potential for deep-well waste storage into th part of the regional sediment mass which lies below the deepest zones containing usable ground waters. For the study, usable ground water is considered to be that which contains less than 10,000 mg/L dissolved solids. Using a group of geohydrologic parameters derived from or combining 21 categories of basic data, established from study and interpretation of well cuttings and geophysical logs, a series of 32 regional maps and 8 stratigraphic cross sections was constructed. For each of the eight geologic units delineated in the subsurface, the maps illustrate the distribution of waste-storage potential in terms of areal extent, depth below land surface, sand-shale geometry, and the approximate sodium chloride concentration of a unit 's nonusable ground water. In areas where the geologic units contain nonusable ground water, the depth below land surface and the thickness of potential waste-storage reservoir and reservoir-seal combinations are variable. The range in variability appears to be broad enough to meet the need for a wide choice among the geologic requirements that would normally be considered in selecting specific waste-storage sites for detailed examination. (Woodard-USGS)

A Self-Regulation Theory–Based Asthma Management Mobile App for Adolescents: A Usability Assessment

PubMed Central

2017-01-01

Background Self-regulation theory suggests people learn to influence their own behavior through self-monitoring, goal-setting, feedback, self-reward, and self-instruction, all of which smartphones are now capable of facilitating. Several mobile apps exist to manage asthma; however, little evidence exists about whether these apps employ user-centered design processes that adhere to government usability guidelines for mobile apps. Objective Building upon a previous study that documented adolescent preferences for an asthma self-management app, we employed a user-centered approach to assess the usability of a high-fidelity wireframe for an asthma self-management app intended for use by adolescents with persistent asthma. Methods Individual interviews were conducted with adolescents (ages 11-18 years) with persistent asthma who owned a smartphone (N=8). Adolescents were asked to evaluate a PDF app wireframe consisting of 76 screen shots displaying app features, including log in and home screen, profile setup, settings and info, self-management features, and graphical displays for charting asthma control and medication. Preferences, comments, and suggestions for each set of screen shots were assessed using the audio-recorded interviews. Two coders reached consensus on adolescent evaluations of the following aspects of app features: (1) usability, (2) behavioral intentions to use, (3) confusing aspects, and (4) suggestions for improvement. Results The app wireframe was generally well received, and several suggestions for improvement were recorded. Suggestions included increased customization of charts and notifications, reminders, and alerts. Participants preferred longitudinal data about asthma control and medication use to be displayed using line graphs. All participants reported that they would find an asthma management app like the one depicted in the wireframe useful for managing their asthma. Conclusions Early stage usability tests guided by government usability guidelines (usability.gov) revealed areas for improvement for an asthma self-management app for adolescents. Addressing these areas will be critical to developing an engaging and effective asthma self-management app that is capable of improving adolescent asthma outcomes. PMID:28148471

Usability testing of a monitoring and feedback tool to stimulate physical activity.

PubMed

van der Weegen, Sanne; Verwey, Renée; Tange, Huibert J; Spreeuwenberg, Marieke D; de Witte, Luc P

2014-01-01

A MONITORING AND FEEDBACK TOOL TO STIMULATE PHYSICAL ACTIVITY, CONSISTING OF AN ACTIVITY SENSOR, SMARTPHONE APPLICATION (APP), AND WEBSITE FOR PATIENTS AND THEIR PRACTICE NURSES, HAS BEEN DEVELOPED: the 'It's LiFe!' tool. In this study the usability of the tool was evaluated by technology experts and end users (people with chronic obstructive pulmonary disease or type 2 diabetes, with ages from 40-70 years), to improve the user interfaces and content of the tool. THE STUDY HAD FOUR PHASES: 1) a heuristic evaluation with six technology experts; 2) a usability test in a laboratory by five patients; 3) a pilot in real life wherein 20 patients used the tool for 3 months; and 4) a final lab test by five patients. In both lab tests (phases 2 and 4) qualitative data were collected through a thinking-aloud procedure and video recordings, and quantitative data through questions about task complexity, text comprehensiveness, and readability. In addition, the post-study system usability questionnaire (PSSUQ) was completed for the app and the website. In the pilot test (phase 3), all patients were interviewed three times and the Software Usability Measurement Inventory (SUMI) was completed. After each phase, improvements were made, mainly to the layout and text. The main improvement was a refresh button for active data synchronization between activity sensor, app, and server, implemented after connectivity problems in the pilot test. The mean score on the PSSUQ for the website improved from 5.6 (standard deviation [SD] 1.3) to 6.5 (SD 0.5), and for the app from 5.4 (SD 1.5) to 6.2 (SD 1.1). Satisfaction in the pilot was not very high according to the SUMI. The use of laboratory versus real-life tests and expert-based versus user-based tests revealed a wide range of usability issues. The usability of the It's LiFe! tool improved considerably during the study.

Preliminary study of online machine translation use of nursing literature: quality evaluation and perceived usability

PubMed Central

2012-01-01

Background Japanese nurses are increasingly required to read published international research in clinical, educational, and research settings. Language barriers are a significant obstacle, and online machine translation (MT) is a tool that can be used to address this issue. We examined the quality of Google Translate® (English to Japanese and Korean to Japanese), which is a representative online MT, using a previously verified evaluation method. We also examined the perceived usability and current use of online MT among Japanese nurses. Findings Randomly selected nursing abstracts were translated and then evaluated for intelligibility and usability by 28 participants, including assistants and research associates from nursing universities throughout Japan. They answered a questionnaire about their online MT use. From simple comparison of mean scores between two language pairs, translation quality was significantly better, with respect to both intelligibility and usability, for Korean-Japanese than for English-Japanese. Most respondents perceived a language barrier. Online MT had been used by 61% of the respondents and was perceived as not useful enough. Conclusion Nursing articles translated from Korean into Japanese by an online MT system could be read at an acceptable level of comprehension, but the same could not be said for English-Japanese translations. Respondents with experience using online MT used it largely to grasp the overall meanings of the original text. Enrichment in technical terms appeared to be the key to better usability. Users will be better able to use MT outputs if they improve their foreign language proficiency as much as possible. Further research is being conducted with a larger sample size and detailed analysis. PMID:23151362

ODMSummary: A Tool for Automatic Structured Comparison of Multiple Medical Forms Based on Semantic Annotation with the Unified Medical Language System

PubMed Central

Krumm, Rainer; Dugas, Martin

2016-01-01

Introduction Medical documentation is applied in various settings including patient care and clinical research. Since procedures of medical documentation are heterogeneous and developed further, secondary use of medical data is complicated. Development of medical forms, merging of data from different sources and meta-analyses of different data sets are currently a predominantly manual process and therefore difficult and cumbersome. Available applications to automate these processes are limited. In particular, tools to compare multiple documentation forms are missing. The objective of this work is to design, implement and evaluate the new system ODMSummary for comparison of multiple forms with a high number of semantically annotated data elements and a high level of usability. Methods System requirements are the capability to summarize and compare a set of forms, enable to estimate the documentation effort, track changes in different versions of forms and find comparable items in different forms. Forms are provided in Operational Data Model format with semantic annotations from the Unified Medical Language System. 12 medical experts were invited to participate in a 3-phase evaluation of the tool regarding usability. Results ODMSummary (available at https://odmtoolbox.uni-muenster.de/summary/summary.html) provides a structured overview of multiple forms and their documentation fields. This comparison enables medical experts to assess multiple forms or whole datasets for secondary use. System usability was optimized based on expert feedback. Discussion The evaluation demonstrates that feedback from domain experts is needed to identify usability issues. In conclusion, this work shows that automatic comparison of multiple forms is feasible and the results are usable for medical experts. PMID:27736972

Usability evaluation and adaptation of the e-health Personal Patient Profile-Prostate decision aid for Spanish-speaking Latino men.

PubMed

Berry, Donna L; Halpenny, Barbara; Bosco, Jaclyn L F; Bruyere, John; Sanda, Martin G

2015-07-24

The Personal Patient Profile-Prostate (P3P), a web-based decision aid, was demonstrated to reduce decisional conflict in English-speaking men with localized prostate cancer early after initial diagnosis. The purpose of this study was to explore and enhance usability and cultural appropriateness of a Spanish P3P by Latino men with a diagnosis of prostate cancer. P3P was translated to Spanish and back-translated by three native Spanish-speaking translators working independently. Spanish-speaking Latino men with a diagnosis of localized prostate cancer, who had made treatment decisions in the past 24 months, were recruited from two urban clinical care sites. Individual cognitive interviews were conducted by two bilingual research assistants as each participant used the Spanish P3P. Notes of user behavior, feedback, and answers to direct questions about comprehension, usability and perceived usefulness were analyzed and categorized. Seven participants with a range of education levels identified 25 unique usability issues in navigation, content comprehension and completeness, sociocultural appropriateness, and methodology. Revisions were prioritized to refine the usability and cultural and linguistic appropriateness of the decision aid. Usability issues were discovered that are potential barriers to effective decision support. Successful use of decision aids requires adaptation and testing beyond translation. Our findings led to revisions further refining the usability and linguistic and cultural appropriateness of Spanish P3P.

Does user-centred design affect the efficiency, usability and safety of CPOE order sets?

PubMed

Chan, Julie; Shojania, Kaveh G; Easty, Anthony C; Etchells, Edward E

2011-05-01

Application of user-centred design principles to Computerized provider order entry (CPOE) systems may improve task efficiency, usability or safety, but there is limited evaluative research of its impact on CPOE systems. We evaluated the task efficiency, usability, and safety of three order set formats: our hospital's planned CPOE order sets (CPOE Test), computer order sets based on user-centred design principles (User Centred Design), and existing pre-printed paper order sets (Paper). 27 staff physicians, residents and medical students. Sunnybrook Health Sciences Centre, an academic hospital in Toronto, Canada. Methods Participants completed four simulated order set tasks with three order set formats (two CPOE Test tasks, one User Centred Design, and one Paper). Order of presentation of order set formats and tasks was randomized. Users received individual training for the CPOE Test format only. Completion time (efficiency), requests for assistance (usability), and errors in the submitted orders (safety). 27 study participants completed 108 order sets. Mean task times were: User Centred Design format 273 s, Paper format 293 s (p=0.73 compared to UCD format), and CPOE Test format 637 s (p<0.0001 compared to UCD format). Users requested assistance in 31% of the CPOE Test format tasks, whereas no assistance was needed for the other formats (p<0.01). There were no significant differences in number of errors between formats. The User Centred Design format was more efficient and usable than the CPOE Test format even though training was provided for the latter. We conclude that application of user-centred design principles can enhance task efficiency and usability, increasing the likelihood of successful implementation.

Does user-centred design affect the efficiency, usability and safety of CPOE order sets?

PubMed Central

Chan, Julie; Shojania, Kaveh G; Easty, Anthony C

2011-01-01

Background Application of user-centred design principles to Computerized provider order entry (CPOE) systems may improve task efficiency, usability or safety, but there is limited evaluative research of its impact on CPOE systems. Objective We evaluated the task efficiency, usability, and safety of three order set formats: our hospital's planned CPOE order sets (CPOE Test), computer order sets based on user-centred design principles (User Centred Design), and existing pre-printed paper order sets (Paper). Participants 27staff physicians, residents and medical students. Setting Sunnybrook Health Sciences Centre, an academic hospital in Toronto, Canada. Methods Participants completed four simulated order set tasks with three order set formats (two CPOE Test tasks, one User Centred Design, and one Paper). Order of presentation of order set formats and tasks was randomized. Users received individual training for the CPOE Test format only. Main Measures Completion time (efficiency), requests for assistance (usability), and errors in the submitted orders (safety). Results 27 study participants completed 108 order sets. Mean task times were: User Centred Design format 273 s, Paper format 293 s (p=0.73 compared to UCD format), and CPOE Test format 637 s (p<0.0001 compared to UCD format). Users requested assistance in 31% of the CPOE Test format tasks, whereas no assistance was needed for the other formats (p<0.01). There were no significant differences in number of errors between formats. Conclusions The User Centred Design format was more efficient and usable than the CPOE Test format even though training was provided for the latter. We conclude that application of user-centred design principles can enhance task efficiency and usability, increasing the likelihood of successful implementation. PMID:21486886

The effect of keyboard key spacing on typing speed, error, usability, and biomechanics, Part 2: Vertical spacing.

PubMed

Pereira, Anna; Hsieh, Chih-Ming; Laroche, Charles; Rempel, David

2014-06-01

The objective was to evaluate the effects of vertical key spacing on a conventional computer keyboard on typing speed, percentage error, usability, forearm muscle activity, and wrist posture for both females with small fingers and males with large fingers. Part I evaluated primarily horizontal key spacing and found that for male typists with large fingers, productivity and usability were similar for spacings of 17, 18, and 19 mm but were reduced for spacings of 16 mm. Few other key spacing studies are available, and the international standards that specify the spacing between keys on a keyboard have been mainly guided by design convention. Experienced female typists (n = 26) with small fingers (middle finger length < or = 7.71 cm or finger breadth of < or = 1.93 cm) and male typists (n = 26) with large fingers (middle finger length > or = 8.37 cm or finger breadth of > or = 2.24 cm) typed on five keyboards that differed primarily in vertical key spacing (17 x 18, 17 x 17, 17 x 16, 17 x 15.5, and 18 x 16 mm) while typing speed, error, fatigue, preference, forearm muscle activity, and wrist posture were recorded. Productivity and usability ratings were significantly worse for the keyboard with 15.5 mm vertical spacing compared to the other keyboards for both groups.There were few significant differences on usability ratings between the other keyboards. Reducing vertical key spacing,from 18 to 17 to 16 mm, had no significant effect on productivity or usability. The findings support the design of keyboards with vertical key spacings of 16, 17, or 18 mm. These findings may influence keyboard design and standards.

Development and Cross-cultural Validation of the Korean Version of SMArtphone's uSability Heuristics (SMASH).

PubMed

Jeong, Yeo Won; Kim, Jung A

2017-10-01

The purpose of this study was to develop and cross-culturally validate the Korean version of SMArtphone's uSability Heuristics (K-SMASH). In the study, it was used the adaptation process consisted of five stages, namely, translation, synthesis, back translation, expert committee review, and pretesting. In the pretesting stage, a mobile application, using the prefinal K-SMASH, was evaluated for the severity of usability problems by three experts in computer science and informatics. Each participant completed the evaluation and was interviewed about their understanding, interpretation, and opinion of the cultural relevance of the prefinal K-SMASH. Next, we reviewed the differences in the experts' opinions and the questionnaire results. Twelve SMASH items, words and sentences, were translated, back translated, and revised, considering the conceptual meaning in the context of the Korean culture, by experts in various fields, including a Korean linguist and a bilingual translator, through the first stage to the fourth stage. In the pretesting stage, the results showed no major differences among the severity ratings of participants. Furthermore, all participants answered that there were no critical discrepancies or inconsistencies with the cultural relevance of the prefinal K-SMASH. The results of the study provide preliminary evidence that the modified K-SMASH can be used for heuristic evaluation, one of the usability tests, when developing applications in Korea.

Development and Cross-cultural Validation of the Korean Version of SMArtphone’s uSability Heuristics (SMASH)

PubMed Central

Jeong, Yeo Won

2017-01-01

Objectives The purpose of this study was to develop and cross-culturally validate the Korean version of SMArtphone's uSability Heuristics (K-SMASH). Methods In the study, it was used the adaptation process consisted of five stages, namely, translation, synthesis, back translation, expert committee review, and pretesting. In the pretesting stage, a mobile application, using the prefinal K-SMASH, was evaluated for the severity of usability problems by three experts in computer science and informatics. Each participant completed the evaluation and was interviewed about their understanding, interpretation, and opinion of the cultural relevance of the prefinal K-SMASH. Next, we reviewed the differences in the experts’ opinions and the questionnaire results. Results Twelve SMASH items, words and sentences, were translated, back translated, and revised, considering the conceptual meaning in the context of the Korean culture, by experts in various fields, including a Korean linguist and a bilingual translator, through the first stage to the fourth stage. In the pretesting stage, the results showed no major differences among the severity ratings of participants. Furthermore, all participants answered that there were no critical discrepancies or inconsistencies with the cultural relevance of the prefinal K-SMASH. Conclusions The results of the study provide preliminary evidence that the modified K-SMASH can be used for heuristic evaluation, one of the usability tests, when developing applications in Korea. PMID:29181243

Augmenting Usability: Cultural Elicitation in HCI

NASA Astrophysics Data System (ADS)

Camara, Souleymane Boundaouda; Oyugi, Cecilia; Abdelnour-Nocera, José; Smith, Andy

This paper offers context and culture elicitation in an inter-cultural and multi-disciplinary setting of ICT design. Localised usability evaluation (LUE) is augmented with a socio-technical evaluation tool (STEM) as a methodological approach to expose and address issues in a collaborative ICT design within the Village e-Science for Life (VeSeL) project in rural Kenya. The paper argues that designers need to locally identify context and culture in situ and further explicate their implications through the design process and at the global level. Stakeholders' context, culture, decisions, agendas, expectations, disciplines and requirements need to be locally identified and globally evaluated to ensure a fit for purpose solution.

Graphical Weather Information System Evaluation: Usability, Perceived Utility, and Preferences from General Aviation Pilots

NASA Technical Reports Server (NTRS)

Latorella, Kara A.; Chamberlain, James P.

2002-01-01

Weather is a significant factor in General Aviation (GA) accidents and fatality rates. Graphical Weather Information Systems (GWISs) for the flight deck are appropriate technologies for mitigating the difficulties GA pilots have with current aviation weather information sources. This paper describes usability evaluations of a prototype GWIS by 12 GA pilots after using the system in flights towards convective weather. We provide design guidance for GWISs and discuss further research required to support weather situation awareness and in-flight decision making for GA pilots.

The Accessibility and Usability of College Websites: Is Your Website Presenting Barriers to Potential Students?

ERIC Educational Resources Information Center

Erickson, William; Trerise, Sharon; Lee, Camille; VanLooy, Sara; Knowlton, Samuel; Bruyère, Susanne

2013-01-01

Thirty community college websites were evaluated for compliance with federal web accessibility standards found in Section 508 of the Rehabilitation Act of 1973 (29 U.S.C. 794d). Two typical sites were tested for usability by individuals with visual impairments, individuals with reading-related learning disabilities (LD), and a control group of…

Usability evaluation of low-cost virtual reality hand and arm rehabilitation games.

PubMed

Seo, Na Jin; Arun Kumar, Jayashree; Hur, Pilwon; Crocher, Vincent; Motawar, Binal; Lakshminarayanan, Kishor

2016-01-01

The emergence of lower-cost motion tracking devices enables home-based virtual reality rehabilitation activities and increased accessibility to patients. Currently, little documentation on patients' expectations for virtual reality rehabilitation is available. This study surveyed 10 people with stroke for their expectations of virtual reality rehabilitation games. This study also evaluated the usability of three lower-cost virtual reality rehabilitation games using a survey and House of Quality analysis. The games (kitchen, archery, and puzzle) were developed in the laboratory to encourage coordinated finger and arm movements. Lower-cost motion tracking devices, the P5 Glove and Microsoft Kinect, were used to record the movements. People with stroke were found to desire motivating and easy-to-use games with clinical insights and encouragement from therapists. The House of Quality analysis revealed that the games should be improved by obtaining evidence for clinical effectiveness, including clinical feedback regarding improving functional abilities, adapting the games to the user's changing functional ability, and improving usability of the motion-tracking devices. This study reports the expectations of people with stroke for rehabilitation games and usability analysis that can help guide development of future games.

Methods for Evaluating the Content, Usability, and Efficacy of Commercial Mobile Health Apps

PubMed Central

Silfee, Valerie J; Waring, Molly E; Boudreaux, Edwin D; Sadasivam, Rajani S; Mullen, Sean P; Carey, Jennifer L; Hayes, Rashelle B; Ding, Eric Y; Bennett, Gary G; Pagoto, Sherry L

2017-01-01

Commercial mobile apps for health behavior change are flourishing in the marketplace, but little evidence exists to support their use. This paper summarizes methods for evaluating the content, usability, and efficacy of commercially available health apps. Content analyses can be used to compare app features with clinical guidelines, evidence-based protocols, and behavior change techniques. Usability testing can establish how well an app functions and serves its intended purpose for a target population. Observational studies can explore the association between use and clinical and behavioral outcomes. Finally, efficacy testing can establish whether a commercial app impacts an outcome of interest via a variety of study designs, including randomized trials, multiphase optimization studies, and N-of-1 studies. Evidence in all these forms would increase adoption of commercial apps in clinical practice, inform the development of the next generation of apps, and ultimately increase the impact of commercial apps. PMID:29254914

Location-based social networking media for restaurant promotion and food review using mobile application

NASA Astrophysics Data System (ADS)

Luhur, H. S.; Widjaja, N. D.

2014-03-01

This paper is focusing on the development of a mobile application for searching restaurants and promotions with location based and social networking features. The main function of the application is to search restaurant information. Other functions are also available in this application such as add restaurant, add promotion, add photo, add food review, and other features including social networking features. The restaurant and promotion searching application will be developed under Android platform. Upon completion of this paper, heuristic evaluation and usability testing have been conducted. The result of both testing shows that the application is highly usable. Even though there are some usability problems discovered, the problems can be eliminated immediately by implementing the recommendations from the expert evaluators and the users as the testers of the application. Further improvement made to the application will ensure that the application can really be beneficial for the users of the application.

What makes an automated teller machine usable by blind users?

PubMed

Manzke, J M; Egan, D H; Felix, D; Krueger, H

1998-07-01

Fifteen blind and sighted subjects, who featured as a control group for acceptance, were asked for their requirements for automated teller machines (ATMs). Both groups also tested the usability of a partially operational ATM mock-up. This machine was based on an existing cash dispenser, providing natural speech output, different function menus and different key arrangements. Performance and subjective evaluation data of blind and sighted subjects were collected. All blind subjects were able to operate the ATM successfully. The implemented speech output was the main usability factor for them. The different interface designs did not significantly affect performance and subjective evaluation. Nevertheless, design recommendations can be derived from the requirement assessment. The sighted subjects were rather open for design modifications, especially the implementation of speech output. However, there was also a mismatch of the requirements of the two subject groups, mainly concerning the key arrangement.

Designing Telemedicine Systems for Geriatric Patients: A Review of the Usability Studies.

PubMed

Narasimha, Shraddhaa; Madathil, Kapil Chalil; Agnisarman, Sruthy; Rogers, Hunter; Welch, Brandon; Ashok, Aparna; Nair, Aswathi; McElligott, James

2017-06-01

One area where telemedicine may prove to be highly effective is in providing medical care to the geriatric population, an age group predicted to account for 20% of the population in the near future. However, even though telemedicine has certain advantages, the usability of these systems with this population merits investigation. This article reviews the literature published from 2000 to 2016 with the goal of analyzing the characteristics of usability-related studies conducted using geriatric participants and the subsequent usability challenges identified. Articles were found using Web of Knowledge and PubMed citation indexing portals using the keywords (1) Telemedicine* AND Geriatrics* (2) Telemedicine* AND Usability* (3) Telemedicine* AND Usability* AND Older Adults*. A total of 297 articles were obtained from the initial search. After further detailed screening, 16 articles were selected for review based on the inclusion criteria. Of these, 60% of the studies focused on the overall usability of telemedicine systems; 6.25% focused on the usability of a telepresence robot; 12.5% compared a face-to-face medical consultation with the use of telemedicine systems, and 25% focused on the study of other aspects of telemedicine in addition to its usability. Findings reported in the studies included high patient satisfaction with telemedicine in 31.25%, whereas another 31.25% indicated a high acceptance of this method of medical consultation. Care coordination in 6.25% of the studies; confidence in telemedicine in 6.25%; trust, privacy, and reliability in 6.25%; and increased convenience when compared to personal visits in 18.75% were also reported. This review suggests limited research providing scientifically valid and reproducible usability evaluation at various stages of telemedicine system development. Telemedicine system designers need to consider the age-related issues in cognition, perception, and behavior of geriatric patients while designing telemedicine applications. Future directions for research were developed based on the limitations as well as other results found in this systematic review.

Evaluation Plan for ORBIS

DOT National Transportation Integrated Search

1974-03-01

This report contains the evaluation plan and experimental design for determining the effectiveness and usability of ORBIS, a proprietary device for automatically detecting and recording speeding motorists. The experimental evaluation will be conducte...

Usability evaluation of the digital anger thermometer app.

PubMed

Mattson, Donald C

2017-09-01

The digital anger thermometer is a prototype for a mobile application (app) for use with adults in anger management treatment. The digital anger thermometer incorporates standards of software development in addition to anger management resources from the Substance Abuse and Mental Health Services Administration. The digital anger thermometer underwent a usability study conducted by five expert reviewers. The results indicate that it is easy to learn, efficient, and ergonomically sound. However, it does not offer support features or user-error tolerance. The digital anger thermometer prototype requires additional usability studies and comparative research in order for it to become an actual mental health app.

Evaluation of Smartphone Applications for Cardiopulmonary Resuscitation Training in South Korea

PubMed Central

Cho, Yongtak; Song, Yeongtak; Lim, Tae Ho; Kang, Hyunggoo

2016-01-01

Objective. There are many smartphone-based applications (apps) for cardiopulmonary resuscitation (CPR) training. We investigated the conformity and the learnability/usability of these apps for CPR training and real-life supports. Methods. We conducted a mixed-method, sequential explanatory study to assess CPR training apps downloaded on two apps stores in South Korea. Apps were collected with inclusion criteria as follows, Korean-language instruction, training features, and emergency supports for real-life incidents, and analyzed with two tests; 15 medical experts evaluated the apps' contents according to current Basic Life Support guidelines in conformity test, and 15 nonmedical individuals examined the apps using System Usability Scale (SUS) in the learnability/usability test. Results. Out of 79 selected apps, five apps were included and analyzed. For conformity (ICC, 0.95, p < 0.001), means of all apps were greater than 12 of 20 points, indicating that they were well designed according to current guidelines. Three of the five apps yielded acceptable level (greater than 68 of 100 points) for learnability/usability. Conclusion. All the included apps followed current BLS guidelines and a majority offered acceptable learnability/usability for layperson. Current and developmental smartphone-based CPR training apps should include accurate CPR information and be easy to use for laypersons that are potential rescuers in real-life incidents. For Clinical Trials. This is a clinical trial, registered at the Clinical Research Information Service (CRIS, cris.nih.go.kr), number KCT0001840. PMID:27668257

A Guided Online and Mobile Self-Help Program for Individuals With Eating Disorders: An Iterative Engagement and Usability Study.

PubMed

Nitsch, Martina; Dimopoulos, Christina N; Flaschberger, Edith; Saffran, Kristina; Kruger, Jenna F; Garlock, Lindsay; Wilfley, Denise E; Taylor, Craig B; Jones, Megan

2016-01-11

Numerous digital health interventions have been developed for mental health promotion and intervention, including eating disorders. Efficacy of many interventions has been evaluated, yet knowledge about reasons for dropout and poor adherence is scarce. Most digital health intervention studies lack appropriate research design and methods to investigate individual engagement issues. User engagement and program usability are inextricably linked, making usability studies vital in understanding and improving engagement. The aim of this study was to explore engagement and corresponding usability issues of the Healthy Body Image Program-a guided online intervention for individuals with body image concerns or eating disorders. The secondary aim was to demonstrate the value of usability research in order to investigate engagement. We conducted an iterative usability study based on a mixed-methods approach, combining cognitive and semistructured interviews as well as questionnaires, prior to program launch. Two separate rounds of usability studies were completed, testing a total of 9 potential users. Thematic analysis and descriptive statistics were used to analyze the think-aloud tasks, interviews, and questionnaires. Participants were satisfied with the overall usability of the program. The average usability score was 77.5/100 for the first test round and improved to 83.1/100 after applying modifications for the second iteration. The analysis of the qualitative data revealed five central themes: layout, navigation, content, support, and engagement conditions. The first three themes highlight usability aspects of the program, while the latter two highlight engagement issues. An easy-to-use format, clear wording, the nature of guidance, and opportunity for interactivity were important issues related to usability. The coach support, time investment, and severity of users' symptoms, the program's features and effectiveness, trust, anonymity, and affordability were relevant to engagement. This study identified salient usability and engagement features associated with participant motivation to use the Healthy Body Image Program and ultimately helped improve the program prior to its implementation. This research demonstrates that improvements in usability and engagement can be achieved by testing and adjusting intervention design and content prior to program launch. The results are consistent with related research and reinforce the need for further research to identify usage patterns and effective means for reducing dropout. Digital health research should include usability studies prior to efficacy trials to help create more user-friendly programs that have a higher likelihood of "real-world" adoption.

Heuristic evaluation of online COPD respiratory therapy and education video resource center.

PubMed

Stellefson, Michael; Chaney, Beth; Chaney, Don

2014-10-01

Abstract Purpose: Because of limited accessibility to pulmonary rehabilitation programs, patients with chronic obstructive pulmonary disease (COPD) are infrequently provided with patient education resources. To help educate patients with COPD on how to live a better life with diminished breathing capacity, we developed a novel social media resource center containing COPD respiratory therapy and education videos called "COPDFlix." A heuristic evaluation of COPDFlix was conducted as part of a larger study to determine whether the prototype was successful in adhering to formal Web site usability guidelines for older adults. A purposive sample of three experts, with expertise in Web design and health communications technology, was recruited (a) to identify usability violations and (b) to propose solutions to improve the functionality of the COPDFlix prototype. Each expert evaluated 18 heuristics in four categories of task-based criteria (i.e., interaction and navigation, information architecture, presentation design, and information design). Seventy-six subcriteria across these four categories were assessed. Quantitative ratings and qualitative comments from each expert were compiled into a single master list, noting the violated heuristic and type/location of problem(s). Sixty-one usability violations were identified across the 18 heuristics. Evaluators rated the majority of heuristic subcriteria as either a "minor hindrance" (n=32) or "no problem" (n=132). Moreover, only 2 of the 18 heuristic categories were noted as "major" violations, with mean severity scores of ≥3. Mixed-methods data analysis helped the multidisciplinary research team to categorize and prioritize usability problems and solutions, leading to 26 discrete design modifications within the COPDFlix prototype.

Evaluation of B2C website based on the usability factors by using fuzzy AHP & hierarchical fuzzy TOPSIS

NASA Astrophysics Data System (ADS)

Masudin, I.; Saputro, T. E.

2016-02-01

In today's technology, electronic trading transaction via internet has been utilized properly with rapid growth. This paper intends to evaluate related to B2C e-commerce website in order to find out the one which meets the usability factors better than another. The influential factors to B2C e-commerce website are determined for two big retailer websites. The factors are investigated based on the consideration of several studies and conformed to the website characteristics. The evaluation is conducted by using different methods namely fuzzy AHP and hierarchical fuzzy TOPSIS so that the final evaluation can be compared. Fuzzy triangular number is adopted to deal with imprecise judgment under fuzzy environment.

Usability Evaluation of an Unstructured Clinical Document Query Tool for Researchers.

PubMed

Hultman, Gretchen; McEwan, Reed; Pakhomov, Serguei; Lindemann, Elizabeth; Skube, Steven; Melton, Genevieve B

2018-01-01

Natural Language Processing - Patient Information Extraction for Researchers (NLP-PIER) was developed for clinical researchers for self-service Natural Language Processing (NLP) queries with clinical notes. This study was to conduct a user-centered analysis with clinical researchers to gain insight into NLP-PIER's usability and to gain an understanding of the needs of clinical researchers when using an application for searching clinical notes. Clinical researcher participants (n=11) completed tasks using the system's two existing search interfaces and completed a set of surveys and an exit interview. Quantitative data including time on task, task completion rate, and survey responses were collected. Interviews were analyzed qualitatively. Survey scores, time on task and task completion proportions varied widely. Qualitative analysis indicated that participants found the system to be useful and usable in specific projects. This study identified several usability challenges and our findings will guide the improvement of NLP-PIER 's interfaces.

The design and evaluation of an activity monitoring user interface for people with stroke.

PubMed

Hart, Phil; Bierwirth, Rebekah; Fulk, George; Sazonov, Edward

2014-01-01

Usability is an important topic in the field of telerehabilitation research. Older users with disabilities in particular, present age-related and disability-related challenges that should be accommodated for in the design of a user interface for a telerehabilitation system. This paper describes the design, implementation, and assessment of a telerehabilitation system user interface that tries to maximize usability for an elderly user who has experienced a stroke. An Internet-connected Nintendo(®) Wii™ gaming system is selected as a hardware platform, and a server and website are implemented to process and display the feedback information. The usability of the interface is assessed with a trial consisting of 18 subjects: 10 healthy Doctor of Physical Therapy students and 8 people with a stroke. Results show similar levels of usability and high satisfaction with the gaming system interface from both groups of subjects.

Parachuting harnesses comparative evaluation on energy distribution grids.

PubMed

Hembecker, Paula Karina; Poletto, Angela Regina; Gontijo, Leila Amaral

2012-01-01

This research aims to make a comparative evaluation of three different parachuting harnesses to work at heights in the energy industry, from the electricians' point of view concerning these products under the optics of usability and ergonomic principles, and mainly justified by the high quantity of injuries at the energy industry due to high falls. According to its main target, this field research is classified as exploratory-descriptive transversal viewing study and, considering this perspective, the study was developed in four steps. Research results have enlightened the weakest spots and the potential improvement opportunities of these products, developed to assure safety of the work at heights to the energy industry, according to the opinion of the users. Still, results point that, regardless of the model, these devices have adapting issues to fulfill the electrical sector user's needs.

A Model for Usability Evaluation for the Development and Implementation of Consumer eHealth Interventions.

PubMed

Parry, David; Carter, Philip; Koziol-McLain, Jane; Feather, Jacqueline

2015-01-01

Consumer eHealth products are often used by people in their own homes or other settings without dedicated clinical supervision, and often with minimal training and limited support--much as eCommerce and eGovernment applications are currently deployed. Internet based self-care systems have been advocated for over a decade as a way to reduce costs and allow more convenient care, and--because of the expectation that they will be used to reduced health cost--, by increasing self-care and avoiding hospitalization. However, the history of consumer eHealth interventions is mixed, with many unsuccessful implementations. Many consumer eHealth products will form part of a broader complex intervention, with many possible benefits and effects on both individuals and society. This poster describes a model of consumer eHealth assessment based on multiple methods of usability evaluation at different stages in the design and fielding of eHealth systems. We argue that different methods of usability evaluation are able to give valuable insights into the likely effects of an intervention in a way that is congruent with software development processes.

Preliminary Evaluation of a Personal Healthcare System Prototype for Cognitive eRehabilitation in a Living Assistance Domain

PubMed Central

Pastorino, Matteo; Fioravanti, Alessio; Arredondo, Maria Teresa; Cogollor, José M.; Rojo, Javier; Ferre, Manuel; Bienkiewicz, Marta; Hermsdörfer, Joachim; Fringi, Evangelia; Wing, Alan M.

2014-01-01

The integration of rehabilitation systems in an ambient assisted living environment can provide a powerful and versatile tool for long-term stroke rehabilitation goals. This paper introduces a novel concept of a personalized cognitive rehabilitation system in a naturalistic setting. The proposed platform was developed within the CogWatch project, with the intent of fostering independence in activities of daily living in patients with apraxia and action disorganization syndrome. Technical usability was evaluated in a series of pilot experiments, which illustrate how this approach may help to retrain patients in activities of daily living. The first system prototype has been tested with 36 participants divided into three groups, providing an exploratory evaluation of the usability of this solution and its acceptability. The technical solutions used within the CogWatch project are targeted to meet both the end users' needs from the interaction and usability point of views and the clinical requirements associated with the use of such systems. The challenges behind the development of ambient assisted living systems for cognitive rehabilitation are discussed. PMID:24922452

Mediating the Cognitive Walkthrough with Patient Groups to achieve Personalized Health in Chronic Disease Self-Management System Evaluation.

PubMed

Georgsson, Mattias; Kushniruk, Andre

2016-01-01

The cognitive walkthrough (CW) is a task-based, expert inspection usability evaluation method involving benefits such as cost effectiveness and efficiency. A drawback of the method is that it doesn't involve the user perspective from real users but instead is based on experts' predictions about the usability of the system and how users interact. In this paper, we propose a way of involving the user in an expert evaluation method by modifying the CW with patient groups as mediators. This along with other modifications include a dual domain session facilitator, specific patient groups and three different phases: 1) a preparation phase where suitable tasks are developed by a panel of experts and patients, validated through the content validity index 2) a patient user evaluation phase including an individual and collaborative process part 3) an analysis and coding phase where all data is digitalized and synthesized making use of Qualitative Data Analysis Software (QDAS) to determine usability deficiencies. We predict that this way of evaluating will utilize the benefits of the expert methods, also providing a way of including the patient user of these self-management systems. Results from this prospective study should provide evidence of the usefulness of this method modification.

e-Learning for the elderly on drug utilization: A pilot study.

PubMed

Throfast, Victoria; Hellström, Lina; Hovstadius, Bo; Petersson, Göran; Ericson, Lisa

2017-05-01

This study explores the attitudes of elderly people to the use of electronic educational technology (e-learning) on drug utilization, with particular emphasis on the layout, usability, content, and level of knowledge in the tool. e-Learning modules were evaluated by a group of elderly people (aged ⩾65 years, n = 16) via a questionnaire comprising closed and open-ended questions. Both qualitative and quantitative analyses of the responses showed mostly positive reviews. The results indicate that the e-learning modules are a suitable tool for distributing information and education and that they can be managed by elderly individuals who are familiar with computers, allowing them to learn more about medication use.

Usability Testing of a Complex Clinical Decision Support Tool in the Emergency Department: Lessons Learned.

PubMed

Press, Anne; McCullagh, Lauren; Khan, Sundas; Schachter, Andy; Pardo, Salvatore; McGinn, Thomas

2015-09-10

As the electronic health record (EHR) becomes the preferred documentation tool across medical practices, health care organizations are pushing for clinical decision support systems (CDSS) to help bring clinical decision support (CDS) tools to the forefront of patient-physician interactions. A CDSS is integrated into the EHR and allows physicians to easily utilize CDS tools. However, often CDSS are integrated into the EHR without an initial phase of usability testing, resulting in poor adoption rates. Usability testing is important because it evaluates a CDSS by testing it on actual users. This paper outlines the usability phase of a study, which will test the impact of integration of the Wells CDSS for pulmonary embolism (PE) diagnosis into a large urban emergency department, where workflow is often chaotic and high stakes decisions are frequently made. We hypothesize that conducting usability testing prior to integration of the Wells score into an emergency room EHR will result in increased adoption rates by physicians. The objective of the study was to conduct usability testing for the integration of the Wells clinical prediction rule into a tertiary care center's emergency department EHR. We conducted usability testing of a CDS tool in the emergency department EHR. The CDS tool consisted of the Wells rule for PE in the form of a calculator and was triggered off computed tomography (CT) orders or patients' chief complaint. The study was conducted at a tertiary hospital in Queens, New York. There were seven residents that were recruited and participated in two phases of usability testing. The usability testing employed a "think aloud" method and "near-live" clinical simulation, where care providers interacted with standardized patients enacting a clinical scenario. Both phases were audiotaped, video-taped, and had screen-capture software activated for onscreen recordings. Phase I: Data from the "think-aloud" phase of the study showed an overall positive outlook on the Wells tool in assessing a patient for a PE diagnosis. Subjects described the tool as "well-organized" and "better than clinical judgment". Changes were made to improve tool placement into the EHR to make it optimal for decision-making, auto-populating boxes, and minimizing click fatigue. Phase II: After incorporating the changes noted in Phase 1, the participants noted tool improvements. There was less toggling between screens, they had all the clinical information required to complete the tool, and were able to complete the patient visit efficiently. However, an optimal location for triggering the tool remained controversial. This study successfully combined "think-aloud" protocol analysis with "near-live" clinical simulations in a usability evaluation of a CDS tool that will be implemented into the emergency room environment. Both methods proved useful in the assessment of the CDS tool and allowed us to refine tool usability and workflow.

Exploring user experience and technology acceptance for a fall prevention system: results from a randomized clinical trial and a living lab.

PubMed

Vaziri, Daryoush D; Aal, Konstantin; Ogonowski, Corinna; Von Rekowski, Thomas; Kroll, Michael; Marston, Hannah R; Poveda, Rakel; Gschwind, Yves J; Delbaere, Kim; Wieching, Rainer; Wulf, Volker

2016-01-01

Falls are common in older adults and can result in serious injuries. Due to demographic changes, falls and related healthcare costs are likely to increase over the next years. Participation and motivation of older adults in fall prevention measures remain a challenge. The iStoppFalls project developed an information and communication technology (ICT)-based system for older adults to use at home in order to reduce common fall risk factors such as impaired balance and muscle weakness. The system aims at increasing older adults' motivation to participate in ICT-based fall prevention measures. This article reports on usability, user-experience and user-acceptance aspects affecting the use of the iStoppFalls system by older adults. In the course of a 16-week international multicenter study, 153 community-dwelling older adults aged 65+ participated in the iStoppFalls randomized controlled trial, of which half used the system in their home to exercise and assess their risk of falling. During the study, 60 participants completed questionnaires regarding the usability, user experience and user acceptance of the iStoppFalls system. Usability was measured with the System Usability Scale (SUS). For user experience the Physical Activity Enjoyment Scale (PACES) was applied. User acceptance was assessed with the Dynamic Acceptance Model for the Re-evaluation of Technologies (DART). To collect more detailed data on usability, user experience and user acceptance, additional qualitative interviews and observations were conducted with participants. Participants evaluated the usability of the system with an overall score of 62 (Standard Deviation, SD 15.58) out of 100, which suggests good usability. Most users enjoyed the iStoppFalls games and assessments, as shown by the overall PACES score of 31 (SD 8.03). With a score of 0.87 (SD 0.26), user acceptance results showed that participants accepted the iStoppFalls system for use in their own home. Interview data suggested that certain factors such as motivation, complexity or graphical design were different for gender and age. The results suggest that the iStoppFalls system has good usability, user experience and user acceptance. It will be important to take these along with factors such as motivation, gender and age into consideration when designing and further developing ICT-based fall prevention systems.

Distributed electrochemical sensors: recent advances and barriers to market adoption.

PubMed

Hoekstra, Rafael; Blondeau, Pascal; Andrade, Francisco J

2018-07-01

Despite predictions of their widespread application in healthcare and environmental monitoring, electrochemical sensors are yet to be distributed at scale, instead remaining largely confined to R&D labs. This contrasts sharply with the situation for physical sensors, which are now ubiquitous and seamlessly embedded in the mature ecosystem provided by electronics and connectivity protocols. Although chemical sensors could be integrated into the same ecosystem, there are fundamental issues with these sensors in the three key areas of analytical performance, usability, and affordability. Nevertheless, advances are being made in each of these fields, leading to hope that the deployment of automated and user-friendly low-cost electrochemical sensors is on the horizon. Here, we present a brief survey of key challenges and advances in the development of distributed electrochemical sensors for liquid samples, geared towards applications in healthcare and wellbeing, environmental monitoring, and homeland security. As will be seen, in many cases the analytical performance of the sensor is acceptable; it is usability that is the major barrier to commercial viability at this moment. Were this to be overcome, the issue of affordability could be addressed. Graphical Abstract ᅟ.

36 CFR 1193.2 - Scoping.

Code of Federal Regulations, 2010 CFR

2010-07-01

... accessibility, usability, and compatibility of new products and existing products which undergo substantial change or upgrade, or for which new releases are distributed. This part does not apply to minor or insubstantial changes to existing products that do not affect functionality. ...

Evaluating a Modular Decision Support Application for Colorectal Cancer Screening

PubMed Central

Diiulio, Julie B.; Borders, Morgan R.; Sushereba, Christen E.; Saleem, Jason J.; Haverkamp, Donald; Imperiale, Thomas F.

2017-01-01

Summary Background There is a need for health information technology evaluation that goes beyond randomized controlled trials to include consideration of usability, cognition, feedback from representative users, and impact on efficiency, data quality, and clinical workflow. This article presents an evaluation illustrating one approach to this need using the Decision-Centered Design framework. Objective To evaluate, through a Decision-Centered Design framework, the ability of the Screening and Surveillance App to support primary care clinicians in tracking and managing colorectal cancer testing. Methods We leveraged two evaluation formats, online and in-person, to obtain feedback from a range primary care clinicians and obtain comparative data. Both the online and in-person evaluations used mock patient data to simulate challenging patient scenarios. Primary care clinicians responded to a series of colorectal cancer-related questions about each patient and made recommendations for screening. We collected data on performance, perceived workload, and usability. Key elements of Decision-Centered Design include evaluation in the context of realistic, challenging scenarios and measures designed to explore impact on cognitive performance. Results Comparison of means revealed increases in accuracy, efficiency, and usability and decreases in perceived mental effort and workload when using the Screening and Surveillance App. Conclusion The results speak to the benefits of using the Decision-Centered Design approach in the analysis, design, and evaluation of Health Information Technology. Furthermore, the Screening and Surveillance App shows promise for filling decision support gaps in current electronic health records. PMID:28197619

Qualitative and quantitative evaluation of EHR-integrated mobile patient questionnaires regarding usability and cost-efficiency.

PubMed

Fritz, Fleur; Balhorn, Sebastian; Riek, Markus; Breil, Bernhard; Dugas, Martin

2012-05-01

The objective of this evaluation study is to assess a web-based application, currently available on iPad, to document questionnaires regarding patient reported outcomes such as quality of life. Based on the single source approach, the results of these questionnaires are available in the electronic health record to be used for treatment and research purposes. The assessment focuses on the usability and efficiency of the system. The system usability scale questionnaire with seven additional items was used to rate the usability by the patients. It was formally validated by a Cronbach Alpha test. In addition, semi-structured interviews were conducted with patients and medical staff. Time and cost measures, based on official tables of costs, were taken through workflow observations. This study was conducted in the department of dermatology at the University Hospital of Münster, Germany from April to June 2011. Using the web-based application questionnaire, results about patient reported outcomes like quality of life are immediately available in the electronic health record and can be used for treatment or research purposes. 118 patients and four staff members participated in the study. The usability score reached 80 from 100 points and patients as well as medical staff stated in the interviews that the usability of the web-based system was high, and they preferred it to the previously used paper-based questionnaires. In the setting of our pilot department the mobile devices amortized their costs after 6.7 months. In general, depending on the professional group who are going to post process the paper-based forms, the earliest break-even point to use mobile questionnaires is at 1737 paper sheets per year. The mobile patient questionnaires, integrated into the electronic health record, were well accepted in our pilot setting with high usability scores from patients and medical staff alike. The system has also proved to be cost-efficient compared to the paper-based workflow, given that a certain number of questionnaires is used per year. Copyright © 2011 Elsevier Ireland Ltd. All rights reserved.

A Self-Regulation Theory-Based Asthma Management Mobile App for Adolescents: A Usability Assessment.

PubMed

Sage, Adam; Roberts, Courtney; Geryk, Lorie; Sleath, Betsy; Tate, Deborah; Carpenter, Delesha

2017-02-01

Self-regulation theory suggests people learn to influence their own behavior through self-monitoring, goal-setting, feedback, self-reward, and self-instruction, all of which smartphones are now capable of facilitating. Several mobile apps exist to manage asthma; however, little evidence exists about whether these apps employ user-centered design processes that adhere to government usability guidelines for mobile apps. Building upon a previous study that documented adolescent preferences for an asthma self-management app, we employed a user-centered approach to assess the usability of a high-fidelity wireframe for an asthma self-management app intended for use by adolescents with persistent asthma. Individual interviews were conducted with adolescents (ages 11-18 years) with persistent asthma who owned a smartphone (N=8). Adolescents were asked to evaluate a PDF app wireframe consisting of 76 screen shots displaying app features, including log in and home screen, profile setup, settings and info, self-management features, and graphical displays for charting asthma control and medication. Preferences, comments, and suggestions for each set of screen shots were assessed using the audio-recorded interviews. Two coders reached consensus on adolescent evaluations of the following aspects of app features: (1) usability, (2) behavioral intentions to use, (3) confusing aspects, and (4) suggestions for improvement. The app wireframe was generally well received, and several suggestions for improvement were recorded. Suggestions included increased customization of charts and notifications, reminders, and alerts. Participants preferred longitudinal data about asthma control and medication use to be displayed using line graphs. All participants reported that they would find an asthma management app like the one depicted in the wireframe useful for managing their asthma. Early stage usability tests guided by government usability guidelines (usability.gov) revealed areas for improvement for an asthma self-management app for adolescents. Addressing these areas will be critical to developing an engaging and effective asthma self-management app that is capable of improving adolescent asthma outcomes. ©Adam Sage, Courtney Roberts, Lorie Geryk, Betsy Sleath, Deborah Tate, Delesha Carpenter. Originally published in JMIR Human Factors (http://humanfactors.jmir.org), 01.02.2017.

A Hypermedia Representation of a Taxonomy of Usability Characteristics in Virtual Environments

DTIC Science & Technology

2003-03-01

user, organization, and social workflow; needs analysis; and user modeling. A user task analysis generates critical information used throughout all...exist specific to VE user interaction [Gabbard and others, 1999]. Typically more than one person performs guidelines-based evaluations, since it’s...unlikely that any one person could identify all if not most of an interaction design’s usability problems. Nielsen [1994] recommends three to five

An Exploratory Usability Evaluation of Colorado State University Libraries' Digital Collections and the Western Waters Digital Library Web Sites

ERIC Educational Resources Information Center

Zimmerman, Don; Paschal, Dawn Bastian

2009-01-01

In an exploratory study, participants (n = 18) completed 11 usability tasks to assess ease of use of two Web sites, and then a Web site perception questionnaire for each. Participants rated both Web sites positively, but 25% and 36% could not complete all tasks; doing so required more than a minute to complete. (Contains 2 figures and 7 tables.)

Field Evaluation of Programmable Thermostats

DOE Office of Scientific and Technical Information (OSTI.GOV)

Sachs, O.; Tiefenbeck, V.; Duvier, C.

2012-12-01

Prior research suggests that poor programmable thermostats usability may prevent their effective use to save energy. The Fraunhofer team hypothesized that home occupants with high-usability thermostats would be more likely to use them to save energy than people with a basic thermostats. In this report, the team discusses results of a project in which the team monitored and compared programmable thermostats with basic thermostats in an affordable housing apartment complex.

A framework for reporting on human factor/usability studies of health information technologies.

PubMed

Peute, Linda W; Driest, Keiko F; Marcilly, Romaric; Bras Da Costa, Sabrina; Beuscart-Zephir, Marie-Catherine; Jaspers, Monique W M

2013-01-01

Increasingly, studies are being published on the potential negative effect of introducing poor designed Health Information Technology (HIT) into clinical settings, relating to technology-induced errors and adverse events. Academic research on HIT design and evaluation is an extremely important source of information in providing new insights into factors contributing to successful system (re)design efforts, system user-friendliness and usability issues and safety critical aspects of HIT design. However, these studies have been inconsistent and incomprehensive in their reporting, complicating the appraisal of outcomes, generalizability of study findings, meta-analysis and harmonization of the available evidence. To improve identification of type of use errors and safety related issues regarding design and implementation of HIT, consensus on issues to be reported on in scientific publications is a necessary step forward. This study presents the first approach to a framework providing a set of principles to follow for comprehensive and unambiguous reporting of HIT design and usability evaluation studies with the objective to reduce variation, improve on the publication reporting quality and proper indexation of these studies. This framework may be helpful in expanding the knowledge base not only concerning the application of Human Factors (HF)/Usability studies of HIT but also improve the knowledge base of how to (re)design and implement effective, efficient and safe HIT.

Assessment of Perceived Attractiveness, Usability, and Societal Impact of a Multimodal Robotic Assistant for Aging Patients With Memory Impairments.

PubMed

Gerłowska, Justyna; Skrobas, Urszula; Grabowska-Aleksandrowicz, Katarzyna; Korchut, Agnieszka; Szklener, Sebastian; Szczęśniak-Stańczyk, Dorota; Tzovaras, Dimitrios; Rejdak, Konrad

2018-01-01

The aim of the present study is to present the results of the assessment of clinical application of the robotic assistant for patients suffering from mild cognitive impairments (MCI) and Alzheimer Disease (AD). The human-robot interaction (HRI) evaluation approach taken within the study is a novelty in the field of social robotics. The proposed assessment of the robotic functionalities are based on end-user perception of attractiveness, usability and potential societal impact of the device. The methods of evaluation applied consist of User Experience Questionnaire (UEQ), AttrakDiff and the societal impact inventory tailored for the project purposes. The prototype version of the Robotic Assistant for MCI patients at Home (RAMCIP) was tested in a semi-controlled environment at the Department of Neurology (Lublin, Poland). Eighteen elderly participants, 10 healthy and 8 MCI, performed everyday tasks and functions facilitated by RAMCIP. The tasks consisted of semi-structuralized scenarios like: medication intake, hazardous events prevention, and social interaction. No differences between the groups of subjects were observed in terms of perceived attractiveness, usability nor-societal impact of the device. The robotic assistant societal impact and attractiveness were highly assessed. The usability of the device was reported as neutral due to the short time of interaction.

A Multicentre Audit of Single-Use Surgical Instruments (SUSI) for Tonsillectomy and Adenoidectomy

PubMed Central

O'Flynn, P; Silva, S; Kothari, P; Persaud, R

2007-01-01

INTRODUCTION Prions are resistant to conventional sterilisation procedures and, therefore, could be transmitted iatrogenically through re-usable adenoid and tonsil surgical instruments. Using disposable instruments would avoid the risk of transmission. We present the results of a complete audit loop using BBraun single-use surgical instruments (SUSI). PATIENTS AND METHODS This was a prospective multicentre audit. Surgeons were asked to fill in a standardised questionnaire recording details including postoperative complications, and evaluation of each piece of equipment compared with their own experience of conventional re-usable instruments. In the first cycle, constructive criticisms of the instruments were noted and the manufacturers modified the instruments accordingly. A second cycle of audit was subsequently undertaken. RESULTS A total of 86 patients were audited in the first cycle and 97 in the second cycle. Postoperative haemorrhage rate for both cycles was well within acceptable range. In the first audit cycle, surgeons generally found the Draffin rods, Boyle-Davis gag and bipolar diathermy forceps of poor quality and difficult to use. These were redesigned and, on repeat evaluation during the second audit cycle, were found to be just as good, if not better, than the re-usable instruments. CONCLUSIONS This study suggests that SUSI may be just as good as re-usable instruments. Furthermore, they may be more cost effective. PMID:18201478

Usability assessment of ASIBOT: a portable robot to aid patients with spinal cord injury.

PubMed

Jardón, Alberto; Gil, Ángel M; de la Peña, Ana I; Monje, Concepción A; Balaguer, Carlos

2011-01-01

The usability concept refers to aspects related to the use of products that are closely linked to the user's degree of satisfaction. Our goal is to present a functional evaluation methodology for assessing the usability of sophisticated technical aids, such as a portable robot for helping disabled patients with severe spinal cord injuries. The specific manipulator used for this task is ASIBOT, a personal assistance robot totally developed by RoboticsLab at the University Carlos III of Madrid. Our purpose is also to improve some aspects of the manipulator according to the user's perception. For our case study, a population of six patients with spinal cord injury is considered. These patients have been suffering spinal cord injuries for a period of time longer than 1 year before the tests are carried out. The methodology followed for the information gathering is based on the Quebec User Evaluation of Satisfaction with assistive Technology (QUEST). Different daily functions, such as drinking, brushing one's teeth and washing one's face, are considered to assess the user's perception when using ASIBOT as a technical aid. The human factor in this procedure is the main base to establish the specific needs and tools to make the end product more suitable and usable.

Evaluation of a Telerehabilitation System for Community-Based Rehabilitation

PubMed Central

Schutte, Jamie; Gales, Sara; Filippone, Ashlee; Saptono, Andi; Parmanto, Bambang; McCue, Michael

2012-01-01

The use of web-based portals, while increasing in popularity in the fields of medicine and research, are rarely reported on in community-based rehabilitation programs. A program within the Pennsylvania Office of Vocational Rehabilitation’s Hiram G. Andrews Center, the Cognitive Skills Enhancement Program (CSEP), sought to enhance organization of program and participant information and communication between part- and full-time employees, supervisors and consultants. A telerehabilitation system was developed consisting of (1) a web-based portal to support a variety of clinical activities, and (2) the Versatile Integrated System for Telerehabilitation (VISYTER) video-conferencing system to support the collaboration and delivery of rehabilitation services remotely. This descriptive evaluation examines the usability of the telerehabilitation system incorporating both the portal and VISYTER. Telerehabilitation system users include CSEP staff members from three geographical locations and employed by two institutions. The IBM After-Scenario Questionnaire (ASQ) and Post-Study System Usability Questionnaire (PSSUQ), the Telehealth Usability Questionnaire (TUQ), and two demographic surveys were administered to gather both objective and subjective information. Results showed generally high levels of usability. Users commented that the telerehabilitation system improved communication, increased access to information, improved speed of completing tasks, and had an appealing interface. Areas where users would like to see improvements, including ease of accessing/editing documents and searching for information, are discussed. PMID:25945193

Developing iCare v.1.0: an academic electronic health record.

PubMed

Wyatt, Tami H; Li, Xueping; Indranoi, Chayawat; Bell, Matthew

2012-06-01

An electronic health record application, iCare v.1.0, was developed and tested that allows data input and retrieval while tracking student performance over time. The development and usability testing of iCare v.1.0 followed a rapid prototyping software development and testing model. Once the functionality was tested by engineers, the usability and feasibility testing began with a convenience sample of focus group members including undergraduate and graduate students and faculty. Three focus groups were created, and four subjects participated in each focus group (n = 12). Nielsen's usability heuristics and methods of evaluation were used to evaluate data captured from each focus group. Overall, users wanted a full-featured electronic health record with features that coached or guided users. The earliest versions of iCare v.1.0 did not provide help features and prompts to guide students but were later added. Future versions will incorporate a full-featured help section. The interface and design of iCare v.1.0 are similar to professional electronic health record applications. As a result of this usability study, future versions of iCare will include more robust help features along with advanced reporting and elements specific to specialty populations such as pediatrics and mental health services.

Assessment of Perceived Attractiveness, Usability, and Societal Impact of a Multimodal Robotic Assistant for Aging Patients With Memory Impairments

PubMed Central

Gerłowska, Justyna; Skrobas, Urszula; Grabowska-Aleksandrowicz, Katarzyna; Korchut, Agnieszka; Szklener, Sebastian; Szczęśniak-Stańczyk, Dorota; Tzovaras, Dimitrios; Rejdak, Konrad

2018-01-01

The aim of the present study is to present the results of the assessment of clinical application of the robotic assistant for patients suffering from mild cognitive impairments (MCI) and Alzheimer Disease (AD). The human-robot interaction (HRI) evaluation approach taken within the study is a novelty in the field of social robotics. The proposed assessment of the robotic functionalities are based on end-user perception of attractiveness, usability and potential societal impact of the device. The methods of evaluation applied consist of User Experience Questionnaire (UEQ), AttrakDiff and the societal impact inventory tailored for the project purposes. The prototype version of the Robotic Assistant for MCI patients at Home (RAMCIP) was tested in a semi-controlled environment at the Department of Neurology (Lublin, Poland). Eighteen elderly participants, 10 healthy and 8 MCI, performed everyday tasks and functions facilitated by RAMCIP. The tasks consisted of semi-structuralized scenarios like: medication intake, hazardous events prevention, and social interaction. No differences between the groups of subjects were observed in terms of perceived attractiveness, usability nor-societal impact of the device. The robotic assistant societal impact and attractiveness were highly assessed. The usability of the device was reported as neutral due to the short time of interaction.

Usability and utility evaluation of the web-based "Should I Start Insulin?" patient decision aid for patients with type 2 diabetes among older people.

PubMed

Lee, Yew Kong; Lee, Ping Yein; Ng, Chirk Jenn; Teo, Chin Hai; Abu Bakar, Ahmad Ihsan; Abdullah, Khatijah Lim; Khoo, Ee Ming; Hanafi, Nik Sherina; Low, Wah Yun; Chiew, Thiam Kian

2018-01-01

This study aimed to evaluate the usability (ease of use) and utility (impact on user's decision-making process) of a web-based patient decision aid (PDA) among older-age users. A pragmatic, qualitative research design was used. We recruited patients with type 2 diabetes who were at the point of making a decision about starting insulin from a tertiary teaching hospital in Malaysia in 2014. Computer screen recording software was used to record the website browsing session and in-depth interviews were conducted while playing back the website recording. The interviews were analyzed using the framework approach to identify usability and utility issues. Three cycles of iteration were conducted until no more major issues emerged. Thirteen patients participated: median age 65 years old, 10 men, and nine had secondary education/diploma, four were graduates/had postgraduate degree. Four usability issues were identified (navigation between pages and sections, a layout with open display, simple language, and equipment preferences). For utility, participants commented that the website influenced their decision about insulin in three ways: it had provided information about insulin, it helped them deliberate choices using the option-attribute matrix, and it allowed them to involve others in their decision making by sharing the PDA summary printout.

The distribution and query systems of the RCSB Protein Data Bank

PubMed Central

Bourne, Philip E.; Addess, Kenneth J.; Bluhm, Wolfgang F.; Chen, Li; Deshpande, Nita; Feng, Zukang; Fleri, Ward; Green, Rachel; Merino-Ott, Jeffrey C.; Townsend-Merino, Wayne; Weissig, Helge; Westbrook, John; Berman, Helen M.

2004-01-01

The Protein Data Bank (PDB; http://www.pdb.org) is the primary source of information on the 3D structure of biological macromolecules. The PDB’s mandate is to disseminate this information in the most usable form and as widely as possible. The current query and distribution system is described and an alpha version of the future re-engineered system introduced. PMID:14681399

Physical and Cognitive Stimulation Using an Exergame in Subjects with Normal Aging, Mild and Moderate Cognitive Impairment.

PubMed

Ben-Sadoun, Grégory; Sacco, Guillaume; Manera, Valeria; Bourgeois, Jérémy; König, Alexandra; Foulon, Pierre; Fosty, Baptiste; Bremond, François; d'Arripe-Longueville, Fabienne; Robert, Philippe

2016-06-30

The use of Serious exerGames (SeG) as enriched environments (EE), which promotes cognitive simulation with physical activity in a positive emotional context, has been proposed to represent a powerful method to slow down the decline due to neurodegenerative diseases (ND), such as Alzheimer's disease (AD). However, so far, no SeG targeting EE has been tested in ND subjects. This study aimed at evaluating the usability and short-term training effects of X-Torp, an action SeG designed for elderly ND subjects with mild cognitive impairment (MCI) and AD. X-Torp is a SeG played using the Microsoft® Kinect™. 10 ND subjects and 8 healthy elderly controls (HEC) were enrolled in a 1-month program with three training sessions per week. Usability was evaluated through game time, game performance, the aerobic intensity level reached, perceived emotions, and perceived usability. All participants successfully completed the training program. ND subjects played less and had a lower game performance compared to HEC. During the sessions, ND subjects maintained a light intensity of aerobic activity, while HEC maintained a moderate intensity. Both groups experienced only positive emotions, and reported a 'moderate' to 'high' perceived competence, a 'moderate' game difficulty, and a 'high' interest in the game. Usability results suggest that X-Torp represents a usable EE for healthy subjects and persons with MCI and AD. However, in order to reach moderate or high intensity of aerobic activity, X-Torp control modes should be adapted to become more physically stimulating.

Evaluating the Quality and Usability of Open Data for Public Health Research: A Systematic Review of Data Offerings on 3 Open Data Platforms.

PubMed

Martin, Erika G; Law, Jennie; Ran, Weijia; Helbig, Natalie; Birkhead, Guthrie S

Government datasets are newly available on open data platforms that are publicly accessible, available in nonproprietary formats, free of charge, and with unlimited use and distribution rights. They provide opportunities for health research, but their quality and usability are unknown. To describe available open health data, identify whether data are presented in a way that is aligned with best practices and usable for researchers, and examine differences across platforms. Two reviewers systematically reviewed a random sample of data offerings on NYC OpenData (New York City, all offerings, n = 37), Health Data NY (New York State, 25% sample, n = 71), and HealthData.gov (US Department of Health and Human Services, 5% sample, n = 75), using a standard coding guide. Three open health data platforms at the federal, New York State, and New York City levels. Data characteristics from the coding guide were aggregated into summary indices for intrinsic data quality, contextual data quality, adherence to the Dublin Core metadata standards, and the 5-star open data deployment scheme. One quarter of the offerings were structured datasets; other presentation styles included charts (14.7%), documents describing data (12.0%), maps (10.9%), and query tools (7.7%). Health Data NY had higher intrinsic data quality (P < .001), contextual data quality (P < .001), and Dublin Core metadata standards adherence (P < .001). All met basic "web availability" open data standards; fewer met higher standards of "hyperlinked to other data." Although all platforms need improvement, they already provide readily available data for health research. Sustained effort on improving open data websites and metadata is necessary for ensuring researchers use these data, thereby increasing their research value.

I want what you've got: Cross platform portabiity and human-robot interaction assessment.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Julie L. Marble, Ph.D.*.; Douglas A. Few; David J. Bruemmer

2005-08-01

Human-robot interaction is a subtle, yet critical aspect of design that must be assessed during the development of both the human-robot interface and robot behaviors if the human-robot team is to effectively meet the complexities of the task environment. Testing not only ensures that the system can successfully achieve the tasks for which it was designed, but more importantly, usability testing allows the designers to understand how humans and robots can, will, and should work together to optimize workload distribution. A lack of human-centered robot interface design, the rigidity of sensor configuration, and the platform-specific nature of research robot developmentmore » environments are a few factors preventing robotic solutions from reaching functional utility in real word environments. Often the difficult engineering challenge of implementing adroit reactive behavior, reliable communication, trustworthy autonomy that combines with system transparency and usable interfaces is overlooked in favor of other research aims. The result is that many robotic systems never reach a level of functional utility necessary even to evaluate the efficacy of the basic system, much less result in a system that can be used in a critical, real-world environment. Further, because control architectures and interfaces are often platform specific, it is difficult or even impossible to make usability comparisons between them. This paper discusses the challenges inherent to the conduct of human factors testing of variable autonomy control architectures and across platforms within a complex, real-world environment. It discusses the need to compare behaviors, architectures, and interfaces within a structured environment that contains challenging real-world tasks, and the implications for system acceptance and trust of autonomous robotic systems for how humans and robots interact in true interactive teams.« less

Design and usability study of an iconic user interface to ease information retrieval of medical guidelines.

PubMed

Griffon, Nicolas; Kerdelhué, Gaétan; Hamek, Saliha; Hassler, Sylvain; Boog, César; Lamy, Jean-Baptiste; Duclos, Catherine; Venot, Alain; Darmoni, Stéfan J

2014-10-01

Doc'CISMeF (DC) is a semantic search engine used to find resources in CISMeF-BP, a quality controlled health gateway, which gathers guidelines available on the internet in French. Visualization of Concepts in Medicine (VCM) is an iconic language that may ease information retrieval tasks. This study aimed to describe the creation and evaluation of an interface integrating VCM in DC in order to make this search engine much easier to use. Focus groups were organized to suggest ways to enhance information retrieval tasks using VCM in DC. A VCM interface was created and improved using the ergonomic evaluation approach. 20 physicians were recruited to compare the VCM interface with the non-VCM one. Each evaluator answered two different clinical scenarios in each interface. The ability and time taken to select a relevant resource were recorded and compared. A usability analysis was performed using the System Usability Scale (SUS). The VCM interface contains a filter based on icons, and icons describing each resource according to focus group recommendations. Some ergonomic issues were resolved before evaluation. Use of VCM significantly increased the success of information retrieval tasks (OR=11; 95% CI 1.4 to 507). Nonetheless, it took significantly more time to find a relevant resource with VCM interface (101 vs 65 s; p=0.02). SUS revealed 'good' usability with an average score of 74/100. VCM was successfully implemented in DC as an option. It increased the success rate of information retrieval tasks, despite requiring slightly more time, and was well accepted by end-users. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

Heuristic Evaluation of Online COPD Respiratory Therapy and Education Video Resource Center

PubMed Central

Chaney, Beth; Chaney, Don

2014-01-01

Abstract Purpose: Because of limited accessibility to pulmonary rehabilitation programs, patients with chronic obstructive pulmonary disease (COPD) are infrequently provided with patient education resources. To help educate patients with COPD on how to live a better life with diminished breathing capacity, we developed a novel social media resource center containing COPD respiratory therapy and education videos called “COPDFlix.” Methodology: A heuristic evaluation of COPDFlix was conducted as part of a larger study to determine whether the prototype was successful in adhering to formal Web site usability guidelines for older adults. A purposive sample of three experts, with expertise in Web design and health communications technology, was recruited (a) to identify usability violations and (b) to propose solutions to improve the functionality of the COPDFlix prototype. Each expert evaluated 18 heuristics in four categories of task-based criteria (i.e., interaction and navigation, information architecture, presentation design, and information design). Seventy-six subcriteria across these four categories were assessed. Quantitative ratings and qualitative comments from each expert were compiled into a single master list, noting the violated heuristic and type/location of problem(s). Results: Sixty-one usability violations were identified across the 18 heuristics. Evaluators rated the majority of heuristic subcriteria as either a “minor hindrance” (n=32) or “no problem” (n=132). Moreover, only 2 of the 18 heuristic categories were noted as “major” violations, with mean severity scores of ≥3. Conclusions: Mixed-methods data analysis helped the multidisciplinary research team to categorize and prioritize usability problems and solutions, leading to 26 discrete design modifications within the COPDFlix prototype. PMID:24650318

User needs analysis and usability assessment of DataMed - a biomedical data discovery index.

PubMed

Dixit, Ram; Rogith, Deevakar; Narayana, Vidya; Salimi, Mandana; Gururaj, Anupama; Ohno-Machado, Lucila; Xu, Hua; Johnson, Todd R

2017-11-30

To present user needs and usability evaluations of DataMed, a Data Discovery Index (DDI) that allows searching for biomedical data from multiple sources. We conducted 2 phases of user studies. Phase 1 was a user needs analysis conducted before the development of DataMed, consisting of interviews with researchers. Phase 2 involved iterative usability evaluations of DataMed prototypes. We analyzed data qualitatively to document researchers' information and user interface needs. Biomedical researchers' information needs in data discovery are complex, multidimensional, and shaped by their context, domain knowledge, and technical experience. User needs analyses validate the need for a DDI, while usability evaluations of DataMed show that even though aggregating metadata into a common search engine and applying traditional information retrieval tools are promising first steps, there remain challenges for DataMed due to incomplete metadata and the complexity of data discovery. Biomedical data poses distinct problems for search when compared to websites or publications. Making data available is not enough to facilitate biomedical data discovery: new retrieval techniques and user interfaces are necessary for dataset exploration. Consistent, complete, and high-quality metadata are vital to enable this process. While available data and researchers' information needs are complex and heterogeneous, a successful DDI must meet those needs and fit into the processes of biomedical researchers. Research directions include formalizing researchers' information needs, standardizing overviews of data to facilitate relevance judgments, implementing user interfaces for concept-based searching, and developing evaluation methods for open-ended discovery systems such as DDIs. © The Author 2017. Published by Oxford University Press on behalf of the American Medical Informatics Association. All rights reserved. For Permissions, please email: journals.permissions@oup.com

Educational software usability: Artifact or Design?

PubMed

Van Nuland, Sonya E; Eagleson, Roy; Rogers, Kem A

2017-03-01

Online educational technologies and e-learning tools are providing new opportunities for students to learn worldwide, and they continue to play an important role in anatomical sciences education. Yet, as we shift to teaching online, particularly within the anatomical sciences, it has become apparent that e-learning tool success is based on more than just user satisfaction and preliminary learning outcomes-rather it is a multidimensional construct that should be addressed from an integrated perspective. The efficiency, effectiveness and satisfaction with which a user can navigate an e-learning tool is known as usability, and represents a construct which we propose can be used to quantitatively evaluate e-learning tool success. To assess the usability of an e-learning tool, usability testing should be employed during the design and development phases (i.e., prior to its release to users) as well as during its delivery (i.e., following its release to users). However, both the commercial educational software industry and individual academic developers in the anatomical sciences have overlooked the added value of additional usability testing. Reducing learner frustration and anxiety during e-learning tool use is essential in ensuring e-learning tool success, and will require a commitment on the part of the developers to engage in usability testing during all stages of an e-learning tool's life cycle. Anat Sci Educ 10: 190-199. © 2016 American Association of Anatomists. © 2016 American Association of Anatomists.

How do health service professionals consider human factors when purchasing interactive medical devices? A qualitative interview study.

PubMed

Vincent, Christopher James; Blandford, Ann

2017-03-01

We present findings of a UK study into how those involved in purchasing interactive medical devices go about evaluating usability, the challenges that arise, and opportunities for improvement. The study focused on procurement of infusion devices because these are used by various professionals across healthcare. A semi-structured interview study was carried out involving a range of stakeholders (20 in total) involved in or impacted by medical device procurement. Data was analysed using thematic analysis, a qualitative method designed to support the identification, analysis and reporting of patterns. In principle, health service purchasing was found to accommodate consideration of equipment usability. In practice, the evaluation process was driven primarily by engineering standards; assessment of local needs did not accommodate substantive assessment of usability; and choice was limited by the availability of equipment on the marketplace. We discuss ways in which purchasing could be improved through techniques that account for social circumstances. Copyright © 2016 Elsevier Ltd. All rights reserved.

Perceived usability and use of custom-made footwear in diabetic patients at high risk for foot ulceration.

PubMed

Arts, Mark L J; de Haart, Mirjam; Bus, Sicco A; Bakker, Jan P J; Hacking, Hub G A; Nollet, Frans

2014-04-01

To assess the perceived usability and use of custom- made footwear in diabetic patients who are at high-risk for foot ulceration, and to elucidate the determinants of usability and use. Survey. A total of 153 patients with diabetes, peripheral neuropathy, prior plantar foot ulceration and newly prescribed custom-made footwear, recruited from 10 Dutch multidisciplinary foot clinics. The Questionnaire of Usability Evaluation was used to assess the patients' perception of weight, appearance, comfort, durability, donning/doffing, stability, benefit and overall appreciation of their prescription footwear (all expressed as visual analogue scores). Data on priorities for usability and footwear use (in h/day) were obtained from patient reports. Multivariate logistic regression analysis was used to assess determinants of usability and use. Median (interquartile range) score for overall appreciation was 8.3 (7.1-9.1). Scores ranged from 6.5 (4.5-8.6) for weight to 9.6 (6.3-9.9) for donning/doffing. Footwear comfort was listed most often (33.3%) as the highest priority. Footwear use was <60% of daytime (where daytime was defined as 16 h out of bed) in 58% of patients. The only significant determinant of footwear use was the perceived benefit of the footwear (p = 0.045). Perceived usability of footwear was mostly positive, although individual scores and priorities varied considerably. Footwear use was low to moderate and dependent only on the perceived benefit of the footwear. Therefore, practitioners should focus on enhancing the patient's ap-preciation of the therapeutic benefit of custom-made footwear.

User-centered development and testing of a monitoring system that provides feedback regarding physical functioning to elderly people

PubMed Central

Vermeulen, Joan; Neyens, Jacques CL; Spreeuwenberg, Marieke D; van Rossum, Erik; Sipers, Walther; Habets, Herbert; Hewson, David J; de Witte, Luc P

2013-01-01

Purpose To involve elderly people during the development of a mobile interface of a monitoring system that provides feedback to them regarding changes in physical functioning and to test the system in a pilot study. Methods and participants The iterative user-centered development process consisted of the following phases: (1) selection of user representatives; (2) analysis of users and their context; (3) identification of user requirements; (4) development of the interface; and (5) evaluation of the interface in the lab. Subsequently, the monitoring and feedback system was tested in a pilot study by five patients who were recruited via a geriatric outpatient clinic. Participants used a bathroom scale to monitor weight and balance, and a mobile phone to monitor physical activity on a daily basis for six weeks. Personalized feedback was provided via the interface of the mobile phone. Usability was evaluated on a scale from 1 to 7 using a modified version of the Post-Study System Usability Questionnaire (PSSUQ); higher scores indicated better usability. Interviews were conducted to gain insight into the experiences of the participants with the system. Results The developed interface uses colors, emoticons, and written and/or spoken text messages to provide daily feedback regarding (changes in) weight, balance, and physical activity. The participants rated the usability of the monitoring and feedback system with a mean score of 5.2 (standard deviation 0.90) on the modified PSSUQ. The interviews revealed that most participants liked using the system and appreciated that it signaled changes in their physical functioning. However, usability was negatively influenced by a few technical errors. Conclusion Involvement of elderly users during the development process resulted in an interface with good usability. However, the technical functioning of the monitoring system needs to be optimized before it can be used to support elderly people in their self-management. PMID:24039407

Evaluation of Usability and Acceptance of a New Autoinjector Intended for Methotrexate Subcutaneous Self-Administration in the Management of Rheumatoid Arthritis.

PubMed

Hudry, Christophe; Lebrun, Agnès; Moura, Bertrand; Zinovieva, Elena; Backers, Onne; Herman-Demars, Hélène

2017-06-01

Rheumatoid arthritis (RA) is a chronic autoimmune inflammatory disease, for which the introduction of injectable treatments has had a major impact on quality of life directly related to the disease. The purpose of this descriptive study was to evaluate the usability of a new autoinjector, intended for methotrexate self-administration, based on the device's design and instructions for use (IFU). This multicenter trial included three user groups: a group of patients with established RA subdivided into two groups according to their hand disability, and a group of caregivers or nurses. Each subject performed three simulated injections with a water-filled device on a foam pad. The first injection was made just after reading the IFU without further instructions (first phase). The second phase consisted of two injections made after explanations provided upon request of the subject in an optimum environment and in a "worst-case" home environment. The usability of the autoinjector was assessed by a questionnaire (success: ≥75% of positive responses) and by a score card reflecting injection performances (success: execution of ≥75% of handling steps). Forty-two subjects were enrolled in the study. During the first phase, the great majority of subjects succeeded in the usability questionnaire (90.5%) and in the injection performance (95.2%) with no major differences between the user groups. In the Second phase, all subjects from all three user groups succeeded in the usability questionnaire and had a positive rate of device handling, regardless of the environment and of the user group. No safety concerns were raised during the study. This study found a very high level of usability and subject acceptance of the autoinjector, intended for methotrexate self-administration, regardless of the hand disability and environmental conditions. Nordic Group. EudraCT reference number: 2014-A0141245.

In the Loop: The Organization of Team-Based Communication in a Patient-Centered Clinical Collaboration System.

PubMed

Kurahashi, Allison M; Weinstein, Peter B; Jamieson, Trevor; Stinson, Jennifer N; Cafazzo, Joseph A; Lokuge, Bhadra; Morita, Plinio P; Cohen, Eyal; Rapoport, Adam; Bezjak, Andrea; Husain, Amna

2016-03-24

We describe the development and evaluation of a secure Web-based system for the purpose of collaborative care called Loop. Loop assembles the team of care with the patient as an integral member of the team in a secure space. The objectives of this paper are to present the iterative design of the separate views for health care providers (HCPs) within each patient's secure space and examine patients', caregivers', and HCPs' perspectives on this separate view for HCP-only communication. The overall research program includes cycles of ethnography, prototyping, usability testing, and pilot testing. This paper describes the usability testing phase that directly informed development. A descriptive qualitative approach was used to analyze participant perspectives that emerged during usability testing. During usability testing, we sampled 89 participants from three user groups: 23 patients, 19 caregivers, and 47 HCPs. Almost all perspectives from the three user groups supported the need for an HCP-only communication view. In an earlier prototype, the visual presentation caused confusion among HCPs when reading and composing messages about whether a message was visible to the patient. Usability testing guided us to design a more deliberate distinction between posting in the Patient and Team view and the Health Care Provider Only view at the time of composing a message, which once posted is distinguished by an icon. The team made a decision to incorporate an HCP-only communication view based on findings during earlier phases of work. During usability testing we tested the separate communication views, and all groups supported this partition. We spent considerable effort designing the partition; however, preliminary findings from the next phase of evaluation, pilot testing, show that the Patient and Team communication is predominantly being used. This demonstrates the importance of a subsequent phase of the clinical trial of Loop to validate the concept and design.

Improved usability of a multi-infusion setup using a centralized control interface: A task-based usability test

PubMed Central

Cnossen, Fokie; Dieperink, Willem; Bult, Wouter; de Smet, Anne Marie; Touw, Daan J.; Nijsten, Maarten W.

2017-01-01

The objective of this study was to assess the usability benefits of adding a bedside central control interface that controls all intravenous (IV) infusion pumps compared to the conventional individual control of multiple infusion pumps. Eighteen dedicated ICU nurses volunteered in a between-subjects task-based usability test. A newly developed central control interface was compared to conventional control of multiple infusion pumps in a simulated ICU setting. Task execution time, clicks, errors and questionnaire responses were evaluated. Overall the central control interface outperformed the conventional control in terms of fewer user actions (40±3 vs. 73±20 clicks, p<0.001) and fewer user errors (1±1 vs. 3±2 errors, p<0.05), with no difference in task execution times (421±108 vs. 406±119 seconds, not significant). Questionnaires indicated a significant preference for the central control interface. Despite being novice users of the central control interface, ICU nurses displayed improved performance with the central control interface compared to the conventional interface they were familiar with. We conclude that the new user interface has an overall better usability than the conventional interface. PMID:28800617

Improved usability of a multi-infusion setup using a centralized control interface: A task-based usability test.

PubMed

Doesburg, Frank; Cnossen, Fokie; Dieperink, Willem; Bult, Wouter; de Smet, Anne Marie; Touw, Daan J; Nijsten, Maarten W

2017-01-01

The objective of this study was to assess the usability benefits of adding a bedside central control interface that controls all intravenous (IV) infusion pumps compared to the conventional individual control of multiple infusion pumps. Eighteen dedicated ICU nurses volunteered in a between-subjects task-based usability test. A newly developed central control interface was compared to conventional control of multiple infusion pumps in a simulated ICU setting. Task execution time, clicks, errors and questionnaire responses were evaluated. Overall the central control interface outperformed the conventional control in terms of fewer user actions (40±3 vs. 73±20 clicks, p<0.001) and fewer user errors (1±1 vs. 3±2 errors, p<0.05), with no difference in task execution times (421±108 vs. 406±119 seconds, not significant). Questionnaires indicated a significant preference for the central control interface. Despite being novice users of the central control interface, ICU nurses displayed improved performance with the central control interface compared to the conventional interface they were familiar with. We conclude that the new user interface has an overall better usability than the conventional interface.

[Benefits and usability of a pharmaceutical record in medical practice. A survey of hospital doctors and pharmacists (MATRIX study)].

PubMed

Schuers, M; Timsit, M; Gillibert, A; Fred, A; Griffon, N; Bénichou, J; Darmoni, S J; Staccini, P

2016-09-01

To evaluate the impact of the pharmaceutical patient record use in emergency, geriatric and anaesthesia and intensive care departments, an experimentation was launched in 2013 in 55 hospitals. The purpose of the study was to assess the opinions of physicians and pharmacists about the benefits and usability of the patient pharmaceutical record. An e-mailed self-administered questionnaire was sent to all the pharmacists, anaesthesiologists, geriatricians and emergency physicians of the 55 hospitals involved in the patient pharmaceutical record experimentation. The questionnaire assessed the usability of the patient pharmaceutical record using the "System Usability Scale", as well as its use, its benefits and limitations perceived in clinical practice, and overall user satisfaction. Questionnaires were collected from November 2014 to January 2015. Ninety-six questionnaires were collected, from 47 hospitals, representing 86% of the hospitals involved in the experimentation. The patient pharmaceutical record was effectively operational in 36 hospitals. Data from 73 questionnaires filled by physicians and pharmacists with potential experience with the patient pharmaceutical record were used for evaluation. Forty-two respondents were pharmacists (57%) and 31 were physicians (43%), including 13 geriatricians, 11 emergency physicians and 7 anaesthesiologists. Patient pharmaceutical record overall usability score was 62.5 out of 100. It did not vary with the profession or seniority of the respondent. It was positively correlated with the frequency of use. More than half of respondents reported that they never or uncommonly used the patient pharmaceutical record. The length of access to data period was considered as insufficient. Main obstacles to more utilization of the patient pharmaceutical record were the lack of information about the dosage of dispensed drugs, the low number of patients in possession of their health card and the low number of patients with an activated patient pharmaceutical record. Two years after the beginning of the experiment aiming to broaden the access to the patient pharmaceutical record to physicians, these first evaluation results are encouraging. The evaluation of the consequences of the access to the patient pharmaceutical record for physicians remains necessary. Copyright © 2016 Elsevier Masson SAS. All rights reserved.

Initial Evaluation of the Intelligent Multi-UxV Planner with Adaptive Collaborative/Control Technologies (IMPACT)

DTIC Science & Technology

2017-02-17

Psychology. Brooke, J. (1996). SUS: a ‘quick and dirty ’ usability scale. In P. Jordan, B. Thomas, I. McClelland, & B. Weerdmeester (Eds.), Usability...level modeling, International Journal of Human Computer Studies, Vol. 45(3). Menzies, T. (1996b). On the Practicality of Abductive Validation, ECAI...1). Shima, T., & Rasmussen, S. (2009). UAV Cooperative Decision and Control: Challenges and Practical Approaches, SIAM Publications, ISBN

National questionnaire study on clinical ICT systems proofs: physicians suffer from poor usability.

PubMed

Viitanen, Johanna; Hyppönen, Hannele; Lääveri, Tinja; Vänskä, Jukka; Reponen, Jarmo; Winblad, Ilkka

2011-10-01

In the health informatics field, usability studies typically focus on evaluating a single information system and involve a rather small group of end-users. However, little is known about the usability of clinical information and communication technology (ICT) environment in which healthcare professionals work daily. This paper aims at contributing to usability research and user-oriented development of healthcare technologies with three objectives: inform researchers and practitioners about the current state of usability of clinical ICT systems, increase the understanding of usability aspects specific for clinical context, and encourage a more holistic approach on studying usability issues in health informatics field. A national web questionnaire study was conducted in Finland in spring 2010 with 3929 physicians actively working in patient care. For the purposes of the study, we described three dimensions of clinical ICT system usability that reflect the physicians' viewpoint on system usage: (1) compatibility between clinical ICT systems and physicians' tasks, (2) ICT support for information exchange, communication and collaboration in clinical work, and (3) interoperability and reliability. The dimensions derive from the definitions of usability and clinical context of use analysis, and reflect the ability of ICT systems to have a positive impact on patient care by supporting physicians in achieving their goals with a pleasant user experience. The research data incorporated 32 statements with a five-point Likert-scale on physicians' experiences on usability of their currently used ICT systems and a summative question about school grade given to electronic health record (EHR) systems. Physicians' estimates of their EHR systems were very critical. With the rating scale from 4 or fail to 10 or excellent, the average of the grades varied from 6.1 to 8.4 dependent on the kind of facility the physician is working. Questionnaire results indicated several usability problems and deficiencies which considerably hindered the efficiency of clinical ICT use and physician's routine work. Systems lacked the appropriate features to support typical clinical tasks, such as decision making, prevention of medical errors, and review of a patient's treatment chart. The systems also required physicians to perform fixed sequences of steps and tasks, and poorly supported the documentation and retrieval of patient data. The findings on ICT support for collaboration showed mainly negative results, aside from collaboration between co-located physicians. In addition, the study results pointed out physicians suffering from system failures and a lack of integration between the systems. The described study and related results are unique in several ways. A national usability study with nearly 4000 respondents had not been conducted in other countries in which healthcare technologies are widely adopted. The questionnaire study provided a generalized picture about the usability problems, however, it should be noted that there were significant differences between legacy systems in use. Previously, researchers had not approached contextual aspects of usability the context of clinical work, where numerous systems are in use. The described usability dimensions and the presented study results can be considered as the first step towards conceptualizing ICT usability in the unique setting of clinical work. Copyright © 2011 Elsevier Ireland Ltd. All rights reserved.

Clinical evaluation of BrainTree, a motor imagery hybrid BCI speller

NASA Astrophysics Data System (ADS)

Perdikis, S.; Leeb, R.; Williamson, J.; Ramsay, A.; Tavella, M.; Desideri, L.; Hoogerwerf, E.-J.; Al-Khodairy, A.; Murray-Smith, R.; Millán, J. d. R.

2014-06-01

Objective. While brain-computer interfaces (BCIs) for communication have reached considerable technical maturity, there is still a great need for state-of-the-art evaluation by the end-users outside laboratory environments. To achieve this primary objective, it is necessary to augment a BCI with a series of components that allow end-users to type text effectively. Approach. This work presents the clinical evaluation of a motor imagery (MI) BCI text-speller, called BrainTree, by six severely disabled end-users and ten able-bodied users. Additionally, we define a generic model of code-based BCI applications, which serves as an analytical tool for evaluation and design. Main results. We show that all users achieved remarkable usability and efficiency outcomes in spelling. Furthermore, our model-based analysis highlights the added value of human-computer interaction techniques and hybrid BCI error-handling mechanisms, and reveals the effects of BCI performances on usability and efficiency in code-based applications. Significance. This study demonstrates the usability potential of code-based MI spellers, with BrainTree being the first to be evaluated by a substantial number of end-users, establishing them as a viable, competitive alternative to other popular BCI spellers. Another major outcome of our model-based analysis is the derivation of a 80% minimum command accuracy requirement for successful code-based application control, revising upwards previous estimates attempted in the literature.

Clinical evaluation of BrainTree, a motor imagery hybrid BCI speller.

PubMed

Perdikis, S; Leeb, R; Williamson, J; Ramsay, A; Tavella, M; Desideri, L; Hoogerwerf, E-J; Al-Khodairy, A; Murray-Smith, R; Millán, J D R

2014-06-01

While brain-computer interfaces (BCIs) for communication have reached considerable technical maturity, there is still a great need for state-of-the-art evaluation by the end-users outside laboratory environments. To achieve this primary objective, it is necessary to augment a BCI with a series of components that allow end-users to type text effectively. This work presents the clinical evaluation of a motor imagery (MI) BCI text-speller, called BrainTree, by six severely disabled end-users and ten able-bodied users. Additionally, we define a generic model of code-based BCI applications, which serves as an analytical tool for evaluation and design. We show that all users achieved remarkable usability and efficiency outcomes in spelling. Furthermore, our model-based analysis highlights the added value of human-computer interaction techniques and hybrid BCI error-handling mechanisms, and reveals the effects of BCI performances on usability and efficiency in code-based applications. This study demonstrates the usability potential of code-based MI spellers, with BrainTree being the first to be evaluated by a substantial number of end-users, establishing them as a viable, competitive alternative to other popular BCI spellers. Another major outcome of our model-based analysis is the derivation of a 80% minimum command accuracy requirement for successful code-based application control, revising upwards previous estimates attempted in the literature.

Ten Demands of Improved Usability in eHealth and Some Progress - Co-Creation by Health and Social Care Professionals.

PubMed

Scandurra, Isabella; Liljequist, David

2016-01-01

Current healthcare organizations often do not accomplish the intended effects of their eHealth systems due to inadequate usability. Commissioned by the Swedish Ministry of Health and Social Affairs, the usability of current eHealth systems in Swedish health and social care has been analysed from the perspective of their professionals. The objective of the study was to report on current problems, potential solutions as well as to relate these to research in relevant areas. Using a participatory approach, nine workshops were held where health informatics researchers guided staff from different care organizations, representatives of the national associations of health and social care professionals and the national eHealth system vendor organization. This paper presents ten demands that Swedish health and social care professionals find imperative to prioritize. The study emphasizes that development of eHealth systems must be integrated into the care practice improvement process and iteratively evaluated regarding usability.

Implementation of the Agitated Behavior Scale in the Electronic Health Record.

PubMed

Wilson, Helen John; Dasgupta, Kritis; Michael, Kathleen

The purpose of the study was to implement an Agitated Behavior Scale through an electronic health record and to evaluate the usability of the scale in a brain injury unit at a rehabilitation hospital. A quality improvement project was conducted in the brain injury unit at a large rehabilitation hospital with registered nurses as participants using convenience sampling. The project consisted of three phases and included education, implementation of the scale in the electronic health record, and administration of the survey questionnaire, which utilized the system usability scale. The Agitated Behavior Scale was found to be usable, and there was 92.2% compliance with the use of the electronic Electronic Agitated Behavior Scale. The Agitated Behavior Scale was effectively implemented in the electronic health record and was found to be usable in the assessment of agitation. Utilization of the scale through the electronic health record on a daily basis will allow for an early identification of agitation in patients with traumatic brain injury and enable prompt interventions to manage agitation.

Development and preliminary testing of a web-based, self-help application for disaster-affected families

PubMed Central

Yuen, Erica K; Gros, Kirstin; Welsh, Kyleen E; McCauley, Jenna; Resnick, Heidi S; Danielson, Carla K; Price, Matthew; Ruggiero, Kenneth J

2015-01-01

Technology-based self-help interventions have the potential to increase access to evidence-based mental healthcare, especially for families affected by natural disasters. However, development of these interventions is a complex process and poses unique challenges. Usability testing, which assesses the ability of individuals to use an application successfully, can have a significant impact on the quality of a self-help intervention. This article describes (a) the development of a novel web-based multi-module self-help intervention for disaster-affected adolescents and their parents and (b) a mixed-methods formal usability study to evaluate user response. A total of 24 adolescents were observed, videotaped, and interviewed as they used the depressed mood component of the self-help intervention. Quantitative results indicated an above-average user experience, and qualitative analysis identified 120 unique usability issues. We discuss the challenges of developing self-help applications, including design considerations and the value of usability testing in technology-based interventions, as well as our plan for widespread dissemination. PMID:25933798

Method for technology-delivered healthcare measures.

PubMed

Kramer-Jackman, Kelli Lee; Popkess-Vawter, Sue

2011-12-01

Current healthcare literature lacks development and evaluation methods for research and practice measures administered by technology. Researchers with varying levels of informatics experience are developing technology-delivered measures because of the numerous advantages they offer. Hasty development of technology-delivered measures can present issues that negatively influence administration and psychometric properties. The Method for Technology-delivered Healthcare Measures is designed to systematically guide the development and evaluation of technology-delivered measures. The five-step Method for Technology-delivered Healthcare Measures includes establishment of content, e-Health literacy, technology delivery, expert usability, and participant usability. Background information and Method for Technology-delivered Healthcare Measures steps are detailed.

Usability Testing and Analysis Facility (UTAF)

NASA Technical Reports Server (NTRS)

Wong, Douglas T.

2010-01-01

This slide presentation reviews the work of the Usability Testing and Analysis Facility (UTAF) at NASA Johnson Space Center. It is one of the Space Human Factors Laboratories in the Habitability and Human Factors Branch (SF3) at NASA Johnson Space Center The primary focus pf the UTAF is to perform Human factors evaluation and usability testing of crew / vehicle interfaces. The presentation reviews the UTAF expertise and capabilities, the processes and methodologies, and the equipment available. It also reviews the programs that it has supported detailing the human engineering activities in support of the design of the Orion space craft, testing of the EVA integrated spacesuit, and work done for the design of the lunar projects of the Constellation Program: Altair, Lunar Electric Rover, and Outposts

Evaluating the Usability and Usefulness of a Mobile App for Atrial Fibrillation Using Qualitative Methods: Exploratory Pilot Study

PubMed Central

Mansour, Moussa; Sperber, Jodi; Agboola, Stephen; Kvedar, Joseph; Jethwani, Kamal

2018-01-01

Background Atrial fibrillation (AFib) is the most common form of heart arrhythmia and a potent risk factor for stroke. Nonvitamin K antagonist oral anticoagulants (NOACs) are routinely prescribed to manage AFib stroke risk; however, nonadherence to treatment is a concern. Additional tools that support self-care and medication adherence may benefit patients with AFib. Objective The aim of this study was to evaluate the perceived usability and usefulness of a mobile app designed to support self-care and treatment adherence for AFib patients who are prescribed NOACs. Methods A mobile app to support AFib patients was previously developed based on early stage interview and usability test data from clinicians and patients. An exploratory pilot study consisting of naturalistic app use, surveys, and semistructured interviews was then conducted to examine patients’ perceptions and everyday use of the app. Results A total of 12 individuals with an existing diagnosis of nonvalvular AFib completed the 4-week study. The average age of participants was 59 years. All participants somewhat or strongly agreed that the app was easy to use, and 92% (11/12) reported being satisfied or very satisfied with the app. Participant feedback identified changes that may improve app usability and usefulness for patients with AFib. Areas of usability improvement were organized by three themes: app navigation, clarity of app instructions and design intent, and software bugs. Perceptions of app usefulness were grouped by three key variables: core needs of the patient segment, patient workflow while managing AFib, and the app’s ability to support the patient’s evolving needs. Conclusions The results of this study suggest that mobile tools that target self-care and treatment adherence may be helpful to AFib patients, particularly those who are newly diagnosed. Additionally, participant feedback provided insight into the varied needs and health experiences of AFib patients, which may improve the design and targeting of the intervention. Pilot studies that qualitatively examine patient perceptions of usability and usefulness are a valuable and often underutilized method for assessing the real-world acceptability of an intervention. Additional research evaluating the AFib Connect mobile app over a longer period, and including a larger, more diverse sample of AFib patients, will be helpful for understanding whether the app is perceived more broadly to be useful and effective in supporting patient self-care and medication adherence. PMID:29549073

Development of a tailored strategy to improve postpartum hemorrhage guideline adherence.

PubMed

de Visser, Suzan M; Woiski, Mallory D; Grol, Richard P; Vandenbussche, Frank P H A; Hulscher, Marlies E J L; Scheepers, Hubertina C J; Hermens, Rosella P M G

2018-02-08

Despite the introduction of evidence based guidelines and practical courses, the incidence of postpartum hemorrhage shows an increasing trend in developed countries. Substandard care is often found, which implies an inadequate implementation in high resource countries. We aimed to reduce the gap between evidence-based guidelines and clinical application, by developing a strategy, tailored to current barriers for implementation. The development of the implementation strategy consisted of three phases, supervised by a multidisciplinary expert panel. In the first phase a framework of the strategy was created, based on barriers to optimal adherence identified among professionals and patients together with evidence on effectiveness of strategies found in literature. In the second phase, the tools within the framework were developed, leading to a first draft. In the third phase the strategy was evaluated among professionals and patients. The professionals were asked to give written feedback on tool contents, clinical usability and inconsistencies with current evidence care. Patients evaluated the tools on content and usability. Based on the feedback of both professionals and patients the tools were adjusted. We developed a tailored strategy to improve guideline adherence, covering the trajectory of the third trimester of pregnancy till the end of the delivery. The strategy, directed at professionals, comprehending three stop moments includes a risk assessment checklist, care bundle and time-out procedure. As patient empowerment tools, a patient passport and a website with patient information was developed. The evaluation among the expert panel showed all professionals to be satisfied with the content and usability and no discrepancies or inconsistencies with current evidence was found. Patients' evaluation revealed that the information they received through the tools was incomplete. The tools were adjusted accordingly to the missing information. A usable, tailored strategy to implement PPH guidelines and practical courses was developed. The next step is the evaluation of the strategy in a feasibility trial. Clinical trial registration: The Fluxim study, registration number: NCT00928863 .

Human factors evaluation of TSO-C129A GPS receivers

DOT National Transportation Integrated Search

1998-10-22

This report documents an evaluation of the usability of TSO-C129a-certified Global Positioning System (GPS) receivers. Bench and flight tests were conducted on six GPS receivers. The evaluations covered 23 flight tasks. Both subjective and objective ...

Hybrid P300-based brain-computer interface to improve usability for people with severe motor disability: electromyographic signals for error correction during a spelling task.

PubMed

Riccio, Angela; Holz, Elisa Mira; Aricò, Pietro; Leotta, Francesco; Aloise, Fabio; Desideri, Lorenzo; Rimondini, Matteo; Kübler, Andrea; Mattia, Donatella; Cincotti, Febo

2015-03-01

To evaluate the impact of a hybrid control on usability of a P300-based brain-computer interface (BCI) system that was designed to control an assistive technology software and was integrated with an electromyographic channel for error correction. Proof-of-principle study with a convenience sample. Neurologic rehabilitation hospital. Participants (N=11) in this pilot study included healthy (n=8) and severely motor impaired (n=3) persons. The 3 people with severe motor disability were identified as potential candidates to benefit from the proposed hybrid BCI system for communication and environmental interaction. To eventually investigate the improvement in usability, we compared 2 modalities of BCI system control: a P300-based and a hybrid P300 electromyographic-based mode of control. System usability was evaluated according to the following outcome measures within 3 domains: (1) effectiveness (overall system accuracy and P300-based BCI accuracy); (2) efficiency (throughput time and users' workload); and (3) satisfaction (users' satisfaction). We also considered the information transfer rate and time for selection. Findings obtained in healthy participants were in favor of a higher usability of the hybrid control as compared with the nonhybrid. A similar trend was indicated by the observational results gathered from each of the 3 potential end-users. The proposed hybrid BCI control modality could provide end-users with severe motor disability with an option to exploit some residual muscular activity, which could not be fully reliable for properly controlling an assistive technology device. The findings reported in this pilot study encourage the implementation of a clinical trial involving a large cohort of end-users. Copyright © 2015 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.

Informational content, literacy demands, and usability of websites offering health-related genetic tests directly to consumers.

PubMed

Lachance, Christina R; Erby, Lori A H; Ford, Beth M; Allen, Vincent C; Kaphingst, Kimberly A

2010-05-01

As direct-to-consumer genetic testing becomes more available, a diverse group of consumers, including those with limited health literacy, may consider testing. In light of concerns raised about direct-to-consumer genetic testing, this study sought to critically examine whether the informational content, literacy demands, and usability of health-related direct-to-consumer websites met existing recommendations. A content analysis was performed on 29 health-related direct-to-consumer websites. Two coders independently evaluated each website for informational content (e.g., benefits, limitations), literacy demands (e.g., reading level), and usability (e.g., ease of navigation). Most sites presented health conditions and some markers for which they tested, benefits of testing, a description of the testing process, and their privacy policy. Fewer cited scientific literature, explained test limitations, or provided an opportunity to consult a health professional. Key informational content was difficult to locate on most sites. Few sites gave sample disease risk estimates or used common language and explained technical terms consistently. Average reading level was grade 15. The quality of informational content, literacy demands, and usability across health-related direct-to-consumer websites varied widely. Many users would struggle to find and understand the important information. For consumers to better understand the content on these sites and evaluate the meaning of the tests for their health, sites should lower the demands placed on users by distilling and prioritizing the key informational content while simultaneously attending to the reading level and usability elements. In the absence of regulation compelling such changes, government agencies or professional organizations may need to increase consumer and provider awareness of these issues.

Providing time-discrete gait information by wearable feedback apparatus for lower-limb amputees: usability and functional validation.

PubMed

Crea, Simona; Cipriani, Christian; Donati, Marco; Carrozza, Maria Chiara; Vitiello, Nicola

2015-03-01

Here we describe a novel wearable feedback apparatus for lower-limb amputees. The system is based on three modules: a pressure-sensitive insole for the measurement of the plantar pressure distribution under the prosthetic foot during gait, a computing unit for data processing and gait segmentation, and a set of vibrating elements placed on the thigh skin. The feedback strategy relies on the detection of specific gait-phase transitions of the amputated leg. Vibrating elements are activated in a time-discrete manner, simultaneously with the occurrence of the detected gait-phase transitions. Usability and effectiveness of the apparatus were successfully assessed through an experimental validation involving ten healthy volunteers.

Usability and Utility of a Mobile Application for Marksmanship Training

DTIC Science & Technology

2015-01-01

Right of Canada, as represented by the Minister of National Defence, 2015 © Sa Majesté la Reine (en droit du Canada), telle que représentée par le...Empirical Evaluation of the System Usability Scale. International Journal of Human-Computer Interaction, 24(6), 574-594. BenMoussa, C. (2003). Workers on...Behavioral and Social Sciences. Jumisko-Pyykko, S., & Vainio, T. (2011). Framing the Context of Use for Mobile HCI. International Journal of Mobile

Development of a web-based executive functioning intervention for adolescents with epilepsy: The Epilepsy Journey.

PubMed

Modi, Avani C; Schmidt, Matthew; Smith, Aimee W; Turnier, Luke; Glaser, Noah; Wade, Shari L

2017-07-01

Youth with epilepsy exhibit significant deficits in executive functioning (EF), yet there are few interventions to improve EF for adolescents. The aims of the current study were to develop an individually-tailored intervention, called Epilepsy Journey, to improve aspects of EF through an iterative, patient-centered process including focus groups and usability testing. Five adolescents and caregivers participated in focus groups. This input was used to develop ten learning modules based on subscales of the Behavioral Rating Inventory of Executive Functions and key issues that may impact EF in adolescents. Six adolescents participated in usability testing and a usability expert conducted a heuristic evaluation. Demographic information, chart reviews and measures of EF were also completed. Focus group participants and their parents reported difficulties with memory, attention, organization, monitoring, initiation, impulsivity, emotional control, sleep, awareness in schools and managing stress. They also identified successful strategies to address memory and organizational difficulties. Usability testing of the resultant Epilepsy Journey modules revealed problems with navigation and identified features that promoted usability, including progress bars and interactive modules. Program modifications were made after each usability trial resulting in a relatively brief, interactive and readily navigable program. Perceived utility was high with all but one participant. Participants rated the content as helpful and indicated they would recommend Epilepsy Journey to others. Feedback from the focus group and usability testing yielded a feasible, acceptable, relevant and user-friendly web-based intervention for adolescents with epilepsy. The Epilepsy Journey program will be further tested in an open pilot with adolescents with epilepsy and associated EF deficits. Copyright © 2017 Elsevier Inc. All rights reserved.

Mobile Phone Apps for Smoking Cessation: Quality and Usability Among Smokers With Psychosis.

PubMed

Ferron, Joelle C; Brunette, Mary F; Geiger, Pamela; Marsch, Lisa A; Adachi-Mejia, Anna M; Bartels, Stephen J

2017-03-03

Smoking is one of the top preventable causes of mortality in people with psychotic disorders such as schizophrenia. Cessation treatment improves abstinence outcomes, but access is a barrier. Mobile phone apps are one way to increase access to cessation treatment; however, whether they are usable by people with psychotic disorders, who often have special learning needs, is not known. Researchers reviewed 100 randomly selected apps for smoking cessation to rate them based on US guidelines for nicotine addiction treatment and to categorize them based on app functions. We aimed to test the usability and usefulness of the top-rated apps in 21 smokers with psychotic disorders. We identified 766 smoking cessation apps and randomly selected 100 for review. Two independent reviewers rated each app with the Adherence Index to US Clinical Practice Guideline for Treating Tobacco Use and Dependence. Then, smokers with psychotic disorders evaluated the top 9 apps within a usability testing protocol. We analyzed quantitative results using descriptive statistics and t tests. Qualitative data were open-coded and analyzed for themes. Regarding adherence to practice guidelines, most of the randomly sampled smoking cessation apps scored poorly-66% rated lower than 10 out of 100 on the Adherence Index (Mean 11.47, SD 11.8). Regarding usability, three common usability problems emerged: text-dense content, abstract symbols on the homepage, and subtle directions to edit features. In order for apps to be effective and usable for this population, developers should utilize a balance of text and simple design that facilitate ease of navigation and content comprehension that will help people learn quit smoking skills. ©Joelle C Ferron, Mary F Brunette, Pamela Geiger, Lisa A Marsch, Anna M Adachi-Mejia, Stephen J Bartels. Originally published in JMIR Human Factors (http://humanfactors.jmir.org), 03.03.2017.

Mobile Phone Apps for Smoking Cessation: Quality and Usability Among Smokers With Psychosis

PubMed Central

Brunette, Mary F; Geiger, Pamela; Marsch, Lisa A; Adachi-Mejia, Anna M; Bartels, Stephen J

2017-01-01

Background Smoking is one of the top preventable causes of mortality in people with psychotic disorders such as schizophrenia. Cessation treatment improves abstinence outcomes, but access is a barrier. Mobile phone apps are one way to increase access to cessation treatment; however, whether they are usable by people with psychotic disorders, who often have special learning needs, is not known. Objective Researchers reviewed 100 randomly selected apps for smoking cessation to rate them based on US guidelines for nicotine addiction treatment and to categorize them based on app functions. We aimed to test the usability and usefulness of the top-rated apps in 21 smokers with psychotic disorders. Methods We identified 766 smoking cessation apps and randomly selected 100 for review. Two independent reviewers rated each app with the Adherence Index to US Clinical Practice Guideline for Treating Tobacco Use and Dependence. Then, smokers with psychotic disorders evaluated the top 9 apps within a usability testing protocol. We analyzed quantitative results using descriptive statistics and t tests. Qualitative data were open-coded and analyzed for themes. Results Regarding adherence to practice guidelines, most of the randomly sampled smoking cessation apps scored poorly—66% rated lower than 10 out of 100 on the Adherence Index (Mean 11.47, SD 11.8). Regarding usability, three common usability problems emerged: text-dense content, abstract symbols on the homepage, and subtle directions to edit features. Conclusions In order for apps to be effective and usable for this population, developers should utilize a balance of text and simple design that facilitate ease of navigation and content comprehension that will help people learn quit smoking skills. PMID:28258047

Sociotechnical Human Factors Involved in Remote Online Usability Testing of Two eHealth Interventions.

PubMed

Wozney, Lori M; Baxter, Pamela; Fast, Hilary; Cleghorn, Laura; Hundert, Amos S; Newton, Amanda S

2016-02-03

Research in the fields of human performance technology and human computer interaction are challenging the traditional macro focus of usability testing arguing for methods that help test moderators assess "use in context" (ie, cognitive skills, usability understood over time) and in authentic "real world" settings. Human factors in these complex test scenarios may impact on the quality of usability results being derived yet there is a lack of research detailing moderator experiences in these test environments. Most comparative research has focused on the impact of the physical environment on results, and rarely on how the sociotechnical elements of the test environment affect moderator and test user performance. Improving our understanding of moderator roles and experiences with conducting "real world" usability testing can lead to improved techniques and strategies To understand moderator experiences of using Web-conferencing software to conduct remote usability testing of 2 eHealth interventions. An exploratory case study approach was used to study 4 moderators' experiences using Blackboard Collaborate for remote testing sessions of 2 different eHealth interventions. Data collection involved audio-recording iterative cycles of test sessions, collecting summary notes taken by moderators, and conducting 2 90-minute focus groups via teleconference. A direct content analysis with an inductive coding approach was used to explore personal accounts, assess the credibility of data interpretation, and generate consensus on the thematic structure of the results. Following the convergence of data from the various sources, 3 major themes were identified: (1) moderators experienced and adapted to unpredictable changes in cognitive load during testing; (2) moderators experienced challenges in creating and sustaining social presence and untangling dialogue; and (3) moderators experienced diverse technical demands, but were able to collaboratively troubleshoot with test users. Results highlight important human-computer interactions and human factor qualities that impact usability testing processes. Moderators need an advanced skill and knowledge set to address the social interaction aspects of Web-based usability testing and technical aspects of conferencing software during test sessions. Findings from moderator-focused studies can inform the design of remote testing platforms and real-time usability evaluation processes that place less cognitive burden on moderators and test users.

Evaluating the usability of speech recognition to create clinical documentation using a commercial electronic health record.

PubMed

Hodgson, Tobias; Magrabi, Farah; Coiera, Enrico

2018-05-01

To conduct a usability study exploring the value of using speech recognition (SR) for clinical documentation tasks within an electronic health record (EHR) system. Thirty-five emergency department clinicians completed a system usability scale (SUS) questionnaire. The study was undertaken after participants undertook randomly allocated clinical documentation tasks using keyboard and mouse (KBM) or SR. SUS scores were analyzed and the results with KBM were compared to SR results. Significant difference in SUS scores between EHR system use with and without SR were observed (KBM 67, SR 61; P = 0.045; CI, 0.1 to 12.0). Nineteen of 35 participants scored higher for EHR with KBM, 11 higher for EHR with SR and 5 gave the same score for both. Factor analysis showed no significant difference in scores for the sub-element of usability (EHR with KBM 65, EHR with SR 62; P = 0.255; CI, -2.6 to 9.5). Scores for the sub-element of learnability were significantly different (KBM 72, SR 55; P < 0.001; CI, 9.8 to 23.5). A significant correlation was found between the perceived usability of the two system configurations (EHR with KBM or SR) and the efficiency of documentation (time to document) (P = 0.002; CI, 10.5 to -0.1) but not with safety (number of errors) (P = 0.90; CI, -2.3 to 2.6). SR was associated with significantly reduced overall usability scores, even though it is often positioned as ease of use technology. SR was perceived to impose larger costs in terms of learnability via training and support requirements for EHR based documentation when compared to using KBM. Lower usability scores were significantly associated with longer documentation times. The usability of EHR systems with any input modality is an area that requires continued development. The addition of an SR component to an EHR system may cause a significant reduction in terms of perceived usability by clinicians. Copyright © 2018 Elsevier B.V. All rights reserved.

An investigation of the efficacy of collaborative virtual reality systems for moderated remote usability testing.

PubMed

Chalil Madathil, Kapil; Greenstein, Joel S

2017-11-01

Collaborative virtual reality-based systems have integrated high fidelity voice-based communication, immersive audio and screen-sharing tools into virtual environments. Such three-dimensional collaborative virtual environments can mirror the collaboration among usability test participants and facilitators when they are physically collocated, potentially enabling moderated usability tests to be conducted effectively when the facilitator and participant are located in different places. We developed a virtual collaborative three-dimensional remote moderated usability testing laboratory and employed it in a controlled study to evaluate the effectiveness of moderated usability testing in a collaborative virtual reality-based environment with two other moderated usability testing methods: the traditional lab approach and Cisco WebEx, a web-based conferencing and screen sharing approach. Using a mixed methods experimental design, 36 test participants and 12 test facilitators were asked to complete representative tasks on a simulated online shopping website. The dependent variables included the time taken to complete the tasks; the usability defects identified and their severity; and the subjective ratings on the workload index, presence and satisfaction questionnaires. Remote moderated usability testing methodology using a collaborative virtual reality system performed similarly in terms of the total number of defects identified, the number of high severity defects identified and the time taken to complete the tasks with the other two methodologies. The overall workload experienced by the test participants and facilitators was the least with the traditional lab condition. No significant differences were identified for the workload experienced with the virtual reality and the WebEx conditions. However, test participants experienced greater involvement and a more immersive experience in the virtual environment than in the WebEx condition. The ratings for the virtual environment condition were not significantly different from those for the traditional lab condition. The results of this study suggest that participants were productive and enjoyed the virtual lab condition, indicating the potential of a virtual world based approach as an alternative to conventional approaches for synchronous usability testing. Copyright © 2017 Elsevier Ltd. All rights reserved.

Signal functions for emergency obstetric care as an intervention for reducing maternal mortality: a survey of public and private health facilities in Lusaka District, Zambia.

PubMed

Tembo, Tannia; Chongwe, Gershom; Vwalika, Bellington; Sitali, Lungowe

2017-09-06

Zambia's maternal mortality ratio was estimated at 398/100,000 live births in 2014. Successful aversion of deaths is dependent on availability and usability of signal functions for emergency obstetric and neonatal care. Evidence of availability, usability and quality of signal functions in urban settings in Zambia is minimal as previous research has evaluated their distribution in rural settings. This survey evaluated the availability and usability of signal functions in private and public health facilities in Lusaka District of Zambia. A descriptive cross sectional study was conducted between November 2014 and February 2015 at 35 public and private health facilities. The Service Availability and Readiness Assessment tool was adapted and administered to overall in-charges, hospital administrators or maternity ward supervisors at health facilities providing maternal and newborn health services. The survey quantified infrastructure, human resources, equipment, essential drugs and supplies and used the UN process indicators to determine availability, accessibility and quality of signal functions. Data on deliveries and complications were collected from registers for periods between June 2013 and May 2014. Of the 35 (25.7% private and 74.2% public) health facilities assessed, only 22 (62.8%) were staffed 24 h a day, 7 days a week and had provided obstetric care 3 months prior to the survey. Pre-eclampsia/ eclampsia and obstructed labor accounted for most direct complications while postpartum hemorrhage was the leading cause of maternal deaths. Overall, 3 (8.6%) and 5 (14.3%) of the health facilities had provided Basic and Comprehensive EmONC services, respectively. All facilities obtained blood products from the only blood bank at a government referral hospital. The UN process indicators can be adequately used to monitor progress towards maternal mortality reduction. Lusaka district had an unmet need for BEmONC as health facilities fell below the minimum UN standard. Public health facilities with capacity to perform signal functions should be upgraded to Basic EmONC status. Efforts must focus on enhancing human resource capacity in EmONC and improving infrastructure and supply chain. Obstetric health needs and international trends must drive policy change.

Usability testing of ANSWER: a web-based methotrexate decision aid for patients with rheumatoid arthritis

PubMed Central

2013-01-01

Background Decision aids are evidence-based tools designed to inform people of the potential benefit and harm of treatment options, clarify their preferences and provide a shared decision-making structure for discussion at a clinic visit. For patients with rheumatoid arthritis (RA) who are considering methotrexate, we have developed a web-based patient decision aid called the ANSWER (Animated, Self-serve, Web-based Research Tool). This study aimed to: 1) assess the usability of the ANSWER prototype; 2) identify strengths and limitations of the ANSWER from the patient’s perspective. Methods The ANSWER prototype consisted of: 1) six animated patient stories and narrated information on the evidence of methotrexate for RA; 2) interactive questionnaires to clarify patients’ treatment preferences. Eligible participants for the usability test were patients with RA who had been prescribed methotrexate. They were asked to verbalize their thoughts (i.e., think aloud) while using the ANSWER, and to complete the System Usability Scale (SUS) to assess overall usability (range = 0-100; higher = more user friendly). Participants were audiotaped and observed, and field notes were taken. The testing continued until no new modifiable issues were found. We used descriptive statistics to summarize participant characteristics and the SUS scores. Content analysis was used to identified usability issues and navigation problems. Results 15 patients participated in the usability testing. The majority were aged 50 or over and were university/college graduates (n = 8, 53.4%). On average they took 56 minutes (SD = 34.8) to complete the tool. The mean SUS score was 81.2 (SD = 13.5). Content analysis of audiotapes and field notes revealed four categories of modifiable usability issues: 1) information delivery (i.e., clarity of the information and presentation style); 2) navigation control (i.e., difficulties in recognizing and using the navigation control buttons); 3) layout (i.e., position of the videos, text, diagrams and navigation buttons); 4) aesthetic (i.e., the colour, look and feel of the online tool). Conclusions Although the SUS score indicated high usability before and after major modification, findings from the think-aloud sessions illustrated areas that required further refinement. Our results highlight the importance of formative evaluation in usability testing. PMID:24289731

Usability testing of ANSWER: a web-based methotrexate decision aid for patients with rheumatoid arthritis.

PubMed

Li, Linda C; Adam, Paul M; Townsend, Anne F; Lacaille, Diane; Yousefi, Charlene; Stacey, Dawn; Gromala, Diane; Shaw, Chris D; Tugwell, Peter; Backman, Catherine L

2013-12-01

Decision aids are evidence-based tools designed to inform people of the potential benefit and harm of treatment options, clarify their preferences and provide a shared decision-making structure for discussion at a clinic visit. For patients with rheumatoid arthritis (RA) who are considering methotrexate, we have developed a web-based patient decision aid called the ANSWER (Animated, Self-serve, Web-based Research Tool). This study aimed to: 1) assess the usability of the ANSWER prototype; 2) identify strengths and limitations of the ANSWER from the patient's perspective. The ANSWER prototype consisted of: 1) six animated patient stories and narrated information on the evidence of methotrexate for RA; 2) interactive questionnaires to clarify patients' treatment preferences. Eligible participants for the usability test were patients with RA who had been prescribed methotrexate. They were asked to verbalize their thoughts (i.e., think aloud) while using the ANSWER, and to complete the System Usability Scale (SUS) to assess overall usability (range = 0-100; higher = more user friendly). Participants were audiotaped and observed, and field notes were taken. The testing continued until no new modifiable issues were found. We used descriptive statistics to summarize participant characteristics and the SUS scores. Content analysis was used to identified usability issues and navigation problems. 15 patients participated in the usability testing. The majority were aged 50 or over and were university/college graduates (n = 8, 53.4%). On average they took 56 minutes (SD = 34.8) to complete the tool. The mean SUS score was 81.2 (SD = 13.5). Content analysis of audiotapes and field notes revealed four categories of modifiable usability issues: 1) information delivery (i.e., clarity of the information and presentation style); 2) navigation control (i.e., difficulties in recognizing and using the navigation control buttons); 3) layout (i.e., position of the videos, text, diagrams and navigation buttons); 4) aesthetic (i.e., the colour, look and feel of the online tool). Although the SUS score indicated high usability before and after major modification, findings from the think-aloud sessions illustrated areas that required further refinement. Our results highlight the importance of formative evaluation in usability testing.

Multi-method laboratory user evaluation of an actionable clinical performance information system: Implications for usability and patient safety.

PubMed

Brown, Benjamin; Balatsoukas, Panos; Williams, Richard; Sperrin, Matthew; Buchan, Iain

2018-01-01

Electronic audit and feedback (e-A&F) systems are used worldwide for care quality improvement. They measure health professionals' performance against clinical guidelines, and some systems suggest improvement actions. However, little is known about optimal interface designs for e-A&F, in particular how to present suggested actions for improvement. We developed a novel theory-informed system for primary care (the Performance Improvement plaN GeneratoR; PINGR) that covers the four principal interface components: clinical performance summaries; patient lists; detailed patient-level information; and suggested actions. As far as we are aware, this is the first report of an e-A&F system with all four interface components. (1) Use a combination of quantitative and qualitative methods to evaluate the usability of PINGR with target end-users; (2) refine existing design recommendations for e-A&F systems; (3) determine the implications of these recommendations for patient safety. We recruited seven primary care physicians to perform seven tasks with PINGR, during which we measured on-screen behaviour and eye movements. Participants subsequently completed usability questionnaires, and were interviewed in-depth. Data were integrated to: gain a more complete understanding of usability issues; enhance and explain each other's findings; and triangulate results to increase validity. Participants committed a median of 10 errors (range 8-21) when using PINGR's interface, and completed a median of five out of seven tasks (range 4-7). Errors violated six usability heuristics: clear response options; perceptual grouping and data relationships; representational formats; unambiguous description; visually distinct screens for confusable items; and workflow integration. Eye movement analysis revealed the integration of components largely supported effective user workflow, although the modular design of clinical performance summaries unnecessarily increased cognitive load. Interviews and questionnaires revealed PINGR is user-friendly, and that improved information prioritisation could further promote useful user action. Comparing our results with the wider usability literature we refine a previously published set of interface design recommendations for e-A&F. The implications for patient safety are significant regarding: user engagement; actionability; and information prioritisation. Our results also support adopting multi-method approaches in usability studies to maximise issue discovery and the credibility of findings. Copyright © 2017 The Authors. Published by Elsevier Inc. All rights reserved.

Training veterinarians and agricultural advisers on a novel tool for tail biting prevention.

PubMed

Vom Brocke, A L; Madey, D P; Gauly, M; Schrader, L; Dippel, S

2015-01-01

Many health and welfare problems in modern livestock production are multifactorial problems which require innovative solutions, such as novel risk assessment and management tools. However, the best way to distribute such novel - and usually complex - tools to the key applicants still has to be discussed. This paper shares experiences from distributing a novel tail biting prevention tool ('SchwIP') to 115 farm advisers and 19 veterinarians in 23 one-day workshops. Participants gave written and oral feedback at the end of the workshops, which was later analysed together with the number of farms they had visited after the workshops. Workshop groups were categorised into groups showing (a) HIGH, (b) INTermediate or (c) LOW levels of antagonism against SchwIP or parts of it during workshop discussions. Group types did not significantly differ in their evaluation of knowledge transfer. However, HIGH group members evaluated the on-farm usability of the tool significantly lower in the workshop feedback and tended to visit fewer farms. As antagonistic discussion can influence workshop output, future workshop leaders should strive for basic communication training as well as some group leadership experience before setting up and leading workshops.

Naive (commonsense) geography and geobrowser usability after ten years of Google Earth

NASA Astrophysics Data System (ADS)

Hamerlinck, J. D.

2016-04-01

In 1995, the concept of ‘naive geography’ was formally introduced as an area of cognitive geographic information science representing ‘the body of knowledge that people have about the surrounding geographic world’ and reflecting ‘the way people think and reason about geographic space and time, both consciously and subconsciously’. The need to incorporate such commonsense knowledge and reasoning into design of geospatial technologies was identified but faced challenges in formalizing these relationships and processes in software implementation. Ten years later, the Google Earth geobrowser was released, marking the beginning of a new era of open access to, and application of, geographic data and information in society. Fast-forward to today, and the opportunity presents itself to take stock of twenty years of naive geography and a decade of the ubiquitous virtual globe. This paper introduces an ongoing research effort to explore the integration of naive (or commonsense) geography concepts in the Google Earth geobrowser virtual globe and their possible impact on Google Earth's usability, utility, and usefulness. A multi-phase methodology is described, combining usability reviews and usability testing with use-case scenarios involving the U.S.-Canadian Yellowstone to Yukon Initiative. Initial progress on a usability review combining cognitive walkthroughs and heuristics evaluation is presented.

Usability study of youtube websites for Malaysian teenagers

NASA Astrophysics Data System (ADS)

Razak, Mohd Nur Faiz Abd; Hussain, Azham; Hamdi, Mohd Maizan Fishol

2017-10-01

Nowadays, YouTube is the 3rd most visited website in the world. It was created for users to search, watch and share video. Statistics show that YouTube run in more than 88 countries and support 76 different languages which covered almost 95% of Internet population globally. Therefore, a usability study is for specific type of users such as based on gender, range of age and country is considered a must for this kind of top website. In this study, we focus on YouTube website usability for Malaysian teenagers that are currently schooling in boarding school with limited access of Internet. It was done in a controlled lab environment with proper devices and software as MacBook, LCD Monitor, and WhatPulse heat map tracker. The evaluation was made based on usability metrics: ease of use, usefulness and satisfaction of users with combination of recording videos, mouse and keyboard heat map and questionnaires. Findings show that most of the respondents just use YouTube for video watching only while ignoring other features in the same time. There are difficulties in using it at the first moment but could catch up in short time. It shows how usable YouTube website especially in the learnability and memorability aspects.

Identification of the heart wall and chamber based on temporal change of ultrasonic scatterer distribution

NASA Astrophysics Data System (ADS)

Takahashi, Kohei; Taki, Hirofumi; Kanai, Hiroshi

2017-07-01

In most current methods for evaluating the cardiac function by ultrasound, the heart wall area is identified manually by an examiner. To eliminate examiner dependence and to improve usability, an automatic heart wall identification method is desirable. Identification based on only echogenicity often fails because of low echogenicity of some areas of the heart wall. In the present study, to determine more essential features, we focused on the relative temporal change of ultrasonic scatterer distribution and proposed three features for identification of the heart wall and the chamber: cross-correlation of RF signals, that of envelopes, and spatial dispersion of movement vectors in small regions. In an in vivo experiment, using echogenicity and the three features, we identified the heart wall and the chamber in the left ventricular long-axis view, resulting in criteria of separability J of 1.69, 1.40, and 3.02 using these features compared with the result of 0.979 using echogenicity.

Usability testing of Avoiding Diabetes Thru Action Plan Targeting (ADAPT) decision support for integrating care-based counseling of pre-diabetes in an electronic health record

PubMed Central

Chrimes, Dillon; Kushniruk, Andre; Kitos, Nicole R.

2014-01-01

Purpose Usability testing can be used to evaluate human computer interaction (HCI) and communication in shared decision making (SDM) for patient-provider behavioral change and behavioral contracting. Traditional evaluations of usability using scripted or mock patient scenarios with think-aloud protocol analysis provide a to identify HCI issues. In this paper we describe the application of these methods in the evaluation of the Avoiding Diabetes Thru Action Plan Targeting (ADAPT) tool, and test the usability of the tool to support the ADAPT framework for integrated care counseling of pre-diabetes. The think-aloud protocol analysis typically does not provide an assessment of how patient-provider interactions are effected in “live” clinical workflow or whether a tool is successful. Therefore, “Near-live” clinical simulations involving applied simulation methods were used to compliment the think-aloud results. This complementary usability technique was used to test the end-user HCI and tool performance by more closely mimicking the clinical workflow and capturing interaction sequences along with assessing the functionality of computer module prototypes on clinician workflow. We expected this method to further complement and provide different usability findings as compared to think-aloud analysis. Together, this mixed method evaluation provided comprehensive and realistic feedback for iterative refinement of the ADAPT system prior to implementation. Methods The study employed two phases of testing of a new interactive ADAPT tool that embedded an evidence-based shared goal setting component into primary care workflow for dealing with pre-diabetes counseling within a commercial physician office electronic health record (EHR). Phase I applied usability testing that involved “think-aloud” protocol analysis of 8 primary care providers interacting with several scripted clinical scenarios. Phase II used “near-live” clinical simulations of 5 providers interacting with standardized trained patient actors enacting the clinical scenario of counseling for pre-diabetes, each of whom had a pedometer that recorded the number of steps taken over a week. In both phases, all sessions were audio-taped and motion screen-capture software was activated for onscreen recordings. Transcripts were coded using iterative qualitative content analysis methods. Results In Phase I, the impact of the components and layout of ADAPT on user’s Navigation, Understandability, and Workflow were associated with the largest volume of negative comments (i.e. approximately 80% of end-user commentary), while Usability and Content of ADAPT were representative of more positive than negative user commentary. The heuristic category of Usability had a positive-to-negative comment ratio of 2.1, reflecting positive perception of the usability of the tool, its functionality, and overall co-productive utilization of ADAPT. However, there were mixed perceptions about content (i.e., how the information was displayed, organized and described in the tool). In Phase II, the duration of patient encounters was approximately 10 minutes with all of the Patient Instructions (prescriptions) and behavioral contracting being activated at the end of each visit. Upon activation, providers accepted the pathway prescribed by the tool 100% of the time and completed all the fields in the tool in the simulation cases. Only 14% of encounter time was spent using the functionality of the ADAPT tool in terms of keystrokes and entering relevant data. The rest of the time was spent on communication and dialogue to populate the patient instructions. In all cases, the interaction sequence of reviewing and discussing exercise and diet of the patient was linked to the functionality of the ADAPT tool in terms of monitoring, response-efficacy, self-efficacy, and negotiation in the patient-provider dialogue. There was a change from one-way dialogue to two-way dialogue and negotiation that ended in a behavioral contract. This change demonstrated the tool’s sequence, which supported recording current exercise and diet followed by a diet and exercise goal setting procedure to reduce the risk of diabetes onset. Conclusions This study demonstrated that “think-aloud” protocol analysis with “near-live” clinical simulations provided a successful usability evaluation of a new primary care pre-diabetes shared goal setting tool. Each phase of the study provided complementary observations on problems with the new onscreen tool and was used to show the influence of the ADAPT framework on the usability, workflow integration, and communication between the patient and provider. The think-aloud tests with the provider showed the tool can be used according to the ADAPT framework (exercise-to-diet behavior change and tool utilization), while the clinical simulations revealed the ADAPT framework to realistically support patient-provider communication to obtain behavioral change contract. SDM interactions and mechanisms affecting protocol-based care can be more completely captured by combining “near-live” clinical simulations with traditional “think-aloud analysis” which augments clinician utilization. More analysis is required to verify if the rich communication actions found in Phase II compliment clinical workflows. PMID:24981988

Usability testing of Avoiding Diabetes Thru Action Plan Targeting (ADAPT) decision support for integrating care-based counseling of pre-diabetes in an electronic health record.

PubMed

Chrimes, Dillon; Kitos, Nicole R; Kushniruk, Andre; Mann, Devin M

2014-09-01

Usability testing can be used to evaluate human-computer interaction (HCI) and communication in shared decision making (SDM) for patient-provider behavioral change and behavioral contracting. Traditional evaluations of usability using scripted or mock patient scenarios with think-aloud protocol analysis provide a way to identify HCI issues. In this paper we describe the application of these methods in the evaluation of the Avoiding Diabetes Thru Action Plan Targeting (ADAPT) tool, and test the usability of the tool to support the ADAPT framework for integrated care counseling of pre-diabetes. The think-aloud protocol analysis typically does not provide an assessment of how patient-provider interactions are effected in "live" clinical workflow or whether a tool is successful. Therefore, "Near-live" clinical simulations involving applied simulation methods were used to compliment the think-aloud results. This complementary usability technique was used to test the end-user HCI and tool performance by more closely mimicking the clinical workflow and capturing interaction sequences along with assessing the functionality of computer module prototypes on clinician workflow. We expected this method to further complement and provide different usability findings as compared to think-aloud analysis. Together, this mixed method evaluation provided comprehensive and realistic feedback for iterative refinement of the ADAPT system prior to implementation. The study employed two phases of testing of a new interactive ADAPT tool that embedded an evidence-based shared goal setting component into primary care workflow for dealing with pre-diabetes counseling within a commercial physician office electronic health record (EHR). Phase I applied usability testing that involved "think-aloud" protocol analysis of eight primary care providers interacting with several scripted clinical scenarios. Phase II used "near-live" clinical simulations of five providers interacting with standardized trained patient actors enacting the clinical scenario of counseling for pre-diabetes, each of whom had a pedometer that recorded the number of steps taken over a week. In both phases, all sessions were audio-taped and motion screen-capture software was activated for onscreen recordings. Transcripts were coded using iterative qualitative content analysis methods. In Phase I, the impact of the components and layout of ADAPT on user's Navigation, Understandability, and Workflow were associated with the largest volume of negative comments (i.e. approximately 80% of end-user commentary), while Usability and Content of ADAPT were representative of more positive than negative user commentary. The heuristic category of Usability had a positive-to-negative comment ratio of 2.1, reflecting positive perception of the usability of the tool, its functionality, and overall co-productive utilization of ADAPT. However, there were mixed perceptions about content (i.e., how the information was displayed, organized and described in the tool). In Phase II, the duration of patient encounters was approximately 10 min with all of the Patient Instructions (prescriptions) and behavioral contracting being activated at the end of each visit. Upon activation, providers accepted the pathway prescribed by the tool 100% of the time and completed all the fields in the tool in the simulation cases. Only 14% of encounter time was spent using the functionality of the ADAPT tool in terms of keystrokes and entering relevant data. The rest of the time was spent on communication and dialog to populate the patient instructions. In all cases, the interaction sequence of reviewing and discussing exercise and diet of the patient was linked to the functionality of the ADAPT tool in terms of monitoring, response-efficacy, self-efficacy, and negotiation in the patient-provider dialog. There was a change from one-way dialog to two-way dialog and negotiation that ended in a behavioral contract. This change demonstrated the tool's sequence, which supported recording current exercise and diet followed by a diet and exercise goal setting procedure to reduce the risk of diabetes onset. This study demonstrated that "think-aloud" protocol analysis with "near-live" clinical simulations provided a successful usability evaluation of a new primary care pre-diabetes shared goal setting tool. Each phase of the study provided complementary observations on problems with the new onscreen tool and was used to show the influence of the ADAPT framework on the usability, workflow integration, and communication between the patient and provider. The think-aloud tests with the provider showed the tool can be used according to the ADAPT framework (exercise-to-diet behavior change and tool utilization), while the clinical simulations revealed the ADAPT framework to realistically support patient-provider communication to obtain behavioral change contract. SDM interactions and mechanisms affecting protocol-based care can be more completely captured by combining "near-live" clinical simulations with traditional "think-aloud analysis" which augments clinician utilization. More analysis is required to verify if the rich communication actions found in Phase II compliment clinical workflows. Copyright © 2014 Elsevier Ireland Ltd. All rights reserved.

The State perspective.

PubMed

Lipton, D S; Appel, P

1984-01-01

Our survey showed that State agencies make use of NIDA materials of all sorts, including NIDA treatment evaluation materials. A majority of the respondents indicated that NIDA treatment evaluation materials were among the most useful of its products; most frequently mentioned was DARP, then Nurco's and Robins' work, and TOPS. That DARP was most frequently mentioned is not a contradiction, since the responses were stated in a general sense, not in terms of a specific report or material. In the past 1 to 2 years, many State drug abuse agency budgets have been substantially reduced due to declines in Federal funding. As a result, treatment evaluation reports and related materials are viewed somewhat differently than they were in the past. The fiscal climate in various States may thus be another factor contributing to the greater familarity and reported use of reports such as DAWN, CODAP, and case management and monitoring manuals published by NIDA. A number of suggestions were made about the kinds of evaluation materials needed by States. It was generally agreed that attempts should be made to produce treatment evaluation findings/new knowledge in a format where it would be more accessible to administrators (e.g., "how-to" manuals, evaluation case studies, dissemination of treatment evaluation bibliographies) and should assist in making existing treatment evaluation results more accessible (divide results for modalities into subtypes, provide data on the effectiveness of specific interventions with specific conditions, diversify the settings of programs in which evaluations are done, etc.). The theme of these various suggestions is to make evaluations more available, usable, and specific, especially now in view of the reduced ability of many States to carry on their own evaluation activities. The general sense of the respondents regarding dissemination was that right now, in view of other problems such as the financial crunch, NIDA's system of distribution cannot be a salient concern. Nevertheless, from a State perspective, NIDA's dissemination of treatment evaluation materials is particularly important in the light of the paucity of resources States have to conduct their own research. Thus, having access to NIDA's usable evaluation data is all the more crucial to improving service delivery and its cost effectiveness. Another factor to bear in mind at the present time is the absence of opportunities to share evaluation results at national conferences which formerly were, of course, major mechanisms for formal dissemination.

Usability factors of mobile health application for chronic diseases

NASA Astrophysics Data System (ADS)

Zahra, Fatima; Hussain, Azham; Mohd, Haslina

2016-08-01

M-health has changed the conventional delivery system of health-care, permitting continuous, pervasive Health-care anywhere, anytime. Chronic disease apps are increasing, as many health workers, patients and clinicians already embracing smartphones in their comprehensive and diverse practices. There are lots of challenges and requirements that need to be addressed for mobile health applications to prevent or eliminate design problems and minimize potential threats for users, the proposed factors for chronic disease mobile applications can be used as a guide for app developers While, the usability testing, and evaluations of chronic disease apps have not yet touched the accuracy level of other web based applications. This study is being conducted to learn about challenges of m-health apps and to identify the factors that affect the usability of such applications.

A Serious Game for Teaching Nursing Students Clinical Reasoning and Decision-Making Skills.

PubMed

Johnsen, Hege Mari; Fossum, Mariann; Vivekananda-Schmidt, Pirashanthie; Fruhling, Ann; Slettebø, Åshild

2016-01-01

The aim of this study was to design and pilot-test a serious game for teaching nursing students clinical reasoning and decision-making skills in caring for patients with chronic obstructive pulmonary disease. A video-based serious game prototype was developed. A purposeful sample of six participants tested and evaluated the prototype. Usability issues were identified regarding functionality and user-computer interface. However, overall the serious game was perceived to be useful, usable and likable to use.

The Software Therapist: Usability Problem Diagnosis Through Latent Semantic Analysis

DTIC Science & Technology

2006-06-14

at a given level is equivalent to removing attributes that don’t apply to a given usability situation, thereby filtering or pruning off irrelevant sub...Each answer prunes the number of stages remaining. Through a process of elimination, the Wizard helps evaluators home in on the correct stage...the diagnosis for one problem report, the user may want to take a break to get a cup of coffee or take a short walk, but when ready to continue with

Usability testing in medical informatics: cognitive approaches to evaluation of information systems and user interfaces.

PubMed Central

Kushniruk, A. W.; Patel, V. L.; Cimino, J. J.

1997-01-01

This paper describes an approach to the evaluation of health care information technologies based on usability engineering and a methodological framework from the study of medical cognition. The approach involves collection of a rich set of data including video recording of health care workers as they interact with systems, such as computerized patient records and decision support tools. The methodology can be applied in the laboratory setting, typically involving subjects "thinking aloud" as they interact with a system. A similar approach to data collection and analysis can also be extended to study of computer systems in the "live" environment of hospital clinics. Our approach is also influenced from work in the area of cognitive task analysis, which aims to characterize the decision making and reasoning of subjects of varied levels of expertise as they interact with information technology in carrying out representative tasks. The stages involved in conducting cognitively-based usability analyses are detailed and the application of such analysis in the iterative process of system and interface development is discussed. PMID:9357620

Development of a Teen-Friendly Health Education Program on Facebook: Lessons Learned.

PubMed

Park, Bu Kyung; Nahm, Eun-Shim; Rogers, Valerie E

2016-01-01

Facebook is the most popular online platform among adolescents and can be an effective medium to deliver health education. Although Korean American (KA) adolescents are at risk of obesity, a culturally tailored health education program is not available for them. Thus, our research team developed a health education program for KA adolescents on Facebook called "Healthy Teens." The aim of this study was to discuss important lessons learned through the program development process. This program includes culturally tailored learning modules about healthy eating and physical activity. The program was developed on the basis of the social cognitive theory, and the online program was developed by applying Web usability principles for adolescents. Upon completion, the usability of the program was assessed using heuristic evaluation. The findings from the heuristic evaluation showed that the Healthy Teens program was usable for KA adolescents. The findings from this study will assist researchers who are planning to build similar Facebook-based health education programs. Copyright © 2016 National Association of Pediatric Nurse Practitioners. Published by Elsevier Inc. All rights reserved.

Implementation and evaluation of LMS mobile application: scele mobile based on user-centered design

NASA Astrophysics Data System (ADS)

Banimahendra, R. D.; Santoso, H. B.

2018-03-01

The development of mobile technology is now increasing rapidly, demanding all activities including learning should be done on mobile devices. It shows that the implementation of mobile application as a learning medium needs to be done. This study describes the process of developing and evaluating the Moodle-based mobile Learning Management System (LMS) application called Student Centered e-Learning Environment (SCeLE). This study discusses the process of defining features, implementing features into the application, and evaluating the application. We define the features using user research and literature study, then we implement the application with user-centered design basis, at the last phase we evaluated the application using usability testing and system usability score (SUS). The purpose of this study is to determine the extent to which this application can help the users doing their tasks and provide recommendation for the next research and development.

A combined disease management and process modeling approach for assessing and improving care processes: a fall management case-study.

PubMed

Askari, Marjan; Westerhof, Richard; Eslami, Saied; Medlock, Stephanie; de Rooij, Sophia E; Abu-Hanna, Ameen

2013-10-01

To propose a combined disease management and process modeling approach for evaluating and improving care processes, and demonstrate its usability and usefulness in a real-world fall management case study. We identified essential disease management related concepts and mapped them into explicit questions meant to expose areas for improvement in the respective care processes. We applied the disease management oriented questions to a process model of a comprehensive real world fall prevention and treatment program covering primary and secondary care. We relied on interviews and observations to complete the process models, which were captured in UML activity diagrams. A preliminary evaluation of the usability of our approach by gauging the experience of the modeler and an external validator was conducted, and the usefulness of the method was evaluated by gathering feedback from stakeholders at an invitational conference of 75 attendees. The process model of the fall management program was organized around the clinical tasks of case finding, risk profiling, decision making, coordination and interventions. Applying the disease management questions to the process models exposed weaknesses in the process including: absence of program ownership, under-detection of falls in primary care, and lack of efficient communication among stakeholders due to missing awareness about other stakeholders' workflow. The modelers experienced the approach as usable and the attendees of the invitational conference found the analysis results to be valid. The proposed disease management view of process modeling was usable and useful for systematically identifying areas of improvement in a fall management program. Although specifically applied to fall management, we believe our case study is characteristic of various disease management settings, suggesting the wider applicability of the approach. Copyright © 2013 Elsevier Ireland Ltd. All rights reserved.

REAGENTLESS FIELD-USABLE FIXED-SITE AND PORTABLE ANALYZER FOR TRIHALOMETHANE (THM) CONCENTRATIONS IN DRINKING WATER - PHASE I

EPA Science Inventory

Environmental Protection Agency rules stipulate that corrective action be taken for drinking water distribution systems that exceed the maximum contaminant level (MCL) for total Trihalomethanes (TTHMs) 80μg/L.  Real-time, or even periodic, monitoring of drinking water i...

The Federation of Earth Science Information Partners ESIP

NASA Technical Reports Server (NTRS)

Tilmes, Curt

2013-01-01

A broad-based, distributed community of science, data and information technology practitioners. With over 150 member organizations, the ESIP Federation brings together public, academic, commercial, and nongovernmental organizations to share knowledge, expertise, technology and best practices to improve opportunities for increasing access, discovery, integration and usability of Earth science data.

Usability evaluation of in-housed developed ERP system

NASA Astrophysics Data System (ADS)

Faisal, Chaudhry Muhammad Nadeem; Shakeel Faridi, Muhammad; Javed, Zahid

2011-10-01

Enterprise Resource Planning systems are the combination of different business IS (Information System) applications that are designed according to the organization requirements. Generally ERP systems are suffering from complex user interface issues. Recent research shows that there is a need for improvement concerning, the user interface from their perspectives. In order to design the software applications that are easy to use, memorize and apply to new problems, we must know the users philosophy and something about learning, reminiscence and problems solving. The Usability engineering is the only way to study the deeds of users while interacting with ERP (Enterprise Resource & Planning). This paper will focus on the users' experiences view of financial module in ERP system. The HCI research method, explicitly survey questionnaire method was adopted to gather users understanding in order to evaluate the selected modules for in-housed ERP system. The study involved group of users from two industries, the results can not be generalized as a whole. The study was first time successfully applied Usability evaluation on in-housed ERP in local industry (Masood Textile Mills, Interloop Ltd) in Pakistan. The results may hopefully opened-up an area of research and methodology that could provide considerable further benefits to Industry in developments of Industrial information systems.

Developing a useful, user-friendly website for cancer patient follow-up: users' perspectives on ease of access and usefulness.

PubMed

Bartlett, Y K; Selby, D L; Newsham, A; Keding, A; Forman, D; Brown, J; Velikova, G; Wright, P

2012-11-01

UK cancer survival has improved, leading to an increase in review patients and pressure on clinics. Use of the Internet for information exchange between patients and healthcare staff may provide a useful adjunct or alternative to traditional follow-up. This study aimed to develop and evaluate a website for use in follow-up cancer care in terms of usability, feasibility and acceptability. A website was developed and underwent iterative amendment following patient usability testing in focus groups. Patients on follow-up completed a Computer and Internet Usage Questionnaire. Internet users consented to a randomised crossover study to complete paper and online questionnaires, browse the website and participate in a website evaluation interview. Patient website use was tracked. Usability: Website changes were made following patient testing (n= 21). Patients would have liked a 'personalized' website with links to their clinical team, out with the scope of this study. Feasibility: The majority of participants (65%) had Internet access. Age remained a differentiating factor. Acceptability: Final evaluation (n= 103) was positive although many would like to maintain face-to-face hospital contact. User involvement in website design can ensure patient needs are met. A website model for follow-up will suit some patients but others will prefer clinical contact. © 2012 Blackwell Publishing Ltd.

Improving the Interoperability and Usability of NASA Earth Observation Data

NASA Astrophysics Data System (ADS)

Walter, J.; Berrick, S. W.; Murphy, K. J.; Mitchell, A. E.; Tilmes, C.

2014-12-01

NASA's Earth Science Data and Information System Project (ESDIS) is charged with managing, maintaining, and evolving NASA's Earth Observing System Data and Information System (EOSDIS) and is responsible for processing, archiving, and distributing NASA Earth Science data. The system supports a multitude of missions and serves diverse science research and other user communities. While NASA has made, and continues to make, great strides in the discoverability and accessibility of its earth observation data holdings, issues associated with data interoperability and usability still present significant challenges to realizing the full scientific and societal benefits of these data. This concern has been articulated by multiple government agencies, both U.S. and international, as well as other non-governmental organizations around the world. Among these is the White House Office of Science and Technology Policy who, in response, has launched the Big Earth Data Initiative and the Climate Data Initiative to address these concerns for U.S. government agencies. This presentation will describe NASA's approach for addressing data interoperability and usability issues with our earth observation data.

Development and preliminary testing of a web-based, self-help application for disaster-affected families.

PubMed

Yuen, Erica K; Gros, Kirstin; Welsh, Kyleen E; McCauley, Jenna; Resnick, Heidi S; Danielson, Carla K; Price, Matthew; Ruggiero, Kenneth J

2016-09-01

Technology-based self-help interventions have the potential to increase access to evidence-based mental healthcare, especially for families affected by natural disasters. However, development of these interventions is a complex process and poses unique challenges. Usability testing, which assesses the ability of individuals to use an application successfully, can have a significant impact on the quality of a self-help intervention. This article describes (a) the development of a novel web-based multi-module self-help intervention for disaster-affected adolescents and their parents and (b) a mixed-methods formal usability study to evaluate user response. A total of 24 adolescents were observed, videotaped, and interviewed as they used the depressed mood component of the self-help intervention. Quantitative results indicated an above-average user experience, and qualitative analysis identified 120 unique usability issues. We discuss the challenges of developing self-help applications, including design considerations and the value of usability testing in technology-based interventions, as well as our plan for widespread dissemination. © The Author(s) 2015.

Health literacy and usability of clinical trial search engines.

PubMed

Utami, Dina; Bickmore, Timothy W; Barry, Barbara; Paasche-Orlow, Michael K

2014-01-01

Several web-based search engines have been developed to assist individuals to find clinical trials for which they may be interested in volunteering. However, these search engines may be difficult for individuals with low health and computer literacy to navigate. The authors present findings from a usability evaluation of clinical trial search tools with 41 participants across the health and computer literacy spectrum. The study consisted of 3 parts: (a) a usability study of an existing web-based clinical trial search tool; (b) a usability study of a keyword-based clinical trial search tool; and (c) an exploratory study investigating users' information needs when deciding among 2 or more candidate clinical trials. From the first 2 studies, the authors found that users with low health literacy have difficulty forming queries using keywords and have significantly more difficulty using a standard web-based clinical trial search tool compared with users with adequate health literacy. From the third study, the authors identified the search factors most important to individuals searching for clinical trials and how these varied by health literacy level.

Evaluating the Usability of Pinchigator, a system for Navigating Virtual Worlds using Pinch Gloves

NASA Technical Reports Server (NTRS)

Hamilton, George S.; Brookman, Stephen; Dumas, Joseph D. II; Tilghman, Neal

2003-01-01

Appropriate design of two dimensional user interfaces (2D U/I) utilizing the well known WIMP (Window, Icon, Menu, Pointing device) environment for computer software is well studied and guidance can be found in several standards. Three-dimensional U/I design is not nearly so mature as 2D U/I, and standards bodies have not reached consensus on what makes a usable interface. This is especially true when the tools for interacting with the virtual environment may include stereo viewing, real time trackers and pinch gloves instead of just a mouse & keyboard. Over the last several years the authors have created a 3D U/I system dubbed Pinchigator for navigating virtual worlds based on the dVise dV/Mockup visualization software, Fakespace Pinch Gloves and Pohlemus trackers. The current work is to test the usability of the system on several virtual worlds, suggest improvements to increase Pinchigator s usability, and then to generalize about what was learned and how those lessons might be applied to improve other 3D U/I systems.

Assessment of the usability and impact of the Idaho Health Data Exchange (IHDE).

PubMed

Reis, Janet; MacKenzie, Lisa; Soelberg, Terri; Smith, Jennifer

2016-04-01

Eighty four health care professionals participated in an online survey assessing the usability, and clinical and administrative impact of the Idaho Health Data Exchange's (IHDE) Virtual Health Record (VHR). The IHDE VHR allows authorized users to use a secure web interface to view lab, radiology and transcribed reports from multiple facilities and view medical histories on patients in the data exchange. Results indicate the usability of the IHDE VHR was almost universally positively rated with the Software Usability Measurement Inventory (SUMI) utilized as the assessment method. Medical providers however had the lowest rating of the exchange, raising concerns about the need for additional training and support. The addition of other Idaho health care organizations to the health data exchange was most widely desired, with the most frequently cited benefit being more comprehensive access to patients' records. In contrast to other published evaluations of health data exchanges in the U.S., few of the concerns emerged about cost of implementation of the data exchange or trust in the quality of information contained therein.

Creating a sustainable collaborative consumer health application for chronic disease self-management.

PubMed

Johnson, Constance M; McIlwain, Steve; Gray, Oliver; Willson, Bradley; Vorderstrasse, Allison

2017-07-01

As the prevalence of chronic diseases increase, there is a need for consumer-centric health informatics applications that assist individuals with disease self-management skills. However, due to the cost of development of these applications, there is also a need to build a disease agnostic architecture so that they could be reused for any chronic disease. This paper describes the architecture of a collaborative virtual environment (VE) platform, LIVE©, that was developed to teach self-management skills and provide social support to those individuals with type 2 diabetes. However, a backend database allows for the application to be easily reused for any chronic disease. We tested its usability in the context of a larger randomized controlled trial of its efficacy. The usability was scored as 'good' by half of the participants in the evaluation. Common errors in the testing and solutions to address initial usability issues are discussed. Overall, LIVE© represents a usable and generalizable platform that will be adapted to other chronic diseases and health needs in future research and applications. Copyright © 2017 Elsevier Inc. All rights reserved.

Translating access into utilization: lessons from the design and evaluation of a health insurance Web site to promote reproductive health care for young women in Massachusetts.

PubMed

Janiak, Elizabeth; Rhodes, Elizabeth; Foster, Angel M

2013-12-01

Following state-level health care reform in Massachusetts, young women reported confusion over coverage of contraception and other sexual and reproductive health services under newly available health insurance products. To address this gap, a plain-language Web site titled "My Little Black Book for Sexual Health" was developed by a statewide network of reproductive health stakeholders. The purpose of this evaluation was to assess the health literacy demands and usability of the site among its target audience, women ages 18-26 years. We performed an evaluation of the literacy demands of the Web site's written content and tested the Web site's usability in a health communications laboratory. Participants found the Web site visually appealing and its overall design concept accessible. However, the Web site's literacy demands were high, and all participants encountered problems navigating through the Web site. Following this evaluation, the Web site was modified to be more usable and more comprehensible to women of all health literacy levels. To avail themselves of sexual and reproductive health services newly available under expanded health insurance coverage, young women require customized educational resources that are rigorously evaluated to ensure accessibility. To maximize utilization of reproductive health services under expanded health insurance coverage, US women require customized educational resources commensurate with their literacy skills. The application of established research methods from the field of health communications will enable advocates to evaluate and adapt these resources to best serve their targeted audiences. © 2013.

Debunking Health IT Usability Myths

PubMed Central

Staggers, N.; Xiao, Y.; Chapman, L.

2013-01-01

Poor usability is a threat to patient safety and linked to productivity loss, workflow disruption, user frustration, sub-optimal product use and system de-installations. Although usability is receiving more attention nationally and internationally, myths about usability persist. This editorial debunks five common myths about usability (1) usability only concerns the look and feel of a product and is, therefore, only a minor concern, (2) usability is not measurable, (3) usability stifles innovation, (4) vendors are solely responsible for product usability, and (5) usability methods are not practical for use in healthcare. PMID:23874361

Usability of Security Management:Defining the Permissions of Guests

NASA Astrophysics Data System (ADS)

Johnson, Matthew; Stajano, Frank

Within the scenario of a Smart Home, we discuss the issues involved in allowing limited interaction with the environment for unidentified principals, or guests. The challenges include identifying and authenticating guests on one hand and delegating authorization to them on the other. While the technical mechanisms for doing so in generic distributed systems have been around for decades, existing solutions are in general not applicable to the smart home because they are too complex to manage. We focus on providing both security and usability; we therefore seek simple and easy to understand approaches that can be used by a normal computer-illiterate home owner, not just by a trained system administrator. This position paper describes ongoing research and does not claim to have all the answers.

Development of MijnAVL, an Interactive Portal to Empower Breast and Lung Cancer Survivors: An Iterative, Multi-Stakeholder Approach.

PubMed

Kuijpers, Wilma; Groen, Wim G; Oldenburg, Hester Sa; Wouters, Michel Wjm; Aaronson, Neil K; van Harten, Wim H

2015-01-22

MijnAVL (MyAVL) is an interactive portal being developed to empower cancer survivors. Literature review and focus groups yielded the selection of features such as access to the electronic medical record (EMR), patient reported outcomes (PROs) and related feedback, and a physical activity support program. Our aim was to present a final design of MijnAVL based on (1) health professionals' evaluation of proposed features, (2) cancer survivors' evaluation of a first draft, and (3) cancer survivors' evaluation of a functional online prototype. Professionals from various disciplines gave input to the content of and procedures related to MijnAVL. Subsequently, 16 cancer survivors participated in an interview to evaluate content and graphic design of a first draft (shown with screenshots). Finally, 7 survivors participated in a usability test with a fully functional prototype. They performed predefined tasks (eg, logging in, finding a test result, completing a questionnaire) while thinking aloud. Descriptive statistics and simple content analysis were used to analyze the data of both the interviews and the usability tests. Professionals supported access to the EMR (eg, histology reports, lab results, and their letters to general practitioners). They also informed the development of PROs and the physical activity support program. Based on the first draft, survivors selected the preferred graphic design, approved the features and provided suggestions for the content (eg, explanation of medical jargon, more concise texts, notification by emails). Usability tests revealed that it was relatively easy to navigate the website and use the different features. Recommendations included, among others, a frequently asked questions section and the use of hyperlinks between different parts of the website. The development of MijnAVL, an interactive portal to empower breast and lung cancer survivors, was performed iteratively and involved multiple groups of end-users. This approach resulted in a usable and understandable final version. Its effectiveness should be determined in further research.

Development of MijnAVL, an Interactive Portal to Empower Breast and Lung Cancer Survivors: An Iterative, Multi-Stakeholder Approach

PubMed Central

Kuijpers, Wilma; Groen, Wim G; Oldenburg, Hester SA; Wouters, Michel WJM; Aaronson, Neil K

2015-01-01

Background MijnAVL (MyAVL) is an interactive portal being developed to empower cancer survivors. Literature review and focus groups yielded the selection of features such as access to the electronic medical record (EMR), patient reported outcomes (PROs) and related feedback, and a physical activity support program. Objective Our aim was to present a final design of MijnAVL based on (1) health professionals' evaluation of proposed features, (2) cancer survivors’ evaluation of a first draft, and (3) cancer survivors’ evaluation of a functional online prototype. Methods Professionals from various disciplines gave input to the content of and procedures related to MijnAVL. Subsequently, 16 cancer survivors participated in an interview to evaluate content and graphic design of a first draft (shown with screenshots). Finally, 7 survivors participated in a usability test with a fully functional prototype. They performed predefined tasks (eg, logging in, finding a test result, completing a questionnaire) while thinking aloud. Descriptive statistics and simple content analysis were used to analyze the data of both the interviews and the usability tests. Results Professionals supported access to the EMR (eg, histology reports, lab results, and their letters to general practitioners). They also informed the development of PROs and the physical activity support program. Based on the first draft, survivors selected the preferred graphic design, approved the features and provided suggestions for the content (eg, explanation of medical jargon, more concise texts, notification by emails). Usability tests revealed that it was relatively easy to navigate the website and use the different features. Recommendations included, among others, a frequently asked questions section and the use of hyperlinks between different parts of the website. Conclusions The development of MijnAVL, an interactive portal to empower breast and lung cancer survivors, was performed iteratively and involved multiple groups of end-users. This approach resulted in a usable and understandable final version. Its effectiveness should be determined in further research. PMID:25614924

An Evaluation of the Usability of a Computerized Decision Support System for Nursing Homes

PubMed Central

Fossum, M.; Ehnfors, M.; Fruhling, A.; Ehrenberg, A.

2011-01-01

Background Computerized decision support systems (CDSSs) have the potential to significantly improve the quality of nursing care of older people by enhancing the decision making of nursing personnel. Despite this potential, health care organizations have been slow to incorporate CDSSs into nursing home practices. Objective This study describes facilitators and barriers that impact the ability of nursing personnel to effectively use a clinical CDSS for planning and treating pressure ulcers (PUs) and malnutrition and for following the suggested risk assessment guidelines for the care of nursing home residents. Methods We employed a qualitative descriptive design using varied methods, including structured group interviews, cognitive walkthrough observations and a graphical user interface (GUI) usability evaluation. Group interviews were conducted with 25 nursing personnel from four nursing homes in southern Norway. Five nursing personnel participated in cognitive walkthrough observations and the GUI usability evaluation. Text transcripts were analyzed using qualitative content analysis. Results Group interview participants reported that ease of use, usefulness and a supportive work environment were key facilitators of CDSS use. The barriers identified were lack of training, resistance to using computers and limited integration of the CDSS with the facility’s electronic health record (EHR) system. Key findings from the usability evaluation also identified the difficulty of using the CDSS within the EHR and the poorly designed GUI integration as barriers. Conclusion Overall, we found disconnect between two types of nursing personnel. Those who were comfortable with computer technology reported positive feedback about the CDSS, while others expressed resistance to using the CDSS for various reasons. This study revealed that organizations must invest more resources in educating nursing personnel on the seriousness of PUs and poor nutrition in the elderly, providing specialized CDSS training and ensuring that nursing personnel have time in the workday to use the CDSS. PMID:23616886

Usability evaluation of pharmacogenomics clinical decision support aids and clinical knowledge resources in a computerized provider order entry system: a mixed methods approach.

PubMed

Devine, Emily Beth; Lee, Chia-Ju; Overby, Casey L; Abernethy, Neil; McCune, Jeannine; Smith, Joe W; Tarczy-Hornoch, Peter

2014-07-01

Pharmacogenomics (PGx) is positioned to have a widespread impact on the practice of medicine, yet physician acceptance is low. The presentation of context-specific PGx information, in the form of clinical decision support (CDS) alerts embedded in a computerized provider order entry (CPOE) system, can aid uptake. Usability evaluations can inform optimal design, which, in turn, can spur adoption. The study objectives were to: (1) evaluate an early prototype, commercial CPOE system with PGx-CDS alerts in a simulated environment, (2) identify potential improvements to the system user interface, and (3) understand the contexts under which PGx knowledge embedded in an electronic health record is useful to prescribers. Using a mixed methods approach, we presented seven cardiologists and three oncologists with five hypothetical clinical case scenarios. Each scenario featured a drug for which a gene encoding drug metabolizing enzyme required consideration of dosage adjustment. We used Morae(®) to capture comments and on-screen movements as participants prescribed each drug. In addition to PGx-CDS alerts, 'Infobutton(®)' and 'Evidence' icons provided participants with clinical knowledge resources to aid decision-making. Nine themes emerged. Five suggested minor improvements to the CPOE user interface; two suggested presenting PGx information through PGx-CDS alerts using an 'Infobutton' or 'Evidence' icon. The remaining themes were strong recommendations to provide succinct, relevant guidelines and dosing recommendations of phenotypic information from credible and trustworthy sources; any more information was overwhelming. Participants' median rating of PGx-CDS system usability was 2 on a Likert scale ranging from 1 (strongly agree) to 7 (strongly disagree). Usability evaluation results suggest that participants considered PGx information important for improving prescribing decisions; and that they would incorporate PGx-CDS when information is presented in relevant and useful ways. Copyright © 2014 Elsevier Ireland Ltd. All rights reserved.

Adapting an in-person patient-caregiver communication intervention to a tailored web-based format.

PubMed

Zulman, Donna M; Schafenacker, Ann; Barr, Kathryn L C; Moore, Ian T; Fisher, Jake; McCurdy, Kathryn; Derry, Holly A; Saunders, Edward W; An, Lawrence C; Northouse, Laurel

2012-03-01

Interventions that target cancer patients and their caregivers have been shown to improve patient-caregiver communication, support, and emotional well-being. To adapt an in-person communication intervention for cancer patients and caregivers to a web-based format, and to examine the usability and acceptability of the web-based program among representative users. A tailored, interactive web-based communication program for cancer patients and their family caregivers was developed based on an existing in-person, nurse-delivered intervention. The development process involved: (1) building a multidisciplinary team of content and web design experts, (2) combining key components of the in-person intervention with the unique tailoring and interactive features of a web-based platform, and (3) conducting focus groups and usability testing to obtain feedback from representative program users at multiple time points. Four focus groups with 2-3 patient-caregiver pairs per group (n = 22 total participants) and two iterations of usability testing with four patient-caregiver pairs per session (n = 16 total participants) were conducted. Response to the program's structure, design, and content was favorable, even among users who were older or had limited computer and Internet experience. The program received high ratings for ease of use and overall usability (mean System Usability Score of 89.5 out of 100). Many elements of a nurse-delivered patient-caregiver intervention can be successfully adapted to a web-based format. A multidisciplinary design team and an iterative evaluation process with representative users were instrumental in the development of a usable and well-received web-based program. Copyright © 2011 John Wiley & Sons, Ltd.

Usability and Safety in Electronic Medical Records Interface Design: A Review of Recent Literature and Guideline Formulation.

PubMed

Zahabi, Maryam; Kaber, David B; Swangnetr, Manida

2015-08-01

The objectives of this study were to (a) review electronic medical record (EMR) and related electronic health record (EHR) interface usability issues, (b) review how EMRs have been evaluated with safety analysis techniques along with any hazard recognition, and (c) formulate design guidelines and a concept for enhanced EMR interfaces with a focus on diagnosis and documentation processes. A major impact of information technology in health care has been the introduction of EMRs. Although numerous studies indicate use of EMRs to increase health care quality, there remain concerns with usability issues and safety. A literature search was conducted using Compendex, PubMed, CINAHL, and Web of Science databases to find EMR research published since 2000. Inclusion criteria included relevant English-language papers with subsets of keywords and any studies (manually) identified with a focus on EMR usability. Fifty studies met the inclusion criteria. Results revealed EMR and EHR usability problems to include violations of natural dialog, control consistency, effective use of language, effective information presentation, and customization principles as well as a lack of error prevention, minimization of cognitive load, and feedback. Studies focusing on EMR system safety made no objective assessments and applied only inductive reasoning methods for hazard recognition. On the basis of the identified usability problems and structure of safety analysis techniques, we provide EMR design guidelines and a design concept focused on the diagnosis process and documentation. The design guidelines and new interface concept can be used for prototyping and testing enhanced EMRs. © 2015, Human Factors and Ergonomics Society.

Review of free software tools for image analysis of fluorescence cell micrographs.

PubMed

Wiesmann, V; Franz, D; Held, C; Münzenmayer, C; Palmisano, R; Wittenberg, T

2015-01-01

An increasing number of free software tools have been made available for the evaluation of fluorescence cell micrographs. The main users are biologists and related life scientists with no or little knowledge of image processing. In this review, we give an overview of available tools and guidelines about which tools the users should use to segment fluorescence micrographs. We selected 15 free tools and divided them into stand-alone, Matlab-based, ImageJ-based, free demo versions of commercial tools and data sharing tools. The review consists of two parts: First, we developed a criteria catalogue and rated the tools regarding structural requirements, functionality (flexibility, segmentation and image processing filters) and usability (documentation, data management, usability and visualization). Second, we performed an image processing case study with four representative fluorescence micrograph segmentation tasks with figure-ground and cell separation. The tools display a wide range of functionality and usability. In the image processing case study, we were able to perform figure-ground separation in all micrographs using mainly thresholding. Cell separation was not possible with most of the tools, because cell separation methods are provided only by a subset of the tools and are difficult to parametrize and to use. Most important is that the usability matches the functionality of a tool. To be usable, specialized tools with less functionality need to fulfill less usability criteria, whereas multipurpose tools need a well-structured menu and intuitive graphical user interface. © 2014 Fraunhofer-Institute for Integrated Circuits IIS Journal of Microscopy © 2014 Royal Microscopical Society.

Usability of a real-time tracked augmented reality display system in musculoskeletal injections

NASA Astrophysics Data System (ADS)

Baum, Zachary; Ungi, Tamas; Lasso, Andras; Fichtinger, Gabor

2017-03-01

PURPOSE: Image-guided needle interventions are seldom performed with augmented reality guidance in clinical practice due to many workspace and usability restrictions. We propose a real-time optically tracked image overlay system to make image-guided musculoskeletal injections more efficient and assess its usability in a bed-side clinical environment. METHODS: An image overlay system consisting of an optically tracked viewbox, tablet computer, and semitransparent mirror allows users to navigate scanned patient volumetric images in real-time using software built on the open-source 3D Slicer application platform. A series of experiments were conducted to evaluate the latency and screen refresh rate of the system using different image resolutions. To assess the usability of the system and software, five medical professionals were asked to navigate patient images while using the overlay and completed a questionnaire to assess the system. RESULTS: In assessing the latency of the system with scanned images of varying size, screen refresh rates were approximately 5 FPS. The study showed that participants found using the image overlay system easy, and found the table-mounted system was significantly more usable and effective than the handheld system. CONCLUSION: It was determined that the system performs comparably with scanned images of varying size when assessing the latency of the system. During our usability study, participants preferred the table-mounted system over the handheld. The participants also felt that the system itself was simple to use and understand. With these results, the image overlay system shows promise for use in a clinical environment.

Brief Report: Adapting an In-Person Patient-Caregiver Communication Intervention to a Tailored Web-Based Format

PubMed Central

Zulman, Donna M.; Schafenacker, Ann; Barr, Kathryn L.C.; Moore, Ian T.; Fisher, Jake; McCurdy, Kathryn; Derry, Holly A.; Saunders, Edward W.; An, Lawrence C.; Northouse, Laurel

2011-01-01

Background Interventions that target cancer patients and their caregivers have been shown to improve communication, support, and emotional well-being. Objective To adapt an in-person communication intervention for cancer patients and caregivers to a web-based format, and to examine the usability and acceptability of the web-based program among representative users. Methods A tailored, interactive web-based communication program for cancer patients and their family caregivers was developed based on an existing in-person, nurse-delivered intervention. The development process involved: 1) building a multidisciplinary team of content and web design experts, 2) combining key components of the in-person intervention with the unique tailoring and interactive features of a web-based platform, and 3) conducting focus groups and usability testing to obtain feedback from representative program users at multiple time points. Results Four focus groups with 2 to 3 patient-caregiver pairs per group (n = 22 total participants) and two iterations of usability testing with 4 patient-caregiver pairs per session (n = 16 total participants) were conducted. Response to the program's structure, design, and content was favorable, even among users who were older or had limited computer and internet experience. The program received high ratings for ease of use and overall usability (mean System Usability Score of 89.5 out of 100). Conclusions Many elements of a nurse-delivered patient-caregiver intervention can be successfully adapted to a web-based format. A multidisciplinary design team and an iterative evaluation process with representative users were instrumental in the development of a usable and well-received web-based program. PMID:21830255

Research-IQ: Development and Evaluation of an Ontology-anchored Integrative Query Tool

PubMed Central

Borlawsky, Tara B.; Lele, Omkar; Payne, Philip R. O.

2011-01-01

Investigators in the translational research and systems medicine domains require highly usable, efficient and integrative tools and methods that allow for the navigation of and reasoning over emerging large-scale data sets. Such resources must cover a spectrum of granularity from bio-molecules to population phenotypes. Given such information needs, we report upon the initial design and evaluation of an ontology-anchored integrative query tool, Research-IQ, which employs a combination of conceptual knowledge engineering and information retrieval techniques to enable the intuitive and rapid construction of queries, in terms of semi-structured textual propositions, that can subsequently be applied to integrative data sets. Our initial results, based upon both quantitative and qualitative evaluations of the efficacy and usability of Research-IQ, demonstrate its potential to increase clinical and translational research throughput. PMID:21821150

Usability and Acceptability of a Web-Based Program for Chemotherapy-Induced Peripheral Neuropathy.

PubMed

Tofthagen, Cindy; Kip, Kevin E; Passmore, Denise; Loy, Ian; Berry, Donna L

2016-07-01

Chemotherapy-induced neuropathy is a painful and debilitating adverse effect of certain chemotherapy drugs. There have not been any patient-centered, easily accessible Web-based interventions to assist with self-management of chemotherapy-induced neuropathy. The aims of this study were to evaluate usability and acceptability and to estimate an effect size of a Web-based intervention for assessing and managing chemotherapy-induced neuropathy. Participants (N = 14) were instructed to complete the Creativity, Optimism, Planning, and Expert Information for Chemotherapy-Induced Peripheral Neuropathy program and provide verbal responses to the program. Participants completed the Chemotherapy Induced Peripheral Neuropathy Assessment Tool and Post-Study System Usability Questionnaire. Iterative changes were made to the COPE-CIPN. Participants were asked to provide feedback on the revised COPE-CIPN, repeat the Chemotherapy Induced Peripheral Neuropathy Assessment Tool, and evaluate acceptability using the Acceptability e-Scale. The COPE-CIPN demonstrated high usability (mean, 1.98 [SD, 1.12]) and acceptability (mean, 4.40 [SD, 0.52]). Comments indicated that the interface was easy to use, and the information was helpful. While neuropathy symptoms continued to increase in this group of patients receiving neurotoxic chemotherapy, there was a decrease in mean level of interference with activities from 53.71 to 39.29 over 3 to 4 months, which indicated a moderate effect (d = 0.39) size. The COPE-CIPN may be a useful intervention to support self-management of chemotherapy-induced neuropathy.

Formative usability evaluation of a fixed-dose pen-injector platform device

PubMed Central

Lange, Jakob; Nemeth, Tobias

2018-01-01

Background This article for the first time presents a formative usability study of a fixed-dose pen injector platform device used for the subcutaneous delivery of biopharmaceuticals, primarily for self-administration by the patient. The study was conducted with a user population of both naïve and experienced users across a range of ages. The goals of the study were to evaluate whether users could use the devices safely and effectively relying on the instructions for use (IFU) for guidance, as well as to benchmark the device against another similar injector established in the market. Further objectives were to capture any usability issues and obtain participants’ subjective ratings on the properties and performance of both devices. Methods A total of 20 participants in three groups studied the IFU and performed simulated injections into an injection pad. Results All participants were able to use the device successfully. The device was well appreciated by all users with, maximum usability feedback scores reported by 90% or more on handling forces and device feedback, and by 85% or more on fit and grip of the device. The presence of clear audible and visible feedbacks upon successful loading of a dose and completion of injection was seen to be a significant improvement over the benchmark injector. Conclusion The observation that the platform device can be safely and efficiently used by all user groups provides confidence that the device and IFU in their current form will pass future summative testing in specific applications. PMID:29670411

HRI usability evaluation of interaction modes for a teleoperated agricultural robotic sprayer.

PubMed

Adamides, George; Katsanos, Christos; Parmet, Yisrael; Christou, Georgios; Xenos, Michalis; Hadzilacos, Thanasis; Edan, Yael

2017-07-01

Teleoperation of an agricultural robotic system requires effective and efficient human-robot interaction. This paper investigates the usability of different interaction modes for agricultural robot teleoperation. Specifically, we examined the overall influence of two types of output devices (PC screen, head mounted display), two types of peripheral vision support mechanisms (single view, multiple views), and two types of control input devices (PC keyboard, PS3 gamepad) on observed and perceived usability of a teleoperated agricultural sprayer. A modular user interface for teleoperating an agricultural robot sprayer was constructed and field-tested. Evaluation included eight interaction modes: the different combinations of the 3 factors. Thirty representative participants used each interaction mode to navigate the robot along a vineyard and spray grape clusters based on a 2 × 2 × 2 repeated measures experimental design. Objective metrics of the effectiveness and efficiency of the human-robot collaboration were collected. Participants also completed questionnaires related to their user experience with the system in each interaction mode. Results show that the most important factor for human-robot interface usability is the number and placement of views. The type of robot control input device was also a significant factor in certain dependents, whereas the effect of the screen output type was only significant on the participants' perceived workload index. Specific recommendations for mobile field robot teleoperation to improve HRI awareness for the agricultural spraying task are presented. Copyright © 2017 Elsevier Ltd. All rights reserved.

Interface evaluation for soft robotic manipulators

NASA Astrophysics Data System (ADS)

Moore, Kristin S.; Rodes, William M.; Csencsits, Matthew A.; Kwoka, Martha J.; Gomer, Joshua A.; Pagano, Christopher C.

2006-05-01

The results of two usability experiments evaluating an interface for the operation of OctArm, a biologically inspired robotic arm modeled after an octopus tentacle, are reported. Due to the many degrees-of-freedom (DOF) for the operator to control, such 'continuum' robotic limbs provide unique challenges for human operators because they do not map intuitively. Two modes have been developed to control the arm and reduce the DOF under the explicit direction of the operator. In coupled velocity (CV) mode, a joystick controls changes in arm curvature. In end-effector (EE) mode, a joystick controls the arm by moving the position of an endpoint along a straight line. In Experiment 1, participants used the two modes to grasp objects placed at different locations in a virtual reality modeling language (VRML). Objective measures of performance and subjective preferences were recorded. Results revealed lower grasp times and a subjective preference for the CV mode. Recommendations for improving the interface included providing additional feedback and implementation of an error recovery function. In Experiment 2, only the CV mode was tested with improved training of participants and several changes to the interface. The error recovery function was implemented, allowing participants to reverse through previously attained positions. The mean time to complete the trials in the second usability test was reduced by more than 4 minutes compared with the first usability test, confirming the interface changes improved performance. The results of these tests will be incorporated into future versions of the arm and improve future usability tests.

Evaluation of the Digital Alzheimer Center: Testing Usability and Usefulness of an Online Portal for Patients with Dementia and Their Carers.

PubMed

Hattink, Bart; Droes, Rose-Marie; Sikkes, Sietske; Oostra, Ellen; Lemstra, Afina W

2016-07-21

Dementia is a progressive and highly disabling neurodegenerative disease that will likely become highly prevalent in the future due to the globally aging population. To improve health care efficiency and quality for dementia care, eHealth could help with, for example, an online portal, such as the Digital Alzheimer Center (DAC) of the Vrije Universiteit Medical Center Amsterdam. It provides up-to-date disease information, peer-to-peer contact, and methods for contacting the hospital and health professionals. We aimed to investigate the usability and usefulness of the DAC for patients with dementia and carers to get insight into the feasibility and value of this eHealth app in dementia care and to recommend potential improvements. A descriptive study among patients, carers, and health care professionals was performed. Mixed methods were used, consisting of observations (n=10, 4 people with dementia, 6 carers), an online survey (n=287; 88 patients, 199 carers), and semistructured interviews (n=18; 6 patients, 6 carers, 6 health care professionals). During the observations, participants performed a set of five different prescribed tasks on the portal. Speed, number of errors, and navigation were noted. The online survey aimed to assess users' opinions on the portal's usability and usefulness. Semistructured interviews were conducted in a subsample of patients, carers, and health care professionals to gain more in-depth information. In the usability assessment, eight categories of errors were distinguished, of which three were of critical, two of medium, and three of low severity. In the survey, 45% (40/88) of the patients and 53% (105/199) of the carers indicated they used the portal. In all, 33% (12/36) of patients and 61% (62/102) of carers found it easy to learn to work with the portal. Most considered the DAC generally useful: 65% (17/26) of patients and 78% (67/86) of carers found the DAC useful, especially for understanding dementia (patients: 64%, 16/25; carers: 62%, 53/86). In the semistructured interviews, the site was generally rated positively on usability and usefulness and being well designed. People with dementia and carers indicated it helped them to understand and deal with dementia. To our knowledge, this is the first study investigating the usability and usefulness of an Internet portal especially designed for people with dementia and their carers. An online patient portal could be a useful means to help to support patients and carers in dealing with dementia: the majority of users positively evaluated usability and usefulness of the portal, and appreciated the information on it. However, only a minority of patients found it easy to work with the portal. Good design and frequent usability testing is essential to offer a good online portal.

Evaluation of Life Sciences Glovebox (LSG) and Multi-Purpose Crew Restraint Concepts

NASA Technical Reports Server (NTRS)

Whitmore, Mihriban

2005-01-01

Within the scope of the Multi-purpose Crew Restraints for Long Duration Spaceflights project, funded by Code U, it was proposed to conduct a series of evaluations on the ground and on the KC-135 to investigate the human factors issues concerning confined/unique workstations, such as the design of crew restraints. The usability of multiple crew restraints was evaluated for use with the Life Sciences Glovebox (LSG) and for performing general purpose tasks. The purpose of the KC-135 microgravity evaluation was to: (1) to investigate the usability and effectiveness of the concepts developed, (2) to gather recommendations for further development of the concepts, and (3) to verify the validity of the existing requirements. Some designs had already been tested during a March KC-135 evaluation, and testing revealed the need for modifications/enhancements. This flight was designed to test the new iterations, as well as some new concepts. This flight also involved higher fidelity tasks in the LSG, and the addition of load cells on the gloveports.

Acceptability and usability of a telepresence robot for geriatric primary care: A pilot.

PubMed

Vermeersch, Patricia; Sampsel, Debi D; Kleman, Carolyn

2015-01-01

The dual challenge of increasing numbers of older adults and overall increases in those with some form of insurance is driving the need to develop and evaluate novel methods of primary care delivery such as telehealth. The goal of this study was to explore the acceptability and usability of a remote presence robot (RPR) in a simulated primary care wellness encounter for older adults. A descriptive exploratory study was used to determine the acceptability and usability of the RPR operated by an APRN 250 miles from 13 older adults residing in a high rise during a simulated primary care visit. The results support previous research that technology such as the RPR can be both acceptable and useful for an older adult and primary care provider but only in certain circumstances. Copyright © 2015 Elsevier Inc. All rights reserved.

A multimethod approach to examining usability of Web privacy polices and user agents for specifying privacy preferences.

PubMed

Proctor, Robert W; Vu, Kim-Phuong L

2007-05-01

Because all research methods have strengths and weaknesses, a multimethod approach often provides the best way to understand human behavior in applied settings. We describe how a multimethod approach was employed in a series of studies designed to examine usability issues associated with two aspects of online privacy: comprehension of privacy policies and configuration of privacy preferences for an online user agent. Archival research, user surveys, data mining, quantitative observations, and controlled experiments each yielded unique findings that, together, contributed to increased understanding of online-privacy issues for users. These findings were used to evaluate the accessibility of Web privacy policies to computer-literate users, determine whether people can configure user agents to achieve specific privacy goals, and discover ways in which the usability of those agents can be improved.

Public Opinion Poll Question Databases: An Evaluation

ERIC Educational Resources Information Center

Woods, Stephen

2007-01-01

This paper evaluates five polling resource: iPOLL, Polling the Nations, Gallup Brain, Public Opinion Poll Question Database, and Polls and Surveys. Content was evaluated on disclosure standards from major polling organizations, scope on a model for public opinion polls, and presentation on a flow chart discussing search limitations and usability.

An Evaluation of Digital Stories Created for Social Studies Teaching

ERIC Educational Resources Information Center

Seker, Burcu Sezginsoy

2016-01-01

Digital stories are useful tools for combining technology with education, in terms of the preparation stage, practicality, availability and usability as an evaluation instrument. In this study, digital stories created in a social studies teaching class were evaluated and the opinions of primary school teacher candidates were obtained concerning…

Evaluating the Usability and Usefulness of a Mobile App for Atrial Fibrillation Using Qualitative Methods: Exploratory Pilot Study.

PubMed

Hirschey, Jaclyn; Bane, Sunetra; Mansour, Moussa; Sperber, Jodi; Agboola, Stephen; Kvedar, Joseph; Jethwani, Kamal

2018-03-15

Atrial fibrillation (AFib) is the most common form of heart arrhythmia and a potent risk factor for stroke. Nonvitamin K antagonist oral anticoagulants (NOACs) are routinely prescribed to manage AFib stroke risk; however, nonadherence to treatment is a concern. Additional tools that support self-care and medication adherence may benefit patients with AFib. The aim of this study was to evaluate the perceived usability and usefulness of a mobile app designed to support self-care and treatment adherence for AFib patients who are prescribed NOACs. A mobile app to support AFib patients was previously developed based on early stage interview and usability test data from clinicians and patients. An exploratory pilot study consisting of naturalistic app use, surveys, and semistructured interviews was then conducted to examine patients' perceptions and everyday use of the app. A total of 12 individuals with an existing diagnosis of nonvalvular AFib completed the 4-week study. The average age of participants was 59 years. All participants somewhat or strongly agreed that the app was easy to use, and 92% (11/12) reported being satisfied or very satisfied with the app. Participant feedback identified changes that may improve app usability and usefulness for patients with AFib. Areas of usability improvement were organized by three themes: app navigation, clarity of app instructions and design intent, and software bugs. Perceptions of app usefulness were grouped by three key variables: core needs of the patient segment, patient workflow while managing AFib, and the app's ability to support the patient's evolving needs. The results of this study suggest that mobile tools that target self-care and treatment adherence may be helpful to AFib patients, particularly those who are newly diagnosed. Additionally, participant feedback provided insight into the varied needs and health experiences of AFib patients, which may improve the design and targeting of the intervention. Pilot studies that qualitatively examine patient perceptions of usability and usefulness are a valuable and often underutilized method for assessing the real-world acceptability of an intervention. Additional research evaluating the AFib Connect mobile app over a longer period, and including a larger, more diverse sample of AFib patients, will be helpful for understanding whether the app is perceived more broadly to be useful and effective in supporting patient self-care and medication adherence. ©Jaclyn Hirschey, Sunetra Bane, Moussa Mansour, Jodi Sperber, Stephen Agboola, Joseph Kvedar, Kamal Jethwani. Originally published in JMIR Human Factors (http://humanfactors.jmir.org), 15.03.2018.

Seamless recording of glucometer measurements among older experienced diabetic patients - A study of perception and usability.

PubMed

Rasche, Peter; Mertens, Alexander; Miron-Shatz, Talya; Berzon, Corinne; Schlick, Christopher M; Jahn, Michael; Becker, Stefan

2018-01-01

Self-measurement and documentation of blood-glucose are critical elements of diabetes management, particularly in regimes including insulin. In this study, we analyze the usability of iBG-STAR, the first blood glucose meter connectable to a smartphone. This technology records glucometer measurements, removing the burden of documentation from diabetic patients. This study assesses the potential for implementation of iBG-STAR in routine care. Twelve long-term diabetic patients (4 males; median age of 66.5 years) were enrolled in the study. N = 4/12 reported diabetic polyneuropathy. Reported subjective mental workload for all tasks related to iBG-STAR was on average lower than 12 points, corresponding to the verbal code 'nearly no effort needed'. A "Post Study System Usability Questionnaire", evaluated the glucometer at an average value of 2.06 (SD = 1.02) on a 7-Likert-scale (1 = 'I fully agree' to 7 = 'I completely disagree') for usability. These results represent a positive user-experience. Patients with polyneuropathy may experience physical difficulties in completing the tasks, thereby affecting usability. Technologically savvy patients (n = 6) with a positive outlook on diabetes assessed the product as a suitable tool for themselves and would recommend to other diabetic patients. The main barrier to regular use was treating physicians' inability to retrieve digitally recorded data. This barrier was due to a shortcoming in interoperability of mobile devices and medical information systems.

Development of the UTAUT2 model to measure the acceptance of medical laboratory portals by patients in Shiraz.

PubMed

Ravangard, Ramin; Kazemi, Zhila; Abbasali, Somaye Zaker; Sharifian, Roxana; Monem, Hossein

2017-02-01

One of the main stages for achieving the success is acceptance of technology by its users. Hence, identifying the effective factors in successful acceptance of information technology is necessary and vital. One such factor is usability. This study aimed to investigate the software usability in the "Unified Theory of Acceptance and Use of Technology 2 (UTAUT2)" model in patients' use of medical diagnosis laboratories' electronic portals in 2015. This cross-sectional study was carried out on 170 patients in 2015. A 27-item questionnaire adopted from previous research and the Usability Evaluation questionnaire were used for data collection. Data were analyzed using Structural Equation Modeling (SEM), with Partial Least Squares approach by SPSS 20.0 and Smart-PLS V3.0. The results showed that the construct of intention to use had significant associations with price value (t-value=2.77), hedonic motivation (t-value=4.46), habit (t-value=1.99) and usability (t-value=5.2), as well as the construct of usage behavior with usability (t-value=3.45) and intention to use (t-value=2.03). Considering the results of this study, the following recommendations can be made in order for the higher use of portals by the patients: informing patients about the advantages of using these portals, designing portals in a simple and understandable form, increasing the portals' attractiveness, etc.

Engineering the electronic health record for safety: a multi-level video-based approach to diagnosing and preventing technology-induced error arising from usability problems.

PubMed

Borycki, Elizabeth M; Kushniruk, Andre W; Kuwata, Shigeki; Kannry, Joseph

2011-01-01

Electronic health records (EHRs) promise to improve and streamline healthcare through electronic entry and retrieval of patient data. Furthermore, based on a number of studies showing their positive benefits, they promise to reduce medical error and make healthcare safer. However, a growing body of literature has clearly documented that if EHRS are not designed properly and with usability as an important goal in their design, rather than reducing error, EHR deployment has the potential to actually increase medical error. In this paper we describe our approach to engineering (and reengineering) EHRs in order to increase their beneficial potential while at the same time improving their safety. The approach described in this paper involves an integration of the methods of usability analysis with video analysis of end users interacting with EHR systems and extends the evaluation of the usability of EHRs to include the assessment of the impact of these systems on work practices. Using clinical simulations, we analyze human-computer interaction in real healthcare settings (in a portable, low-cost and high fidelity manner) and include both artificial and naturalistic data collection to identify potential usability problems and sources of technology-induced error prior to widespread system release. Two case studies where the methods we have developed and refined have been applied at different levels of user-computer interaction are described.

Mind the Gap: The Effect of Keyboard Key Gap and Pitch on Typing Speed, Accuracy, and Usability, Part 3.

PubMed

Madison, Heather; Pereira, Anna; Korshøj, Mette; Taylor, Laura; Barr, Alan; Rempel, David

2015-11-01

The aim of this study was to evaluate the effects of key gap (distance between edges of keys) on computer keyboards on typing speed, percentage error, preference, and usability. In Parts 1 and 2 of this series, a small key pitch (center-to-center distance between keys) was found to reduce productivity and usability, but the findings were confounded by gap. In this study, key gap was varied while holding key pitch constant. Participants (N = 25) typed on six keyboards, which differed in gap between keys (1, 3, or 5 mm) and pitch (16 or 17 mm; distance between centers of keys), while typing speed, accuracy, usability, and preference were measured. There was no statistical interaction between gap and pitch. Accuracy was better for keyboards with a gap of 5 mm compared to a 1-mm gap (p = .04). Net typing speed (p = .02), accuracy (p = .002), and most usability measures were better for keyboards with a pitch of 17 mm compared to a 16-mm pitch. The study findings support keyboard designs with a gap between keys of 5 mm over 1 mm and a key pitch of 17 mm over 16 mm. These findings may influence keyboard standards and design, especially the design of small keyboards used with portable devices, such as tablets and laptops. © 2015, Human Factors and Ergonomics Society.

SciSpark's SRDD : A Scientific Resilient Distributed Dataset for Multidimensional Data

NASA Astrophysics Data System (ADS)

Palamuttam, R. S.; Wilson, B. D.; Mogrovejo, R. M.; Whitehall, K. D.; Mattmann, C. A.; McGibbney, L. J.; Ramirez, P.

2015-12-01

Remote sensing data and climate model output are multi-dimensional arrays of massive sizes locked away in heterogeneous file formats (HDF5/4, NetCDF 3/4) and metadata models (HDF-EOS, CF) making it difficult to perform multi-stage, iterative science processing since each stage requires writing and reading data to and from disk. We have developed SciSpark, a robust Big Data framework, that extends ApacheTM Spark for scaling scientific computations. Apache Spark improves the map-reduce implementation in ApacheTM Hadoop for parallel computing on a cluster, by emphasizing in-memory computation, "spilling" to disk only as needed, and relying on lazy evaluation. Central to Spark is the Resilient Distributed Dataset (RDD), an in-memory distributed data structure that extends the functional paradigm provided by the Scala programming language. However, RDDs are ideal for tabular or unstructured data, and not for highly dimensional data. The SciSpark project introduces the Scientific Resilient Distributed Dataset (sRDD), a distributed-computing array structure which supports iterative scientific algorithms for multidimensional data. SciSpark processes data stored in NetCDF and HDF files by partitioning them across time or space and distributing the partitions among a cluster of compute nodes. We show usability and extensibility of SciSpark by implementing distributed algorithms for geospatial operations on large collections of multi-dimensional grids. In particular we address the problem of scaling an automated method for finding Mesoscale Convective Complexes. SciSpark provides a tensor interface to support the pluggability of different matrix libraries. We evaluate performance of the various matrix libraries in distributed pipelines, such as Nd4jTM and BreezeTM. We detail the architecture and design of SciSpark, our efforts to integrate climate science algorithms, parallel ingest and partitioning (sharding) of A-Train satellite observations from model grids. These solutions are encompassed in SciSpark, an open-source software framework for distributed computing on scientific data.

Sociotechnical Human Factors Involved in Remote Online Usability Testing of Two eHealth Interventions

PubMed Central

2016-01-01

Background Research in the fields of human performance technology and human computer interaction are challenging the traditional macro focus of usability testing arguing for methods that help test moderators assess “use in context” (ie, cognitive skills, usability understood over time) and in authentic “real world” settings. Human factors in these complex test scenarios may impact on the quality of usability results being derived yet there is a lack of research detailing moderator experiences in these test environments. Most comparative research has focused on the impact of the physical environment on results, and rarely on how the sociotechnical elements of the test environment affect moderator and test user performance. Improving our understanding of moderator roles and experiences with conducting “real world” usability testing can lead to improved techniques and strategies Objective To understand moderator experiences of using Web-conferencing software to conduct remote usability testing of 2 eHealth interventions. Methods An exploratory case study approach was used to study 4 moderators’ experiences using Blackboard Collaborate for remote testing sessions of 2 different eHealth interventions. Data collection involved audio-recording iterative cycles of test sessions, collecting summary notes taken by moderators, and conducting 2 90-minute focus groups via teleconference. A direct content analysis with an inductive coding approach was used to explore personal accounts, assess the credibility of data interpretation, and generate consensus on the thematic structure of the results. Results Following the convergence of data from the various sources, 3 major themes were identified: (1) moderators experienced and adapted to unpredictable changes in cognitive load during testing; (2) moderators experienced challenges in creating and sustaining social presence and untangling dialogue; and (3) moderators experienced diverse technical demands, but were able to collaboratively troubleshoot with test users. Conclusions Results highlight important human-computer interactions and human factor qualities that impact usability testing processes. Moderators need an advanced skill and knowledge set to address the social interaction aspects of Web-based usability testing and technical aspects of conferencing software during test sessions. Findings from moderator-focused studies can inform the design of remote testing platforms and real-time usability evaluation processes that place less cognitive burden on moderators and test users. PMID:27026291

"Think aloud" and "Near live" usability testing of two complex clinical decision support tools.

PubMed

Richardson, Safiya; Mishuris, Rebecca; O'Connell, Alexander; Feldstein, David; Hess, Rachel; Smith, Paul; McCullagh, Lauren; McGinn, Thomas; Mann, Devin

2017-10-01

Low provider adoption continues to be a significant barrier to realizing the potential of clinical decision support. "Think Aloud" and "Near Live" usability testing were conducted on two clinical decision support tools. Each was composed of an alert, a clinical prediction rule which estimated risk of either group A Streptococcus pharyngitis or pneumonia and an automatic order set based on risk. The objective of this study was to further understanding of the facilitators of usability and to evaluate the types of additional information gained from proceeding to "Near Live" testing after completing "Think Aloud". This was a qualitative observational study conducted at a large academic health care system with 12 primary care providers. During "Think Aloud" testing, participants were provided with written clinical scenarios and asked to verbalize their thought process while interacting with the tool. During "Near Live" testing participants interacted with a mock patient. Morae usability software was used to record full screen capture and audio during every session. Participant comments were placed into coding categories and analyzed for generalizable themes. Themes were compared across usability methods. "Think Aloud" and "Near Live" usability testing generated similar themes under the coding categories visibility, workflow, content, understand-ability and navigation. However, they generated significantly different themes under the coding categories usability, practical usefulness and medical usefulness. During both types of testing participants found the tool easier to use when important text was distinct in its appearance, alerts were passive and appropriately timed, content was up to date, language was clear and simple, and each component of the tool included obvious indicators of next steps. Participant comments reflected higher expectations for usability and usefulness during "Near Live" testing. For example, visit aids, such as automatically generated order sets, were felt to be less useful during "Near-Live" testing because they would not be all inclusive for the visit. These complementary types of usability testing generated unique and generalizable insights. Feedback during "Think Aloud" testing primarily helped to improve the tools' ease of use. The additional feedback from "Near Live" testing, which mimics a real clinical encounter, was helpful for eliciting key barriers and facilitators to provider workflow and adoption. Copyright © 2017 Elsevier B.V. All rights reserved.

Do Perceptions of Insulin Pump Usability Impact Attitudes Toward Insulin Pump Therapy? A Pilot Study of Individuals With Type 1 and Insulin-Treated Type 2 Diabetes

PubMed Central

Gilgen, Emily

2014-01-01

Background: We assessed the impact of perceived insulin pump usability on attitudes toward insulin pump therapy in diabetic individuals currently treated with multiple daily insulin injections (MDI). Method: This comparative, single-arm study recruited 28 adults with type 1 (n = 16) and insulin-treated type 2 diabetes (n = 12) to evaluate 2 current insulin pumps: Medtronic Revel 723 (Pump 1), Asante Snap Insulin Pump (Pump 2). Participants were randomized 1:1 to 1 of 2 assessment sequences: Pump 1 followed by Pump 2; and Pump 2 followed by Pump 1. Structured observational protocols were utilized to assess participants’ ability and time required to learn/perform common tasks associated with pump setup/use. Participants used a modified version of the System Usability Scale (SUS) and investigator-developed questionnaires to rate pump usability and task difficulty; pre-post questionnaires assessed changes in attitudes toward insulin pump therapy. Results: All participants completed the study. SUS scores showed Pump 2 to be more usable than Pump 1 on all usability attributes. Participants rated Pump 2 more positively than Pump 1, overall mean SUS scores of 5.7 versus 4.1 respectively, F(1, 52) = 32.7, P < .001, and SUS scores were higher if participants used the Pump 2 last, 5.3 versus 4.4 for Pump 1 last, F(1, 52) = 10.8, P < .01. Pump 2 was preferred for all tasks: manual bolus (86%), bolus calculation (71%), managing basal rates (93%), interpreting alarms (96%), transferring settings (100%), changing insulin and infusion sets (93%), all P < .05. Conclusions: Perceptions of pump usability can directly impact acceptance and use of features that may benefit those who wear them. Simpler pump devices that decrease perceptions of complexity may encourage broader use of this technology. PMID:25269659

Using Distributed Data over HBase in Big Data Analytics Platform for Clinical Services

PubMed Central

Zamani, Hamid

2017-01-01

Big data analytics (BDA) is important to reduce healthcare costs. However, there are many challenges of data aggregation, maintenance, integration, translation, analysis, and security/privacy. The study objective to establish an interactive BDA platform with simulated patient data using open-source software technologies was achieved by construction of a platform framework with Hadoop Distributed File System (HDFS) using HBase (key-value NoSQL database). Distributed data structures were generated from benchmarked hospital-specific metadata of nine billion patient records. At optimized iteration, HDFS ingestion of HFiles to HBase store files revealed sustained availability over hundreds of iterations; however, to complete MapReduce to HBase required a week (for 10 TB) and a month for three billion (30 TB) indexed patient records, respectively. Found inconsistencies of MapReduce limited the capacity to generate and replicate data efficiently. Apache Spark and Drill showed high performance with high usability for technical support but poor usability for clinical services. Hospital system based on patient-centric data was challenging in using HBase, whereby not all data profiles were fully integrated with the complex patient-to-hospital relationships. However, we recommend using HBase to achieve secured patient data while querying entire hospital volumes in a simplified clinical event model across clinical services. PMID:29375652

Using Distributed Data over HBase in Big Data Analytics Platform for Clinical Services.

PubMed

Chrimes, Dillon; Zamani, Hamid

2017-01-01

Big data analytics (BDA) is important to reduce healthcare costs. However, there are many challenges of data aggregation, maintenance, integration, translation, analysis, and security/privacy. The study objective to establish an interactive BDA platform with simulated patient data using open-source software technologies was achieved by construction of a platform framework with Hadoop Distributed File System (HDFS) using HBase (key-value NoSQL database). Distributed data structures were generated from benchmarked hospital-specific metadata of nine billion patient records. At optimized iteration, HDFS ingestion of HFiles to HBase store files revealed sustained availability over hundreds of iterations; however, to complete MapReduce to HBase required a week (for 10 TB) and a month for three billion (30 TB) indexed patient records, respectively. Found inconsistencies of MapReduce limited the capacity to generate and replicate data efficiently. Apache Spark and Drill showed high performance with high usability for technical support but poor usability for clinical services. Hospital system based on patient-centric data was challenging in using HBase, whereby not all data profiles were fully integrated with the complex patient-to-hospital relationships. However, we recommend using HBase to achieve secured patient data while querying entire hospital volumes in a simplified clinical event model across clinical services.

75 FR 52309 - Pacific Fishery Management Council; Tule Chinook Workgroup Meeting

Federal Register 2010, 2011, 2012, 2013, 2014

2010-08-25

... management approach for Columbia River natural tule chinook . This meeting of the TCW is open to the public... distributed to State and Federal recovery planning processes. In the event a usable approach emerges from this...: The Pacific Fishery Management Council's (Pacific Council) Tule Chinook Workgroup (TCW) will hold a...

Leveraging Python Interoperability Tools to Improve Sapphire's Usability

DOE Office of Scientific and Technical Information (OSTI.GOV)

Gezahegne, A; Love, N S

2007-12-10

The Sapphire project at the Center for Applied Scientific Computing (CASC) develops and applies an extensive set of data mining algorithms for the analysis of large data sets. Sapphire's algorithms are currently available as a set of C++ libraries. However many users prefer higher level scripting languages such as Python for their ease of use and flexibility. In this report, we evaluate four interoperability tools for the purpose of wrapping Sapphire's core functionality with Python. Exposing Sapphire's functionality through a Python interface would increase its usability and connect its algorithms to existing Python tools.

User Interface Requirements for Web-Based Integrated Care Pathways: Evidence from the Evaluation of an Online Care Pathway Investigation Tool.

PubMed

Balatsoukas, Panos; Williams, Richard; Davies, Colin; Ainsworth, John; Buchan, Iain

2015-11-01

Integrated care pathways (ICPs) define a chronological sequence of steps, most commonly diagnostic or treatment, to be followed in providing care for patients. Care pathways help to ensure quality standards are met and to reduce variation in practice. Although research on the computerisation of ICP progresses, there is still little knowledge on what are the requirements for designing user-friendly and usable electronic care pathways, or how users (normally health care professionals) interact with interfaces that support design, analysis and visualisation of ICPs. The purpose of the study reported in this paper was to address this gap by evaluating the usability of a novel web-based tool called COCPIT (Collaborative Online Care Pathway Investigation Tool). COCPIT supports the design, analysis and visualisation of ICPs at the population level. In order to address the aim of this study, an evaluation methodology was designed based on heuristic evaluations and a mixed method usability test. The results showed that modular visualisation and direct manipulation of information related to the design and analysis of ICPs is useful for engaging and stimulating users. However, designers should pay attention to issues related to the visibility of the system status and the match between the system and the real world, especially in relation to the display of statistical information about care pathways and the editing of clinical information within a care pathway. The paper concludes with recommendations for interface design.

TEAMS (Tele-Exercise and Multiple Sclerosis), a Tailored Telerehabilitation mHealth App: Participant-Centered Development and Usability Study

PubMed Central

Rimmer, James H; Johnson, George; Wilroy, Jereme; Young, Hui-Ju; Mehta, Tapan; Lai, Byron

2018-01-01

Background People with multiple sclerosis face varying levels of disability and symptoms, thus requiring highly trained therapists and/or exercise trainers to design personalized exercise programs. However, for people living in geographically isolated communities, access to such trained professionals can be challenging due to a number of barriers associated with cost, access to transportation, and travel distance. Generic mobile health exercise apps often fall short of what people with multiple sclerosis need to become physically active (ie, exercise content that has been adapted to accommodate a wide range of functional limitations). Objective This usability study describes the development process of the TEAMS (Tele-Exercise and Multiple Sclerosis) app, which is being used by people with multiple sclerosis in a large randomized controlled trial to engage in home-based telerehabilitation. Methods Twenty-one participants with disabilities (10 people with multiple sclerosis) were involved in the double iterative design, which included the simultaneous development of the app features and exercise content (exercise videos and articles). Framed within a user-centered design approach, the development process included 2 stages: ground-level creation (focus group followed by early stage evaluations and developments), and proof of concept through 2 usability tests. Usability (effectiveness, usefulness, and satisfaction) was evaluated using a mixed-methods approach. Results During testing of the app’s effectiveness, the second usability test resulted in an average of 1 problem per participant, a decrease of 53% compared to the initial usability test. Five themes were constructed from the qualitative data that related to app usefulness and satisfaction, namely: high perceived confidence for app usability, positive perceptions of exercise videos, viable exercise option at home, orientation and familiarity required for successful participation, and app issues. Participants acknowledged that the final app was ready to be delivered to the public after minor revisions. After including these revisions, the project team released the final app that is being used in the randomized controlled trial. Conclusions A multi-level user-centered development process resulted in the development of an inclusive exercise program for people with multiple sclerosis operated through an easy-to-use app. The promotion of exercise through self-regulated mHealth programs requires a stakeholder-driven approach to app development. This ensures that app and content match the preferences and functional abilities of the end user (ie, people with varying levels of multiple sclerosis). PMID:29798832

TEAMS (Tele-Exercise and Multiple Sclerosis), a Tailored Telerehabilitation mHealth App: Participant-Centered Development and Usability Study.

PubMed

Thirumalai, Mohanraj; Rimmer, James H; Johnson, George; Wilroy, Jereme; Young, Hui-Ju; Mehta, Tapan; Lai, Byron

2018-05-24

People with multiple sclerosis face varying levels of disability and symptoms, thus requiring highly trained therapists and/or exercise trainers to design personalized exercise programs. However, for people living in geographically isolated communities, access to such trained professionals can be challenging due to a number of barriers associated with cost, access to transportation, and travel distance. Generic mobile health exercise apps often fall short of what people with multiple sclerosis need to become physically active (ie, exercise content that has been adapted to accommodate a wide range of functional limitations). This usability study describes the development process of the TEAMS (Tele-Exercise and Multiple Sclerosis) app, which is being used by people with multiple sclerosis in a large randomized controlled trial to engage in home-based telerehabilitation. Twenty-one participants with disabilities (10 people with multiple sclerosis) were involved in the double iterative design, which included the simultaneous development of the app features and exercise content (exercise videos and articles). Framed within a user-centered design approach, the development process included 2 stages: ground-level creation (focus group followed by early stage evaluations and developments), and proof of concept through 2 usability tests. Usability (effectiveness, usefulness, and satisfaction) was evaluated using a mixed-methods approach. During testing of the app's effectiveness, the second usability test resulted in an average of 1 problem per participant, a decrease of 53% compared to the initial usability test. Five themes were constructed from the qualitative data that related to app usefulness and satisfaction, namely: high perceived confidence for app usability, positive perceptions of exercise videos, viable exercise option at home, orientation and familiarity required for successful participation, and app issues. Participants acknowledged that the final app was ready to be delivered to the public after minor revisions. After including these revisions, the project team released the final app that is being used in the randomized controlled trial. A multi-level user-centered development process resulted in the development of an inclusive exercise program for people with multiple sclerosis operated through an easy-to-use app. The promotion of exercise through self-regulated mHealth programs requires a stakeholder-driven approach to app development. This ensures that app and content match the preferences and functional abilities of the end user (ie, people with varying levels of multiple sclerosis). ©Mohanraj Thirumalai, James H Rimmer, George Johnson, Jereme Wilroy, Hui-Ju Young, Tapan Mehta, Byron Lai. Originally published in JMIR Mhealth and Uhealth (http://mhealth.jmir.org), 24.05.2018.

Measurement of Usability for Multimedia Interactive Learning Based on Website in Mathematics for SMK

NASA Astrophysics Data System (ADS)

Sukardjo, Moch.; Sugiyanta, Lipur

2018-04-01

Web usability, if evaluation done correctly, can significantly improve the quality of the website. Website containing multimedia for education shoud apply user interfaces that are both easy to learn and easy to use. Multimedia has big role in changing the mindset of a person in learning. Using multimedia, learners get easy to obtain information, adjust information and empower information. Therefore, multimedia is utilized by teachers in developing learning techniques to improve student learning outcomes. For students with self-directed learning, multimedia provides the ease and completeness of the courses in such a way that students can complete the learning independently both at school and at home without the guidance of teachers. The learning independence takes place in how students choose, absorb information, and follow the evaluation quickly and efficiently. The 2013 Curriculum 2013 for Vocational High School (SMK) requires teachers to create engaging teaching and learning activities that students enjoy in the classroom (also called invitation learning environment). The creation of learning activity environment is still problem for most teachers. Various researches reveal that teaching and learning activities will be more effective and easy when assisted by visual tools. Using multimedia, learning material can be presented more attractively that help students understand the material easily. The opposite is found in the learning activity environment who only rely on ordinary lectures. Usability is a quality level of multimedia with easy to learn, easy to use and encourages users to use it. The website Multimedia Interactive Learning for Mathematics SMK Class X is targeted object. Usability website in Multimedia Interactive Learning for Mathematics SMK Class X is important indicators to measure effectiveness, efficiency, and student satisfaction to access the functionality of website. This usability measurement should be done carefully before the design is implemented thoroughly. The only way to get test with high quality results is to start testing at the beginning of the design process and continuously testing each of the next steps. This research performs usability testing on of website by using WAMMI criterion (Website Analysis and Measurement Inventory) and will be focused on how convenience using the website application. Components of Attractiveness, Controllability, Efficiency, Helpfulness, and Learnability are applied. The website in Multimedia Interactive Learning for Mathematics SMK Class X can be in accordance with the purpose to be accepted by student to improve student learning outcomes. The results show that WAMMI method show the usability value of Multimedia Mathematics SMK Class X is about from 70% to 90%.

Usage, Utility, and Usability of the Knowledge Wall During the Global 2000 War Game

DTIC Science & Technology

2001-08-01

evaluation during the Global 2000 War Game. The prototype KW was designed to meet 14 user requirements identified in a previous cognitive task analysis of potential KW users. This report presents the results of the evaluation.