Investigating Technical and Pedagogical Usability Issues of Collaborative Learning with Wikis

ERIC Educational Resources Information Center

Hadjerrouit, Said

2012-01-01

Wikis have been recently promoted as tools that foster collaborative learning. However, there has been little research devoted to the criteria that are suitable to address issues pertinent to collaborative learning. This paper proposes a set of criteria to explore technical and pedagogical usability issues of collaborative learning with wikis. The…

National Functional Guidelines for Inorganic Superfund Methods Data Review (ISM02.4)

EPA Pesticide Factsheets

This document is designed to assist the reviewer in evaluating (a) whether the analytical data meet the technical and Quality Control (QC) criteria specified in the SOW, and (b) the usability and extent of bias of any data that do not meet these criteria.

Sociotechnical Human Factors Involved in Remote Online Usability Testing of Two eHealth Interventions.

PubMed

Wozney, Lori M; Baxter, Pamela; Fast, Hilary; Cleghorn, Laura; Hundert, Amos S; Newton, Amanda S

2016-02-03

Research in the fields of human performance technology and human computer interaction are challenging the traditional macro focus of usability testing arguing for methods that help test moderators assess "use in context" (ie, cognitive skills, usability understood over time) and in authentic "real world" settings. Human factors in these complex test scenarios may impact on the quality of usability results being derived yet there is a lack of research detailing moderator experiences in these test environments. Most comparative research has focused on the impact of the physical environment on results, and rarely on how the sociotechnical elements of the test environment affect moderator and test user performance. Improving our understanding of moderator roles and experiences with conducting "real world" usability testing can lead to improved techniques and strategies To understand moderator experiences of using Web-conferencing software to conduct remote usability testing of 2 eHealth interventions. An exploratory case study approach was used to study 4 moderators' experiences using Blackboard Collaborate for remote testing sessions of 2 different eHealth interventions. Data collection involved audio-recording iterative cycles of test sessions, collecting summary notes taken by moderators, and conducting 2 90-minute focus groups via teleconference. A direct content analysis with an inductive coding approach was used to explore personal accounts, assess the credibility of data interpretation, and generate consensus on the thematic structure of the results. Following the convergence of data from the various sources, 3 major themes were identified: (1) moderators experienced and adapted to unpredictable changes in cognitive load during testing; (2) moderators experienced challenges in creating and sustaining social presence and untangling dialogue; and (3) moderators experienced diverse technical demands, but were able to collaboratively troubleshoot with test users. Results highlight important human-computer interactions and human factor qualities that impact usability testing processes. Moderators need an advanced skill and knowledge set to address the social interaction aspects of Web-based usability testing and technical aspects of conferencing software during test sessions. Findings from moderator-focused studies can inform the design of remote testing platforms and real-time usability evaluation processes that place less cognitive burden on moderators and test users.

Training Teachers and Serving Students: Applying Usability Testing in Writing Programs

ERIC Educational Resources Information Center

McGovern, Heather

2007-01-01

Teachers often test course materials by using them in class. Usability testing provides an alternative: teachers receive student feedback and revise materials "before" teaching a class. Case studies based on interviews and observations with two teaching assistants who usability tested materials before teaching introductory technical writing…

Usability 101: A Pilot Test of DOE PAGES Beta | OSTI, US Dept of Energy

Science.gov Websites

Office of Scientific and Technical Information skip to main content Sign In Create Account OSTI.GOV title logo U.S. Department of Energy Office of Scientific and Technical Information Search terms News Sign In Create Account This page is being shared by OSTI.GOV. Usability 101: A Pilot Test of DOE

Web-based Education for Low-literate Parents in Neonatal Intensive Care Unit: Development of a Website and Heuristic Evaluation and Usability Testing

PubMed Central

Choi, Jeungok; Bakken, Suzanne

2010-01-01

Purpose Low health literacy has been associated with poor health-related outcomes. The purposes are to report the development of a website for low-literate parents in the Neonatal Intensive Care Unit (NICU), and the findings of heuristic evaluation and a usability testing of this website. Methods To address low literacy of NICU parents, multimedia educational Website using visual aids (e.g., pictographs, photographs), voice-recorded text message in addition to a simplified text was developed. The text was created at the 5th grade readability level. The heuristic evaluation was conducted by three usability experts using 10 heuristics. End-users’ performance was measured by counting the time spent completing tasks and number of errors, as well as recording users’ perception of ease of use and usefulness (PEUU) in a sample of 10 NICU parents. Results Three evaluators identified 82 violations across the 10 heuristics. All violations, however, received scores <2, indicating minor usability problems. Participants’ time to complete task varies from 81.2 seconds (SD=30.9) to 2.2 seconds (SD=1.3). Participants rated the Website as easy to use and useful (PEUU Mean= 4.52, SD=0.53). Based on the participants’ comments, appropriate modifications were made. Discussion and Conclusions Different types of visuals on the Website were well accepted by low-literate users and agreement of visuals with text improved understanding of the educational materials over that with text alone. The findings suggest that using concrete and realistic pictures and pictographs with clear captions would maximize the benefit of visuals. One emerging theme was “simplicity” in design (e.g., limited use of colors, one font type and size), content (e.g., avoid lengthy text), and technical features (e.g., limited use of pop-ups). The heuristic evaluation by usability experts and the usability test with actual users provided complementary expertise, which can give a richer assessment of a design for low literacy Website. These results facilitated design modification and implementation of solutions by categorizing and prioritizing the usability problems. PMID:20617546

Web-based education for low-literate parents in Neonatal Intensive Care Unit: development of a website and heuristic evaluation and usability testing.

PubMed

Choi, Jeungok; Bakken, Suzanne

2010-08-01

Low health literacy has been associated with poor health-related outcomes. The purposes are to report the development of a website for low-literate parents in the Neonatal Intensive Care Unit (NICU), and the findings of heuristic evaluation and a usability testing of this website. To address low literacy of NICU parents, multimedia educational Website using visual aids (e.g., pictographs, photographs), voice-recorded text message in addition to a simplified text was developed. The text was created at the 5th grade readability level. The heuristic evaluation was conducted by three usability experts using 10 heuristics. End-users' performance was measured by counting the time spent completing tasks and number of errors, as well as recording users' perception of ease of use and usefulness (PEUU) in a sample of 10 NICU parents. Three evaluators identified 82 violations across the 10 heuristics. All violations, however, received scores <2, indicating minor usability problems. Participants' time to complete task varies from 81.2 s (SD = 30.9) to 2.2 s (SD = 1.3). Participants rated the Website as easy to use and useful (PEUU mean = 4.52, SD = 0.53). Based on the participants' comments, appropriate modifications were made. Different types of visuals on the Website were well accepted by low-literate users and agreement of visuals with text improved understanding of the educational materials over that with text alone. The findings suggest that using concrete and realistic pictures and pictographs with clear captions would maximize the benefit of visuals. One emerging theme was "simplicity" in design (e.g., limited use of colors, one font type and size), content (e.g., avoid lengthy text), and technical features (e.g., limited use of pop-ups). The heuristic evaluation by usability experts and the usability test with actual users provided complementary expertise, which can give a richer assessment of a design for low literacy Website. These results facilitated design modification and implementation of solutions by categorizing and prioritizing the usability problems.

Investigation of the Usability of Computerized Critical Care Information Systems in Germany.

PubMed

von Dincklage, Falk; Suchodolski, Klaudiusz; Lichtner, Gregor; Friesdorf, Wolfgang; Podtschaske, Beatrice; Ragaller, Maximilian

2017-01-01

The term "usability" describes how effectively, efficiently, and with what level of user satisfaction an information system can be used to accomplish specific goals. Computerized critical care information systems (CCISs) with high usability increase quality of care and staff satisfaction, while reducing medication errors. Conversely, systems lacking usability can interrupt clinical workflow, facilitate errors, and increase charting time. The aim of this study was to investigate and compare usability across CCIS currently used in Germany. In this study, German intensive care unit (ICU) nurses and physicians completed a specialized, previously validated, web-based questionnaire. The questionnaire assessed CCIS usability based on three rating models: an overall rating of the systems, a model rating technical usability, and a model rating task-specific usability. We analyzed results from 535 survey participants and compared eight different CCIS commonly used in Germany. Our results showed that usability strongly differs across the compared systems. The system ICUData had the best overall rating and technical usability, followed by the platforms ICM and MetaVision. The same three systems performed best in the rating of task-specific usability without significant differences between each other. Across all systems, overall ratings were more dependent on ease-of-use aspects than on aspects of utility/functionality, and the general scope of the functions offered was rated better than how well the functions are realized. Our results suggest that manufacturers should shift some of their effort away from the development of new features and focus more on improving the ease-of-use and quality of existing features.

A Learning Evaluation for an Immersive Virtual Laboratory for Technical Training Applied into a Welding Workshop

ERIC Educational Resources Information Center

Torres, Francisco; Neira Tovar, Leticia A.; del Rio, Marta Sylvia

2017-01-01

This study aims to explore the results of welding virtual training performance, designed using a learning model based on cognitive and usability techniques, applying an immersive concept focused on person attention. Moreover, it also intended to demonstrate that exits a moderating effect of performance improvement when the user experience is taken…

Sociotechnical Human Factors Involved in Remote Online Usability Testing of Two eHealth Interventions

PubMed Central

2016-01-01

Background Research in the fields of human performance technology and human computer interaction are challenging the traditional macro focus of usability testing arguing for methods that help test moderators assess “use in context” (ie, cognitive skills, usability understood over time) and in authentic “real world” settings. Human factors in these complex test scenarios may impact on the quality of usability results being derived yet there is a lack of research detailing moderator experiences in these test environments. Most comparative research has focused on the impact of the physical environment on results, and rarely on how the sociotechnical elements of the test environment affect moderator and test user performance. Improving our understanding of moderator roles and experiences with conducting “real world” usability testing can lead to improved techniques and strategies Objective To understand moderator experiences of using Web-conferencing software to conduct remote usability testing of 2 eHealth interventions. Methods An exploratory case study approach was used to study 4 moderators’ experiences using Blackboard Collaborate for remote testing sessions of 2 different eHealth interventions. Data collection involved audio-recording iterative cycles of test sessions, collecting summary notes taken by moderators, and conducting 2 90-minute focus groups via teleconference. A direct content analysis with an inductive coding approach was used to explore personal accounts, assess the credibility of data interpretation, and generate consensus on the thematic structure of the results. Results Following the convergence of data from the various sources, 3 major themes were identified: (1) moderators experienced and adapted to unpredictable changes in cognitive load during testing; (2) moderators experienced challenges in creating and sustaining social presence and untangling dialogue; and (3) moderators experienced diverse technical demands, but were able to collaboratively troubleshoot with test users. Conclusions Results highlight important human-computer interactions and human factor qualities that impact usability testing processes. Moderators need an advanced skill and knowledge set to address the social interaction aspects of Web-based usability testing and technical aspects of conferencing software during test sessions. Findings from moderator-focused studies can inform the design of remote testing platforms and real-time usability evaluation processes that place less cognitive burden on moderators and test users. PMID:27026291

Usability evaluation with mental health professionals and young people to develop an Internet-based cognitive-behaviour therapy program for adolescents with anxiety disorders.

PubMed

Wozney, Lori; Baxter, Pamela; Newton, Amanda S

2015-12-16

Use of the Internet to deliver cognitive behavioural therapy, a frontline treatment for anxiety disorders, is emerging as an option to increase access to treatment among adolescents with anxiety disorders. This study examined the usability of the Internet-based component of Breathe, a CBT program designed for adolescents with mild to moderate anxiety and impairments. A mixed-method usability testing design with semi-structured interviews, task completion, and survey by trained usability moderators was undertaken with two interactive cycles to determine the usability (ease of use, efficiency, errors, and user satisfaction) of the user interface and content areas of the program. Purposeful sampling was used to recruit mental health clinicians with expertise in treating adolescent anxiety disorders and young people aged 15 to 24 years involved. Testing involved using Web-conferencing software that allowed remote participation through personal computers. Two testing cycles involved participants completing structured 'think aloud' and 'cognitive walkthrough' tasks within the program. At the end of each cycle participants completed a 15-item global usability evaluation survey and were asked a series of open-ended questions. Descriptive and simple content analyses were used to identify and score usability issues for frequency and severity. Five clinicians and four young people (all < 20 years of age) participated. Most participants described their computer skills as 'good' (60% clinicians, 50% young people), and attitudes toward Internet-based health care ranged from negative (75% young people) to positive (60% clinicians, 25% young people). Scores from the global usability evaluation after both testing cycles ranged from 3.5 to 5 out of 5 in strong agreement/support of the program in terms of user performance indicators (i.e., learnability, efficiency and number of errors) and user satisfaction. Participants were able to complete all critical tasks with minimal errors. Errors and issues identified during testing were predominantly around enhancements to the visual design and navigational support. Opinions across usability elements did not differ between young people and clinician participants. A multi-method remote usability approach provided the opportunity to improve the technical interface, therapeutic messaging and user experience of an Internet-based treatment program for adolescent anxiety disorders.

Evaluation of Standardized Instruments for Use in Universal Screening of Very Early School-Age Children: Suitability, Technical Adequacy, and Usability

ERIC Educational Resources Information Center

Miles, Sandra; Fulbrook, Paul; Mainwaring-Mägi, Debra

2018-01-01

Universal screening of very early school-age children (age 4-7 years) is important for early identification of learning problems that may require enhanced learning opportunity. In this context, use of standardized instruments is critical to obtain valid, reliable, and comparable assessment outcomes. A wide variety of standardized instruments is…

Preliminary study of online machine translation use of nursing literature: quality evaluation and perceived usability

PubMed Central

2012-01-01

Background Japanese nurses are increasingly required to read published international research in clinical, educational, and research settings. Language barriers are a significant obstacle, and online machine translation (MT) is a tool that can be used to address this issue. We examined the quality of Google Translate® (English to Japanese and Korean to Japanese), which is a representative online MT, using a previously verified evaluation method. We also examined the perceived usability and current use of online MT among Japanese nurses. Findings Randomly selected nursing abstracts were translated and then evaluated for intelligibility and usability by 28 participants, including assistants and research associates from nursing universities throughout Japan. They answered a questionnaire about their online MT use. From simple comparison of mean scores between two language pairs, translation quality was significantly better, with respect to both intelligibility and usability, for Korean-Japanese than for English-Japanese. Most respondents perceived a language barrier. Online MT had been used by 61% of the respondents and was perceived as not useful enough. Conclusion Nursing articles translated from Korean into Japanese by an online MT system could be read at an acceptable level of comprehension, but the same could not be said for English-Japanese translations. Respondents with experience using online MT used it largely to grasp the overall meanings of the original text. Enrichment in technical terms appeared to be the key to better usability. Users will be better able to use MT outputs if they improve their foreign language proficiency as much as possible. Further research is being conducted with a larger sample size and detailed analysis. PMID:23151362

Clinical evaluation of BrainTree, a motor imagery hybrid BCI speller

NASA Astrophysics Data System (ADS)

Perdikis, S.; Leeb, R.; Williamson, J.; Ramsay, A.; Tavella, M.; Desideri, L.; Hoogerwerf, E.-J.; Al-Khodairy, A.; Murray-Smith, R.; Millán, J. d. R.

2014-06-01

Objective. While brain-computer interfaces (BCIs) for communication have reached considerable technical maturity, there is still a great need for state-of-the-art evaluation by the end-users outside laboratory environments. To achieve this primary objective, it is necessary to augment a BCI with a series of components that allow end-users to type text effectively. Approach. This work presents the clinical evaluation of a motor imagery (MI) BCI text-speller, called BrainTree, by six severely disabled end-users and ten able-bodied users. Additionally, we define a generic model of code-based BCI applications, which serves as an analytical tool for evaluation and design. Main results. We show that all users achieved remarkable usability and efficiency outcomes in spelling. Furthermore, our model-based analysis highlights the added value of human-computer interaction techniques and hybrid BCI error-handling mechanisms, and reveals the effects of BCI performances on usability and efficiency in code-based applications. Significance. This study demonstrates the usability potential of code-based MI spellers, with BrainTree being the first to be evaluated by a substantial number of end-users, establishing them as a viable, competitive alternative to other popular BCI spellers. Another major outcome of our model-based analysis is the derivation of a 80% minimum command accuracy requirement for successful code-based application control, revising upwards previous estimates attempted in the literature.

Clinical evaluation of BrainTree, a motor imagery hybrid BCI speller.

PubMed

Perdikis, S; Leeb, R; Williamson, J; Ramsay, A; Tavella, M; Desideri, L; Hoogerwerf, E-J; Al-Khodairy, A; Murray-Smith, R; Millán, J D R

2014-06-01

While brain-computer interfaces (BCIs) for communication have reached considerable technical maturity, there is still a great need for state-of-the-art evaluation by the end-users outside laboratory environments. To achieve this primary objective, it is necessary to augment a BCI with a series of components that allow end-users to type text effectively. This work presents the clinical evaluation of a motor imagery (MI) BCI text-speller, called BrainTree, by six severely disabled end-users and ten able-bodied users. Additionally, we define a generic model of code-based BCI applications, which serves as an analytical tool for evaluation and design. We show that all users achieved remarkable usability and efficiency outcomes in spelling. Furthermore, our model-based analysis highlights the added value of human-computer interaction techniques and hybrid BCI error-handling mechanisms, and reveals the effects of BCI performances on usability and efficiency in code-based applications. This study demonstrates the usability potential of code-based MI spellers, with BrainTree being the first to be evaluated by a substantial number of end-users, establishing them as a viable, competitive alternative to other popular BCI spellers. Another major outcome of our model-based analysis is the derivation of a 80% minimum command accuracy requirement for successful code-based application control, revising upwards previous estimates attempted in the literature.

[The development and evaluation of software to verify diagnostic accuracy].

PubMed

Jensen, Rodrigo; de Moraes Lopes, Maria Helena Baena; Silveira, Paulo Sérgio Panse; Ortega, Neli Regina Siqueira

2012-02-01

This article describes the development and evaluation of software that verifies the accuracy of diagnoses made by nursing students. The software was based on a model that uses fuzzy logic concepts, including PERL, the MySQL database for Internet accessibility, and the NANDA-I 2007-2008 classification system. The software was evaluated in terms of its technical quality and usability through specific instruments. The activity proposed in the software involves four stages in which students establish the relationship values between nursing diagnoses, defining characteristics/risk factors and clinical cases. The relationship values determined by students are compared to those of specialists, generating performance scores for the students. In the evaluation, the software demonstrated satisfactory outcomes regarding the technical quality and, according to the students, helped in their learning and may become an educational tool to teach the process of nursing diagnosis.

Field Test Report of the Self-Directed, Interpretive, and Creative Reading Elements of the Wisconsin Design for Reading Skill Development. Technical Report No. 330.

ERIC Educational Resources Information Center

Chester, Robert; And Others

This study of the self-directed, interpretive, and creative reading elements of the Wisconsin Design for Reading Skill Development was conducted to gather descriptive data about implementation strategies being developed and practiced by field test teachers and to gather evaluative information about the usability of various management and…

Computer Security Issues in Online Banking: An Assessment from the Context of Usable Security

NASA Astrophysics Data System (ADS)

Mahmadi, FN; Zaaba, ZF; Osman, A.

2016-11-01

Today's online banking is a convenient mode of finance management. Despite the ease of doing online banking, there are people that still sceptical in utilizing it due to perception and its security. This paper highlights the subject of online banking security in Malaysia, especially from the perspective of the end-users. The study is done by assessing human computer interaction, usability and security. An online survey utilising 137 participants was previously conducted to gain preliminary insights on security issues of online banking in Malaysia. Following from those results, 37 participants were interviewed to gauge deeper understanding about end-users perception on online banking within the context of usable security. The results suggested that most of the end-users are continuingly experiencing significant difficulties especially in relation to the technical terminologies, security features and other technical issues. Although the security features are provided to provide a shield or protection, users are still incapable to cope with the technical aspects of such implementation.

User needs analysis and usability assessment of DataMed - a biomedical data discovery index.

PubMed

Dixit, Ram; Rogith, Deevakar; Narayana, Vidya; Salimi, Mandana; Gururaj, Anupama; Ohno-Machado, Lucila; Xu, Hua; Johnson, Todd R

2017-11-30

To present user needs and usability evaluations of DataMed, a Data Discovery Index (DDI) that allows searching for biomedical data from multiple sources. We conducted 2 phases of user studies. Phase 1 was a user needs analysis conducted before the development of DataMed, consisting of interviews with researchers. Phase 2 involved iterative usability evaluations of DataMed prototypes. We analyzed data qualitatively to document researchers' information and user interface needs. Biomedical researchers' information needs in data discovery are complex, multidimensional, and shaped by their context, domain knowledge, and technical experience. User needs analyses validate the need for a DDI, while usability evaluations of DataMed show that even though aggregating metadata into a common search engine and applying traditional information retrieval tools are promising first steps, there remain challenges for DataMed due to incomplete metadata and the complexity of data discovery. Biomedical data poses distinct problems for search when compared to websites or publications. Making data available is not enough to facilitate biomedical data discovery: new retrieval techniques and user interfaces are necessary for dataset exploration. Consistent, complete, and high-quality metadata are vital to enable this process. While available data and researchers' information needs are complex and heterogeneous, a successful DDI must meet those needs and fit into the processes of biomedical researchers. Research directions include formalizing researchers' information needs, standardizing overviews of data to facilitate relevance judgments, implementing user interfaces for concept-based searching, and developing evaluation methods for open-ended discovery systems such as DDIs. © The Author 2017. Published by Oxford University Press on behalf of the American Medical Informatics Association. All rights reserved. For Permissions, please email: journals.permissions@oup.com

The Unfortunate Human Factor: A Selective History of Human Factors for Technical Communicators.

ERIC Educational Resources Information Center

Johnson, Robert R.

1994-01-01

Reviews moments in the history of human factors that are especially relevant to the field of technical communications. Discusses human factors research that is applicable to technical communications. Focuses on qualitative usability research, minimalism, and human activity interface design. (HB)

A continuous usability evaluation of an electronic medication administration record application.

PubMed

Vicente Oliveros, Noelia; Gramage Caro, Teresa; Pérez Menéndez-Conde, Covadonga; Álvarez-Diaz, Ana María; Martín-Aragón Álvarez, Sagrario; Bermejo Vicedo, Teresa; Delgado Silveira, Eva

2017-12-01

The complexity of an electronic medication administration record (eMAR) has been underestimated by most designers in the past. Usability issues, such as poorly designed user application flow in eMAR, are therefore of vital importance, since they can have a negative impact on nursing activities and result in poor outcomes. The purpose of this study was to evaluate the usability of an eMAR application during its development. A usability evaluation was conducted during the development of the eMAR application. Two usability methods were used: a heuristic evaluation complemented by usability testing. Each eMAR application version provided by the vendor was evaluated by 2 hospital pharmacists, who applied the heuristic method. They reviewed the eMAR tasks, detected usability problems and their heuristic violations, and rated the severity of the usability problems. Usability testing was used to assess the final application version by observing how 3 nurses interacted with the application. Thirty-four versions were assessed before the eMAR application was considered usable. During the heuristic evaluation, the usability problems decreased from 46 unique usability problems in version 1 (V1) to 9 in version 34 (V34). In V1, usability problems were categorized into 154 heuristic violations, which decreased to 27 in V34. The average severity rating also decreased from major usability problem (2.96) to no problem (0.23). During usability testing, the 3 nurses did not encounter new usability problems. A thorough heuristic evaluation is a good method for obtaining a usable eMAR application. This evaluation points key areas for improvement and decreases usability problems and their severity. © 2017 John Wiley & Sons, Ltd.

Interactivity Centered Usability Evaluation (ICUE) for Course Management Systems

ERIC Educational Resources Information Center

Yoon, Sangil

2010-01-01

ICUE (Interactivity Centered Usability Evaluation) is an enhanced usability testing protocol created by the researcher. ICUE augments the facilitator's role for usability testing, and offers strategies in developing and presenting usability tasks during a testing session. ICUE was designed to address weaknesses found in the usability evaluation of…

Development and evaluation of a patient-centred measurement tool for surgeons' non-technical skills.

PubMed

Yule, J; Hill, K; Yule, S

2018-06-01

Non-technical skills are essential for safe and effective surgery. Several tools to assess surgeons' non-technical skills from the clinician's perspective have been developed. However, a reliable measurement tool using a patient-centred approach does not currently exist. The aim of this study was to translate the existing Non-Technical Skills for Surgeons (NOTSS) tool into a patient-centred evaluation tool. Data were gathered from four cohorts of patients using an iterative four-stage mixed-methods research design. Exploratory and confirmatory factor analyses were performed to establish the psychometric properties of the tool, focusing on validity, reliability, usability and parsimony. Some 534 patients were recruited to the study. A total of 24 patient-centred non-technical skill items were developed in stage 1, and reduced to nine items in stage 2 using exploratory factor analysis. In stage 3, confirmatory factor analysis demonstrated that these nine items each loaded on to one of three factors, with excellent internal consistency: decision-making, leadership, and communication and teamwork. In stage 4, validity testing established that the new tool was independent of physician empathy and predictive of surgical quality. Surgical leadership emerged as the most dominant skill that patients could recognize and evaluate. A novel nine-item assessment tool has been developed. The Patients' Evaluation of Non-Technical Skills (PENTS) tool allows valid and reliable measurement of surgeons' non-technical skills from the patient perspective. © 2018 BJS Society Ltd Published by John Wiley & Sons Ltd.

Informational content, literacy demands, and usability of websites offering health-related genetic tests directly to consumers.

PubMed

Lachance, Christina R; Erby, Lori A H; Ford, Beth M; Allen, Vincent C; Kaphingst, Kimberly A

2010-05-01

As direct-to-consumer genetic testing becomes more available, a diverse group of consumers, including those with limited health literacy, may consider testing. In light of concerns raised about direct-to-consumer genetic testing, this study sought to critically examine whether the informational content, literacy demands, and usability of health-related direct-to-consumer websites met existing recommendations. A content analysis was performed on 29 health-related direct-to-consumer websites. Two coders independently evaluated each website for informational content (e.g., benefits, limitations), literacy demands (e.g., reading level), and usability (e.g., ease of navigation). Most sites presented health conditions and some markers for which they tested, benefits of testing, a description of the testing process, and their privacy policy. Fewer cited scientific literature, explained test limitations, or provided an opportunity to consult a health professional. Key informational content was difficult to locate on most sites. Few sites gave sample disease risk estimates or used common language and explained technical terms consistently. Average reading level was grade 15. The quality of informational content, literacy demands, and usability across health-related direct-to-consumer websites varied widely. Many users would struggle to find and understand the important information. For consumers to better understand the content on these sites and evaluate the meaning of the tests for their health, sites should lower the demands placed on users by distilling and prioritizing the key informational content while simultaneously attending to the reading level and usability elements. In the absence of regulation compelling such changes, government agencies or professional organizations may need to increase consumer and provider awareness of these issues.

Perceived Usability Evaluation of Learning Management Systems: Empirical Evaluation of the System Usability Scale

ERIC Educational Resources Information Center

Orfanou, Konstantina; Tselios, Nikolaos; Katsanos, Christos

2015-01-01

Perceived usability affects greatly student's learning effectiveness and overall learning experience, and thus is an important requirement of educational software. The System Usability Scale (SUS) is a well-researched and widely used questionnaire for perceived usability evaluation. However, surprisingly few studies have used SUS to evaluate the…

Designing an Affordable Usability Test for E-Learning Modules

ERIC Educational Resources Information Center

O'Bryan, Corliss A.; Johnson, Donald M.; Shores-Ellis, Katrina D.; Crandall, Philip G.; Marcy, John A.; Seideman, Steve C.; Ricke, Steven C.

2010-01-01

This article provides background and an introduction to a user-centered design and usability test in an inexpensive format that allows content experts who are novices in e-learning development to perform testing on newly developed technical training modules prior to their release. The use of a small number of test participants, avoidance of…

A methodology for evaluating the usability of audiovisual consumer electronic products.

PubMed

Kwahk, Jiyoung; Han, Sung H

2002-09-01

Usability evaluation is now considered an essential procedure in consumer product development. Many studies have been conducted to develop various techniques and methods of usability evaluation hoping to help the evaluators choose appropriate methods. However, planning and conducting usability evaluation requires considerations of a number of factors surrounding the evaluation process including the product, user, activity, and environmental characteristics. In this perspective, this study suggested a new methodology of usability evaluation through a simple, structured framework. The framework was outlined by three major components: the interface features of a product as design variables, the evaluation context consisting of user, product, activity, and environment as context variables, and the usability measures as dependent variables. Based on this framework, this study established methods to specify the product interface features, to define evaluation context, and to measure usability. The effectiveness of this methodology was demonstrated through case studies in which the usability of audiovisual products was evaluated by using the methods developed in this study. This study is expected to help the usability practitioners in consumer electronics industry in various ways. Most directly, it supports the evaluators' plan and conduct usability evaluation sessions in a systematic and structured manner. In addition, it can be applied to other categories of consumer products (such as appliances, automobiles, communication devices, etc.) with minor modifications as necessary.

Towards a virtual health record for mobile home care of elderly citizens.

PubMed

Koch, Sabine; Hägglund, Maria; Scandurra, Isabella; Moström, Dennis

2004-01-01

Mobile work situations within home care of the elderly require immediate and ubiquitous access to patient-oriented data. The ongoing Swedish research project "Technical support for Mobile CloseCare" focuses on the development and evaluation of work-scenario oriented ICT support for enhanced home care of elderly citizens. The aim of the project is to provide a seamless and consistent information flow between different health care providers and to give intuitive access to information services for the elderly and their relatives. For that purpose, different independent software components are connected through a mobile communication platform. Flexible access to prioritized information for different users in different work situations will be given through a virtual health record. In order to obtain both usable and clinically relevant results, a user centered system development approach is followed. Evaluation of the project results will be based on usability tests and quasi-experimental studies on how system implementation influences quality of care and job- and life satisfaction for care providers, patients and relatives.

Workload measurement in a communication application operated through a P300-based brain-computer interface

NASA Astrophysics Data System (ADS)

Riccio, A.; Leotta, F.; Bianchi, L.; Aloise, F.; Zickler, C.; Hoogerwerf, E.-J.; Kübler, A.; Mattia, D.; Cincotti, F.

2011-04-01

Advancing the brain-computer interface (BCI) towards practical applications in technology-based assistive solutions for people with disabilities requires coping with problems of accessibility and usability to increase user acceptance and satisfaction. The main objective of this study was to introduce a usability-oriented approach in the assessment of BCI technology development by focusing on evaluation of the user's subjective workload and satisfaction. The secondary aim was to compare two applications for a P300-based BCI. Eight healthy subjects were asked to use an assistive technology solution which integrates the P300-based BCI with commercially available software under two conditions—visual stimuli needed to evoke the P300 response were either overlaid onto the application's graphical user interface or presented on a separate screen. The two conditions were compared for effectiveness (level of performance), efficiency (subjective workload measured by means of NASA-TXL) and satisfaction of the user. Although no significant difference in usability could be detected between the two conditions, the methodology proved to be an effective tool to highlight weaknesses in the technical solution.

Web-Based Teaching and Learning Approach (WBTLA) Usability in Institutions of Higher Learning in Malaysia

ERIC Educational Resources Information Center

Nordin, Abu Bakar; Alias, Norlidah

2013-01-01

Today teachers in schools and lecturers in institutions of higher learning are endowed with a wide range of new teaching experiences through web-based teaching and learning approaches (WBTLA), which was not possible before through the traditional classroom approach. With the use of WBTLA emerged problems related to usability in technical,…

Post-deployment usability evaluation of a radiology workstation.

PubMed

Jorritsma, Wiard; Cnossen, Fokie; Dierckx, Rudi A; Oudkerk, Matthijs; Van Ooijen, Peter M A

2016-01-01

To determine the number, nature and severity of usability issues radiologists encounter while using a commercially available radiology workstation in clinical practice, and to assess how well the results of a pre-deployment usability evaluation of this workstation generalize to clinical practice. The usability evaluation consisted of semi-structured interviews and observations of twelve users using the workstation during their daily work. Usability issues and positive usability findings were documented. Each issue was given a severity rating and its root cause was determined. Results were compared to the results of a pre-deployment usability evaluation of the same workstation. Ninety-two usability issues were identified, ranging from issues that cause minor frustration or delay, to issues that cause significant delays, prevent users from completing tasks, or even pose a potential threat to patient safety. The results of the pre-deployment usability evaluation had limited generalizability to clinical practice. This study showed that radiologists encountered a large number and a wide variety of usability issues when using a commercially available radiology workstation in clinical practice. This underlines the need for effective usability engineering in radiology. Given the limitations of pre-deployment usability evaluation in radiology, which were confirmed by our finding that the results of a pre-deployment usability evaluation of this workstation had limited generalizability to clinical practice, it is vital that radiology workstation vendors devote significant resources to usability engineering efforts before deployment of their workstation, and to continue these efforts after the workstation is deployed in a hospital. Copyright © 2015 Elsevier Ireland Ltd. All rights reserved.

Using a fuzzy comprehensive evaluation method to determine product usability: A test case

PubMed Central

Zhou, Ronggang; Chan, Alan H. S.

2016-01-01

BACKGROUND: In order to take into account the inherent uncertainties during product usability evaluation, Zhou and Chan [1] proposed a comprehensive method of usability evaluation for products by combining the analytic hierarchy process (AHP) and fuzzy evaluation methods for synthesizing performance data and subjective response data. This method was designed to provide an integrated framework combining the inevitable vague judgments from the multiple stages of the product evaluation process. OBJECTIVE AND METHODS: In order to illustrate the effectiveness of the model, this study used a summative usability test case to assess the application and strength of the general fuzzy usability framework. To test the proposed fuzzy usability evaluation framework [1], a standard summative usability test was conducted to benchmark the overall usability of a specific network management software. Based on the test data, the fuzzy method was applied to incorporate both the usability scores and uncertainties involved in the multiple components of the evaluation. Then, with Monte Carlo simulation procedures, confidence intervals were used to compare the reliabilities among the fuzzy approach and two typical conventional methods combining metrics based on percentages. RESULTS AND CONCLUSIONS: This case study showed that the fuzzy evaluation technique can be applied successfully for combining summative usability testing data to achieve an overall usability quality for the network software evaluated. Greater differences of confidence interval widths between the method of averaging equally percentage and weighted evaluation method, including the method of weighted percentage averages, verified the strength of the fuzzy method. PMID:28035942

Using a fuzzy comprehensive evaluation method to determine product usability: A test case.

PubMed

Zhou, Ronggang; Chan, Alan H S

2017-01-01

In order to take into account the inherent uncertainties during product usability evaluation, Zhou and Chan [1] proposed a comprehensive method of usability evaluation for products by combining the analytic hierarchy process (AHP) and fuzzy evaluation methods for synthesizing performance data and subjective response data. This method was designed to provide an integrated framework combining the inevitable vague judgments from the multiple stages of the product evaluation process. In order to illustrate the effectiveness of the model, this study used a summative usability test case to assess the application and strength of the general fuzzy usability framework. To test the proposed fuzzy usability evaluation framework [1], a standard summative usability test was conducted to benchmark the overall usability of a specific network management software. Based on the test data, the fuzzy method was applied to incorporate both the usability scores and uncertainties involved in the multiple components of the evaluation. Then, with Monte Carlo simulation procedures, confidence intervals were used to compare the reliabilities among the fuzzy approach and two typical conventional methods combining metrics based on percentages. This case study showed that the fuzzy evaluation technique can be applied successfully for combining summative usability testing data to achieve an overall usability quality for the network software evaluated. Greater differences of confidence interval widths between the method of averaging equally percentage and weighted evaluation method, including the method of weighted percentage averages, verified the strength of the fuzzy method.

Evaluating a Proof-of-Concept Approach of the German Health Telematics Infrastructure in the Context of Discharge Management.

PubMed

Hübner, Ursula; Schulte, Georg; Sellemann, Björn; Quade, Matthias; Rottmann, Thorsten; Fenske, Matthias; Egbert, Nicole; Kuhlisch, Raik; Rienhoff, Otto

2015-01-01

Although national eHealth strategies have existed now for more than a decade in many countries, they have been implemented with varying success. In Germany, the eHealth strategy so far has resulted in a roll out of electronic health cards for all citizens in the statutory health insurance, but in no clinically meaningful IT-applications. The aim of this study was to test the technical and organisation feasibility, usability, and utility of an eDischarge application embedded into a laboratory Health Telematics Infrastructure (TI). The tests embraced the exchange of eDischarge summaries based on the multiprofessional HL7 eNursing Summary standard between a municipal hospital and a nursing home. All in all, 36 transmissions of electronic discharge documents took place. They demonstrated the technical-organisation feasibility and resulted in moderate usability ratings. A comparison between eDischarge and paper-based summaries hinted at higher ratings of utility and information completeness for eDischarges. Despite problems with handling the electronic health card, the proof-of-concept for the first clinically meaningful IT-application in the German Health TI could be regarded as successful.

OPTIMIZING USABILITY OF AN ECONOMIC DECISION SUPPORT TOOL: PROTOTYPE OF THE EQUIPT TOOL.

PubMed

Cheung, Kei Long; Hiligsmann, Mickaël; Präger, Maximilian; Jones, Teresa; Józwiak-Hagymásy, Judit; Muñoz, Celia; Lester-George, Adam; Pokhrel, Subhash; López-Nicolás, Ángel; Trapero-Bertran, Marta; Evers, Silvia M A A; de Vries, Hein

2018-01-01

Economic decision-support tools can provide valuable information for tobacco control stakeholders, but their usability may impact the adoption of such tools. This study aims to illustrate a mixed-method usability evaluation of an economic decision-support tool for tobacco control, using the EQUIPT ROI tool prototype as a case study. A cross-sectional mixed methods design was used, including a heuristic evaluation, a thinking aloud approach, and a questionnaire testing and exploring the usability of the Return of Investment tool. A total of sixty-six users evaluated the tool (thinking aloud) and completed the questionnaire. For the heuristic evaluation, four experts evaluated the interface. In total twenty-one percent of the respondents perceived good usability. A total of 118 usability problems were identified, from which twenty-six problems were categorized as most severe, indicating high priority to fix them before implementation. Combining user-based and expert-based evaluation methods is recommended as these were shown to identify unique usability problems. The evaluation provides input to optimize usability of a decision-support tool, and may serve as a vantage point for other developers to conduct usability evaluations to refine similar tools before wide-scale implementation. Such studies could reduce implementation gaps by optimizing usability, enhancing in turn the research impact of such interventions.

Usability evaluation techniques in mobile commerce applications: A systematic review

NASA Astrophysics Data System (ADS)

Hussain, Azham; Mkpojiogu, Emmanuel O. C.

2016-08-01

Obviously, there are a number of literatures concerning the usability of mobile commerce (m-commerce) applications and related areas, but they do not adequately provide knowledge about usability techniques used in most of the empirical usability evaluation for m-commerce application. Therefore, this paper is aimed at producing the usability techniques frequently used in the aspect of usability evaluation for m-commerce applications. To achieve the stated objective, systematic literature review was employed. Sixty seven papers were downloaded in usability evaluation for m-commerce and related areas; twenty one most relevant studies were selected for review in order to extract the appropriate information. The results from the review shows that heuristic evaluation, formal test and think aloud methods are the most commonly used methods in m-commerce application in comparison to cognitive walkthrough and the informal test methods. Moreover, most of the studies applied control experiment (33.3% of the total studies); other studies that applied case study for usability evaluation are 14.28%. The results from this paper provide additional knowledge to the usability practitioners and research community for the current state and use of usability techniques in m-commerce application.

Combining usability evaluations to highlight the chain that leads from usability flaws to usage problems and then negative outcomes.

PubMed

Watbled, Ludivine; Marcilly, Romaric; Guerlinger, Sandra; Bastien, J-M Christian; Beuscart-Zéphir, Marie-Catherine; Beuscart, Régis

2018-02-01

Poor usability of health technology is thought to diminish work system performance, increase error rates and, potentially, harm patients. The present study (i) used a combination of usability evaluation methods to highlight the chain that leads from usability flaws to usage problems experienced by users and, ultimately, to negative patient outcomes, and (ii) validated this approach by studying two different discharge summary production systems. To comply with quality guidelines, the process of drafting and sending discharge summaries is increasingly being automated. However, the usability of these systems may modify their impact (or the absence thereof) in terms of production times and quality, and must therefore be evaluated. Here, we applied three successive techniques for usability evaluation (heuristic evaluation, user testing and field observation) to two discharge summary production systems (underpinned by different technologies). The systems' main usability flaws led respectively to an increase in the time need to produce a discharge summary and the risk of patient misidentification. Our results are discussed with regard to the possibility of linking the usability flaws, usage problems and the negative outcomes by successively applying three methods for evaluating usability (heuristic evaluation, user testing and in situ observations) throughout the system development life cycle. Copyright © 2018 Elsevier Inc. All rights reserved.

Usability Evaluation of a Web-Based Learning System

ERIC Educational Resources Information Center

Nguyen, Thao

2012-01-01

The paper proposes a contingent, learner-centred usability evaluation method and a prototype tool of such systems. This is a new usability evaluation method for web-based learning systems using a set of empirically-supported usability factors and can be done effectively with limited resources. During the evaluation process, the method allows for…

Using a fuzzy comprehensive evaluation method to determine product usability: A proposed theoretical framework.

PubMed

Zhou, Ronggang; Chan, Alan H S

2017-01-01

In order to compare existing usability data to ideal goals or to that for other products, usability practitioners have tried to develop a framework for deriving an integrated metric. However, most current usability methods with this aim rely heavily on human judgment about the various attributes of a product, but often fail to take into account of the inherent uncertainties in these judgments in the evaluation process. This paper presents a universal method of usability evaluation by combining the analytic hierarchical process (AHP) and the fuzzy evaluation method. By integrating multiple sources of uncertain information during product usability evaluation, the method proposed here aims to derive an index that is structured hierarchically in terms of the three usability components of effectiveness, efficiency, and user satisfaction of a product. With consideration of the theoretical basis of fuzzy evaluation, a two-layer comprehensive evaluation index was first constructed. After the membership functions were determined by an expert panel, the evaluation appraisals were computed by using the fuzzy comprehensive evaluation technique model to characterize fuzzy human judgments. Then with the use of AHP, the weights of usability components were elicited from these experts. Compared to traditional usability evaluation methods, the major strength of the fuzzy method is that it captures the fuzziness and uncertainties in human judgments and provides an integrated framework that combines the vague judgments from multiple stages of a product evaluation process.

Science in the Sun: How Science is Performed as a Spatial Practice

NASA Astrophysics Data System (ADS)

Kass, Natalie

This study analyzes how spatial organization impacts science communication at the St. Petersburg Science Festival in Florida. Through map analysis, qualitative interviews, and a close reading of evaluation reports, the author determines that sponsorship, logistics, exhibitor ambience, and map usability and design are the factors most affecting the spatial performance of science. To mitigate their effects, technical communicators can identify these factors and provide the necessary revisions when considering how science is communicated to the public.

Usability Evaluation of An Electronic Medication Administration Record (eMAR) Application

PubMed Central

Guo, J.; Iribarren, S.; Kapsandoy, S.; Perri, S.; Staggers, N.

2011-01-01

Background Electronic medication administration records (eMARs) have been widely used in recent years. However, formal usability evaluations are not yet available for these vendor applications, especially from the perspective of nurses, the largest group of eMAR users. Objective To conduct a formal usability evaluation of an implemented eMAR. Methods Four evaluators examined a commercial vendor eMAR using heuristic evaluation techniques. The evaluators defined seven tasks typical of eMAR use and independently evaluated the application. Consensus techniques were used to obtain 100% agreement of identified usability problems and severity ratings. Findings were reviewed with 5 clinical staff nurses and the Director of Clinical Informatics who verified findings with a small group of clinical nurses. Results Evaluators found 60 usability problems categorized into 233 heuristic violations. Match, Error, and Visibility heuristics were the most frequently violated. Administer Medication and Order and Modify Medications tasks had the highest number of heuristic violations and usability problems rated as major or catastrophic. Conclusion The high number of usability problems could impact the effectiveness, efficiency and satisfaction of nurses’ medication administration activities and may include concerns about patient safety. Usability is a joint responsibility between sites and vendors. We offer a call to action for usability evaluations at all sites and eMAR application redesign as necessary to improve the user experience and promote patient safety. PMID:23616871

BRD usability requirements

DOE Office of Scientific and Technical Information (OSTI.GOV)

Deshpande, Alina

2015-03-12

This document describes the usability requirements for the Biosurveillance resource directory (BRD); that is, who will be using the tool and what tasks they will be using it for. It does not include information on technical implementation (e.g., whether specific information is contained in the database or pulled on demand from other sources). It also avoids specific design ideas (such as widget descriptions) unless they are necessary to illustrate a requirement.

Using a fuzzy comprehensive evaluation method to determine product usability: A proposed theoretical framework

PubMed Central

Zhou, Ronggang; Chan, Alan H. S.

2016-01-01

BACKGROUND: In order to compare existing usability data to ideal goals or to that for other products, usability practitioners have tried to develop a framework for deriving an integrated metric. However, most current usability methods with this aim rely heavily on human judgment about the various attributes of a product, but often fail to take into account of the inherent uncertainties in these judgments in the evaluation process. OBJECTIVE: This paper presents a universal method of usability evaluation by combining the analytic hierarchical process (AHP) and the fuzzy evaluation method. By integrating multiple sources of uncertain information during product usability evaluation, the method proposed here aims to derive an index that is structured hierarchically in terms of the three usability components of effectiveness, efficiency, and user satisfaction of a product. METHODS: With consideration of the theoretical basis of fuzzy evaluation, a two-layer comprehensive evaluation index was first constructed. After the membership functions were determined by an expert panel, the evaluation appraisals were computed by using the fuzzy comprehensive evaluation technique model to characterize fuzzy human judgments. Then with the use of AHP, the weights of usability components were elicited from these experts. RESULTS AND CONCLUSIONS: Compared to traditional usability evaluation methods, the major strength of the fuzzy method is that it captures the fuzziness and uncertainties in human judgments and provides an integrated framework that combines the vague judgments from multiple stages of a product evaluation process. PMID:28035943

Multimedia telehomecare system using standard TV set.

PubMed

Guillén, S; Arredondo, M T; Traver, V; García, J M; Fernández, C

2002-12-01

Nowadays, there are a very large number of patients that need specific health support at home. The deployment of broadband communication networks is making feasible the provision of home care services with a proper quality of service. This paper presents a telehomecare multimedia platform that runs over integrated services digital network and internet protocol using videoconferencing standards H.320 and H.323, and standard TV set for patient interaction. This platform allows online remote monitoring: ECG, heart sound, blood pressure. Usability, affordability, and interoperability were considered for the design and development of its hardware and software components. A first evaluation of technical and usability aspects were carried forward with 52 patients of a private clinic and 10 students in the University. Results show a high rate (mean = 4.33, standard deviation--SD = 1.63 in a five-points Likert scale) in the global perception of users on the quality of images, voice, and feeling of virtual presence.

Usability Evaluation of a Private Social Network on Mental Health for Relatives.

PubMed

Toribio-Guzmán, José Miguel; García-Holgado, Alicia; Soto Pérez, Felipe; García-Peñalvo, Francisco J; Franco Martín, Manuel

2017-09-01

Usability is one of the most prominent criteria that must be fulfilled by a software product. This study aims to evaluate the usability of SocialNet, a private social network for monitoring the daily progress of patients by their relatives, using a mixed usability approach: heuristic evaluation conducted by experts and user testing. A double heuristic evaluation with one expert evaluator identified the issues related to consistency, design, and privacy. User testing was conducted on 20 users and one evaluator using observation techniques and questionnaires. The main usability problems were found to be related to the structure of SocialNet, and the users presented some difficulties in locating the buttons or links. The results show a high level of usability and satisfaction with the product. This evaluation provides data on the usability of SocialNet based on the difficulties experienced by the users and the expert. The results help in redesigning the tool to resolve the identified problems as part of an iterative process.

HKHC Community Dashboard: design, development, and function of a Web-based performance monitoring system.

PubMed

Bors, Philip A; Kemner, Allison; Fulton, John; Stachecki, Jessica; Brennan, Laura K

2015-01-01

As part of Robert Wood Johnson Foundation's Healthy Kids, Healthy Communities (HKHC) national grant program, a technical assistance team designed the HKHC Community Dashboard, an online progress documentation and networking system. The Dashboard was central to HKHC's multimethod program evaluation and became a communication interface for grantees and technical assistance providers. The Dashboard was designed through an iterative process of identifying needs and priorities; designing the user experience, technical development, and usability testing; and applying visual design. The system was created with an open-source content management system and support for building an online community of users. The site developer trained technical assistance providers at the national program office and evaluators, who subsequently trained all 49 grantees. Evaluators provided support for Dashboard users and populated the site with the bulk of its uploaded tools and resource documents. The system tracked progress through an interactive work plan template, regular documentation by local staff and partners, and data coding and analysis by the evaluation team. Other features included the ability to broadcast information to Dashboard users via e-mail, event calendars, discussion forums, private messaging, a resource clearinghouse, a technical assistance diary, and real-time progress reports. The average number of Dashboard posts was 694 per grantee during the grant period. Technical assistance providers and grantees uploaded a total of 1304 resource documents. The Dashboard functions with the highest grantee satisfaction were its interfaces for sharing and progress documentation. A majority of Dashboard users (69%) indicated a preference for continued access to the Dashboard's uploaded resource documents. The Dashboard was a useful and innovative tool for participatory evaluation of a large national grant program. While progress documentation added some burden to local project staff, the system proved to be a useful resource-sharing technology.

Integration of MSFC Usability Lab with Usability Testing

NASA Technical Reports Server (NTRS)

Cheng, Yiwei; Richardson, Sally

2010-01-01

As part of the Stage Analysis Branch, human factors engineering plays an important role in relating humans to the systems of hardware and structure designs of the new launch vehicle. While many branches are involved in the technical aspects of creating a launch vehicle, human factors connects humans to the scientific systems with the goal of improving operational performance and safety while reducing operational error and damage to the hardware. Human factors engineers use physical and computerized models to visualize possible areas for improvements to ensure human accessibility to components requiring maintenance and that the necessary maintenance activities can be accomplished with minimal risks to human and hardware. Many methods of testing are used to fulfill this goal, such as physical mockups, computerized visualization, and usability testing. In this analysis, a usability test is conducted to test how usable a website is to users who are and are not familiar with it. The testing is performed using participants and Morae software to record and analyze the results. This analysis will be a preliminary test of the usability lab in preparation for use in new spacecraft programs, NASA Enterprise, or other NASA websites. The usability lab project is divided into two parts: integration of the usability lab and a preliminary test of the usability lab.

A human reliability based usability evaluation method for safety-critical software

DOE Office of Scientific and Technical Information (OSTI.GOV)

Boring, R. L.; Tran, T. Q.; Gertman, D. I.

2006-07-01

Boring and Gertman (2005) introduced a novel method that augments heuristic usability evaluation methods with that of the human reliability analysis method of SPAR-H. By assigning probabilistic modifiers to individual heuristics, it is possible to arrive at the usability error probability (UEP). Although this UEP is not a literal probability of error, it nonetheless provides a quantitative basis to heuristic evaluation. This method allows one to seamlessly prioritize and identify usability issues (i.e., a higher UEP requires more immediate fixes). However, the original version of this method required the usability evaluator to assign priority weights to the final UEP, thusmore » allowing the priority of a usability issue to differ among usability evaluators. The purpose of this paper is to explore an alternative approach to standardize the priority weighting of the UEP in an effort to improve the method's reliability. (authors)« less

Comparison of two heuristic evaluation methods for evaluating the usability of health information systems.

PubMed

Khajouei, Reza; Hajesmaeel Gohari, Sadrieh; Mirzaee, Moghaddameh

2018-04-01

In addition to following the usual Heuristic Evaluation (HE) method, the usability of health information systems can also be evaluated using a checklist. The objective of this study is to compare the performance of these two methods in identifying usability problems of health information systems. Eight evaluators independently evaluated different parts of a Medical Records Information System using two methods of HE (usual and with a checklist). The two methods were compared in terms of the number of problems identified, problem type, and the severity of identified problems. In all, 192 usability problems were identified by two methods in the Medical Records Information System. This was significantly higher than the number of usability problems identified by the checklist and usual method (148 and 92, respectively) (p < 0.0001). After removing the duplicates, the difference between the number of unique usability problems identified by the checklist method (n = 100) and usual method (n = 44) was significant (p < 0.0001). Differences between the mean severity of the real usability problems (1.83) and those identified by only one of the methods (usual = 2.05, checklist = 1.74) were significant (p = 0.001). This study revealed the potential of the two HE methods for identifying usability problems of health information systems. The results demonstrated that the checklist method had significantly better performance in terms of the number of identified usability problems; however, the performance of the usual method for identifying problems of higher severity was significantly better. Although the checklist method can be more efficient for less experienced evaluators, wherever usability is critical, the checklist should be used with caution in usability evaluations. Copyright © 2018 Elsevier Inc. All rights reserved.

An evaluation of selected NASA scientific and technical information products: Results of a pilot study

NASA Technical Reports Server (NTRS)

Pinelli, Thomas E.; Glassman, Myron

1989-01-01

A pilot study was conducted to evaluate selected NASA scientific and technical information (STI) products. The study, which utilized survey research in the form of a self-administered mail questionnaire, had a two-fold purpose -- to gather baseline data regarding the use and perceived usefulness of selected NASA STI products and to develop/validate questions that could be used in a future study concerned with the role of the U.S. government technical report in aeronautics. The sample frame consisted of 25,000 members of the American Institute of Aeronautics and Astronautics in the U.S. with academic, government or industrial affiliation. Simple random sampling was used to select 2000 individuals to participate in the study. Three hundred fifty-three usable questionnaires (17 percent response rate) were received by the established cutoff date. The findings indicate that: (1) NASA STI is used and is generally perceived as being important; (2) the use rate for NASA-authored conference/meeting papers, journal articles, and technical reports is fairly uniform; (3) a considerable number of respondents are unfamiliar with STAR (Scientific and Technical Aerospace Reports), IAA (International Aerospace Abstracts), SCAN (Selected Current Aerospace Notices), and the RECON on-line retrieval system; (4) a considerable number of respondents who are familiar with these media do not use them; and (5) the perceived quality of NASA-authored journal articles and technical reports is very good.

Development of the public information and communication technology assessment tool.

PubMed

Ripat, Jacquie; Watzke, James; Birch, Gary

2008-09-01

Public information and communication technologies, such as information kiosks, automated banking machines and ticket dispensers, allow people to access services in a convenient and timely manner. However, the development of these technologies has occurred largely without consideration of access by people with disabilities. Inaccessible technical features make operation of a public technology difficult and barriers in the environment create navigational challenges, limiting the opportunity of people with disabilities to use these devices and access the services they provide. This paper describes the development of a tool that individuals, disability advocacy groups, business owners, healthcare providers, and urban planners can use to evaluate the accessibility of public technologies and the surrounding environment. Evaluation results can then be used to develop recommendations and advocate for technical and environmental changes to improve access. Tool development consisted of a review of the literature and key Canadian Standards Association documents, task analysis, and consultation with accessibility experts. Studies of content validity, tool usability, inter-rater and test-retest reliability were conducted in sites across Canada. Accessibility experts verified the content validity of the tool. The current version of the tool has incorporated the findings of a usability study. Initial testing indicated excellent agreement for inter-rater and test-retest reliability scores. Social exclusion can arise when public technologies are not accessible. This newly developed instrument provides detailed information that can be used to advocate for more accessible and inclusive public information and communication technologies.

Usability and feasibility of a tablet-based Decision-Support and Integrated Record-keeping (DESIRE) tool in the nurse management of hypertension in rural western Kenya.

PubMed

Vedanthan, Rajesh; Blank, Evan; Tuikong, Nelly; Kamano, Jemima; Misoi, Lawrence; Tulienge, Deborah; Hutchinson, Claire; Ascheim, Deborah D; Kimaiyo, Sylvester; Fuster, Valentin; Were, Martin C

2015-03-01

Mobile health (mHealth) applications have recently proliferated, especially in low- and middle-income countries, complementing task-redistribution strategies with clinical decision support. Relatively few studies address usability and feasibility issues that may impact success or failure of implementation, and few have been conducted for non-communicable diseases such as hypertension. To conduct iterative usability and feasibility testing of a tablet-based Decision Support and Integrated Record-keeping (DESIRE) tool, a technology intended to assist rural clinicians taking care of hypertension patients at the community level in a resource-limited setting in western Kenya. Usability testing consisted of "think aloud" exercises and "mock patient encounters" with five nurses, as well as one focus group discussion. Feasibility testing consisted of semi-structured interviews of five nurses and two members of the implementation team, and one focus group discussion with nurses. Content analysis was performed using both deductive codes and significant inductive codes. Critical incidents were identified and ranked according to severity. A cause-of-error analysis was used to develop corresponding design change suggestions. Fifty-seven critical incidents were identified in usability testing, 21 of which were unique. The cause-of-error analysis yielded 23 design change suggestions. Feasibility themes included barriers to implementation along both human and technical axes, facilitators to implementation, provider issues, patient issues and feature requests. This participatory, iterative human-centered design process revealed previously unaddressed usability and feasibility issues affecting the implementation of the DESIRE tool in western Kenya. In addition to well-known technical issues, we highlight the importance of human factors that can impact implementation of mHealth interventions. Copyright © 2015 Elsevier Ireland Ltd. All rights reserved.

Usability and Feasibility of a Tablet-Based Decision-Support and Integrated Record-Keeping (DESIRE) Tool in the Nurse Management of Hypertension in Rural Western Kenya

PubMed Central

Vedanthan, Rajesh; Blank, Evan; Tuikong, Nelly; Kamano, Jemima; Misoi, Lawrence; Tulienge, Deborah; Hutchinson, Claire; Ascheim, Deborah D.; Kimaiyo, Sylvester; Fuster, Valentin; Were, Martin C.

2015-01-01

Background Mobile health (mHealth) applications have recently proliferated, especially in low- and middle-income countries, complementing task-redistribution strategies with clinical decision support. Relatively few studies address usability and feasibility issues that may impact success or failure of implementation, and few have been conducted for non-communicable diseases such as hypertension. Objective To conduct iterative usability and feasibility testing of a tablet-based Decision Support and Integrated Record-keeping (DESIRE) tool, a technology intended to assist rural clinicians taking care of hypertension patients at the community level in a resource-limited setting in western Kenya. Methods Usability testing consisted of “think aloud” exercises and “mock patient encounters” with five nurses, as well as one focus group discussion. Feasibility testing consisted of semi-structured interviews of five nurses and two members of the implementation team, and one focus group discussion with nurses. Content analysis was performed using both deductive codes and significant inductive codes. Critical incidents were identified and ranked according to severity. A cause-of-error analysis was used to develop corresponding design change suggestions. Results Fifty-seven critical incidents were identified in usability testing, 21 of which were unique. The cause-of-error analysis yielded 23 design change suggestions. Feasibility themes included barriers to implementation along both human and technical axes, facilitators to implementation, provider issues, patient issues and feature requests. Conclusions This participatory, iterative human-centered design process revealed previously unaddressed usability and feasibility issues affecting the implementation of the DESIRE tool in western Kenya. In addition to well-known technical issues, we highlight the importance of human factors that can impact implementation of mHealth interventions. PMID:25612791

Ambulatory polysomnography using a new programmable amplifier system with on-line digitization of data: technical and clinical findings.

PubMed

Drewes, A M; Nielsen, K D; Taagholt, S J; Svendsen, L; Bjerregård, K; Nielsson, L; Kristensen, L

1996-05-01

A new system for polysomnographic recording at home is presented. It consists of a 12 to 24-channel amplifier system with direct digitization of the polygraph signals using a portable computer. Sampling frequency, amplification and filter settings can be defined by the user, and the signals are evaluated at bedside. Technical testing proved a high signal/noise ratio, linear amplification and a good signal quality. Clinical testing of the first 100 recordings showed that they were acceptable for conventional sleep scoring in 98 cases. A comparison of two consecutive recordings was done in 9 healthy subjects and 11 patients with rheumatic disorders. Using conventional sleep staging, only a slight "first night effect" (FNE) was demonstrated in the sleep architecture. Power spectral analysis using autoregressive modeling demonstrated only a difference of power between the 2 nights in the beta (14.5-25 Hz) band. In conclusion, the usability and technical advantages make the system very suitable for ambulatory recordings and only a minimal FNE should be considered when results are evaluated.

Advancing Usability Evaluation through Human Reliability Analysis

DOE Office of Scientific and Technical Information (OSTI.GOV)

Ronald L. Boring; David I. Gertman

2005-07-01

This paper introduces a novel augmentation to the current heuristic usability evaluation methodology. The SPAR-H human reliability analysis method was developed for categorizing human performance in nuclear power plants. Despite the specialized use of SPAR-H for safety critical scenarios, the method also holds promise for use in commercial off-the-shelf software usability evaluations. The SPAR-H method shares task analysis underpinnings with human-computer interaction, and it can be easily adapted to incorporate usability heuristics as performance shaping factors. By assigning probabilistic modifiers to heuristics, it is possible to arrive at the usability error probability (UEP). This UEP is not a literal probabilitymore » of error but nonetheless provides a quantitative basis to heuristic evaluation. When combined with a consequence matrix for usability errors, this method affords ready prioritization of usability issues.« less

Usability Prediction & Ranking of SDLC Models Using Fuzzy Hierarchical Usability Model

NASA Astrophysics Data System (ADS)

Gupta, Deepak; Ahlawat, Anil K.; Sagar, Kalpna

2017-06-01

Evaluation of software quality is an important aspect for controlling and managing the software. By such evaluation, improvements in software process can be made. The software quality is significantly dependent on software usability. Many researchers have proposed numbers of usability models. Each model considers a set of usability factors but do not cover all the usability aspects. Practical implementation of these models is still missing, as there is a lack of precise definition of usability. Also, it is very difficult to integrate these models into current software engineering practices. In order to overcome these challenges, this paper aims to define the term `usability' using the proposed hierarchical usability model with its detailed taxonomy. The taxonomy considers generic evaluation criteria for identifying the quality components, which brings together factors, attributes and characteristics defined in various HCI and software models. For the first time, the usability model is also implemented to predict more accurate usability values. The proposed system is named as fuzzy hierarchical usability model that can be easily integrated into the current software engineering practices. In order to validate the work, a dataset of six software development life cycle models is created and employed. These models are ranked according to their predicted usability values. This research also focuses on the detailed comparison of proposed model with the existing usability models.

A usability evaluation toolkit for In-Vehicle Information Systems (IVISs).

PubMed

Harvey, Catherine; Stanton, Neville A; Pickering, Carl A; McDonald, Mike; Zheng, Pengjun

2011-05-01

Usability must be defined specifically for the context of use of the particular system under investigation. This specific context of use should also be used to guide the definition of specific usability criteria and the selection of appropriate evaluation methods. There are four principles which can guide the selection of evaluation methods, relating to the information required in the evaluation, the stage at which to apply methods, the resources required and the people involved in the evaluation. This paper presents a framework for the evaluation of usability in the context of In-Vehicle Information Systems (IVISs). This framework guides designers through defining usability criteria for an evaluation, selecting appropriate evaluation methods and applying those methods. These stages form an iterative process of design-evaluation-redesign with the overall aim of improving the usability of IVISs and enhancing the driving experience, without compromising the safety of the driver. Copyright © 2010 Elsevier Ltd and The Ergonomics Society. All rights reserved.

Applying usability methods to identify health literacy issues: an example using a Personal Health Record.

PubMed

Monkman, Helen; Kushniruk, Andre

2013-01-01

The prevalence of consumer health information systems is increasing. However, usability and health literacy impact both the value and adoption of these systems. Health literacy and usability are closely related in that systems may not be used accurately if users cannot understand the information therein. Thus, it is imperative to focus on mitigating the demands on health literacy in consumer health information systems. This study modified two usability evaluation methods (heuristic evaluation and usability testing) to incorporate the identification of potential health literacy issues in a Personal Health Record (PHR). Heuristic evaluation is an analysis of a system performed by a usability specialist who evaluates how well the system abides by usability principles. In contrast, a usability test involves a post hoc analysis of a representative user interacting with the system. These two methods revealed several health literacy issues and suggestions to ameliorate them were made. Thus, it was demonstrated that usability methods could be successfully augmented for the purpose of investigating health literacy issues. To improve users' health knowledge, the adoption of consumer health information systems, and the accuracy of the information contained therein, it is encouraged that usability methods be applied with an added focus on health literacy.

A Framework for Usability Evaluation in EHR Procurement.

PubMed

Tyllinen, Mari; Kaipio, Johanna; Lääveri, Tinja

2018-01-01

Usability should be considered already by the procuring organizations when selecting future systems. In this paper, we present a framework for usability evaluation during electronic health record (EHR) system procurement. We describe the objectives of the evaluation, the procedure, selected usability attributes and the evaluation methods to measure them. We also present the emphasis usability had in the selection process. We do not elaborate on the details of the results, the application of methods or gathering of data. Instead we focus on the components of the framework to inform and give an example to other similar procurement projects.

Usability study of a computer-based self-management system for older adults with chronic diseases.

PubMed

Or, Calvin; Tao, Da

2012-11-08

Usability can influence patients' acceptance and adoption of a health information technology. However, little research has been conducted to study the usability of a self-management health care system, especially one geared toward elderly patients. This usability study evaluated a new computer-based self-management system interface for older adults with chronic diseases, using a paper prototype approach. Fifty older adults with different chronic diseases participated. Two usability evaluation methods were involved: (1) a heuristics evaluation and (2) end-user testing with a think-aloud testing method, audio recording, videotaping, and interviewing. A set of usability metrics was employed to determine the overall system usability, including task incompletion rate, task completion time, frequency of error, frequency of help, satisfaction, perceived usefulness, and perceived ease of use. Interviews were used to elicit participants' comments on the system design. The quantitative data were analyzed using descriptive statistics and the qualitative data were analyzed for content. The participants were able to perform the predesigned self-management tasks with the current system design and they expressed mostly positive responses about the perceived usability measures regarding the system interface. However, the heuristics evaluation, performance measures, and interviews revealed a number of usability problems related to system navigation, information search and interpretation, information presentation, and readability. Design recommendations for further system interface modifications were discussed. This study verified the usability of the self-management system developed for older adults with chronic diseases. Also, we demonstrated that our usability evaluation approach could be used to quickly and effectively identify usability problems in a health care information system at an early stage of the system development process using a paper prototype. Conducting a usability evaluation is an essential step in system development to ensure that the system features match the users' true needs, expectations, and characteristics, and also to minimize the likelihood of the users committing user errors and having difficulties using the system.

Usability Study of a Computer-Based Self-Management System for Older Adults with Chronic Diseases

PubMed Central

Tao, Da

2012-01-01

Background Usability can influence patients’ acceptance and adoption of a health information technology. However, little research has been conducted to study the usability of a self-management health care system, especially one geared toward elderly patients. Objective This usability study evaluated a new computer-based self-management system interface for older adults with chronic diseases, using a paper prototype approach. Methods Fifty older adults with different chronic diseases participated. Two usability evaluation methods were involved: (1) a heuristics evaluation and (2) end-user testing with a think-aloud testing method, audio recording, videotaping, and interviewing. A set of usability metrics was employed to determine the overall system usability, including task incompletion rate, task completion time, frequency of error, frequency of help, satisfaction, perceived usefulness, and perceived ease of use. Interviews were used to elicit participants’ comments on the system design. The quantitative data were analyzed using descriptive statistics and the qualitative data were analyzed for content. Results The participants were able to perform the predesigned self-management tasks with the current system design and they expressed mostly positive responses about the perceived usability measures regarding the system interface. However, the heuristics evaluation, performance measures, and interviews revealed a number of usability problems related to system navigation, information search and interpretation, information presentation, and readability. Design recommendations for further system interface modifications were discussed. Conclusions This study verified the usability of the self-management system developed for older adults with chronic diseases. Also, we demonstrated that our usability evaluation approach could be used to quickly and effectively identify usability problems in a health care information system at an early stage of the system development process using a paper prototype. Conducting a usability evaluation is an essential step in system development to ensure that the system features match the users’ true needs, expectations, and characteristics, and also to minimize the likelihood of the users committing user errors and having difficulties using the system. PMID:23612015

Information Design: A New Approach to Teaching Technical Writing Service Courses

ERIC Educational Resources Information Center

McKee, Candie DeLane

2012-01-01

This study used a needs assessment, process analysis, process design, and textbook design to develop a new process and new textbook, based on Cargile-Cook's layered literacies, Quesenbery's five qualities of usability, and Carliner's information design theories, for use in technical writing service learning courses. The needs assessment was based…

POLICIES AFFECTING ACCEPTANCE OF TRANSFER CREDIT FOR COURSES IN TECHNICAL EDUCATION.

ERIC Educational Resources Information Center

PURTZER, WAYNE R.

A 16-STATE QUESTIONNAIRE SURVEY OF 80 COLLEGES WAS DESIGNED TO IDENTIFY THE POLICIES OF THESE INSTITUTIONS CONCERNING GRANTING OF CREDIT FOR TECHNICAL SKILLS ACQUIRED IN OTHER SCHOOLS AND COLLEGES, MILITARY TRAINING, AND WORK EXPERIENCE. USABLE RESPONSES WERE OBTAINED FROM 48 COLLEGES. ALL COLLEGES EXCEPT ONE GRANTED SUCH CREDIT FOR COURSES IN…

Using Isocrates to Teach Technical Communication and Civic Engagement

ERIC Educational Resources Information Center

Brizee, Allen

2015-01-01

Building on work by Dubinsky, Haskins, and Simmons and Grabill, this article explains how a technical communication instructor used Isocrates and informal usability testing to help guide a service-learning project involving the One Laptop Per Child XO-1 notebook. For the project, engineering students received feedback from peers and elementary…

Usability Evaluation of Multimedia Courseware (MEL-SindD)

NASA Astrophysics Data System (ADS)

Yussof, Rahmah Lob; Badioze Zaman, Halimah

Constructive evaluations on any software are needed to ensure the effectiveness and usability of the software. This assesment on the multimedia courseware is part of the researcher's study towards the development and usability of the early reading software for students with Down Syndrome (MEL-SindD). This paper will discuss the usability assesment of this courseware, the methods used for the evaluation as well as suitable approaches that can be deployed to evaluate the courseware effectiveness to disabled children.

End-Users' Voice in EHR Selection: Development of a Usability Questionnaire for Demonstrations in Procurement (DPUQ).

PubMed

Tyllinen, Mari; Kaipio, Johanna; Lääveri, Tinja; Nieminen, Marko

2017-01-01

This paper describes the development of a questionnaire for evaluating usability during EHR system procurement (DPUQ). Established usability questionnaires can be used to gather user feedback after using the systems. However, during procurement, experimenting with real system use is practical only with a limited number of system candidates. There is a need for less resource-demanding usability evaluation in the early stages of procurement in cases with several vendors. DPUQ has been designed for usability evaluation by end-users during special scenario-based vendor demonstrations. The questionnaire includes three sets of questions to be used during and after the vendor demonstration. DPUQ delivers specific usability scores and can be used to compare system candidates in procurement complementing other evaluation methods.

Beyond Effectiveness: A Pragmatic Evaluation Framework for Learning and Continuous Quality Improvement of e-Learning Interventions in Healthcare.

PubMed

Dafalla, Tarig Dafalla Mohamed; Kushniruk, Andre W; Borycki, Elizabeth M

2015-01-01

A pragmatic evaluation framework for evaluating the usability and usefulness of an e-learning intervention for a patient clinical information scheduling system is presented in this paper. The framework was conceptualized based on two different but related concepts (usability and usefulness) and selection of appropriate and valid methods of data collection and analysis that included: (1) Low-Cost Rapid Usability Engineering (LCRUE), (2) Cognitive Task Analysis (CTA), (3) Heuristic Evaluation (HE) criteria for web-based learning, and (4) Software Usability Measurement Inventory (SUMI). The results of the analysis showed some areas where usability that were related to General Interface Usability (GIU), instructional design and content was problematic; some of which might account for the poorly rated aspects of usability when subjectively measured. This paper shows that using a pragmatic framework can be a useful way, not only for measuring the usability and usefulness, but also for providing a practical objective evidences for learning and continuous quality improvement of e-learning systems. The findings should be of interest to educators, developers, designers, researchers, and usability practitioners involved in the development of e-learning systems in healthcare. This framework could be an appropriate method for assessing the usability, usefulness and safety of health information systems both in the laboratory and in the clinical context.

User Interface Problems of a Nationwide Inpatient Information System: A Heuristic Evaluation.

PubMed

Atashi, Alireza; Khajouei, Reza; Azizi, Amirabbas; Dadashi, Ali

2016-01-01

While studies have shown that usability evaluation could uncover many design problems of health information systems, the usability of health information systems in developing countries using their native language is poorly studied. The objective of this study was to evaluate the usability of a nationwide inpatient information system used in many academic hospitals in Iran. Three trained usability evaluators independently evaluated the system using Nielsen's 10 usability heuristics. The evaluators combined identified problems in a single list and independently rated the severity of the problems. We statistically compared the number and severity of problems identified by HIS experienced and non-experienced evaluators. A total of 158 usability problems were identified. After removing duplications 99 unique problems were left. The highest mismatch with usability principles was related to "Consistency and standards" heuristic (25%) and the lowest related to "Flexibility and efficiency of use" (4%). The average severity of problems ranged from 2.4 (Major problem) to 3.3 (Catastrophe problem). The experienced evaluator with HIS identified significantly more problems and gave higher severities to problems (p<0.02). Heuristic Evaluation identified a high number of usability problems in a widely used inpatient information system in many academic hospitals. These problems, if remain unsolved, may waste users' and patients' time, increase errors and finally threaten patient's safety. Many of them can be fixed with simple redesign solutions such as using clear labels and better layouts. This study suggests conducting further studies to confirm the findings concerning effect of evaluator experience on the results of Heuristic Evaluation.

User Interface Problems of a Nationwide Inpatient Information System: A Heuristic Evaluation

PubMed Central

Atashi, Alireza; Azizi, Amirabbas; Dadashi, Ali

2016-01-01

Summary Introduction While studies have shown that usability evaluation could uncover many design problems of health information systems, the usability of health information systems in developing countries using their native language is poorly studied. The objective of this study was to evaluate the usability of a nationwide inpatient information system used in many academic hospitals in Iran. Material and Methods Three trained usability evaluators independently evaluated the system using Nielsen’s 10 usability heuristics. The evaluators combined identified problems in a single list and independently rated the severity of the problems. We statistically compared the number and severity of problems identified by HIS experienced and non-experienced evaluators. Results A total of 158 usability problems were identified. After removing duplications 99 unique problems were left. The highest mismatch with usability principles was related to “Consistency and standards” heuristic (25%) and the lowest related to “Flexibility and efficiency of use” (4%). The average severity of problems ranged from 2.4 (Major problem) to 3.3 (Catastrophe problem). The experienced evaluator with HIS identified significantly more problems and gave higher severities to problems (p<0.02). Discussion Heuristic Evaluation identified a high number of usability problems in a widely used inpatient information system in many academic hospitals. These problems, if remain unsolved, may waste users’ and patients’ time, increase errors and finally threaten patient’s safety. Many of them can be fixed with simple redesign solutions such as using clear labels and better layouts. This study suggests conducting further studies to confirm the findings concerning effect of evaluator experience on the results of Heuristic Evaluation. PMID:27081409

Training Software Developers and Designers to Conduct Usability Evaluations

ERIC Educational Resources Information Center

Skov, Mikael Brasholt; Stage, Jan

2012-01-01

Many efforts to improve the interplay between usability evaluation and software development rely either on better methods for conducting usability evaluations or on better formats for presenting evaluation results in ways that are useful for software designers and developers. Both of these approaches depend on a complete division of work between…

From Usability Engineering to Evidence-based Usability in Health IT.

PubMed

Marcilly, Romaric; Peute, Linda; Beuscart-Zephir, Marie-Catherine

2016-01-01

Usability is a critical factor in the acceptance, safe use, and success of health IT. The User-Centred Design process is widely promoted to improve usability. However, this traditional case by case approach that is rooted in the sound understanding of users' needs is not sufficient to improve technologies' usability and prevent usability-induced use-errors that may harm patients. It should be enriched with empirical evidence. This evidence is on design elements (what are the most valuable design principles, and the worst usability mistakes), and on the usability evaluation methods (which combination of methods is most suitable in which context). To achieve this evidence, several steps must be fulfilled and challenges must be overcome. Some attempts to search evidence for designing elements of health IT and for usability evaluation methods exist and are summarized. A concrete instance of evidence-based usability design principles for medication-related alerting systems is briefly described.

The use of think-aloud and instant data analysis in evaluation research: Exemplar and lessons learned.

PubMed

Joe, Jonathan; Chaudhuri, Shomir; Le, Thai; Thompson, Hilaire; Demiris, George

2015-08-01

While health information technologies have become increasingly popular, many have not been formally tested to ascertain their usability. Traditional rigorous methods take significant amounts of time and manpower to evaluate the usability of a system. In this paper, we evaluate the use of instant data analysis (IDA) as developed by Kjeldskov et al. to perform usability testing on a tool designed for older adults and caregivers. The IDA method is attractive because it takes significantly less time and manpower than the traditional usability testing methods. In this paper we demonstrate how IDA was used to evaluate usability of a multifunctional wellness tool, discuss study results and lessons learned while using this method. We also present findings from an extension of the method which allows the grouping of similar usability problems in an efficient manner. We found that the IDA method is a quick, relatively easy approach to identifying and ranking usability issues among health information technologies. Copyright © 2015 Elsevier Inc. All rights reserved.

Usability evaluation of Laboratory and Radiology Information Systems integrated into a hospital information system.

PubMed

Nabovati, Ehsan; Vakili-Arki, Hasan; Eslami, Saeid; Khajouei, Reza

2014-04-01

This study was conducted to evaluate the usability of widely used laboratory and radiology information systems. Three usability experts independently evaluated the user interfaces of Laboratory and Radiology Information Systems using heuristic evaluation method. They applied Nielsen's heuristics to identify and classify usability problems and Nielsen's severity rating to judge their severity. Overall, 116 unique heuristic violations were identified as usability problems. In terms of severity, 67 % of problems were rated as major and catastrophic. Among 10 heuristics, "consistency and standards" was violated most frequently. Moreover, mean severity of problems concerning "error prevention" and "help and documentation" heuristics was higher than of the others. Despite widespread use of specific healthcare information systems, they suffer from usability problems. Improving the usability of systems by following existing design standards and principles from the early phased of system development life cycle is recommended. Especially, it is recommended that the designers design systems that inhibit the initiation of erroneous actions and provide sufficient guidance to users.

Reusable Software Usability Specifications for mHealth Applications.

PubMed

Cruz Zapata, Belén; Fernández-Alemán, José Luis; Toval, Ambrosio; Idri, Ali

2018-01-25

One of the key factors for the adoption of mobile technologies, and in particular of mobile health applications, is usability. A usable application will be easier to use and understand by users, and will improve user's interaction with it. This paper proposes a software requirements catalog for usable mobile health applications, which can be used for the development of new applications, or the evaluation of existing ones. The catalog is based on the main identified sources in literature on usability and mobile health applications. Our catalog was organized according to the ISO/IEC/IEEE 29148:2011 standard and follows the SIREN methodology to create reusable catalogs. The applicability of the catalog was verified by the creation of an audit method, which was used to perform the evaluation of a real app, S Health, application created by Samsung Electronics Co. The usability requirements catalog, along with the audit method, identified several usability flaws on the evaluated app, which scored 83%. Some flaws were detected in the app related to the navigation pattern. Some more issues related to the startup experience, empty screens or writing style were also found. The way a user navigates through an application improves or deteriorates user's experience with the application. We proposed a reusable usability catalog and an audit method. This proposal was used to evaluate a mobile health application. An audit report was created with the usability issues identified on the evaluated application.

Measuring the Usability of Augmented Reality e-Learning Systems: A User-Centered Evaluation Approach

NASA Astrophysics Data System (ADS)

Pribeanu, Costin; Balog, Alexandru; Iordache, Dragoş Daniel

The development of Augmented Reality (AR) systems is creating new challenges and opportunities for the designers of e-learning systems. The mix of real and virtual requires appropriate interaction techniques that have to be evaluated with users in order to avoid usability problems. Formative usability aims at finding usability problems as early as possible in the development life cycle and is suitable to support the development of such novel interactive systems. This work presents an approach to the user-centered usability evaluation of an e-learning scenario for Biology developed on an Augmented Reality educational platform. The evaluation has been carried on during and after a summer school held within the ARiSE research project. The basic idea was to perform usability evaluation twice. In this respect, we conducted user testing with a small number of students during the summer school in order to get a fast feedback from users having good knowledge in Biology. Then, we repeated the user testing in different conditions and with a relatively larger number of representative users. In this paper we describe both experiments and compare the usability evaluation results.

Evaluating Web Usability

ERIC Educational Resources Information Center

Snider, Jean; Martin, Florence

2012-01-01

Web usability focuses on design elements and processes that make web pages easy to use. A website for college students was evaluated for underutilization. One-on-one testing, focus groups, web analytics, peer university review and marketing focus group and demographic data were utilized to conduct usability evaluation. The results indicated that…

Evaluation of expert system application based on usability aspects

NASA Astrophysics Data System (ADS)

Munaiseche, C. P. C.; Liando, O. E. S.

2016-04-01

Usability usually defined as a point of human acceptance to a product or a system based on understands and right reaction to an interface. The performance of web application has been influence by the quality of the interface of that web to supporting information transfer process. Preferably, before the applications of expert systems were installed in the operational environment, these applications must be evaluated first by usability testing. This research aimed to measure the usability of the expert system application using tasks as interaction media. This study uses an expert system application to diagnose skin disease in human using questionnaire method which utilize the tasks as interaction media in measuring the usability. Certain tasks were executed by the participants in observing usability value of the application. The usability aspects observed were learnability, efficiency, memorability, errors, and satisfaction. Each questionnaire question represent aspects of usability. The results present the usability value for each aspect and the total average merit for all the five-usability aspect was 4.28, this indicated that the tested expert system application is in the range excellent for the usability level, so the application can be implemented as the operated system by user. The main contribution of the study is the research became the first step in using task model in the usability evaluation for the expert system application software.

An Online Social Constructivist Course: Toward a Framework for Usability Evaluations

ERIC Educational Resources Information Center

Phillips, Alana S.; Sheffield, Anneliese; Moore, Michelle; Robinson, Heather A.

2016-01-01

There is a need for a holistic usability evaluation framework that accommodates social constructivist online courses. Social knowledge construction may not be adequately evaluated using current frameworks. This qualitative research study examined the usability needs of a social constructivist online course. Data from an online course were analyzed…

Improving non-technical skills (teamwork) in post-partum haemorrhage: A grouped randomised trial.

PubMed

Letchworth, Pippa M; Duffy, Shane P; Phillips, Dan

2017-10-01

To determine the effect of a decision support technology on teamwork and associated non-technical (NTS) and technical skills when teams manage post-partum haemorrhage (PPH) in the simulated environment. Multidisciplinary (MDT) maternity teams were taught how to manage post partum haemorrhage. They were randomised to the intervention: using a decision support mobile digital platform or a control group. Each team managed a post-partum simulation, which was recorded and reviewed by assessors. Primary outcome measures to assess teams NTS were the validated Global Assessment of Obstetric Team Performance (GAOTP) and Clinical Teamwork Scale (CTS). Secondary outcome measures were the 'friends and family test', technical skills, and the System Usability Scale (SUS). Sample size estimation was calculated by using 80% power 5% significance two tailed test (p1=85% p2=40%) n=34. 38 teams from August 2014-February 2016, were recruited, technical issues with failure of recording equipment meant 4 teams were excluded from teamwork analysis (1 intervention 3 control). Teamwork improved across all domains with the intervention (using a decision support mobile digital platform) p <0.01. CTS improved between 6.7-16.8% (average 14.2%) and GAOTP between 8.6-17.1% (average 13.5%) for all domains. Using the control group as baseline, the intervention improved teamwork by 25% using CTS and 22% using GAOTP. Fewer technical skills were missed with the intervention (p<0.01). There was no statistical difference in the time technical skills were achieved. Assessors were more likely to recommend intervention teams 87.5% (77/88) than control teams 63.6% (56/88) p<0.01 to their friends or family. The SUS was 'Good' (69) becoming excellently 'Usable' (81.6) over the study period. We report a decision support system, which improved NTS when managing PPH. Lack of teamwork is often cited as the cause of failures in care and we report a usable technology that assists with and improves teamwork during an emergency. Copyright © 2017 Elsevier B.V. All rights reserved.

Enhancing patient freedom in rehabilitation robotics using gaze-based intention detection.

PubMed

Novak, Domen; Riener, Robert

2013-06-01

Several design strategies for rehabilitation robotics have aimed to improve patients' experiences using motivating and engaging virtual environments. This paper presents a new design strategy: enhancing patient freedom with a complex virtual environment that intelligently detects patients' intentions and supports the intended actions. A 'virtual kitchen' scenario has been developed in which many possible actions can be performed at any time, allowing patients to experiment and giving them more freedom. Remote eye tracking is used to detect the intended action and trigger appropriate support by a rehabilitation robot. This approach requires no additional equipment attached to the patient and has a calibration time of less than a minute. The system was tested on healthy subjects using the ARMin III arm rehabilitation robot. It was found to be technically feasible and usable by healthy subjects. However, the intention detection algorithm should be improved using better sensor fusion, and clinical tests with patients are needed to evaluate the system's usability and potential therapeutic benefits.

Determining the Number of Participants Needed for the Usability Evaluation of E-Learning Resources: A Monte Carlo Simulation

ERIC Educational Resources Information Center

Davids, Mogamat Razeen; Harvey, Justin; Halperin, Mitchell L.; Chikte, Usuf M. E.

2015-01-01

The usability of computer interfaces has a major influence on learning. Optimising the usability of e-learning resources is therefore essential. However, this may be neglected because of time and monetary constraints. User testing is a common approach to usability evaluation and involves studying typical end-users interacting with the application…

Pattern mining of user interaction logs for a post-deployment usability evaluation of a radiology PACS client.

PubMed

Jorritsma, Wiard; Cnossen, Fokie; Dierckx, Rudi A; Oudkerk, Matthijs; van Ooijen, Peter M A

2016-01-01

To perform a post-deployment usability evaluation of a radiology Picture Archiving and Communication System (PACS) client based on pattern mining of user interaction log data, and to assess the usefulness of this approach compared to a field study. All user actions performed on the PACS client were logged for four months. A data mining technique called closed sequential pattern mining was used to automatically extract frequently occurring interaction patterns from the log data. These patterns were used to identify usability issues with the PACS. The results of this evaluation were compared to the results of a field study based usability evaluation of the same PACS client. The interaction patterns revealed four usability issues: (1) the display protocols do not function properly, (2) the line measurement tool stays active until another tool is selected, rather than being deactivated after one use, (3) the PACS's built-in 3D functionality does not allow users to effectively perform certain 3D-related tasks, (4) users underuse the PACS's customization possibilities. All usability issues identified based on the log data were also found in the field study, which identified 48 issues in total. Post-deployment usability evaluation based on pattern mining of user interaction log data provides useful insights into the way users interact with the radiology PACS client. However, it reveals few usability issues compared to a field study and should therefore not be used as the sole method of usability evaluation. Copyright © 2015 Elsevier Ireland Ltd. All rights reserved.

Usability in Mobile Electronic Data Collection Tools: Form Developers' Views.

PubMed

Mugisha, Alice; Babic, Ankica; Wakholi, Peter; Nankabirwa, Victoria; Tylleskar, Thorkild

2017-01-01

Mobile Electronic Data Collection Tools (MEDCTs) are created by form developers to collect data. Usability being one of the top quality attributes is of great concern to developers of any interactive applications. However, little is known about the form developers' understanding of usability, how they measure usability and their limitations in designing for usability. We conducted an empirical study where we aimed at getting the developers' views on usability by interviewing 8 form developers. These are creators of forms used for data collection. We found that developers knew about usability, but it was not their main focus during form development. Challenges included constraining deadlines, software limitations and the insufficient communication with the field users to establish the usability needs. Furthermore, the methods used to evaluate the usability of created forms varied amongst developers and these included in-house evaluations and feedback from piloting sessions with end users.

An eHealth Application of Self-Reported Sports-Related Injuries and Illnesses in Paralympic Sport: Pilot Feasibility and Usability Study

PubMed Central

2017-01-01

Background Sport participation is associated with a risk of sports-related injuries and illnesses, and Paralympic athletes’ additional medical issues can be a challenge to health care providers and medical staff. However, few prospective studies have assessed sports-related injuries and illnesses in Paralympic sport (SRIIPS) over time. Advances in mobile phone technology and networking systems offer novel opportunities to develop innovative eHealth applications for collection of athletes’ self-reports. Using eHealth applications for collection of self-reported SRIIPS is an unexplored area, and before initiation of full-scale research of SRIIPS, the feasibility and usability of such an approach needs to be ascertained. Objective The aim of this study was to perform a 4-week pilot study and (1) evaluate the monitoring feasibility and system usability of a novel eHealth application for self-reported SRIIPS and (2) report preliminary data on SRIIPS. Methods An eHealth application for routine collection of data from athletes was developed and adapted to Paralympic athletes. A 4-week pilot study was performed where Paralympic athletes (n=28) were asked to weekly self-report sport exposure, training load, general well-being, pain, sleep, anxiety, and possible SRIIPS. The data collection was followed by a poststudy use assessment survey. Quantitative data related to the system use (eg, completed self-reports, missing responses, and errors) were analyzed using descriptive statistics. The qualitative feasibility and usability data provided by the athletes were condensed and categorized using thematic analysis methods. Results The weekly response rate was 95%. The athletes were of the opinion that the eHealth application was usable and feasible but stated that it was not fully adapted to Paralympic athletes and their impairments. For example, it was difficult to understand how a new injury or illness should be identified when the impairment was involved. More survey items related to the impairments were requested, as the athletes perceived that injuries and illnesses often occurred because of the impairment. Options for description of multifactorial incidents including an injury, an illness, and the impairment were also insufficient. Few technical issues were encountered, but athletes with visual impairment reported usability difficulties with the speech synthesizer. An incidence rate of 1.8 injuries and 1.7 illnesses per 100 hours of athlete exposure were recorded. The weekly pain prevalence was 56% and the impairment contributed to 20% of the reported incidents. Conclusions The novel eHealth-based application for self-reported SRIIPS developed and tested in this pilot study was generally feasible and usable. With some adaptation to accommodate Paralympic athletes’ prerequisites and improved technical support for athletes with visual impairment, this application can be recommended for use in prospective studies of SRIIPS. Trial Registration ClinicalTrials.gov NCT02788500; https://clinicaltrials.gov/ct2/show/NCT02788500 (Archived by WebCite at http://www.webcitation.org/6v56OqTeP) PMID:29187343

Usability Evaluation of Electronic Health Record System around Clinical Notes Usage-An Ethnographic Study.

PubMed

Rizvi, Rubina F; Marquard, Jenna L; Hultman, Gretchen M; Adam, Terrence J; Harder, Kathleen A; Melton, Genevieve B

2017-10-01

Background A substantial gap exists between current Electronic Health Record (EHR) usability and potential optimal usability. One of the fundamental reasons for this discrepancy is poor incorporation of a User-Centered Design (UCD) approach during the Graphical User Interface (GUI) development process. Objective To evaluate usability strengths and weaknesses of two widely implemented EHR GUIs for critical clinical notes usage tasks. Methods Twelve Internal Medicine resident physicians interacting with one of the two EHR systems (System-1 at Location-A and System-2 at Location-B) were observed by two usability evaluators employing an ethnographic approach. User comments and observer findings were analyzed for two critical tasks: (1) clinical notes entry and (2) related information-seeking tasks. Data were analyzed from two standpoints: (1) usability references categorized by usability evaluators as positive, negative, or equivocal and (2) usability impact of each feature measured through a 7-point severity rating scale. Findings were also validated by user responses to a post observation questionnaire. Results For clinical notes entry, System-1 surpassed System-2 with more positive (26% vs. 12%) than negative (12% vs. 34%) usability references. Greatest impact features on EHR usability (severity score pertaining to each feature) for clinical notes entry were: autopopulation (6), screen options (5.5), communication (5), copy pasting (4.5), error prevention (4.5), edit ability (4), and dictation and transcription (3.5). Both systems performed equally well on information-seeking tasks and features with greatest impacts on EHR usability were navigation for notes (7) and others (e.g., looking for ancillary data; 5.5). Ethnographic observations were supported by follow-up questionnaire responses. Conclusion This study provides usability-specific insights to inform future, improved, EHR interface that is better aligned with UCD approach.

Ergonomic evaluation of slide boards used by home care aides to assist client transfers.

PubMed

Sun, Chuan; Buchholz, Bryan; Quinn, Margaret; Punnett, Laura; Galligan, Catherine; Gore, Rebecca

2018-07-01

Home care aides risk musculoskeletal injury because they lift and move clients; the body weight of most adults exceeds the NIOSH recommended limit for lifting. Methods to reduce manual patient lifting in institutional settings are often technically or economically infeasible in home care. Our goal was to identify suitable, safe, low-technology transfer devices for home care use. Sixteen experienced home care aides performed client transfers from wheelchair to bed (upward) and bed to wheelchair (downward) in a simulated home care environment (laboratory), using four different slide boards and by hand without a device. Aides' hand forces were measured during client transfers; aides also evaluated usability of each board. Hand forces exerted while using slide boards were mostly lower than in manual transfer, and forces were lower in downward versus upward transfers. Aides judged a board with a sliding mechanism easier to use than boards without a sliding mechanism. Practitioner Summary: This paper provides quantitative biomechanical measurements showing that slide boards reduced the hand forces needed by home care aides to transfer clients from bed to wheel chair and vice versa, compared to manual lifting. Using a semi-quantitative usability survey, aides identified boards with a sliding mechanism easiest to use.

Development, Technical, and User Evaluation of a Web Mobile Application for Self-Control of Diabetes.

PubMed

Garcia-Zapirain, Begoña; de la Torre Díez, Isabel; Sainz de Abajo, Beatriz; López-Coronado, Miguel

2016-09-01

The main objective of this research was to develop and evaluate a Web-based mobile application (app) known as "Diario Diabetes" on both a technical and user level, by means of which individuals with diabetes may monitor their illness easily at any time and in any place using any device that has Internet access. The technologies used to develop the app were HTML, CSS, JavaScript, PHP, and MySQL, all of which are an open source. Once the app was developed, it was evaluated on a technical level (by measuring loading times) and on a user level, through a survey. Different loading times for the application were measured, with it being noted that under no circumstances does this exceed 2 s. Usability was evaluated by 150 users who initially used the application. A majority (71%) of users used a PC to access the app, 83% considered the app's design to be attractive, 67% considered the tasks to be very useful, and 67% found it very easy to use. Although applications exist for controlling diabetes both at mobile virtual shops or on a research level, our app may help to improve the administration of these types of patients and they are the ones who will ultimately opt for one or the other. According to the results obtained, we can state that all users would recommend the app's use to other users.

The Role of Free Internet Resources for Library Technical Services and Reference in a Hungarian LIS Continuing Education Course

ERIC Educational Resources Information Center

Koltay, Tibor

2006-01-01

After providing background to Continuing Professional Education (CPE) of librarians in Hungary, this article outlines the content of a course that seeks to make Hungarian librarians familiar with free Internet resources that are usable for library technical services and reference. One of the most important topics covered in the course is the…

The Unified English Braille Code: Examination by Science, Mathematics, and Computer Science Technical Expert Braille Readers

ERIC Educational Resources Information Center

Holbrook, M. Cay; MacCuspie, P. Ann

2010-01-01

Braille-reading mathematicians, scientists, and computer scientists were asked to examine the usability of the Unified English Braille Code (UEB) for technical materials. They had little knowledge of the code prior to the study. The research included two reading tasks, a short tutorial about UEB, and a focus group. The results indicated that the…

Evaluating Usability of Radiology Information Systems in Hospitals of Tabriz University of Medical Sciences.

PubMed

Rezaei-Hachesu, Peyman; Pesianian, Esmaeil; Mohammadian, Mohsen

2016-02-01

Radiology information system (RIS) in order to reduce workload and improve the quality of services must be well-designed. Heuristic evaluation is one of the methods that understand usability problems with the least time, cost and resources. The aim of present study is to evaluate the usability of RISs in hospitals. This is a cross-sectional descriptive study (2015) that uses heuristic evaluation method to evaluate the usability of RIS used in 3 hospitals of Tabriz city. The data are collected using a standard checklist based on 13 principles of Nielsen Heuristic evaluation method. Usability of RISs was investigated based on the number of components observed from Nielsen principles and problems of usability based on the number of non-observed components as well as non-existent or unrecognizable components. by evaluation of RISs in each of the hospitals 1, 2 and 3, total numbers of observed components were obtained as 173, 202 and 196, respectively. It was concluded that the usability of RISs in the studied population, on average and with observing 190 components of the 291 components related to the 13 principles of Nielsen is 65.41 %. Furthermore, problems of usability were obtained as 26.35%. The established and visible nature of some components such as response time of application, visual feedbacks, colors, view and design and arrangement of software objects cause more attention to these components as principal components in designing UI software. Also, incorrect analysis before system design leads to a lack of attention to secondary needs like Help software and security issues.

Evaluating the Usability of a Museum Web Site.

ERIC Educational Resources Information Center

Harms, Ilse; Schweibenz, Werner

This paper presents a research project conducted by the Department of Information Science in cooperation with the Saarland Museum, the art museum of the Federal State of Saarland, Germany. The study had two aims. The first was to evaluate some methods of usability engineering for the Web, and the second was to evaluate the usability of the…

A new global and comprehensive model for ICU ventilator performances evaluation.

PubMed

Marjanovic, Nicolas S; De Simone, Agathe; Jegou, Guillaume; L'Her, Erwan

2017-12-01

This study aimed to provide a new global and comprehensive evaluation of recent ICU ventilators taking into account both technical performances and ergonomics. Six recent ICU ventilators were evaluated. Technical performances were assessed under two FIO 2 levels (100%, 50%), three respiratory mechanics combinations (Normal: compliance [C] = 70 mL cmH 2 O -1 /resistance [R] = 5 cmH 2 O L -1  s -1 ; Restrictive: C = 30/R = 10; Obstructive: C = 120/R = 20), four exponential levels of leaks (from 0 to 12.5 L min -1 ) and three levels of inspiratory effort (P0.1 = 2, 4 and 8 cmH 2 O), using an automated test lung. Ergonomics were evaluated by 20 ICU physicians using a global and comprehensive model involving physiological response to stress measurements (heart rate, respiratory rate, tidal volume variability and eye tracking), psycho-cognitive scales (SUS and NASA-TLX) and objective tasks completion. Few differences in terms of technical performance were observed between devices. Non-invasive ventilation modes had a huge influence on asynchrony occurrence. Using our global model, either objective tasks completion, psycho-cognitive scales and/or physiological measurements were able to depict significant differences in terms of devices' usability. The level of failure that was observed with some devices depicted the lack of adaptation of device's development to end users' requests. Despite similar technical performance, some ICU ventilators exhibit low ergonomics performance and a high risk of misusage.

Comparison of heuristic and cognitive walkthrough usability evaluation methods for evaluating health information systems.

PubMed

Khajouei, Reza; Zahiri Esfahani, Misagh; Jahani, Yunes

2017-04-01

There are several user-based and expert-based usability evaluation methods that may perform differently according to the context in which they are used. The objective of this study was to compare 2 expert-based methods, heuristic evaluation (HE) and cognitive walkthrough (CW), for evaluating usability of health care information systems. Five evaluators independently evaluated a medical office management system using HE and CW. We compared the 2 methods in terms of the number of identified usability problems, their severity, and the coverage of each method. In total, 156 problems were identified using the 2 methods. HE identified a significantly higher number of problems related to the "satisfaction" attribute ( P  = .002). The number of problems identified using CW concerning the "learnability" attribute was significantly higher than those identified using HE ( P  = .005). There was no significant difference between the number of problems identified by HE, based on different usability attributes ( P  = .232). Results of CW showed a significant difference between the number of problems related to usability attributes ( P  < .0001). The average severity of problems identified using CW was significantly higher than that of HE ( P  < .0001). This study showed that HE and CW do not differ significantly in terms of the number of usability problems identified, but they differ based on the severity of problems and the coverage of some usability attributes. The results suggest that CW would be the preferred method for evaluating systems intended for novice users and HE for users who have experience with similar systems. However, more studies are needed to support this finding. © The Author 2016. Published by Oxford University Press on behalf of the American Medical Informatics Association. All rights reserved. For Permissions, please email: journals.permissions@oup.com

A usability evaluation of a SNOMED CT based compositional interface terminology for intensive care.

PubMed

Bakhshi-Raiez, F; de Keizer, N F; Cornet, R; Dorrepaal, M; Dongelmans, D; Jaspers, M W M

2012-05-01

To evaluate the usability of a large compositional interface terminology based on SNOMED CT and the terminology application for registration of the reasons for intensive care admission in a Patient Data Management System. Observational study with user-based usability evaluations before and 3 months after the system was implemented and routinely used. Usability was defined by five aspects: effectiveness, efficiency, learnability, overall user satisfaction, and experienced usability problems. Qualitative (the Think-Aloud user testing method) and quantitative (the System Usability Scale questionnaire and Time-on-Task analyses) methods were used to examine these usability aspects. The results of the evaluation study revealed that the usability of the interface terminology fell short (SUS scores before and after implementation of 47.2 out of 100 and 37.5 respectively out of 100). The qualitative measurements revealed a high number (n=35) of distinct usability problems, leading to ineffective and inefficient registration of reasons for admission. The effectiveness and efficiency of the system did not change over time. About 14% (n=5) of the revealed usability problems were related to the terminology content based on SNOMED CT, while the remaining 86% (n=30) was related to the terminology application. The problems related to the terminology content were more severe than the problems related to the terminology application. This study provides a detailed insight into how clinicians interact with a controlled compositional terminology through a terminology application. The extensiveness, complexity of the hierarchy, and the language usage of an interface terminology are defining for its usability. Carefully crafted domain-specific subsets and a well-designed terminology application are needed to facilitate the use of a complex compositional interface terminology based on SNOMED CT. Copyright © 2011 Elsevier Ireland Ltd. All rights reserved.

Evidence-based Heuristics for Evaluating Demands on eHealth Literacy and Usability in a Mobile Consumer Health Application.

PubMed

Monkman, Helen; Griffith, Janessa; Kushniruk, Andre W

2015-01-01

Heuristic evaluations have proven to be valuable for identifying usability issues in systems. Commonly used sets of heuritics exist; however, they may not always be the most suitable, given the specific goal of the analysis. One such example is seeking to evaluate the demands on eHealth literacy and usability of consumer health information systems. In this study, eight essential heuristics and three optional heuristics subsumed from the evidence on eHealth/health literacy and usability were tested for their utility in assessing a mobile blood pressure tracking application (app). This evaluation revealed a variety of ways the design of the app could both benefit and impede users with limited eHealth literacy. This study demonstrated the utility of a low-cost, single evaluation approach for identifying both eHealth literacy and usability issues based on existing evidence in the literature.

Using Eye Trackers for Usability Evaluation of Health Information Technology: A Systematic Literature Review

PubMed Central

Yang, Yushi

2015-01-01

Background Eye-tracking technology has been used to measure human cognitive processes and has the potential to improve the usability of health information technology (HIT). However, it is still unclear how the eye-tracking method can be integrated with other traditional usability methodologies to achieve its full potential. Objective The objective of this study was to report on HIT evaluation studies that have used eye-tracker technology, and to envision the potential use of eye-tracking technology in future research. Methods We used four reference databases to initially identify 5248 related papers, which resulted in only 9 articles that met our inclusion criteria. Results Eye-tracking technology was useful in finding usability problems in many ways, but is still in its infancy for HIT usability evaluation. Limited types of HITs have been evaluated by eye trackers, and there has been a lack of evaluation research in natural settings. Conclusions More research should be done in natural settings to discover the real contextual-based usability problems of clinical and mobile HITs using eye-tracking technology with more standardized methodologies and guidance. PMID:27026079

Feasibility of a computer-assisted alcohol screening, brief intervention and referral to treatment program for DWI offenders.

PubMed

Mullen, Jillian; Ryan, Stacy R; Mathias, Charles W; Dougherty, Donald M

2015-11-09

Alcohol use patterns that are hazardous for one's health is prevalent among DWI (driving while intoxicated) offenders and is a key predictor of recidivism. The aim of this program evaluation was to determine the feasibility and usability of implementing a computer-assisted screening, brief intervention and referral to treatment (SBIRT) program for DWI offenders to enable the identification of those in need of treatment services soon after arrest. Our treatment program consisted of a web-based, self-guided screening tool for assessing alcohol use patterns and generating a personalized feedback report that is then used to deliver a brief motivational intervention and if needed, a referral to treatment. Between August and November 2014, all DWI offenders attending orientation for pre-trial supervision were assessed for eligibility. Of the 129 eligible offenders, 53.5 percent enrolled and the first 50 were asked to complete a usability and satisfaction questionnaire. The results demonstrated that the majority of those screened reported at-risk alcohol use patterns requiring referral to treatment. Clients reported high ratings of usability and satisfaction with the screening tool and personalized feedback report, which did not significantly differ depending on alcohol use patterns. There were relatively few technical difficulties, and the majority of clients reported high levels of satisfaction with the overall SBIRT program. Results of this program evaluation suggest that computer-assisted SBIRT may be successfully implemented within the criminal justice system to DWI offenders soon after arrest; however, further research is required to examine its effects on treatment utilization and recidivism.

Adapting a Psychosocial Intervention for Smartphone Delivery to Middle-Aged and Older Adults with Serious Mental Illness.

PubMed

Whiteman, Karen L; Lohman, Matthew C; Gill, Lydia E; Bruce, Martha L; Bartels, Stephen J

2017-08-01

To describe the process of adapting an integrated medical and psychiatric self-management intervention to a smartphone application for middle-aged and older adults with serious mental illness using an adaptive systems engineering framework and user-centered design. First, we determined the technical abilities and needs of middle-aged and older adults with serious mental illnesses using smartphones. Then, we developed smartphone content through principles of user-centered design and modified an existing smartphone platform. Finally, we conducted a usability test using "think aloud" and verbal probing. We adapted a psychosocial self-management intervention to a smartphone application and tested its usability. Ten participants (mean age: 55.3 years, SD: 6.2 years) with serious mental illness and comorbid chronic health conditions reported a high level of usability and satisfaction with the smartphone application. Middle-aged and older adults with serious mental illness and limited technical abilities were able to participate in a process involving user-centered design and adaptation of a self-management intervention to be delivered by a smartphone. High usability ratings suggest that middle-aged and older adults with serious mental illness have the potential to use tailored smartphone interventions. Future research is indicated to establish effectiveness and to determine the type and intensity of clinical support needed to successfully implement smartphone applications as a component of community-based services for older adults with psychiatric and medical conditions. Copyright © 2017 American Association for Geriatric Psychiatry. Published by Elsevier Inc. All rights reserved.

Comparison of four different mobile devices for measuring heart rate and ECG with respect to aspects of usability and acceptance by older people.

PubMed

Ehmen, Hilko; Haesner, Marten; Steinke, Ines; Dorn, Mario; Gövercin, Mehmet; Steinhagen-Thiessen, Elisabeth

2012-05-01

In the area of product design and usability, most products are developed for the mass-market by technically oriented designers and developers for use by persons who themselves are also technically adept by today's standards. The demands of older people are commonly not given sufficient consideration within the early developmental process. In the present study, the usability and acceptability of four different devices meant to be worn for the measurement of heart rate or ECG were analyzed on the basis of qualitative subjective user ratings and structured interviews of twelve older participants. The data suggest that there was a relatively high acceptance concerning these belts by older adults but none of the four harnesses was completely usable. Especially problematic to the point of limiting satisfaction among older subjects were problems encountered while adjusting the length of the belt and/or closing the locking mechanism. The two devices intended for dedicated heart rate recording yielded the highest user ratings for design, and were clearly preferred for extended wearing time. Yet for all the devices participants identified several important deficiencies in their design, as well as suggestions for improvement. We conclude that the creation of an acceptable monitoring device for older persons requires designers and developers to consider the special demands and abilities of the target group. Copyright © 2011 Elsevier Ltd and The Ergonomics Society. All rights reserved.

Does the use of structured reporting improve usability? A comparative evaluation of the usability of two approaches for findings reporting in a large-scale telecardiology context.

PubMed

Lacerda, Thaisa Cardoso; von Wangenheim, Christiane Gresse; von Wangenheim, Aldo; Giuliano, Isabela

2014-12-01

One of the main reasons that leads to a low adoption rate of telemedicine systems is poor usability. An aspect that influences usability during the reporting of findings is the input mode, e.g., if a free-text (FT) or a structured report (SR) interface is employed. The objective of our study is to compare the usability of FT and ST telemedicine systems, specifically in terms of user satisfaction, efficiency and general usability. We comparatively evaluate the usability of these two input modes in a telecardiology system for issuing electrocardiography reports in the context of a statewide telemedicine system in Brazil with more than 350.000 performed tele-electrocardiography examinations. We adopted a multiple method research strategy, applying three different kinds of usability evaluations: user satisfaction was evaluated through interviews with seven medical professionals using the System Usability Scale (SUS) questionnaire and specific questions related to adequacy and user experience. Efficiency was evaluated by estimating execution time using the Keystroke-Level Model (KLM). General usability was assessed based on the conformity of the systems to a set of e-health specific usability heuristics. The results of this comparison provide a first indication that a structured report (SR) input mode for such a system is more satisfactory and efficient with a larger conformity to usability heuristics than free-text (FT) input. User satisfaction using the SUS questionnaire has been scored in average with 58.8 and 77.5 points for the FT and SR system, respectively, which means that the SR system was rated 18.65 points higher than the FT system. In terms of efficiency, the completion of a findings report using the SR mode is estimated to take 8.5s, 3.74 times faster than using the FT system (31.8s). The SR system also demonstrated less violations to usability heuristics (8 points) in comparison to 14 points observed in the FT system. These results provide a first indication that the usage of structured reporting as an input mode in telecardiology systems may enhance usability. This also seems to confirm the advantages of the usage of structured reporting, as already described in the literature for other areas such as teleradiology. Copyright © 2014 Elsevier Inc. All rights reserved.

Accessibility and usability OCW data: The UTPL OCW.

PubMed

Rodríguez, Germania; Perez, Jennifer; Cueva, Samanta; Torres, Rommel

2017-08-01

This data article provides a data description on article entitled "A framework for improving web accessibility and usability of Open Course Ware sites" [3] This Data in Brief presents the data obtained from the accessibility and usability evaluation of the UTPL OCW. The data obtained from the framework evaluation consists of the manual evaluation of the standards criteria and the automatic evaluation of the tools Google PageSpeed and Google Analytics. In addition, this article presents the synthetized tables from standards that are used by the framework to evaluate the accessibility and usability of OCW, and the questionnaires required to extract the data. As a result, the article also provides the data required to reproduce the evaluation of other OCW.

Applying heuristic evaluation to improve the usability of a telemedicine system.

PubMed

Tang, Zhihua; Johnson, Todd R; Tindall, R Douglas; Zhang, Jiajie

2006-02-01

The development of a telemedicine system should not only take advantage of technological advances but also pay close attention to users and the human issues involved. In this paper we examine the utility of heuristic evaluation in improving the usability of a digital emergency medical services (EMS) system equipped on an ambulance. The digital EMS system used advanced communication technologies to help remotely located trauma specialists gain access to patient data in real-time and direct life-saving measures in a timely fashion. To improve its usability, three experts inspected prototypes of the system according to 14 software usability heuristics. The analyses revealed information on the prevalence, severity, and nature of heuristic violations in the user interface design. The results were subsequently utilized to guide the iterative software design process. A comparison between two consecutive prototypes showed that the second design had only half as many usability violations as the first prototype and had considerable improvement in a number of usability heuristic categories. The validity of heuristic evaluation was examined in an ethnographic study of paramedics using a prototype of the system in their work environment. Users' task performances partially verified heuristic evaluation results. However, they also revealed problems that were not identified in heuristic evaluation but only became prominent during field observation. In conclusion, we argue that usability should be given high priority in the development of a telemedicine system, and that heuristic evaluation can be an effective and efficient way to identify usability problems in the early stage of software development.

19 CFR 163.1 - Definitions.

Code of Federal Regulations, 2011 CFR

2011-04-01

... following: Statements; declarations; documents; electronically generated or machine readable data; electronically stored or transmitted information or data; books; papers; correspondence; accounts; financial accounting data; technical data; computer programs necessary to retrieve information in a usable form; and...

Usability Evaluation of a Clinical Decision Support System for Geriatric ED Pain Treatment.

PubMed

Genes, Nicholas; Kim, Min Soon; Thum, Frederick L; Rivera, Laura; Beato, Rosemary; Song, Carolyn; Soriano, Jared; Kannry, Joseph; Baumlin, Kevin; Hwang, Ula

2016-01-01

Older adults are at risk for inadequate emergency department (ED) pain care. Unrelieved acute pain is associated with poor outcomes. Clinical decision support systems (CDSS) hold promise to improve patient care, but CDSS quality varies widely, particularly when usability evaluation is not employed. To conduct an iterative usability and redesign process of a novel geriatric abdominal pain care CDSS. We hypothesized this process would result in the creation of more usable and favorable pain care interventions. Thirteen emergency physicians familiar with the Electronic Health Record (EHR) in use at the study site were recruited. Over a 10-week period, 17 1-hour usability test sessions were conducted across 3 rounds of testing. Participants were given 3 patient scenarios and provided simulated clinical care using the EHR, while interacting with the CDSS interventions. Quantitative System Usability Scores (SUS), favorability scores and qualitative narrative feedback were collected for each session. Using a multi-step review process by an interdisciplinary team, positive and negative usability issues in effectiveness, efficiency, and satisfaction were considered, prioritized and incorporated in the iterative redesign process of the CDSS. Video analysis was used to determine the appropriateness of the CDS appearances during simulated clinical care. Over the 3 rounds of usability evaluations and subsequent redesign processes, mean SUS progressively improved from 74.8 to 81.2 to 88.9; mean favorability scores improved from 3.23 to 4.29 (1 worst, 5 best). Video analysis revealed that, in the course of the iterative redesign processes, rates of physicians' acknowledgment of CDS interventions increased, however most rates of desired actions by physicians (such as more frequent pain score updates) decreased. The iterative usability redesign process was instrumental in improving the usability of the CDSS; if implemented in practice, it could improve geriatric pain care. The usability evaluation process led to improved acknowledgement and favorability. Incorporating usability testing when designing CDSS interventions for studies may be effective to enhance clinician use.

Evaluating Usability in a Distance Digital Systems Laboratory Class

ERIC Educational Resources Information Center

Kostaras, N.; Xenos, M.; Skodras, A. N.

2011-01-01

This paper presents the usability evaluation of a digital systems laboratory class offered to distance-learning students. It details the way in which students can participate remotely in such a laboratory, the methodology employed in the usability assessment of the laboratory infrastructure (hardware and software), and also outlines the main…

A Usability Evaluation of Academic Virtual Reference Services

ERIC Educational Resources Information Center

Chow, Anthony S.; Croxton, Rebecca A.

2014-01-01

This study examined the usability of five virtual reference services--instant messenger chat, e-mail, telephone, text messaging, and Skype videoconferencing--by having 31 undergraduate and graduate students evaluate the usability of the virtual reference services of two different universities. The study's results suggest that user preference and…

Usability Assessment of E-Café Operational Management Simulation Game

ERIC Educational Resources Information Center

Chang, Chiung-sui; Huang, Ya-Ping

2013-01-01

To ensure the quality of digital simulation game, we utilized the usability evaluation heuristic in the design and development processes of e-café operational management game-based learning material for students. The application of usability evaluations during this study is described. Additionally, participant selection, data collection and…

Usability Study and Heuristic Evaluation of the Applied Robotics for Installations and Base Operations (ARIBO) Driverless Vehicle Reservation Application ARIBO Mobile

DTIC Science & Technology

2017-03-01

ARL-TN-0814 ● MAR 2017 US Army Research Laboratory Usability Study and Heuristic Evaluation of the Applied Robotics for...ARL-TN-0814 ● MAR 2017 US Army Research Laboratory Usability Study and Heuristic Evaluation of the Applied Robotics for...Heuristic Evaluation of the Applied Robotics for Installations and Base Operations (ARIBO) Driverless Vehicle Reservation Application ARIBO Mobile 5a

Placing wireless tablets in clinical settings for patient education.

PubMed

Stribling, Judy C; Richardson, Joshua E

2016-04-01

The authors explored the feasibility and possible benefit of tablet-based educational materials for patients in clinic waiting areas. We distributed eight tablets preloaded with diagnosis-relevant information in two clinic waiting areas. Patients were surveyed about satisfaction, usability, and effects on learning. Technical issues were resolved. Thirty-seven of forty patients completed the survey. On average, the patients were satisfied in all categories. Placing tablet-based educational materials in clinic waiting areas is relatively easy to implement. Patients using tablets reported satisfaction across three domains: usability, education, and satisfaction.

Usage and Usability of a Web-based Program for Family Caregivers of Older People in Three European Countries: A Mixed-Methods Evaluation.

PubMed

Barbabella, Francesco; Poli, Arianna; Hanson, Elizabeth; Andréasson, Frida; Salzmann, Benjamin; Döhner, Hanneli; Papa, Roberta; Efthymiou, Areti; Valenza, Silvia; Pelliccioni, Giuseppe; Lamura, Giovanni

2018-05-01

InformCare is a European Web platform that supports informal caregivers of older people by providing access to online information and professional and peer support. The aim of this study was to assess the usage and usability of a psychosocial Web-based program carried out in three European countries (Italy, Sweden, and Germany). A mixed-methods sequential explanatory design was adopted, comprising baseline and postintervention assessments, as well as combined thematic content analysis of results and focus group findings. A convenience sample of 118 caregivers was enrolled, of whom 94 used the services offered by the program at least once. The subsamples in the three countries used the platform in different ways, with a predominance of passive strategies (eg, seeking information and reading other people's comments) for Italian caregivers, and more active usage by Swedish and German caregivers. The usability assessment showed that the platform was perceived well by Italian and German caregivers, whereas technical problems affected the Swedish sample's experiences. Focus group data highlighted user satisfaction with the online support and reliability of the environment. Recommendations for practitioners are to ensure digital training for caregivers who have lower confidence in use of the Internet, to involve different healthcare professionals in the provision of professional support, and to adequately manage online community building.

Evaluation of Usability Utilizing Markov Models

ERIC Educational Resources Information Center

Penedo, Janaina Rodrigues; Diniz, Morganna; Ferreira, Simone Bacellar Leal; Silveira, Denis S.; Capra, Eliane

2012-01-01

Purpose: The purpose of this paper is to analyze the usability of a remote learning system in its initial development phase, using a quantitative usability evaluation method through Markov models. Design/methodology/approach: The paper opted for an exploratory study. The data of interest of the research correspond to the possible accesses of users…

Review of health information technology usability study methodologies

PubMed Central

Bakken, Suzanne

2011-01-01

Usability factors are a major obstacle to health information technology (IT) adoption. The purpose of this paper is to review and categorize health IT usability study methods and to provide practical guidance on health IT usability evaluation. 2025 references were initially retrieved from the Medline database from 2003 to 2009 that evaluated health IT used by clinicians. Titles and abstracts were first reviewed for inclusion. Full-text articles were then examined to identify final eligibility studies. 629 studies were categorized into the five stages of an integrated usability specification and evaluation framework that was based on a usability model and the system development life cycle (SDLC)-associated stages of evaluation. Theoretical and methodological aspects of 319 studies were extracted in greater detail and studies that focused on system validation (SDLC stage 2) were not assessed further. The number of studies by stage was: stage 1, task-based or user–task interaction, n=42; stage 2, system–task interaction, n=310; stage 3, user–task–system interaction, n=69; stage 4, user–task–system–environment interaction, n=54; and stage 5, user–task–system–environment interaction in routine use, n=199. The studies applied a variety of quantitative and qualitative approaches. Methodological issues included lack of theoretical framework/model, lack of details regarding qualitative study approaches, single evaluation focus, environmental factors not evaluated in the early stages, and guideline adherence as the primary outcome for decision support system evaluations. Based on the findings, a three-level stratified view of health IT usability evaluation is proposed and methodological guidance is offered based upon the type of interaction that is of primary interest in the evaluation. PMID:21828224

Design and validation of a questionnaire to evaluate the usability of computerized critical care information systems.

PubMed

von Dincklage, Falk; Lichtner, Gregor; Suchodolski, Klaudiusz; Ragaller, Maximilian; Friesdorf, Wolfgang; Podtschaske, Beatrice

2017-08-01

The implementation of computerized critical care information systems (CCIS) can improve the quality of clinical care and staff satisfaction, but also holds risks of disrupting the workflow with consecutive negative impacts. The usability of CCIS is one of the key factors determining their benefits and weaknesses. However, no tailored instrument exists to measure the usability of such systems. Therefore, the aim of this study was to design and validate a questionnaire that measures the usability of CCIS. Following a mixed-method design approach, we developed a questionnaire comprising two evaluation models to assess the usability of CCIS: (1) the task-specific model rates the usability individually for several tasks which CCIS could support and which we derived by analyzing work processes in the ICU; (2) the characteristic-specific model rates the different aspects of the usability, as defined by the international standard "ergonomics of human-system interaction". We tested validity and reliability of the digital version of the questionnaire in a sample population. In the sample population of 535 participants both usability evaluation models showed a strong correlation with the overall rating of the system (multiple correlation coefficients ≥0.80) as well as a very high internal consistency (Cronbach's alpha ≥0.93). The novel questionnaire is a valid and reliable instrument to measure the usability of CCIS and can be used to study the influence of the usability on their implementation benefits and weaknesses.

Usability Assessment of Secure Messaging for Clinical Document Sharing between Health Care Providers and Patients.

PubMed

Jahn, Michelle A; Porter, Brian W; Patel, Himalaya; Zillich, Alan J; Simon, Steven R; Russ, Alissa L

2018-04-01

 Web-based patient portals feature secure messaging systems that enable health care providers and patients to communicate information. However, little is known about the usability of these systems for clinical document sharing.  This article evaluates the usability of a secure messaging system for providers and patients in terms of its ability to support sharing of electronic clinical documents.  We conducted usability testing with providers and patients in a human-computer interaction laboratory at a Midwestern U.S. hospital. Providers sent a medication list document to a fictitious patient via secure messaging. Separately, patients retrieved the clinical document from a secure message and returned it to a fictitious provider. We collected use errors, task completion, task time, and satisfaction.  Twenty-nine individuals participated: 19 providers (6 physicians, 6 registered nurses, and 7 pharmacists) and 10 patients. Among providers, 11 (58%) attached and sent the clinical document via secure messaging without requiring assistance, in a median (range) of 4.5 (1.8-12.7) minutes. No patients completed tasks without moderator assistance. Patients accessed the secure messaging system within 3.6 (1.2-15.0) minutes; retrieved the clinical document within 0.8 (0.5-5.7) minutes; and sent the attached clinical document in 6.3 (1.5-18.1) minutes. Although median satisfaction ratings were high, with 5.8 for providers and 6.0 for patients (scale, 0-7), we identified 36 different use errors. Physicians and pharmacists requested additional features to support care coordination via health information technology, while nurses requested features to support efficiency for their tasks.  This study examined the usability of clinical document sharing, a key feature of many secure messaging systems. Our results highlight similarities and differences between provider and patient end-user groups, which can inform secure messaging design to improve learnability and efficiency. The observations suggest recommendations for improving the technical aspects of secure messaging for clinical document sharing. Schattauer GmbH Stuttgart.

An eHealth Application of Self-Reported Sports-Related Injuries and Illnesses in Paralympic Sport: Pilot Feasibility and Usability Study.

PubMed

Fagher, Kristina; Jacobsson, Jenny; Dahlström, Örjan; Timpka, Toomas; Lexell, Jan

2017-11-29

Sport participation is associated with a risk of sports-related injuries and illnesses, and Paralympic athletes' additional medical issues can be a challenge to health care providers and medical staff. However, few prospective studies have assessed sports-related injuries and illnesses in Paralympic sport (SRIIPS) over time. Advances in mobile phone technology and networking systems offer novel opportunities to develop innovative eHealth applications for collection of athletes' self-reports. Using eHealth applications for collection of self-reported SRIIPS is an unexplored area, and before initiation of full-scale research of SRIIPS, the feasibility and usability of such an approach needs to be ascertained. The aim of this study was to perform a 4-week pilot study and (1) evaluate the monitoring feasibility and system usability of a novel eHealth application for self-reported SRIIPS and (2) report preliminary data on SRIIPS. An eHealth application for routine collection of data from athletes was developed and adapted to Paralympic athletes. A 4-week pilot study was performed where Paralympic athletes (n=28) were asked to weekly self-report sport exposure, training load, general well-being, pain, sleep, anxiety, and possible SRIIPS. The data collection was followed by a poststudy use assessment survey. Quantitative data related to the system use (eg, completed self-reports, missing responses, and errors) were analyzed using descriptive statistics. The qualitative feasibility and usability data provided by the athletes were condensed and categorized using thematic analysis methods. The weekly response rate was 95%. The athletes were of the opinion that the eHealth application was usable and feasible but stated that it was not fully adapted to Paralympic athletes and their impairments. For example, it was difficult to understand how a new injury or illness should be identified when the impairment was involved. More survey items related to the impairments were requested, as the athletes perceived that injuries and illnesses often occurred because of the impairment. Options for description of multifactorial incidents including an injury, an illness, and the impairment were also insufficient. Few technical issues were encountered, but athletes with visual impairment reported usability difficulties with the speech synthesizer. An incidence rate of 1.8 injuries and 1.7 illnesses per 100 hours of athlete exposure were recorded. The weekly pain prevalence was 56% and the impairment contributed to 20% of the reported incidents. The novel eHealth-based application for self-reported SRIIPS developed and tested in this pilot study was generally feasible and usable. With some adaptation to accommodate Paralympic athletes' prerequisites and improved technical support for athletes with visual impairment, this application can be recommended for use in prospective studies of SRIIPS. ClinicalTrials.gov NCT02788500; https://clinicaltrials.gov/ct2/show/NCT02788500 (Archived by WebCite at http://www.webcitation.org/6v56OqTeP). ©Kristina Fagher, Jenny Jacobsson, Örjan Dahlström, Toomas Timpka, Jan Lexell. Originally published in JMIR Human Factors (http://humanfactors.jmir.org), 29.11.2017.

Usability in the real world: assessing medical information technologies in patients' homes.

PubMed

Kaufman, David R; Patel, Vimla L; Hilliman, Charlyn; Morin, Philip C; Pevzner, Jenia; Weinstock, Ruth S; Goland, Robin; Shea, Steven; Starren, Justin

2003-01-01

This paper presents an approach to usability evaluation of computer-based health care systems designed for patient use in their homes. Although such devices are becoming more prevalent, there is very little known about their usability. The theoretical foundations for the methods are discussed. The approach incorporates a cognitive walkthrough usability evaluation and new methods for usability testing that can be conducted in patient's homes. The method was applied to the IDEATel intervention, a multi-institution randomized controlled trial of the feasibility, acceptability, and clinical utility of a home-based telemedicine system for diabetic Medicare population. The usability study was designed to assess barriers to optimal use of the system. The focus was both on dimensions of the interface and on dimensions of patient skills and competency. The usability field research involved testing 25 patients in their homes using the system. The analysis included a range of video-analytic methods of varying levels of granularity. The usability evaluation revealed aspects of the interface that were sub-optimal and impeded the performance of certain tasks. It also found a range of patient-related factors such as numeracy and psychomotor skills that constituted barriers to productive use. A multifaceted usability approach provided important insight regarding use of technology by an elderly chronic-care patient population and more generally, for understanding how home health initiatives can more effectively use such technology.

Cyberpsychology: a human-interaction perspective based on cognitive modeling.

PubMed

Emond, Bruno; West, Robert L

2003-10-01

This paper argues for the relevance of cognitive modeling and cognitive architectures to cyberpsychology. From a human-computer interaction point of view, cognitive modeling can have benefits both for theory and model building, and for the design and evaluation of sociotechnical systems usability. Cognitive modeling research applied to human-computer interaction has two complimentary objectives: (1) to develop theories and computational models of human interactive behavior with information and collaborative technologies, and (2) to use the computational models as building blocks for the design, implementation, and evaluation of interactive technologies. From the perspective of building theories and models, cognitive modeling offers the possibility to anchor cyberpsychology theories and models into cognitive architectures. From the perspective of the design and evaluation of socio-technical systems, cognitive models can provide the basis for simulated users, which can play an important role in usability testing. As an example of application of cognitive modeling to technology design, the paper presents a simulation of interactive behavior with five different adaptive menu algorithms: random, fixed, stacked, frequency based, and activation based. Results of the simulation indicate that fixed menu positions seem to offer the best support for classification like tasks such as filing e-mails. This research is part of the Human-Computer Interaction, and the Broadband Visual Communication research programs at the National Research Council of Canada, in collaboration with the Carleton Cognitive Modeling Lab at Carleton University.

Task-specific usability requirements of electronic medical records systems: Lessons learned from a national survey of end-users.

PubMed

Farzandipour, Mehrdad; Meidani, Zahra; Riazi, Hossein; Sadeqi Jabali, Monireh

2018-09-01

There are various approaches to evaluating the usability of electronic medical record (EMR) systems. User perspectives are an integral part of evaluation. Usability evaluations efficiently and effectively contribute to user-centered design and supports tasks and increase user satisfaction. This study determined the main usability requirements for EMRs by means of an end-user survey. A mixed-method strategy was conducted in three phases. A qualitative approach was employed to collect and formulate EMR usability requirements using the focus group method and the modified Delphi technique. Classic Delphi technique was used to evaluate the proposed requirements among 380 end-users in Iran. The final list of EMR usability requirements was verified and included 163 requirements divided into nine groups. The highest rates of end-user agreement relate to EMR visual clarity (3.65 ± 0.61), fault tolerance (3.58 ± 0.56), and suitability for learning (3.55 ± 0.54). The lowest end-user agreement was for auditory presentation (3.18 ± 0.69). The highest and lowest agreement among end-users was for visual clarity and auditory presentation by EMRs, respectively. This suggests that user priorities in determination of EMR usability and their understanding of the importance of the types of individual tasks and context characteristics differ.

The value of Retrospective and Concurrent Think Aloud in formative usability testing of a physician data query tool.

PubMed

Peute, Linda W P; de Keizer, Nicolette F; Jaspers, Monique W M

2015-06-01

To compare the performance of the Concurrent (CTA) and Retrospective (RTA) Think Aloud method and to assess their value in a formative usability evaluation of an Intensive Care Registry-physician data query tool designed to support ICU quality improvement processes. Sixteen representative intensive care physicians participated in the usability evaluation study. Subjects were allocated to either the CTA or RTA method by a matched randomized design. Each subject performed six usability-testing tasks of varying complexity in the query tool in a real-working context. Methods were compared with regard to number and type of problems detected. Verbal protocols of CTA and RTA were analyzed in depth to assess differences in verbal output. Standardized measures were applied to assess thoroughness in usability problem detection weighted per problem severity level and method overall effectiveness in detecting usability problems with regard to the time subjects spent per method. The usability evaluation of the data query tool revealed a total of 43 unique usability problems that the intensive care physicians encountered. CTA detected unique usability problems with regard to graphics/symbols, navigation issues, error messages, and the organization of information on the query tool's screens. RTA detected unique issues concerning system match with subjects' language and applied terminology. The in-depth verbal protocol analysis of CTA provided information on intensive care physicians' query design strategies. Overall, CTA performed significantly better than RTA in detecting usability problems. CTA usability problem detection effectiveness was 0.80 vs. 0.62 (p<0.05) respectively, with an average difference of 42% less time spent per subject compared to RTA. In addition, CTA was more thorough in detecting usability problems of a moderate (0.85 vs. 0.7) and severe nature (0.71 vs. 0.57). In this study, the CTA is more effective in usability-problem detection and provided clarification of intensive care physician query design strategies to inform redesign of the query tool. However, CTA does not outperform RTA. The RTA additionally elucidated unique usability problems and new user requirements. Based on the results of this study, we recommend the use of CTA in formative usability evaluation studies of health information technology. However, we recommend further research on the application of RTA in usability studies with regard to user expertise and experience when focusing on user profile customized (re)design. Copyright © 2015 Elsevier Inc. All rights reserved.

The Usability of Diabetes MAP: A Web-delivered Intervention for Improving Medication Adherence.

PubMed

Nelson, Lyndsay A; Bethune, Magaela C; Lagotte, Andrea E; Osborn, Chandra Y

2016-05-12

Web-delivered interventions are a feasible approach to health promotion. However, if a website is poorly designed, difficult to navigate, and has technical bugs, it will not be used as intended. Usability testing prior to evaluating a website's benefits can identify barriers to user engagement and maximize future use. We developed a Web-delivered intervention called Diabetes Medication Adherence Promotion (Diabetes MAP) and used a mixed-methods approach to test its usability prior to evaluating its efficacy on medication adherence and glycemic control in a randomized controlled trial. We recruited English-speaking adults with type 2 diabetes mellitus (T2DM) from an academic medical center who were prescribed diabetes medications. A trained research assistant administered a baseline survey, collected medical record information, and instructed participants on how to access Diabetes MAP. Participants were asked to use the site independently for 2 weeks and to provide survey and/or focus group feedback on their experience. We analyzed survey data descriptively and qualitative data thematically to identify participants' favorable and unfavorable experiences, characterize usability concerns, and solicit recommendations for improving Diabetes MAP. Enrolled participants (N=32) were an average of 51.7 ± 11.8 years old, 66% (21/32) female, 60% (19/32) non-Hispanic White, 88% (28/32) had more than 12 years of education, half had household incomes over $50,000, and 78% (25/32) were privately insured. Average duration of diagnosed diabetes was 7.8 ± 6.3 years, average A1c was 7.4 ± 2.0, and 38% (12/32) were prescribed insulin. Of enrolled participants, 91% (29/32) provided survey and/or focus group feedback about Diabetes MAP. On the survey, participants agreed website information was clear and easy to understand, but in focus groups they reported navigational challenges and difficulty overcoming user errors (eg, entering data in an unspecified format). Participants also reported difficulty accessing the site and, once accessed, using all of its features. Participants recommended improving the site's user interface to facilitate quick, efficient access to all features and content. Adults with T2DM rated the Diabetes MAP website favorably on surveys, but focus groups gave more in-depth feedback on the user experience (eg, difficulty accessing the site, maximizing all of the site's features and content, and recovering from errors). Appropriate usability testing methods ensure Web-delivered interventions work as intended and any benefits are not diminished by usability challenges.

The Usability of Diabetes MAP: A Web-delivered Intervention for Improving Medication Adherence

PubMed Central

Nelson, Lyndsay A; Bethune, Magaela C; Lagotte, Andrea E

2016-01-01

Background Web-delivered interventions are a feasible approach to health promotion. However, if a website is poorly designed, difficult to navigate, and has technical bugs, it will not be used as intended. Usability testing prior to evaluating a website’s benefits can identify barriers to user engagement and maximize future use. Objective We developed a Web-delivered intervention called Diabetes Medication Adherence Promotion (Diabetes MAP) and used a mixed-methods approach to test its usability prior to evaluating its efficacy on medication adherence and glycemic control in a randomized controlled trial. Methods We recruited English-speaking adults with type 2 diabetes mellitus (T2DM) from an academic medical center who were prescribed diabetes medications. A trained research assistant administered a baseline survey, collected medical record information, and instructed participants on how to access Diabetes MAP. Participants were asked to use the site independently for 2 weeks and to provide survey and/or focus group feedback on their experience. We analyzed survey data descriptively and qualitative data thematically to identify participants’ favorable and unfavorable experiences, characterize usability concerns, and solicit recommendations for improving Diabetes MAP. Results Enrolled participants (N=32) were an average of 51.7 ± 11.8 years old, 66% (21/32) female, 60% (19/32) non-Hispanic White, 88% (28/32) had more than 12 years of education, half had household incomes over $50,000, and 78% (25/32) were privately insured. Average duration of diagnosed diabetes was 7.8 ± 6.3 years, average A1c was 7.4 ± 2.0, and 38% (12/32) were prescribed insulin. Of enrolled participants, 91% (29/32) provided survey and/or focus group feedback about Diabetes MAP. On the survey, participants agreed website information was clear and easy to understand, but in focus groups they reported navigational challenges and difficulty overcoming user errors (eg, entering data in an unspecified format). Participants also reported difficulty accessing the site and, once accessed, using all of its features. Participants recommended improving the site’s user interface to facilitate quick, efficient access to all features and content. Conclusions Adults with T2DM rated the Diabetes MAP website favorably on surveys, but focus groups gave more in-depth feedback on the user experience (eg, difficulty accessing the site, maximizing all of the site’s features and content, and recovering from errors). Appropriate usability testing methods ensure Web-delivered interventions work as intended and any benefits are not diminished by usability challenges. PMID:27174496

Sensor-oriented feature usability evaluation in fingerprint segmentation

NASA Astrophysics Data System (ADS)

Li, Ying; Yin, Yilong; Yang, Gongping

2013-06-01

Existing fingerprint segmentation methods usually process fingerprint images captured by different sensors with the same feature or feature set. We propose to improve the fingerprint segmentation result in view of an important fact that images from different sensors have different characteristics for segmentation. Feature usability evaluation, which means to evaluate the usability of features to find the personalized feature or feature set for different sensors to improve the performance of segmentation. The need for feature usability evaluation for fingerprint segmentation is raised and analyzed as a new issue. To address this issue, we present a decision-tree-based feature-usability evaluation method, which utilizes a C4.5 decision tree algorithm to evaluate and pick the best suitable feature or feature set for fingerprint segmentation from a typical candidate feature set. We apply the novel method on the FVC2002 database of fingerprint images, which are acquired by four different respective sensors and technologies. Experimental results show that the accuracy of segmentation is improved, and time consumption for feature extraction is dramatically reduced with selected feature(s).

Usability and acceptability of balance exergames in older adults: A scoping review.

PubMed

Nawaz, Ather; Skjæret, Nina; Helbostad, Jorunn Lægdheim; Vereijken, Beatrix; Boulton, Elisabeth; Svanaes, Dag

2016-12-01

Serious games (exergames) have the potential to be effective for postural balance and increasing muscle strength. Several games have been developed to increase physical fitness and balance among older adults. However, it is unclear to which degree usability and acceptability of exergames for older adults have been evaluated. The aim of this study was to summarize usability evaluation and acceptability of studies in older adults. We conducted a scoping review on studies focusing on usability of exergames for older adults. The result shows that older adults consider usability and acceptability of exercise video games good. The review shows that longitudinal studies mainly use off-the-shelf exergame and evaluated game effectiveness and acceptability, whereas cross-sectional studies focus on interactional experience. Studies varied in their approaches to measure usability and acceptability of exergames for older adults. There is a need for a systematic developmental approach to involve older adults in development of exergames for longitudinal studies. © The Author(s) 2015.

Heuristic Evaluation on Mobile Interfaces: A New Checklist

PubMed Central

Yáñez Gómez, Rosa; Cascado Caballero, Daniel; Sevillano, José-Luis

2014-01-01

The rapid evolution and adoption of mobile devices raise new usability challenges, given their limitations (in screen size, battery life, etc.) as well as the specific requirements of this new interaction. Traditional evaluation techniques need to be adapted in order for these requirements to be met. Heuristic evaluation (HE), an Inspection Method based on evaluation conducted by experts over a real system or prototype, is based on checklists which are desktop-centred and do not adequately detect mobile-specific usability issues. In this paper, we propose a compilation of heuristic evaluation checklists taken from the existing bibliography but readapted to new mobile interfaces. Selecting and rearranging these heuristic guidelines offer a tool which works well not just for evaluation but also as a best-practices checklist. The result is a comprehensive checklist which is experimentally evaluated as a design tool. This experimental evaluation involved two software engineers without any specific knowledge about usability, a group of ten users who compared the usability of a first prototype designed without our heuristics, and a second one after applying the proposed checklist. The results of this experiment show the usefulness of the proposed checklist for avoiding usability gaps even with nontrained developers. PMID:25295300

Applying usability heuristics to radiotherapy systems.

PubMed

Chan, Alvita J; Islam, Mohammad K; Rosewall, Tara; Jaffray, David A; Easty, Anthony C; Cafazzo, Joseph A

2012-01-01

Heuristic evaluations have been used to evaluate safety of medical devices by identifying and assessing usability issues. Since radiotherapy treatment delivery systems often consist of multiple complex user-interfaces, a heuristic evaluation was conducted to assess the potential safety issues of such a system. A heuristic evaluation was conducted to evaluate the treatment delivery system at Princess Margaret Hospital (Toronto, Canada). Two independent evaluators identified usability issues with the user-interfaces and rated the severity of each issue. The evaluators identified 75 usability issues in total. Eighteen of them were rated as high severity, indicating the potential to have a major impact on patient safety. A majority of issues were found on the record and verify system, and many were associated with the patient setup process. While the hospital has processes in place to ensure patient safety, recommendations were developed to further mitigate the risks of potential consequences. Heuristic evaluation is an efficient and inexpensive method that can be successfully applied to radiotherapy delivery systems to identify usability issues and improve patient safety. Although this study was conducted only at one site, the findings may have broad implications for the design of these systems. Copyright © 2011 Elsevier Ireland Ltd. All rights reserved.

Web usability evaluation on BloobIS website by using hallway usability testing method and ISO 9241:11

NASA Astrophysics Data System (ADS)

Dwi Susanto, Tony; Ingesti Prasetyo, Anisa; Astuti, Hanim Maria

2018-03-01

At this moment, the need for web as an information media is highly important. Not only confined in the infotainment area, government, and education, but health as well uses the web media as a medium for providing information effectively. BloobIS is a web based application which integrates blood supply and distribution information at the Blood Transfusion Unit. Knowing how easy information is on BloobIS is marked by how convenient the website is used. Up until now, the BloobIS website is nearing completion but testing has not yet been performed to users and is on the testing and development phase in the Development Life Cycle software. Thus, an evaluation namely the quality control software which focuses on the perspective of BloobIs web usability is required. Hallway Usability Testing and ISO 9241:11 are the methods chosen to measure the BloobIS application usability. The expected outputs of the quality control software focusing on the usability evaluation are being able to rectify the usability deficiencies on the BloobIs web and provide recommendations to develop the web as a basic BloobIS web quality upgraed which sets a goal to amplify the satisfaction of web users based on usability factors in ISO 9241:11.

Evaluation and comparison of a lightweight bamboo composite

NASA Astrophysics Data System (ADS)

Loth, Andreas; Berwing, Michael; Förster, Ralf

2016-10-01

The demand for fast changing production lines and other facilities needs new lightweight and stable systems for partitioning walls. There is also a need for ecological products for this application. The wood like grass bamboo provides a wide potential to substitute conventional wood. A composite lightweight honeycomb like bamboo board was developed and compared with reinforced and unreinforced plywood specimen. The acquired mechanical properties gave a promising result for the usability of bamboo as basis material for wide span boards. It can be manufactured with minimal technical investments, that suits also well for regions with little industry. The ecological assessment of the structure is very positive.

Liquid metal magnetohydrodynamics (LMMHD) technology transfer feasibility study. Volume 1: Summary

NASA Technical Reports Server (NTRS)

Phen, R. L.; Hays, L. G.; Alper, M. E.

1973-01-01

The potential application of liquid metal magnetohydrodynamics (LMMHD) to central station utility power generation through the period to 1990 is examined. Included are: (1) a description of LMMHD and a review of its development status, (2) LMMHD preliminary design for application to central station utility power generation, (3) evaluation of LMMHD in comparison with conventional and other advanced power generation systems and (4) a technology development plan. One of the major conclusions found is that the most economic and technically feasible application of LMMHD is a topping cycle to a steam plant, taking advantage of high temperatures available but not usable by the steam cycle.

Usability Evaluation of the Student Centered e-Learning Environment

ERIC Educational Resources Information Center

Junus, Inas Sofiyah; Santoso, Harry Budi; Isal, R. Yugo K.; Utomo, Andika Yudha

2015-01-01

Student Centered e-Learning Environment (SCeLE) has substantial roles to support learning activities at Faculty of Computer Science, Universitas Indonesia (Fasilkom UI). Although it has been utilized for about 10 years, the usability aspect of SCeLE as an e-Learning system has not been evaluated. Therefore, the usability aspects of SCeLE Fasilkom…

A Usability Study of Users' Perceptions toward a Multimedia Computer-Assisted Learning Tool for Neuroanatomy

ERIC Educational Resources Information Center

Gould, Douglas J.; Terrell, Mark A.; Fleming, Jo

2008-01-01

This usability study evaluated users' perceptions of a multimedia prototype for a new e-learning tool: Anatomy of the Central Nervous System: A Multimedia Course. Usability testing is a collection of formative evaluation methods that inform the developmental design of e-learning tools to maximize user acceptance, satisfaction, and adoption.…

Knowledge discovery from data and Monte-Carlo DEA to evaluate technical efficiency of mental health care in small health areas

PubMed Central

García-Alonso, Carlos; Pérez-Naranjo, Leonor

2009-01-01

Introduction Knowledge management, based on information transfer between experts and analysts, is crucial for the validity and usability of data envelopment analysis (DEA). Aim To design and develop a methodology: i) to assess technical efficiency of small health areas (SHA) in an uncertainty environment, and ii) to transfer information between experts and operational models, in both directions, for improving expert’s knowledge. Method A procedure derived from knowledge discovery from data (KDD) is used to select, interpret and weigh DEA inputs and outputs. Based on KDD results, an expert-driven Monte-Carlo DEA model has been designed to assess the technical efficiency of SHA in Andalusia. Results In terms of probability, SHA 29 is the most efficient being, on the contrary, SHA 22 very inefficient. 73% of analysed SHA have a probability of being efficient (Pe) >0.9 and 18% <0.5. Conclusions Expert knowledge is necessary to design and validate any operational model. KDD techniques make the transfer of information from experts to any operational model easy and results obtained from the latter improve expert’s knowledge.

Evaluating a Web-Based Interface for Internet Telemedicine

NASA Technical Reports Server (NTRS)

Lathan, Corinna E.; Newman, Dava J.; Sebrechts, Marc M.; Doarn, Charles R.

1997-01-01

The objective is to introduce the usability engineering methodology, heuristic evaluation, to the design and development of a web-based telemedicine system. Using a set of usability criteria, or heuristics, one evaluator examined the Spacebridge to Russia web-site for usability problems. Thirty-four usability problems were found in this preliminary study and all were assigned a severity rating. The value of heuristic analysis in the iterative design of a system is shown because the problems can be fixed before deployment of a system and the problems are of a different nature than those found by actual users of the system. It was therefore determined that there is potential value of heuristic evaluation paired with user testing as a strategy for optimal system performance design.

Technology, design and dementia: an exploratory survey of developers.

PubMed

Jiancaro, Tizneem; Jaglal, Susan B; Mihailidis, Alex

2017-08-01

Despite worldwide surges in dementia, we still know relatively little about the design of home technologies that support this population. The purpose of this study was to investigate design considerations from the perspective of developers. Participants, including technical and clinical specialists, were recruited internationally and answered web-based survey questions comprising Likert-type responses with text entry options. Developers were queried on 23 technology acceptance characteristics and 24 design practices. In all, forty developers completed the survey. Concerning "technology acceptance", cost, learnability, self-confidence (during use) and usability were deemed very important. Concerning "design practice", developers overwhelmingly valued user-centred design (UCD). In terms of general assistive technology (AT) models, these were largely unknown by technical specialists compared to clinical specialists. Recommendations based on this study include incorporating "self-confidence" into design protocols; examining the implications of "usability" and UCD in this context; and considering empathy-based design approaches to suit a diverse user population. Moreover, clinical specialists have much to offer development teams, particularly concerning the use of conceptual AT models. Implications of rehabilitation Stipulate precise usability criteria. Consider "learnability" and "self-confidence" as technology adoption criteria. Recognize the important theoretical role that clinical specialists can fulfil concerning the use of design schemas. Acknowledge the diversity amongst users with dementia, potentially adopting techniques, such as designing for "extraordinary users".

Web usability testing with a Hispanic medically underserved population.

PubMed

Moore, Mary; Bias, Randolph G; Prentice, Katherine; Fletcher, Robin; Vaughn, Terry

2009-04-01

Skilled website developers value usability testing to assure user needs are met. When the target audience differs substantially from the developers, it becomes essential to tailor both design and evaluation methods. In this study, researchers carried out a multifaceted usability evaluation of a website (Healthy Texas) designed for Hispanic audiences with lower computer literacy and lower health literacy. METHODS INCLUDED: (1) heuristic evaluation by a usability engineer, (2) remote end-user testing using WebEx software; and (3) face-to-face testing in a community center where use of the website was likely. Researchers found standard usability testing methods needed to be modified to provide interpreters, increased flexibility for time on task, presence of a trusted intermediary such as a librarian, and accommodation for family members who accompanied participants. Participants offered recommendations for website redesign, including simplified language, engaging and relevant graphics, culturally relevant examples, and clear navigation. User-centered design is especially important when website developers are not representative of the target audience. Failure to conduct appropriate usability testing with a representative audience can substantially reduce use and value of the website. This thorough course of usability testing identified improvements that benefit all users but become crucial when trying to reach an underserved audience.

Field Evaluation of Programmable Thermostats

DOE Office of Scientific and Technical Information (OSTI.GOV)

Sachs, O.; Tiefenbeck, V.; Duvier, C.

2012-12-01

Prior research suggests that poor programmable thermostats usability may prevent their effective use to save energy. We hypothesized that home occupants with a high-usability thermostats would be more likely to use them to save energy than people with a basic thermostat. We randomly installed a high-usability thermostat in half the 77 apartments of an affordable housing complex, installing a basic thermostat in the other half. During the heating season, we collected space temperature and furnace on-off data to evaluate occupant interaction with the thermostats, foremost nighttime setbacks. We found that thermostat usability did not influence energy-saving behaviors, finding no significantmore » difference in temperature maintained among apartments with high- and low-usability thermostats.« less

Usability and feasibility of health IT interventions to enhance Self-Care for Lymphedema Symptom Management in breast cancer survivors.

PubMed

Fu, Mei R; Axelrod, Deborah; Guth, Amber A; Wang, Yao; Scagliola, Joan; Hiotis, Karen; Rampertaap, Kavita; El-Shammaa, Nardin

2016-09-01

The-Optimal-Lymph-Flow health IT system (TOLF) is a patient-centered, web-and-mobile-based educational and behavioral health IT system focusing on safe, innovative, and pragmatic self-care strategies for lymphedema symptom management. The purpose of this study was to evaluate usability, feasibility, and acceptability of TOLF among the end-user of breast cancer survivors. Two types of usability testing were completed with 30 breast cancer survivors: heuristic evaluation and end-user testing. Each participant was asked to think aloud while completing a set of specified tasks designed to explicate and freely explore the system features. A heuristic evaluation checklist, the Perceived Ease of Use and Usefulness Questionnaire, and The Post Study System Usability Questionnaire were used to evaluate usability of the system. Open-ended questions were used to gather qualitative data. Quantitative data were analyzed using descriptive statistics and qualitative data were summarized thematically. Breast cancer survivors were very satisfied with the system: 90% (n = 27) rated the system having no usability problems; 10% (n = 3) noted minor cosmetic problems: spelling errors or text font size. The majority of participants 96.6% (n = 29) strongly agreed that the system was easy to use and effective in helping to learn about lymphedema, symptoms and self-care strategies. Themes from the qualitative data included empowerment, high quality information, loving avatar simulation videos, easy accessibility, and user-friendliness. This usability study provided evidence on breast cancer survivor's acceptance and highly positive evaluation of TOLF's usability as well as feasibility of using technologically-driven delivery model to enhance self-care strategies for lymphedema symptom management.

An Iterative, Mixed Usability Approach Applied to the Telekit System from the Danish TeleCare North Trial

PubMed Central

Schaarup, Clara; Hejlesen, Ole Kristian

2016-01-01

Objective. The aim of the present study is to evaluate the usability of the telehealth system, coined Telekit, by using an iterative, mixed usability approach. Materials and Methods. Ten double experts participated in two heuristic evaluations (HE1, HE2), and 11 COPD patients attended two think-aloud tests. The double experts identified usability violations and classified them into Jakob Nielsen's heuristics. These violations were then translated into measurable values on a scale of 0 to 4 indicating degree of severity. In the think-aloud tests, COPD participants were invited to verbalise their thoughts. Results. The double experts identified 86 usability violations in HE1 and 101 usability violations in HE2. The majority of the violations were rated in the 0–2 range. The findings from the think-aloud tests resulted in 12 themes and associated examples regarding the usability of the Telekit system. The use of the iterative, mixed usability approach produced both quantitative and qualitative results. Conclusion. The iterative, mixed usability approach yields a strong result owing to the high number of problems identified in the tests because the double experts and the COPD participants focus on different aspects of Telekit's usability. This trial is registered with Clinicaltrials.gov, NCT01984840, November 14, 2013. PMID:27974888

An Iterative, Mixed Usability Approach Applied to the Telekit System from the Danish TeleCare North Trial.

PubMed

Lilholt, Pernille Heyckendorff; Schaarup, Clara; Hejlesen, Ole Kristian

2016-01-01

Objective . The aim of the present study is to evaluate the usability of the telehealth system, coined Telekit, by using an iterative, mixed usability approach. Materials and Methods . Ten double experts participated in two heuristic evaluations (HE1, HE2), and 11 COPD patients attended two think-aloud tests. The double experts identified usability violations and classified them into Jakob Nielsen's heuristics. These violations were then translated into measurable values on a scale of 0 to 4 indicating degree of severity. In the think-aloud tests, COPD participants were invited to verbalise their thoughts. Results . The double experts identified 86 usability violations in HE1 and 101 usability violations in HE2. The majority of the violations were rated in the 0-2 range. The findings from the think-aloud tests resulted in 12 themes and associated examples regarding the usability of the Telekit system. The use of the iterative, mixed usability approach produced both quantitative and qualitative results. Conclusion . The iterative, mixed usability approach yields a strong result owing to the high number of problems identified in the tests because the double experts and the COPD participants focus on different aspects of Telekit's usability. This trial is registered with Clinicaltrials.gov, NCT01984840, November 14, 2013.

To twist or poke? A method for identifying usability issues with the rotary controller and touch screen for control of in-vehicle information systems.

PubMed

Harvey, Catherine; Stanton, Neville A; Pickering, Carl A; McDonald, Mike; Zheng, Pengjun

2011-07-01

In-vehicle information systems (IVIS) can be controlled by the user via direct or indirect input devices. In order to develop the next generation of usable IVIS, designers need to be able to evaluate and understand the usability issues associated with these two input types. The aim of this study was to investigate the effectiveness of a set of empirical usability evaluation methods for identifying important usability issues and distinguishing between the IVIS input devices. A number of usability issues were identified and their causal factors have been explored. These were related to the input type, the structure of the menu/tasks and hardware issues. In particular, the translation between inputs and on-screen actions and a lack of visual feedback for menu navigation resulted in lower levels of usability for the indirect device. This information will be useful in informing the design of new IVIS, with improved usability. STATEMENT OF RELEVANCE: This paper examines the use of empirical methods for distinguishing between direct and indirect IVIS input devices and identifying usability issues. Results have shown that the characteristics of indirect input devices produce more serious usability issues, compared with direct devices and can have a negative effect on the driver-vehicle interaction.

A health literacy and usability heuristic evaluation of a mobile consumer health application.

PubMed

Monkman, Helen; Kushniruk, Andre

2013-01-01

Usability and health literacy are two critical factors in the design and evaluation of consumer health information systems. However, methods for evaluating these two factors in conjunction remain limited. This study adapted a set of existing guidelines for the design of consumer health Web sites into evidence-based evaluation heuristics tailored specifically for mobile consumer health applications. In order to test the approach, a mobile consumer health application (app) was then evaluated using these heuristics. In addition to revealing ways to improve the usability of the system, this analysis identified opportunities to augment the content to make it more understandable by users with limited health literacy. This study successfully demonstrated the utility of converting existing design guidelines into heuristics for the evaluation of usability and health literacy. The heuristics generated could be applied for assessing and revising other existing consumer health information systems.

Developing a Self-Report-Based Sequential Analysis Method for Educational Technology Systems: A Process-Based Usability Evaluation

ERIC Educational Resources Information Center

Lin, Yi-Chun; Hsieh, Ya-Hui; Hou, Huei-Tse

2015-01-01

The development of a usability evaluation method for educational systems or applications, called the self-report-based sequential analysis, is described herein. The method aims to extend the current practice by proposing self-report-based sequential analysis as a new usability method, which integrates the advantages of self-report in survey…

Evaluation of a BCMA’s Electronic Medication Administration Record

PubMed Central

Staggers, Nancy; Iribarren, Sarah; Guo, Jia-Wen; Weir, Charlene

2015-01-01

Barcode medication administration (BCMA) systems can reduce medication errors, but sociotechnical issues are quite common. Although crucial to nurses’ work, few usability evaluations are available for electronic medication administration record screens (eMARs). The purpose of this research was to identify current usability problems in the VA’s eMAR/BCMA system and explore how these might impact nurses’ situation awareness. Three expert evaluators used 10 tasks/elements, heuristic evaluation techniques and explored potential impacts using a situation awareness perspective. The results yielded 99 usability problems categorized into 440 heuristic violations with the largest volume in the category of Match with the Real World. Fifteen usability issues were rated as catastrophic with the Administer/Chart medications task having the most. Situational awareness was impacted at all levels, especially at Level 2, Comprehension. Usability problems point to important areas for improvement because these issues have the potential to impact nurses’ situation awareness, “at a glance” information, nurse productivity and patient safety. PMID:25601936

An appraisal of published usability evaluations of electronic health records via systematic review.

PubMed

Ellsworth, Marc A; Dziadzko, Mikhail; O'Horo, John C; Farrell, Ann M; Zhang, Jiajie; Herasevich, Vitaly

2017-01-01

In this systematic review, we aimed to evaluate methodological and reporting trends present in the current literature by investigating published usability studies of electronic health records (EHRs). A literature search was conducted for articles published through January 2015 using MEDLINE (Ovid), EMBASE, Scopus, and Web of Science, supplemented by citation and reference list reviews. Studies were included if they tested the usability of hospital and clinic EHR systems in the inpatient, outpatient, emergency department, or operating room setting. A total of 4848 references were identified for title and abstract screening. Full text screening was performed for 197 articles, with 120 meeting the criteria for study inclusion. A review of the literature demonstrates a paucity of quality published studies describing scientifically valid and reproducible usability evaluations at various stages of EHR system development. A lack of formal and standardized reporting of EHR usability evaluation results is a major contributor to this knowledge gap, and efforts to improve this deficiency will be one step of moving the field of usability engineering forward. © The Author 2016. Published by Oxford University Press on behalf of the American Medical Informatics Association. All rights reserved. For Permissions, please email: journals.permissions@oup.com.

A low cost technique to evaluate usable product for small manufacturing companies: a case study on Garcia robot.

PubMed

An, Vatana; Soares, Marcelo

2012-01-01

A usability evaluation technique to evaluate user interfaces is introduces. The technique is effective and affordable for small manufacturing companies. By using this technique, an integration of users' feedbacks and some usability concepts, a product can be 3 times easier to use among potential users and more than 5 times easier to use among motivated users. In addition, the technique can be implemented with the company's employees as participants.

[Distance education: use of the WebCT as a support tool for teaching intravenous therapy in nursing undergraduate programs].

PubMed

Dias, Denise Costa; Cassiani, Silvia Helena De Bortoli

2003-01-01

This investigation focused on a learning environment via internet, through which Intravenous Therapy (IVT) was taught. Due to its complexity, Intravenous Therapy was chosen against numerous subjects to be taught through an e-learning environment, by comprising both technical procedures and conceptual aspects that can be discussed through a virtual learning environment. The objectives of this study were to develop educational material about Intravenous Therapy to guide students through the learning related to intravenous therapy, to have the related educational material evaluated by experts, and to evaluate the students' use of this material, considering difficulties and/or advantages, participation/interaction in this environment, and usability of its tools. The interface used for the internet-based training program was WebCT.

Richland five-year O2 R and D Program. Integrated site operation

DOE Office of Scientific and Technical Information (OSTI.GOV)

Not Available

1966-07-11

The technical feasibility of using an electrolytic reduction process to reduce metal scrap and oxide to usable uranium metal is being studied. The incentives for using electrolytic reduction at Richland may be summarized as follows: (1) reduce the unit and total costs of producing plutonium; (2) increase the flexibility of the Richland reactors for producing isotopes, particularly U-236; and (3) simplify the present fuel cycle complex. The scope of the mission is limited to the evaluation of hollow extruded I and E cores, the evaluation of electro-reduced uranium, an investigation of the solution rate of UO{sub 2} in the electrolyte,more » and small-scale irradiations of UO{sub 2} fuels in the N and K Reactors. Progress during FY 1966 is summarized.« less

Exploring the Usability of Mobile Apps Supporting Radiologists' Training in Diagnostic Decision Making.

PubMed

Kim, Min Soon; Aro, Michael R; Lage, Kraig J; Ingalls, Kevin L; Sindhwani, Vivek; Markey, Mia K

2016-03-01

The objective of this study was to conduct a usability evaluation of mobile apps for supporting education and training in radiologic diagnostic decision-making processes. Of 381 mobile apps available at two major stores (Google Play and iTunes), eight iOS apps were selected for laboratory-based usability tests. Six staff radiologists completed eight app-specific task sets, using a think-aloud strategy. The triangular methods approach included quantitative performance measures, System Usability Scale (SUS), and qualitative thematic analysis using heuristic usability principles of usability issues. Overall, radiologists achieved higher than 70% success, with favorable SUS scores, in completing the tasks for seven of the eight apps. However, task success rate and SUS score had a weak relation (r = 0.23), indicating that the perceived usability may not reflect the holistic usability of the app. Task analysis and self-report revealed 108 usability issues, which were condensed to 55 unique issues and categorized by nine usability themes and mapped to ten usability heuristics. Nonintuitive functionality (eg, nonintuitive or misleading labels) was the most frequent theme observed, leading to inefficient navigation. These usability findings were consistent with the 13 improvements the radiologists suggested. This study demonstrates the feasibility of usability evaluation of radiology mobile apps and suggests potential improvements in the development of radiology mobile apps. This study also suggests that proficiency with mobile devices may not be equivalent to being an expert user, proficient in using the apps. Copyright © 2016 American College of Radiology. Published by Elsevier Inc. All rights reserved.

Ten factors to consider when developing usability scenarios and tasks for health information technology.

PubMed

Russ, Alissa L; Saleem, Jason J

2018-02-01

The quality of usability testing is highly dependent upon the associated usability scenarios. To promote usability testing as part of electronic health record (EHR) certification, the Office of the National Coordinator (ONC) for Health Information Technology requires that vendors test specific capabilities of EHRs with clinical end-users and report their usability testing process - including the test scenarios used - along with the results. The ONC outlines basic expectations for usability testing, but there is little guidance in usability texts or scientific literature on how to develop usability scenarios for healthcare applications. The objective of this article is to outline key factors to consider when developing usability scenarios and tasks to evaluate computer-interface based health information technologies. To achieve this goal, we draw upon a decade of our experience conducting usability tests with a variety of healthcare applications and a wide range of end-users, to include healthcare professionals as well as patients. We discuss 10 key factors that influence scenario development: objectives of usability testing; roles of end-user(s); target performance goals; evaluation time constraints; clinical focus; fidelity; scenario-related bias and confounders; embedded probes; minimize risks to end-users; and healthcare related outcome measures. For each factor, we present an illustrative example. This article is intended to aid usability researchers and practitioners in their efforts to advance health information technologies. The article provides broad guidance on usability scenario development and can be applied to a wide range of clinical information systems and applications. Published by Elsevier Inc.

Getting a Technology-based Diabetes Intervention Ready for Primetime: A Review of Usability Testing Studies

PubMed Central

Lyles, Courtney R.; Sarkar, Urmimala; Osborn, Chandra Y.

2014-01-01

Consumer health technologies can educate patients about diabetes and support their self-management, yet usability evidence is rarely published even though it determines patient engagement, optimal benefit of any intervention, and an understanding of generalizability. Therefore, we conducted a narrative review of peer-reviewed articles published from 2009–2013 that tested the usability of a web- or mobile-delivered system/application designed to educate and support patients with diabetes. Overall, the 23 papers included in our review used mixed (n=11), descriptive quantitative (n=9), and qualitative methods (n=3) to assess usability, such as documenting which features performed as intended and how patients rated their experiences. More sophisticated usability evaluations combined several complementary approaches to elucidate more aspects of functionality. Future work pertaining to the design and evaluation of technology-delivered diabetes education/support interventions should aim to standardize the usability testing processes, and publish usability findings to inform interpretation of why an intervention succeeded or failed, and for whom. PMID:25173689

Usability evaluation model for mobile e-book applications

NASA Astrophysics Data System (ADS)

Matraf, Munya Saleh Ba; Hussain, Azham

2017-10-01

Evaluation for mobile e-book applications are limited and did not address all the important usability measurements. Hence, this study aimed to identify the characteristics that affect user satisfaction on the usability of mobile e-book applications. Five characteristics that have a significant effect on the user satisfaction of mobile e-book applications have been identified namely readability, effectiveness, accessibility, efficiency, and navigation. A usability evaluation was conducted on three mobile e-book applications namely Adobe Acrobat Reader, Ebook Reader, and Amazon Kindle. 30 students from Universiti Utara Malaysia evaluated the mobile e-book applications and their satisfaction was measured using questionnaire. The outcomes discovered that the five characteristics have a significant positive relationship with user satisfaction. This provides insights into the main characteristics that increase user satisfaction.

A Modified User-Oriented Heuristic Evaluation of a Mobile Health System for Diabetes Self-management Support

PubMed Central

Georgsson, Mattias; Staggers, Nancy; Weir, Charlene

2016-01-01

Mobile health platforms offer significant opportunities for improving diabetic self-care, but only if adequate usability exists. Expert evaluations such as heuristic evaluation can provide distinct usability information about systems. The purpose of this study was to complete a usability evaluation of a mobile health system for diabetes patients using a modified heuristic evaluation technique of (1) dual-domain experts (healthcare professionals, usability experts), (2) validated scenarios and user tasks related to patients’ self-care, and (3) in-depth severity factor ratings. Experts identified 129 usability problems with 274 heuristic violations for the system. The categories Consistency and Standards dominated at 24.1% (n = 66), followed by Match Between System and Real World at 22.3% (n = 61). Average severity ratings across system views were 2.8 (of 4), with 9.3% (n = 12) rated as catastrophic and 53.5% (n = 69) as major. The large volume of violations with severe ratings indicated clear priorities for redesign. The modified heuristic approach allowed evaluators to identify unique and important issues, including ones related to self-management and patient safety. This article provides a template for one type of expert evaluation adding to the informaticists’ toolbox when needing to conduct a fast, resource-efficient and user-oriented heuristic evaluation. PMID:26657618

A Modified User-Oriented Heuristic Evaluation of a Mobile Health System for Diabetes Self-management Support.

PubMed

Georgsson, Mattias; Staggers, Nancy; Weir, Charlene

2016-02-01

Mobile health platforms offer significant opportunities for improving diabetic self-care, but only if adequate usability exists. Expert evaluations such as heuristic evaluation can provide distinct usability information about systems. The purpose of this study was to complete a usability evaluation of a mobile health system for diabetes patients using a modified heuristic evaluation technique of (1) dual-domain experts (healthcare professionals, usability experts), (2) validated scenarios and user tasks related to patients' self-care, and (3) in-depth severity factor ratings. Experts identified 129 usability problems with 274 heuristic violations for the system. The categories Consistency and Standards dominated at 24.1% (n = 66), followed by Match Between System and Real World at 22.3% (n = 61). Average severity ratings across system views were 2.8 (of 4), with 9.3% (n = 12) rated as catastrophic and 53.5% (n = 69) as major. The large volume of violations with severe ratings indicated clear priorities for redesign. The modified heuristic approach allowed evaluators to identify unique and important issues, including ones related to self-management and patient safety. This article provides a template for one type of expert evaluation adding to the informaticists' toolbox when needing to conduct a fast, resource-efficient and user-oriented heuristic evaluation.

The E-health Literacy Demands of Australia's My Health Record: A Heuristic Evaluation of Usability.

PubMed

Walsh, Louisa; Hemsley, Bronwyn; Allan, Meredith; Adams, Natalie; Balandin, Susan; Georgiou, Andrew; Higgins, Isabel; McCarthy, Shaun; Hill, Sophie

2017-01-01

My Health Record is Australia's electronic personal health record system, which was introduced in July 2012. As of August 2017, approximately 21 percent of Australia's total population was registered to use My Health Record. Internationally, usability issues have been shown to negatively influence the uptake and use of electronic health record systems, and this scenario may particularly affect people who have low e-health literacy. It is likely that usability issues are negatively affecting the uptake and use of My Health Record in Australia. To identify potential e-health literacy-related usability issues within My Health Record through a heuristic evaluation method. Between September 14 and October 12, 2016, three of the authors conducted a heuristic evaluation of the two consumer-facing components of My Health Record-the information website and the electronic health record itself. These two components were evaluated against two sets of heuristics-the Health Literacy Online checklist and the Monkman Heuristics. The Health Literacy Online checklist and Monkman Heuristics are evidence-based checklists of web design elements with a focus on design for audiences with low health literacy. During this heuristic evaluation, the investigators individually navigated through the consumer-facing components of My Health Record, recording instances where the My Health Record did not conform to the checklist criteria. After the individual evaluations were completed, the investigators conferred and aggregated their results. From this process, a list of usability violations was constructed. When evaluated against the Health Literacy Online Checklist, the information website demonstrated violations in 12 of 35 criteria, and the electronic health record demonstrated violations in 16 of 35 criteria. When evaluated against the Monkman Heuristics, the information website demonstrated violations in 7 of 11 criteria, and the electronic health record demonstrated violations in 9 of 11 criteria. The identified violations included usability issues with the reading levels used within My Health Record, the graphic design elements, the layout of web pages, and a lack of images and audiovisual tools to support learning. Other important usability issues included a lack of translated resources, difficulty using accessibility tools, and complexity of the registration processes. My Health Record is an important piece of technology that has the potential to facilitate better communication between consumers and their health providers. However, this heuristic evaluation demonstrated that many usability-related elements of My Health Record cater poorly to users at risk of having low e-health literacy. Usability issues have been identified as an important barrier to use of personal health records internationally, and the findings of this heuristic evaluation demonstrate that usability issues may be substantial barriers to the uptake and use of My Health Record.

The E-health Literacy Demands of Australia's My Health Record: A Heuristic Evaluation of Usability

PubMed Central

Walsh, Louisa; Hemsley, Bronwyn; Allan, Meredith; Adams, Natalie; Balandin, Susan; Georgiou, Andrew; Higgins, Isabel; McCarthy, Shaun; Hill, Sophie

2017-01-01

Background My Health Record is Australia's electronic personal health record system, which was introduced in July 2012. As of August 2017, approximately 21 percent of Australia's total population was registered to use My Health Record. Internationally, usability issues have been shown to negatively influence the uptake and use of electronic health record systems, and this scenario may particularly affect people who have low e-health literacy. It is likely that usability issues are negatively affecting the uptake and use of My Health Record in Australia. Objective To identify potential e-health literacy–related usability issues within My Health Record through a heuristic evaluation method. Methods Between September 14 and October 12, 2016, three of the authors conducted a heuristic evaluation of the two consumer-facing components of My Health Record—the information website and the electronic health record itself. These two components were evaluated against two sets of heuristics—the Health Literacy Online checklist and the Monkman Heuristics. The Health Literacy Online checklist and Monkman Heuristics are evidence-based checklists of web design elements with a focus on design for audiences with low health literacy. During this heuristic evaluation, the investigators individually navigated through the consumer-facing components of My Health Record, recording instances where the My Health Record did not conform to the checklist criteria. After the individual evaluations were completed, the investigators conferred and aggregated their results. From this process, a list of usability violations was constructed. Results When evaluated against the Health Literacy Online Checklist, the information website demonstrated violations in 12 of 35 criteria, and the electronic health record demonstrated violations in 16 of 35 criteria. When evaluated against the Monkman Heuristics, the information website demonstrated violations in 7 of 11 criteria, and the electronic health record demonstrated violations in 9 of 11 criteria. The identified violations included usability issues with the reading levels used within My Health Record, the graphic design elements, the layout of web pages, and a lack of images and audiovisual tools to support learning. Other important usability issues included a lack of translated resources, difficulty using accessibility tools, and complexity of the registration processes. Conclusion My Health Record is an important piece of technology that has the potential to facilitate better communication between consumers and their health providers. However, this heuristic evaluation demonstrated that many usability-related elements of My Health Record cater poorly to users at risk of having low e-health literacy. Usability issues have been identified as an important barrier to use of personal health records internationally, and the findings of this heuristic evaluation demonstrate that usability issues may be substantial barriers to the uptake and use of My Health Record. PMID:29118683

45 CFR 155.230 - General standards for Exchange notices.

Code of Federal Regulations, 2014 CFR

2014-10-01

...). (c) Re-evaluation of appropriateness and usability. The Exchange must re-evaluate the appropriateness and usability of applications, forms, and notices. (d) Electronic notices. (1) The individual market...

45 CFR 155.230 - General standards for Exchange notices.

Code of Federal Regulations, 2013 CFR

2013-10-01

...). (c) Re-evaluation of appropriateness and usability. The Exchange must re-evaluate the appropriateness and usability of applications, forms, and notices. (d) Electronic notices. (1) The individual market...

Usability Evaluation at the Point-of-Care: A Method to Identify User Information Needs in CPOE Applications

PubMed Central

Washburn, Jeff; Fiol, Guilherme Del; Rocha, Roberto A.

2006-01-01

Point of care usability evaluation may help identify information needs that occur during the process of providing care. We describe the process of using usability-specific recording software to record Computerized Physician Order Entry (CPOE) ordering sessions on admitted adult and pediatric patients at two urban tertiary hospitals in the Intermountain Healthcare system of hospitals. PMID:17238756

Teaching clinical reasoning and decision-making skills to nursing students: Design, development, and usability evaluation of a serious game.

PubMed

Johnsen, Hege Mari; Fossum, Mariann; Vivekananda-Schmidt, Pirashanthie; Fruhling, Ann; Slettebø, Åshild

2016-10-01

Serious games (SGs) are a type of simulation technology that may provide nursing students with the opportunity to practice their clinical reasoning and decision-making skills in a safe and authentic environment. Despite the growing number of SGs developed for healthcare professionals, few SGs are video based or address the domain of home health care. This paper aims to describe the design, development, and usability evaluation of a video based SG for teaching clinical reasoning and decision-making skills to nursing students who care for patients with chronic obstructive pulmonary disease (COPD) in home healthcare settings. A prototype SG was developed. A unified framework of usability called TURF (Task, User, Representation, and Function) and SG theory were employed to ensure a user-centered design. The educational content was based on the clinical decision-making model, Bloom's taxonomy, and a Bachelor of Nursing curriculum. A purposeful sample of six participants evaluated the SG prototype in a usability laboratory. Cognitive walkthrough evaluations, a questionnaire, and individual interviews were used for the usability evaluation. The data were analyzed using qualitative deductive content analysis based on the TURF framework elements and related usability heuristics. The SG was perceived as being realistic, clinically relevant, and at an adequate level of complexity for the intended users. Usability issues regarding functionality and the user-computer interface design were identified. However, the SG was perceived as being easy to learn, and participants suggested that the SG could serve as a supplement to traditional training in laboratory and clinical settings. Using video based scenarios with an authentic COPD patient and a home healthcare registered nurse as actors contributed to increased realism. Using different theoretical approaches in the SG design was considered an advantage of the design process. The SG was perceived as being useful, usable, and satisfying. The achievement of the desired functionality and the minimization of user-computer interface issues emphasize the importance of conducting a usability evaluation during the SG development process. Copyright © 2016 Elsevier Ireland Ltd. All rights reserved.

Usability Testing of a Multimedia e-Learning Resource for Electrolyte and Acid-Base Disorders

ERIC Educational Resources Information Center

Davids, Mogamat Razeen; Chikte, Usuf; Grimmer-Somers, Karen; Halperin, Mitchell L.

2014-01-01

The usability of computer interfaces may have a major influence on learning. Design approaches that optimize usability are commonplace in the software development industry but are seldom used in the development of e-learning resources, especially in medical education. We conducted a usability evaluation of a multimedia resource for teaching…

47 CFR 6.7 - Product design, development, and evaluation.

Code of Federal Regulations, 2014 CFR

2014-10-01

...) Manufacturers and service providers shall evaluate the accessibility, usability, and compatibility of equipment... identify barriers to accessibility and usability as part of such a product design and development process...

47 CFR 6.7 - Product design, development, and evaluation.

Code of Federal Regulations, 2013 CFR

2013-10-01

...) Manufacturers and service providers shall evaluate the accessibility, usability, and compatibility of equipment... identify barriers to accessibility and usability as part of such a product design and development process...

Building Science-Relevant Literacy with Technical Writing in High School

DOE Office of Scientific and Technical Information (OSTI.GOV)

Girill, T R

2006-06-02

By drawing on the in-class work of an on-going literacy outreach project, this paper explains how well-chosen technical writing activities can earn time in high-school science courses by enabling underperforming students (including ESL students) to learn science more effectively. We adapted basic research-based text-design and usability techniques into age-appropriate exercises and cases using the cognitive apprenticeship approach. This enabled high-school students, aided by explicit guidelines, to build their cognitive maturity, learn how to craft good instructions and descriptions, and apply those skills to better note taking and technical talks in their science classes.

Quality in End User Documentation.

ERIC Educational Resources Information Center

Morrison, Ronald

1994-01-01

Discusses quality in end-user documentation for computer applications and explains four approaches to improving quality in end-user documents. Highlights include online help, usability testing, technical writing elements, statistical approaches, and concepts relating to software quality that are also applicable to user manuals. (LRW)

Usability of a patient education and motivation tool using heuristic evaluation.

PubMed

Joshi, Ashish; Arora, Mohit; Dai, Liwei; Price, Kathleen; Vizer, Lisa; Sears, Andrew

2009-11-06

Computer-mediated educational applications can provide a self-paced, interactive environment to deliver educational content to individuals about their health condition. These programs have been used to deliver health-related information about a variety of topics, including breast cancer screening, asthma management, and injury prevention. We have designed the Patient Education and Motivation Tool (PEMT), an interactive computer-based educational program based on behavioral, cognitive, and humanistic learning theories. The tool is designed to educate users and has three key components: screening, learning, and evaluation. The objective of this tutorial is to illustrate a heuristic evaluation using a computer-based patient education program (PEMT) as a case study. The aims were to improve the usability of PEMT through heuristic evaluation of the interface; to report the results of these usability evaluations; to make changes based on the findings of the usability experts; and to describe the benefits and limitations of applying usability evaluations to PEMT. PEMT was evaluated by three usability experts using Nielsen's usability heuristics while reviewing the interface to produce a list of heuristic violations with severity ratings. The violations were sorted by heuristic and ordered from most to least severe within each heuristic. A total of 127 violations were identified with a median severity of 3 (range 0 to 4 with 0 = no problem to 4 = catastrophic problem). Results showed 13 violations for visibility (median severity = 2), 38 violations for match between system and real world (median severity = 2), 6 violations for user control and freedom (median severity = 3), 34 violations for consistency and standards (median severity = 2), 11 violations for error severity (median severity = 3), 1 violation for recognition and control (median severity = 3), 7 violations for flexibility and efficiency (median severity = 2), 9 violations for aesthetic and minimalist design (median severity = 2), 4 violations for help users recognize, diagnose, and recover from errors (median severity = 3), and 4 violations for help and documentation (median severity = 4). We describe the heuristic evaluation method employed to assess the usability of PEMT, a method which uncovers heuristic violations in the interface design in a quick and efficient manner. Bringing together usability experts and health professionals to evaluate a computer-mediated patient education program can help to identify problems in a timely manner. This makes this method particularly well suited to the iterative design process when developing other computer-mediated health education programs. Heuristic evaluations provided a means to assess the user interface of PEMT.

Usability of a Patient Education and Motivation Tool Using Heuristic Evaluation

PubMed Central

Arora, Mohit; Dai, Liwei; Price, Kathleen; Vizer, Lisa; Sears, Andrew

2009-01-01

Background Computer-mediated educational applications can provide a self-paced, interactive environment to deliver educational content to individuals about their health condition. These programs have been used to deliver health-related information about a variety of topics, including breast cancer screening, asthma management, and injury prevention. We have designed the Patient Education and Motivation Tool (PEMT), an interactive computer-based educational program based on behavioral, cognitive, and humanistic learning theories. The tool is designed to educate users and has three key components: screening, learning, and evaluation. Objective The objective of this tutorial is to illustrate a heuristic evaluation using a computer-based patient education program (PEMT) as a case study. The aims were to improve the usability of PEMT through heuristic evaluation of the interface; to report the results of these usability evaluations; to make changes based on the findings of the usability experts; and to describe the benefits and limitations of applying usability evaluations to PEMT. Methods PEMT was evaluated by three usability experts using Nielsen’s usability heuristics while reviewing the interface to produce a list of heuristic violations with severity ratings. The violations were sorted by heuristic and ordered from most to least severe within each heuristic. Results A total of 127 violations were identified with a median severity of 3 (range 0 to 4 with 0 = no problem to 4 = catastrophic problem). Results showed 13 violations for visibility (median severity = 2), 38 violations for match between system and real world (median severity = 2), 6 violations for user control and freedom (median severity = 3), 34 violations for consistency and standards (median severity = 2), 11 violations for error severity (median severity = 3), 1 violation for recognition and control (median severity = 3), 7 violations for flexibility and efficiency (median severity = 2), 9 violations for aesthetic and minimalist design (median severity = 2), 4 violations for help users recognize, diagnose, and recover from errors (median severity = 3), and 4 violations for help and documentation (median severity = 4). Conclusion We describe the heuristic evaluation method employed to assess the usability of PEMT, a method which uncovers heuristic violations in the interface design in a quick and efficient manner. Bringing together usability experts and health professionals to evaluate a computer-mediated patient education program can help to identify problems in a timely manner. This makes this method particularly well suited to the iterative design process when developing other computer-mediated health education programs. Heuristic evaluations provided a means to assess the user interface of PEMT. PMID:19897458

Qualitative review of usability problems in health information systems for radiology.

PubMed

Dias, Camila Rodrigues; Pereira, Marluce Rodrigues; Freire, André Pimenta

2017-12-01

Radiology processes are commonly supported by Radiology Information System (RIS), Picture Archiving and Communication System (PACS) and other software for radiology. However, these information technologies can present usability problems that affect the performance of radiologists and physicians, especially considering the complexity of the tasks involved. The purpose of this study was to extract, classify and analyze qualitatively the usability problems in PACS, RIS and other software for radiology. A systematic review was performed to extract usability problems reported in empirical usability studies in the literature. The usability problems were categorized as violations of Nielsen and Molich's usability heuristics. The qualitative analysis indicated the causes and the effects of the identified usability problems. From the 431 papers initially identified, 10 met the study criteria. The analysis of the papers identified 90 instances of usability problems, classified into categories corresponding to established usability heuristics. The five heuristics with the highest number of instances of usability problems were "Flexibility and efficiency of use", "Consistency and standards", "Match between system and the real world", "Recognition rather than recall" and "Help and documentation", respectively. These problems can make the interaction time consuming, causing delays in tasks, dissatisfaction, frustration, preventing users from enjoying all the benefits and functionalities of the system, as well as leading to more errors and difficulties in carrying out clinical analyses. Furthermore, the present paper showed a lack of studies performed on systems for radiology, especially usability evaluations using formal methods of evaluation involving the final users. Copyright © 2017 Elsevier Inc. All rights reserved.

A literature review about usability evaluation methods for e-learning platforms.

PubMed

Freire, Luciana Lopes; Arezes, Pedro Miguel; Campos, José Creissac

2012-01-01

The usability analysis of information systems has been the target of several research studies over the past thirty years. These studies have highlighted a great diversity of points of view, including researchers from different scientific areas such as Ergonomics, Computer Science, Design and Education. Within the domain of information ergonomics, the study of tools and methods used for usability evaluation dedicated to E-learning presents evidence that there is a continuous and dynamic evolution of E-learning systems, in many different contexts -academics and corporative. These systems, also known as LMS (Learning Management Systems), can be classified according to their educational goals and their technological features. However, in these systems the usability issues are related with the relationship/interactions between user and system in the user's context. This review is a synthesis of research project about Information Ergonomics and embraces three dimensions, namely the methods, models and frameworks that have been applied to evaluate LMS. The study also includes the main usability criteria and heuristics used. The obtained results show a notorious change in the paradigms of usability, with which it will be possible to discuss about the studies carried out by different researchers that were focused on usability ergonomic principles aimed at E-learning.

Usability of online psychoeducation for siblings of people with psychosis.

PubMed

Sin, Jacqueline; Henderson, Claire; Norman, Ian

2014-10-01

The E Sibling Project aims to address the needs of siblings of individuals affected by psychosis through provision of a comprehensive online intervention. The online intervention comprises four core elements, including: information on psychosis; various coping and promoting well-being strategies; siblings' blogs and discussion forum with peers; and an "Ask the Experts" function. After the intervention-prototype was developed, we tested its feasibility, usability and acceptability by siblings. We evaluated the usability of the intervention-prototype using a non-randomised usability study with siblings of individuals diagnosed with psychosis. The usability study adapted Poulson et al's framework to collect subjective feedback from participants on ease of use, perceived usefulness and acceptability, together with objective usage data on the intervention. Twenty siblings were recruited to the usability test; 19 tried out the resource-prototype over a 4-week period and 17 completed the online evaluation after using the intervention. In total, 906 page-views were made by the participants and each spent about two hours using the resource. Participants evaluated the intervention as helpful, relevant and useful in terms of content, design and usability. Developments are needed to improve the navigation and intuitiveness of the resource. Using an internet-based information-giving and peer support intervention to promote wellbeing and coping is feasible and acceptable to siblings of people with psychosis.

The STEP database through the end-users eyes--USABILITY STUDY.

PubMed

Salunke, Smita; Tuleu, Catherine

2015-08-15

The user-designed database of Safety and Toxicity of Excipients for Paediatrics ("STEP") is created to address the shared need of drug development community to access the relevant information of excipients effortlessly. Usability testing was performed to validate if the database satisfies the need of the end-users. Evaluation framework was developed to assess the usability. The participants performed scenario based tasks and provided feedback and post-session usability ratings. Failure Mode Effect Analysis (FMEA) was performed to prioritize the problems and improvements to the STEP database design and functionalities. The study revealed several design vulnerabilities. Tasks such as limiting the results, running complex queries, location of data and registering to access the database were challenging. The three critical attributes identified to have impact on the usability of the STEP database included (1) content and presentation (2) the navigation and search features (3) potential end-users. Evaluation framework proved to be an effective method for evaluating database effectiveness and user satisfaction. This study provides strong initial support for the usability of the STEP database. Recommendations would be incorporated into the refinement of the database to improve its usability and increase user participation towards the advancement of the database. Copyright © 2015 Elsevier B.V. All rights reserved.

Operating manual-based usability evaluation of medical devices: an effective patient safety screening method.

PubMed

Turley, James P; Johnson, Todd R; Smith, Danielle Paige; Zhang, Jaijie; Brixey, Juliana J

2006-04-01

Use of medical devices often directly contributes to medical errors. Because it is difficult or impossible to change the design of existing devices, the best opportunity for improving medical device safety is during the purchasing process. However, most hospital personnel are not familiar with the usability evaluation methods designed to identify aspects of a user interface that do not support intuitive and safe use. A review of medical device operating manuals is proposed as a more practical method of usability evaluation. Operating manuals for five volumetric infusion pumps from three manufacturers were selected for this study (January-April 2003). Each manual's safety message content was evaluated to determine whether the message indicated a device design characteristic that violated known usability principles (heuristics) or indicated a violation of an affordance of the device. "Minimize memory load," with 65 violations, was the heuristic violated most frequently across pumps. Variations between pumps, including the frequency and severity of violations for each, were noted. Results suggest that manual review can provide a proxy for heuristic evaluation of the actual medical device. This method, intended to be a component of prepurchasing evaluation, can complement more formal usability evaluation methods and be used to select a subset of devices for more extensive and formal testing.

A Collaborative Evaluation Framework for Biometric Connected Devices in Healthcare.

PubMed

Farnia, Troskah; Jaulent, Marie Christine; Marchand, Guillaume; Yasini, Mobin

2017-01-01

A large number of biometric connected devices are currently available with a variety of designs. Healthcare users cannot easily choose the reliable ones that correspond the best to their healthcare problems. The existing evaluation methods do not consider at the same time aspects of connectivity and healthcare usage. In this study, a collaborative evaluation framework for biometric connected devices in healthcare usage is proposed. This framework contains six dimensions: medical validity, technical reliability, usability, ergonomy, legal compliance, and accuracy of measurements. In a first step, these dimensions were assessed by designing a self administered questionnaire answered by the stakeholders (patients, health professionals, payers, and manufacturers). A case study was then carried out in a second step to test this framework in a project of telemonitoring for heart failure patients. The results are in favor of the efficiency of the proposed framework as a decision making tool in healthcare usage.

Impact relevance and usability of high resolution climate modeling and data

DOE Office of Scientific and Technical Information (OSTI.GOV)

Arnott, James C.

2016-10-30

The Aspen Global Change Institute hosted a technical science workshop entitled, “Impact Relevance and Usability of High-Resolution Climate Modeling and Datasets,” on August 2-7, 2015 in Aspen, CO. Kate Calvin (Pacific Northwest National Laboratory), Andrew Jones (Lawrence Berkeley National Laboratory) and Jean-François Lamarque (NCAR) served as co-chairs for the workshop. The meeting included the participation of 29 scientists for a total of 145 participant days. Following the workshop, workshop co-chairs authored a meeting report published in Eos on April 27, 2016. Insights from the workshop directly contributed to the formation of a new DOE-supported project co-led by workshop co-chair Andymore » Jones. A subset of meeting participants continue to work on a publication on institutional innovations that can support the usability of high resolution modeling, among other sources of climate information.« less

Initial Usability and Feasibility Evaluation of a Personal Health Record-Based Self-Management System for Older Adults.

PubMed

Sheehan, Barbara; Lucero, Robert J

2015-01-01

Electronic personal health record-based (ePHR-based) self-management systems can improve patient engagement and have an impact on health outcomes. In order to realize the benefits of these systems, there is a need to develop and evaluate heath information technology from the same theoretical underpinnings. Using an innovative usability approach based in human-centered distributed information design (HCDID), we tested an ePHR-based falls-prevention self-management system-Self-Assessment via a Personal Health Record (i.e., SAPHeR)-designed using HCDID principles in a laboratory. And we later evaluated SAPHeR's use by community-dwelling older adults at home. The innovative approach used in this study supported the analysis of four components: tasks, users, representations, and functions. Tasks were easily learned and features such as text-associated images facilitated task completion. Task performance times were slow, however user satisfaction was high. Nearly seven out of every ten features desired by design participants were evaluated in our usability testing of the SAPHeR system. The in vivo evaluation suggests that older adults could improve their confidence in performing indoor and outdoor activities after using the SAPHeR system. We have applied an innovative consumer-usability evaluation. Our approach addresses the limitations of other usability testing methods that do not utilize consistent theoretically based methods for designing and testing technology. We have successfully demonstrated the utility of testing consumer technology use across multiple components (i.e., task, user, representational, functional) to evaluate the usefulness, usability, and satisfaction of an ePHR-based self-management system.

An evaluation of patients' experienced usability of a diabetes mHealth system using a multi-method approach.

PubMed

Georgsson, Mattias; Staggers, Nancy

2016-02-01

mHealth systems are becoming more common to aid patients in their diabetes self-management, but recent studies indicate a need for thorough evaluation of patients' experienced usability. Current evaluations lack a multi-method design for data collection and structured methods for data analyses. The purpose of this study was to provide a feasibility test of a multi-method approach for both data collection and data analyses for patients' experienced usability of a mHealth system for diabetes type 2 self-management. A random sample of 10 users was selected from a larger clinical trial. Data collection methods included user testing with eight representative tasks and Think Aloud protocol, a semi-structured interview and a questionnaire on patients' experiences using the system. The Framework Analysis (FA) method and Usability Problem Taxonomy (UPT) were used to structure, code and analyze the results. A usability severity rating was assigned after classification. The combined methods resulted in a total of 117 problems condensed into 19 usability issues with an average severity rating of 2.47 or serious. The usability test detected 50% of the initial usability problems, followed by the post-interview at 29%. The usability test found 18 of 19 consolidated usability problems while the questionnaire uncovered one unique issue. Patients experienced most usability problems (8) in the Glucose Readings View when performing complex tasks such as adding, deleting, and exporting glucose measurements. The severity ratings were the highest for the Glucose Diary View, Glucose Readings View, and Blood Pressure View with an average severity rating of 3 (serious). Most of the issues were classified under the artifact component of the UPT and primary categories of Visualness (7) and Manipulation (6). In the UPT task component, most issues were in the primary category Task-mapping (12). Multiple data collection methods yielded a more comprehensive set of usability issues. Usability testing uncovered the largest volume of usability issues, followed by interviewing and then the questionnaire. The interview did not surface any unique consolidated usability issues while the questionnaire surfaced one. The FA and UPT were valuable in structuring and classifying problems. The resulting descriptions serve as a communication tool in problem solving and programming. We recommend the usage of multiple methods in data collection and employing the FA and UPT in data analyses for future usability testing. Copyright © 2015 The Authors. Published by Elsevier Inc. All rights reserved.

Application of near field communication for health monitoring in daily life.

PubMed

Strömmer, Esko; Kaartinen, Jouni; Pärkkä, Juha; Ylisaukko-Oja, Arto; Korhonen, Ilkka

2006-01-01

We study the possibility of applying an emerging RFID-based communication technology, NFC (Near Field Communication), to health monitoring. We suggest that NFC is, compared to other competing technologies, a high-potential technology for short-range connectivity between health monitoring devices and mobile terminals. We propose practices to apply NFC to some health monitoring applications and study the benefits that are attainable with NFC. We compare NFC to other short-range communication technologies such as Bluetooth and IrDA, and study the possibility of improving the usability of health monitoring devices with NFC. We also introduce a research platform for technical evaluation, applicability study and application demonstrations of NFC.

Usability in telemedicine systems-A literature survey.

PubMed

Klaassen, B; van Beijnum, B J F; Hermens, H J

2016-09-01

The rapid development of sensors and communication technologies enable the growth of new innovative services in healthcare, such as Telemedicine. An essential ingredient in the development of a telemedicine system and its final acceptance by end users are usability studies. The principles of usability engineering, evaluations and telemedicine are well established, and it may contribute to the adoption and eventually deployment of such systems and services. An in-depth usability analysis, including performance and attitude measures, requires knowledge about available usability techniques, and is depending on the amount of resources. Therefore it is worth investigating how usability methods are applied in developing telemedicine systems. Our hypothesis is: with increasing research and development of telemedicine systems, we expect that various usability methods are more equally employed for different end-user groups and applications. A literature survey was conducted to find telemedicine systems that have been evaluated for usability or ease of use. The elements of the PICO framework were used as a basis for the selection criteria in the literature search. The search was not limited by year. Two independent reviewers screened all search results first by title, and then by abstract for inclusion. Articles were included up to May 2015. In total, 127 publications were included in this survey. The number of publications on telemedicine systems significantly increased after 2008. Older adults and end-users with cardiovascular conditions were among largest target end-user groups. Remote monitoring systems were found the most, in 90 publications. Questionnaires are the most common means for evaluating telemedicine systems, and were found in 88 publications. Questionnaires are used frequently in studies focusing on cardiovascular diseases, Parkinson's disease and older adult conditions. Interviews are found the most in publications related to stroke. In total 71% of the publications were trial-orientated and the remaining process orientated. An increase in telemedicine research, development and applications is found worldwide, with the majority of publications conducted in America. Monitoring patients in their homes can lead to better healthcare at lower costs which implies an increased demand of new healthcare strategies like telemedicine. We expected that with the increase in telemedicine research and development, a greater range of usability methods would also be employed in the included publications. This is not the case. Researchers employed questionnaires as a preferred usability method for each type of telemedicine system and most end-users. However, in process-orientated studies a greater range of usability evaluations were applied, with fewer differences found in the amount of publications for each evaluation method. Questionnaires enable researchers to evaluate a system quickly on end users, as it requires less expertise on the evaluation method compared to the other methods. They are easily distributed and are customizable. The use of questionnaires is therefore an evaluation method of choice for a variety of telemedicine systems and end-users. Copyright © 2016 Elsevier Ireland Ltd. All rights reserved.

Safety status system for operating room devices.

PubMed

Guédon, Annetje C P; Wauben, Linda S G L; Overvelde, Marlies; Blok, Joleen H; van der Elst, Maarten; Dankelman, Jenny; van den Dobbelsteen, John J

2014-01-01

Since the increase of the number of technological aids in the operating room (OR), equipment-related incidents have come to be a common kind of adverse events. This underlines the importance of adequate equipment management to improve the safety in the OR. A system was developed to monitor the safety status (periodic maintenance and registered malfunctions) of OR devices and to facilitate the notification of malfunctions. The objective was to assess whether the system is suitable for use in an busy OR setting and to analyse its effect on the notification of malfunctions. The system checks automatically the safety status of OR devices through constant communication with the technical facility management system, informs the OR staff real-time and facilitates notification of malfunctions. The system was tested for a pilot period of six months in four ORs of a Dutch teaching hospital and 17 users were interviewed on the usability of the system. The users provided positive feedback on the usability. For 86.6% of total time, the localisation of OR devices was accurate. 62 malfunctions of OR devices were reported, an increase of 12 notifications compared to the previous year. The safety status system was suitable for an OR complex, both from a usability and technical point of view, and an increase of reported malfunctions was observed. The system eases monitoring the safety status of equipment and is a promising tool to improve the safety related to OR devices.

Approaches for Evaluating the Usability of Assistive Technology Product Prototypes

ERIC Educational Resources Information Center

Choi, Young Mi; Sprigle, Stephen H.

2011-01-01

User input is an important component to help guide designers in producing a more usable product. Evaluation of prototypes is one method of obtaining this input, but methods for evaluating assistive technology prototypes during design have not been adequately described or evaluated. This project aimed to compare different methods of evaluating…

Usability of American Nurses Association State Web Sites: A Follow-up Evaluation.

PubMed

Koch, Gina; Wakefield, Bonnie J; Alexander, Gregory L; Wilson, Melissa A; Becker, Colleen

2016-05-01

The American Nurses Association supports professional nurses through Web sites administered by state nursing associations, providing important information for current and potential members. Optimal usability of these Web sites is critical for nurses to obtain the information they seek. Heuristic evaluations are general criteria used to evaluate the usability of technology such as Web sites. A study published in 2014, using heuristic criteria from Nielsen's 10 principles and Health on The Web, evaluated 27 state nursing Web sites to identify usability concerns that could prevent nurses from obtaining accurate information regarding state nursing practice. The purpose of this study is to conduct a second heuristic evaluation to assess for changes in a subset of 12 Web sites. The analysis comparing the evaluation from 2012 to 2014 found that mean scores increased and variance decreased; however, no statistically significant difference was found between the two studies. Scores increased in 2014 for "help users to diagnose, and recover from errors," "match between the system and real world," and "consistency and standards." Scores decreased due to absence of mission statements and identification of intended audience. Ideally, Web site designers will use the feedback from this study and make changes that improve their usability to provide information to nurses.

Usability evaluation of mobile applications using ISO 9241 and ISO 25062 standards.

PubMed

Moumane, Karima; Idri, Ali; Abran, Alain

2016-01-01

This paper presents an empirical study based on a set of measures to evaluate the usability of mobile applications running on different mobile operating systems, including Android, iOS and Symbian. The aim is to evaluate empirically a framework that we have developed on the use of the Software Quality Standard ISO 9126 in mobile environments, especially the usability characteristic. To do that, 32 users had participated in the experiment and we have used ISO 25062 and ISO 9241 standards for objective measures by working with two widely used mobile applications: Google Apps and Google Maps. The QUIS 7.0 questionnaire have been used to collect measures assessing the users' level of satisfaction when using these two mobile applications. By analyzing the results we highlighted a set of mobile usability issues that are related to the hardware as well as to the software and that need to be taken into account by designers and developers in order to improve the usability of mobile applications.

Usability evaluation of user interface of thesis title review system

NASA Astrophysics Data System (ADS)

Tri, Y.; Erna, A.; Gellysa, U.

2018-03-01

Presentation of programs with user interface that can be accessed online through the website of course greatly provide user benefits. User can easily access the program they need. There are usability values that serve as a benchmark for the success of a user accessible program, ie efficiency, effectiveness, and convenience. These usability values also determine the development of the program for the better use. Therefore, on the review title thesis program that will be implemented in STT Dumai was measured usability evaluation. It aims to see which sides are not yet perfect and need to be improved to improve the performance and utilization of the program. Usability evaluation was measured by using smartPLS software. Database used was the result of respondent questionnaires that include questions about the experience when they used program. The result of a review of thesis title program implemented in STT Dumai has an efficiency value of 22.615, the effectiveness of 20.612, and satisfaction of 33.177.

Usability evaluation of a medication reconciliation tool: Embedding safety probes to assess users' detection of medication discrepancies.

PubMed

Russ, Alissa L; Jahn, Michelle A; Patel, Himalaya; Porter, Brian W; Nguyen, Khoa A; Zillich, Alan J; Linsky, Amy; Simon, Steven R

2018-06-01

An electronic medication reconciliation tool was previously developed by another research team to aid provider-patient communication for medication reconciliation. To evaluate the usability of this tool, we integrated artificial safety probes into standard usability methods. The objective of this article is to describe this method of using safety probes, which enabled us to evaluate how well the tool supports users' detection of medication discrepancies. We completed a mixed-method usability evaluation in a simulated setting with 30 participants: 20 healthcare professionals (HCPs) and 10 patients. We used factual scenarios but embedded three artificial safety probes: (1) a missing medication (i.e., omission); (2) an extraneous medication (i.e., commission); and (3) an inaccurate dose (i.e., dose discrepancy). We measured users' detection of each probe to estimate the probability that a HCP or patient would detect these discrepancies. Additionally, we recorded participants' detection of naturally occurring discrepancies. Each safety probe was detected by ≤50% of HCPs. Patients' detection rates were generally higher. Estimates indicate that a HCP and patient, together, would detect 44.8% of these medication discrepancies. Additionally, HCPs and patients detected 25 and 45 naturally-occurring discrepancies, respectively. Overall, detection of medication discrepancies was low. Findings indicate that more advanced interface designs are warranted. Future research is needed on how technologies can be designed to better aid HCPs' and patients' detection of medication discrepancies. This is one of the first studies to evaluate the usability of a collaborative medication reconciliation tool and assess HCPs' and patients' detection of medication discrepancies. Results demonstrate that embedded safety probes can enhance standard usability methods by measuring additional, clinically-focused usability outcomes. The novel safety probes we used may serve as an initial, standard set for future medication reconciliation research. More prevalent use of safety probes could strengthen usability research for a variety of health information technologies. Published by Elsevier Inc.

A usability study of a mobile health application for rural Ghanaian midwives.

PubMed

Vélez, Olivia; Okyere, Portia Boakye; Kanter, Andrew S; Bakken, Suzanne

2014-01-01

Midwives in rural Ghana work at the frontline of the health care system, where they have access to essential data about the patient population. However, current methods of data capture, primarily pen and paper, make the data neither accessible nor usable for monitoring patient care or program evaluation. Electronic health (eHealth) systems present a potential mechanism for enhancing the roles of midwives by providing tools for collecting, exchanging, and viewing patient data as well as offering midwives the possibility for receiving information and decision support. Introducing such technology in low-resource settings has been challenging because of low levels of user acceptance, software design that does not match the end-user environment, and/or unforeseen challenges such as irregular power availability. These challenges are often attributable to a lack of understanding by the software developers of the end users' needs and work environment. A mobile health (mHealth) application known as mClinic was designed to support midwife access to the Millennium Village-Global Network, an eHealth delivery platform that captures data for managing patient care as well as program evaluation and monitoring, decision making, and management. We conducted a descriptive usability study composed of 3 phases to evaluate an mClinic prototype: 1) hybrid lab-live software evaluation of mClinic to identify usability issues; 2) completion of a usability questionnaire; and 3) interviews that included low-fidelity prototyping of new functionality proposed by midwives. The heuristic evaluation identified usability problems related to 4 of 8 usability categories. Analysis of usability questionnaire data indicated that the midwives perceived mClinic as useful but were more neutral about the ease of use. Analysis of midwives' reactions to low-fidelity prototypes during the interview process supported the applicability of mClinic to midwives' work and identified the need for additional functionality. User acceptance is essential for the success of any mHealth implementation. Usability testing identified mClinic development flaws and needed software enhancements. © 2014 by the American College of Nurse-Midwives.

CUNY+ Web: Usability Study of the Web-Based GUI Version of the Bibliographic Database of the City University of New York (CUNY).

ERIC Educational Resources Information Center

Oulanov, Alexei; Pajarillo, Edmund J. Y.

2002-01-01

Describes the usability evaluation of the CUNY (City University of New York) information system in Web and Graphical User Interface (GUI) versions. Compares results to an earlier usability study of the basic information database available on CUNY's wide-area network and describes the applicability of the previous usability instrument to this…

Assessment of the usability of a digital learning technology prototype for monitoring intracranial pressure 1

PubMed Central

de Carvalho, Lilian Regina; Évora, Yolanda Dora Martinez; Zem-Mascarenhas, Silvia Helena

2016-01-01

ABSTRACT Objective: to assess the usability of a digital learning technology prototype as a new method for minimally invasive monitoring of intracranial pressure. Method: descriptive study using a quantitative approach on assessing the usability of a prototype based on Nielsen's ten heuristics. Four experts in the area of Human-Computer interaction participated in the study. Results: the evaluation delivered eight violated heuristics and 31 usability problems in the 32 screens of the prototype. Conclusion: the suggestions of the evaluators were critical for developing an intuitive, user-friendly interface and will be included in the final version of the digital learning technology. PMID:27579932

Innovative Imagery System for Enhanced Habitability Onboard ISS: Desired Features and Possible Hardware Applications

NASA Technical Reports Server (NTRS)

Whitmore, Mihriban; Baggerman, Susan; Byrne, Vicky

2004-01-01

With the advent of the ISS and the experience of Russian, European, and US crewmembers on Mir, the importance of the psychological element in long duration missions is increasingly recognized. An integrated imagery system or Magic Window System could enhance the habitability, performance, and productivity for long term stays in space. Because this is type of system is a new concept for space, functional and technical requirements need to be determined. As part of a three-year project, the functional and technical requirements for an Imagery System onboard the International Space Station (ISS) have been explored. Valuable information was gathered from a survey completed by participants that had been in analog environments (remote/isolated) such as Antarctica, Aquarius, ISS crewmember debriefs, and crew support meetings to identify key functions desired for an integrated Magic Window System. Exercise and medical care activities were identified as areas that could benefit from such a system. It was determined that for exercise, it was worth exploring the concept of displaying a dynamic screen that changes as the crewmember's speed changes while showing physiological measures in a combined display. In terms of enhancing the interfaces for medical care activities, the Magic Window System could show video clips along side procedures for just-in-time training scenarios through a heads-up display. In addition, the portability, usability, and reliability were stressed as important considerations for an integrated system of technologies or Magic Window System. In addition, a review of state-of-the-art screens and other existing technologies such as tablet PCs and Personal Digital Assistants (PDAs) was conducted and contributed to defining technical requirements and feasibility of systems. Some heuristic evaluations of large displays and PDAs were conducted. Finally, feasibility for implementation onboard ISS has been considered. Currently, specific headset units are undergoing usability testing. The outcome of these activities will be valuable to determine the best candidates for an integrated system that could accommodate different needs depending on task.

Feasibility of mHealth and Near Field Communication technology based medication adherence monitoring.

PubMed

Morak, Juergen; Schwarz, Mark; Hayn, Dieter; Schreier, Guenter

2012-01-01

Poor patients' adherence to intake of prescribed medication has been identified as a serious problem in the treatment of chronically ill patients. Technical solutions are needed to measure and - if necessary - to increase the patients' adherence. A telemonitoring solution was developed to record a patient's medication intake based on smart blisters and mobile phones with NFC functionality. The components allowed recording of drug type, timestamp, and dosage of pills taken. The system's usability and technical feasibility was evaluated in the course of an application study. Over a period of 13 months 59 patients suffering from diabetes were monitored. 1,760 blisters were handed out to these patients and 14,843 takeout events were recorded and transmitted via mobile phone. Results indicate the feasibility of this concept to monitor adherence. Although the system still needs to be optimized for routine use it shows the potential for targeting the problem of poor patient adherence by NFC enabled devices.

Usability and Instructional Design Heuristics for E-Learning Evaluation.

ERIC Educational Resources Information Center

Reeves, Thomas C.; Benson, Lisa; Elliott, Dean; Grant, Michael; Holschuh, Doug; Kim, Beaumie; Kim, Hyeonjin; Lauber, Erick; Loh, Sebastian

Heuristic evaluation is a methodology for investigating the usability of software originally developed by Nielsen (1993, 2000). Nielsen's protocol was modified and refined for evaluating e-learning programs by participants in a doctoral seminar held at the University of Georgia in 2001. The modifications primarily involved expanding Nielsen's…

Systematic Heuristic Evaluation of Computerized Consultation Order Templates: Clinicians' and Human Factors Engineers' Perspectives.

PubMed

Savoy, April; Patel, Himalaya; Flanagan, Mindy E; Weiner, Michael; Russ, Alissa L

2017-08-01

We assessed the usability of consultation order templates and identified problems to prioritize in design efforts for improving referral communication. With a sample of 26 consultation order templates, three evaluators performed a usability heuristic evaluation. The evaluation used 14 domain-independent heuristics and the following three supplemental references: 1 new domain-specific heuristic, 6 usability goals, and coded clinicians' statements regarding ease of use for 10 sampled templates. Evaluators found 201 violations, a mean of 7.7 violations per template. Minor violations outnumbered major violations almost twofold, 115 (57%) to 62 (31%). Approximately 68% of violations were linked to 5 heuristics: aesthetic and minimalist design (17%), error prevention (16%), consistency and standards (14%), recognition rather than recall (11%), and meet referrers' information needs (10%). Severe violations were attributed mostly to meet referrers' information needs and recognition rather than recall. Recorded violations yielded potential negative consequences for efficiency, effectiveness, safety, learnability, and utility. Evaluators and clinicians demonstrated 80% agreement in usability assessment. Based on frequency and severity of usability heuristic violations, the consultation order templates reviewed may impede clinical efficiency and risk patient safety. Results support the following design considerations: communicate consultants' requirements, facilitate information seeking, and support communication. While the most frequent heuristic violations involved interaction design and presentation, the most severe violations lacked information desired by referring clinicians. Violations related to templates' inability to support referring clinicians' information needs had the greatest potential negative impact on efficiency and safety usability goals. Heuristics should be prioritized in future design efforts.

An efficient approach to improve the usability of e-learning resources: the role of heuristic evaluation.

PubMed

Davids, Mogamat Razeen; Chikte, Usuf M E; Halperin, Mitchell L

2013-09-01

Optimizing the usability of e-learning materials is necessary to maximize their potential educational impact, but this is often neglected when time and other resources are limited, leading to the release of materials that cannot deliver the desired learning outcomes. As clinician-teachers in a resource-constrained environment, we investigated whether heuristic evaluation of our multimedia e-learning resource by a panel of experts would be an effective and efficient alternative to testing with end users. We engaged six inspectors, whose expertise included usability, e-learning, instructional design, medical informatics, and the content area of nephrology. They applied a set of commonly used heuristics to identify usability problems, assigning severity scores to each problem. The identification of serious problems was compared with problems previously found by user testing. The panel completed their evaluations within 1 wk and identified a total of 22 distinct usability problems, 11 of which were considered serious. The problems violated the heuristics of visibility of system status, user control and freedom, match with the real world, intuitive visual layout, consistency and conformity to standards, aesthetic and minimalist design, error prevention and tolerance, and help and documentation. Compared with user testing, heuristic evaluation found most, but not all, of the serious problems. Combining heuristic evaluation and user testing, with each involving a small number of participants, may be an effective and efficient way of improving the usability of e-learning materials. Heuristic evaluation should ideally be used first to identify the most obvious problems and, once these are fixed, should be followed by testing with typical end users.

Evaluation of the usability of a serious game aiming to teach facial expressions to schizophrenic patients.

PubMed

Isleyen, Filiz; Gulkesen, K Hakan; Cinemre, Buket; Samur, M Kemal; Zayim, Nese; Sen Kaya, Semiha

2014-01-01

In some psychological disorders such as autism and schizophrenia, loss of facial expression recognition skill may complicate patient's daily life. Information technology may help to develop facial expression recognition skill by educational software and games. We designed and developed an interactive web-based educational program with which we performed a usability study before investigating its effectiveness on the schizophrenia patients' ability of emotion perception. The purpose of this study is to describe the usability evaluation for a web-based game set that has been designed to teach facial expressions to schizophrenic patients. The usability study was done at two steps; first, we applied heuristic evaluation and the violations were rated in a scale from most to least severe and the major problems were solved. In the second step, think-aloud method was used and the web site was assessed by five schizophrenic patients. Eight experts participated in the heuristic evaluation, in which a total of 60 violations were identified with a mean severity of 2.77 (range: 0-4). All of the major problems (severity over 2.5) were listed and the usability problems were solved by the development team. After solving the problems, five users with a diagnosis of schizophrenia used the web site with the same scenario. They reported to have experienced minor, but different problems. In conclusion, we suggest that a combination of heuristic evaluation and think-aloud method may be an effective and efficient way for usability evaluations for the serious games that have been designed for special patient groups.

The Usability of SEEQ in Quality Evaluation of Arabic Secondary Education in Malaysia

ERIC Educational Resources Information Center

al-Muslim, M.; Arifin, Zamri

2015-01-01

Evaluation of the quality of Arabic education in Malaysia needs to be conducted on a continuous basis to achieve the objectives of Arabic education. Student Evaluation of Education Quality (SEEQ) was proposed as one of the evaluation instruments of the quality of Arabic education. This study aimed to evaluate the usability of SEEQ in the context…

'Televaluation' of clinical information systems: an integrative approach to assessing Web-based systems.

PubMed

Kushniruk, A W; Patel, C; Patel, V L; Cimino, J J

2001-04-01

The World Wide Web provides an unprecedented opportunity for widespread access to health-care applications by both patients and providers. The development of new methods for assessing the effectiveness and usability of these systems is becoming a critical issue. This paper describes the distance evaluation (i.e. 'televaluation') of emerging Web-based information technologies. In health informatics evaluation, there is a need for application of new ideas and methods from the fields of cognitive science and usability engineering. A framework is presented for conducting evaluations of health-care information technologies that integrates a number of methods, ranging from deployment of on-line questionnaires (and Web-based forms) to remote video-based usability testing of user interactions with clinical information systems. Examples illustrating application of these techniques are presented for the assessment of a patient clinical information system (PatCIS), as well as an evaluation of use of Web-based clinical guidelines. Issues in designing, prototyping and iteratively refining evaluation components are discussed, along with description of a 'virtual' usability laboratory.

Effect of improving the usability of an e-learning resource: a randomized trial.

PubMed

Davids, Mogamat Razeen; Chikte, Usuf M E; Halperin, Mitchell L

2014-06-01

Optimizing the usability of e-learning materials is necessary to reduce extraneous cognitive load and maximize their potential educational impact. However, this is often neglected, especially when time and other resources are limited. We conducted a randomized trial to investigate whether a usability evaluation of our multimedia e-learning resource, followed by fixing of all problems identified, would translate into improvements in usability parameters and learning by medical residents. Two iterations of our e-learning resource [version 1 (V1) and version 2 (V2)] were compared. V1 was the first fully functional version and V2 was the revised version after all identified usability problems were addressed. Residents in internal medicine and anesthesiology were randomly assigned to one of the versions. Usability was evaluated by having participants complete a user satisfaction questionnaire and by recording and analyzing their interactions with the application. The effect on learning was assessed by questions designed to test the retention and transfer of knowledge. Participants reported high levels of satisfaction with both versions, with good ratings on the System Usability Scale and adjective rating scale. In contrast, analysis of video recordings revealed significant differences in the occurrence of serious usability problems between the two versions, in particular in the interactive HandsOn case with its treatment simulation, where there was a median of five serious problem instances (range: 0-50) recorded per participant for V1 and zero instances (range: 0-1) for V2 (P < 0.001). There were no differences in tests of retention or transfer of knowledge between the two versions. In conclusion, usability evaluation followed by a redesign of our e-learning resource resulted in significant improvements in usability. This is likely to translate into improved motivation and willingness to engage with the learning material. In this population of relatively high-knowledge participants, learning scores were similar across the two versions. Copyright © 2014 The American Physiological Society.

Effect of improving the usability of an e-learning resource: a randomized trial

PubMed Central

Chikte, Usuf M. E.; Halperin, Mitchell L.

2014-01-01

Optimizing the usability of e-learning materials is necessary to reduce extraneous cognitive load and maximize their potential educational impact. However, this is often neglected, especially when time and other resources are limited. We conducted a randomized trial to investigate whether a usability evaluation of our multimedia e-learning resource, followed by fixing of all problems identified, would translate into improvements in usability parameters and learning by medical residents. Two iterations of our e-learning resource [version 1 (V1) and version 2 (V2)] were compared. V1 was the first fully functional version and V2 was the revised version after all identified usability problems were addressed. Residents in internal medicine and anesthesiology were randomly assigned to one of the versions. Usability was evaluated by having participants complete a user satisfaction questionnaire and by recording and analyzing their interactions with the application. The effect on learning was assessed by questions designed to test the retention and transfer of knowledge. Participants reported high levels of satisfaction with both versions, with good ratings on the System Usability Scale and adjective rating scale. In contrast, analysis of video recordings revealed significant differences in the occurrence of serious usability problems between the two versions, in particular in the interactive HandsOn case with its treatment simulation, where there was a median of five serious problem instances (range: 0–50) recorded per participant for V1 and zero instances (range: 0–1) for V2 (P < 0.001). There were no differences in tests of retention or transfer of knowledge between the two versions. In conclusion, usability evaluation followed by a redesign of our e-learning resource resulted in significant improvements in usability. This is likely to translate into improved motivation and willingness to engage with the learning material. In this population of relatively high-knowledge participants, learning scores were similar across the two versions. PMID:24913451

Written online situational feedback via mobile phone to support self-management of chronic widespread pain: a usability study of a Web-based intervention

PubMed Central

2011-01-01

Background This pretrial study aimed to develop and test the usability of a four-week Internet intervention delivered by a Web-enabled mobile phone to support self-management of chronic widespread pain. Methods The intervention included daily online entries and individualized written feedback, grounded in a mindfulness-based cognitive behavioral approach. The participants registered activities, emotions and pain cognitions three times daily using the mobile device. The therapist had immediate access to this information through a secure Web site. The situational information was used to formulate and send a personalized text message to the participant with the aim of stimulating effective self-management of the current situation. Six women participated and evaluated the experience. Results The intervention was rated as supportive, meaningful and user-friendly by the majority of the women. The response rate to the daily registration entries was high and technical problems were few. Conclusion The results indicate a feasible intervention. Web-applications are fast becoming standard features of mobile phones and interventions of this kind can therefore be more available than before. Trial registration number ClinicalTrials.gov: NCT01236209 PMID:21352516

Randomised controlled trial to assess the effect of a Just-in-Time training on procedural performance: a proof-of-concept study to address procedural skill decay.

PubMed

Branzetti, Jeremy B; Adedipe, Adeyinka A; Gittinger, Matthew J; Rosenman, Elizabeth D; Brolliar, Sarah; Chipman, Anne K; Grand, James A; Fernandez, Rosemarie

2017-11-01

A subset of high-risk procedures present significant safety threats due to their (1) infrequent occurrence, (2) execution under time constraints and (3) immediate necessity for patient survival. A Just-in-Time (JIT) intervention could provide real-time bedside guidance to improve high-risk procedural performance and address procedural deficits associated with skill decay. To evaluate the impact of a novel JIT intervention on transvenous pacemaker (TVP) placement during a simulated patient event. This was a prospective, randomised controlled study to determine the effect of a JIT intervention on performance of TVP placement. Subjects included board-certified emergency medicine physicians from two hospitals. The JIT intervention consisted of a portable, bedside computer-based procedural adjunct. The primary outcome was performance during a simulated patient encounter requiring TVP placement, as assessed by trained raters using a technical skills checklist. Secondary outcomes included global performance ratings, time to TVP placement, number of critical omissions and System Usability Scale scores (intervention only). Groups were similar at baseline across all outcomes. Compared with the control group, the intervention group demonstrated statistically significant improvement in the technical checklist score (11.45 vs 23.44, p<0.001, Cohen's d effect size 4.64), the global rating scale (2.27 vs 4.54, p<0.001, Cohen's d effect size 3.76), and a statistically significant reduction in critical omissions (2.23 vs 0.68, p<0.001, Cohen's d effect size -1.86). The difference in time to procedural completion was not statistically significant between conditions (11.15 min vs 12.80 min, p=0.12, Cohen's d effect size 0.65). System Usability Scale scores demonstrated excellent usability. A JIT intervention improved procedure perfromance, suggesting a role for JIT interventions in rarely performed procedures. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

INCOMMANDS TDP: Human Factors Evaluation of the Command Decision Support Capability Prototype

DTIC Science & Technology

2009-03-01

CDSC) design with guidelines and principles stipulated in the INCOMMANDS TDP Human Factors Design and Evaluation Guide. 2. Usability and Utility...INCOMMANDS CDSC. The Heuristic Evaluation helps to ensure that the design of system is compliant with HCI best practices. Whereas the Usability and...implemented to confirm compliance with the INCOMMANDS TDP Human Factors Design and Evaluation Guide

Usability requirements for buildings: a case study on primary schools.

PubMed

Duca, Gabriella

2012-01-01

This paper concerns an applied research aimed at applying the concept of usability, as derived form the standard ISO 9241/11, in the filed of building design, namely primary schools. Starting from the concept that space characteristics play a very relevant role in learning performances, the study presented here developed an original methodology for the assessment of effectiveness, efficiency and satisfaction of buildings hosting primary schools, in order to create a school environment better supporting users in their tasks. Research core is the framework of usability requirements and their related markers, indicators and technical specification that has been formulated in order to check compliance of urban area, building, rooms and architectural details with users needs. Therefore, a detailed task analysis of pupils and teacher tasks has been carried out and two questionnaires addressed to a significant users panel have been formulated for satisfaction survey. Lastly, a matrix for an overall reading of gathered data has been set-up and criteria for usability assessment based on that data has been defined. The whole study has been developed within the case study of a primary school in the Naples city centre, whose contents and results are discussed.

Development and evaluation of RAMP I - a practitioner's tool for screening of musculoskeletal disorder risk factors in manual handling.

PubMed

Lind, Carl Mikael; Forsman, Mikael; Rose, Linda Maria

2017-10-16

RAMP I is a screening tool developed to support practitioners in screening for work-related musculoskeletal disorder risk factors related to manual handling. RAMP I, which is part of the RAMP tool, is based on research-based studies combined with expert group judgments. More than 80 practitioners participated in the development of RAMP I. The tool consists of dichotomous assessment items grouped into seven categories. Acceptable reliability was found for a majority of the assessment items for 15 practitioners who were given 1 h of training. The usability evaluation points to RAMP I being usable for screening for musculoskeletal disorder risk factors, i.e., usable for assessing risks, being usable as a decision base, having clear results and that the time needed for an assessment is acceptable. It is concluded that RAMP I is a usable tool for practitioners.

Usability evaluation of an emergency department information system prototype designed using cognitive systems engineering techniques.

PubMed

Clark, Lindsey N; Benda, Natalie C; Hegde, Sudeep; McGeorge, Nicolette M; Guarrera-Schick, Theresa K; Hettinger, A Zachary; LaVergne, David T; Perry, Shawna J; Wears, Robert L; Fairbanks, Rollin J; Bisantz, Ann M

2017-04-01

This article presents an evaluation of novel display concepts for an emergency department information system (EDIS) designed using cognitive systems engineering methods. EDISs assist emergency medicine staff with tracking patient care and ED resource allocation. Participants performed patient planning and orientation tasks using the EDIS displays and rated the display's ability to support various cognitive performance objectives along with the usability, usefulness, and predicted frequency of use for 18 system components. Mean ratings were positive for cognitive performance support objectives, usability, usefulness, and frequency of use, demonstrating the successful application of design methods to create useful and usable EDIS concepts that provide cognitive support for emergency medicine staff. Nurse and provider roles had significantly different perceptions of the usability and usefulness of certain EDIS components, suggesting that they have different information needs while working. Copyright © 2016 Elsevier Ltd. All rights reserved.

Using a medical simulation center as an electronic health record usability laboratory

PubMed Central

Landman, Adam B; Redden, Lisa; Neri, Pamela; Poole, Stephen; Horsky, Jan; Raja, Ali S; Pozner, Charles N; Schiff, Gordon; Poon, Eric G

2014-01-01

Usability testing is increasingly being recognized as a way to increase the usability and safety of health information technology (HIT). Medical simulation centers can serve as testing environments for HIT usability studies. We integrated the quality assurance version of our emergency department (ED) electronic health record (EHR) into our medical simulation center and piloted a clinical care scenario in which emergency medicine resident physicians evaluated a simulated ED patient and documented electronically using the ED EHR. Meticulous planning and close collaboration with expert simulation staff was important for designing test scenarios, pilot testing, and running the sessions. Similarly, working with information systems teams was important for integration of the EHR. Electronic tools are needed to facilitate entry of fictitious clinical results while the simulation scenario is unfolding. EHRs can be successfully integrated into existing simulation centers, which may provide realistic environments for usability testing, training, and evaluation of human–computer interactions. PMID:24249778

Usability evaluation of an emergency department information system prototype designed using cognitive systems engineering techniques

PubMed Central

Clark, Lindsey N.; Benda, Natalie C.; Hegde, Sudeep; McGeorge, Nicolette M.; Guarrera-Schick, Theresa K.; Hettinger, A. Zachary; LaVergne, David T.; Perry, Shawna J.; Wears, Robert L.; Fairbanks, Rollin J.; Bisantz, Ann M.

2017-01-01

This article presents an evaluation of novel display concepts for an emergency department information system (EDIS) designed using cognitive systems engineering methods. EDISs assist emergency medicine staff with tracking patient care and ED resource allocation. Participants performed patient planning and orientation tasks using the EDIS displays and rated the display’s ability to support various cognitive performance objectives along with the usability, usefulness, and predicted frequency of use for 18 system components. Mean ratings were positive for cognitive performance support objectives, usability, usefulness, and frequency of use, demonstrating the successful application of design methods to create useful and usable EDIS concepts that provide cognitive support for emergency medicine staff. Nurse and provider roles had significantly different perceptions of the usability and usefulness of certain EDIS components, suggesting that they have different information needs while working. PMID:28166896

Usability Evaluation Methods for Gesture-Based Games: A Systematic Review.

PubMed

Simor, Fernando Winckler; Brum, Manoela Rogofski; Schmidt, Jaison Dairon Ebertz; Rieder, Rafael; De Marchi, Ana Carolina Bertoletti

2016-10-04

Gestural interaction systems are increasingly being used, mainly in games, expanding the idea of entertainment and providing experiences with the purpose of promoting better physical and/or mental health. Therefore, it is necessary to establish mechanisms for evaluating the usability of these interfaces, which make gestures the basis of interaction, to achieve a balance between functionality and ease of use. This study aims to present the results of a systematic review focused on usability evaluation methods for gesture-based games, considering devices with motion-sensing capability. We considered the usability methods used, the common interface issues, and the strategies adopted to build good gesture-based games. The research was centered on four electronic databases: IEEE, Association for Computing Machinery (ACM), Springer, and Science Direct from September 4 to 21, 2015. Within 1427 studies evaluated, 10 matched the eligibility criteria. As a requirement, we considered studies about gesture-based games, Kinect and/or Wii as devices, and the use of a usability method to evaluate the user interface. In the 10 studies found, there was no standardization in the methods because they considered diverse analysis variables. Heterogeneously, authors used different instruments to evaluate gesture-based interfaces and no default approach was proposed. Questionnaires were the most used instruments (70%, 7/10), followed by interviews (30%, 3/10), and observation and video recording (20%, 2/10). Moreover, 60% (6/10) of the studies used gesture-based serious games to evaluate the performance of elderly participants in rehabilitation tasks. This highlights the need for creating an evaluation protocol for older adults to provide a user-friendly interface according to the user's age and limitations. Through this study, we conclude this field is in need of a usability evaluation method for serious games, especially games for older adults, and that the definition of a methodology and a test protocol may offer the user more comfort, welfare, and confidence.

Usability Evaluation Methods for Gesture-Based Games: A Systematic Review

PubMed Central

Simor, Fernando Winckler; Brum, Manoela Rogofski; Schmidt, Jaison Dairon Ebertz; De Marchi, Ana Carolina Bertoletti

2016-01-01

Background Gestural interaction systems are increasingly being used, mainly in games, expanding the idea of entertainment and providing experiences with the purpose of promoting better physical and/or mental health. Therefore, it is necessary to establish mechanisms for evaluating the usability of these interfaces, which make gestures the basis of interaction, to achieve a balance between functionality and ease of use. Objective This study aims to present the results of a systematic review focused on usability evaluation methods for gesture-based games, considering devices with motion-sensing capability. We considered the usability methods used, the common interface issues, and the strategies adopted to build good gesture-based games. Methods The research was centered on four electronic databases: IEEE, Association for Computing Machinery (ACM), Springer, and Science Direct from September 4 to 21, 2015. Within 1427 studies evaluated, 10 matched the eligibility criteria. As a requirement, we considered studies about gesture-based games, Kinect and/or Wii as devices, and the use of a usability method to evaluate the user interface. Results In the 10 studies found, there was no standardization in the methods because they considered diverse analysis variables. Heterogeneously, authors used different instruments to evaluate gesture-based interfaces and no default approach was proposed. Questionnaires were the most used instruments (70%, 7/10), followed by interviews (30%, 3/10), and observation and video recording (20%, 2/10). Moreover, 60% (6/10) of the studies used gesture-based serious games to evaluate the performance of elderly participants in rehabilitation tasks. This highlights the need for creating an evaluation protocol for older adults to provide a user-friendly interface according to the user’s age and limitations. Conclusions Through this study, we conclude this field is in need of a usability evaluation method for serious games, especially games for older adults, and that the definition of a methodology and a test protocol may offer the user more comfort, welfare, and confidence. PMID:27702737

Usability Evaluation and Implementation of a Health Information Technology Dashboard of Evidence-Based Quality Indicators.

PubMed

Schall, Mark Christopher; Cullen, Laura; Pennathur, Priyadarshini; Chen, Howard; Burrell, Keith; Matthews, Grace

2017-06-01

Health information technology dashboards that integrate evidence-based quality indicators can efficiently and accurately display patient risk information to promote early intervention and improve overall quality of patient care. We describe the process of developing, evaluating, and implementing a dashboard designed to promote quality care through display of evidence-based quality indicators within an electronic health record. Clinician feedback was sought throughout the process. Usability evaluations were provided by three nurse pairs and one physician from medical-surgical areas. Task completion times, error rates, and ratings of system usability were collected to compare the use of quality indicators displayed on the dashboard to the indicators displayed in a conventional electronic health record across eight experimental scenarios. Participants rated the dashboard as "highly usable" following System Usability Scale (mean, 87.5 [SD, 9.6]) and Poststudy System Usability Questionnaire (mean, 1.7 [SD, 0.5]) criteria. Use of the dashboard led to reduced task completion times and error rates in comparison to the conventional electronic health record for quality indicator-related tasks. Clinician responses to the dashboard display capabilities were positive, and a multifaceted implementation plan has been used. Results suggest application of the dashboard in the care environment may lead to improved patient care.

Quality and Usability of Arthritic Pain Self-Management Apps for Older Adults: A Systematic Review.

PubMed

Bhattarai, Priyanka; Newton-John, T R O; Phillips, Jane L

2018-03-01

To appraise the quality and usability of currently available pain applications that could be used by community-dwelling older adults to self-manage their arthritic pain. A systematic review. Searches were conducted in App Store and Google Play to identify pain self-management apps relevant to arthritic pain management. English language pain management apps providing pain assessment and documentation function and pain management education were considered for inclusion. A quality evaluation audit tool based on the Stanford Arthritis Self-Management Program was developed a priori to evaluate app content quality. The usability of included apps was assessed using an established usability evaluation tool. Out of the 373 apps that were identified, four met the inclusion criteria. The included apps all included a pain assessment and documentation function and instructions on medication use, communication with health professionals, cognitive behavioral therapy-based pain management, and physical exercise. Management of mood, depression, anxiety, and sleep were featured in most apps (N = 3). Three-quarters (N = 3) of the apps fell below the acceptable moderate usability score (≥3), while one app obtained a moderate score (3.2). Few of the currently available pain apps offer a comprehensive pain self-management approach incorporating evidence-based strategies in accordance with the Stanford Arthritis Self-Management Program. The moderate-level usability across the included apps indicates a need to consider the usability needs of the older population in future pain self-management app development endeavors.

A framework for evaluating electronic health record vendor user-centered design and usability testing processes.

PubMed

Ratwani, Raj M; Zachary Hettinger, A; Kosydar, Allison; Fairbanks, Rollin J; Hodgkins, Michael L

2017-04-01

Currently, there are few resources for electronic health record (EHR) purchasers and end users to understand the usability processes employed by EHR vendors during product design and development. We developed a framework, based on human factors literature and industry standards, to systematically evaluate the user-centered design processes and usability testing methods used by EHR vendors. We reviewed current usability certification requirements and the human factors literature to develop a 15-point framework for evaluating EHR products. The framework is based on 3 dimensions: user-centered design process, summative testing methodology, and summative testing results. Two vendor usability reports were retrieved from the Office of the National Coordinator's Certified Health IT Product List and were evaluated using the framework. One vendor scored low on the framework (5 pts) while the other vendor scored high on the framework (15 pts). The 2 scored vendor reports demonstrate the framework's ability to discriminate between the variabilities in vendor processes and to determine which vendors are meeting best practices. The framework provides a method to more easily comprehend EHR vendors' usability processes and serves to highlight where EHR vendors may be falling short in terms of best practices. The framework provides a greater level of transparency for both purchasers and end users of EHRs. The framework highlights the need for clearer certification requirements and suggests that the authorized certification bodies that examine vendor usability reports may need to be provided with clearer guidance. © The Author 2016. Published by Oxford University Press on behalf of the American Medical Informatics Association. All rights reserved. For Permissions, please email: journals.permissions@oup.com

Safety and usability evaluation of a web-based insulin self-titration system for patients with type 2 diabetes mellitus.

PubMed

Simon, Airin C R; Holleman, Frits; Gude, Wouter T; Hoekstra, Joost B L; Peute, Linda W; Jaspers, Monique W M; Peek, Niels

2013-09-01

The rising incidence of type 2 diabetes mellitus (T2DM) induces severe challenges for the health care system. Our research group developed a web-based system named PANDIT that provides T2DM patients with insulin dosing advice using state of the art clinical decision support technology. The PANDIT interface resembles a glucose diary and provides advice through pop-up messages. Diabetes nurses (DNs) also have access to the system, allowing them to intervene when needed. The objective of this study was to establish whether T2DM patients can safely use PANDIT at home. To this end, we assessed whether patients experience usability problems with a high risk of compromising patient safety when interacting with the system, and whether PANDIT's insulin dosing advice are clinically safe. The study population consisted of patients with T2DM (aged 18-80) who used a once daily basal insulin as well as DNs from a university hospital. The usability evaluation consisted of think-aloud sessions with four patients and three DNs. Video data, audio data and verbal utterances were analyzed for usability problems encountered during PANDIT interactions. Usability problems were rated by a physician and a usability expert according to their potential impact on patient safety. The usability evaluation was followed by an implementation with a duration of four weeks. This implementation took place at the patients' homes with ten patients to evaluate clinical safety of PANDIT advice. PANDIT advice were systematically compared with DN advice. Deviating advice were evaluated with respect to patient safety by a panel of experienced physicians, which specialized in diabetes care. We detected seventeen unique usability problems, none of which was judged to have a high risk of compromising patient safety. Most usability problems concerned the lay-out of the diary, which did not clearly indicate which data entry fields had to be entered in order to obtain an advice. 27 out of 74 (36.5%) PANDIT advice differed from those provided by DNs. However, only one of these (1.4%) was considered unsafe by the panel. T2DM patients with no prior experience with the web-based self-management system were capable of consulting the system without encountering significant usability problems. Furthermore, the large majority of PANDIT advice were considered clinically safe according to the expert panel. One advice was considered unsafe. This could however easily be corrected by implementing a small modification to the system's knowledge base. Copyright © 2013 Elsevier B.V. All rights reserved.

Usability Evaluation of Public Web Mapping Sites

NASA Astrophysics Data System (ADS)

Wang, C.

2014-04-01

Web mapping sites are interactive maps that are accessed via Webpages. With the rapid development of Internet and Geographic Information System (GIS) field, public web mapping sites are not foreign to people. Nowadays, people use these web mapping sites for various reasons, in that increasing maps and related map services of web mapping sites are freely available for end users. Thus, increased users of web mapping sites led to more usability studies. Usability Engineering (UE), for instance, is an approach for analyzing and improving the usability of websites through examining and evaluating an interface. In this research, UE method was employed to explore usability problems of four public web mapping sites, analyze the problems quantitatively and provide guidelines for future design based on the test results. Firstly, the development progress for usability studies were described, and simultaneously several usability evaluation methods such as Usability Engineering (UE), User-Centered Design (UCD) and Human-Computer Interaction (HCI) were generally introduced. Then the method and procedure of experiments for the usability test were presented in detail. In this usability evaluation experiment, four public web mapping sites (Google Maps, Bing maps, Mapquest, Yahoo Maps) were chosen as the testing websites. And 42 people, who having different GIS skills (test users or experts), gender (male or female), age and nationality, participated in this test to complete the several test tasks in different teams. The test comprised three parts: a pretest background information questionnaire, several test tasks for quantitative statistics and progress analysis, and a posttest questionnaire. The pretest and posttest questionnaires focused on gaining the verbal explanation of their actions qualitatively. And the design for test tasks targeted at gathering quantitative data for the errors and problems of the websites. Then, the results mainly from the test part were analyzed. The success rate from different public web mapping sites was calculated and compared, and displayed by the means of diagram. And the answers from questionnaires were also classified and organized in this part. Moreover, based on the analysis, this paper expands the discussion about the layout, map visualization, map tools, search logic and etc. Finally, this paper closed with some valuable guidelines and suggestions for the design of public web mapping sites. Also, limitations for this research stated in the end.

A Usability Study of Users’ Perceptions Toward a Multimedia Computer-Assisted Learning Tool for Neuroanatomy

PubMed Central

Gould, Douglas J.; Terrell, Mark A.; Fleming, Jo

2015-01-01

This usability study evaluated users’ perceptions of a multimedia prototype for a new e-learning tool: Anatomy of the Central Nervous System: A Multimedia Course. Usability testing is a collection of formative evaluation methods that inform the developmental design of e-learning tools to maximize user acceptance, satisfaction, and adoption. Sixty-two study participants piloted the prototype and completed a usability questionnaire designed to measure two usability properties: program need and program applicability. Statistical analyses were used to test the hypothesis that the multimedia prototype was well designed and highly usable, it was perceived as: 1) highly needed across a spectrum of educational contexts, 2) highly applicable in supporting the pedagogical processes of teaching and learning neuroanatomy, and 3) was highly usable by all types of users. Three independent variables represented user differences: level of expertise (faculty vs. student), age, and gender. Analysis of the results supports the research hypotheses that the prototype was designed well for different types of users in various educational contexts and for supporting the pedagogy of neuroanatomy. In addition, the results suggest that the multimedia program will be most useful as a neuroanatomy review tool for health-professions students preparing for licensing or board exams. This study demonstrates the importance of integrating quality properties of usability with principles of human learning during the instructional design process for multimedia products. PMID:19177405

U.S.A.B.I.L.I.T.Y. Framework for Older Adults.

PubMed

Caboral-Stevens, Meriam; Whetsell, Martha V; Evangelista, Lorraine S; Cypress, Brigitte; Nickitas, Donna

2015-01-01

The purpose of the current study was to present a framework to determine potential usability of health websites by older adults. Review of the literature showed paucity of nursing theory related to the use of technology and usability, particularly in older adults. The Roy Adaptation Model, a widely used nursing theory, was chosen to provide framework for the new model. Technology constructs from the Technology Acceptance Model and United Theory of Acceptance and Use of Technology and behavioral control construct from the Theory of Planned Behavior were integrated into the construction of the derived model. The Use of Technology for Adaptation by Older Adults and/or Those With Limited Literacy (U.S.A.B.I.L.I.T.Y.) Model was constructed from the integration of diverse theoretical/conceptual perspectives. The four determinants of usability in the conceptual model include (a) efficiency, (b) learnability, (c) perceived user experience, and (d) perceived control. Because of the lack of well-validated survey questionnaires to measure these determinants, a U.S.A.B.I.L.I.T.Y. Survey was developed. A panel of experts evaluated face and content validity of the new instrument. Internal consistency of the new instrument was 0.96. Usability is key to accepting technology. The derived U.S.A.B.I.L.I.T.Y. framework could serve as a guide for nurses in formative evaluation of technology. Copyright 2015, SLACK Incorporated.

Effect of Improving the Usability of an E-Learning Resource: A Randomized Trial

ERIC Educational Resources Information Center

Davids, Mogamat Razeen; Chikte, Usuf M. E.; Halperin, Mitchell L.

2014-01-01

Optimizing the usability of e-learning materials is necessary to reduce extraneous cognitive load and maximize their potential educational impact. However, this is often neglected, especially when time and other resources are limited. We conducted a randomized trial to investigate whether a usability evaluation of our multimedia e-learning…

Internationalization and localization: evaluating and testing a Website for Asian users.

PubMed

Rau, Pei-Luen Patrick; Liang, Sheau-Farn Max

2003-01-15

The objective of this study was to combine internationalization and localization of Websites and improvement of Website usability with user-centred design methods. This study designed for internationalization and localization of Websites for Asian users, and implemented usability engineering into every phase of Website usability testing, based on the internationalization and localization perspectives of the honeywell.com/your home Website. The first step was to develop the usage scenarios. Three Asian usability specialists carried out one heuristic evaluation session for the current honeywell.com/your home Website. The usability problems were analysed and possible solutions to these problems were discussed. In the next phase, cluster analysis was utilized to test current information architecture. The results provided options for future information architecture development for this Website. Finally, a performance measurement test was conducted to investigate the performance for Asian users. Based on the results, suggestions for improving the Website usability from the localization perspective were provided. The results demonstrate the user-centred design (UCD) approach and stress international and local issues in Website development to Website designers.

PROOF OF CONCEPT FOR A HUMAN RELIABILITY ANALYSIS METHOD FOR HEURISTIC USABILITY EVALUATION OF SOFTWARE

DOE Office of Scientific and Technical Information (OSTI.GOV)

Ronald L. Boring; David I. Gertman; Jeffrey C. Joe

2005-09-01

An ongoing issue within human-computer interaction (HCI) is the need for simplified or “discount” methods. The current economic slowdown has necessitated innovative methods that are results driven and cost effective. The myriad methods of design and usability are currently being cost-justified, and new techniques are actively being explored that meet current budgets and needs. Recent efforts in human reliability analysis (HRA) are highlighted by the ten-year development of the Standardized Plant Analysis Risk HRA (SPAR-H) method. The SPAR-H method has been used primarily for determining humancentered risk at nuclear power plants. The SPAR-H method, however, shares task analysis underpinnings withmore » HCI. Despite this methodological overlap, there is currently no HRA approach deployed in heuristic usability evaluation. This paper presents an extension of the existing SPAR-H method to be used as part of heuristic usability evaluation in HCI.« less

An Authoring Tool for User Generated Mobile Services

NASA Astrophysics Data System (ADS)

Danado, José; Davies, Marcin; Ricca, Paulo; Fensel, Anna

Imagine what kind of applications become possible when our mobile devices not only present data but provide valuable information to other users. Users become able to instantaneously create services and to publish content and knowledge on their own mobile device, which can be discovered and accessed remotely by other mobile users in a simple way. To achieve the vision of customizable and context aware user-generated mobile services, we present a mobile authoring tool for end-users to create, customize and deploy mobile services while on-the-go. This tool is designed to allow users with different levels of technical expertise to create mobile services. The paper also gives insight on the performed usability evaluations, namely user interviews and an online survey.

Development of an Assessment Methodology for Demonstrating Usability, Technical Maturity, and Operational Benefits of Advanced Medical Technology (Developpement d’une Methodologie d’Evaluation Permettant de Demontrer la Facilite d’Utilisation, la Maturite Technique et les Avantages Operationnels des Technologies Medicales Evoluees)

DTIC Science & Technology

2010-09-01

de nations, que ce soit au sein de l’Alliance ou dans le cadre du Partenariat pour la paix, ont développé au cours des ...pour l’évacuation des blessés (CASEVAC). Certaines de ces technologies peuvent inclure en temps réel le contrôle de l’état du combattant/patient, la ...localisation du patient, le contrôle de l’état de la logistique médicale, ou encore l’établissement de rapports épidémiologiques. Le

Navigation in the electronic health record: A review of the safety and usability literature.

PubMed

Roman, Lisette C; Ancker, Jessica S; Johnson, Stephen B; Senathirajah, Yalini

2017-03-01

Inefficient navigation in electronic health records has been shown to increase users' cognitive load, which may increase potential for errors, reduce efficiency, and increase fatigue. However, navigation has received insufficient recognition and attention in the electronic health record (EHR) literature as an independent construct and contributor to overall usability. Our aims in this literature review were to (1) assess the prevalence of navigation-related topics within the EHR usability and safety research literature, (2) categorize types of navigation actions within the EHR, (3) capture relationships between these navigation actions and usability principles, and (4) collect terms and concepts related to EHR navigation. Our goal was to improve access to navigation-related research in usability. We applied scoping literature review search methods with the assistance of a reference librarian to identify articles published since 1996 that reported evaluation of the usability or safety of an EHR user interface via user test, analytic methods, or inspection methods. The 4336 references collected from MEDLINE, EMBASE, Engineering Village, and expert referrals were de-duplicated and screened for relevance, and navigation-related concepts were abstracted from the 21 articles eligible for review using a standard abstraction form. Of the 21 eligible articles, 20 (95%) mentioned navigation in results and discussion of usability evaluations. Navigation between pages of the EHR was the more frequently documented type of navigation (86%) compared to navigation within a single page (14%). Navigation actions (e.g., scrolling through a medication list) were frequently linked to specific usability heuristic violations, among which flexibility and efficiency of use, recognition rather than recall, and error prevention were most common. Discussion of navigation was prevalent in results across all types of evaluation methods among the articles reviewed. Navigating between multiple screens was frequently identified as a usability barrier. The lack of standard terminology created some challenges to identifying and comparing articles. We observed that usability researchers are frequently capturing navigation-related issues even in articles that did not explicitly state navigation as a focus. Capturing and synthesizing the literature on navigation is challenging because of the lack of uniform vocabulary. Navigation is a potential target for normative recommendations for improved interaction design for safer systems. Future research in this domain, including development of normative recommendations for usability design and evaluation, will be facilitated by development of a standard terminology for describing EHR navigation. Copyright © 2017 Elsevier Inc. All rights reserved.

Optimizing the user interface of a data entry module for an electronic patient record for cardiac rehabilitation: A mixed method usability approach.

PubMed

van Engen-Verheul, Mariëtte M; Peute, Linda W P; de Keizer, Nicolette F; Peek, Niels; Jaspers, Monique W M

2016-03-01

Cumbersome electronic patient record (EPR) interfaces may complicate data-entry in clinical practice. Completeness of data entered in the EPR determines, among other things, the value of computerized clinical decision support (CCDS). Quantitative usability evaluations can provide insight into mismatches between the system design model of data entry and users' data entry behavior, but not into the underlying causes for these mismatches. Mixed method usability evaluation studies may provide these insights, and thus support generating redesign recommendations for improving an EPR system's data entry interface. To improve the usability of the data entry interface of an EPR system with CCDS in the field of cardiac rehabilitation (CR), and additionally, to assess the value of a mixed method usability approach in this context. Seven CR professionals performed a think-aloud usability evaluation both before (beta-version) and after the redesign of the system. Observed usability problems from both evaluations were analyzed and categorized using Zhang et al.'s heuristic principles of good interface design. We combined the think-aloud usability evaluation of the system's beta-version with the measurement of a new usability construct: users' deviations in action sequence from the system's predefined data entry order sequence. Recommendations for redesign were implemented. We assessed whether the redesign improved CR professionals' (1) task efficacy (with respect to the completeness of data they collected), and (2) task efficiency (with respect to the average number of mouse clicks they needed to complete data entry subtasks). With the system's beta version, 40% of health care professionals' navigation actions through the system deviated from the predefined next system action. The causes for these deviations as revealed by the think-aloud method mostly concerned mismatches between the system design model for data entry action sequences and users expectations of these action sequences, based on their paper-based daily routines. This caused non completion of data entry tasks (31% of main tasks completed), and more navigation actions than minimally required (146% of the minimum required). In the redesigned system the data entry navigational structure was organized in a flexible way around an overview screen to better mimic users' paper-based daily routines of collecting patient data. This redesign resulted in an increased number of completed main tasks (70%) and a decrease in navigation actions (133% of the minimum required). The think-aloud usability evaluation of the redesigned system showed that remaining problems concerned flexibility (e.g., lack of customization options) and consistency (mainly with layout and position of items on the screen). The mixed method usability evaluation was supportive in revealing the magnitude and causes of mismatches between the system design model of data-entry with users' data entry behavior. However, as both task efficacy and efficiency were still not optimal with the redesigned EPR, we advise to perform a cognitive analysis on end users' mental processes and behavior patterns in daily work processes specifically during the requirements analysis phase of development of interactive healthcare information systems. Copyright © 2015 Elsevier Ireland Ltd. All rights reserved.

VRUSE--a computerised diagnostic tool: for usability evaluation of virtual/synthetic environment systems.

PubMed

Kalawsky, R S

1999-02-01

A special questionnaire (VRUSE) has been designed to measure the usability of a VR system according to the attitude and perception of its users. Important aspects of VR systems were carefully derived to produce key usability factors for the questionnaire. Unlike questionnaires designed for generic interfaces VRUSE is specifically designed to cater for evaluating virtual environments, being a diagnostic tool providing a wealth of information about a user's viewpoint of the interface. VRUSE can be used to great effect with other evaluation techniques to pinpoint problematical areas of a VR interface. Other applications include bench-marking of competitor VR systems.

Assessing the Potential Use of Eye-Tracking Triangulation for Evaluating the Usability of an Online Diabetes Exercise System.

PubMed

Schaarup, Clara; Hartvigsen, Gunnar; Larsen, Lars Bo; Tan, Zheng-Hua; Årsand, Eirik; Hejlesen, Ole Kristian

2015-01-01

The Online Diabetes Exercise System was developed to motivate people with Type 2 diabetes to do a 25 minutes low-volume high-intensity interval training program. In a previous multi-method evaluation of the system, several usability issues were identified and corrected. Despite the thorough testing, it was unclear whether all usability problems had been identified using the multi-method evaluation. Our hypothesis was that adding the eye-tracking triangulation to the multi-method evaluation would increase the accuracy and completeness when testing the usability of the system. The study design was an Eye-tracking Triangulation; conventional eye-tracking with predefined tasks followed by The Post-Experience Eye-Tracked Protocol (PEEP). Six Areas of Interests were the basis for the PEEP-session. The eye-tracking triangulation gave objective and subjective results, which are believed to be highly relevant for designing, implementing, evaluating and optimizing systems in the field of health informatics. Future work should include testing the method on a larger and more representative group of users and apply the method on different system types.

[NASA/DOD Aerospace Knowledge Diffusion Research Project. Report 1, part 2:] Technical communications in aeronautics: Results of an exploratory study

NASA Technical Reports Server (NTRS)

Pinelli, Thomas E.; Glassman, Myron; Oliu, Walter E.; Barclay, Rebecca O.

1989-01-01

A study was undertaken that explored several aspects of technical communications in aeronautics. The study, which utilized survey research in the form of a self-administered questionnaire, was sent to 2,000 randomly selected members of the American Institute of Aeronautics and Astronautics. Six hundred and six usable questionnaires (30.3 percent) were received by the established cut off date. Part 2 of this study lists appendices to part 1, including survey instrument, aggregate totals, cross tabulations, and open-ended comments.

Preparing a neuropediatric upper limb exergame rehabilitation system for home-use: a feasibility study.

PubMed

Gerber, Corinna N; Kunz, Bettina; van Hedel, Hubertus J A

2016-03-23

Home-based, computer-enhanced therapy of hand and arm function can complement conventional interventions and increase the amount and intensity of training, without interfering too much with family routines. The objective of the present study was to investigate the feasibility and usability of the new portable version of the YouGrabber® system (YouRehab AG, Zurich, Switzerland) in the home setting. Fifteen families of children (7 girls, mean age: 11.3y) with neuromotor disorders and affected upper limbs participated. They received instructions and took the system home to train for 2 weeks. After returning it, they answered questions about usability, motivation, and their general opinion of the system (Visual Analogue Scale; 0 indicating worst score, 100 indicating best score; ≤30 not satisfied, 31-69 average, ≥70 satisfied). Furthermore, total pure playtime and number of training sessions were quantified. To prove the usability of the system, number and sort of support requests were logged. The usability of the system was considered average to satisfying (mean 60.1-93.1). The lowest score was given for the occurrence of technical errors. Parents had to motivate their children to start (mean 66.5) and continue (mean 68.5) with the training. But in general, parents estimated the therapeutic benefit as high (mean 73.1) and the whole system as very good (mean 87.4). Children played on average 7 times during the 2 weeks; total pure playtime was 185 ± 45 min. Especially at the beginning of the trial, systems were very error-prone. Fortunately, we, or the company, solved most problems before the patients took the systems home. Nevertheless, 10 of 15 families contacted us at least once because of technical problems. Despite that the YouGrabber® is a promising and highly accepted training tool for home-use, currently, it is still error-prone, and the requested support exceeds the support that can be provided by clinical therapists. A technically more robust system, combined with additional attractive games, likely results in higher patient motivation and better compliance. This would reduce the need for parents to motivate their children extrinsically and allow for clinical trials to investigate the effectiveness of the system. ClinicalTrials.gov NCT02368223.

Design and evaluation of a telemonitoring concept based on NFC-enabled mobile phones and sensor devices.

PubMed

Morak, Jürgen; Kumpusch, Hannes; Hayn, Dieter; Modre-Osprian, Robert; Schreier, Günter

2012-01-01

Utilization of information and communication technologies such as mobile phones and wireless sensor networks becomes more and more common in the field of telemonitoring for chronic diseases. Providing elderly people with a mobile-phone-based patient terminal requires a barrier-free design of the overall user interface including the setup of wireless communication links to sensor devices. To easily manage the connection between a mobile phone and wireless sensor devices, a concept based on the combination of Bluetooth and near-field communication technology has been developed. It allows us initiating communication between two devices just by bringing them close together for a few seconds without manually configuring the communication link. This concept has been piloted with a sensor device and evaluated in terms of usability and feasibility. Results indicate that this solution has the potential to simplify the handling of wireless sensor networks for people with limited technical skills.

Usability studies on e-learning platforms: Preliminary study in USM

NASA Astrophysics Data System (ADS)

Emang, Devinna Win Anak Boniface; Lukman, Raja Nurul Izzati Raja; Kamarulzaman, Muhammad Izzat Syafiq; Zaaba, Zarul Fitri

2017-10-01

This paper explores the end-users' experienced in regards to the usability issues in E-learning platform. An online survey utilising 116 participants were conducted to investigate the end-users understanding and satisfaction on E-learning platform in the Universiti Sains Malaysia (USM). The results indicates that mainly students still experiencing significant challenges in E-learning platform in regards to accessibility, technical terminologies and functionality. On the other hand, the 10 heuristic guideline is chosen to be a referral point to compare five E-learning platforms in order to assess each performance on regards to the usability criteria. Overall, USM E-learning platform can be considered in a good shape. However, there are more works to be done to improve the delivery system of the E-learning if it would like to sustain for a long period of time. Although the result is at the preliminary stage, it provides useful insights to improve the E-learning platform as one of the most popular education platform in Malaysia.

The use of fault reporting of medical equipment to identify latent design flaws.

PubMed

Flewwelling, C J; Easty, A C; Vicente, K J; Cafazzo, J A

2014-10-01

Poor device design that fails to adequately account for user needs, cognition, and behavior is often responsible for use errors resulting in adverse events. This poor device design is also often latent, and could be responsible for "No Fault Found" (NFF) reporting, in which medical devices sent for repair by clinical users are found to be operating as intended. Unresolved NFF reports may contribute to incident under reporting, clinical user frustration, and biomedical engineering technologist inefficacy. This study uses human factors engineering methods to investigate the relationship between NFF reporting frequency and device usability. An analysis of medical equipment maintenance data was conducted to identify devices with a high NFF reporting frequency. Subsequently, semi-structured interviews and heuristic evaluations were performed in order to identify potential usability issues. Finally, usability testing was conducted in order to validate that latent usability related design faults result in a higher frequency of NFF reporting. The analysis of medical equipment maintenance data identified six devices with a high NFF reporting frequency. Semi-structured interviews, heuristic evaluations and usability testing revealed that usability issues caused a significant portion of the NFF reports. Other factors suspected to contribute to increased NFF reporting include accessory issues, intermittent faults and environmental issues. Usability testing conducted on three of the devices revealed 23 latent usability related design faults. These findings demonstrate that latent usability related design faults manifest themselves as an increase in NFF reporting and that devices containing usability related design faults can be identified through an analysis of medical equipment maintenance data. Copyright © 2014 The Authors. Published by Elsevier Inc. All rights reserved.

Health Information Technology Usability Evaluation Scale (Health-ITUES) for Usability Assessment of Mobile Health Technology: Validation Study.

PubMed

Schnall, Rebecca; Cho, Hwayoung; Liu, Jianfang

2018-01-05

Mobile technology has become a ubiquitous technology and can be particularly useful in the delivery of health interventions. This technology can allow us to deliver interventions to scale, cover broad geographic areas, and deliver technologies in highly tailored ways based on the preferences or characteristics of users. The broad use of mobile technologies supports the need for usability assessments of these tools. Although there have been a number of usability assessment instruments developed, none have been validated for use with mobile technologies. The goal of this work was to validate the Health Information Technology Usability Evaluation Scale (Health-ITUES), a customizable usability assessment instrument in a sample of community-dwelling adults who were testing the use of a new mobile health (mHealth) technology. A sample of 92 community-dwelling adults living with HIV used a new mobile app for symptom self-management and completed the Health-ITUES to assess the usability of the app. They also completed the Post-Study System Usability Questionnaire (PSSUQ), a widely used and well-validated usability assessment tool. Correlations between these scales and each of the subscales were assessed. The subscales of the Health-ITUES showed high internal consistency reliability (Cronbach alpha=.85-.92). Each of the Health-ITUES subscales and the overall scale was moderately to strongly correlated with the PSSUQ scales (r=.46-.70), demonstrating the criterion validity of the Health-ITUES. The Health-ITUES has demonstrated reliability and validity for use in assessing the usability of mHealth technologies in community-dwelling adults living with a chronic illness. ©Rebecca Schnall, Hwayoung Cho, Jianfang Liu. Originally published in JMIR Mhealth and Uhealth (http://mhealth.jmir.org), 05.01.2018.

Health Information Technology Usability Evaluation Scale (Health-ITUES) for Usability Assessment of Mobile Health Technology: Validation Study

PubMed Central

Cho, Hwayoung; Liu, Jianfang

2018-01-01

Background Mobile technology has become a ubiquitous technology and can be particularly useful in the delivery of health interventions. This technology can allow us to deliver interventions to scale, cover broad geographic areas, and deliver technologies in highly tailored ways based on the preferences or characteristics of users. The broad use of mobile technologies supports the need for usability assessments of these tools. Although there have been a number of usability assessment instruments developed, none have been validated for use with mobile technologies. Objective The goal of this work was to validate the Health Information Technology Usability Evaluation Scale (Health-ITUES), a customizable usability assessment instrument in a sample of community-dwelling adults who were testing the use of a new mobile health (mHealth) technology. Methods A sample of 92 community-dwelling adults living with HIV used a new mobile app for symptom self-management and completed the Health-ITUES to assess the usability of the app. They also completed the Post-Study System Usability Questionnaire (PSSUQ), a widely used and well-validated usability assessment tool. Correlations between these scales and each of the subscales were assessed. Results The subscales of the Health-ITUES showed high internal consistency reliability (Cronbach alpha=.85-.92). Each of the Health-ITUES subscales and the overall scale was moderately to strongly correlated with the PSSUQ scales (r=.46-.70), demonstrating the criterion validity of the Health-ITUES. Conclusions The Health-ITUES has demonstrated reliability and validity for use in assessing the usability of mHealth technologies in community-dwelling adults living with a chronic illness. PMID:29305343

The University in the Networked Economy and Society: Challenges and Opportunities

ERIC Educational Resources Information Center

Benkler, Yochai

2008-01-01

The networked information economy and society present a new social, technical, and economic environment within which the university functions. To understand the new challenges and opportunities this environment presents, a usable characterization of the core new characteristics of both the environment and the university as a system and how those…

77 FR 64920 - Revisions to Reliability Standard for Transmission Vegetation Management

Federal Register 2010, 2011, 2012, 2013, 2014

2012-10-24

... applications or print-to-PDF format and not a scanned format. Mail/Hand Delivery: Those unable to file... application of the Gallet equation and the assumptions used in the technical reference paper [Exh. A of NERC's... evidence that statistics relating to tower design are usable with vegetation.\\66\\ Instead, the PNNL Report...

A Framework for Mapping User-Designed Forms to Relational Databases

ERIC Educational Resources Information Center

Khare, Ritu

2011-01-01

In the quest for database usability, several applications enable users to design custom forms using a graphical interface, and forward engineer the forms into new databases. The path-breaking aspect of such applications is that users are completely shielded from the technicalities of database creation. Despite this innovation, the process of…

High Technology Technical Training Needs Assessment. Final Report 1983-84.

ERIC Educational Resources Information Center

Middlesex County Coll., Edison, NJ.

A project sought to produce adequate data on high technology training needs in New Jersey's Middlesex County College's service area. Of 168 individuals at high technology companies who were sent surveys, 52 returned usable surveys. Respondents supplied information on the impact of high technology on the company over the next five years, the…

A Project-Based Learning Setting to Human-Computer Interaction for Teenagers

ERIC Educational Resources Information Center

Geyer, Cornelia; Geisler, Stefan

2012-01-01

Knowledge of fundamentals of human-computer interaction resp. usability engineering is getting more and more important in technical domains. However this interdisciplinary field of work and corresponding degree programs are not broadly known. Therefore at the Hochschule Ruhr West, University of Applied Sciences, a program was developed to give…

Web usability evaluation with screen reader users: implementation of the partial concurrent thinking aloud technique.

PubMed

Federici, Stefano; Stefano, Federici; Borsci, Simone; Stamerra, Gianluca

2010-08-01

A verbal protocol technique, adopted for a web usability evaluation, requires that the users are able to perform a double task: surfing and talking. Nevertheless, when blind users surf by using a screen reader and talk about the way they interact with the computer, the evaluation is influenced by a structural interference: users are forced to think aloud and listen to the screen reader at the same time. The aim of this study is to build up a verbal protocol technique for samples of visual impaired users in order to overcome the limits of concurrent and retrospective protocols. The technique we improved, called partial concurrent thinking aloud (PCTA), integrates a modified set of concurrent verbalization and retrospective analysis. One group of 6 blind users and another group of 6 sighted users evaluated the usability of a website using PCTA. By estimating the number of necessary users by the means of an asymptotic test, it was found out that the two groups had an equivalent ability of identifying usability problems, both over 80%. The result suggests that PCTA, while respecting the properties of classic verbal protocols, also allows to overcome the structural interference and the limits of concurrent and retrospective protocols when used with screen reader users. In this way, PCTA reduces the efficiency difference of usability evaluation between blind and sighted users.

Usability testing of a prototype multi-user telehealth kiosk.

PubMed

Courtney, Karen L; Matthews, Judith T; McMillan, Julie M; Person Mecca, Laurel; Smailagic, Asim; Siewiorek, Daniel

2015-01-01

The overall purpose of this study was to learn how community-dwelling older adults would interact with our prototype multi-user telehealth kiosk and their views about its usability. Seven subjects participated in laboratory-based usability sessions to evaluate the physical design, appearance, functionality and perceived ease of use of a multi-user telehealth kiosk prototype. During usability testing participants recommended 18 new features (29% of comments), identified 15 software errors (23% of comments) and 29 user interface errors (47% of comments).

Improving the Quality and Effectiveness of Computer-Mediated Instruction Through Usability Evaluations

ERIC Educational Resources Information Center

Crowther, Michael S.; Keller, Chris C.; Waddoups, Gregory L.

2004-01-01

Brigham Young University's Center for Instructional Design (CID) creates online courses and multimedia instructional applications for university faculty. This paper asserts that including usability testing as a part of evaluation improves the quality and effectiveness of computer-mediated instruction. The paper describes the fundamental purpose…

Evaluating the usability of 19 effluents for heterotrophic cultivation of microalgal consortia as biodiesel feedstock

USDA-ARS?s Scientific Manuscript database

A key reason inhibiting commercialization of algal oil as biodiesel feedstock is cultivation cost. For this reason, the usability of 19 readily available industrial effluents (autoclaved and non-autoclaved) to support heterotrophic growth and lipid accumulation was evaluated using six mixed algal cu...

User-Centered Design and Usability Testing of a Web Site: An Illustrative Case Study.

ERIC Educational Resources Information Center

Corry, Michael D.; Frick, Theodore W.; Hansen, Lisa

1997-01-01

Presents an overview of user-centered design and usability testing. Describes a Web site evaluation project at a university, the iterative process of rapid prototyping and usability testing, and how the findings helped to improve the design. Discusses recommendations for university Web site design and reflects on problems faced in usability…

Developing an Android-Based Patient Decision Aid Based on Ottawa Standards for Patients After Kidney Transplant and Its Usability Evaluation.

PubMed

Zare Moayedi, Mahboobeh; Aslani, Azam; Fakhrahmad, Mostafa; Ezzatzadegan J, Shahrokh

2018-01-01

This study was conducted to develop an android based patient decision aid (PDA) as a self-care instrument for patients after kidney transplant and its usability evaluation. In this study, the systematic development process of Android-based self-care application for patients after kidney transplant based on Ottawa standard was included: scoping, assemble steering group, analysis of requirements, designing, develop of a prototype and system evaluation. The PDA is a self-triage system that will help early identification of risk symptoms in patients, and help manage them. System recommendations for risk signs are: Refer to the nearest hospital or healthcare center without delay, refer to the doctor and tell your doctor in the next visit. To identify patient care needs, a semi-structured interview with members of steering group, including patients and clinical experts, was conducted by the researchers. A prototype of the decision aid was made according to identified needs in the previous step. Finally, in order to evaluate its usability rate by using the System Usability Scale (SUS) questionnaire, it was used by exerts and patients. This study identified information needs, risk signs and steps that patients need to make appropriate decisions about them. The main capabilities of the decision aid are features such as reminders for appointment/test, time of taking medication, registration of symptoms, weight, blood pressure, body temperature, advising to patient in case of signs of risk, weight, blood pressure, body temperature and test results which were reported in the diagram. The mean score of system's usability evaluated by medical informatics specialists, clinicians, and patients were 88.33, 95, and 91. PDAs was usable and desirable from the point of view of medical informatics specialists, clinicians and patients.

Evaluating the Functionality and Usability of Two Novel Wheelchair Anti-Rollback Devices for Ramp Ascent in Manual Wheelchair Users With Spinal Cord Injury.

PubMed

Deems-Dluhy, Susan L; Jayaraman, Chandrasekaran; Green, Steve; Albert, Mark V; Jayaraman, Arun

2017-05-01

Difficulty ascending ramps and inclines with a manual wheelchair adversely affects the everyday mobility and overall quality of life of manual wheelchair users. Currently, various anti-rollback devices are available to assist manual wheelchair users to ascend ramps and inclines. However, these devices have 2 main shortcomings: restriction to backward motion limiting recovery from an overturning wheelchair, which is a safety concern; and difficulty in engaging/disengaging the device while on the ramp. To evaluate the functionality and usability of 2 novel wheelchair anti-rollback devices developed to address these shortcomings (prototypes "Wheel" and "Brake"). Cross-sectional. Rehabilitation research facility. Twelve adult participants with chronic spinal cord injury. Participants completed training and tested with both the wheelchair anti-rollback devices on a 7.3-m-long ramp. Number of stops, perceived physical exertion, pain, and ease of use of these devices as participants maneuvered their wheelchairs up a 7.3-m ramp were assessed. Participants also evaluated their satisfaction with the usability of both the devices using the Quebec User Evaluation of Satisfaction With Assistive Technology (QUEST 2.0). Both prototypes evaluated overcame the limitations of the existing anti-rollback devices. Nonparametric statistical tests showed that participants rated both prototypes similarly for the overall functional and usability aspects. However, the participants' satisfactory rating were higher for the prototype "Brake" than for the prototype "Wheel" based on a functional aspect (ie, engaging/disengaging easiness), and higher for Wheel than for Brake, based on a usability aspect (prototype size). The qualitative and quantitative outcomes of this investigation, based on the usability and functional evaluations, provided useful information for the improvement in the design of both anti-rollback devices, which may allow manual wheelchair users to manage ramp ascent more safely and easily. Further evaluations with a different SCI population is recommended. IV. Copyright © 2017 American Academy of Physical Medicine and Rehabilitation. Published by Elsevier Inc. All rights reserved.

VA FitHeart, a Mobile App for Cardiac Rehabilitation: Usability Study

PubMed Central

Magnusson, Sara L; Fortney, John C; Sayre, George G; Whooley, Mary A

2018-01-01

Background Cardiac rehabilitation (CR) improves outcomes for patients with ischemic heart disease or heart failure but is underused. New strategies to improve access to and engagement in CR are needed. There is considerable interest in technology-facilitated home CR. However, little is known about patient acceptance and use of mobile technology for CR. Objective The aim of this study was to develop a mobile app for technology-facilitated home CR and seek to determine its usability. Methods We recruited patients eligible for CR who had access to a mobile phone, tablet, or computer with Internet access. The mobile app includes physical activity goal setting, logs for tracking physical activity and health metrics (eg, weight, blood pressure, and mood), health education, reminders, and feedback. Study staff demonstrated the mobile app to participants in person and then observed participants completing prespecified tasks with the mobile app. Participants completed the System Usability Scale (SUS, 0-100), rated likelihood to use the mobile app (0-100), questionnaires on mobile app use, and participated in a semistructured interview. The Unified Theory of Acceptance and Use of Technology and the Theory of Planned Behavior informed the analysis. On the basis of participant feedback, we made iterative revisions to the mobile app between users. Results We conducted usability testing in 13 participants. The first version of the mobile app was used by the first 5 participants, and revised versions were used by the final 8 participants. From the first version to revised versions, task completion success rate improved from 44% (11/25 tasks) to 78% (31/40 tasks; P=.05), SUS improved from 54 to 76 (P=.04; scale 0-100, with 100 being the best usability), and self-reported likelihood of use remained high at 76 and 87 (P=.30; scale 0-100, with 100 being the highest likelihood). In interviews, patients expressed interest in tracking health measures (“I think it’ll be good to track my exercise and to see what I’m doing”), a desire for introductory training (“Initially, training with a technical person, instead of me relying on myself”), and an expectation for sharing data with providers (“It would also be helpful to share with my doctor, it just being a matter of clicking a button and sharing it with my doctor”). Conclusions With participant feedback and iterative revisions, we significantly improved the usability of a mobile app for CR. Patient expectations for using a mobile app for CR include tracking health metrics, introductory training, and sharing data with providers. Iterative mixed-method evaluation may be useful for improving the usability of health technology. PMID:29335235

VA FitHeart, a Mobile App for Cardiac Rehabilitation: Usability Study.

PubMed

Beatty, Alexis L; Magnusson, Sara L; Fortney, John C; Sayre, George G; Whooley, Mary A

2018-01-15

Cardiac rehabilitation (CR) improves outcomes for patients with ischemic heart disease or heart failure but is underused. New strategies to improve access to and engagement in CR are needed. There is considerable interest in technology-facilitated home CR. However, little is known about patient acceptance and use of mobile technology for CR. The aim of this study was to develop a mobile app for technology-facilitated home CR and seek to determine its usability. We recruited patients eligible for CR who had access to a mobile phone, tablet, or computer with Internet access. The mobile app includes physical activity goal setting, logs for tracking physical activity and health metrics (eg, weight, blood pressure, and mood), health education, reminders, and feedback. Study staff demonstrated the mobile app to participants in person and then observed participants completing prespecified tasks with the mobile app. Participants completed the System Usability Scale (SUS, 0-100), rated likelihood to use the mobile app (0-100), questionnaires on mobile app use, and participated in a semistructured interview. The Unified Theory of Acceptance and Use of Technology and the Theory of Planned Behavior informed the analysis. On the basis of participant feedback, we made iterative revisions to the mobile app between users. We conducted usability testing in 13 participants. The first version of the mobile app was used by the first 5 participants, and revised versions were used by the final 8 participants. From the first version to revised versions, task completion success rate improved from 44% (11/25 tasks) to 78% (31/40 tasks; P=.05), SUS improved from 54 to 76 (P=.04; scale 0-100, with 100 being the best usability), and self-reported likelihood of use remained high at 76 and 87 (P=.30; scale 0-100, with 100 being the highest likelihood). In interviews, patients expressed interest in tracking health measures ("I think it'll be good to track my exercise and to see what I'm doing"), a desire for introductory training ("Initially, training with a technical person, instead of me relying on myself"), and an expectation for sharing data with providers ("It would also be helpful to share with my doctor, it just being a matter of clicking a button and sharing it with my doctor"). With participant feedback and iterative revisions, we significantly improved the usability of a mobile app for CR. Patient expectations for using a mobile app for CR include tracking health metrics, introductory training, and sharing data with providers. Iterative mixed-method evaluation may be useful for improving the usability of health technology. ©Alexis L Beatty, Sara L Magnusson, John C Fortney, George G Sayre, Mary A Whooley. Originally published in JMIR Human Factors (http://humanfactors.jmir.org), 15.01.2018.

Accessibility and usability of parks and playgrounds.

PubMed

Perry, Meredith A; Devan, Hemakumar; Fitzgerald, Harry; Han, Karen; Liu, Li-Ting; Rouse, Jack

2018-04-01

Public parks and playgrounds are an environment for leisure activity, which all generations can enjoy at low or no financial cost. Evaluating the accessibility and usability of parks and playgrounds is crucial because their design, environment (natural and built) and safety could restrict participation of persons with disabilities. To evaluate the accessibility and usability of 21 public parks and playgrounds in three metropolitan cities of New Zealand. Secondary aims were to compare the accessibility and usability by park type (destination or neighborhood) and deprivation level (high and low). Twenty-one parks were evaluated. A stratified random sampling was used to select 18 parks (six from each city). Three additional parks were purposely selected (one from each city) at the request of each respective city council. The parks and playgrounds were evaluated using a customized tool. Data were analyzed using descriptive statistics. None of the parks we evaluated met the national standards and/or international guidelines for park and playground design. We identified potential accessibility and usability issues with car parking spaces, path surfaces and play equipment as well as lack of lighting and fencing. The presence of amenities (e.g. toilets and drinking fountains) was more common in destination parks. Fewer parks in areas of higher deprivation had accessible car parking spaces and main paths wider than 1.5 m. Our evaluation identified potential design, environmental and safety barriers to park and playground based participation for persons with disabilities across the lifespan. A larger, more comprehensive evaluation of parks and playgrounds is required. Copyright © 2017 Elsevier Inc. All rights reserved.

Usability: Human Research Program - Space Human Factors and Habitability

NASA Technical Reports Server (NTRS)

Sandor, Aniko; Holden, Kritina L.

2009-01-01

The Usability project addresses the need for research in the area of metrics and methodologies used in hardware and software usability testing in order to define quantifiable and verifiable usability requirements. A usability test is a human-in-the-loop evaluation where a participant works through a realistic set of representative tasks using the hardware/software under investigation. The purpose of this research is to define metrics and methodologies for measuring and verifying usability in the aerospace domain in accordance with FY09 focus on errors, consistency, and mobility/maneuverability. Usability metrics must be predictive of success with the interfaces, must be easy to obtain and/or calculate, and must meet the intent of current Human Systems Integration Requirements (HSIR). Methodologies must work within the constraints of the aerospace domain, be cost and time efficient, and be able to be applied without extensive specialized training.

Usability of clinical decision support system as a facilitator for learning the assistive technology adaptation process.

PubMed

Danial-Saad, Alexandra; Kuflik, Tsvi; Weiss, Patrice L Tamar; Schreuer, Naomi

2016-01-01

The aim of this study was to evaluate the usability of Ontology Supported Computerized Assistive Technology Recommender (OSCAR), a Clinical Decision Support System (CDSS) for the assistive technology adaptation process, its impact on learning the matching process, and to determine the relationship between its usability and learnability. Two groups of expert and novice clinicians (total, n = 26) took part in this study. Each group filled out system usability scale (SUS) to evaluate OSCAR's usability. The novice group completed a learning questionnaire to assess OSCAR's effect on their ability to learn the matching process. Both groups rated OSCAR's usability as "very good", (M [SUS] = 80.7, SD = 11.6, median = 83.7) by the novices, and (M [SUS] = 81.2, SD = 6.8, median = 81.2) by the experts. The Mann-Whitney results indicated that no significant differences were found between the expert and novice groups in terms of OSCAR's usability. A significant positive correlation existed between the usability of OSCAR and the ability to learn the adaptation process (rs = 0.46, p = 0.04). Usability is an important factor in the acceptance of a system. The successful application of user-centered design principles during the development of OSCAR may serve as a case study that models the significant elements to be considered, theoretically and practically in developing other systems. Implications for Rehabilitation Creating a CDSS with a focus on its usability is an important factor for its acceptance by its users. Successful usability outcomes can impact the learning process of the subject matter in general, and the AT prescription process in particular. The successful application of User-Centered Design principles during the development of OSCAR may serve as a case study that models the significant elements to be considered, theoretically and practically. The study emphasizes the importance of close collaboration between the developers and the end users.

Empirical studies on usability of mHealth apps: a systematic literature review.

PubMed

Zapata, Belén Cruz; Fernández-Alemán, José Luis; Idri, Ali; Toval, Ambrosio

2015-02-01

The release of smartphones and tablets, which offer more advanced communication and computing capabilities, has led to the strong emergence of mHealth on the market. mHealth systems are being used to improve patients' lives and their health, in addition to facilitating communication between doctors and patients. Researchers are now proposing mHealth applications for many health conditions such as dementia, autism, dysarthria, Parkinson's disease, and so on. Usability becomes a key factor in the adoption of these applications, which are often used by people who have problems when using mobile devices and who have a limited experience of technology. The aim of this paper is to investigate the empirical usability evaluation processes described in a total of 22 selected studies related to mHealth applications by means of a Systematic Literature Review. Our results show that the empirical evaluation methods employed as regards usability could be improved by the adoption of automated mechanisms. The evaluation processes should also be revised to combine more than one method. This paper will help researchers and developers to create more usable applications. Our study demonstrates the importance of adapting health applications to users' need.

36 CFR 1193.23 - Product design, development, and evaluation.

Code of Federal Regulations, 2014 CFR

2014-07-01

..., usability, and compatibility of telecommunications equipment and customer premises equipment and shall... as possible. Manufacturers shall identify barriers to accessibility and usability as part of such a...

Usability Study of a Wireless Monitoring System among Alzheimer's Disease Elderly Population

PubMed Central

Avvenuti, Marco

2014-01-01

Healthcare technologies are slowly entering into our daily lives, replacing old devices and techniques with newer intelligent ones. Although they are meant to help people, the reaction and willingness to use such new devices by the people can be unexpected, especially among the elderly. We conducted a usability study of a fall monitoring system in a long-term nursing home. The subjects were the elderly with advanced Alzheimer's disease. The study presented here highlights some of the challenges faced in the use of wearable devices and the lessons learned. The results gave us useful insights, leading to ergonomics and aesthetics modifications to our wearable systems that significantly improved their usability and acceptance. New evaluating metrics were designed for the performance evaluation of usability and acceptability. PMID:24963289

Usability evaluation of mobile applications; where do we stand?

NASA Astrophysics Data System (ADS)

Zahra, Fatima; Hussain, Azham; Mohd, Haslina

2017-10-01

The range and availability of mobile applications is expanding rapidly. With the increased processing power available on portable devices, developers are increasing the range of services by embracing smartphones in their extensive and diverse practices. While usability testing and evaluations of mobile applications have not yet touched the accuracy level of other web based applications. The existing usability models do not adequately capture the complexities of interacting with applications on a mobile platform. Therefore, this study aims to presents review on existing usability models for mobile applications. These models are in their infancy but with time and more research they may eventually be adopted. Moreover, different categories of mobile apps (medical, entertainment, education) possess different functional and non-functional requirements thus customized models are required for diverse mobile applications.

Usability study of a novel, self-lighted, disposable speculum: military applications.

PubMed

Jones, Christina L; Gruber, Daniel D; Warner, William; Buller, Jerome L

2013-04-01

Data collected from a postutilization questionnaire were used to evaluate the usability of the OfficeSPEC disposable vaginal speculum, specifically the effectiveness, efficiency, and acceptability, in clinical, hospital, and austere environments. Usability data analysis showed the OfficeSPEC speculum had an effectiveness rating of 4.6/5, efficiency rating of 4.5/5, and acceptability rating of 4.6/5; overall usability in deployed environments was favorable. The overall rankings were 3.4 for plastic, 4.2 for metal (p < 0.001), and 4.5 for OfficeSPEC (p < 0.001). Cost analysis of the OfficeSPEC placed the disposable speculum as a reasonable alternative with yearly cost of $129,200, compared to traditional metal ($209,100) and plastic ($319,175). By evaluating the OfficeSPEC speculum within a usability framework, it proved to be practical, viable alternative in all environments, particularly in the forward deployed environment. Reprint & Copyright © 2013 Association of Military Surgeons of the U.S.

Usability Testing of Two Ambulatory EHR Navigators.

PubMed

Hultman, Gretchen; Marquard, Jenna; Arsoniadis, Elliot; Mink, Pamela; Rizvi, Rubina; Ramer, Tim; Khairat, Saif; Fickau, Keri; Melton, Genevieve B

2016-01-01

Despite widespread electronic health record (EHR) adoption, poor EHR system usability continues to be a significant barrier to effective system use for end users. One key to addressing usability problems is to employ user testing and user-centered design. To understand if redesigning an EHR-based navigation tool with clinician input improved user performance and satisfaction. A usability evaluation was conducted to compare two versions of a redesigned ambulatory navigator. Participants completed tasks for five patient cases using the navigators, while employing a think-aloud protocol. The tasks were based on Meaningful Use (MU) requirements. The version of navigator did not affect perceived workload, and time to complete tasks was longer in the redesigned navigator. A relatively small portion of navigator content was used to complete the MU-related tasks, though navigation patterns were highly variable across participants for both navigators. Preferences for EHR navigation structures appeared to be individualized. This study demonstrates the importance of EHR usability assessments to evaluate group and individual performance of different interfaces and preferences for each design.

Enabling Data Discovery and Reuse by Improving Software Usability:Data Science Experiences, Lessons, and Gaps

NASA Astrophysics Data System (ADS)

Rosati, A.; Yarmey, L.

2014-12-01

It is well understood that a good data scientist needs domain science, analysis, programming, and communication skills to create finished data products, visualizations, and reports. Articles and blogs tout the need for "expert" skill levels in domain knowledge, statistics, storytelling, graphic design, technology…and the list goes on. Since it seems impossible that one person would encompass all these skills, it is often suggested that data science be done by a team instead of an individual. This research into, and experience with, data product design offers an augmented definition - one that elevates relationships and engagement with the final user of a product. Essentially, no matter how fantastic or technically advanced a product appears, the intended audience of that product must be able to understand, use, and find value in the product in order for it to be considered a success. Usability is often misunderstood and seen as common sense or common knowledge, but it is actually an important and challenging piece of product development. This paper describes the National Snow and Ice Data Center's process to usability test the Arctic Data Explorer (ADE). The ADE is a federated data search tool for interdisciplinary Arctic science data that has been improved in features, appearance, functionality, and quality through a series of strategic and targeted usability testing and assessments. Based on the results, it is recommended that usability testing be incorporated into the skill set of each data science team.

Treatment of Infantile Hemangioma in Regional Hospitals With eHealth Support: Evaluation of Feasibility and Acceptance by Parents and Doctors

PubMed Central

van Os-Medendorp, Harmieke; van Renselaar, Wilco; Breugem, Corstiaan C; Pasmans, Suzanne GMA

2014-01-01

Background Since beta blockers became the preferred treatment for infantile hemangiomas (IH), the number of patients eligible for treatment is increasing. Currently treatment of IH with beta blockers is mainly reserved for expert centers, where wait times are lengthening. This demonstrated the need for development of a more efficient and accessible way of providing care for children needing treatment for IH. An eHealth intervention, Hemangioma Treatment Plan (HTP), was developed to treat IH in regional hospitals with online support from an academic doctor. Objective Our goal was to evaluate the feasibility of the eHealth intervention by determining its use, acceptance, and usability. By evaluating the feasibility, usage can be predicted and points for improvement can be defined, thereby facilitating implementation of the intervention. Methods Parents of children with an IH, presenting between October 2012 and November 2013 at the tertiary expert Center for Congenital Vascular Anomalies Utrecht, requiring treatment with a beta blocker, were asked to participate in the digital HTP. Both parents and regional doctors were sent a study questionnaire. Acceptance and usability of the HTP were evaluated by using the modified Technology Acceptance Model. Results A total of 31 parents and 22 regional doctors participated in the eHealth intervention and received the questionnaire, and 25 parents and 15 doctors responded (response rates respectively 81% and 68%). A majority of the parents (96%, 24/25) and the regional doctors (87%, 13/15) considered the eHealth intervention useful in the care for IH. Most parents (76%, 19/25) and over half of the regional doctors (53%, 8/15) found the HTP easy to use. Technical problems using the HTP were reported by 28% (7/25) of the parents and 73% (11/15) of the doctors. The majority of parents (92%, 23/25) felt positive about usage of the HTP during treatment of their child. All regional doctors (100%, 15/15) felt positive about transition of treatment from the tertiary expert center to them, and 93% (14/15) felt positive about using the HTP. Conclusions Our eHealth intervention shows good feasibility, especially among parents. Improvement with respect to technical problems, training of regional doctors, and achieving organizational support might be needed for successful implementation in the future. PMID:25367558

Employment of telemedicine in emergency medicine. Clinical requirement analysis, system development and first test results.

PubMed

Czaplik, M; Bergrath, S; Rossaint, R; Thelen, S; Brodziak, T; Valentin, B; Hirsch, F; Beckers, S K; Brokmann, J C

2014-01-01

Demographic change, rising co-morbidity and an increasing number of emergencies are the main challenges that emergency medical services (EMS) in several countries worldwide are facing. In order to improve quality in EMS, highly trained personnel and well-equipped ambulances are essential. However several studies have shown a deficiency in qualified EMS physicians. Telemedicine emerges as a complementary system in EMS that may provide expertise and improve quality of medical treatment on the scene. Hence our aim is to develop and test a specific teleconsultation system. During the development process several use cases were defined and technically specified by medical experts and engineers in the areas of: system administration, start-up of EMS assistance systems, audio communication, data transfer, routine tele-EMS physician activities and research capabilities. Upon completion, technical field tests were performed under realistic conditions to test system properties such as robustness, feasibility and usability, providing end-to-end measurements. Six ambulances were equipped with telemedical facilities based on the results of the requirement analysis and 55 scenarios were tested under realistic conditions in one month. The results indicate that the developed system performed well in terms of usability and robustness. The major challenges were, as expected, mobile communication and data network availability. Third generation networks were only available in 76.4% of the cases. Although 3G (third generation), such as Universal Mobile Telecommunications System (UMTS), provides beneficial conditions for higher bandwidth, system performance for most features was also acceptable under adequate 2G (second generation) test conditions. An innovative concept for the use of telemedicine for medical consultations in EMS was developed. Organisational and technical aspects were considered and practical requirements specified. Since technical feasibility was demonstrated in these technical field tests, the next step would be to prove medical usefulness and technical robustness under real conditions in a clinical trial.

Human Factors in the Large: Experiences from Denmark, Finland and Canada in Moving Towards Regional and National Evaluations of Health Information System Usability. Contribution of the IMIA Human Factors Working Group.

PubMed

Kushniruk, A; Kaipio, J; Nieminen, M; Hyppönen, H; Lääveri, T; Nohr, C; Kanstrup, A M; Berg Christiansen, M; Kuo, M-H; Borycki, E

2014-08-15

The objective of this paper is to explore approaches to understanding the usability of health information systems at regional and national levels. Several different methods are discussed in case studies from Denmark, Finland and Canada. They range from small scale qualitative studies involving usability testing of systems to larger scale national level questionnaire studies aimed at assessing the use and usability of health information systems by entire groups of health professionals. It was found that regional and national usability studies can complement smaller scale usability studies, and that they are needed in order to understand larger trends regarding system usability. Despite adoption of EHRs, many health professionals rate the usability of the systems as low. A range of usability issues have been noted when data is collected on a large scale through use of widely distributed questionnaires and websites designed to monitor user perceptions of usability. As health information systems are deployed on a widespread basis, studies that examine systems used regionally or nationally are required. In addition, collection of large scale data on the usability of specific IT products is needed in order to complement smaller scale studies of specific systems.

Human Factors in the Large: Experiences from Denmark, Finland and Canada in Moving Towards Regional and National Evaluations of Health Information System Usability

PubMed Central

Kaipio, J.; Nieminen, M.; Hyppönen, H.; Lääveri, T.; Nohr, C.; Kanstrup, A. M.; Berg Christiansen, M.; Kuo, M.-H.; Borycki, E.

2014-01-01

Summary Objectives The objective of this paper is to explore approaches to understanding the usability of health information systems at regional and national levels. Methods Several different methods are discussed in case studies from Denmark, Finland and Canada. They range from small scale qualitative studies involving usability testing of systems to larger scale national level questionnaire studies aimed at assessing the use and usability of health information systems by entire groups of health professionals. Results It was found that regional and national usability studies can complement smaller scale usability studies, and that they are needed in order to understand larger trends regarding system usability. Despite adoption of EHRs, many health professionals rate the usability of the systems as low. A range of usability issues have been noted when data is collected on a large scale through use of widely distributed questionnaires and websites designed to monitor user perceptions of usability. Conclusion As health information systems are deployed on a widespread basis, studies that examine systems used regionally or nationally are required. In addition, collection of large scale data on the usability of specific IT products is needed in order to complement smaller scale studies of specific systems. PMID:25123725

36 CFR § 1193.23 - Product design, development, and evaluation.

Code of Federal Regulations, 2013 CFR

2013-07-01

..., usability, and compatibility of telecommunications equipment and customer premises equipment and shall... as possible. Manufacturers shall identify barriers to accessibility and usability as part of such a...

Integrated Model for E-Learning Acceptance

NASA Astrophysics Data System (ADS)

Ramadiani; Rodziah, A.; Hasan, S. M.; Rusli, A.; Noraini, C.

2016-01-01

E-learning is not going to work if the system is not used in accordance with user needs. User Interface is very important to encourage using the application. Many theories had discuss about user interface usability evaluation and technology acceptance separately, actually why we do not make it correlation between interface usability evaluation and user acceptance to enhance e-learning process. Therefore, the evaluation model for e-learning interface acceptance is considered important to investigate. The aim of this study is to propose the integrated e-learning user interface acceptance evaluation model. This model was combined some theories of e-learning interface measurement such as, user learning style, usability evaluation, and the user benefit. We formulated in constructive questionnaires which were shared at 125 English Language School (ELS) students. This research statistics used Structural Equation Model using LISREL v8.80 and MANOVA analysis.

Developing and Validation a Usability Evaluation Tools for Distance Education Websites: Persian Version

ERIC Educational Resources Information Center

Hafezi, Soheila; Farahi, Ahmad; Mehri, Soheil Najafi; Mahmoodi, Hosein

2010-01-01

The web is playing a central role in distance education. The word "usability" is usually synonymous with functionality of the system for the user. Also, usability of a website is defined as something that can be used by a specific group of people to carry out specific objectives in an effective way, with efficiency and satisfaction.…

Product design enhancement using apparent usability and affective quality.

PubMed

Seva, Rosemary R; Gosiaco, Katherine Grace T; Santos, Ma Crea Eurice D; Pangilinan, Denise Mae L

2011-03-01

In this study, apparent usability and affective quality were integrated in a design framework called the Usability Perception and Emotion Enhancement Model (UPEEM). The UPEEM was validated using structural equation modeling (SEM). The methodology consists of four phases namely product selection, attribute identification, design alternative generation, and design alternative evaluation. The first stage involved the selection of a product that highly involves the consumer. In the attribute identification stage, design elements of the product were identified. The possible values of these elements were also determined for use in the experimentation process. Design of experiments was used to identify how the attributes will be varied in the design alternative stage and which of the attributes significantly contribute to affective quality, apparent usability, and desirability in the design evaluation stage. Results suggest that product attributes related to form are relevant in eliciting intense affect and perception of usability in mobile phones especially those directly related to functionality and aesthetics. This study considered only four product attributes among so many due to the constraints of the research design employed. Attributes related to aesthetic perception of a product enhance apparent usability such as those related to dimensional ratios. Copyright © 2010 Elsevier Ltd and The Ergonomics Society. All rights reserved.

Usability Evaluation of a Research Repository and Collaboration Web Site

ERIC Educational Resources Information Center

Zhang, Tao; Maron, Deborah J.; Charles, Christopher C.

2013-01-01

This article reports results from an empirical usability evaluation of Human-Animal Bond Research Initiative Central as part of the effort to develop an open access research repository and collaboration platform for human-animal bond researchers. By repurposing and altering key features of the original HUBzero system, Human-Animal Bond Research…

Genomic imputation and evaluation using high density Holstein genotypes

USDA-ARS?s Scientific Manuscript database

Genomic evaluations for 161,341 Holsteins were computed using 311,725 of the 777,962 markers on the Illumina high-density (HD) chip. Initial edits with 1,741 HD genotypes from 5 breeds revealed that 636,967 markers were usable but that half were redundant. Usable Holstein genotypes included 1,510 an...

Usability Level of Distance Education Website (Sakarya University Sample)

ERIC Educational Resources Information Center

Isman, Aytekin; Isbulan, Onur

2010-01-01

The main goal of this research is to determine the usability of Sakarya University Adapazari Vocational Two-Year Community College's Web Site. A scale was developed to the evaluation and applied to 1512 students. From the applied questionnaire only appropriate ones were selected to be evaluated and 1229 questionnaires were analysed. Finally,…

Development of Usability Criteria for E-Learning Content Development Software

ERIC Educational Resources Information Center

Celik, Serkan

2012-01-01

Revolutionary advancements have been observed in e-learning technologies though an amalgamated evaluation methodology for new generation e-learning content development tools is not available. The evaluation of educational software for online use must consider its usability and as well as its pedagogic effectiveness. This study is a first step…

Establishing usability heuristics for heuristics evaluation in a specific domain: Is there a consensus?

PubMed

Hermawati, Setia; Lawson, Glyn

2016-09-01

Heuristics evaluation is frequently employed to evaluate usability. While general heuristics are suitable to evaluate most user interfaces, there is still a need to establish heuristics for specific domains to ensure that their specific usability issues are identified. This paper presents a comprehensive review of 70 studies related to usability heuristics for specific domains. The aim of this paper is to review the processes that were applied to establish heuristics in specific domains and identify gaps in order to provide recommendations for future research and area of improvements. The most urgent issue found is the deficiency of validation effort following heuristics proposition and the lack of robustness and rigour of validation method adopted. Whether domain specific heuristics perform better or worse than general ones is inconclusive due to lack of validation quality and clarity on how to assess the effectiveness of heuristics for specific domains. The lack of validation quality also affects effort in improving existing heuristics for specific domain as their weaknesses are not addressed. Copyright © 2016 Elsevier Ltd. All rights reserved.

Pilot Test of a New Personal Health System Integrating Environmental and Wearable Sensors for Telemonitoring and Care of Elderly People at Home (SMARTA Project).

PubMed

Pigini, Lucia; Bovi, Gabriele; Panzarino, Claudia; Gower, Valerio; Ferratini, Maurizio; Andreoni, Giuseppe; Sassi, Roberto; Rivolta, Massimo W; Ferrarin, Maurizio

2017-01-01

The increase in life expectancy is accompanied by a growing number of elderly subjects affected by chronic comorbidities, a health issue which also implies important socioeconomic consequences. Shifting from hospital or community dwelling care towards a home personalized healthcare paradigm would promote active aging with a better quality of life, along with a reduction in healthcare-related costs. The aim of the SMARTA project was to develop and test an innovative personal health system integrating standard sensors as well as innovative wearable and environmental sensors to allow home telemonitoring of vital parameters and detection of anomalies in daily activities, thus supporting active aging through remote healthcare. A first phase of the project consisted in the definition of the health and environmental parameters to be monitored (electrocardiography and actigraphy, blood pressure and oxygen saturation, weight, ear temperature, glycemia, home interaction monitoring - water tap, refrigerator, and dishwasher), the feedbacks for the clinicians, and the reminders for the patients. It was followed by a technical feasibility analysis leading to an iterative process of prototype development, sensor integration, and testing. Once the prototype had reached an advanced stage of development, a group of 32 volunteers - including 15 healthy adult subjects, 13 elderly people with cardiac diseases, and 4 clinical operators - was recruited to test the system in a real home setting, in order to evaluate both technical reliability and user perception of the system in terms of effectiveness, usability, acceptance, and attractiveness. The testing in a real home setting showed a good perception of the SMARTA system and its functionalities both by the patients and by the clinicians, who appreciated the user interface and the clinical governance system. The moderate system reliability of 65-70% evidenced some technical issues, mainly related to sensor integration, while the patient's user interface showed excellent reliability (100%). Both elderly people and clinical operators considered the SMARTA system a promising and attractive tool for improving patients' healthcare while reducing related costs and preserving quality of life. However, the moderate reliability of the system should prompt further technical developments in terms of sensor integration and usability of the clinical operator's user interface. © 2017 S. Karger AG, Basel.

[NASA/DOD Aerospace Knowledge Diffusion Research Project. Report 1, part 1:] Technical communications in aeronautics: Results of an exploratory study

NASA Technical Reports Server (NTRS)

Pinelli, Thomas E.; Glassman, Myron; Oliu, Walter E.; Barclay, Rebecca O.

1989-01-01

A study was undertaken that explored several aspects of technical communications in aeronautics. The study, which utilized survey research in the form of a self-administered questionnaire, was sent to 2,000 randomly selected members of the American Institute of Aeronautics and Astronautics. Six hundred and six usable questionnaires (30.3 percent) were received by the established cut off date. The study had five objectives. The first was to solicit the opinions of aeronautical engineers and scientists regarding the importance of technical communications to their profession; second, to determine their use and production of technical communications; third, to seek their views on the content of an undergraduate course in technical communications; fourth, to determine their use of libraries/technical information centers; and finally, to determine the use and importance of computer and information technology to them. The findings add considerable information to the knowledge of technical communications practices among aeronautical engineers and scientists and reinforce some of the conventional wisdom about technical communications and question other widely-held notions.

Learning Through TAFE for Voluntary and Paid Work: A Survey of TAFE Students. Working Paper.

ERIC Educational Resources Information Center

Smith, Chris Selby; Hopkins, Sonnie

Students in two Australian Technical and Further Education (TAFE) institutes were surveyed (862 usable responses from 1,700 metropolitan students, 297 from 1,008 regional students). Focus group discussions were held with three metro and five regional students. A higher proportion of regional than metro students were volunteers or wanted to…

Risk terminology primer: Basic principles and a glossary for the wildland fire management community

Treesearch

Matthew P. Thompson; Tom Zimmerman; Dan Mindar; Mary Taber

2016-01-01

Risk management is being increasingly promoted as an appropriate method for addressing wildland fire management challenges. However, a lack of a common understanding of risk concepts and terminology is hindering effective application. In response, this General Technical Report provides a set of clear, consistent, understandable, and usable definitions for terms...

A Non-Technical Approach for Illustrating Item Response Theory

ERIC Educational Resources Information Center

Yu, Chong Ho; Jannasch-Pennell, Angel; DiGangi, Samuel

2008-01-01

Since the introduction of the "No Child Left Behind Act," assessment has become a pre-dominant theme in the US K-12 system. However, making assessment results understandable and usable for the K-12 teachers has been a challenge. While test technology offered by various vendors has been widely implemented, technology of training for test…

CMU/IBM Usability Study: Final Report. CDC Technical Report No. 11.

ERIC Educational Resources Information Center

Ballay, Joseph M.; And Others

This report focuses on the activities and findings of the fourth phase of research carried out at Carnegie-Mellon University (CMU) on the development of user documentation for computer-aided design (CAD) systems. The first of four major sections provides an overview of recent research, issues involved in the research, and implications of the…

Science of Security Lablet - Scalability and Usability

DTIC Science & Technology

2014-12-16

mobile computing [19]. However, the high-level infrastructure design and our own implementation (both described throughout this paper) can easily...critical and infrastructural systems demands high levels of sophistication in the technical aspects of cybersecurity, software and hardware design...Forget, S. Komanduri, Alessandro Acquisti, Nicolas Christin, Lorrie Cranor, Rahul Telang. "Security Behavior Observatory: Infrastructure for Long-term

Didactic and Technical Considerations When Developing e-Learning and CME

ERIC Educational Resources Information Center

te Pas, Ellen; Wieringa-de Waard, Margreet; Blok, Bernadette Snijders; Pouw, Henny; van Dijk, Nynke

2016-01-01

Several usability issues were encountered during the design of a blended e-learning program for a course in evidence-based medicine for general practice trainers. The program was developed in four steps. We focused in this article on step 2 and 3. Step 2 focused on which educational principles to apply, that is, which learning theories,…

Practical considerations in the development of hemoglobin-based oxygen therapeutics.

PubMed

Kim, Hae Won; Estep, Timothy N

2012-09-01

The development of hemoglobin based oxygen therapeutics (HBOCs) requires consideration of a number of factors. While the enabling technology derives from fundamental research on protein biochemistry and biological interactions, translation of these research insights into usable medical therapeutics demands the application of considerable technical expertise and consideration and reconciliation of a myriad of manufacturing, medical, and regulatory requirements. The HBOC development challenge is further exacerbated by the extremely high intravenous doses required for many of the indications contemplated for these products, which in turn implies an extremely high level of purity is required. This communication discusses several of the important product configuration and developmental considerations that impact the translation of fundamental research discoveries on HBOCs into usable medical therapeutics.

Usability of Security Management:Defining the Permissions of Guests

NASA Astrophysics Data System (ADS)

Johnson, Matthew; Stajano, Frank

Within the scenario of a Smart Home, we discuss the issues involved in allowing limited interaction with the environment for unidentified principals, or guests. The challenges include identifying and authenticating guests on one hand and delegating authorization to them on the other. While the technical mechanisms for doing so in generic distributed systems have been around for decades, existing solutions are in general not applicable to the smart home because they are too complex to manage. We focus on providing both security and usability; we therefore seek simple and easy to understand approaches that can be used by a normal computer-illiterate home owner, not just by a trained system administrator. This position paper describes ongoing research and does not claim to have all the answers.

Making intelligent systems team players: Overview for designers

NASA Technical Reports Server (NTRS)

Malin, Jane T.; Schreckenghost, Debra L.

1992-01-01

This report is a guide and companion to the NASA Technical Memorandum 104738, 'Making Intelligent Systems Team Players,' Volumes 1 and 2. The first two volumes of this Technical Memorandum provide comprehensive guidance to designers of intelligent systems for real-time fault management of space systems, with the objective of achieving more effective human interaction. This report provides an analysis of the material discussed in the Technical Memorandum. It clarifies what it means for an intelligent system to be a team player, and how such systems are designed. It identifies significant intelligent system design problems and their impacts on reliability and usability. Where common design practice is not effective in solving these problems, we make recommendations for these situations. In this report, we summarize the main points in the Technical Memorandum and identify where to look for further information.

An evaluation method of computer usability based on human-to-computer information transmission model.

PubMed

Ogawa, K

1992-01-01

This paper proposes a new evaluation and prediction method for computer usability. This method is based on our two previously proposed information transmission measures created from a human-to-computer information transmission model. The model has three information transmission levels: the device, software, and task content levels. Two measures, called the device independent information measure (DI) and the computer independent information measure (CI), defined on the software and task content levels respectively, are given as the amount of information transmitted. Two information transmission rates are defined as DI/T and CI/T, where T is the task completion time: the device independent information transmission rate (RDI), and the computer independent information transmission rate (RCI). The method utilizes the RDI and RCI rates to evaluate relatively the usability of software and device operations on different computer systems. Experiments using three different systems, in this case a graphical information input task, confirm that the method offers an efficient way of determining computer usability.

Using Heuristic Evaluation to Improve Sepsis Alert Usability.

PubMed

Pertiwi, Ariani Arista Putri; Fraczkowski, Dan; Stogis, Sheryl L; Lopez, Karen Dunn

2018-06-01

Sepsis, life-threatening organ dysfunction in response to infection, is an alarmingly common and aggressive illness in US hospitals, especially for intensive care patients. Preventing sepsis deaths rests on the clinicians' ability to promptly recognize and treat sepsis. To aid early recognition, many organizations have employed clinician-facing electronic sepsis alert systems. However, the effectiveness of the alert relies on heavily on the visual interface, textual information, and overall usability. This article reports a usability inspection of a sepsis alert system. The authors found violations in 12 of the 14 usability principles and promote use of this method in practice to systematically identify usability problems. Copyright © 2018 Elsevier Inc. All rights reserved.

Pre-post evaluation of physicians' satisfaction with a redesigned electronic medical record system.

PubMed

Jaspers, Monique W M; Peute, Linda W P; Lauteslager, Arnaud; Bakker, Piet J M

2008-01-01

Physicians' acceptance of Electronic Medical Record Systems (EMRs) is closely related to their usability. Knowledge about end-users' opinions on usability of an EMR system may contribute to planning for the next phase of the usability cycle of the system. A demand for integration of new functionalities, such as computerized order entry and an electronic patient status led to redesign of our EMR system, which had been in use for over 8 years at the Academic Medical Center of Amsterdam. The aim of this study was to understand whether the redesigned EMR system was an improvement of the earlier EMR and which system aspects accounted for user satisfaction and which did not. We conducted a formative pre- and post usability evaluation of our former and redesigned EMR system. For the assessment of both system versions' usability, we distributed two standardized usability questionnaires among 150 clinicians who routinely had used the older EMR system and had been working with its newer version for 6 weeks. Though overall user satisfaction was relatively high for both EMR systems, screen layout and interaction structure proved less easy to work with in the newer EMR system. The new EMR system however was more appreciated because of its enhanced functionality, capabilities and likeable user-interface. The results point to a number of actions that might be useful in future usability improvement efforts of our EMR system and other EMRs.

Development and usability of a computer-tailored pedometer-based physical activity advice for breast cancer survivors.

PubMed

De Cocker, K; Charlier, C; Van Hoof, E; Pauwels, E; Lechner, L; Bourgois, J; Spittaels, H; Vandelanotte, C; De Bourdeaudhuij, I

2015-09-01

This observational study aimed to adapt a computer-tailored step advice for the general population into a feasible advice for breast cancer survivors and to test its usability. First, several adaptations were made to the original design (adding cancer-related physical activity (PA) barriers and beliefs, and self-management strategies to improve survivors' personal control). Second, the adapted advice was evaluated in two phases: (1) a usability testing in healthy women (n = 3) and survivors (n = 6); and (2) a process evaluation during 3 weeks in breast cancer survivors (n = 8). Preliminary usability testing revealed no problems during logging-in; however, three survivors misinterpreted some questions. After refining the questionnaire and advice, survivors evaluated the advice as interesting, attractive to read, comprehensible and credible. Inactive survivors found the advice novel, but too long. The process evaluation indicated that the majority of the women (n = 5/8) reported increased steps. Monitoring step counts by using a pedometer was perceived as an important motivator to be more active. To conclude, this study provides initial support for the usability and acceptability of a computer-tailored pedometer-based PA advice for breast cancer survivors. After testing efficacy and effectiveness of this intervention, this tool can broaden the reach of PA promotion in breast cancer survivors. © 2014 John Wiley & Sons Ltd.

A systematic review of hybrid brain-computer interfaces: Taxonomy and usability perspectives

PubMed Central

Lee, Yushin; Yun, Myung Hwan

2017-01-01

A new Brain-Computer Interface (BCI) technique, which is called a hybrid BCI, has recently been proposed to address the limitations of conventional single BCI system. Although some hybrid BCI studies have shown promising results, the field of hybrid BCI is still in its infancy and there is much to be done. Especially, since the hybrid BCI systems are so complicated and complex, it is difficult to understand the constituent and role of a hybrid BCI system at a glance. Also, the complicated and complex systems make it difficult to evaluate the usability of the systems. We systematically reviewed and analyzed the current state-of-the-art hybrid BCI studies, and proposed a systematic taxonomy for classifying the types of hybrid BCIs with multiple taxonomic criteria. After reviewing 74 journal articles, hybrid BCIs could be categorized with respect to 1) the source of brain signals, 2) the characteristics of the brain signal, and 3) the characteristics of operation in each system. In addition, we exhaustively reviewed recent literature on usability of BCIs. To identify the key evaluation dimensions of usability, we focused on task and measurement characteristics of BCI usability. We classified and summarized 31 BCI usability journal articles according to task characteristics (type and description of task) and measurement characteristics (subjective and objective measures). Afterwards, we proposed usability dimensions for BCI and hybrid BCI systems according to three core-constructs: Satisfaction, effectiveness, and efficiency with recommendations for further research. This paper can help BCI researchers, even those who are new to the field, can easily understand the complex structure of the hybrid systems at a glance. Recommendations for future research can also be helpful in establishing research directions and gaining insight in how to solve ergonomics and HCI design issues surrounding BCI and hybrid BCI systems by usability evaluation. PMID:28453547

A systematic review of hybrid brain-computer interfaces: Taxonomy and usability perspectives.

PubMed

Choi, Inchul; Rhiu, Ilsun; Lee, Yushin; Yun, Myung Hwan; Nam, Chang S

2017-01-01

A new Brain-Computer Interface (BCI) technique, which is called a hybrid BCI, has recently been proposed to address the limitations of conventional single BCI system. Although some hybrid BCI studies have shown promising results, the field of hybrid BCI is still in its infancy and there is much to be done. Especially, since the hybrid BCI systems are so complicated and complex, it is difficult to understand the constituent and role of a hybrid BCI system at a glance. Also, the complicated and complex systems make it difficult to evaluate the usability of the systems. We systematically reviewed and analyzed the current state-of-the-art hybrid BCI studies, and proposed a systematic taxonomy for classifying the types of hybrid BCIs with multiple taxonomic criteria. After reviewing 74 journal articles, hybrid BCIs could be categorized with respect to 1) the source of brain signals, 2) the characteristics of the brain signal, and 3) the characteristics of operation in each system. In addition, we exhaustively reviewed recent literature on usability of BCIs. To identify the key evaluation dimensions of usability, we focused on task and measurement characteristics of BCI usability. We classified and summarized 31 BCI usability journal articles according to task characteristics (type and description of task) and measurement characteristics (subjective and objective measures). Afterwards, we proposed usability dimensions for BCI and hybrid BCI systems according to three core-constructs: Satisfaction, effectiveness, and efficiency with recommendations for further research. This paper can help BCI researchers, even those who are new to the field, can easily understand the complex structure of the hybrid systems at a glance. Recommendations for future research can also be helpful in establishing research directions and gaining insight in how to solve ergonomics and HCI design issues surrounding BCI and hybrid BCI systems by usability evaluation.

Assessing the Usability of University Websites: An Empirical Study on Namik Kemal University

ERIC Educational Resources Information Center

Mentes, S. Ahmet; Turan, Aykut H.

2012-01-01

Web sites are emerging as a key component of an organization's survival in our ever globalizing competitive world. Usability of a web site has assumed a great deal of importance in terms of satisfying web site users' needs and expectations. The aim of the study is to evaluate and to explore the usability level of Namik Kemal University (NKU)…

Development of the Telehealth Usability Questionnaire (TUQ).

PubMed

Parmanto, Bambang; Lewis, Allen Nelson; Graham, Kristin M; Bertolet, Marnie H

2016-01-01

Current telehealth usability questionnaires are designed primarily for older technologies, where telehealth interaction is conducted over dedicated videoconferencing applications. However, telehealth services are increasingly conducted over computer-based systems that rely on commercial software and a user supplied computer interface. Therefore, a usability questionnaire that addresses the changes in telehealth service delivery and technology is needed. The Telehealth Usability Questionnaire (TUQ) was developed to evaluate the usability of telehealth implementation and services. This paper addresses: (1) the need for a new measure of telehealth usability, (2) the development of the TUQ, (3) intended uses for the TUQ, and (4) the reliability of the TUQ. Analyses indicate that the TUQ is a solid, robust, and versatile measure that can be used to measure the quality of the computer-based user interface and the quality of the telehealth interaction and services.

An Evaluation of Learning Objects in Singapore Primary Education: A Case Study Approach

ERIC Educational Resources Information Center

Grace, Tay Pei Lyn; Suan, Ng Peck; Wanzhen, Liaw

2008-01-01

Purpose: The purpose of this paper is to evaluate the usability and interface design of e-learning portal developed for primary schools in Singapore. Design/methodology/approach: Using Singapore-based learning EDvantage (LEAD) portal as a case study, this paper reviews and analyses the usability and usefulness of embedded learning objects (LOs)…

Web Accessibility and Usability of the Homepages from Academy of Human Resource Development Members' Institutions

ERIC Educational Resources Information Center

Zeng, Xiaoming; Sligar, Steven R.

2008-01-01

Human resource development programs in various institutions communicate with their constituencies including persons with disabilities through websites. Web sites need to be accessible for legal, economic and ethical reasons. We used an automated web usability evaluation tool, aDesigner, to evaluate 205 home pages from the organizations of AHRD…

A Concise and Practical Framework for the Development and Usability Evaluation of Patient Information Websites.

PubMed

Peute, L W; Knijnenburg, S L; Kremer, L C; Jaspers, M W M

2015-01-01

The Website Developmental Model for the Healthcare Consumer (WDMHC) is an extensive and successfully evaluated framework that incorporates user-centered design principles. However, due to its extensiveness its application is limited. In the current study we apply a subset of the WDMHC framework in a case study concerning the development and evaluation of a website aimed at childhood cancer survivors (CCS). To assess whether the implementation of a limited subset of the WDMHC-framework is sufficient to deliver a high-quality website with few usability problems, aimed at a specific patient population. The website was developed using a six-step approach divided into three phases derived from the WDMHC: 1) information needs analysis, mock-up creation and focus group discussion; 2) website prototype development; and 3) heuristic evaluation (HE) and think aloud analysis (TA). The HE was performed by three double experts (knowledgeable both in usability engineering and childhood cancer survivorship), who assessed the site using the Nielsen heuristics. Eight end-users were invited to complete three scenarios covering all functionality of the website by TA. The HE and TA were performed concurrently on the website prototype. The HE resulted in 29 unique usability issues; the end-users performing the TA encountered eleven unique problems. Four issues specifically revealed by HE concerned cosmetic design flaws, whereas two problems revealed by TA were related to website content. Based on the subset of the WDMHC framework we were able to deliver a website that closely matched the expectancy of the end-users and resulted in relatively few usability problems during end-user testing. With the successful application of this subset of the WDMHC, we provide developers with a clear and easily applicable framework for the development of healthcare websites with high usability aimed at specific medical populations.

Interface design recommendations for computerised clinical audit and feedback: Hybrid usability evidence from a research-led system.

PubMed

Brown, Benjamin; Balatsoukas, Panos; Williams, Richard; Sperrin, Matthew; Buchan, Iain

2016-10-01

Audit and Feedback (A&F) is a widely used quality improvement technique that measures clinicians' clinical performance and reports it back to them. Computerised A&F (e-A&F) system interfaces may consist of four key components: (1) Summaries of clinical performance; (2) Patient lists; (3) Patient-level data; (4) Recommended actions. There is a lack of evidence regarding how to best design e-A&F interfaces; establishing such evidence is key to maximising usability, and in turn improving patient safety. To evaluate the usability of a novel theoretically-informed and research-led e-A&F system for primary care (the Performance Improvement plaN GeneratoR: PINGR). (1) Describe PINGR's design, rationale and theoretical basis; (2) Identify usability issues with PINGR; (3) Understand how these issues may interfere with the cognitive goals of end-users; (4) Translate the issues into recommendations for the user-centred design of e-A&F systems. Eight experienced health system evaluators performed a usability inspection using an innovative hybrid approach consisting of five stages: (1) Development of representative user tasks, Goals, and Actions; (2) Combining Heuristic Evaluation and Cognitive Walkthrough methods into a single protocol to identify usability issues; (3) Consolidation of issues; (4) Severity rating of consolidated issues; (5) Analysis of issues according to usability heuristics, interface components, and Goal-Action structure. A final list of 47 issues were categorised into 8 heuristic themes. The most error-prone heuristics were 'Consistency and standards' (13 usability issues; 28% of the total) and 'Match between system and real world' (n=10, 21%). The recommended actions component of the PINGR interface had the most usability issues (n=21, 45%), followed by patient-level data (n=5, 11%), patient lists (n=4, 9%), and summaries of clinical performance (n=4, 9%). The most error-prone Actions across all user Goals were: (1) Patient selection from a list; (2) Data identification from a figure (both population-level and patient-level); (3) Disagreement with a system recommendation. By contextualising our findings within the wider literature on health information system usability, we provide recommendations for the design of e-A&F system interfaces relating to their four key components, in addition to how they may be integrated within a system. Copyright © 2016. Published by Elsevier Ireland Ltd.

Development and user evaluation of a virtual rehabilitation system for wobble board balance training.

PubMed

Fitzgerald, Diarmaid; Trakarnratanakul, Nanthana; Dunne, Lucy; Smyth, Barry; Caulfield, Brian

2008-01-01

We have developed a prototype virtual reality-based balance training system using a single inertial orientation sensor attached to the upper surface of a wobble board. This input device has been interfaced with Neverball, an open source computer game to create the balance training platform. Users can exercise with the system by standing on the wobble board and tilting it in different directions to control an on-screen environment. We have also developed a customized instruction manual to use when setting up the system. To evaluate the usability our prototype system we undertook a user evaluation study with twelve healthy novice participants. Participants were required to assemble the system using an instruction manual and then perform balance exercises with the system. Following this period of exercise VRUSE, a usability evaluation questionnaire, was completed by participants. Results indicated a high level of usability in all categories evaluated.

Evaluating the usability of a commercial cooling vest in the Hong Kong industries.

PubMed

Chan, Albert P; Yang, Yang; Song, Wen-Fang

2018-03-01

The provision of appropriate personal cooling vests is recognized as an effective measure to combat heat stress. However, personal cooling vests are not widely implemented in the Hong Kong industries. The current study aims to evaluate the usability of a hybrid cooling vest that is associated with the success of its application in industrial settings. A self-administrated questionnaire focusing on 10 subjective attributes of cooling effect, ergonomic design and usability of a hybrid cooling vest was administered with 232 occupational workers in the construction, horticultural and cleaning, airport apron services and kitchen and catering industries. A structural equation model estimated by analysis of moment structures was constructed to evaluate the usability of the cooling vest, as influenced by cooling effect and ergonomic design. Results showed that cooling effect (path coefficient = 0.69, p < 0.001) and ergonomic design (path coefficient = 0.55, p < 0.001) significantly affect the usability of the cooling vest. The structural equation model is feasible to examine the complex nature of the structural relationships among the subjective perceptions of personal cooling vests. The empirical findings furnish sound evidence for further optimization of the hybrid cooling vest in terms of cooling effect and ergonomic design for occupational workers.

Current State of Agile User-Centered Design: A Survey

NASA Astrophysics Data System (ADS)

Hussain, Zahid; Slany, Wolfgang; Holzinger, Andreas

Agile software development methods are quite popular nowadays and are being adopted at an increasing rate in the industry every year. However, these methods are still lacking usability awareness in their development lifecycle, and the integration of usability/User-Centered Design (UCD) into agile methods is not adequately addressed. This paper presents the preliminary results of a recently conducted online survey regarding the current state of the integration of agile methods and usability/UCD. A world wide response of 92 practitioners was received. The results show that the majority of practitioners perceive that the integration of agile methods with usability/UCD has added value to their adopted processes and to their teams; has resulted in the improvement of usability and quality of the product developed; and has increased the satisfaction of the end-users of the product developed. The top most used HCI techniques are low-fidelity prototyping, conceptual designs, observational studies of users, usability expert evaluations, field studies, personas, rapid iterative testing, and laboratory usability testing.

A Comparison of What Is Part of Usability Testing in Three Countries

NASA Astrophysics Data System (ADS)

Clemmensen, Torkil

The cultural diversity of users of technology challenges our methods for usability evaluation. In this paper we report and compare three ethnographic interview studies of what is a part of a standard (typical) usability test in a company in Mumbai, Beijing and Copenhagen. At each of these three locations, we use structural and contrast questions do a taxonomic and paradigm analysis of a how a company performs a usability test. We find similar parts across the three locations. We also find different results for each location. In Mumbai, most parts of the usability test are not related to the interactive application that is tested, but to differences in user characteristics, test preparation, method, and location. In Copenhagen, considerations about the client's needs are part of a usability test. In Beijing, the only varying factor is the communication pattern and relation to the user. These results are then contrasted in a cross cultural matrix to identify cultural themes that can help interpret results from existing laboratory research in usability test methods.

Usability flaws of medication-related alerting functions: A systematic qualitative review.

PubMed

Marcilly, Romaric; Ammenwerth, Elske; Vasseur, Francis; Roehrer, Erin; Beuscart-Zéphir, Marie-Catherine

2015-06-01

Medication-related alerting functions may include usability flaws that limit their optimal use. A first step on the way to preventing usability flaws is to understand the characteristics of these usability flaws. This systematic qualitative review aims to analyze the type of usability flaws found in medication-related alerting functions. Papers were searched via PubMed, Scopus and Ergonomics Abstracts databases, along with references lists. Paper selection, data extraction and data analysis was performed by two to three Human Factors experts. Meaningful semantic units representing instances of usability flaws were the main data extracted. They were analyzed through qualitative methods: categorization following general usability heuristics and through an inductive process for the flaws specific to medication-related alerting functions. From the 6380 papers initially identified, 26 met all eligibility criteria. The analysis of the papers identified a total of 168 instances of usability flaws that could be classified into 13 categories of usability flaws representing either violations of general usability principles (i.e. they could be found in any system, e.g. guidance and workload issues) or infractions specific to medication-related alerting functions. The latter refer to issues of low signal-to-noise ratio, incomplete content of alerts, transparency, presentation mode and timing, missing alert features, tasks and control distribution. The list of 168 instances of usability flaws of medication-related alerting functions provides a source of knowledge for checking the usability of medication-related alerting functions during their design and evaluation process and ultimately constructs evidence-based usability design principles for these functions. Copyright © 2015 Elsevier Inc. All rights reserved.

A user experience evaluation of Amazon Kindle mobile application

NASA Astrophysics Data System (ADS)

Hussain, Azham; Mkpojiogu, Emmanuel O. C.; Musa, Ja'afaru; Mortada, Salah

2017-10-01

There is a dramatic increase in the development of mobile applications in recent years. This makes the usability evaluation of these mobile applications an important aspect in the advancement and application of technology. In this paper, a laboratory-based usability evaluation was carried out on the Amazon Kindle app using 15 users who performed 5 tasks on the Kindle e-book mobile app. A post-test questionnaire was administered to elicit users' perception on the usability of the application. The results demonstrate that almost all the participants were satisfied with services provided by the Amazon Kindle e-book mobile app. On all the four user experience factors examined, namely, perceived ease-of-use, perceived visibility, perceived enjoyabilty, and perceived efficiency, the evaluation outcome shows that the participants had a good and rich mobile experience with the application.

A Web-Based Treatment Decision Support Tool for Patients With Advanced Knee Arthritis: Evaluation of User Interface and Content Design

PubMed Central

Zheng, Hua; Rosal, Milagros C; Li, Wenjun; Borg, Amy; Yang, Wenyun; Ayers, David C

2018-01-01

Background Data-driven surgical decisions will ensure proper use and timing of surgical care. We developed a Web-based patient-centered treatment decision and assessment tool to guide treatment decisions among patients with advanced knee osteoarthritis who are considering total knee replacement surgery. Objective The aim of this study was to examine user experience and acceptance of the Web-based treatment decision support tool among older adults. Methods User-centered formative and summative evaluations were conducted for the tool. A sample of 28 patients who were considering total knee replacement participated in the study. Participants’ responses to the user interface design, the clarity of information, as well as usefulness, satisfaction, and acceptance of the tool were collected through qualitative (ie, individual patient interviews) and quantitative (ie, standardized Computer System Usability Questionnaire) methods. Results Participants were older adults with a mean age of 63 (SD 11) years. Three-quarters of them had no technical questions using the tool. User interface design recommendations included larger fonts, bigger buttons, less colors, simpler navigation without extra “next page” click, less mouse movement, and clearer illustrations with simple graphs. Color-coded bar charts and outcome-specific graphs with positive action were easiest for them to understand the outcomes data. Questionnaire data revealed high satisfaction with the tool usefulness and interface quality, and also showed ease of use of the tool, regardless of age or educational status. Conclusions We evaluated the usability of a patient-centered decision support tool designed for advanced knee arthritis patients to facilitate their knee osteoarthritis treatment decision making. The lessons learned can inform other decision support tools to improve interface and content design for older patients’ use. PMID:29712620

Human Factors for Nursing: From In-Situ Testing to Mobile Usability Engineering.

PubMed

Kushniruk, Andre W; Borycki, Elizabeth M; Solvoll, Terje; Hullin, Carola

2016-01-01

The tutorial goal is to familiarize participants with human aspects of health informatics and human-centered approaches to the design, evaluation and deployment of both usable and safe healthcare information systems. The focus will be on demonstrating and teaching practical and low-cost methods for evaluating mobile applications in nursing. Basic background to testing methods will be provided, followed by live demonstration of the methods. Then the audience will break into small groups to explore the application of the methods to applications of interest (there will be a number of possible applications that will be available for applications in areas such as electronic health records and decision support, however, if the groups have applications of specific interest to them that will be possible). The challenges of conducting usability testing, and in particular mobile usability testing will be discussed along with practical solutions. The target audience includes practicing nurses and nurse researchers, nursing informatics specialists, nursing students, nursing managers and health informatics professionals interested in improving the usability and safety of healthcare applications.

Usability Evaluation of NLP-PIER: A Clinical Document Search Engine for Researchers.

PubMed

Hultman, Gretchen; McEwan, Reed; Pakhomov, Serguei; Lindemann, Elizabeth; Skube, Steven; Melton, Genevieve B

2017-01-01

NLP-PIER (Natural Language Processing - Patient Information Extraction for Research) is a self-service platform with a search engine for clinical researchers to perform natural language processing (NLP) queries using clinical notes. We conducted user-centered testing of NLP-PIER's usability to inform future design decisions. Quantitative and qualitative data were analyzed. Our findings will be used to improve the usability of NLP-PIER.

User ratings of prosthetic usability and satisfaction in VA study to optimize DEKA arm.

PubMed

Resnik, Linda; Borgia, Matthew

2014-01-01

The Department of Veterans Affairs study to optimize the DEKA Arm provided feedback to inform optimization of the gen 2 (second-generation) prototype and evaluate the gen 3 (third-generation) prototype. This article summarizes recommendations to improve gen 2 and reports satisfaction and usability ratings of gen 2 and gen 3. Data were collected from 39 subjects; 37 subjects were included in this analysis. Of the subjects, 24 were fit with gen 2 (8 radial configuration [RC], 6 humeral configuration [HC], and 10 shoulder configuration [SC]), 13 were fit with gen 3 (4 RC, 5 HC, and 4 SC), and 5 were fit with both. Usability and satisfaction were evaluated using the Trinity Amputation and Prosthesis Experience Scale (TAPES) and study-specific usability and satisfaction scales. Descriptive statistics were examined and prototypes compared using Wilcoxon rank-sum. Results were stratified by configuration level and outcomes compared by prototype. Satisfaction and usability were greater for gen 3 than gen 2. Overall TAPES scores were similar; however, scores of the TAPES aesthetic satisfaction subscale were higher for gen 3. Compared with gen 2 users, gen 3 users were more satisfied with appearance, grips, and doffing and rated overall usability higher. Features of gen 3, including weight, external cables and wires, hand covering, and fingernails, would benefit from further optimization.

Scientific and Technical Cooperation With Developing Countries, 1977-78. Higher Education Panel Reports, Number 40.

ERIC Educational Resources Information Center

Atelsek, Frank J.; Gomberg, Irene L.

A survey was conducted on nonimmigrant students from developing countries who were enrolled in postsecondary education in the United States during the 1977-78 academic year and on U.S. faculty who taught in the less developed regions or who collaborated in research or consulted with faculty from these regions. Usable questionnaire data were…

Usability of Low-Cost Android Data Collection System for Community-Based Participatory Research.

PubMed

Salihu, Hamisu M; Salinas-Miranda, Abraham; Turner, DeAnne; King, Lindsey; Paothong, Arnut; Austin, Deborah; Berry, Estrellita Lo

2016-01-01

Android tablet computers can be valuable tools for data collection, but their usability has not been evaluated in community-based participatory research (CBPR). This article examines the usability of a low-cost bilingual touchscreen computerized survey system using Android tablets, piloted with a sample of 201 community residents in Tampa, Florida, from November 2013 to March 2014. Needs assessment questions were designed with the droidSURVEY software, and deployed using Android tablet computers. In addition, participants were asked questions about system usability. The mean system usability was 77.57 ± 17.66 (range, 0-100). The mean completion time for taking the 63 survey questions in the needs assessment was 23.11 ± 9.62 minutes. The survey completion rate was optimal (100%), with only 6.34% missingness per variable. We found no sociodemographic differences in usability scores. Our findings indicate that Android tablets could serve as useful tools in CBPR studies.

Usability engineering: domain analysis activities for augmented-reality systems

NASA Astrophysics Data System (ADS)

Gabbard, Joseph; Swan, J. E., II; Hix, Deborah; Lanzagorta, Marco O.; Livingston, Mark; Brown, Dennis B.; Julier, Simon J.

2002-05-01

This paper discusses our usability engineering process for the Battlefield Augmented Reality System (BARS). Usability engineering is a structured, iterative, stepwise development process. Like the related disciplines of software and systems engineering, usability engineering is a combination of management principals and techniques, formal and semi- formal evaluation techniques, and computerized tools. BARS is an outdoor augmented reality system that displays heads- up battlefield intelligence information to a dismounted warrior. The paper discusses our general usability engineering process. We originally developed the process in the context of virtual reality applications, but in this work we are adapting the procedures to an augmented reality system. The focus of this paper is our work on domain analysis, the first activity of the usability engineering process. We describe our plans for and our progress to date on our domain analysis for BARS. We give results in terms of a specific urban battlefield use case we have designed.

Older Adults' Acceptance of Activity Trackers

PubMed Central

Preusse, Kimberly C.; Mitzner, Tracy L.; Fausset, Cara Bailey; Rogers, Wendy A.

2016-01-01

Objective To assess the usability and acceptance of activity tracking technologies by older adults. Method First in our multi-method approach, we conducted heuristic evaluations of two activity trackers that revealed potential usability barriers to acceptance. Next, questionnaires and interviews were administered to 16 older adults (Mage=70, SDage=3.09, rangeage= 65-75) before and after a 28-day field study to understand facilitators and additional barriers to acceptance. These measurements were supplemented with diary and usage data and assessed if and why users overcame usability issues. Results The heuristic evaluation revealed usability barriers in System Status Visibility; Error Prevention; and Consistency and Standards. The field study revealed additional barriers (e.g., accuracy, format), and acceptance-facilitators (e.g., goal-tracking, usefulness, encouragement). Discussion The acceptance of wellness management technologies, such as activity trackers, may be increased by addressing acceptance-barriers during deployment (e.g., providing tutorials on features that were challenging, communicating usefulness). PMID:26753803

Lessons learned from the usability assessment of home-based telemedicine systems.

PubMed

Agnisarman, Sruthy Orozhiyathumana; Chalil Madathil, Kapil; Smith, Kevin; Ashok, Aparna; Welch, Brandon; McElligott, James T

2017-01-01

At-home telemedicine visits are quickly becoming an acceptable alternative for in-person patient visits. However, little work has been done to understand the usability of these home-based telemedicine solutions. It is critical for user acceptance and real-world applicability to evaluate available telemedicine solutions within the context-specific needs of the users of this technology. To address this need, this study evaluated the usability of four home-based telemedicine software platforms: Doxy.me, Vidyo, VSee, and Polycom. Using a within-subjects experimental design, twenty participants were asked to complete a telemedicine session involving several tasks using the four platforms. Upon completion of these tasks for each platform, participants completed the IBM computer system usability questionnaire (CSUQ) and the NASA Task Load Index test. Upon completing the tasks on all four platforms, the participants completed a final post-test subjective questionnaire ranking the platforms based on their preference. Of the twenty participants, 19 completed the study. Statistically significant differences among the telemedicine software platforms were found for task completion time, total workload, mental demand, effort, frustration, preference ranking and computer system usability scores. Usability problems with installation and account creation led to high mental demand and task completion time, suggesting the participants preferred a system without such requirements. Majority of the usability issues were identified at the telemedicine initiation phase. The findings from this study can be used by software developers to develop user-friendly telemedicine systems. Copyright © 2016 Elsevier Ltd. All rights reserved.

Evaluating the usability of an interactive, bi-lingual, touchscreen-enabled breastfeeding educational programme: application of Nielson's heuristics.

PubMed

Joshi, Ashish; Perin, Douglas M Puricelli; Amadi, Chioma; Trout, Kate

2015-03-05

The study purpose was to conduct heuristic evaluation of an interactive, bilingual touchscreen-enabled breastfeeding educational programme for Hispanic women living in rural settings in Nebraska. Three raters conducted the evaluation during May 2013 using principles of Nielson's heuristics. A total of 271 screens were evaluated and included: interface (n = 5), programme sections (n = 223) and educational content (n = 43). A total of 97 heuristic violations were identified and were mostly related to interface (8 violations/5 screens) and programme components (89 violations/266 screens). The most common heuristic violations reported were recognition rather than recall (62%, n = 60), consistency and standards (14%, n = 14) and match between the system and real world (9%, n = 9). Majority of the heuristic violations had minor usability issues (73%, n = 71). The only grade 4 heuristic violation reported was due to the visibility of system status in the assessment modules. The results demonstrated that the system was more consistent with Nielsen's usability heuristics. With Nielsen's usability heuristics, it is possible to identify problems in a timely manner, and help facilitate the identification and prioritisation of problems needing urgent attention at an earlier stage before the final deployment of the system.

Evolving the Technical Infrastructure of the Planetary Data System for the 21st Century

NASA Technical Reports Server (NTRS)

Beebe, Reta F.; Crichton, D.; Hughes, S.; Grayzeck, E.

2010-01-01

The Planetary Data System (PDS) was established in 1989 as a distributed system to assure scientific oversight. Initially the PDS followed guidelines recommended by the National Academies Committee on Data Management and Computation (CODMAC, 1982) and placed emphasis on archiving validated datasets. But overtime user demands, supported by increased computing capabilities and communication methods, have placed increasing demands on the PDS. The PDS must add additional services to better enable scientific analysis within distributed environments and to ensure that those services integrate with existing systems and data. To face these challenges the Planetary Data System (PDS) must modernize its architecture and technical implementation. The PDS 2010 project addresses these challenges. As part of this project, the PDS has three fundamental project goals that include: (1) Providing more efficient client delivery of data by data providers to the PDS (2) Enabling a stable, long-term usable planetary science data archive (3) Enabling services for the data consumer to find, access and use the data they require in contemporary data formats. In order to achieve these goals, the PDS 2010 project is upgrading both the technical infrastructure and the data standards to support increased efficiency in data delivery as well as usability of the PDS. Efforts are underway to interface with missions as early as possible and to streamline the preparation and delivery of data to the PDS. Likewise, the PDS is working to define and plan for data services that will help researchers to perform analysis in cost-constrained environments. This presentation will cover the PDS 2010 project including the goals, data standards and technical implementation plans that are underway within the Planetary Data System. It will discuss the plans for moving from the current system, version PDS 3, to version PDS 4.

User-friendly technology to help family carers cope.

PubMed

Chambers, Mary; Connor, Samantha L

2002-12-01

Increases in the older adult population are occurring simultaneously with a growth in new technology. Modern technology presents an opportunity to enhance the quality of life and independence of older people and their family carers through communication and access to health care information. To evaluate the usability of a multimedia software application designed to provide family carers of the elderly or disabled with information, advice and psychological support to increase their coping capacity. The interactive application consisted of an information-based package that provided carers with advice on the promotion of psychological health, including relaxation and other coping strategies. The software application also included a carer self-assessment instrument, designed to provide both family and professional carers with information to assess how family carers were coping with their care-giving role. Usability evaluation was carried out in two stages. In the first stage (verification), user trials and an evaluation questionnaire were used to refine and develop the content and usability of the multimedia software application. In the second (demonstration), stage evaluation questionnaires were used to appraise the usability of the modified software application. The findings evidenced that the majority of users found the software to be usable and informative. Some areas were highlighted for improvement in the navigation of the software. The authors conclude that with further refinement, the software application has the potential to offer information and support to those who are caring for the elderly and disabled at home.

Heuristic Evaluation and Usability Testing of a Computerized Patient-Reported Outcomes Survey for Headache Sufferers

PubMed Central

Saris-Baglama, Renee N.; Smith, Kevin J.; DeRosa, Michael A.; Paulsen, Christine A.; Hogue, Sarah J.

2011-01-01

Abstract Objective The aim of this study was to evaluate usability of a prototype tablet PC-administered computerized adaptive test (CAT) of headache impact and patient feedback report, referred to as HEADACHE-CAT. Materials and Methods Heuristic evaluation specialists (n = 2) formed a consensus opinion on the application's strengths and areas for improvement based on general usability principles and human factors research. Usability testing involved structured interviews with headache sufferers (n = 9) to assess how they interacted with and navigated through the application, and to gather input on the survey and report interface, content, visual design, navigation, instructions, and user preferences. Results Specialists identified the need for improved instructions and text formatting, increased font size, page setup that avoids scrolling, and simplified presentation of feedback reports. Participants found the tool useful, and indicated a willingness to complete it again and recommend it to their healthcare provider. However, some had difficulty using the onscreen keyboard and autoadvance option; understanding the difference between generic and headache-specific questions; and interpreting score reports. Conclusions Heuristic evaluation and user testing can help identify usability problems in the early stages of application development, and improve the construct validity of electronic assessments such as the HEADACHE-CAT. An improved computerized HEADACHE-CAT measure can offer headache sufferers an efficient tool to increase patient self-awareness, monitor headaches over time, aid patient–provider communications, and improve quality of life. PMID:21214341

A personal health information toolkit for health intervention research.

PubMed

Kizakevich, Paul N; Eckhoff, Randall; Weger, Stacey; Weeks, Adam; Brown, Janice; Bryant, Stephanie; Bakalov, Vesselina; Zhang, Yuying; Lyden, Jennifer; Spira, James

2014-01-01

With the emergence of mobile health (mHealth) apps, there is a growing demand for better tools for developing and evaluating mobile health interventions. Recently we developed the Personal Health Intervention Toolkit (PHIT), a software framework which eases app implementation and facilitates scientific evaluation. PHIT integrates self-report and physiological sensor instruments, evidence-based advisor logic, and self-help interventions such as meditation, health education, and cognitive behavior change. PHIT can be used to facilitate research, interventions for chronic diseases, risky behaviors, sleep, medication adherence, environmental monitoring, momentary data collection health screening, and clinical decision support. In a series of usability evaluations, participants reported an overall usability score of 4.5 on a 1-5 Likert scale and an 85 score on the System Usability Scale, indicating a high percentile rank of 95%.

Quantifying usability: an evaluation of a diabetes mHealth system on effectiveness, efficiency, and satisfaction metrics with associated user characteristics.

PubMed

Georgsson, Mattias; Staggers, Nancy

2016-01-01

Mobile health (mHealth) systems are becoming more common for chronic disease management, but usability studies are still needed on patients' perspectives and mHealth interaction performance. This deficiency is addressed by our quantitative usability study of a mHealth diabetes system evaluating patients' task performance, satisfaction, and the relationship of these measures to user characteristics. We used metrics in the International Organization for Standardization (ISO) 9241-11 standard. After standardized training, 10 patients performed representative tasks and were assessed on individual task success, errors, efficiency (time on task), satisfaction (System Usability Scale [SUS]) and user characteristics. Tasks of exporting and correcting values proved the most difficult, had the most errors, the lowest task success rates, and consumed the longest times on task. The average SUS satisfaction score was 80.5, indicating good but not excellent system usability. Data trends showed males were more successful in task completion, and younger participants had higher performance scores. Educational level did not influence performance, but a more recent diabetes diagnosis did. Patients with more experience in information technology (IT) also had higher performance rates. Difficult task performance indicated areas for redesign. Our methods can assist others in identifying areas in need of improvement. Data about user background and IT skills also showed how user characteristics influence performance and can provide future considerations for targeted mHealth designs. Using the ISO 9241-11 usability standard, the SUS instrument for satisfaction and measuring user characteristics provided objective measures of patients' experienced usability. These could serve as an exemplar for standardized, quantitative methods for usability studies on mHealth systems. © The Author 2015. Published by Oxford University Press on behalf of the American Medical Informatics Association.

Quantifying usability: an evaluation of a diabetes mHealth system on effectiveness, efficiency, and satisfaction metrics with associated user characteristics

PubMed Central

Staggers, Nancy

2016-01-01

Objective Mobile health (mHealth) systems are becoming more common for chronic disease management, but usability studies are still needed on patients’ perspectives and mHealth interaction performance. This deficiency is addressed by our quantitative usability study of a mHealth diabetes system evaluating patients’ task performance, satisfaction, and the relationship of these measures to user characteristics. Materials and Methods We used metrics in the International Organization for Standardization (ISO) 9241-11 standard. After standardized training, 10 patients performed representative tasks and were assessed on individual task success, errors, efficiency (time on task), satisfaction (System Usability Scale [SUS]) and user characteristics. Results Tasks of exporting and correcting values proved the most difficult, had the most errors, the lowest task success rates, and consumed the longest times on task. The average SUS satisfaction score was 80.5, indicating good but not excellent system usability. Data trends showed males were more successful in task completion, and younger participants had higher performance scores. Educational level did not influence performance, but a more recent diabetes diagnosis did. Patients with more experience in information technology (IT) also had higher performance rates. Discussion Difficult task performance indicated areas for redesign. Our methods can assist others in identifying areas in need of improvement. Data about user background and IT skills also showed how user characteristics influence performance and can provide future considerations for targeted mHealth designs. Conclusion Using the ISO 9241-11 usability standard, the SUS instrument for satisfaction and measuring user characteristics provided objective measures of patients’ experienced usability. These could serve as an exemplar for standardized, quantitative methods for usability studies on mHealth systems. PMID:26377990

A usability evaluation of four commercial dental computer-based patient record systems

PubMed Central

Thyvalikakath, Thankam P.; Monaco, Valerie; Thambuganipalle, Hima Bindu; Schleyer, Titus

2008-01-01

Background The usability of dental computer-based patient record (CPR) systems has not been studied, despite early evidence that poor usability is a problem for dental CPR system users at multiple levels. Methods The authors conducted formal usability tests of four dental CPR systems by using a purposive sample of four groups of five novice users. The authors measured task outcomes (correctly completed, incorrectly completed and incomplete) in each CPR system while the participants performed nine clinical documentation tasks, as well as the number of usability problems identified in each CPR system and their potential relationship to task outcomes. The authors reviewed the software application design aspects responsible for these usability problems. Results The range for correctly completed tasks was 16 to 64 percent, for incorrectly completed tasks 18 to 38 percent and for incomplete tasks 9 to 47 percent. The authors identified 286 usability problems. The main types were three unsuccessful attempts, negative affect and task incorrectly completed. They also identified six problematic interface and interaction designs that led to usability problems. Conclusion The four dental CPR systems studied have significant usability problems for novice users, resulting in a steep learning curve and potentially reduced system adoption. Clinical Implications The significant number of data entry errors raises concerns about the quality of documentation in clinical practice. PMID:19047669

Surface operations usability study utilizing Capstone phase I avionics : quick look report

DOT National Transportation Integrated Search

2000-10-07

Evaluate usability, suitability and acceptability of of the surface moving map implemented within Capstone Phase 1 Avionics for surface operations : Task 1: Airport Surface Situational Awareness (ASSA) : Task 2: Surface-Final Approach Runway Occupanc...

Better bioinformatics through usability analysis.

PubMed

Bolchini, Davide; Finkelstein, Anthony; Perrone, Vito; Nagl, Sylvia

2009-02-01

Improving the usability of bioinformatics resources enables researchers to find, interact with, share, compare and manipulate important information more effectively and efficiently. It thus enables researchers to gain improved insights into biological processes with the potential, ultimately, of yielding new scientific results. Usability 'barriers' can pose significant obstacles to a satisfactory user experience and force researchers to spend unnecessary time and effort to complete their tasks. The number of online biological databases available is growing and there is an expanding community of diverse users. In this context there is an increasing need to ensure the highest standards of usability. Using 'state-of-the-art' usability evaluation methods, we have identified and characterized a sample of usability issues potentially relevant to web bioinformatics resources, in general. These specifically concern the design of the navigation and search mechanisms available to the user. The usability issues we have discovered in our substantial case studies are undermining the ability of users to find the information they need in their daily research activities. In addition to characterizing these issues, specific recommendations for improvements are proposed leveraging proven practices from web and usability engineering. The methods and approach we exemplify can be readily adopted by the developers of bioinformatics resources.

Smartphone Apps for Cardiopulmonary Resuscitation Training and Real Incident Support: A Mixed-Methods Evaluation Study

PubMed Central

Felzen, Marc; Rossaint, Rolf; Tabuenca, Bernardo; Specht, Marcus; Skorning, Max

2014-01-01

Background No systematic evaluation of smartphone/mobile apps for resuscitation training and real incident support is available to date. To provide medical, usability, and additional quality criteria for the development of apps, we conducted a mixed-methods sequential evaluation combining the perspective of medical experts and end-users. Objective The study aims to assess the quality of current mobile apps for cardiopulmonary resuscitation (CPR) training and real incident support from expert as well as end-user perspective. Methods Two independent medical experts evaluated the medical content of CPR apps from the Google Play store and the Apple App store. The evaluation was based on pre-defined minimum medical content requirements according to current Basic Life Support (BLS) guidelines. In a second phase, non-medical end-users tested usability and appeal of the apps that had at least met the minimum requirements. Usability was assessed with the System Usability Scale (SUS); appeal was measured with the self-developed ReactionDeck toolkit. Results Out of 61 apps, 46 were included in the experts’ evaluation. A consolidated list of 13 apps resulted for the following layperson evaluation. The interrater reliability was substantial (kappa=.61). Layperson end-users (n=14) had a high interrater reliability (intraclass correlation 1 [ICC1]=.83, P<.001, 95% CI 0.75-0.882 and ICC2=.79, P<.001, 95% CI 0.695-0.869). Their evaluation resulted in a list of 5 recommendable apps. Conclusions Although several apps for resuscitation training and real incident support are available, very few are designed according to current BLS guidelines and offer an acceptable level of usability and hedonic quality for laypersons. The results of this study are intended to optimize the development of CPR mobile apps. The app ranking supports the informed selection of mobile apps for training situations and CPR campaigns as well as for real incident support. PMID:24647361

Smartphone apps for cardiopulmonary resuscitation training and real incident support: a mixed-methods evaluation study.

PubMed

Kalz, Marco; Lenssen, Niklas; Felzen, Marc; Rossaint, Rolf; Tabuenca, Bernardo; Specht, Marcus; Skorning, Max

2014-03-19

No systematic evaluation of smartphone/mobile apps for resuscitation training and real incident support is available to date. To provide medical, usability, and additional quality criteria for the development of apps, we conducted a mixed-methods sequential evaluation combining the perspective of medical experts and end-users. The study aims to assess the quality of current mobile apps for cardiopulmonary resuscitation (CPR) training and real incident support from expert as well as end-user perspective. Two independent medical experts evaluated the medical content of CPR apps from the Google Play store and the Apple App store. The evaluation was based on pre-defined minimum medical content requirements according to current Basic Life Support (BLS) guidelines. In a second phase, non-medical end-users tested usability and appeal of the apps that had at least met the minimum requirements. Usability was assessed with the System Usability Scale (SUS); appeal was measured with the self-developed ReactionDeck toolkit. Out of 61 apps, 46 were included in the experts' evaluation. A consolidated list of 13 apps resulted for the following layperson evaluation. The interrater reliability was substantial (kappa=.61). Layperson end-users (n=14) had a high interrater reliability (intraclass correlation 1 [ICC1]=.83, P<.001, 95% CI 0.75-0.882 and ICC2=.79, P<.001, 95% CI 0.695-0.869). Their evaluation resulted in a list of 5 recommendable apps. Although several apps for resuscitation training and real incident support are available, very few are designed according to current BLS guidelines and offer an acceptable level of usability and hedonic quality for laypersons. The results of this study are intended to optimize the development of CPR mobile apps. The app ranking supports the informed selection of mobile apps for training situations and CPR campaigns as well as for real incident support.

Usability Methods for Ensuring Health Information Technology Safety: Evidence-Based Approaches. Contribution of the IMIA Working Group Health Informatics for Patient Safety.

PubMed

Borycki, E; Kushniruk, A; Nohr, C; Takeda, H; Kuwata, S; Carvalho, C; Bainbridge, M; Kannry, J

2013-01-01

Issues related to lack of system usability and potential safety hazards continue to be reported in the health information technology (HIT) literature. Usability engineering methods are increasingly used to ensure improved system usability and they are also beginning to be applied more widely for ensuring the safety of HIT applications. These methods are being used in the design and implementation of many HIT systems. In this paper we describe evidence-based approaches to applying usability engineering methods. A multi-phased approach to ensuring system usability and safety in healthcare is described. Usability inspection methods are first described including the development of evidence-based safety heuristics for HIT. Laboratory-based usability testing is then conducted under artificial conditions to test if a system has any base level usability problems that need to be corrected. Usability problems that are detected are corrected and then a new phase is initiated where the system is tested under more realistic conditions using clinical simulations. This phase may involve testing the system with simulated patients. Finally, an additional phase may be conducted, involving a naturalistic study of system use under real-world clinical conditions. The methods described have been employed in the analysis of the usability and safety of a wide range of HIT applications, including electronic health record systems, decision support systems and consumer health applications. It has been found that at least usability inspection and usability testing should be applied prior to the widespread release of HIT. However, wherever possible, additional layers of testing involving clinical simulations and a naturalistic evaluation will likely detect usability and safety issues that may not otherwise be detected prior to widespread system release. The framework presented in the paper can be applied in order to develop more usable and safer HIT, based on multiple layers of evidence.

Evaluation of the free, open source software WordPress as electronic portfolio system in undergraduate medical education.

PubMed

Avila, Javier; Sostmann, Kai; Breckwoldt, Jan; Peters, Harm

2016-06-03

Electronic portfolios (ePortfolios) are used to document and support learning activities. E-portfolios with mobile capabilities allow even more flexibility. However, the development or acquisition of ePortfolio software is often costly, and at the same time, commercially available systems may not sufficiently fit the institution's needs. The aim of this study was to design and evaluate an ePortfolio system with mobile capabilities using a commercially free and open source software solution. We created an online ePortfolio environment using the blogging software WordPress based on reported capability features of such software by a qualitative weight and sum method. Technical implementation and usability were evaluated by 25 medical students during their clinical training by quantitative and qualitative means using online questionnaires and focus groups. The WordPress ePortfolio environment allowed students a broad spectrum of activities - often documented via mobile devices - like collection of multimedia evidences, posting reflections, messaging, web publishing, ePortfolio searches, collaborative learning, knowledge management in a content management system including a wiki and RSS feeds, and the use of aid tools for studying. The students' experience with WordPress revealed a few technical problems, and this report provides workarounds. The WordPress ePortfolio was rated positively by the students as a content management system (67 % of the students), for exchange with other students (74 %), as a note pad for reflections (53 %) and for its potential as an information source for assessment (48 %) and exchange with a mentor (68 %). On the negative side, 74 % of the students in this pilot study did not find it easy to get started with the system, and 63 % rated the ePortfolio as not being user-friendly. Qualitative analysis indicated a need for more introductory information and training. It is possible to build an advanced ePortfolio system with mobile capabilities with the free and open source software WordPress. This allows institutions without proprietary software to build a sophisticated ePortfolio system adapted to their needs with relatively few resources. The implementation of WordPress should be accompanied by introductory courses in the use of the software and its apps in order to facilitate its usability.

Ergonomic Evaluation of the Foot Restraint Equipment Device (FRED)

NASA Technical Reports Server (NTRS)

Whitmore, Mihriban; Chmielewski, Cindy; Qazi, A. S.; Mount, Francis

1999-01-01

Within the scope of the Microgravity Workstation and Restraint Evaluation project, funded by the NASA Headquarters Life Sciences Division, evaluations were proposed to be conducted in ground, KC-135, and/or Shuttle environments to investigate the human factors engineering (HFE) issues concerning confined/unique workstations, including crew restraint requirements. As part of these evaluations, KC-135 flights were conducted to investigate user/ workstation/ restraint integration for microgravity use of the FRED with the RMS workstation. This evaluation was a pre-cursor to Detailed Supplementary Objective (DSO) - 904 on STS-88. On that mission, a small-statured astronaut will be using the FRED restraint while working at the Aft RMS workstation. The DSO will collect video for later posture analyses, as well as subjective data in the form of an electronic questionnaire. This report describes the current FRED KC-135 evaluations. The primary objectives were to evaluate the usability of the FRED and to verify the DSO in-flight setup. The restraint interface evaluation consisted of four basic areas of restraint use: 1) adjustability; 2) general usability and comfort; 3) usability at the RMS workstation; and 4) assembly and disassembly.

Engaging Community Stakeholders to Evaluate the Design, Usability, and Acceptability of a Chronic Obstructive Pulmonary Disease Social Media Resource Center

PubMed Central

Chaney, Beth; Chaney, Don; Paige, Samantha; Payne-Purvis, Caroline; Tennant, Bethany; Walsh-Childers, Kim; Sriram, PS; Alber, Julia

2015-01-01

Background Patients with chronic obstructive pulmonary disease (COPD) often report inadequate access to comprehensive patient education resources. Objective The purpose of this study was to incorporate community-engagement principles within a mixed-method research design to evaluate the usability and acceptability of a self-tailored social media resource center for medically underserved patients with COPD. Methods A multiphase sequential design (qual → QUANT → quant + QUAL) was incorporated into the current study, whereby a small-scale qualitative (qual) study informed the design of a social media website prototype that was tested with patients during a computer-based usability study (QUANT). To identify usability violations and determine whether or not patients found the website prototype acceptable for use, each patient was asked to complete an 18-item website usability and acceptability questionnaire, as well as a retrospective, in-depth, semistructured interview (quant + QUAL). Results The majority of medically underserved patients with COPD (n=8, mean 56 years, SD 7) found the social media website prototype to be easy to navigate and relevant to their self-management information needs. Mean responses on the 18-item website usability and acceptability questionnaire were very high on a scale of 1 (strongly disagree) to 5 (strongly agree) (mean 4.72, SD 0.33). However, the majority of patients identified several usability violations related to the prototype’s information design, interactive capabilities, and navigational structure. Specifically, 6 out of 8 (75%) patients struggled to create a log-in account to access the prototype, and 7 out of 8 patients (88%) experienced difficulty posting and replying to comments on an interactive discussion forum. Conclusions Patient perceptions of most social media website prototype features (eg, clickable picture-based screenshots of videos, comment tools) were largely positive. Mixed-method stakeholder feedback was used to make design recommendations, categorize usability violations, and prioritize potential solutions for improving the usability of a social media resource center for COPD patient education. PMID:25630449

The Use of an Adapted Health IT Usability Evaluation Model (Health-ITUEM) for Evaluating Consumer Reported Ratings of Diabetes mHealth Applications: Implications for Diabetes Care and Management

PubMed Central

Househ, Mowafa S.; Shubair, Mamdouh M.; Yunus, Faisel; Jamal, Amr; Aldossari, Bakheet

2015-01-01

Background: The aim of this paper is to present a usability analysis of the consumer ratings of key diabetes mHealth applications using an adapted Health IT Usability Evaluation Model (Health-ITUEM). Methods: A qualitative content analysis method was used to analyze publicly available consumer reported data posted on the Android Market and Google Play for four leading diabetes mHealth applications. Health-ITUEM concepts including information needs, flexibility/customizability, learnability, performance speed, and competency guided the categorization and analysis of the data. Health impact was an additional category that was included in the study. A total of 405 consumers’ ratings collected from January 9, 2014 to February 17, 2014 were included in the study. Results: Overall, the consumers’ ratings of the leading diabetes mHealth applications for both usability and health impacts were positive. The performance speed of the mHealth application and the information needs of the consumers were the primary usability factors impacting the use of the diabetes mHealth applications. There was also evidence on the positive health impacts of such applications. Conclusions: Consumers are more likely to use diabetes related mHealth applications that perform well and meet their information needs. Furthermore, there is preliminary evidence that diabetes mHealth applications can have positive impact on the health of patients. PMID:26635437

The Use of an Adapted Health IT Usability Evaluation Model (Health-ITUEM) for Evaluating Consumer Reported Ratings of Diabetes mHealth Applications: Implications for Diabetes Care and Management.

PubMed

Househ, Mowafa S; Shubair, Mamdouh M; Yunus, Faisel; Jamal, Amr; Aldossari, Bakheet

2015-10-01

The aim of this paper is to present a usability analysis of the consumer ratings of key diabetes mHealth applications using an adapted Health IT Usability Evaluation Model (Health-ITUEM). A qualitative content analysis method was used to analyze publicly available consumer reported data posted on the Android Market and Google Play for four leading diabetes mHealth applications. Health-ITUEM concepts including information needs, flexibility/customizability, learnability, performance speed, and competency guided the categorization and analysis of the data. Health impact was an additional category that was included in the study. A total of 405 consumers' ratings collected from January 9, 2014 to February 17, 2014 were included in the study. Overall, the consumers' ratings of the leading diabetes mHealth applications for both usability and health impacts were positive. The performance speed of the mHealth application and the information needs of the consumers were the primary usability factors impacting the use of the diabetes mHealth applications. There was also evidence on the positive health impacts of such applications. Consumers are more likely to use diabetes related mHealth applications that perform well and meet their information needs. Furthermore, there is preliminary evidence that diabetes mHealth applications can have positive impact on the health of patients.

A usability evaluation of medical software at an expert conference setting.

PubMed

Bond, Raymond Robert; Finlay, Dewar D; Nugent, Chris D; Moore, George; Guldenring, Daniel

2014-01-01

A usability test was employed to evaluate two medical software applications at an expert conference setting. One software application is a medical diagnostic tool (electrocardiogram [ECG] viewer) and the other is a medical research tool (electrode misplacement simulator [EMS]). These novel applications have yet to be adopted by the healthcare domain, thus, (1) we wanted to determine the potential user acceptance of these applications and (2) we wanted to determine the feasibility of evaluating medical diagnostic and medical research software at a conference setting as opposed to the conventional laboratory setting. The medical diagnostic tool (ECG viewer) was evaluated using seven delegates and the medical research tool (EMS) was evaluated using 17 delegates that were recruited at the 2010 International Conference on Computing in Cardiology. Each delegate/participant was required to use the software and undertake a set of predefined tasks during the session breaks at the conference. User interactions with the software were recorded using screen-recording software. The 'think-aloud' protocol was also used to elicit verbal feedback from the participants whilst they attempted the pre-defined tasks. Before and after each session, participants completed a pre-test and a post-test questionnaire respectively. The average duration of a usability session at the conference was 34.69 min (SD=10.28). However, taking into account that 10 min was dedicated to the pre-test and post-test questionnaires, the average time dedication to user interaction of the medical software was 24.69 min (SD=10.28). Given we have shown that usability data can be collected at conferences, this paper details the advantages of conference-based usability studies over the laboratory-based approach. For example, given delegates gather at one geographical location, a conference-based usability evaluation facilitates recruitment of a convenient sample of international subject experts. This would otherwise be very expensive to arrange. A conference-based approach also allows for data to be collected over a few days as opposed to months by avoiding administration duties normally involved in laboratory based approach, e.g. mailing invitation letters as part of a recruitment campaign. Following analysis of the user video recordings, 41 (previously unknown) use errors were identified in the advanced ECG viewer and 29 were identified in the EMS application. All use errors were given a consensus severity rating from two independent usability experts. Out of a rating scale of 4 (where 1=cosmetic and 4=critical), the average severity rating for the ECG viewer was 2.24 (SD=1.09) and the average severity rating for the EMS application was 2.34 (SD=0.97). We were also able to extract task completion rates and times from the video recordings to determine the effectiveness of the software applications. For example, six out of seven tasks were completed by all participants when using both applications. This statistic alone suggests both applications already have a high degree of usability. As well as extracting data from the video recordings, we were also able to extract data from the questionnaires. Using a semantic differential scale (where 1=poor and 5=excellent), delegates highly rated the 'responsiveness', 'usefulness', 'learnability' and the 'look and feel' of both applications. This study has shown the potential user acceptance and user-friendliness of the novel EMS and the ECG viewer applications within the healthcare domain. It has also shown that both medical diagnostic software and medical research software can be evaluated for their usability at an expert conference setting. The primary advantage of a conference-based usability evaluation over a laboratory-based evaluation is the high concentration of experts at one location, which is convenient, less time consuming and less expensive. Copyright © 2013 Elsevier Ireland Ltd. All rights reserved.

Applying usability testing techniques to improve a health promotion website.

PubMed

Hinchliffe, Anetta; Mummery, W Kerry

2008-04-01

Use of the Internet for health promotion is increasing; however, the lack of published research regarding website usability suggests that health promotion websites are being developed without consultation with their users or formal evaluation. This study conducted usability testing of an existing health promotion website to inform modifications and to identify common usability themes that should be addressed by organisations developing or maintaining a health promotion website. A combination of qualitative and quantitative techniques were implemented during the usability testing sessions to gather data from users while completing tasks on the website. Techniques included performance measures (time taken), direct observation (participant observation) and subjective user preferences (questionnaire and interview). Improvements to the website were measured in terms of reduced problems reported, reduced time taken to complete tasks and increased subjective reports. Seven usability themes emerged from the data: design, feedback, format, instructions, navigation, terminology and learnability. This study demonstrates the application of usability testing to the design and modification of a health promotion website and illustrates the areas or themes that can be used as a framework for testing and modification.

Participatory design of a collaborative clinical trial protocol writing system.

PubMed

Weng, Chunhua; McDonald, David W; Sparks, Dana; McCoy, Jason; Gennari, John H

2007-06-01

To explore concrete approaches to socio-technical design of collaborative healthcare information systems and to design a groupware technology for collaborative clinical trial protocol writing. We conducted "quick and dirty ethnography" through semi-structured interviews, observational studies, and work artifacts analysis to understand the group work for protocol development. We used participatory design through evolutionary prototyping to explore the feature space of a collaborative writing system. Our design strategies include role-based user advocacy, formative evaluation, and change management. Quick and dirty ethnography helped us efficiently understand relevant work practice, and participatory design helped us engage users into design and bring out their tacit work knowledge. Our approach that intertwined both techniques helped achieve a "work-informed and user-oriented" design. This research leads to a collaborative writing system that supports in situ communication, group awareness, and effective work progress tracking. The usability evaluation results have been satisfactory. The system design is being transferred to an organizational tool for daily use.

A web-based program for informal caregivers of persons with Alzheimer's disease: an iterative user-centered design.

PubMed

Cristancho-Lacroix, Victoria; Moulin, Florence; Wrobel, Jérémy; Batrancourt, Bénédicte; Plichart, Matthieu; De Rotrou, Jocelyne; Cantegreil-Kallen, Inge; Rigaud, Anne-Sophie

2014-09-15

Web-based programs have been developed for informal caregivers of people with Alzheimer's disease (PWAD). However, these programs can prove difficult to adopt, especially for older people, who are less familiar with the Internet than other populations. Despite the fundamental role of usability testing in promoting caregivers' correct use and adoption of these programs, to our knowledge, this is the first study describing this process before evaluating a program for caregivers of PWAD in a randomized clinical trial. The objective of the study was to describe the development process of a fully automated Web-based program for caregivers of PWAD, aiming to reduce caregivers' stress, and based on the user-centered design approach. There were 49 participants (12 health care professionals, 6 caregivers, and 31 healthy older adults) that were involved in a double iterative design allowing for the adaptation of program content and for the enhancement of website usability. This process included three component parts: (1) project team workshops, (2) a proof of concept, and (3) two usability tests. The usability tests were based on a mixed methodology using behavioral analysis, semistructured interviews, and a usability questionnaire. The user-centered design approach provided valuable guidelines to adapt the content and design of the program, and to improve website usability. The professionals, caregivers (mainly spouses), and older adults considered that our project met the needs of isolated caregivers. Participants underlined that contact between caregivers would be desirable. During usability observations, the mistakes of users were also due to ergonomics issues from Internet browsers and computer interfaces. Moreover, negative self-stereotyping was evidenced, when comparing interviews and results of behavioral analysis. Face-to-face psycho-educational programs may be used as a basis for Web-based programs. Nevertheless, a user-centered design approach involving targeted users (or their representatives) remains crucial for their correct use and adoption. For future user-centered design studies, we recommend to involve end-users from preconception stages, using a mixed research method in usability evaluations, and implementing pilot studies to evaluate acceptability and feasibility of programs.

Overcoming the Law of the Hidden in Cyberinfrastructures.

PubMed

Bucksch, Alexander; Das, Abhiram; Schneider, Hannah; Merchant, Nirav; Weitz, Joshua S

2017-02-01

Cyberinfrastructure projects (CIPs) are complex, integrated systems that require interaction and organization amongst user, developer, hardware, technical infrastructure, and funding resources. Nevertheless, CIP usability, functionality, and growth do not scale with the sum of these resources. Instead, growth and efficient usage of CIPs require access to 'hidden' resources. These include technical resources within CIPs as well as social and functional interactions among stakeholders. We identify approaches to overcome resource limitations following the conceptual basis of Liebig's Law of the Minimum. In so doing, we recommend practical steps towards efficient and scaleable resource use, taking the iPlant/CyVerse CIP as an example. Copyright © 2016 Elsevier Ltd. All rights reserved.

Systematically evaluating interfaces for RNA-seq analysis from a life scientist perspective.

PubMed

Poplawski, Alicia; Marini, Federico; Hess, Moritz; Zeller, Tanja; Mazur, Johanna; Binder, Harald

2016-03-01

RNA-sequencing (RNA-seq) has become an established way for measuring gene expression in model organisms and humans. While methods development for refining the corresponding data processing and analysis pipeline is ongoing, protocols for typical steps have been proposed and are widely used. Several user interfaces have been developed for making such analysis steps accessible to life scientists without extensive knowledge of command line tools. We performed a systematic search and evaluation of such interfaces to investigate to what extent these can indeed facilitate RNA-seq data analysis. We found a total of 29 open source interfaces, and six of the more widely used interfaces were evaluated in detail. Central criteria for evaluation were ease of configuration, documentation, usability, computational demand and reporting. No interface scored best in all of these criteria, indicating that the final choice will depend on the specific perspective of users and the corresponding weighting of criteria. Considerable technical hurdles had to be overcome in our evaluation. For many users, this will diminish potential benefits compared with command line tools, leaving room for future improvement of interfaces. © The Author 2015. Published by Oxford University Press. For Permissions, please email: journals.permissions@oup.com.

Using scenarios and personas to enhance the effectiveness of heuristic usability evaluations for older adults and their care team.

PubMed

Kneale, Laura; Mikles, Sean; Choi, Yong K; Thompson, Hilaire; Demiris, George

2017-09-01

Using heuristics to evaluate user experience is a common methodology for human-computer interaction studies. One challenge of this method is the inability to tailor results towards specific end-user needs. This manuscript reports on a method that uses validated scenarios and personas of older adults and care team members to enhance heuristics evaluations of the usability of commercially available personal health records for homebound older adults. Our work extends the Chisnell and Redish heuristic evaluation methodology by using a protocol that relies on multiple expert reviews of each system. It further standardizes the heuristic evaluation process through the incorporation of task-based scenarios. We were able to use the modified version of the Chisnell and Redish heuristic evaluation methodology to identify potential usability challenges of two commercially available personal health record systems. This allowed us to: (1) identify potential usability challenges for specific types of users, (2) describe improvements that would be valuable to all end-users of the system, and (3) better understand how the interactions of different users may vary within a single personal health record. The methodology described in this paper may help designers of consumer health information technology tools, such as personal health records, understand the needs of diverse end-user populations. Such methods may be particularly helpful when designing systems for populations that are difficult to recruit for end-user evaluations through traditional methods. Copyright © 2017 Elsevier Inc. All rights reserved.

Usability evaluation of the SMART application for youth with mTBI.

PubMed

Dexheimer, Judith W; Kurowski, Brad G; Anders, Shilo H; McClanahan, Nicole; Wade, Shari L; Babcock, Lynn

2017-01-01

There is a dearth of evidence-based treatments available to address the significant morbidity associated with mild traumatic brain injury (mTBI). To address this gap, we designed a novel user-friendly, web-based application. We describe the preliminary evaluation of feasibility and usability of the application to promote recovery following mTBI in youth, the Self-Monitoring Activity-Restriction and Relaxation Treatment (SMART). SMART incorporates real-time recommendations for individualized symptom management and activity restriction along with training in cognitive-behavioral coping strategies. We conducted a usability evaluation to assess and modify the SMART system prior to further study and deployment. Children ages 11-18 years presenting to the emergency department were recruited after symptoms resolved. Usability was assessed using a 60-min think-aloud protocol of teens and parents describing their interaction with the application. Upon completion of the tasks, each participant also completed the system usability scale (SUS). We performed tests with 4 parent/child dyads. The average age of the children was 13 years (standard deviation=1.8). The parents were an average of 41.5 years old (standard deviation=6.2). Research revealed that the participants were enthusiastic about the interactive portions of the tool particularly the video based sessions. Parents were concerned about the speed at which their child might move through the program and the children thought that the system required large amounts of reading. Based on user feedback, researchers modified SMART to include an audio file in every module and improved the system's aesthetic properties. The mean SUS score was 85, with high SUS scores (>68) indicating satisfactory usability. High initial usability and favorable user feedback provide a foundation for further iterative development and testing of the SMART application as a tool for managing recovery from concussion. Copyright © 2016 Elsevier Ireland Ltd. All rights reserved.

Asking the Presidents: The Most Pressing Issues at Community Colleges in the North Central Region. AIR 1988 Annual Forum Paper.

ERIC Educational Resources Information Center

Budig, Jeanne E.

A survey of 350 presidents at two-year colleges in the North Central Accreditation Region generated a list of their perceptions of the currently most pressing issues related to accreditation, academic transfer and vocational/technical education. A total of 162 usable responses was received. Results included the finding that the most pressing issue…

Implementing School-to-Work Transition Skills for Disadvantaged Youth. Final Report. Vocational-Technical Education Research Report, Volume 20, Number 5.

ERIC Educational Resources Information Center

Wircenski, Jerry L.; And Others

A study was conducted to expand and disseminate the school-to-work transition skill activities begun in a 1980-81 project in Pennsylvania by focusing on two groups: vocational instructors and disadvantaged vocational students. Questionnaires were created and mailed to 903 teachers, with a 50 percent usable response; while a student survey was sent…

A Study of the Two-Year College and the Ph.D. Surplus.

ERIC Educational Resources Information Center

Smith, Milton L.

A survey of 1,165 institutions listed in the 1978 Community, Junior, and Technical College Directory was conducted during the spring semester, 1978, to determine if two-year colleges are becoming a major market for the surplus of holders of Doctorates of Philosophy (Ph.D.'s). Survey results, based on a 65.41% usable return rate, indicate that: (1)…

Evaluation of Nursing Information Systems: Application of Usability Aspects in the Development of Systems.

PubMed

Moghaddasi, Hamid; Rabiei, Reza; Asadi, Farkhondeh; Ostvan, Negin

2017-04-01

As the largest group providing healthcare services, nurses require well-designed information systems in their practice. This study aims to evaluate the usability of nursing information systems (NIS). This cross-sectional survey was conducted in 2015. The settings of the study consisted of four hospitals affiliated with three medical universities in Tehran (Iran). The subjects of the study included nurses who had access to and used a NIS developed by four major software companies. The data were collected using a modified version of a usability questionnaire known as IsoMetrics, based on the International Standard ISO 9241, Part 11. The questionnaire is composed of 35 questions divided into seven general criteria. The validity of the questionnaire was determined by experts in the field, and the reliability was checked using Cronbach's alpha (α = 0.91). The questionnaire was then distributed to 184 nurses. The response rate was 64.6%. Among the seven ISO usability criteria, suitability for the task (3.10 ± 1.24) and suitability for learning (3.10 ± 1.27) had the highest mean value. The lowest mean value (2.37 ± 1.29) was related to the suitability for individualization. Addressing issues related to individualization and self-descriptiveness could improve the usability of nursing systems. Considering usability requirements in the design of a NIS will lead to the efficient and effective use of these systems.

Evaluating the Usability of a Professional Modeling Tool Repurposed for Middle School Learning

NASA Astrophysics Data System (ADS)

Peters, Vanessa L.; Songer, Nancy Butler

2013-10-01

This paper reports the results of a three-stage usability test of a modeling tool designed to support learners' deep understanding of the impacts of climate change on ecosystems. The design process involved repurposing an existing modeling technology used by professional scientists into a learning tool specifically designed for middle school students. To evaluate usability, we analyzed students' task performance and task completion time as they worked on an activity with the repurposed modeling technology. In stage 1, we conducted remote testing of an early modeling prototype with urban middle school students (n = 84). In stages 2 and 3, we used screencasting software to record students' mouse and keyboard movements during collaborative think-alouds (n = 22) and conducted a qualitative analysis of their peer discussions. Taken together, the study findings revealed two kinds of usability issues that interfered with students' productive use of the tool: issues related to the use of data and information, and issues related to the use of the modeling technology. The study findings resulted in design improvements that led to stronger usability outcomes and higher task performance among students. In this paper, we describe our methods for usability testing, our research findings, and our design solutions for supporting students' use of the modeling technology and use of data. The paper concludes with implications for the design and study of modeling technologies for science learning.

Physician satisfaction with a critical care clinical information system using a multimethod evaluation of usability.

PubMed

Hudson, Darren; Kushniruk, Andre; Borycki, Elizabeth; Zuege, Danny J

2018-04-01

Physician satisfaction with electronic medical records has often been poor. Usability has frequently been identified as a source for decreased satisfaction. While surveys can identify many issues, and are logistically easier to administer, they may miss issues identified using other methods This study sought to understand the level of physician satisfaction and usability issues associated with a critical care clinical information system (eCritical Alberta) implemented throughout the province of Alberta, Canada. All critical care attending physicians using the system were invited to participate in an online survey. Questions included components of the User Acceptance of Information Technology and Usability Questionnaire as well as free text feedback on system components. Physicians were also invited to participate in a think aloud test using simulated scenarios. The transcribed think aloud text and questionnaire were subjected to textual analysis. 82% of all eligible physicians completed the on-line survey (n = 61). Eight physicians were invited and seven completed the think aloud test. Overall satisfaction with the system was moderate. Usability was identified as a significant factor contributing to satisfaction. The major usability factors identified were system response time and layout. The think aloud component identified additional factors beyond those identified in the on-line survey. This study found a modestly high level of physician satisfaction with a province-wide clinical critical care information system. Usability continues to be a significant factor in physician satisfaction. Using multiple methods of evaluation can capture the benefits of a large sample size and deeper understanding of the issues. Copyright © 2018 Elsevier B.V. All rights reserved.

Extraction of phenotypic traits from taxonomic descriptions for the tree of life using natural language processing.

PubMed

Endara, Lorena; Cui, Hong; Burleigh, J Gordon

2018-03-01

Phenotypic data sets are necessary to elucidate the genealogy of life, but assembling phenotypic data for taxa across the tree of life can be technically challenging and prohibitively time consuming. We describe a semi-automated protocol to facilitate and expedite the assembly of phenotypic character matrices of plants from formal taxonomic descriptions. This pipeline uses new natural language processing (NLP) techniques and a glossary of over 9000 botanical terms. Our protocol includes the Explorer of Taxon Concepts (ETC), an online application that assembles taxon-by-character matrices from taxonomic descriptions, and MatrixConverter, a Java application that enables users to evaluate and discretize the characters extracted by ETC. We demonstrate this protocol using descriptions from Araucariaceae. The NLP pipeline unlocks the phenotypic data found in taxonomic descriptions and makes them usable for evolutionary analyses.

Study of space shuttle orbiter system management computer function. Volume 1: Analysis, baseline design

NASA Technical Reports Server (NTRS)

1975-01-01

A system analysis of the shuttle orbiter baseline system management (SM) computer function is performed. This analysis results in an alternative SM design which is also described. The alternative design exhibits several improvements over the baseline, some of which are increased crew usability, improved flexibility, and improved growth potential. The analysis consists of two parts: an application assessment and an implementation assessment. The former is concerned with the SM user needs and design functional aspects. The latter is concerned with design flexibility, reliability, growth potential, and technical risk. The system analysis is supported by several topical investigations. These include: treatment of false alarms, treatment of off-line items, significant interface parameters, and a design evaluation checklist. An in-depth formulation of techniques, concepts, and guidelines for design of automated performance verification is discussed.

Ensuring quality Website redesign: the University of Maryland's experience.

PubMed

Fuller, D M; Hinegardner, P G

2001-10-01

The Web Redesign Committee at the Health Sciences and Human Services Library (HS/HSL) of the University of Maryland was formed to evaluate its site and oversee the site's redesign. The committee's goal was to design a site that would be functional, be usable, and provide the library with a more current image. Based on a literature review and discussions with colleagues, a usability study was conducted to gain a better understanding of how the Website was used. Volunteers from across the campus participated in the study. A Web-based survey was also used to gather feedback. To complement user input, library staff were asked to review the existing site. A prototype site was developed incorporating suggestions obtained from the evaluation mechanisms. The usability study was particularly useful because it identified problem areas, including terminology, which would have been overlooked by library staff. A second usability study was conducted to refine the prototype. The new site was launched in the spring of 2000. The usability studies were valuable mechanisms in designing the site. Users felt invested in the project, and the committee received valuable feedback. This process led to an improved Website and higher visibility for the library on campus.

Evaluating the parent-adolescent communication toolkit: Usability and preliminary content effectiveness of an online intervention.

PubMed

Toombs, Elaine; Unruh, Anita; McGrath, Patrick

2018-01-01

This study aimed to assess the Parent-Adolescent Communication Toolkit, an online intervention designed to help improve parent communication with their adolescents. Participant preferences for two module delivery systems (sequential and unrestricted module access) were identified. Usability assessment of the PACT intervention was completed using pre-test and posttest comparisons. Usability data, including participant completion and satisfaction ratings were examined. Parents ( N  =   18) of adolescents were randomized to a sequential or unrestricted chapter access group. Parent participants completed pre-test measures, the PACT intervention and posttest measures. Participants provided feedback for the intervention to improve modules and provided usability ratings. Adolescent pre- and posttest ratings were evaluated. Usability ratings were high and parent feedback was positive. The sequential module access groups rated the intervention content higher and completed more content than the unrestricted chapter access group, indicating support for the sequential access design. Parent mean posttest communication scores were significantly higher ( p  <   .05) than pre-test scores. No significant differences were detected for adolescent participants. Findings suggest that the Parent-Adolescent Communication Toolkit has potential to improve parent-adolescent communication but further effectiveness assessment is required.

Facilitating energy savings with programmable thermostats: evaluation and guidelines for the thermostat user interface.

PubMed

Peffer, Therese; Perry, Daniel; Pritoni, Marco; Aragon, Cecilia; Meier, Alan

2013-01-01

Thermostats control heating and cooling in homes - representing a major part of domestic energy use - yet, poor ergonomics of these devices has thwarted efforts to reduce energy consumption. Theoretically, programmable thermostats can reduce energy by 5-15%, but in practice little to no savings compared to manual thermostats are found. Several studies have found that programmable thermostats are not installed properly, are generally misunderstood and have poor usability. After conducting a usability study of programmable thermostats, we reviewed several guidelines from ergonomics, general device usability, computer-human interfaces and building control sources. We analysed the characteristics of thermostats that enabled or hindered successfully completing tasks and in a timely manner. Subjects had higher success rates with thermostat displays with positive examples of guidelines, such as visibility of possible actions, consistency and standards, and feedback. We suggested other guidelines that seemed missing, such as navigation cues, clear hierarchy and simple decision paths. Our evaluation of a usability test of five residential programmable thermostats led to the development of a comprehensive set of specific guidelines for thermostat design including visibility of possible actions, consistency, standards, simple decision paths and clear hierarchy. Improving the usability of thermostats may facilitate energy savings.

A web-based communication system for integrated care in cerebral palsy: design features, technical feasibility and usability.

PubMed

Gulmans, Jitske; Vollenbroek-Hutten, Miriam M R; Visser, Jacqueline J W; Nijeweme-d'Hollosy, Wendy Oude; van Gemert-Pijnen, J E W C Lisette; van Harten, Wim H

2010-01-01

We developed a secure, web-based system for parent-professional and inter-professional communication. The aim was to improve communication in the care of children with cerebral palsy. We conducted a six-month trial of the system in three Dutch health-care regions. The participants were the parents of 30 cerebral palsy patients and 120 professional staff involved in their care. Information about system usage was extracted from the system's database. The experience of the parents and professionals was evaluated by a questionnaire after six months. The system proved to be technically robust and reliable. A total of 21 parents (70%) and 66 professionals (55%) used the system. The parents submitted 111 questions and 59 responses, with a mean of 5 questions (range 1-17) and 3 responses (range 1-9) per parent. The professionals submitted 79 questions and 237 responses, with a mean of 2 questions (range 1-8) and 4 responses (range 1-23) per professional. Most parents (95%) and some professionals (30%) reported value in using the system, which ranged from efficiency and accessibility to flexibility and transparency. The web-based communication system was technically feasible and produced improved parent-professional and inter-professional communication. It may be especially valuable if frequent interventions or consultations about a child's care are required, involving complex care networks of different professionals and organisations.

Usability evaluation of the interactive Personal Patient Profile-Prostate decision support system with African American men.

PubMed

Jaja, Cheedy; Pares-Avila, Jose; Wolpin, Seth; Berry, Donna

2010-04-01

The Personal Patient Profile-Prostate (P4) program is an interactive Web-based decision support system that provides men with localized prostate cancer customized education and coaching with which to make the best personal treatment decision. This study assessed functionality and usability of the P4 program and identified problems in user-computer interaction in a sample of African American men. Usability testing was conducted with 12 community-dwelling African American adult men. The health status of participants was not known or collected by the research team. Each participant worked with the P4 program and provided simultaneous feedback using the "think aloud" technique. Handwritten field notes were collated and assigned to 3 standard coded categories. Aspects of P4 program usability was made based on common issues in the assigned categories. Summary statistics were derived for types and frequency of usability issues noted in the coded data. Twelve participants reported a total of 122 usability comments, with a mean of 9 usability comments. The most common usability issue by participant was completeness of information content, which comprised 53 (43%) of the total issues. Comprehensibility of text and graphics was second, comprising 51 (42%) of the total issues. This study provided initial inventory of usability issues for community African American men that may potentially interfere with application of the P4 system in the community setting and overall system usability, confirming the need for usability testing of a culturally appropriate Internet-based decision support system before community application.

Evaluation of Home Health Care Devices: Remote Usability Assessment.

PubMed

Kortum, Philip; Peres, S Camille

2015-06-05

An increasing amount of health care is now performed in a home setting, away from the hospital. While there is growing anecdotal evidence about the difficulty patients and caregivers have using increasingly complex health care devices in the home, there has been little systematic scientific study to quantify the global nature of home health care device usability in the field. Research has tended to focus on a handful of devices, making it difficult to gain a broad view of the usability of home-care devices in general. The objective of this paper is to describe a remote usability assessment method using the System Usability Scale (SUS), and to report on the usability of a broad range of health care devices using this metric. A total of 271 participants selected and rated up to 10 home health care devices of their choice using the SUS, which scores usability from 0 (unusable) to 100 (highly usable). Participants rated a total of 455 devices in their own home without an experimenter present. Usability scores ranged from 98 (oxygen masks) to 59 (home hormone test kits). An analysis conducted on devices that had at least 10 ratings showed that the effect of device on SUS scores was significant (P<.001), and that the usability of these devices was on the low end when compared with other commonly used items in the home, such as microwave ovens and telephones. A large database of usability scores for home health care devices collected using this remote methodology would be beneficial for physicians, patients, and their caregivers.

An app for patient education and self-audit within an enhanced recovery program for bowel surgery: a pilot study assessing validity and usability.

PubMed

Pecorelli, Nicolò; Fiore, Julio F; Kaneva, Pepa; Somasundram, Abarna; Charlebois, Patrick; Liberman, A Sender; Stein, Barry L; Carli, Franco; Feldman, Liane S

2018-05-01

While patient engagement and clinical audit are key components of successful enhanced recovery programs (ERPs), they require substantial resource allocation. The objective of this study was to assess the validity and usability of a novel mobile device application for education and self-reporting of adherence for patients undergoing bowel surgery within an established ERP. Prospectively recruited patients undergoing bowel surgery within an ERP used a novel app specifically designed to provide daily recovery milestones and record adherence to 15 different ERP processes and six patient-reported outcomes (PROs). Validity was measured by the agreement index (Cohen's kappa coefficient for categorical, and interclass correlation coefficient (ICC) for continuous variables) between patient-reported data through the app and data recorded by a clinical auditor. Acceptability and usability of the app were measured by the System Usability Scale (SUS). Forty-five patients participated in the study (mean age 61, 64% male). Overall, patients completed 159 of 179 (89%) of the available questionnaires through the app. Median time to complete a questionnaire was 2 min 49 s (i.q.r. 2'32″-4'36″). Substantial (kappa > 0.6) or almost perfect agreement (kappa > 0.8) and strong correlation (ICC > 0.7) between data collected through the app and by the clinical auditor was found for 14 ERP processes and four PROs. Patient-reported usability was high; mean SUS score was 87 (95% CI 83-91). Only 6 (13%) patients needed technical support to use the app. Forty (89%) patients found the app was helpful to achieve their daily goals, and 34 (76%) thought it increased their motivation to recover after surgery. This novel application provides a tool to record patient adherence to care processes and PROs, with high agreement with traditional clinical audit, high usability, and patient satisfaction. Future studies should investigate the use of mobile device apps as strategies to increase adherence to perioperative interventions.

[Method for the evaluation of the stability and usability after opening packages of orally disintegrating tablets: case of amlodipine besilate products].

PubMed

Hori, Katsuhito; Yoshida, Naoko; Okumura, Tomonori; Okamura, Yasufumi; Kawakami, Junichi

2010-08-01

Orally disintegrating (OD) tablets are widely used in clinical practice. However, drug information on the choice and dispensing based on their stability after opening packages and usability in patients and dispensaries is not sufficient. The aim of this study was to investigate possible evaluation methods of the stability and usability of amlodipine OD tablets. Additives of the brand were changed in April 2009, and therefore the previous and current forms and two generics, current and newly marketed (in November 2009) products of different firms, were used. OD tablets were stored at 25 degrees C and 75% relative humidity for 3 months after opening the packages, and their physicochemical properties were evaluated. Their weight, diameter, thickness, and color difference increased slightly from the initial state. The extent of the change in their hardness, disintegration time, and friability was different among products. These physicochemical changes were acceptable in dispensary practice. Storage after opening the packages did not affect their dissolution rate. The dissolution rate at the initial state of the current brand was slower than that of the previous one. All products used were able to be dispensed by an automatic tablet-packing machine and applied to the so-called simple suspension method for intubational administration. Sensory evaluation tests revealed no major difference in the oral disintegration time, taste, impression, and preference among products. In conclusion, the stability and usability of amlodipine OD tablets used in this study were examined using several methods, and they can be used equivalently from the stability and usability viewpoints.

Dimensions for hearing-impaired mobile application usability model

NASA Astrophysics Data System (ADS)

Nathan, Shelena Soosay; Hussain, Azham; Hashim, Nor Laily; Omar, Mohd Adan

2017-10-01

This paper discuss on the dimensions that has been derived for the hearing-impaired mobile applications usability model. General usability model consist of general dimension for evaluating mobile application however requirements for the hearing-impaired are overlooked and often scanted. This led towards mobile application developed for the hearing-impaired are left unused. It is also apparent that these usability models do not consider accessibility dimensions according to the requirement of the special users. This complicates the work of usability practitioners as well as academician that practices research usability when application are developed for the specific user needs. To overcome this issue, dimension chosen for the hearing-impaired are ensured to be align with the real need of the hearing-impaired mobile application. Besides literature studies, requirements for the hearing-impaired mobile application have been identified through interview conducted with hearing-impaired mobile application users that were recorded as video outputs and analyzed using Nvivo. Finally total of 6 out of 15 dimensions gathered are chosen for the proposed model and presented.

Usability and Culture as Two of the Value Criteria for Evaluating the Artifact

NASA Astrophysics Data System (ADS)

Kurosu, Masaaki

In this paper, the conceptual framework of the Artifact Development Analysis (ADA) and its relationship to the usability engineering are outlined. The ADA analyses the significance of all artifacts including hardware, software, humanware and system. Its viewpoint extends both in temporal and spatial dimensions. In short, it deals with the diversity of the artifact and casts the questions "why it is so" and "why it is not so". In this respect, the ADA is related to the usability engineering as one of the value attitudes. The usability engineering puts emphasis on effectiveness and efficiency. The usability is not always the value criterion of highest importance and some people sometimes put more emphasis on other criteria such as the aesthetic aspect, the cost, etc. Based on the findings of ADA, we should focus on the extent where the usability can provide the core satisfaction and we should also summarize the guideline on how the artifact should be designed.

Iterative User Interface Design for Automated Sequential Organ Failure Assessment Score Calculator in Sepsis Detection

PubMed Central

Herasevich, Vitaly

2017-01-01

Background The new sepsis definition has increased the need for frequent sequential organ failure assessment (SOFA) score recalculation and the clerical burden of information retrieval makes this score ideal for automated calculation. Objective The aim of this study was to (1) estimate the clerical workload of manual SOFA score calculation through a time-motion analysis and (2) describe a user-centered design process for an electronic medical record (EMR) integrated, automated SOFA score calculator with subsequent usability evaluation study. Methods First, we performed a time-motion analysis by recording time-to-task-completion for the manual calculation of 35 baseline and 35 current SOFA scores by 14 internal medicine residents over a 2-month period. Next, we used an agile development process to create a user interface for a previously developed automated SOFA score calculator. The final user interface usability was evaluated by clinician end users with the Computer Systems Usability Questionnaire. Results The overall mean (standard deviation, SD) time-to-complete manual SOFA score calculation time was 61.6 s (33). Among the 24% (12/50) usability survey respondents, our user-centered user interface design process resulted in >75% favorability of survey items in the domains of system usability, information quality, and interface quality. Conclusions Early stakeholder engagement in our agile design process resulted in a user interface for an automated SOFA score calculator that reduced clinician workload and met clinicians’ needs at the point of care. Emerging interoperable platforms may facilitate dissemination of similarly useful clinical score calculators and decision support algorithms as “apps.” A user-centered design process and usability evaluation should be considered during creation of these tools. PMID:28526675

Iterative User Interface Design for Automated Sequential Organ Failure Assessment Score Calculator in Sepsis Detection.

PubMed

Aakre, Christopher Ansel; Kitson, Jaben E; Li, Man; Herasevich, Vitaly

2017-05-18

The new sepsis definition has increased the need for frequent sequential organ failure assessment (SOFA) score recalculation and the clerical burden of information retrieval makes this score ideal for automated calculation. The aim of this study was to (1) estimate the clerical workload of manual SOFA score calculation through a time-motion analysis and (2) describe a user-centered design process for an electronic medical record (EMR) integrated, automated SOFA score calculator with subsequent usability evaluation study. First, we performed a time-motion analysis by recording time-to-task-completion for the manual calculation of 35 baseline and 35 current SOFA scores by 14 internal medicine residents over a 2-month period. Next, we used an agile development process to create a user interface for a previously developed automated SOFA score calculator. The final user interface usability was evaluated by clinician end users with the Computer Systems Usability Questionnaire. The overall mean (standard deviation, SD) time-to-complete manual SOFA score calculation time was 61.6 s (33). Among the 24% (12/50) usability survey respondents, our user-centered user interface design process resulted in >75% favorability of survey items in the domains of system usability, information quality, and interface quality. Early stakeholder engagement in our agile design process resulted in a user interface for an automated SOFA score calculator that reduced clinician workload and met clinicians' needs at the point of care. Emerging interoperable platforms may facilitate dissemination of similarly useful clinical score calculators and decision support algorithms as "apps." A user-centered design process and usability evaluation should be considered during creation of these tools. ©Christopher Ansel Aakre, Jaben E Kitson, Man Li, Vitaly Herasevich. Originally published in JMIR Human Factors (http://humanfactors.jmir.org), 18.05.2017.

Evaluating input device usability as a function of task difficulty in a tracking task.

PubMed

Rupp, Michael A; Oppold, Paul; McConnell, Daniel S

2015-01-01

Game controllers are emerging as a preferred choice for the manual control of unmanned vehicles, but an understanding of their usability characteristics has yet to emerge. We compared the usability of an Xbox 360 game controller in a dual task situation using MATB II to the traditional joystick and keyboard interface in two experiments. In the first experiment, performance with the game controller was associated with fewer tracking errors. In a second experiment, we trained users on the devices, and found that even after training the game controller was still associated with fewer tracking errors as well as higher usability and lower workload ratings. These results are consistent with the idea that game controllers are highly usable input devices and do not require high mental workload to operate, thus making them suitable for complex control tasks.

Checking an integrated model of web accessibility and usability evaluation for disabled people.

PubMed

Federici, Stefano; Micangeli, Andrea; Ruspantini, Irene; Borgianni, Stefano; Corradi, Fabrizio; Pasqualotto, Emanuele; Olivetti Belardinelli, Marta

2005-07-08

A combined objective-oriented and subjective-oriented method for evaluating accessibility and usability of web pages for students with disability was tested. The objective-oriented approach is devoted to verifying the conformity of interfaces to standard rules stated by national and international organizations responsible for web technology standardization, such as W3C. Conversely, the subjective-oriented approach allows assessing how the final users interact with the artificial system, accessing levels of user satisfaction based on personal factors and environmental barriers. Five kinds of measurements were applied as objective-oriented and subjective-oriented tests. Objective-oriented evaluations were performed on the Help Desk web page for students with disability, included in the website of a large Italian state university. Subjective-oriented tests were administered to 19 students labeled as disabled on the basis of their own declaration at the University enrolment: 13 students were tested by means of the SUMI test and six students by means of the 'Cooperative evaluation'. Objective-oriented and subjective-oriented methods highlighted different and sometimes conflicting results. Both methods have pointed out much more consistency regarding levels of accessibility than of usability. Since usability is largely affected by individual differences in user's own (dis)abilities, subjective-oriented measures underscored the fact that blind students encountered much more web surfing difficulties.

A Concise and Practical Framework for the Development and Usability Evaluation of Patient Information Websites

PubMed Central

Knijnenburg, S.L.; Kremer, L.C.; Jaspers, M.W.M.

2015-01-01

Summary Background The Website Developmental Model for the Healthcare Consumer (WDMHC) is an extensive and successfully evaluated framework that incorporates user-centered design principles. However, due to its extensiveness its application is limited. In the current study we apply a subset of the WDMHC framework in a case study concerning the development and evaluation of a website aimed at childhood cancer survivors (CCS). Objective To assess whether the implementation of a limited subset of the WDMHC-framework is sufficient to deliver a high-quality website with few usability problems, aimed at a specific patient population. Methods The website was developed using a six-step approach divided into three phases derived from the WDMHC: 1) information needs analysis, mock-up creation and focus group discussion; 2) website prototype development; and 3) heuristic evaluation (HE) and think aloud analysis (TA). The HE was performed by three double experts (knowledgeable both in usability engineering and childhood cancer survivorship), who assessed the site using the Nielsen heuristics. Eight end-users were invited to complete three scenarios covering all functionality of the website by TA. Results The HE and TA were performed concurrently on the website prototype. The HE resulted in 29 unique usability issues; the end-users performing the TA encountered eleven unique problems. Four issues specifically revealed by HE concerned cosmetic design flaws, whereas two problems revealed by TA were related to website content. Conclusion Based on the subset of the WDMHC framework we were able to deliver a website that closely matched the expectancy of the end-users and resulted in relatively few usability problems during end-user testing. With the successful application of this subset of the WDMHC, we provide developers with a clear and easily applicable framework for the development of healthcare websites with high usability aimed at specific medical populations. PMID:26171083

Health figures: an open source JavaScript library for health data visualization.

PubMed

Ledesma, Andres; Al-Musawi, Mohammed; Nieminen, Hannu

2016-03-22

The way we look at data has a great impact on how we can understand it, particularly when the data is related to health and wellness. Due to the increased use of self-tracking devices and the ongoing shift towards preventive medicine, better understanding of our health data is an important part of improving the general welfare of the citizens. Electronic Health Records, self-tracking devices and mobile applications provide a rich variety of data but it often becomes difficult to understand. We implemented the hFigures library inspired on the hGraph visualization with additional improvements. The purpose of the library is to provide a visual representation of the evolution of health measurements in a complete and useful manner. We researched the usefulness and usability of the library by building an application for health data visualization in a health coaching program. We performed a user evaluation with Heuristic Evaluation, Controlled User Testing and Usability Questionnaires. In the Heuristics Evaluation the average response was 6.3 out of 7 points and the Cognitive Walkthrough done by usability experts indicated no design or mismatch errors. In the CSUQ usability test the system obtained an average score of 6.13 out of 7, and in the ASQ usability test the overall satisfaction score was 6.64 out of 7. We developed hFigures, an open source library for visualizing a complete, accurate and normalized graphical representation of health data. The idea is based on the concept of the hGraph but it provides additional key features, including a comparison of multiple health measurements over time. We conducted a usability evaluation of the library as a key component of an application for health and wellness monitoring. The results indicate that the data visualization library was helpful in assisting users in understanding health data and its evolution over time.

Cognitive engineering of film library transition from film medium to digital environment in a Texas teaching hospital.

PubMed

Koperwhats, Martha A; Chang, Wei-Chih; Xiao, Jianguo

2002-01-01

Digital imaging technology promises efficient, economical, and fast service for patient care, but the challenges are great in the transition from film to a filmless (digital) environment. This change has a significant impact on the film library's personnel (film librarians) who play a leading roles in storage, classification, and retrieval of images. The objectives of this project were to study film library errors and the usability of a physical computerized system that could not be changed, while developing an intervention to reduce errors and test the usability of the intervention. Cognitive and human factors analysis were used to evaluate human-computer interaction. A workflow analysis was performed to understand the film and digital imaging processes. User and task analyses were applied to account for all behaviors involved in interaction with the system. A heuristic evaluation was used to probe the usability issues in the picture archiving and communication systems (PACS) modules. Simplified paper-based instructions were designed to familiarize the film librarians with the digital system. A usability survey evaluated the effectiveness of the instruction. The user and task analyses indicated that different users faced challenges based on their computer literacy, education, roles, and frequency of use of diagnostic imaging. The workflow analysis showed that the approaches to using the digital library differ among the various departments. The heuristic evaluation of the PACS modules showed the human-computer interface to have usability issues that prevented easy operation. Simplified instructions were designed for operation of the modules. Usability surveys conducted before and after revision of the instructions showed that performance improved. Cognitive and human factor analysis can help film librarians and other users adapt to the filmless system. Use of cognitive science tools will aid in successful transition of the film library from a film environment to a digital environment.

Low-Cost Rapid Usability Testing: Its Application in Both Product Development and System Implementation.

PubMed

Kushniruk, Andre; Borycki, Elizabeth

2017-01-01

In recent years there has been considerable discussion around the need for certification and regulation of healthcare information technology (IT). In particular, the usability of the products being developed needs to be evaluated. This has included the application of standards designed to ensure the process of system development is user-centered and takes usability into consideration while a product is being developed. In addition to this, in healthcare, organizations in the United States and Europe have also addressed the need and requirement for product certification. However, despite these efforts there are continued reports of unusable and unsafe implementations. In this paper we discuss the need to not only include (and require) usability testing in the one-time development process of health IT products (such as EHRs), but we also argue for the need to additionally develop specific usability standards and requirements for usability testing during the implementation of vendor products (i.e. post product development) in healthcare settings. It is further argued that health IT products that may have been certified regarding their development process will still require application of usability testing in the process of implementing them in real hospital settings in order to ensure usability and safety. This is needed in order to ensure that the final result of both product development and implementation processes take into account and apply the latest usability principles and methods.

Development and usability evaluation of the mHealth Tool for Lung Cancer (mHealth TLC): A virtual world health game for lung cancer patients

PubMed Central

Brown-Johnson, Cati G.; Berrean, Beth; Cataldo, Janine K.

2015-01-01

Objective To test the feasibility and usability of mHealth TLC, an interactive, immersive 3-dimensional iPad health game that coaches lung cancer patients toward assertive communication strategies during first-person virtual clinics visits. Method We observed players and conducted semi-structured interviews. Research questions focused on scenario believability, the impact of technical issues, transparency of game goals, and potential of mHealth TLC to decrease lung cancer stigma (LCS) and improve patient–clinician communication. Results Eight users confirmed mHealth TLC to be: (1) believable, (2) clinic-appropriate, and (3) helpful in support of informed healthcare consumers. Concerns were expressed about emotionally charged content and plans to use mHealth TLC in clinic settings as opposed to at home. Conclusions Although the dialog and interactions addressed emotionally charged issues, players were able to engage, learn, and benefit from role-play in a virtual world. Health games have the potential to improve patient–clinician communication, and mHealth TLC specifically may decrease LCS, and promote optimal self-management. Practice implications Process reflection revealed the need for health games to be created by experienced game developers in collaboration with health care experts. To prepare for this best practice, research institutions and game developers interested in health games should proactively seek out networking and collaboration opportunities. PMID:25620075

Integrating cancer survivors' experiences into UK cancer registries: design and development of the ePOCS system (electronic Patient-reported Outcomes from Cancer Survivors)

PubMed Central

Ashley, L; Jones, H; Thomas, J; Forman, D; Newsham, A; Morris, E; Johnson, O; Velikova, G; Wright, P

2011-01-01

Background: Understanding the psychosocial challenges of cancer survivorship, and identifying which patients experience ongoing difficulties, is a key priority. The ePOCS (electronic patient-reported outcomes from cancer survivors) project aims to develop and evaluate a cost-efficient, UK-scalable electronic system for collecting patient-reported outcome measures (PROMs), at regular post-diagnostic timepoints, and linking these with clinical data in cancer registries. Methods: A multidisciplinary team developed the system using agile methods. Design entailed process mapping the system's constituent parts, data flows and involved human activities, and undertaking usability testing. Informatics specialists built new technical components, including a web-based questionnaire tool and tracking database, and established component-connecting data flows. Development challenges were overcome, including patient usability and data linkage and security. Results: We have developed a system in which PROMs are completed online, using a secure questionnaire administration tool, accessed via a public-facing website, and the responses are linked and stored with clinical registry data. Patient monitoring and communications are semiautomated via a tracker database, and patient correspondence is primarily Email-based. The system is currently honed for clinician-led hospital-based patient recruitment. Conclusions: A feasibility test study is underway. Although there are possible challenges to sustaining and scaling up ePOCS, the system has potential to support UK epidemiological PROMs collection and clinical data linkage. PMID:22048035

Development and usability evaluation of the mHealth Tool for Lung Cancer (mHealth TLC): a virtual world health game for lung cancer patients.

PubMed

Brown-Johnson, Cati G; Berrean, Beth; Cataldo, Janine K

2015-04-01

To test the feasibility and usability of mHealth TLC, an interactive, immersive 3-dimensional iPad health game that coaches lung cancer patients toward assertive communication strategies during first-person virtual clinics visits. We observed players and conducted semi-structured interviews. Research questions focused on scenario believability, the impact of technical issues, transparency of game goals, and potential of mHealth TLC to decrease lung cancer stigma (LCS) and improve patient-clinician communication. Eight users confirmed mHealth TLC to be: (1) believable, (2) clinic-appropriate, and (3) helpful in support of informed healthcare consumers. Concerns were expressed about emotionally charged content and plans to use mHealth TLC in clinic settings as opposed to at home. Although the dialog and interactions addressed emotionally charged issues, players were able to engage, learn, and benefit from role-play in a virtual world. Health games have the potential to improve patient-clinician communication, and mHealth TLC specifically may decrease LCS, and promote optimal self-management. Process reflection revealed the need for health games to be created by experienced game developers in collaboration with health care experts. To prepare for this best practice, research institutions and game developers interested in health games should proactively seek out networking and collaboration opportunities. Copyright © 2015 Elsevier Ireland Ltd. All rights reserved.

Mobile applications for diabetics: a systematic review and expert-based usability evaluation considering the special requirements of diabetes patients age 50 years or older.

PubMed

Arnhold, Madlen; Quade, Mandy; Kirch, Wilhelm

2014-04-09

A multitude of mhealth (mobile health) apps have been developed in recent years to support effective self-management of patients with diabetes mellitus type 1 or 2. We carried out a systematic review of all currently available diabetes apps for the operating systems iOS and Android. We considered the number of newly released diabetes apps, range of functions, target user groups, languages, acquisition costs, user ratings, available interfaces, and the connection between acquisition costs and user ratings. Additionally, we examined whether the available applications serve the special needs of diabetes patients aged 50 or older by performing an expert-based usability evaluation. We identified relevant keywords, comparative categories, and their specifications. Subsequently, we performed the app review based on the information given in the Google Play Store, the Apple App Store, and the apps themselves. In addition, we carried out an expert-based usability evaluation based on a representative 10% sample of diabetes apps. In total, we analyzed 656 apps finding that 355 (54.1%) offered just one function and 348 (53.0%) provided a documentation function. The dominating app language was English (85.4%, 560/656), patients represented the main user group (96.0%, 630/656), and the analysis of the costs revealed a trend toward free apps (53.7%, 352/656). The median price of paid apps was €1.90. The average user rating was 3.6 stars (maximum 5). Our analyses indicated no clear differences in the user rating between free and paid apps. Only 30 (4.6%) of the 656 available diabetes apps offered an interface to a measurement device. We evaluated 66 apps within the usability evaluation. On average, apps were rated best regarding the criterion "comprehensibility" (4.0 out of 5.0), while showing a lack of "fault tolerance" (2.8 out of 5.0). Of the 66 apps, 48 (72.7%) offered the ability to read the screen content aloud. The number of functions was significantly negative correlated with usability. The presence of documentation and analysis functions reduced the usability score significantly by 0.36 and 0.21 points. A vast number of diabetes apps already exist, but the majority offer similar functionalities and combine only one to two functions in one app. Patients and physicians alike should be involved in the app development process to a greater extent. We expect that the data transmission of health parameters to physicians will gain more importance in future applications. The usability of diabetes apps for patients aged 50 or older was moderate to good. But this result applied mainly to apps offering a small range of functions. Multifunctional apps performed considerably worse in terms of usability. Moreover, the presence of a documentation or analysis function resulted in significantly lower usability scores. The operability of accessibility features for diabetes apps was quite limited, except for the feature "screen reader".

Virtually Usable: A Test of the Information Gardens

ERIC Educational Resources Information Center

Johnson, Megan; Ochoa, Louise; Purpur, Geraldine

2007-01-01

This paper presents the results of a usability study conducted to determine the functionality of a desktop, three-dimensional virtual library designed and supported by the Appalachian State University Distance Learning Library Services team. Formative evaluations were performed with representative students utilizing Morae software. Results…

Usability testing of an mHealth device for swallowing therapy in head and neck cancer survivors.

PubMed

Constantinescu, Gabriela; Kuffel, Kristina; King, Ben; Hodgetts, William; Rieger, Jana

2018-04-01

The objective of this study was to conduct the first patient usability testing of a mobile health (mHealth) system for in-home swallowing therapy. Five participants with a history of head and neck cancer evaluated the mHealth system. After completing an in-application (app) tutorial with the clinician, participants were asked to independently complete five tasks: pair the device to the smartphone, place the device correctly, exercise, interpret progress displays, and close the system. Quantitative and qualitative methods were used to evaluate the effectiveness, efficiency, and satisfaction with the system. Critical changes to the app were found in three of the tasks, resulting in recommendations for the next iteration. These issues were related to ease of Bluetooth pairing, placement of device, and interpretation of statistics. Usability testing with patients identified issues that were essential to address prior to implementing the mHealth system in subsequent clinical trials. Of the usability methods used, video observation (synced screen capture with videoed gestures) revealed the most information.

Evacuation support system for improved medical documentation and information flow in the field.

PubMed

Walderhaug, Ståle; Meland, Per Håkon; Mikalsen, Marius; Sagen, Terje; Brevik, John Ivar

2008-02-01

Documentation of medical treatment and observation of patients during evacuation from the point of injury to definitive treatment is important both for optimizing patient treatment and managing the evacuation process. The current practice in military medical field documentation uses paper forms and voice communication. There are many shortcomings associated with this approach, especially with respect to information capture and sharing processes. Current research addresses the use of new technology for civilian ambulance-to-hospital communication. The research work presented in this article addresses information capture and sharing in extreme military conditions by evaluating a targeted computerized information system called EvacSys during a military exercise in northern Norway in December 2003. EvacSys was designed and implemented in close cooperation with military medical personnel in both Norway and the USA. The system was evaluated and compared to the traditional paper-based documentation method during a military exercise. The on-site evaluation was conducted in a military medical platoon in the Norwegian Armed Forces, using questionnaires, semi-structured interviews, observation and video recording to capture the users' system acceptance. A prototype software system running on a commercial off-the-shelf hardware platform was successfully developed. The evaluation of this system shows that the usability of digital information capturing and sharing are perceived to be at least as good as the traditional paper-based method. The medics found the new digital method to be more viable than the old one. No technical problems were encountered. Our research shows that it is feasible to utilize digital information systems for medical documentation in extreme outdoor environments. The usability concern is of utmost importance, and more research should be put into the design and alignment with existing workflow. Successful digitalization of information at the point of care will provide accurate and timely information for the management of resources during disaster response.

LOX/hydrocarbon rocket engine analytical design methodology development and validation. Volume 1: Executive summary and technical narrative

NASA Technical Reports Server (NTRS)

Pieper, Jerry L.; Walker, Richard E.

1993-01-01

During the past three decades, an enormous amount of resources were expended in the design and development of Liquid Oxygen/Hydrocarbon and Hydrogen (LOX/HC and LOX/H2) rocket engines. A significant portion of these resources were used to develop and demonstrate the performance and combustion stability for each new engine. During these efforts, many analytical and empirical models were developed that characterize design parameters and combustion processes that influence performance and stability. Many of these models are suitable as design tools, but they have not been assembled into an industry-wide usable analytical design methodology. The objective of this program was to assemble existing performance and combustion stability models into a usable methodology capable of producing high performing and stable LOX/hydrocarbon and LOX/hydrogen propellant booster engines.

Evaluation of English Websites on Dental Caries by Using Consumer Evaluation Tools.

PubMed

Blizniuk, Anastasiya; Furukawa, Sayaka; Ueno, Masayuki; Kawaguchi, Yoko

2016-01-01

To evaluate the quality of patient-oriented online information about dental caries using existing consumer evaluation tools and to judge the efficacy of these tools in quality assessment. The websites for the evaluation were pooled by using two general search engines (Google and Yahoo!). The search terms were: 'dental caries', 'tooth decay' and 'tooth cavity'. Three assessment tools (LIDA, DISCERN and FRES) were used to evaluate the quality of the information in the areas of accessibility, usability, reliability and readability. In total, 77 websites were analysed. The median scores of LIDA accessibility and usability were 45.0 and 8.0, respectively, which corresponded to a medium level of quality. The median reliability scores for LIDA (12.0) and DISCERN (20.0) both corresponded to low level of quality. The readability was high with the median FRES score 59.7. The websites on caries had good accessibility, usability and readability, while reliability of the information was poor. The LIDA instrument was found to be more convenient than DISCERN and can be recommended to lay people for quick quality assessment.

Patient safety related to the use of medical devices: a review and investigation of the current status in the medical device industry.

PubMed

Geissler, Norman; Byrnes, Trevor; Lauer, Wolfgang; Radermacher, Klaus; Kotzsch, Susanne; Korb, Werner; Hölscher, Uvo M

2013-02-01

To reduce the risk of application error, the federal legislator has demanded a development process which is oriented towards usability (DIN EN 62366). Therefore, the research question concerns the application of this standard by medical device manufacturers. Questionnaires were filled out by five trained interviewers in fully standardized face-to-face interviews at MEDICA Düsseldorf 2010. The results are based on 65 interviews. Almost all companies evaluated usability as relevant for product development; however, the understanding of usability through companies can still be improved as well as increasing the amount of trained usability experts in the process.

A Human Reliability Based Usability Evaluation Method for Safety-Critical Software

DOE Office of Scientific and Technical Information (OSTI.GOV)

Phillippe Palanque; Regina Bernhaupt; Ronald Boring

2006-04-01

Recent years have seen an increasing use of sophisticated interaction techniques including in the field of safety critical interactive software [8]. The use of such techniques has been required in order to increase the bandwidth between the users and systems and thus to help them deal efficiently with increasingly complex systems. These techniques come from research and innovation done in the field of humancomputer interaction (HCI). A significant effort is currently being undertaken by the HCI community in order to apply and extend current usability evaluation techniques to these new kinds of interaction techniques. However, very little has been donemore » to improve the reliability of software offering these kinds of interaction techniques. Even testing basic graphical user interfaces remains a challenge that has rarely been addressed in the field of software engineering [9]. However, the non reliability of interactive software can jeopardize usability evaluation by showing unexpected or undesired behaviors. The aim of this SIG is to provide a forum for both researchers and practitioners interested in testing interactive software. Our goal is to define a roadmap of activities to cross fertilize usability and reliability testing of these kinds of systems to minimize duplicate efforts in both communities.« less

The quality of orthodontic practice websites.

PubMed

Parekh, J; Gill, D S

2014-05-01

To evaluate orthodontic practice websites for the reliability of information presented, accessibility, usability for patients and compliance to General Dental Council (GDC) regulations on ethical advertising. World Wide Web. The term 'orthodontic practice' was entered into three separate search engines. The 30 websites from the UK were selected and graded according to the LIDA tool (a validated method of evaluating healthcare websites) for accessibility, usability of the website and reliability of information on orthodontic treatment. The websites were then evaluated against the GDC's Principles for ethical advertising in nine different criteria. On average, each website fulfilled six out of nine points of the GDC's criteria, with inclusion of a complaints policy being the most poorly fulfilled criteria. The mean LIDA score (a combination of usability, reliability and accessibility) was 102/144 (standard deviation 8.38). The websites scored most poorly on reliability (average 43% SD 11.7), with no single website reporting a clear, reliable method of content production. Average accessibility was 81% and usability 73%. In general, websites did not comply with GDC guidelines on ethical advertising. Furthermore, practitioners should consider reporting their method of information production, particularly when making claims about efficiency and speed of treatment in order to improve reliability.

77 FR 8217 - Evaluating the Usability of Electronic Health Record (EHR) Systems

Federal Register 2010, 2011, 2012, 2013, 2014

2012-02-14

... interface design guidelines for EHRs. Manufacturers interested in participating in this research will be... the usability of health information technology (HIT) systems. NIST research is designed to: (1... develop performance-oriented user interface design guidelines for EHRs, and a framework for assessing the...

Tree Testing of Hierarchical Menu Structures for Health Applications

PubMed Central

Le, Thai; Chaudhuri, Shomir; Chung, Jane; Thompson, Hilaire J; Demiris, George

2014-01-01

To address the need for greater evidence-based evaluation of Health Information Technology (HIT) systems we introduce a method of usability testing termed tree testing. In a tree test, participants are presented with an abstract hierarchical tree of the system taxonomy and asked to navigate through the tree in completing representative tasks. We apply tree testing to a commercially available health application, demonstrating a use case and providing a comparison with more traditional in-person usability testing methods. Online tree tests (N=54) and in-person usability tests (N=15) were conducted from August to September 2013. Tree testing provided a method to quantitatively evaluate the information structure of a system using various navigational metrics including completion time, task accuracy, and path length. The results of the analyses compared favorably to the results seen from the traditional usability test. Tree testing provides a flexible, evidence-based approach for researchers to evaluate the information structure of HITs. In addition, remote tree testing provides a quick, flexible, and high volume method of acquiring feedback in a structured format that allows for quantitative comparisons. With the diverse nature and often large quantities of health information available, addressing issues of terminology and concept classifications during the early development process of a health information system will improve navigation through the system and save future resources. Tree testing is a usability method that can be used to quickly and easily assess information hierarchy of health information systems. PMID:24582924

Usability analysis of 2D graphics software for designing technical clothing.

PubMed

Teodoroski, Rita de Cassia Clark; Espíndola, Edilene Zilma; Silva, Enéias; Moro, Antônio Renato Pereira; Pereira, Vera Lucia D V

2012-01-01

With the advent of technology, the computer became a working tool increasingly present in companies. Its purpose is to increase production and reduce the inherent errors in manual production. The aim of this study was to analyze the usability of 2D graphics software in creating clothing designs by a professional during his work. The movements of the mouse, keyboard and graphical tools were monitored in real time by software Camtasia 7® installed on the user's computer. To register the use of mouse and keyboard we used auxiliary software called MouseMeter®, which quantifies the number of times they pressed the right, middle and left mouse's buttons, the keyboard and also the distance traveled in meters by the cursor on the screen. Data was collected in periods of 15 minutes, 1 hour and 8 hours, consecutively. The results showed that the job is considered repetitive and high demands physical efforts, which can lead to the appearance of repetitive strain injuries. Thus, the goal of minimizing operator efforts and thereby enhance the usability of the examined tool, becomes imperative to replace the mouse by a device called tablet, which also offers an electronic pen and a drawing platform for design development.

Usability Assessment of the Missouri Cancer Registry's Published Interactive Mapping Reports: Round One.

PubMed

Ben Ramadan, Awatef Ahmed; Jackson-Thompson, Jeannette; Schmaltz, Chester Lee

2017-08-04

 Many users of spatial data have difficulty interpreting information in health-related spatial reports. The Missouri Cancer Registry and Research Center (MCR-ARC) has produced interactive reports for several years. These reports have never been tested for usability.  The aims of this study were to: (1) conduct a multi-approach usability testing study to understand ease of use (user friendliness) and user satisfaction; and (2) evaluate the usability of MCR-ARC's published InstantAtlas reports.   An institutional review board (IRB) approved mixed methodology usability testing study using a convenience sample of health professionals. A recruiting email was sent to faculty in the Master of Public Health program and to faculty and staff in the Department of Health Management and Informatics at the University of Missouri-Columbia. The study included 7 participants. The test included a pretest questionnaire, a multi-task usability test, and the System Usability Scale (SUS). Also, the researchers collected participants' comments about the tested maps immediately after every trial. Software was used to record the computer screen during the trial and the participants' spoken comments. Several performance and usability metrics were measured to evaluate the usability of MCR-ARC's published mapping reports. Of the 10 assigned tasks, 6 reached a 100% completion success rate, and this outcome was relative to the complexity of the tasks. The simple tasks were handled more efficiently than the complicated tasks. The SUS score ranged between 20-100 points, with an average of 62.7 points and a median of 50.5 points. The tested maps' effectiveness outcomes were better than the efficiency and satisfaction outcomes. There was a statistically significant relationship between the subjects' performance on the study test and the users' previous experience with geographic information system (GIS) tools (P=.03). There were no statistically significant relationships between users' performance and satisfaction and their education level, work type, or previous experience in health care (P>.05). There were strong positive correlations between the three measured usability elements. The tested maps should undergo an extensive refining and updating to overcome all the discovered usability issues and meet the perspectives and needs of the tested maps' potential users. The study results might convey the perspectives of academic health professionals toward GIS health data. We need to conduct a second-round usability study with public health practitioners and cancer professionals who use GIS tools on a routine basis. Usability testing should be conducted before and after releasing MCR-ARC's maps in the future. ©Awatef Ahmed Ben Ramadan, Jeannette Jackson-Thompson, Chester Lee Schmaltz. Originally published in JMIR Human Factors (http://humanfactors.jmir.org), 04.08.2017.

Usability Assessment of the Missouri Cancer Registry’s Published Interactive Mapping Reports: Round One

PubMed Central

Jackson-Thompson, Jeannette; Schmaltz, Chester Lee

2017-01-01

Background  Many users of spatial data have difficulty interpreting information in health-related spatial reports. The Missouri Cancer Registry and Research Center (MCR-ARC) has produced interactive reports for several years. These reports have never been tested for usability. Objective  The aims of this study were to: (1) conduct a multi-approach usability testing study to understand ease of use (user friendliness) and user satisfaction; and (2) evaluate the usability of MCR-ARC’s published InstantAtlas reports. Methods   An institutional review board (IRB) approved mixed methodology usability testing study using a convenience sample of health professionals. A recruiting email was sent to faculty in the Master of Public Health program and to faculty and staff in the Department of Health Management and Informatics at the University of Missouri-Columbia. The study included 7 participants. The test included a pretest questionnaire, a multi-task usability test, and the System Usability Scale (SUS). Also, the researchers collected participants’ comments about the tested maps immediately after every trial. Software was used to record the computer screen during the trial and the participants’ spoken comments. Several performance and usability metrics were measured to evaluate the usability of MCR-ARC’s published mapping reports. Results Of the 10 assigned tasks, 6 reached a 100% completion success rate, and this outcome was relative to the complexity of the tasks. The simple tasks were handled more efficiently than the complicated tasks. The SUS score ranged between 20-100 points, with an average of 62.7 points and a median of 50.5 points. The tested maps’ effectiveness outcomes were better than the efficiency and satisfaction outcomes. There was a statistically significant relationship between the subjects’ performance on the study test and the users’ previous experience with geographic information system (GIS) tools (P=.03). There were no statistically significant relationships between users’ performance and satisfaction and their education level, work type, or previous experience in health care (P>.05). There were strong positive correlations between the three measured usability elements. Conclusions The tested maps should undergo an extensive refining and updating to overcome all the discovered usability issues and meet the perspectives and needs of the tested maps’ potential users. The study results might convey the perspectives of academic health professionals toward GIS health data. We need to conduct a second-round usability study with public health practitioners and cancer professionals who use GIS tools on a routine basis. Usability testing should be conducted before and after releasing MCR-ARC’s maps in the future. PMID:28778842

Adapting Nielsen’s Design Heuristics to Dual Processing for Clinical Decision Support

PubMed Central

Taft, Teresa; Staes, Catherine; Slager, Stacey; Weir, Charlene

2016-01-01

The study objective was to improve the applicability of Nielson’s standard design heuristics for evaluating electronic health record (EHR) alerts and linked ordering support by integrating them with Dual Process theory. Through initial heuristic evaluation and a user study of 7 physicians, usability problems were identified. Through independent mapping of specific usability criteria to support for each of the Dual Cognitive processes (S1 and S2) and deliberation, agreement was reached on mapping criteria. Finally, usability errors from the heuristic and user study were mapped to S1 and S2. Adding a dual process perspective to specific heuristic analysis increases the applicability and relevance of computerized health information design evaluations. This mapping enables designers to measure that their systems are tailored to support attention allocation. System 1 will be supported by improving pattern recognition and saliency, and system 2 through efficiency and control of information access. PMID:28269915

Adapting Nielsen's Design Heuristics to Dual Processing for Clinical Decision Support.

PubMed

Taft, Teresa; Staes, Catherine; Slager, Stacey; Weir, Charlene

2016-01-01

The study objective was to improve the applicability of Nielson's standard design heuristics for evaluating electronic health record (EHR) alerts and linked ordering support by integrating them with Dual Process theory. Through initial heuristic evaluation and a user study of 7 physicians, usability problems were identified. Through independent mapping of specific usability criteria to support for each of the Dual Cognitive processes (S1 and S2) and deliberation, agreement was reached on mapping criteria. Finally, usability errors from the heuristic and user study were mapped to S1 and S2. Adding a dual process perspective to specific heuristic analysis increases the applicability and relevance of computerized health information design evaluations. This mapping enables designers to measure that their systems are tailored to support attention allocation. System 1 will be supported by improving pattern recognition and saliency, and system 2 through efficiency and control of information access.

Usability Evaluation of Clinical Guidelines on the Web Using Eye-Tracker.

PubMed

Khodambashi, Soudabeh; Gilstad, Heidi; Nytrø, Øystein

2016-01-01

Publishing clinical guidelines (GLs) on the web increases their accessibility. However, evaluating their usability and understanding how users interact with the websites has been neglected. In this study we used Tobii eye-tracker to analyse users' interaction with five commercial and public GL sites popular in Norway (four in Norwegian and one English of US origin (UpToDate)). We measured number of clicks and usage rate for search functions, task completion time, users' objective and perception of task success rate. We also measured learning effect for inexperienced users. We found a direct correlation between participant's satisfaction regarding website usability and the time spent, number of mouse clicks and use of search function to obtain the desired results. Our study showed that users' perceived success rate was not reliable and GL publishers should evaluate their website regarding presentation format, layout, navigation bar and search function.

Multi-Level Cultural Models

DTIC Science & Technology

2014-11-05

usable simulations. This procedure was to be tested using real-world data collected from open-source venues. The final system would support rapid...assess social change. Construct is an agent-based dynamic-network simulation system design to allow the user to assess the spread of information and...protest or violence. Technical Challenges Addressed  Re‐use:    Most agent-based simulation ( ABM ) in use today are one-off. In contrast, we

Beyond Nunn-Lugar: Curbing the Next Wave of Weapons Proliferation Threat from Russia

DTIC Science & Technology

2002-04-01

international commerce in nuclear weapons-usable fuels. In addition to identifying these differences, the study’s working groups used competitive ...that Russian technical students continue to attract in international competitions , etc. 52. Author interviews with MFTI, St. Petersburg...book is different from other studies of U.S.-Russian cooperation because it relies on competitive strategies, which detail how best to pit one’s

A usability evaluation of Lazada mobile application

NASA Astrophysics Data System (ADS)

Hussain, Azham; Mkpojiogu, Emmanuel O. C.; Jamaludin, Nur Hafiza; Moh, Somia T. L.

2017-10-01

This paper reports on a usability evaluation of Lazada mobile application, an online shopping app for mobile devices. The evaluation was conducted using 12 users of ages 18 to 24. Seven (7) were expert users and the other 5 were novice users. The study objectives were to evaluate the perceived effectiveness, efficiency and satisfaction of the mobile application. The result provides a positive feedback and shows that the mobile shopping app is effective, efficient, and satisfying as perceived by the study participants. However, there are some observed usability issues with the main menu and the payment method that necessitates improvements to increase the application's effectiveness, efficiency and satisfaction. The suggested improvements include: 1) the main menu should be capitalized and place on the left side of mobile app and 2) payment method tutorial should be included as a hyperlink in the payment method page. This observation will be helpful to the owners of the application in future version development of the app.

Evaluation of Sensor Configurations for Robotic Surgical Instruments

PubMed Central

Gómez-de-Gabriel, Jesús M.; Harwin, William

2015-01-01

Designing surgical instruments for robotic-assisted minimally-invasive surgery (RAMIS) is challenging due to constraints on the number and type of sensors imposed by considerations such as space or the need for sterilization. A new method for evaluating the usability of virtual teleoperated surgical instruments based on virtual sensors is presented. This method uses virtual prototyping of the surgical instrument with a dual physical interaction, which allows testing of different sensor configurations in a real environment. Moreover, the proposed approach has been applied to the evaluation of prototypes of a two-finger grasper for lump detection by remote pinching. In this example, the usability of a set of five different sensor configurations, with a different number of force sensors, is evaluated in terms of quantitative and qualitative measures in clinical experiments with 23 volunteers. As a result, the smallest number of force sensors needed in the surgical instrument that ensures the usability of the device can be determined. The details of the experimental setup are also included. PMID:26516863

Evaluation of Sensor Configurations for Robotic Surgical Instruments.

PubMed

Gómez-de-Gabriel, Jesús M; Harwin, William

2015-10-27

Designing surgical instruments for robotic-assisted minimally-invasive surgery (RAMIS) is challenging due to constraints on the number and type of sensors imposed by considerations such as space or the need for sterilization. A new method for evaluating the usability of virtual teleoperated surgical instruments based on virtual sensors is presented. This method uses virtual prototyping of the surgical instrument with a dual physical interaction, which allows testing of different sensor configurations in a real environment. Moreover, the proposed approach has been applied to the evaluation of prototypes of a two-finger grasper for lump detection by remote pinching. In this example, the usability of a set of five different sensor configurations, with a different number of force sensors, is evaluated in terms of quantitative and qualitative measures in clinical experiments with 23 volunteers. As a result, the smallest number of force sensors needed in the surgical instrument that ensures the usability of the device can be determined. The details of the experimental setup are also included.

A Facebook-Based Obesity Prevention Program for Korean American Adolescents: Usability Evaluation.

PubMed

Park, Bu Kyung; Nahm, Eun-Shim; Rogers, Valerie E; Choi, Mona; Friedmann, Erika; Wilson, Marisa; Koru, Gunes

Adolescent obesity is one of the most serious global public health challenges. Social networking sites are currently popular among adolescents. Therefore, the obesity prevention program for Korean American adolescents was developed on the most popular social networking site, Facebook. The purpose of this study was to evaluate the usability of a culturally tailored Facebook-based obesity prevention program for Korean American adolescents (Healthy Teens). An explorative descriptive design of usability testing was used. Usability testing employing one-on-one observation, the think-aloud method, audio taping, screen activity capture, and surveys was performed. Twenty participants were recruited from two Korean language schools (mean age, 15.40 ± 1.50 years). Recruitment and user testing was performed between February and April 2014. Content analysis, using the inductive coding approach, was performed by three coders to analyze transcriptions. Descriptive statistics were used to analyze quantitative data including demographic characteristics, perceived usability, eHealth literacy, and health behaviors. Testing revealed several usability issues in content, appearance, and navigation. Participants' comments regarding content were positive. Although the Facebook platform provided limited flexibility with respect to building the site, participants described the program's appearance as appropriate. Most participants did not experience difficulty in navigating the program. Our preliminary findings indicated that participants perceived the Healthy Teens program as usable and useful. This program could be used as a robust platform for the delivery of health education to adolescents. Further research is required to assess the effects of Facebook-based programs on adolescent obesity prevention. Copyright © 2016 National Association of Pediatric Nurse Practitioners. Published by Elsevier Inc. All rights reserved.

Bus use and older people: a literature review applying the Person-Environment-Occupation model in macro practice.

PubMed

Broome, Kieran; McKenna, Kryss; Fleming, Jennifer; Worrall, Linda

2009-03-01

The same reasons that prompt older people to give up driving can also result in difficulties with accessing public transport. Difficulties using public transport can limit older people's participation in society, thereby impacting negatively on their health. Focusing on public buses, this review explicates the link between bus usability and the health of older people and frames existing evidence on bus usability issues. The Person-Environment-Occupation (PEO) model offers a framework by which bus usability can be assessed. A combination of person-centred, environmental, and occupation-related factors, including bus design, service provision and performance, information, and the attitudes of staff and the community, impact on older people's ability to catch buses. More systematic research needs to take place in order to develop a comprehensive understanding of bus usability. Occupational therapy has a key role to play in conceptualizing, implementing, and evaluating improvements in bus usability for older people.

Integrating Low-Cost Rapid Usability Testing into Agile System Development of Healthcare IT: A Methodological Perspective.

PubMed

Kushniruk, Andre W; Borycki, Elizabeth M

2015-01-01

The development of more usable and effective healthcare information systems has become a critical issue. In the software industry methodologies such as agile and iterative development processes have emerged to lead to more effective and usable systems. These approaches highlight focusing on user needs and promoting iterative and flexible development practices. Evaluation and testing of iterative agile development cycles is considered an important part of the agile methodology and iterative processes for system design and re-design. However, the issue of how to effectively integrate usability testing methods into rapid and flexible agile design cycles has remained to be fully explored. In this paper we describe our application of an approach known as low-cost rapid usability testing as it has been applied within agile system development in healthcare. The advantages of the integrative approach are described, along with current methodological considerations.

Evaluation of the acceptability and usability of a decision support system to encourage safe and effective use of opioid therapy for chronic, noncancer pain by primary care providers.

PubMed

Trafton, Jodie; Martins, Susana; Michel, Martha; Lewis, Eleanor; Wang, Dan; Combs, Ann; Scates, Naquell; Tu, Samson; Goldstein, Mary K

2010-04-01

To develop and evaluate a clinical decision support system (CDSS) named Assessment and Treatment in Healthcare: Evidenced-Based Automation (ATHENA)-Opioid Therapy, which encourages safe and effective use of opioid therapy for chronic, noncancer pain. CDSS development and iterative evaluation using the analysis, design, development, implementation, and evaluation process including simulation-based and in-clinic assessments of usability for providers followed by targeted system revisions. Volunteers provided detailed feedback to guide improvements in the graphical user interface, and content and design changes to increase clinical usefulness, understandability, clinical workflow fit, and ease of completing guideline recommended practices. Revisions based on feedback increased CDSS usability ratings over time. Practice concerns outside the scope of the CDSS were also identified. Usability testing optimized the CDSS to better address barriers such as lack of provider education, confusion in dosing calculations and titration schedules, access to relevant patient information, provider discontinuity, documentation, and access to validated assessment tools. It also highlighted barriers to good clinical practice that are difficult to address with CDSS technology in its current conceptualization. For example, clinicians indicated that constraints on time and competing priorities in primary care, discomfort in patient-provider communications, and lack of evidence to guide opioid prescribing decisions impeded their ability to provide effective, guideline-adherent pain management. Iterative testing was essential for designing a highly usable and acceptable CDSS; however, identified barriers may limit the impact of the ATHENA-Opioid Therapy system and other CDSS on clinical practices and outcomes unless CDSS are paired with parallel initiatives to address these issues.

Equity in Assistance? Usability of a U.S. Government Food Assistance Application

ERIC Educational Resources Information Center

Saal, Leah Katherine

2016-01-01

This article focuses on the quantitative phase of a multiphase mixed methods study investigating adults' and families' access to government food assistance. The research evaluates participants' comprehension of, and ability to, adequately complete authentic complex texts--national food assistance application documents. Summative usability testing…

Improving a Counselor Education Web Site through Usability Testing: The Bibliotherapy Education Project

ERIC Educational Resources Information Center

McMillen, Paula S.; Pehrsson, Dale-Elizabeth

2009-01-01

Technology proficiency expectations have proliferated in counselor education; however, limited information in the counseling literature details how to effectively evaluate or refine online resources from a design/utility standpoint. This description of a small-scale usability study demonstrates a cost-effective strategy for improving counselor…

77 FR 28853 - Proposed Information Collection; Comment Request; Generic Clearance for Usability Data Collections

Federal Register 2010, 2011, 2012, 2013, 2014

2012-05-16

... the Department of Commerce, proposes to conduct a number of data collection efforts--both quantitative and qualitative. The data collections will be designed to determine requirement and evaluate the usability and utility of NIST research for measurement and standardization work. These data collections...

User Satisfaction Evaluation of an Educational Website

ERIC Educational Resources Information Center

Akilli, Goknur Kaplan

2005-01-01

This study focuses on one particular aspect of usability, namely, user satisfaction, for an educational website used as a supportive tool for various courses by employing only one specific usability testing technique, a questionnaire. The researcher aimed to find out whether eighth semester undergraduate students of Computer Education and…

Proposal for an IT Security Standard for Preventing Tax Fraud in Cash Registers

NASA Astrophysics Data System (ADS)

Neuhaus, Mathias; Wolff, Jörg; Zisky, Norbert

This paper describes a technology solution for preventing tax fraud in electronic cash registers (ECR) and point of sale (POS) systems. The solution is based on electronic signatures, and as a result, any alterations to protected data will be detected. The signed transaction data can be stored on various electronic memory devices. Technical provisions enable the estimation of transaction volumes, even after tampering or loss of data. In this way the solution presented here differs significantly from other fiscal solutions where a pattern of approvals for ECRs and permanent technical supervision of the market is necessary. This paper is focused on the architecture, the protocols and the usability of the proposed system.

An analysis of electronic document management in oncology care.

PubMed

Poulter, Thomas; Gannon, Brian; Bath, Peter A

2012-06-01

In this research in progress, a reference model for the use of electronic patient record (EPR) systems in oncology is described. The model, termed CICERO, comprises technical and functional components, and emphasises usability, clinical safety and user acceptance. One of the functional components of the model-an electronic document and records management (EDRM) system-is monitored in the course of its deployment at a leading oncology centre in the UK. Specifically, the user requirements and design of the EDRM solution are described.The study is interpretative and forms part a wider research programme to define and validate the CICERO model. Preliminary conclusions confirm the importance of a socio-technical perspective in Onco-EPR system design.

Educational technology "Anatomy and Vital Signs": Evaluation study of content, appearance and usability.

PubMed

de Góes, Fernanda dos Santos Nogueira; Fonseca, Luciana Mara Monti; de Camargo, Rosangela Andrade Aukar; de Oliveira, Gustavo Faria; Felipe, Helena Reche

2015-11-01

The use of new technology has recently grown considerably as an increasing number of college students using Internet. In nursing education, the personal computer and the Internet facilitate teaching theoretical and practical knowledge. Evaluate an educational technology known as "Anatomy and Vital Signs" with respect to content, appearance and usability. This was a first stage evaluation-by specialists to verify content and functioning, prior to a second validation as to learning by students. A methodological study in which instructional technologists (11 participants) and nursing specialists (17 participants) used the technology in an unguided manner and completed three questionnaires. The evaluation was measured by the difference between disagreement and agreement for each statement in the questionnaires. Most of the items were positively evaluated at a level higher than 70% by most of the evaluators except for the following usability criteria: grouping by shape, minimum actions and user control, which did not attain the 70% agreement level among instructional technologists. The evaluation was useful to improve the technology and guarantee suitable product for nursing education. It may be a reliable educational tool for nursing education that applies technological resources. Copyright © 2015 Elsevier Ireland Ltd. All rights reserved.

Comparing two anesthesia information management system user interfaces: a usability evaluation.

PubMed

Wanderer, Jonathan P; Rao, Anoop V; Rothwell, Sarah H; Ehrenfeld, Jesse M

2012-11-01

Anesthesia information management systems (AIMS) have been developed by multiple vendors and are deployed in thousands of operating rooms around the world, yet not much is known about measuring and improving AIMS usability. We developed a methodology for evaluating AIMS usability in a low-fidelity simulated clinical environment and used it to compare an existing user interface with a revised version. We hypothesized that the revised user interface would be more useable. In a low-fidelity simulated clinical environment, twenty anesthesia providers documented essential anesthetic information for the start of the case using both an existing and a revised user interface. Participants had not used the revised user interface previously and completed a brief training exercise prior to the study task. All participants completed a workload assessment and a satisfaction survey. All sessions were recorded. Multiple usability metrics were measured. The primary outcome was documentation accuracy. Secondary outcomes were perceived workload, number of documentation steps, number of user interactions, and documentation time. The interfaces were compared and design problems were identified by analyzing recorded sessions and survey results. Use of the revised user interface was shown to improve documentation accuracy from 85.1% to 92.4%, a difference of 7.3% (95% confidence interval [CI] for the difference 1.8 to 12.7). The revised user interface decreased the number of user interactions by 6.5 for intravenous documentation (95% CI 2.9 to 10.1) and by 16.1 for airway documentation (95% CI 11.1 to 21.1). The revised user interface required 3.8 fewer documentation steps (95% CI 2.3 to 5.4). Airway documentation time was reduced by 30.5 seconds with the revised workflow (95% CI 8.5 to 52.4). There were no significant time differences noted in intravenous documentation or in total task time. No difference in perceived workload was found between the user interfaces. Two user interface design problems were identified in the revised user interface. The usability of anesthesia information management systems can be evaluated using a low-fidelity simulated clinical environment. User testing of the revised user interface showed improvement in some usability metrics and highlighted areas for further revision. Vendors of AIMS and those who use them should consider adopting methods to evaluate and improve AIMS usability.

Evaluation Studies of Robotic Rollators by the User Perspective: A Systematic Review.

PubMed

Werner, Christian; Ullrich, Phoebe; Geravand, Milad; Peer, Angelika; Hauer, Klaus

2016-01-01

Robotic rollators enhance the basic functions of established devices by technically advanced physical, cognitive, or sensory support to increase autonomy in persons with severe impairment. In the evaluation of such ambient assisted living solutions, both the technical and user perspectives are important to prove usability, effectiveness and safety, and to ensure adequate device application. The aim of this systematic review is to summarize the methodology of studies evaluating robotic rollators with focus on the user perspective and to give recommendations for future evaluation studies. A systematic literature search up to December 31, 2014, was conducted based on the Cochrane Review methodology using the electronic databases PubMed and IEEE Xplore. Articles were selected according to the following inclusion criteria: evaluation studies of robotic rollators documenting human-robot interaction, no case reports, published in English language. Twenty-eight studies were identified that met the predefined inclusion criteria. Large heterogeneity in the definitions of the target user group, study populations, study designs and assessment methods was found across the included studies. No generic methodology to evaluate robotic rollators could be identified. We found major methodological shortcomings related to insufficient sample descriptions and sample sizes, and lack of appropriate, standardized and validated assessment methods. Long-term use in habitual environment was also not evaluated. Apart from the heterogeneity, methodological deficits in most of the identified studies became apparent. Recommendations for future evaluation studies include: clear definition of target user group, adequate selection of subjects, inclusion of other assistive mobility devices for comparison, evaluation of the habitual use of advanced prototypes, adequate assessment strategy with established, standardized and validated methods, and statistical analysis of study results. Assessment strategies may additionally focus on specific functionalities of the robotic rollators allowing an individually tailored assessment of innovative features to document their added value. © 2016 S. Karger AG, Basel.

From expert-derived user needs to user-perceived ease of use and usefulness: a two-phase mixed-methods evaluation framework.

PubMed

Boland, Mary Regina; Rusanov, Alexander; So, Yat; Lopez-Jimenez, Carlos; Busacca, Linda; Steinman, Richard C; Bakken, Suzanne; Bigger, J Thomas; Weng, Chunhua

2014-12-01

Underspecified user needs and frequent lack of a gold standard reference are typical barriers to technology evaluation. To address this problem, this paper presents a two-phase evaluation framework involving usability experts (phase 1) and end-users (phase 2). In phase 1, a cross-system functionality alignment between expert-derived user needs and system functions was performed to inform the choice of "the best available" comparison system to enable a cognitive walkthrough in phase 1 and a comparative effectiveness evaluation in phase 2. During phase 2, five quantitative and qualitative evaluation methods are mixed to assess usability: time-motion analysis, software log, questionnaires - System Usability Scale and the Unified Theory of Acceptance of Use of Technology, think-aloud protocols, and unstructured interviews. Each method contributes data for a unique measure (e.g., time motion analysis contributes task-completion-time; software log contributes action transition frequency). The measures are triangulated to yield complementary insights regarding user-perceived ease-of-use, functionality integration, anxiety during use, and workflow impact. To illustrate its use, we applied this framework in a formative evaluation of a software called Integrated Model for Patient Care and Clinical Trials (IMPACT). We conclude that this mixed-methods evaluation framework enables an integrated assessment of user needs satisfaction and user-perceived usefulness and usability of a novel design. This evaluation framework effectively bridges the gap between co-evolving user needs and technology designs during iterative prototyping and is particularly useful when it is difficult for users to articulate their needs for technology support due to the lack of a baseline. Copyright © 2013 Elsevier Inc. All rights reserved.

Evaluating the Usability of a Free Electronic Health Record for Training

PubMed Central

Hoyt, Robert; Adler, Kenneth; Ziesemer, Brandy; Palombo, Georgina

2013-01-01

The United States will need to train a large workforce of skilled health information technology (HIT) professionals in order to meet the US government's goal of universal electronic health records (EHRs) for all patients and widespread health information exchange. The Health Information Technology for Economic and Clinical Health (HITECH) Act established several HIT workforce educational programs to accomplish this goal. Recent studies have shown that EHR usability is a significant concern of physicians and is a potential obstacle to EHR adoption. It is important to have a highly usable EHR to train both clinicians and students. In this article, we report a qualitative-quantitative usability analysis of a web-based EHR for training health informatics and health information management students. PMID:23805062

The influence of socio-cultural background and product value in usability testing.

PubMed

Sonderegger, Andreas; Sauer, Juergen

2013-05-01

This article examines the influence of socio-cultural background and product value on different outcomes of usability tests. A study was conducted in two different socio-cultural regions, Switzerland and East Germany, which differed in a number of aspects (e.g. economic power, price sensitivity and culture). Product value (high vs. low) was varied by manipulating the price of the product. Sixty-four test participants were asked to carry out five typical user tasks in the context of coffee machine usage, measuring performance, perceived usability, and emotion. The results showed that in Switzerland, high-value products were rated higher in usability than low-value products whereas in East Germany, high-value products were evaluated lower in usability. A similar interaction effect of socio-cultural background and product value was observed for user emotion. Implications are that the outcomes of usability tests do not allow for a simple transfer across cultures and that the mediating influence of perceived product value needs to be taken into consideration. Copyright © 2012 Elsevier Ltd and The Ergonomics Society. All rights reserved.

A Re-evaluation of Discarded Deceased Donor Kidneys in the UK: Are Usable Organs Still Being Discarded?

PubMed

Mittal, Shruti; Adamusiak, Anna; Horsfield, Catherine; Loukopoulos, Ioannis; Karydis, Nikolaos; Kessaris, Nicos; Drage, Martin; Olsburgh, Jonathon; Watson, Christopher Je; Callaghan, Chris J

2017-07-01

A significant proportion of procured deceased donor kidneys are subsequently discarded. The UK Kidney Fast-Track Scheme (KFTS) was introduced in 2012, enabling kidneys at risk of discard to be simultaneously offered to participating centers. We undertook an analysis of discarded kidneys to determine if unnecessary organ discard was still occurring since the KFTS was introduced. Between April and June 2015, senior surgeons independently inspected 31 consecutive discarded kidneys from throughout the United Kingdom. All kidneys were biopsied. Organs were categorized as usable, possibly usable pending histology, or not usable for implantation. After histology reports were available, final assessments of usability were made. There were 19 donors (6 donations after brain death, 13 donations after circulatory death), with a median (range) donor age of 67 (29-83) years and Kidney Donor Profile Index of 93 (19-100). Reasons for discard were variable. Only 3 discarded kidneys had not entered the KFTS. After initial assessment postdiscard, 11 kidneys were assessed as usable, with 9 kidneys thought to be possibly usable. Consideration of histological data reduced the number of kidneys thought usable to 10 (10/31; 32%). The KFTS scheme is successfully identifying organs at high risk of discard, though potentially transplantable organs are still being discarded. Analyses of discarded organs are essential to identify barriers to organ utilization and develop strategies to reduce unnecessary discard.

Development and Usability of REACH: A Tailored Theory-Based Text Messaging Intervention for Disadvantaged Adults With Type 2 Diabetes.

PubMed

Nelson, Lyndsay A; Mayberry, Lindsay S; Wallston, Kenneth; Kripalani, Sunil; Bergner, Erin M; Osborn, Chandra Y

2016-09-08

Among adults with type 2 diabetes mellitus (T2DM), adherence to recommended self-care activities is suboptimal, especially among racial and ethnic minorities with low income. Self-care nonadherence is associated with having worse glycemic control and diabetes complications. Text messaging interventions are improving the self-care of adults with T2DM, but few have been tested with disadvantaged populations. To develop Rapid Education/Encouragement And Communications for Health (REACH), a tailored, text messaging intervention to support the self-care adherence of disadvantaged patients with T2DM, based on the Information-Motivation-Behavioral skills model. We then tested REACH's usability to make improvements before evaluating its effects. We developed REACH's content and functionality using an empirical and theory-based approach, findings from a previously pilot-tested intervention, and the expertise of our interdisciplinary research team. We recruited 36 adults with T2DM from Federally Qualified Health Centers to participate in 1 of 3 rounds of usability testing. For 2 weeks, participants received daily text messages assessing and promoting self-care, including tailored messages addressing users' unique barriers to adherence, and weekly text messages with adherence feedback. We analyzed quantitative and qualitative user feedback and system-collected data to improve REACH. Participants were, on average, 52.4 (SD 9.5) years old, 56% (20/36) female, 63% (22/35) were a racial or ethnic minority, and 67% (22/33) had an income less than US $35,000. About half were taking insulin, and average hemoglobin A1c level was 8.2% (SD 2.2%). We identified issues (eg, user concerns with message phrasing, technical restrictions with responding to assessment messages) and made improvements between testing rounds. Overall, participants favorably rated the ease of understanding (mean 9.6, SD 0.7) and helpfulness (mean 9.3, SD 1.4) of self-care promoting text messages on a scale of 1-10, responded to 96% of assessment text messages, and rated the helpfulness of feedback text messages 8.5 (SD 2.7) on a scale of 1-10. User feedback led to refining our study enrollment process so that users understood the flexibility in message timing and that computers, not people, send the messages. Furthermore, research assistants' feedback on the enrollment process helped improve participants' engagement with study procedures. Testing technology-delivered interventions with disadvantaged adults revealed preferences and concerns unique to this population. Through iterative testing and multiple data sources, we identified and responded to users' intervention preferences, technical issues, and shortcomings in our research procedures.

Mobile Applications for Diabetics: A Systematic Review and Expert-Based Usability Evaluation Considering the Special Requirements of Diabetes Patients Age 50 Years or Older

PubMed Central

Quade, Mandy; Kirch, Wilhelm

2014-01-01

Background A multitude of mhealth (mobile health) apps have been developed in recent years to support effective self-management of patients with diabetes mellitus type 1 or 2. Objective We carried out a systematic review of all currently available diabetes apps for the operating systems iOS and Android. We considered the number of newly released diabetes apps, range of functions, target user groups, languages, acquisition costs, user ratings, available interfaces, and the connection between acquisition costs and user ratings. Additionally, we examined whether the available applications serve the special needs of diabetes patients aged 50 or older by performing an expert-based usability evaluation. Methods We identified relevant keywords, comparative categories, and their specifications. Subsequently, we performed the app review based on the information given in the Google Play Store, the Apple App Store, and the apps themselves. In addition, we carried out an expert-based usability evaluation based on a representative 10% sample of diabetes apps. Results In total, we analyzed 656 apps finding that 355 (54.1%) offered just one function and 348 (53.0%) provided a documentation function. The dominating app language was English (85.4%, 560/656), patients represented the main user group (96.0%, 630/656), and the analysis of the costs revealed a trend toward free apps (53.7%, 352/656). The median price of paid apps was €1.90. The average user rating was 3.6 stars (maximum 5). Our analyses indicated no clear differences in the user rating between free and paid apps. Only 30 (4.6%) of the 656 available diabetes apps offered an interface to a measurement device. We evaluated 66 apps within the usability evaluation. On average, apps were rated best regarding the criterion “comprehensibility” (4.0 out of 5.0), while showing a lack of “fault tolerance” (2.8 out of 5.0). Of the 66 apps, 48 (72.7%) offered the ability to read the screen content aloud. The number of functions was significantly negative correlated with usability. The presence of documentation and analysis functions reduced the usability score significantly by 0.36 and 0.21 points. Conclusions A vast number of diabetes apps already exist, but the majority offer similar functionalities and combine only one to two functions in one app. Patients and physicians alike should be involved in the app development process to a greater extent. We expect that the data transmission of health parameters to physicians will gain more importance in future applications. The usability of diabetes apps for patients aged 50 or older was moderate to good. But this result applied mainly to apps offering a small range of functions. Multifunctional apps performed considerably worse in terms of usability. Moreover, the presence of a documentation or analysis function resulted in significantly lower usability scores. The operability of accessibility features for diabetes apps was quite limited, except for the feature “screen reader”. PMID:24718852

An Objective Comparison of Cell Tracking Algorithms

PubMed Central

Ulman, Vladimír; Maška, Martin; Magnusson, Klas E. G.; Ronneberger, Olaf; Haubold, Carsten; Harder, Nathalie; Matula, Pavel; Matula, Petr; Svoboda, David; Radojevic, Miroslav; Smal, Ihor; Rohr, Karl; Jaldén, Joakim; Blau, Helen M.; Dzyubachyk, Oleh; Lelieveldt, Boudewijn; Xiao, Pengdong; Li, Yuexiang; Cho, Siu-Yeung; Dufour, Alexandre C.; Olivo-Marin, Jean-Christophe; Reyes-Aldasoro, Constantino C.; Solis-Lemus, Jose A.; Bensch, Robert; Brox, Thomas; Stegmaier, Johannes; Mikut, Ralf; Wolf, Steffen; Hamprecht, Fred. A.; Esteves, Tiago; Quelhas, Pedro; Demirel, Ömer; Malmström, Lars; Jug, Florian; Tomancak, Pavel; Meijering, Erik; Muñoz-Barrutia, Arrate; Kozubek, Michal; Ortiz-de-Solorzano, Carlos

2017-01-01

We present a combined report on the results of three editions of the Cell Tracking Challenge, an ongoing initiative aimed at promoting the development and objective evaluation of cell tracking algorithms. With twenty-one participating algorithms and a data repository consisting of thirteen datasets of various microscopy modalities, the challenge displays today’s state of the art in the field. We analyze the results using performance measures for segmentation and tracking that rank all participating methods. We also analyze the performance of all algorithms in terms of biological measures and their practical usability. Even though some methods score high in all technical aspects, not a single one obtains fully correct solutions. We show that methods that either take prior information into account using learning strategies or analyze cells in a global spatio-temporal video context perform better than other methods under the segmentation and tracking scenarios included in the challenge. PMID:29083403

An objective comparison of cell-tracking algorithms.

PubMed

Ulman, Vladimír; Maška, Martin; Magnusson, Klas E G; Ronneberger, Olaf; Haubold, Carsten; Harder, Nathalie; Matula, Pavel; Matula, Petr; Svoboda, David; Radojevic, Miroslav; Smal, Ihor; Rohr, Karl; Jaldén, Joakim; Blau, Helen M; Dzyubachyk, Oleh; Lelieveldt, Boudewijn; Xiao, Pengdong; Li, Yuexiang; Cho, Siu-Yeung; Dufour, Alexandre C; Olivo-Marin, Jean-Christophe; Reyes-Aldasoro, Constantino C; Solis-Lemus, Jose A; Bensch, Robert; Brox, Thomas; Stegmaier, Johannes; Mikut, Ralf; Wolf, Steffen; Hamprecht, Fred A; Esteves, Tiago; Quelhas, Pedro; Demirel, Ömer; Malmström, Lars; Jug, Florian; Tomancak, Pavel; Meijering, Erik; Muñoz-Barrutia, Arrate; Kozubek, Michal; Ortiz-de-Solorzano, Carlos

2017-12-01

We present a combined report on the results of three editions of the Cell Tracking Challenge, an ongoing initiative aimed at promoting the development and objective evaluation of cell segmentation and tracking algorithms. With 21 participating algorithms and a data repository consisting of 13 data sets from various microscopy modalities, the challenge displays today's state-of-the-art methodology in the field. We analyzed the challenge results using performance measures for segmentation and tracking that rank all participating methods. We also analyzed the performance of all of the algorithms in terms of biological measures and practical usability. Although some methods scored high in all technical aspects, none obtained fully correct solutions. We found that methods that either take prior information into account using learning strategies or analyze cells in a global spatiotemporal video context performed better than other methods under the segmentation and tracking scenarios included in the challenge.

Quality assessment of websites providing educational content for patients with rheumatoid arthritis.

PubMed

Siddhanamatha, Harish Rajashekarappa; Heung, Eric; Lopez-Olivo, Maria de Los Angeles; Abdel-Wahab, Noha; Ojeda-Prias, Ana; Willcockson, Irmgard; Leong, Amye; Suarez-Almazor, Maria Eugenia

2017-06-01

We performed an environmental scan of currently available websites providing educational information about rheumatoid arthritis (RA) and evaluated the quality of these websites. We searched three separate search engines, Google, Bing, and Ask.com, on August 27, 2015, using two search terms, "arthritis" and "rheumatoid." Only patient education websites were included. Two independent investigators evaluated the accuracy, completeness, technical elements, design and esthetics, readability, usability, and accessibility of the websites. The navigation experience was also evaluated by an adult training expert. We identified 46 websites. Nearly all websites (98%) provided accurate information. However, no website covered all essential RA topics. Common essential topics not covered included epidemiology, pathogenesis, treatment and disease monitoring, complications, self-management, risks and benefits of treatment, prognosis, treatment adherence, questions for patients to ask their doctors, and costs. For the technical elements, all websites disclosed their ownership, but the date that the content was last updated was mentioned in only 10 websites, ranging from 2007 to 2015. The mean reading level was grade 12.1 (standard deviation ±2.3). Most websites (78%) were easy to navigate but only 33% were friendly for people with visual and/or hearing impairments. The navigation experience was rated fair or poor in 41% of the websites. Current patient information on the Internet does not comprehensively address all educational needs of patients with RA, and is often outdated. The findings from our study highlight potential areas for improvement in online education materials for patients with RA. Copyright © 2017. Published by Elsevier Inc.

Human-computer interaction: psychological aspects of the human use of computing.

PubMed

Olson, Gary M; Olson, Judith S

2003-01-01

Human-computer interaction (HCI) is a multidisciplinary field in which psychology and other social sciences unite with computer science and related technical fields with the goal of making computing systems that are both useful and usable. It is a blend of applied and basic research, both drawing from psychological research and contributing new ideas to it. New technologies continuously challenge HCI researchers with new options, as do the demands of new audiences and uses. A variety of usability methods have been developed that draw upon psychological principles. HCI research has expanded beyond its roots in the cognitive processes of individual users to include social and organizational processes involved in computer usage in real environments as well as the use of computers in collaboration. HCI researchers need to be mindful of the longer-term changes brought about by the use of computing in a variety of venues.

Development of a digital clinical pathway for emergency medicine: Lessons from usability testing and implementation failure.

PubMed

Gutenstein, Marc; Pickering, John W; Than, Martin

2018-06-01

Clinical pathways are used to support the management of patients in emergency departments. An existing document-based clinical pathway was used as the foundation on which to design and build a digital clinical pathway for acute chest pain, with the aim of improving clinical calculations, clinician decision-making, documentation, and data collection. Established principles of decision support system design were used to build an application within the existing electronic health record, before testing with a multidisciplinary team of doctors using a think-aloud protocol. Technical authoring was successful, however, usability testing revealed that the user experience and the flexibility of workflow within the application were critical barriers to implementation. Emergency medicine and acute care decision support systems face particular challenges to existing models of linear workflow that should be deliberately addressed in digital pathway design. We make key recommendations regarding digital pathway design in emergency medicine.

Reprint of: environmental information for military planning.

PubMed

Doherty, Victoria; Croft, Darryl; Knight, Ashley

2013-11-01

A study was conducted to consider the implications of presenting Environmental Information (EI; information on current environmental features including weather, topography and visibility maps) for military planning to the growing audience of non-technical users; to provide guidance for ensuring usability and for development of a suitable EI interface, and to produce an EI concept interface mock-up to demonstrate initial design ideas. Knowledge was elicited from current EI users and providers regarding anticipated use of EI by non-specialists. This was combined with human factors and cognition expertise to produce guidance for data usability and development of an EI interface. A simple mock-up of an EI concept interface was developed. Recommendations for further development were made including application of the guidance derived, identification of a user test-bed and development of business processes. Copyright © 2012 Elsevier Ltd and The Ergonomics Society. All rights reserved.

Environmental information for military planning.

PubMed

Doherty, Victoria; Croft, Darryl; Knight, Ashley

2013-07-01

A study was conducted to consider the implications of presenting Environmental Information (EI; information on current environmental features including weather, topography and visibility maps) for military planning to the growing audience of non-technical users; to provide guidance for ensuring usability and for development of a suitable EI interface, and to produce an EI concept interface mock-up to demonstrate initial design ideas. Knowledge was elicited from current EI users and providers regarding anticipated use of EI by non-specialists. This was combined with human factors and cognition expertise to produce guidance for data usability and development of an EI interface. A simple mock-up of an EI concept interface was developed. Recommendations for further development were made including application of the guidance derived, identification of a user test-bed and development of business processes. Copyright © 2012 Elsevier Ltd and The Ergonomics Society. All rights reserved.

Effects of Aging and Domain Knowledge on Usability in Small Screen Devices for Diabetes Patients

NASA Astrophysics Data System (ADS)

Calero Valdez, André; Ziefle, Martina; Horstmann, Andreas; Herding, Daniel; Schroeder, Ulrik

Technology acceptance has become a key concept for the successful rollout of technical devices. Though the concept is intensively studied for nearly 20 years now, still, many open questions remain. This especially applies to technology acceptance of older users, which are known to be very sensitive to suboptimal interfaces and show considerable reservations towards the usage of new technology. Mobile small screen technology increasingly penetrates health care and medical applications. This study investigates impacts of aging, technology expertise and domain knowledge on user interaction using the example of diabetes. For this purpose user effectiveness and efficiency have been measured on a simulated small screen device and related to user characteristics, showing that age and technology expertise have a big impact on usability of the device. Furthermore, impacts of user characteristics and success during the trial on acceptance of the device were surveyed and analyzed.

Lumber recovery and deterioration of beetle-killed douglas-fir and grand fir in the Blue Mountains of eastern Oregon. Forest Service general technical report

DOE Office of Scientific and Technical Information (OSTI.GOV)

Parry, D.L.; Filip, G.M.; Willits, S.A.

1996-09-01

The purpose of this study was to determine the effect of time since death over a 4-year period on the amount of usable product volume and value, and to determine the species of fungi associated with wood deterioration in the stems of Douglas-fir and grand fir trees killed by bark beetles in northeastern Oregon.

C3I and Modelling and Simulation (M&S) Interoperability

DTIC Science & Technology

2004-03-01

customised Open Source products. The technical implementation is based on the use of the eXtendend Markup Language (XML) and Python . XML is developed...to structure, store and send information. The language is focus on the description of data. Python is a portable, interpreted, object-oriented...programming language. A huge variety of usable Open Source Projects were issued by the Python Community. 3.1 Phase 1: Feasibility Studies Phase 1 was

Evaluating the Acceptability and Usability of EASEL: A Mobile Application That Supports Guided Reflection for Experiential Learning Activities

ERIC Educational Resources Information Center

Schnepp, Jerry; Rogers, Christian

2017-01-01

Aim/Purpose: To examine the early perceptions (acceptability) and usability of EASEL (Education through Application-Supported Experiential Learning), a mobile platform that delivers reflection prompts and content before, during, and after an experiential learning activity. Background: Experiential learning is an active learning approach in which…

General Framework for Evaluating Password Complexity and Strength

DTIC Science & Technology

2015-11-15

stronger password requirements: User attitudes and behaviors,” in Pro- ceedings of the Sixth Symposium on Usable Privacy and Security, ser. SOUPS ’10. New...Proceedings of the Eighth Symposium on Usable Privacy and Security, ser. SOUPS ’12. New York, NY, USA: ACM, 2012, pp. 1–20. [22] P. Kelley, S. Komanduri

"Introduction to Teaching Online": Usability Evaluation of Interactivity in an Online Social Constructivist Course

ERIC Educational Resources Information Center

Robinson, Heather A.; Sheffield, Anneliese; Phillips, Alana S.; Moore, Michelle

2017-01-01

In this study, the usability of a social constructivist online teacher preparation course was examined using a framework developed for asynchronous constructivist courses. In particular, students' approaches to learning through interactivity were examined. Students from around the world participated in the course. Data from weekly feedback were…

Conferences as Information Grounds: Web Site Evaluation with a Mobile Usability Laboratory

ERIC Educational Resources Information Center

Bossaller, Jenny S.; Paul, Anindita; Hill, Heather; Wang, Jiazhen; Erdelez, Sanda

2008-01-01

This article describes an "on-the-road" usability study and explains the study's methodological challenges, solutions, and recommendations. The study concerned a library-consortium website, which is a communication and educational tool for librarians who are physically dispersed throughout the state, and an intranet for remote users.…

Design Rationale Behind the Serious Self-Regulation Game Intervention "Balance It": Overweight Prevention Among Secondary Vocational Education Students in The Netherlands.

PubMed

Spook, Jorinde E; Paulussen, Theo; Paulissen, Rosie; Visschedijk, Gillian; Kok, Gerjo; van Empelen, Pepijn

2015-10-01

This article describes the design rationale behind a serious self-regulation game intervention. The aim of the game is to promote healthy dietary intake and physical activity among secondary vocational educational students in The Netherlands (approximately 16-20 years of age). The game "Balance It" was developed according to an intervention mapping (IM) protocol. Following IM, we specified health promotion and usability objectives and linked these objectives to selected behavior change and persuasive methods. Accordingly, these methods were translated into a coherent intervention program. The health behavior change objectives were derived from the determinants of the behavior and from Self-Regulation Theory (e.g., students are asked to set goals, monitor and evaluate their behavior, and create coping plans). Usability objectives were derived from the RE-AIM model (i.e., Reach, Effectiveness, Adoption, Implementation, and Maintenance). Next, behavior change and persuasive techniques were selected (e.g., goal setting and prompting, respectively) that did fit with the targeted change objectives and were translated in the design of a (mobile) serious self-regulation game intervention. Subsequently, three concept and usability tests were performed to improve intervention usability, and an evaluation plan was developed. The aim of this study was to provide a design rationale for game interventions targeting health-related behaviors. We developed a coherent program design in which both health behavior change and usability factors are addressed. The IM protocol can serve as a useful guide for decision making in program development and evaluation.

An Evaluation of the Design and Usability of a Novel Robotic Bilateral Arm Rehabilitation Device for Patients with Stroke.

PubMed

Pei, Yu-Cheng; Chen, Jean-Lon; Wong, Alice M K; Tseng, Kevin C

2017-01-01

Case series. IV (case series). Robot-assisted therapy for upper limb rehabilitation is an emerging research topic and its design process must integrate engineering, neurological pathophysiology, and clinical needs. This study developed/evaluated the usefulness of a novel rehabilitation device, the MirrorPath , designed for the upper limb rehabilitation of patients with hemiplegic stroke. The process follows Tseng's methodology for innovative product design and development, namely two stages, device development and usability assessment. During the development process, the design was guided by patients' rehabilitation needs as defined by patients and their therapists. The design applied synchronic movement of the bilateral upper limbs, an approach that is compatible with the bilateral movement therapy and proprioceptive neuromuscular facilitation theories. MirrorPath consists of a robotic device that guides upper limb movement linked to a control module containing software controlling the robotic movement. Five healthy subjects were recruited in the pretest, and 4 patients, 4 caregivers, and 4 therapists were recruited in the formal test for usability. All recruited subjects were allocated to the test group, completed the evaluation, and their data were all analyzed. The total system usability scale score obtained from the patients, caregivers, and therapists was 71.8 ± 11.9, indicating a high level of usability and product acceptance. Following a standard development process, we could yield a design that meets clinical needs. This low-cost device provides a feasible platform for carrying out robot-assisted bilateral movement therapy of patients with hemiplegic stroke. identifier NCT02698605.

ODMSummary: A Tool for Automatic Structured Comparison of Multiple Medical Forms Based on Semantic Annotation with the Unified Medical Language System.

PubMed

Storck, Michael; Krumm, Rainer; Dugas, Martin

2016-01-01

Medical documentation is applied in various settings including patient care and clinical research. Since procedures of medical documentation are heterogeneous and developed further, secondary use of medical data is complicated. Development of medical forms, merging of data from different sources and meta-analyses of different data sets are currently a predominantly manual process and therefore difficult and cumbersome. Available applications to automate these processes are limited. In particular, tools to compare multiple documentation forms are missing. The objective of this work is to design, implement and evaluate the new system ODMSummary for comparison of multiple forms with a high number of semantically annotated data elements and a high level of usability. System requirements are the capability to summarize and compare a set of forms, enable to estimate the documentation effort, track changes in different versions of forms and find comparable items in different forms. Forms are provided in Operational Data Model format with semantic annotations from the Unified Medical Language System. 12 medical experts were invited to participate in a 3-phase evaluation of the tool regarding usability. ODMSummary (available at https://odmtoolbox.uni-muenster.de/summary/summary.html) provides a structured overview of multiple forms and their documentation fields. This comparison enables medical experts to assess multiple forms or whole datasets for secondary use. System usability was optimized based on expert feedback. The evaluation demonstrates that feedback from domain experts is needed to identify usability issues. In conclusion, this work shows that automatic comparison of multiple forms is feasible and the results are usable for medical experts.

Usability and feasibility of mobile phone diaries in an experimental physical exercise study.

PubMed

Heinonen, Reetta; Luoto, Riitta; Lindfors, Pirjo; Nygård, Clas-Håkan

2012-03-01

Wireless and mobile phone technology as a method of data collection will increase alongside conventional methods. The aim of the present study was to evaluate the use of a mobile phone application for recording symptoms and physical activity exertion during an experimental physical exercise study. An experimental study on the effects of physical exercise on the well-being of menopausal women included 158 subjects between 44 and 63 years of age. The women were randomized into intervention and control groups. All participants in both groups reported daily symptoms by responding to morning and evening questionnaires via mobile phones. The usability of the mobile phone as a data collector tool was evaluated with the System Usability Scale (SUS) questionnaire 2 months after the intervention. The feasibility evaluation was based on the frequency of responses and open questions. The response rates were about 70% to both morning and evening questionnaires. The average frequency of responses (n =158) to morning questionnaires was 125 (±40)/170 (±14) and to evening questionnaires was 118 (±40)/171 (±14). The response rate did not differ between the intervention and the control groups. The SUS score was on average 75.4 (range, 0-100; n =107). A mobile phone diary is a feasible and usable tool for data collection in clinical trials.

How to Present Evidence-Based Usability Design Principles Dedicated to Medication-Related Alerting Systems to Designers and Evaluators? Results from a Workshop.

PubMed

Marcilly, Romaric; Monkman, Helen; Villumsen, Sidsel; Kaufman, David; Beuscart-Zephir, Marie-Catherine

2016-01-01

Medication alerting system use errors and lack of adoption are often attributed to usability issues. Previous work has used evidence from the literature to reveal usability principles specific to medication alerting systems and identify potential consequences of violating these principles. The current study sought to explore how best to convey these principles to designers and evaluators of these systems to facilitate their work. To this aim, a workshop with 19 participants was used to generate ideas and opinions on how to deliver these topic-specific design principles in a way that would be most helpful for them. Participants generated ideas for how (e.g., a collaborative, continuously updated forum) and what (e.g., illustrations, checklists, evidence sources and strength, consequences of violations) information is most useful to disseminate usability principles for medication alerting systems. Participants, especially designers, expressed desire to use these principles in practice and avoid previously documented mistakes and therefore make design and evaluation of these systems more effective and efficient. Those insights are discussed in terms of feasibility and logistical challenges to developing the proposed documentation). To move this work forward, a more collaborative approach of Human Factors specialists in medical informatics is necessary.

Development of an interactive social media tool for parents with concerns about vaccines.

PubMed

Shoup, Jo Ann; Wagner, Nicole M; Kraus, Courtney R; Narwaney, Komal J; Goddard, Kristin S; Glanz, Jason M

2015-06-01

Describe a process for designing, building, and evaluating a theory-driven social media intervention tool to help reduce parental concerns about vaccination. We developed an interactive web-based tool using quantitative and qualitative methods (e.g., survey, focus groups, individual interviews, and usability testing). Survey results suggested that social media may represent an effective intervention tool to help parents make informed decisions about vaccination for their children. Focus groups and interviews revealed four main themes for development of the tool: Parents wanted information describing both benefits and risks of vaccination, transparency of sources of information, moderation of the tool by an expert, and ethnic and racial diversity in the visual display of people. Usability testing showed that parents were satisfied with the usability of the tool but had difficulty with performing some of the informational searches. Based on focus groups, interviews, and usability evaluations, we made additional revisions to the tool's content, design, functionality, and overall look and feel. Engaging parents at all stages of development is critical when designing a tool to address concerns about childhood vaccines. Although this can be both resource- and time-intensive, the redesigned tool is more likely to be accepted and used by parents. Next steps involve a formal evaluation through a randomized trial. © 2014 Society for Public Health Education.

The acceptability of TV-based game platforms as an instrument to support the cognitive evaluation of senior adults at home.

PubMed

Rivas Costa, Carlos; Fernández Iglesias, Manuel José; Anido Rifón, Luis Eulogio; Gómez Carballa, Miguel; Valladares Rodríguez, Sonia

2017-01-01

The computing capabilities of state-of-the-art television sets and media centres may facilitate the introduction of computer-assisted evaluation at home. This approach would help to overcome the drawbacks of traditional pen-and-paper evaluations administered in clinical facilities, as they could be performed in a more comfortable environment, the subject's home, and they would be more flexible for designing complex environments for the evaluation of neuropsychological constructs that are difficult to assess through traditional testing. The objective of this work was to obtain some initial evidence about the technical acceptance by senior adults of serious games played at home on the TV set and therefore about the convenience of further investigating such an approach to cognitive assesment. We developed a collection of games to be deployed on a TV environment. These games were tried by a group of senior adults at their homes. The Technology Acceptance Model (TAM) was used to validate this approach. Surveys were performed to study the perceived usefulness and perceived ease of use of such technical setting as an instrument for their cognitive evaluation; that is, its technical acceptance. Subjective information collected from participants was correlated with actual interaction data captured. An additional survey was performed 36 months after pilot testing to have an indication about the long-term perceptions about usefulness and ease of use. More than 90% of participating subjects perceived cognitive games on TV as useful or very useful. The majority of participants selected the TV set as their preferred option to interact with serious games at home, when compared to other devices such as smartphones, tablets or PCs. This result correlates with the number of participants perceiving them as easily usable or very easy to use, and also with automatically captured interaction data. Three out of four seniors expressed their interest in keeping the system at home after the pilot. Besides, these perceptions are fairly stable in time as shown by the survey performed 36 months after pilot testing. Although participating users are a representative sample of the Galician population, which in turn is comparable to the population of most rural areas in Europe, a larger and more diverse user sample would be needed to obtain significant results for a wider population profile. The study confirmed the technical acceptance, that is, the perceived usefulness and perceived ease of use, of the TV-based home technical setting introduced as a means of cognitive evaluation. This study provides initial evidence on the viability of a TV-based serious games approach for cognitive longitudinal screening at home with little intervention of clinical professionals, thus contributing to the early detection of cognitive impairments in the senior population.

Monitoring dietary intake and physical activity electronically: feasibility, usability, and ecological validity of a mobile-based Ecological Momentary Assessment tool.

PubMed

Spook, Jorinde Eline; Paulussen, Theo; Kok, Gerjo; Van Empelen, Pepijn

2013-09-24

Despite the growing body of research on complex lifestyle behaviors (eg, Dietary Intake [DI] and Physical Activity [PA]), monitoring of these behaviors has been hampered by a lack of suitable methods. A possible solution to this deficiency is mobile-based Ecological Momentary Assessment (mEMA), which enables researchers to collect data on participants' states in real-time by means of a smartphone application. However, feasibility, usability, and ecological validity need to be anticipated and managed in order to enhance the validity of mEMA. To examine the feasibility, usability, and ecological validity of a mEMA application (app) with regard to DI and PA among Dutch vocational education students. The students (n=30) participated in the mEMA study for seven consecutive days. They downloaded the mEMA app on their smartphone. Feasibility and usability of the mEMA app were evaluated by completing an online evaluation after seven days of participation. Ecological validity was measured by assessing the degree to which the content of the mEMA app approximated the real-world setting that was being examined, through several multiple-choice questions. Compliance rates, as registered by the mEMA app, declined 46% over a seven-day period, while self-reported compliance, as measured with an online evaluation questionnaire afterwards, indicated a smaller decrease in compliance (29%). The students evaluated the mEMA app as feasible and usable. Ecological validity analyses showed that all DI and almost all PA multiple-choice options were covered with the compound response categories. The mEMA app offers the opportunity to assess complex health behaviors (eg, DI and PA) in real-time settings, in which specifically routinized behaviors are involved. However, the mEMA app faced several challenges that needed to be overcome in order to improve its validity. Overall, the present study showed that the mEMA app is a usable and ecologically valid tool to measure DI and PA behaviors among vocational education students, but compliance is still limited.

From Usability Testing to Clinical Simulations: Bringing Context into the Design and Evaluation of Usable and Safe Health Information Technologies. Contribution of the IMIA Human Factors Engineering for Healthcare Informatics Working Group.

PubMed

Kushniruk, A; Nohr, C; Jensen, S; Borycki, E M

2013-01-01

The objective of this paper is to explore human factors approaches to understanding the use of health information technology (HIT) by extending usability engineering approaches to include analysis of the impact of clinical context through use of clinical simulations. Methods discussed are considered on a continuum from traditional laboratory-based usability testing to clinical simulations. Clinical simulations can be conducted in a simulation laboratory and they can also be conducted in real-world settings. The clinical simulation approach attempts to bring the dimension of clinical context into stronger focus. This involves testing of systems with representative users doing representative tasks, in representative settings/environments. Application of methods where realistic clinical scenarios are used to drive the study of users interacting with systems under realistic conditions and settings can lead to identification of problems and issues with systems that may not be detected using traditional usability engineering methods. In conducting such studies, careful consideration is needed in creating ecologically valid test scenarios. The evidence obtained from such evaluation can be used to improve both the usability and safety of HIT. In addition, recent work has shown that clinical simulations, in particular those conducted in-situ, can lead to considerable benefits when compared to the costs of running such studies. In order to bring context of use into the testing of HIT, clinical simulation, involving observing representative users carrying out tasks in representative settings, holds considerable promise.

Monoscopic photogrammetry to obtain 3D models by a mobile device: a method for making facial prostheses.

PubMed

Salazar-Gamarra, Rodrigo; Seelaus, Rosemary; da Silva, Jorge Vicente Lopes; da Silva, Airton Moreira; Dib, Luciano Lauria

2016-05-25

The aim of this study is to present the development of a new technique to obtain 3D models using photogrammetry by a mobile device and free software, as a method for making digital facial impressions of patients with maxillofacial defects for the final purpose of 3D printing of facial prostheses. With the use of a mobile device, free software and a photo capture protocol, 2D captures of the anatomy of a patient with a facial defect were transformed into a 3D model. The resultant digital models were evaluated for visual and technical integrity. The technical process and resultant models were described and analyzed for technical and clinical usability. Generating 3D models to make digital face impressions was possible by the use of photogrammetry with photos taken by a mobile device. The facial anatomy of the patient was reproduced by a *.3dp and a *.stl file with no major irregularities. 3D printing was possible. An alternative method for capturing facial anatomy is possible using a mobile device for the purpose of obtaining and designing 3D models for facial rehabilitation. Further studies must be realized to compare 3D modeling among different techniques and systems. Free software and low cost equipment could be a feasible solution to obtain 3D models for making digital face impressions for maxillofacial prostheses, improving access for clinical centers that do not have high cost technology considered as a prior acquisition.

[Artistic anatomy of the nose: proposals for a simplified project of rhinoplasty].

PubMed

Polselli, R; Saban, Y

2007-01-01

The authors developed an original and simple method of evaluation of the aesthetic lines of the nose adapted to the harmony of the face. Initially based on their experience, the authors propose an evaluation of the nose in 2 stages and 5 sequencies based on the construction of single circuit lines according to various incidences. They checked thereafter the validity of this method on the operative project and on the appreciation of the results of the rhinoplasties. Controlled on several types of faces, the method suggested by the authors proved to be reliable, simple, reproducible. The authors proposed a method of evaluation of the aesthetic lines of the nose integrated to the harmony of the face. This method relies on the construction, in 5 stages, of single circuit lines not requiring any particular material. The artistic method of evaluation of the nose proposed by the authors is very simple. Rapid and immediately usable, it makes it possible to schedule a rhinoplasty in a few minutes. The evaluation of the aesthetic results of the rhinoplasties is also very simple and reproducible. It has moreover the merit to propose a model of teaching making it possible to the rhinoplastician to criticize his results and thus to progress in its technical training and its operational indications.

A Persuasive and Social mHealth Application for Physical Activity: A Usability and Feasibility Study

PubMed Central

Al Ayubi, Soleh U; Branch, Robert; Ding, Dan

2014-01-01

Background Advances in smartphones and the wide usage of social networking systems offer opportunities for the development of innovative interventions to promote physical activity. To that end, we developed a persuasive and social mHealth application designed to monitor and motivate users to walk more every day. Objective The objectives of this project were to conduct a focused review on the fundamental characteristics of mHealth for physical activity promotion, to develop an mHealth application that meets such characteristics, and to conduct a feasibility study to deploy the application in everyday life. Methods This project started as an analytical study to review the fundamental characteristics of the technologies used in physical activity monitoring and promotion. Then, it was followed by a technical development of the application. Next, a 4 week deployment was conducted where participants used the application as part of their daily life. A think-aloud method and in-depth semistructured interviews were conducted following the deployment. A qualitative description method was used to thematically analyze the interviews. Feasibility measures included, adherence to the program, user-system interactions, motivation to use, and experience with physical activity and online social interactions. Results There were seven fundamental characteristics of physical activity monitoring and promotion that were identified, which were then used as a foundation to develop the application. There were fourteen participants that enrolled in the application evaluation. The age range was from 24 to 45; body mass index ranged from 18.5 to 42.98, with 4 of the subjects falling into the category “obese”. Half of them were experienced with smartphones, and all were familiar with a social network system. There were thirteen participants that completed the study; one was excluded. Overall, participants gave high scores to almost all of the usability factors examined, with averages of 4.52 out of a 5.00 maximum. Over 29 days, participants used the application for a total of 119,380 minutes (average=7.57 hours/day/participant; SD 1.56). Conclusions Based on the fundamental characteristics, the application was successfully developed. The usability results suggest that the system is usable and user satisfaction was high. Deploying the application was shown to be feasible for the promotion of daily physical activity. PMID:25099928

A Persuasive and Social mHealth Application for Physical Activity: A Usability and Feasibility Study.

PubMed

Al Ayubi, Soleh U; Parmanto, Bambang; Branch, Robert; Ding, Dan

2014-05-22

Advances in smartphones and the wide usage of social networking systems offer opportunities for the development of innovative interventions to promote physical activity. To that end, we developed a persuasive and social mHealth application designed to monitor and motivate users to walk more every day. The objectives of this project were to conduct a focused review on the fundamental characteristics of mHealth for physical activity promotion, to develop an mHealth application that meets such characteristics, and to conduct a feasibility study to deploy the application in everyday life. This project started as an analytical study to review the fundamental characteristics of the technologies used in physical activity monitoring and promotion. Then, it was followed by a technical development of the application. Next, a 4 week deployment was conducted where participants used the application as part of their daily life. A think-aloud method and in-depth semistructured interviews were conducted following the deployment. A qualitative description method was used to thematically analyze the interviews. Feasibility measures included, adherence to the program, user-system interactions, motivation to use, and experience with physical activity and online social interactions. There were seven fundamental characteristics of physical activity monitoring and promotion that were identified, which were then used as a foundation to develop the application. There were fourteen participants that enrolled in the application evaluation. The age range was from 24 to 45; body mass index ranged from 18.5 to 42.98, with 4 of the subjects falling into the category "obese". Half of them were experienced with smartphones, and all were familiar with a social network system. There were thirteen participants that completed the study; one was excluded. Overall, participants gave high scores to almost all of the usability factors examined, with averages of 4.52 out of a 5.00 maximum. Over 29 days, participants used the application for a total of 119,380 minutes (average=7.57 hours/day/participant; SD 1.56). Based on the fundamental characteristics, the application was successfully developed. The usability results suggest that the system is usable and user satisfaction was high. Deploying the application was shown to be feasible for the promotion of daily physical activity.

Usability and accessibility in consumer health informatics current trends and future challenges.

PubMed

Goldberg, Larry; Lide, Bettijoyce; Lowry, Svetlana; Massett, Holly A; O'Connell, Trisha; Preece, Jennifer; Quesenbery, Whitney; Shneiderman, Ben

2011-05-01

It is a truism that, for innovative eHealth systems to have true value and impact, they must first and foremost be usable and accessible by clinicians, consumers, and other stakeholders. In this paper, current trends and future challenges in the usability and accessibility of consumer health informatics will be described. Consumer expectations of their healthcare providers and healthcare records in this new era of consumer-directed care will be explored, and innovative visualizations, assistive technologies, and other ways that healthcare information is currently being provided and/or shared will be described. Challenges for ensuring the usability of current and future systems will also be discussed. An innovative model for conducting systematic, timely, user-centered research on consumer-facing websites at the National Cancer Institute (NCI) and the ongoing efforts at the National Institute of Standards and Technology (NIST) to promote health information technology (HIT) usability standards and evaluation criteria will also be presented. Copyright © 2011 American Journal of Preventive Medicine. All rights reserved.

Usability: a critical success factor for managing change in the clinical info-structure.

PubMed

Kay, S

2005-06-01

There can be no doubt that the clinical info-structure is being significantly enriched with the deployment of new systems throughout the health sector. From a technological perspective, the initial emphasis has been mainly on functionality and only latterly on the usability of these clinical information systems. However, the large scale and rapid pace of the changes being wrought in the health sector will have a major impact on clinicians and patients, not least in how they interact with the technology. Therefore, it is not only hardware and software but people-ware, too, that needs to be actively managed; not simply a one-off functional specification but an ongoing, complex relationship. Usability is the human factor that encompasses the ethical, educational, and evaluative aspects of design. There is also a strong case for regarding usability of clinical information systems as a key critical success factor for the management of change within the health-care domain. In particular, the relationship between usability, and education and training is examined.

Feasibility and usability of a home monitoring concept based on mobile phones and near field communication (NFC) technology.

PubMed

Morak, Jürgen; Kollmann, Alexander; Schreier, Günter

2007-01-01

Utilization of mobile information and communication technologies in home monitoring applications is becoming more and more common. The mobile phone, acting as a patient terminal for patients suffering from chronic diseases, provides an active link to the caregiver to transmit health status information and receive feedback. In such a concept the usability is still limited by the necessity of entering the values via the mobile phone's small keypad. The near field communication technology (NFC), a touch-based wireless interface that became available recently, may improve the usability level of such applications significantly. The focus of this paper is to describe the development of a prototype application based on this technology embedded in a home monitoring system. The feasibility and usability of this approach are evaluated and compared with concepts used in previous approaches. The high quantifier with respect to overall usability indicates that NFC may be the technology of choice for some tasks in home monitoring applications.

An ambient assisted living approach in designing domiciliary services combined with innovative technologies for patients with Alzheimer's disease: a case study.

PubMed

Cavallo, Filippo; Aquilano, Michela; Arvati, Marco

2015-02-01

Alzheimer's disease (AD) is one of the most disabling diseases to affect large numbers of elderly people worldwide. Because of the characteristics of this disease, patients with AD require daily assistance from service providers both in nursing homes and at home. Domiciliary assistance has been demonstrated to be cost effective and efficient in the first phase of the disease, helping to slow down the course of the illness, improve the quality of life and care, and extend independence for patients and caregivers. In this context, the aim of this work is to demonstrate the technical effectiveness and acceptability of an innovative domiciliary smart sensor system for providing domiciliary assistance to patients with AD which has been developed with an Ambient Assisted Living (AAL) approach. The design, development, testing, and evaluation of the innovative technological solution were performed by a multidisciplinary team. In all, 15 sociomedical operators and 14 patients with AD were directly involved in defining the end-users' needs and requirements, identifying design principles with acceptability and usability features and evaluating the technological solutions before and after the real experimentation. A modular technological system was produced to help caregivers continuously monitor the health status, safety, and daily activities of patients with AD. During the experimentation, the acceptability, utility, usability, and efficacy of this system were evaluated as quite positive. The experience described in this article demonstrated that AAL technologies are feasible and effective nowadays and can be actively used in assisting patients with AD in their homes. The extensive involvement of caregivers in the experimentation allowed to assess that there is, through the use of the technological system, a proven improvement in care performance and efficiency of care provision by both formal and informal caregivers and consequently an increase in the quality of life of patients, their relatives, and their caregivers. © The Author(s) 2014.

A Web-Based Treatment Decision Support Tool for Patients With Advanced Knee Arthritis: Evaluation of User Interface and Content Design.

PubMed

Zheng, Hua; Rosal, Milagros C; Li, Wenjun; Borg, Amy; Yang, Wenyun; Ayers, David C; Franklin, Patricia D

2018-04-30

Data-driven surgical decisions will ensure proper use and timing of surgical care. We developed a Web-based patient-centered treatment decision and assessment tool to guide treatment decisions among patients with advanced knee osteoarthritis who are considering total knee replacement surgery. The aim of this study was to examine user experience and acceptance of the Web-based treatment decision support tool among older adults. User-centered formative and summative evaluations were conducted for the tool. A sample of 28 patients who were considering total knee replacement participated in the study. Participants' responses to the user interface design, the clarity of information, as well as usefulness, satisfaction, and acceptance of the tool were collected through qualitative (ie, individual patient interviews) and quantitative (ie, standardized Computer System Usability Questionnaire) methods. Participants were older adults with a mean age of 63 (SD 11) years. Three-quarters of them had no technical questions using the tool. User interface design recommendations included larger fonts, bigger buttons, less colors, simpler navigation without extra "next page" click, less mouse movement, and clearer illustrations with simple graphs. Color-coded bar charts and outcome-specific graphs with positive action were easiest for them to understand the outcomes data. Questionnaire data revealed high satisfaction with the tool usefulness and interface quality, and also showed ease of use of the tool, regardless of age or educational status. We evaluated the usability of a patient-centered decision support tool designed for advanced knee arthritis patients to facilitate their knee osteoarthritis treatment decision making. The lessons learned can inform other decision support tools to improve interface and content design for older patients' use. ©Hua Zheng, Milagros C Rosal, Wenjun Li, Amy Borg, Wenyun Yang, David C Ayers, Patricia D Franklin. Originally published in JMIR Human Factors (http://humanfactors.jmir.org), 30.04.2018.

A usability evaluation exploring the design of American Nurses Association state web sites.

PubMed

Alexander, Gregory L; Wakefield, Bonnie J; Anbari, Allison B; Lyons, Vanessa; Prentice, Donna; Shepherd, Marilyn; Strecker, E Bradley; Weston, Marla J

2014-08-01

National leaders are calling for opportunities to facilitate the Future of Nursing. Opportunities can be encouraged through state nurses association Web sites, which are part of the American Nurses Association, that are well designed, with appropriate content, and in a language professional nurses understand. The American Nurses Association and constituent state nurses associations provide information about nursing practice, ethics, credentialing, and health on Web sites. We conducted usability evaluations to determine compliance with heuristic and ethical principles for Web site design. We purposefully sampled 27 nursing association Web sites and used 68 heuristic and ethical criteria to perform systematic usability assessments of nurse association Web sites. Web site analysis included seven double experts who were all RNs trained in usability analysis. The extent to which heuristic and ethical criteria were met ranged widely from one state that met 0% of the criteria for "help and documentation" to states that met greater than 92% of criteria for "visibility of system status" and "aesthetic and minimalist design." Suggested improvements are simple yet make an impact on a first-time visitor's impression of the Web site. For example, adding internal navigation and tracking features and providing more details about the application process through help and frequently asked question documentation would facilitate better use. Improved usability will improve effectiveness, efficiency, and consumer satisfaction with these Web sites.

A methodological approach for designing a usable ontology-based GUI in healthcare.

PubMed

Lasierra, N; Kushniruk, A; Alesanco, A; Borycki, E; García, J

2013-01-01

This paper presents a methodological approach to the design and evaluation of an interface for an ontology-based system used for designing care plans for monitoring patients at home. In order to define the care plans, physicians need a tool for creating instances of the ontology and configuring some rules. Our purpose is to develop an interface to allow clinicians to interact with the ontology. Although ontology-driven applications do not necessarily present the ontology in the user interface, it is our hypothesis that showing selected parts of the ontology in a "usable" way could enhance clinician's understanding and make easier the definition of the care plans. Based on prototyping and iterative testing, this methodology combines visualization techniques and usability methods. Preliminary results obtained after a formative evaluation indicate the effectiveness of suggested combination.

Knowledge management impact of information technology Web 2.0/3.0. The case study of agent software technology usability in knowledge management system

NASA Astrophysics Data System (ADS)

Sołtysik-Piorunkiewicz, Anna

2015-02-01

How we can measure the impact of internet technology Web 2.0/3.0 for knowledge management? How we can use the Web 2.0/3.0 technologies for generating, evaluating, sharing, organizing knowledge in knowledge-based organization? How we can evaluate it from user-centered perspective? Article aims to provide a method for evaluate the usability of web technologies to support knowledge management in knowledge-based organizations of the various stages of the cycle knowledge management, taking into account: generating knowledge, evaluating knowledge, sharing knowledge, etc. for the modern Internet technologies based on the example of agent technologies. The method focuses on five areas of evaluation: GUI, functional structure, the way of content publication, organizational aspect, technological aspect. The method is based on the proposed indicators relating respectively to assess specific areas of evaluation, taking into account the individual characteristics of the scoring. Each of the features identified in the evaluation is judged first point wise, then this score is subject to verification and clarification by means of appropriate indicators of a given feature. The article proposes appropriate indicators to measure the impact of Web 2.0/3.0 technologies for knowledge management and verification them in an example of agent technology usability in knowledge management system.

Adaptation of non-technical skills behavioural markers for delivery room simulation.

PubMed

Bracco, Fabrizio; Masini, Michele; De Tonetti, Gabriele; Brogioni, Francesca; Amidani, Arianna; Monichino, Sara; Maltoni, Alessandra; Dato, Andrea; Grattarola, Claudia; Cordone, Massimo; Torre, Giancarlo; Launo, Claudio; Chiorri, Carlo; Celleno, Danilo

2017-03-17

Simulation in healthcare has proved to be a useful method in improving skills and increasing the safety of clinical operations. The debriefing session, after the simulated scenario, is the core of the simulation, since it allows participants to integrate the experience with the theoretical frameworks and the procedural guidelines. There is consistent evidence for the relevance of non-technical skills (NTS) for the safe and efficient accomplishment of operations. However, the observation, assessment and feedback on these skills is particularly complex, because the process needs expert observers and the feedback is often provided in judgmental and ineffective ways. The aim of this study was therefore to develop and test a set of observation and rating forms for the NTS behavioural markers of multi-professional teams involved in delivery room emergency simulations (MINTS-DR, Multi-professional Inventory for Non-Technical Skills in the Delivery Room). The MINTS-DR was developed by adapting the existing tools and, when needed, by designing new tools according to the literature. We followed a bottom-up process accompanied by interviews and co-design between practitioners and psychology experts. The forms were specific for anaesthetists, gynaecologists, nurses/midwives, assistants, plus a global team assessment tool. We administered the tools in five editions of a simulation training course that involved 48 practitioners. Ratings on usability and usefulness were collected. The mean ratings of the usability and usefulness of the tools were not statistically different to or higher than 4 on a 5-point rating scale. In either case no significant differences were found across professional categories. The MINTS-DR is quick and easy to administer. It is judged to be a useful asset in maximising the learning experience that is provided by the simulation.

Pervasive mobile healthcare systems for chronic disease monitoring.

PubMed

Huzooree, Geshwaree; Kumar Khedo, Kavi; Joonas, Noorjehan

2017-05-01

Pervasive mobile healthcare system has the potential to improve healthcare and the quality of life of chronic disease patients through continuous monitoring. Recently, many articles related to pervasive mobile healthcare system focusing on health monitoring using wireless technologies have been published. The main aim of this review is to evaluate the state-of-the-art pervasive mobile healthcare systems to identify major technical requirements and design challenges associated with the realization of a pervasive mobile healthcare system. A systematic literature review was conducted over IEEE Xplore Digital Library to evaluate 20 pervasive mobile healthcare systems out of 683 articles from 2011 to 2016. The classification of the pervasive mobile healthcare systems and other important factors are discussed. Potential opportunities and challenges are pointed out for the further deployment of effective pervasive mobile healthcare systems. This article helps researchers in health informatics to have a holistic view toward understanding pervasive mobile healthcare systems and points out new technological trends and design challenges that researchers have to consider when designing such systems for better adoption, usability, and seamless integration.

NASA Aviation Safety Program Weather Accident Prevention/weather Information Communications (WINCOMM)

NASA Technical Reports Server (NTRS)

Feinberg, Arthur; Tauss, James; Chomos, Gerald (Technical Monitor)

2002-01-01

Weather is a contributing factor in approximately 25-30 percent of general aviation accidents. The lack of timely, accurate and usable weather information to the general aviation pilot in the cockpit to enhance pilot situational awareness and improve pilot judgment remains a major impediment to improving aviation safety. NASA Glenn Research Center commissioned this 120 day weather datalink market survey to assess the technologies, infrastructure, products, and services of commercial avionics systems being marketed to the general aviation community to address these longstanding safety concerns. A market survey of companies providing or proposing to provide graphical weather information to the general aviation cockpit was conducted. Fifteen commercial companies were surveyed. These systems are characterized and evaluated in this report by availability, end-user pricing/cost, system constraints/limits and technical specifications. An analysis of market survey results and an evaluation of product offerings were made. In addition, recommendations to NASA for additional research and technology development investment have been made as a result of this survey to accelerate deployment of cockpit weather information systems for enhancing aviation safety.

A wireless PDA-based physiological monitoring system for patient transport.

PubMed

Lin, Yuan-Hsiang; Jan, I-Chien; Ko, Patrick Chow-In; Chen, Yen-Yu; Wong, Jau-Min; Jan, Gwo-Jen

2004-12-01

This paper proposes a mobile patient monitoring system, which integrates current personal digital assistant (PDA) technology and wireless local area network (WLAN) technology. At the patient's location, a wireless PDA-based monitor is used to acquire continuously the patient's vital signs, including heart rate, three-lead electrocardiography, and SpO2. Through the WLAN, the patient's biosignals can be transmitted in real-time to a remote central management unit, and authorized medical staffs can access the data and the case history of the patient, either by the central management unit or the wireless devices. A prototype of this system has been developed and implemented. The system has been evaluated by technical verification, clinical test, and user survey. The evaluation of performance yields a high degree of satisfaction (mean = 4.64, standard deviation--SD = 0.53 in a five-point Likert scale) of users who used the PDA-based system for intrahospital transport. The results also show that the wireless PDA model is superior to the currently used monitors both in mobility and in usability, and is, therefore, better suited to patient transport.

Development of an interprofessional lean facilitator assessment scale.

PubMed

Bravo-Sanchez, Cindy; Dorazio, Vincent; Denmark, Robert; Heuer, Albert J; Parrott, J Scott

2018-05-01

High reliability is important for optimising quality and safety in healthcare organisations. Reliability efforts include interprofessional collaborative practice (IPCP) and Lean quality/process improvement strategies, which require skilful facilitation. Currently, no validated Lean facilitator assessment tool for interprofessional collaboration exists. This article describes the development and pilot evaluation of such a tool; the Interprofessional Lean Facilitator Assessment Scale (ILFAS), which measures both technical and 'soft' skills, which have not been measured in other instruments. The ILFAS was developed using methodologies and principles from Lean/Shingo, IPCP, metacognition research and Bloom's Taxonomy of Learning Domains. A panel of experts confirmed the initial face validity of the instrument. Researchers independently assessed five facilitators, during six Lean sessions. Analysis included quantitative evaluation of rater agreement. Overall inter-rater agreement of the assessment of facilitator performance was high (92%), and discrepancies in the agreement statistics were analysed. Face and content validity were further established, and usability was evaluated, through primary stakeholder post-pilot feedback, uncovering minor concerns, leading to tool revision. The ILFAS appears comprehensive in the assessment of facilitator knowledge, skills, abilities, and may be useful in the discrimination between facilitators of different skill levels. Further study is needed to explore instrument performance and validity.

Evaluating the Usability of a Professional Modeling Tool Repurposed for Middle School Learning

ERIC Educational Resources Information Center

Peters, Vanessa L.; Songer, Nancy Butler

2013-01-01

This paper reports the results of a three-stage usability test of a modeling tool designed to support learners' deep understanding of the impacts of climate change on ecosystems. The design process involved repurposing an existing modeling technology used by professional scientists into a learning tool specifically designed for middle school…

Design and Usability Testing of an Audio Platform Game for Players with Visual Impairments

ERIC Educational Resources Information Center

Oren, Michael; Harding, Chris; Bonebright, Terri L.

2008-01-01

This article reports on the evaluation of a novel audio platform game that creates a spatial, interactive experience via audio cues. A pilot study with players with visual impairments, and usability testing comparing the visual and audio game versions using both sighted players and players with visual impairments, revealed that all the…

Usability of a Web-Based School Experience System: Opinions of IT Teachers and Teacher Candidates

ERIC Educational Resources Information Center

Genç, Zülfü

2015-01-01

With advances in information and communication technologies, the classical nature of educational institutions has changed. One innovative effort within teacher training is the Web-Based School Experience System (WBSES) developed by the researcher. In this study, the usability of an existing WBSES is evaluated from both teachers' (n = 13) and…

Mobile Learning Analytics in Higher Education: Usability Testing and Evaluation of an APP Prototype

ERIC Educational Resources Information Center

Kuhnel, Matthias; Seiler, Luisa; Honal, Andrea; Ifenthaler, Dirk

2017-01-01

This study aims to test the usability of MyLA (My Learning Analytics), an application for students at two German universities: The Cooperative State University Mannheim and University of Mannheim. The participating universities focus on the support of personalized and self-regulated learning. MyLA collects data such as learning behavior and…

Evaluating CSL/CFL Website Usability: A User-Centered Design Approach

ERIC Educational Resources Information Center

Huang, Chung-Kai; Hsin, Ching-O; Chiu, Chiung-Hui

2010-01-01

With the widespread availability of Internet and computer technology, on-line web-based learning has become prevalent in the field of teaching Chinese as a second/foreign language (CSL/CFL). This study examined the concepts of usability and types of design elements that help construct an effective web-based learning environment, as well as their…

An Efficient Approach to Improve the Usability of e-Learning Resources: The Role of Heuristic Evaluation

ERIC Educational Resources Information Center

Davids, Mogamat Razeen; Chikte, Usuf M. E.; Halperin, Mitchell L.

2013-01-01

Optimizing the usability of e-learning materials is necessary to maximize their potential educational impact, but this is often neglected when time and other resources are limited, leading to the release of materials that cannot deliver the desired learning outcomes. As clinician-teachers in a resource-constrained environment, we investigated…

Popular Mobile Phone Apps for Diet and Weight Loss: A Content Analysis.

PubMed

Zaidan, Sarah; Roehrer, Erin

2016-07-11

A review of the literature has revealed that the rates of overweight and obesity have been increasing in Australia over the last two decades and that wellness mobile phone apps play a significant role in monitoring and managing individuals' weight. Although mobile phone app markets (iTunes and Google Play) list thousands of mobile phone health apps, it is not always clear whether those apps are supported by credible sources. Likewise, despite the prevailing use of mobile phone apps to aid with weight management, the usability features of these apps are not well characterized. The research explored how usability taxonomy could inform the popularity of downloaded, socially focused wellness mobile phone apps, in particular weight loss and diet apps. The aim of the study was to investigate the Australian mobile phone app stores (iTunes and Google Play) in order to examine the usability features of the most popular (ie, most downloaded) wellness apps. The design of this study comprises 3 main stages: stage 1, identifying apps; stage 2, development of weight loss and diet evaluation framework; and stage 3, application of the evaluation framework. Each stage includes specific data collection, analysis tools, and techniques. The study has resulted in the development of a justified evaluation framework for weight loss and diet mobile phone apps. Applying the evaluation framework to the identified apps has shown that the most downloaded iTunes and Google Play apps are not necessarily the most usable or effective. In addition, the research found that search algorithms for iTunes and Google Play are biased toward apps' titles and keywords that do not accurately define the real functionality of the app. Moreover, the study has also analyzed the apps' user reviews, which served as justification for the developed evaluation framework. The analysis has shown that ease of use, reminder, bar code scanning, motivation, usable for all, and synchronization are significant attributes that should be included in weight loss and diet mobile phone apps and ultimately in potential weight loss and diet evaluation frameworks.

Popular Mobile Phone Apps for Diet and Weight Loss: A Content Analysis

PubMed Central

Roehrer, Erin

2016-01-01

Background A review of the literature has revealed that the rates of overweight and obesity have been increasing in Australia over the last two decades and that wellness mobile phone apps play a significant role in monitoring and managing individuals’ weight. Although mobile phone app markets (iTunes and Google Play) list thousands of mobile phone health apps, it is not always clear whether those apps are supported by credible sources. Likewise, despite the prevailing use of mobile phone apps to aid with weight management, the usability features of these apps are not well characterized. Objective The research explored how usability taxonomy could inform the popularity of downloaded, socially focused wellness mobile phone apps, in particular weight loss and diet apps. The aim of the study was to investigate the Australian mobile phone app stores (iTunes and Google Play) in order to examine the usability features of the most popular (ie, most downloaded) wellness apps. Methods The design of this study comprises 3 main stages: stage 1, identifying apps; stage 2, development of weight loss and diet evaluation framework; and stage 3, application of the evaluation framework. Each stage includes specific data collection, analysis tools, and techniques. Results The study has resulted in the development of a justified evaluation framework for weight loss and diet mobile phone apps. Applying the evaluation framework to the identified apps has shown that the most downloaded iTunes and Google Play apps are not necessarily the most usable or effective. In addition, the research found that search algorithms for iTunes and Google Play are biased toward apps’ titles and keywords that do not accurately define the real functionality of the app. Moreover, the study has also analyzed the apps’ user reviews, which served as justification for the developed evaluation framework. Conclusions The analysis has shown that ease of use, reminder, bar code scanning, motivation, usable for all, and synchronization are significant attributes that should be included in weight loss and diet mobile phone apps and ultimately in potential weight loss and diet evaluation frameworks. PMID:27400806

The UX of amila pregnancy on mobile device

NASA Astrophysics Data System (ADS)

Hussain, Azham; Mkpojiogu, Emmanuel O. C.; Fadzil, Najdawati Mohd; Hassan, Norhasizasuriati Mohd

2017-10-01

The increased use of mobile devices has led to an upsurge in the number of mobile applications. This makes the usability of these applications a very crucial and critical issue. The Amila Pregnancy mobile app is revolutionizing the delivery of healthcare services to pregnancy woman across the globe and is increasingly becoming beneficial in their daily life. Only a few digital interventions have been developed for pregnant woman, and little is known about the acceptability and usability of such mobile apps that provide assistance to pregnant women. Usability comprises everything that is connected with the intuitive and efficient handling of user interaction with human-made devices. This paper reports the result of a usability evaluation for Amila Pregnancy mobile application. In the study five attributes of perceived usability was measured following Jakob Nielsen principles, namely: effectiveness, efficiency, learnability, memorability and satisfaction. In addition, performance metrics were also captured. The results reveal the difficulty users had in interpreting displayed icon, locating the information provided, re-finding it and in navigating through the mobile app. The study suggests that the main menu of the app need to be further improved upon to enhance its usability.

Usability Testing of a National Substance Use Screening Tool Embedded in Electronic Health Records.

PubMed

Press, Anne; DeStio, Catherine; McCullagh, Lauren; Kapoor, Sandeep; Morley, Jeanne; Conigliaro, Joseph

2016-07-08

Screening, brief intervention, and referral to treatment (SBIRT) is currently being implemented into health systems nationally via paper and electronic methods. The purpose of this study was to evaluate the integration of an electronic SBIRT tool into an existing paper-based SBIRT clinical workflow in a patient-centered medical home. Usability testing was conducted in an academic ambulatory clinic. Two rounds of usability testing were done with medical office assistants (MOAs) using a paper and electronic version of the SBIRT tool, with two and four participants, respectively. Qualitative and quantitative data was analyzed to determine the impact of both tools on clinical workflow. A second round of usability testing was done with the revised electronic version and compared with the first version. Personal workflow barriers cited in the first round of testing were that the electronic health record (EHR) tool was disruptive to patient's visits. In Round 2 of testing, MOAs reported favoring the electronic version due to improved layout and the inclusion of an alert system embedded in the EHR. For example, using the system usability scale (SUS), MOAs reported a grade "1" for the statement, "I would like to use this system frequently" during the first round of testing but a "5" during the second round of analysis. The importance of testing usability of various mediums of tools used in health care screening is highlighted by the findings of this study. In the first round of testing, the electronic tool was reported as less user friendly, being difficult to navigate, and time consuming. Many issues faced in the first generation of the tool were improved in the second generation after usability was evaluated. This study demonstrates how usability testing of an electronic SBRIT tool can help to identify challenges that can impact clinical workflow. However, a limitation of this study was the small sample size of MOAs that participated. The results may have been biased to Northwell Health workers' perceptions of the SBIRT tool and their specific clinical workflow.

Opening Reproducible Research

NASA Astrophysics Data System (ADS)

Nüst, Daniel; Konkol, Markus; Pebesma, Edzer; Kray, Christian; Klötgen, Stephanie; Schutzeichel, Marc; Lorenz, Jörg; Przibytzin, Holger; Kussmann, Dirk

2016-04-01

Open access is not only a form of publishing such that research papers become available to the large public free of charge, it also refers to a trend in science that the act of doing research becomes more open and transparent. When science transforms to open access we not only mean access to papers, research data being collected, or data being generated, but also access to the data used and the procedures carried out in the research paper. Increasingly, scientific results are generated by numerical manipulation of data that were already collected, and may involve simulation experiments that are completely carried out computationally. Reproducibility of research findings, the ability to repeat experimental procedures and confirm previously found results, is at the heart of the scientific method (Pebesma, Nüst and Bivand, 2012). As opposed to the collection of experimental data in labs or nature, computational experiments lend themselves very well for reproduction. Some of the reasons why scientists do not publish data and computational procedures that allow reproduction will be hard to change, e.g. privacy concerns in the data, fear for embarrassment or of losing a competitive advantage. Others reasons however involve technical aspects, and include the lack of standard procedures to publish such information and the lack of benefits after publishing them. We aim to resolve these two technical aspects. We propose a system that supports the evolution of scientific publications from static papers into dynamic, executable research documents. The DFG-funded experimental project Opening Reproducible Research (ORR) aims for the main aspects of open access, by improving the exchange of, by facilitating productive access to, and by simplifying reuse of research results that are published over the Internet. Central to the project is a new form for creating and providing research results, the executable research compendium (ERC), which not only enables third parties to reproduce the original research and hence recreate the original research results (figures, tables), but also facilitates interaction with them as well as their recombination with new data or methods. Building on existing open standards and software, this project develops standards and tools for ERCs, and will demonstrate and evaluate these, focusing on the geosciences domains. The project goes beyond a technical solution for ERCs by evaluating the system from the perspectives of geoscience researchers as participants in a scientific publication process. It will focus on the statistical environment R, but also evaluate larger run time systems captured in virtual environments (Docker containers). ERCs are built upon and integrate well with both established day-to-day workflows of digital research and the scientific publication process. They make research accessible on different levels at any stage to anyone via open web platforms. Other scientists can transfer a compendium of software and tools to their own local environment and collaborate, while others make minimal changes and compare changed results in a web browser. Building on recent advances in mainstream IT, ORR envisions a new architecture for storing, executing and interacting with the original analysis environment alongside the corresponding research data and text. ORR bridges the gap between long-term archives, practical geoscience researchers, as well as publication media. Consequently, the project team seeks input and feedback from researchers working with geospatial data to ensure usable and useful open access publications as well as a publication process that minimizes effort while maximizing usability and re-usability. {References} Pebesma, E., D. Nüst, R. Bivand, 2012. The R software environment in reproducible geoscientific research. Eos, Transactions American Geophysical Union 93, vol 16, p. http://dx.doi.org/10.1029/2012EO160003{163-164}. Opening Reproducible Research project description and website: https://www.uni-muenster.de/forschungaz/project/9520?lang=en

Standardization by ISO to Ensure the Sustainability of Space Activities

NASA Astrophysics Data System (ADS)

Kato, A.; Lazare, B.; Oltrogge, D.; Stokes, H.

2013-08-01

The ISO / Technical Committee 20 / Sub-committee 14 develops debris-related standards and technical reports to mitigate debris and help ensure mission and space sustainability. While UN Guidelines and the IADC Guidelines encourage national governments and agencies to promote debris mitigation design and operation, the ISO standards will help the global space industry promote and sustain its space-related business. In this paper the scope and status of each ISO standard is discussed within an overall framework. A comparison with international guidelines is also provided to demonstrate the level of consistency. Finally, as a case study, the ISO standards are applied to a CubeSat mission, thus demonstrating their usability on a relatively recent and popular class of satellite.

Reservoir Sedimentation: Impact, Extent, and Mitigation

NASA Astrophysics Data System (ADS)

Hadley, Richard F.

Storage reservoirs play an important role in water resources development throughout the world. The one problem with reservoirs that is universal is the continual reduction in usable capacity caused by siltation. This book reviews the world picture of erosion and sediment yield, the large variations that exist, and the physical phenomena related to reservoir siltation. The book is in the Technical Paper series of The World Bank (Technical Paper 71) and is not a formal publication. Rather, it is intended to be circulated to encourage discussion and comment and to communicate results quickly. The book is reproduced from typescript, but this does not detract from the value of the contents as a useful text for hydrologrsts, engineers, and soil conservationists in developing countries.

Robotic Companions for Older People: A Case Study in the Wild.

PubMed

Doering, Nicola; Richter, Katja; Gross, Horst-Michael; Schroeter, Christof; Mueller, Steffen; Volkhardt, Michael; Scheidig, Andrea; Debes, Klaus

2015-01-01

Older people tend to have difficulties using unknown technical devices and are less willing to accept technical shortcomings. Therefore, a robot that is supposed to support older people in managing daily life has to adapt to the users' needs and capabilities that are very heterogeneous within the target group. The aim of the presented case study was to provide in-depth insights on individual usage patterns and acceptance of a mobile service robot in real live environments (i.e. in the users' homes). Results from three cases (users aged 67, 78 and 85 living in their own apartments) are reported. Findings on usability and user experience illustrate that the robot has considerable potential to be accepted to support daily living at home.

A Self-Regulation Theory–Based Asthma Management Mobile App for Adolescents: A Usability Assessment

PubMed Central

2017-01-01

Background Self-regulation theory suggests people learn to influence their own behavior through self-monitoring, goal-setting, feedback, self-reward, and self-instruction, all of which smartphones are now capable of facilitating. Several mobile apps exist to manage asthma; however, little evidence exists about whether these apps employ user-centered design processes that adhere to government usability guidelines for mobile apps. Objective Building upon a previous study that documented adolescent preferences for an asthma self-management app, we employed a user-centered approach to assess the usability of a high-fidelity wireframe for an asthma self-management app intended for use by adolescents with persistent asthma. Methods Individual interviews were conducted with adolescents (ages 11-18 years) with persistent asthma who owned a smartphone (N=8). Adolescents were asked to evaluate a PDF app wireframe consisting of 76 screen shots displaying app features, including log in and home screen, profile setup, settings and info, self-management features, and graphical displays for charting asthma control and medication. Preferences, comments, and suggestions for each set of screen shots were assessed using the audio-recorded interviews. Two coders reached consensus on adolescent evaluations of the following aspects of app features: (1) usability, (2) behavioral intentions to use, (3) confusing aspects, and (4) suggestions for improvement. Results The app wireframe was generally well received, and several suggestions for improvement were recorded. Suggestions included increased customization of charts and notifications, reminders, and alerts. Participants preferred longitudinal data about asthma control and medication use to be displayed using line graphs. All participants reported that they would find an asthma management app like the one depicted in the wireframe useful for managing their asthma. Conclusions Early stage usability tests guided by government usability guidelines (usability.gov) revealed areas for improvement for an asthma self-management app for adolescents. Addressing these areas will be critical to developing an engaging and effective asthma self-management app that is capable of improving adolescent asthma outcomes. PMID:28148471

Usability testing of a monitoring and feedback tool to stimulate physical activity.

PubMed

van der Weegen, Sanne; Verwey, Renée; Tange, Huibert J; Spreeuwenberg, Marieke D; de Witte, Luc P

2014-01-01

A MONITORING AND FEEDBACK TOOL TO STIMULATE PHYSICAL ACTIVITY, CONSISTING OF AN ACTIVITY SENSOR, SMARTPHONE APPLICATION (APP), AND WEBSITE FOR PATIENTS AND THEIR PRACTICE NURSES, HAS BEEN DEVELOPED: the 'It's LiFe!' tool. In this study the usability of the tool was evaluated by technology experts and end users (people with chronic obstructive pulmonary disease or type 2 diabetes, with ages from 40-70 years), to improve the user interfaces and content of the tool. THE STUDY HAD FOUR PHASES: 1) a heuristic evaluation with six technology experts; 2) a usability test in a laboratory by five patients; 3) a pilot in real life wherein 20 patients used the tool for 3 months; and 4) a final lab test by five patients. In both lab tests (phases 2 and 4) qualitative data were collected through a thinking-aloud procedure and video recordings, and quantitative data through questions about task complexity, text comprehensiveness, and readability. In addition, the post-study system usability questionnaire (PSSUQ) was completed for the app and the website. In the pilot test (phase 3), all patients were interviewed three times and the Software Usability Measurement Inventory (SUMI) was completed. After each phase, improvements were made, mainly to the layout and text. The main improvement was a refresh button for active data synchronization between activity sensor, app, and server, implemented after connectivity problems in the pilot test. The mean score on the PSSUQ for the website improved from 5.6 (standard deviation [SD] 1.3) to 6.5 (SD 0.5), and for the app from 5.4 (SD 1.5) to 6.2 (SD 1.1). Satisfaction in the pilot was not very high according to the SUMI. The use of laboratory versus real-life tests and expert-based versus user-based tests revealed a wide range of usability issues. The usability of the It's LiFe! tool improved considerably during the study.

Geospatial Standards and the Knowledge Generation Lifescycle

NASA Technical Reports Server (NTRS)

Khalsa, Siri Jodha S.; Ramachandran, Rahul

2014-01-01

Standards play an essential role at each stage in the sequence of processes by which knowledge is generated from geoscience observations, simulations and analysis. This paper provides an introduction to the field of informatics and the knowledge generation lifecycle in the context of the geosciences. In addition we discuss how the newly formed Earth Science Informatics Technical Committee is helping to advance the application of standards and best practices to make data and data systems more usable and interoperable.

Current research on aviation weather (bibliography)

NASA Technical Reports Server (NTRS)

Durham, D. E.; Frost, W.

1978-01-01

This bibliography of 326 readily usable references of basic and applied research programs related to the various areas of aviation meteorology was assembled. A literature search was conducted which surveyed the major abstract publications such as the International Aerospace Abstracts, the Meteorological and Geoastrophysical Abstracts, and the Scientific and Technical Aerospace Reports. In addition, NASA and DOT computer literature searches were run; and NASA, NOAA, and FAA research project managers were requested to provide writeups on their ongoing research.

[Organize quality assurance as in aviation; improve patient safety in Dutch hospitals].

PubMed

Haerkens, Marck H T M; Beekmann, Roland T A; van den Elzen, Guus J P; Lansbergen, Michael D I; Berlijn, Dick L

2009-01-01

Failing teamwork is a major cause of adverse events in hospitals in the Netherlands. Training team-skills can improve the safety standards in clinical heath care. An adapted version of Crew Resource Management (CRM) training is proving to be a usable format in the hospital environment. We emphasize that paying attention to the subject of safety has to start early in medical education in order to incorporate non-technical skills into the hospital culture.

The diffusion of virtual communities in health care: concepts and challenges.

PubMed

Demiris, George

2006-08-01

This paper providers an overview and discussion of virtual communities in health care. Furthermore, we aim to discuss in this context ethical, legal and technical considerations and the current status of research in this domain. We searched medical and social science literature including survey studies, randomized and non-randomized controlled interventions and reviews. The literature indicates that a virtual community in health care as a group of people using telecommunication with the purposes of delivering health care and education, and/or providing support, covers a wide range of clinical specialties, technologies and stakeholders. Examples include peer-to-peer networks, virtual health care delivery and research teams. Ethical challenges including the concepts of identity and deception, privacy and confidentiality and technical issues, such as sociability and usability are discussed. Virtual communities may empower patients and enhance coordination of care services; however, there is not sufficient systematic evidence of the effectiveness of virtual communities on clinical outcomes or patient empowerment. Researchers need to address issues, such as sample sizes and experimental design to further the research field in this domain. When practitioners utilize virtual community tools to communicate with patients or colleagues they have to maximize sociability and usability of this mode of communication, while addressing concerns for privacy and the fear of de-humanizing practice, and the lack of clarity or relevance of current legislative frameworks.

ODMSummary: A Tool for Automatic Structured Comparison of Multiple Medical Forms Based on Semantic Annotation with the Unified Medical Language System

PubMed Central

Krumm, Rainer; Dugas, Martin

2016-01-01

Introduction Medical documentation is applied in various settings including patient care and clinical research. Since procedures of medical documentation are heterogeneous and developed further, secondary use of medical data is complicated. Development of medical forms, merging of data from different sources and meta-analyses of different data sets are currently a predominantly manual process and therefore difficult and cumbersome. Available applications to automate these processes are limited. In particular, tools to compare multiple documentation forms are missing. The objective of this work is to design, implement and evaluate the new system ODMSummary for comparison of multiple forms with a high number of semantically annotated data elements and a high level of usability. Methods System requirements are the capability to summarize and compare a set of forms, enable to estimate the documentation effort, track changes in different versions of forms and find comparable items in different forms. Forms are provided in Operational Data Model format with semantic annotations from the Unified Medical Language System. 12 medical experts were invited to participate in a 3-phase evaluation of the tool regarding usability. Results ODMSummary (available at https://odmtoolbox.uni-muenster.de/summary/summary.html) provides a structured overview of multiple forms and their documentation fields. This comparison enables medical experts to assess multiple forms or whole datasets for secondary use. System usability was optimized based on expert feedback. Discussion The evaluation demonstrates that feedback from domain experts is needed to identify usability issues. In conclusion, this work shows that automatic comparison of multiple forms is feasible and the results are usable for medical experts. PMID:27736972

Selection and collection of multi parameter physiological data for cardiac rhythm diagnostic algorithm development

NASA Astrophysics Data System (ADS)

Bostock, J.; Weller, P.; Cooklin, M.

2010-07-01

Automated diagnostic algorithms are used in implantable cardioverter-defibrillators (ICD's) to detect abnormal heart rhythms. Algorithms misdiagnose and improved specificity is needed to prevent inappropriate therapy. Knowledge engineering (KE) and artificial intelligence (AI) could improve this. A pilot study of KE was performed with artificial neural network (ANN) as AI system. A case note review analysed arrhythmic events stored in patients ICD memory. 13.2% patients received inappropriate therapy. The best ICD algorithm had sensitivity 1.00, specificity 0.69 (p<0.001 different to gold standard). A subset of data was used to train and test an ANN. A feed-forward, back-propagation network with 7 inputs, a 4 node hidden layer and 1 output had sensitivity 1.00, specificity 0.71 (p<0.001). A prospective study was performed using KE to list arrhythmias, factors and indicators for which measurable parameters were evaluated and results reviewed by a domain expert. Waveforms from electrodes in the heart and thoracic bio-impedance; temperature and motion data were collected from 65 patients during cardiac electrophysiological studies. 5 incomplete datasets were due to technical failures. We concluded that KE successfully guided selection of parameters and ANN produced a usable system and that complex data collection carries greater risk of technical failure, leading to data loss.

Usability evaluation and adaptation of the e-health Personal Patient Profile-Prostate decision aid for Spanish-speaking Latino men.

PubMed

Berry, Donna L; Halpenny, Barbara; Bosco, Jaclyn L F; Bruyere, John; Sanda, Martin G

2015-07-24

The Personal Patient Profile-Prostate (P3P), a web-based decision aid, was demonstrated to reduce decisional conflict in English-speaking men with localized prostate cancer early after initial diagnosis. The purpose of this study was to explore and enhance usability and cultural appropriateness of a Spanish P3P by Latino men with a diagnosis of prostate cancer. P3P was translated to Spanish and back-translated by three native Spanish-speaking translators working independently. Spanish-speaking Latino men with a diagnosis of localized prostate cancer, who had made treatment decisions in the past 24 months, were recruited from two urban clinical care sites. Individual cognitive interviews were conducted by two bilingual research assistants as each participant used the Spanish P3P. Notes of user behavior, feedback, and answers to direct questions about comprehension, usability and perceived usefulness were analyzed and categorized. Seven participants with a range of education levels identified 25 unique usability issues in navigation, content comprehension and completeness, sociocultural appropriateness, and methodology. Revisions were prioritized to refine the usability and cultural and linguistic appropriateness of the decision aid. Usability issues were discovered that are potential barriers to effective decision support. Successful use of decision aids requires adaptation and testing beyond translation. Our findings led to revisions further refining the usability and linguistic and cultural appropriateness of Spanish P3P.

Does user-centred design affect the efficiency, usability and safety of CPOE order sets?

PubMed

Chan, Julie; Shojania, Kaveh G; Easty, Anthony C; Etchells, Edward E

2011-05-01

Application of user-centred design principles to Computerized provider order entry (CPOE) systems may improve task efficiency, usability or safety, but there is limited evaluative research of its impact on CPOE systems. We evaluated the task efficiency, usability, and safety of three order set formats: our hospital's planned CPOE order sets (CPOE Test), computer order sets based on user-centred design principles (User Centred Design), and existing pre-printed paper order sets (Paper). 27 staff physicians, residents and medical students. Sunnybrook Health Sciences Centre, an academic hospital in Toronto, Canada. Methods Participants completed four simulated order set tasks with three order set formats (two CPOE Test tasks, one User Centred Design, and one Paper). Order of presentation of order set formats and tasks was randomized. Users received individual training for the CPOE Test format only. Completion time (efficiency), requests for assistance (usability), and errors in the submitted orders (safety). 27 study participants completed 108 order sets. Mean task times were: User Centred Design format 273 s, Paper format 293 s (p=0.73 compared to UCD format), and CPOE Test format 637 s (p<0.0001 compared to UCD format). Users requested assistance in 31% of the CPOE Test format tasks, whereas no assistance was needed for the other formats (p<0.01). There were no significant differences in number of errors between formats. The User Centred Design format was more efficient and usable than the CPOE Test format even though training was provided for the latter. We conclude that application of user-centred design principles can enhance task efficiency and usability, increasing the likelihood of successful implementation.

Does user-centred design affect the efficiency, usability and safety of CPOE order sets?

PubMed Central

Chan, Julie; Shojania, Kaveh G; Easty, Anthony C

2011-01-01

Background Application of user-centred design principles to Computerized provider order entry (CPOE) systems may improve task efficiency, usability or safety, but there is limited evaluative research of its impact on CPOE systems. Objective We evaluated the task efficiency, usability, and safety of three order set formats: our hospital's planned CPOE order sets (CPOE Test), computer order sets based on user-centred design principles (User Centred Design), and existing pre-printed paper order sets (Paper). Participants 27staff physicians, residents and medical students. Setting Sunnybrook Health Sciences Centre, an academic hospital in Toronto, Canada. Methods Participants completed four simulated order set tasks with three order set formats (two CPOE Test tasks, one User Centred Design, and one Paper). Order of presentation of order set formats and tasks was randomized. Users received individual training for the CPOE Test format only. Main Measures Completion time (efficiency), requests for assistance (usability), and errors in the submitted orders (safety). Results 27 study participants completed 108 order sets. Mean task times were: User Centred Design format 273 s, Paper format 293 s (p=0.73 compared to UCD format), and CPOE Test format 637 s (p<0.0001 compared to UCD format). Users requested assistance in 31% of the CPOE Test format tasks, whereas no assistance was needed for the other formats (p<0.01). There were no significant differences in number of errors between formats. Conclusions The User Centred Design format was more efficient and usable than the CPOE Test format even though training was provided for the latter. We conclude that application of user-centred design principles can enhance task efficiency and usability, increasing the likelihood of successful implementation. PMID:21486886

The effect of keyboard key spacing on typing speed, error, usability, and biomechanics, Part 2: Vertical spacing.

PubMed

Pereira, Anna; Hsieh, Chih-Ming; Laroche, Charles; Rempel, David

2014-06-01

The objective was to evaluate the effects of vertical key spacing on a conventional computer keyboard on typing speed, percentage error, usability, forearm muscle activity, and wrist posture for both females with small fingers and males with large fingers. Part I evaluated primarily horizontal key spacing and found that for male typists with large fingers, productivity and usability were similar for spacings of 17, 18, and 19 mm but were reduced for spacings of 16 mm. Few other key spacing studies are available, and the international standards that specify the spacing between keys on a keyboard have been mainly guided by design convention. Experienced female typists (n = 26) with small fingers (middle finger length < or = 7.71 cm or finger breadth of < or = 1.93 cm) and male typists (n = 26) with large fingers (middle finger length > or = 8.37 cm or finger breadth of > or = 2.24 cm) typed on five keyboards that differed primarily in vertical key spacing (17 x 18, 17 x 17, 17 x 16, 17 x 15.5, and 18 x 16 mm) while typing speed, error, fatigue, preference, forearm muscle activity, and wrist posture were recorded. Productivity and usability ratings were significantly worse for the keyboard with 15.5 mm vertical spacing compared to the other keyboards for both groups.There were few significant differences on usability ratings between the other keyboards. Reducing vertical key spacing,from 18 to 17 to 16 mm, had no significant effect on productivity or usability. The findings support the design of keyboards with vertical key spacings of 16, 17, or 18 mm. These findings may influence keyboard design and standards.

Development and Cross-cultural Validation of the Korean Version of SMArtphone's uSability Heuristics (SMASH).

PubMed

Jeong, Yeo Won; Kim, Jung A

2017-10-01

The purpose of this study was to develop and cross-culturally validate the Korean version of SMArtphone's uSability Heuristics (K-SMASH). In the study, it was used the adaptation process consisted of five stages, namely, translation, synthesis, back translation, expert committee review, and pretesting. In the pretesting stage, a mobile application, using the prefinal K-SMASH, was evaluated for the severity of usability problems by three experts in computer science and informatics. Each participant completed the evaluation and was interviewed about their understanding, interpretation, and opinion of the cultural relevance of the prefinal K-SMASH. Next, we reviewed the differences in the experts' opinions and the questionnaire results. Twelve SMASH items, words and sentences, were translated, back translated, and revised, considering the conceptual meaning in the context of the Korean culture, by experts in various fields, including a Korean linguist and a bilingual translator, through the first stage to the fourth stage. In the pretesting stage, the results showed no major differences among the severity ratings of participants. Furthermore, all participants answered that there were no critical discrepancies or inconsistencies with the cultural relevance of the prefinal K-SMASH. The results of the study provide preliminary evidence that the modified K-SMASH can be used for heuristic evaluation, one of the usability tests, when developing applications in Korea.

Development and Cross-cultural Validation of the Korean Version of SMArtphone’s uSability Heuristics (SMASH)

PubMed Central

Jeong, Yeo Won

2017-01-01

Objectives The purpose of this study was to develop and cross-culturally validate the Korean version of SMArtphone's uSability Heuristics (K-SMASH). Methods In the study, it was used the adaptation process consisted of five stages, namely, translation, synthesis, back translation, expert committee review, and pretesting. In the pretesting stage, a mobile application, using the prefinal K-SMASH, was evaluated for the severity of usability problems by three experts in computer science and informatics. Each participant completed the evaluation and was interviewed about their understanding, interpretation, and opinion of the cultural relevance of the prefinal K-SMASH. Next, we reviewed the differences in the experts’ opinions and the questionnaire results. Results Twelve SMASH items, words and sentences, were translated, back translated, and revised, considering the conceptual meaning in the context of the Korean culture, by experts in various fields, including a Korean linguist and a bilingual translator, through the first stage to the fourth stage. In the pretesting stage, the results showed no major differences among the severity ratings of participants. Furthermore, all participants answered that there were no critical discrepancies or inconsistencies with the cultural relevance of the prefinal K-SMASH. Conclusions The results of the study provide preliminary evidence that the modified K-SMASH can be used for heuristic evaluation, one of the usability tests, when developing applications in Korea. PMID:29181243

Graphical Weather Information System Evaluation: Usability, Perceived Utility, and Preferences from General Aviation Pilots

NASA Technical Reports Server (NTRS)

Latorella, Kara A.; Chamberlain, James P.

2002-01-01

Weather is a significant factor in General Aviation (GA) accidents and fatality rates. Graphical Weather Information Systems (GWISs) for the flight deck are appropriate technologies for mitigating the difficulties GA pilots have with current aviation weather information sources. This paper describes usability evaluations of a prototype GWIS by 12 GA pilots after using the system in flights towards convective weather. We provide design guidance for GWISs and discuss further research required to support weather situation awareness and in-flight decision making for GA pilots.

The Accessibility and Usability of College Websites: Is Your Website Presenting Barriers to Potential Students?

ERIC Educational Resources Information Center

Erickson, William; Trerise, Sharon; Lee, Camille; VanLooy, Sara; Knowlton, Samuel; Bruyère, Susanne

2013-01-01

Thirty community college websites were evaluated for compliance with federal web accessibility standards found in Section 508 of the Rehabilitation Act of 1973 (29 U.S.C. 794d). Two typical sites were tested for usability by individuals with visual impairments, individuals with reading-related learning disabilities (LD), and a control group of…

Usability evaluation of low-cost virtual reality hand and arm rehabilitation games.

PubMed

Seo, Na Jin; Arun Kumar, Jayashree; Hur, Pilwon; Crocher, Vincent; Motawar, Binal; Lakshminarayanan, Kishor

2016-01-01

The emergence of lower-cost motion tracking devices enables home-based virtual reality rehabilitation activities and increased accessibility to patients. Currently, little documentation on patients' expectations for virtual reality rehabilitation is available. This study surveyed 10 people with stroke for their expectations of virtual reality rehabilitation games. This study also evaluated the usability of three lower-cost virtual reality rehabilitation games using a survey and House of Quality analysis. The games (kitchen, archery, and puzzle) were developed in the laboratory to encourage coordinated finger and arm movements. Lower-cost motion tracking devices, the P5 Glove and Microsoft Kinect, were used to record the movements. People with stroke were found to desire motivating and easy-to-use games with clinical insights and encouragement from therapists. The House of Quality analysis revealed that the games should be improved by obtaining evidence for clinical effectiveness, including clinical feedback regarding improving functional abilities, adapting the games to the user's changing functional ability, and improving usability of the motion-tracking devices. This study reports the expectations of people with stroke for rehabilitation games and usability analysis that can help guide development of future games.

Methods for Evaluating the Content, Usability, and Efficacy of Commercial Mobile Health Apps

PubMed Central

Silfee, Valerie J; Waring, Molly E; Boudreaux, Edwin D; Sadasivam, Rajani S; Mullen, Sean P; Carey, Jennifer L; Hayes, Rashelle B; Ding, Eric Y; Bennett, Gary G; Pagoto, Sherry L

2017-01-01

Commercial mobile apps for health behavior change are flourishing in the marketplace, but little evidence exists to support their use. This paper summarizes methods for evaluating the content, usability, and efficacy of commercially available health apps. Content analyses can be used to compare app features with clinical guidelines, evidence-based protocols, and behavior change techniques. Usability testing can establish how well an app functions and serves its intended purpose for a target population. Observational studies can explore the association between use and clinical and behavioral outcomes. Finally, efficacy testing can establish whether a commercial app impacts an outcome of interest via a variety of study designs, including randomized trials, multiphase optimization studies, and N-of-1 studies. Evidence in all these forms would increase adoption of commercial apps in clinical practice, inform the development of the next generation of apps, and ultimately increase the impact of commercial apps. PMID:29254914

Location-based social networking media for restaurant promotion and food review using mobile application

NASA Astrophysics Data System (ADS)

Luhur, H. S.; Widjaja, N. D.

2014-03-01

This paper is focusing on the development of a mobile application for searching restaurants and promotions with location based and social networking features. The main function of the application is to search restaurant information. Other functions are also available in this application such as add restaurant, add promotion, add photo, add food review, and other features including social networking features. The restaurant and promotion searching application will be developed under Android platform. Upon completion of this paper, heuristic evaluation and usability testing have been conducted. The result of both testing shows that the application is highly usable. Even though there are some usability problems discovered, the problems can be eliminated immediately by implementing the recommendations from the expert evaluators and the users as the testers of the application. Further improvement made to the application will ensure that the application can really be beneficial for the users of the application.

What makes an automated teller machine usable by blind users?

PubMed

Manzke, J M; Egan, D H; Felix, D; Krueger, H

1998-07-01

Fifteen blind and sighted subjects, who featured as a control group for acceptance, were asked for their requirements for automated teller machines (ATMs). Both groups also tested the usability of a partially operational ATM mock-up. This machine was based on an existing cash dispenser, providing natural speech output, different function menus and different key arrangements. Performance and subjective evaluation data of blind and sighted subjects were collected. All blind subjects were able to operate the ATM successfully. The implemented speech output was the main usability factor for them. The different interface designs did not significantly affect performance and subjective evaluation. Nevertheless, design recommendations can be derived from the requirement assessment. The sighted subjects were rather open for design modifications, especially the implementation of speech output. However, there was also a mismatch of the requirements of the two subject groups, mainly concerning the key arrangement.

Designing Telemedicine Systems for Geriatric Patients: A Review of the Usability Studies.

PubMed

Narasimha, Shraddhaa; Madathil, Kapil Chalil; Agnisarman, Sruthy; Rogers, Hunter; Welch, Brandon; Ashok, Aparna; Nair, Aswathi; McElligott, James

2017-06-01

One area where telemedicine may prove to be highly effective is in providing medical care to the geriatric population, an age group predicted to account for 20% of the population in the near future. However, even though telemedicine has certain advantages, the usability of these systems with this population merits investigation. This article reviews the literature published from 2000 to 2016 with the goal of analyzing the characteristics of usability-related studies conducted using geriatric participants and the subsequent usability challenges identified. Articles were found using Web of Knowledge and PubMed citation indexing portals using the keywords (1) Telemedicine* AND Geriatrics* (2) Telemedicine* AND Usability* (3) Telemedicine* AND Usability* AND Older Adults*. A total of 297 articles were obtained from the initial search. After further detailed screening, 16 articles were selected for review based on the inclusion criteria. Of these, 60% of the studies focused on the overall usability of telemedicine systems; 6.25% focused on the usability of a telepresence robot; 12.5% compared a face-to-face medical consultation with the use of telemedicine systems, and 25% focused on the study of other aspects of telemedicine in addition to its usability. Findings reported in the studies included high patient satisfaction with telemedicine in 31.25%, whereas another 31.25% indicated a high acceptance of this method of medical consultation. Care coordination in 6.25% of the studies; confidence in telemedicine in 6.25%; trust, privacy, and reliability in 6.25%; and increased convenience when compared to personal visits in 18.75% were also reported. This review suggests limited research providing scientifically valid and reproducible usability evaluation at various stages of telemedicine system development. Telemedicine system designers need to consider the age-related issues in cognition, perception, and behavior of geriatric patients while designing telemedicine applications. Future directions for research were developed based on the limitations as well as other results found in this systematic review.

Evaluation Plan for ORBIS

DOT National Transportation Integrated Search

1974-03-01

This report contains the evaluation plan and experimental design for determining the effectiveness and usability of ORBIS, a proprietary device for automatically detecting and recording speeding motorists. The experimental evaluation will be conducte...

Usability evaluation of the digital anger thermometer app.

PubMed

Mattson, Donald C

2017-09-01

The digital anger thermometer is a prototype for a mobile application (app) for use with adults in anger management treatment. The digital anger thermometer incorporates standards of software development in addition to anger management resources from the Substance Abuse and Mental Health Services Administration. The digital anger thermometer underwent a usability study conducted by five expert reviewers. The results indicate that it is easy to learn, efficient, and ergonomically sound. However, it does not offer support features or user-error tolerance. The digital anger thermometer prototype requires additional usability studies and comparative research in order for it to become an actual mental health app.

Evaluation of Smartphone Applications for Cardiopulmonary Resuscitation Training in South Korea

PubMed Central

Cho, Yongtak; Song, Yeongtak; Lim, Tae Ho; Kang, Hyunggoo

2016-01-01

Objective. There are many smartphone-based applications (apps) for cardiopulmonary resuscitation (CPR) training. We investigated the conformity and the learnability/usability of these apps for CPR training and real-life supports. Methods. We conducted a mixed-method, sequential explanatory study to assess CPR training apps downloaded on two apps stores in South Korea. Apps were collected with inclusion criteria as follows, Korean-language instruction, training features, and emergency supports for real-life incidents, and analyzed with two tests; 15 medical experts evaluated the apps' contents according to current Basic Life Support guidelines in conformity test, and 15 nonmedical individuals examined the apps using System Usability Scale (SUS) in the learnability/usability test. Results. Out of 79 selected apps, five apps were included and analyzed. For conformity (ICC, 0.95, p < 0.001), means of all apps were greater than 12 of 20 points, indicating that they were well designed according to current guidelines. Three of the five apps yielded acceptable level (greater than 68 of 100 points) for learnability/usability. Conclusion. All the included apps followed current BLS guidelines and a majority offered acceptable learnability/usability for layperson. Current and developmental smartphone-based CPR training apps should include accurate CPR information and be easy to use for laypersons that are potential rescuers in real-life incidents. For Clinical Trials. This is a clinical trial, registered at the Clinical Research Information Service (CRIS, cris.nih.go.kr), number KCT0001840. PMID:27668257

A Guided Online and Mobile Self-Help Program for Individuals With Eating Disorders: An Iterative Engagement and Usability Study.

PubMed

Nitsch, Martina; Dimopoulos, Christina N; Flaschberger, Edith; Saffran, Kristina; Kruger, Jenna F; Garlock, Lindsay; Wilfley, Denise E; Taylor, Craig B; Jones, Megan

2016-01-11

Numerous digital health interventions have been developed for mental health promotion and intervention, including eating disorders. Efficacy of many interventions has been evaluated, yet knowledge about reasons for dropout and poor adherence is scarce. Most digital health intervention studies lack appropriate research design and methods to investigate individual engagement issues. User engagement and program usability are inextricably linked, making usability studies vital in understanding and improving engagement. The aim of this study was to explore engagement and corresponding usability issues of the Healthy Body Image Program-a guided online intervention for individuals with body image concerns or eating disorders. The secondary aim was to demonstrate the value of usability research in order to investigate engagement. We conducted an iterative usability study based on a mixed-methods approach, combining cognitive and semistructured interviews as well as questionnaires, prior to program launch. Two separate rounds of usability studies were completed, testing a total of 9 potential users. Thematic analysis and descriptive statistics were used to analyze the think-aloud tasks, interviews, and questionnaires. Participants were satisfied with the overall usability of the program. The average usability score was 77.5/100 for the first test round and improved to 83.1/100 after applying modifications for the second iteration. The analysis of the qualitative data revealed five central themes: layout, navigation, content, support, and engagement conditions. The first three themes highlight usability aspects of the program, while the latter two highlight engagement issues. An easy-to-use format, clear wording, the nature of guidance, and opportunity for interactivity were important issues related to usability. The coach support, time investment, and severity of users' symptoms, the program's features and effectiveness, trust, anonymity, and affordability were relevant to engagement. This study identified salient usability and engagement features associated with participant motivation to use the Healthy Body Image Program and ultimately helped improve the program prior to its implementation. This research demonstrates that improvements in usability and engagement can be achieved by testing and adjusting intervention design and content prior to program launch. The results are consistent with related research and reinforce the need for further research to identify usage patterns and effective means for reducing dropout. Digital health research should include usability studies prior to efficacy trials to help create more user-friendly programs that have a higher likelihood of "real-world" adoption.

Defense Information Systems Agency Technical Integration Support (DISA- TIS). MUMPS Study.

DTIC Science & Technology

1993-01-01

usable in DoD, MUMPS must continue to improve in its support of DoD and OSE standards such as SQL , X-Windows, POSIX, PHIGS, etc. MUMPS and large AlSs...Language ( SQL ), X-Windows, and Graphical Kernel Services (GKS)) 2.2.2.3 FIPS Adoption by NIST The National Institute of Standards and Technology (NIST...many of the performance tuning mechanisms that must be performed explicitly with other systems. The VA looks forward to the SQL binding (1993 ANS) that

The Exploitation of the Electric Contributions in Infrared Power Generation

DTIC Science & Technology

2016-02-02

Technical Report for year one 3. DATES COVERED (From - To) 3/10/2015-2/2/16 4. TITLE AND SUBTITLE The exploitation of the electric contributions in...establishes a method to harvest infrared radiation and transform it into usable energy. We have identified an electrical contribution to the energy...area code) (540) 568-8857 ^olko^ögüöo Standard Form 298 (Rev. 8/98) Prescribed by ANSI Std. Z39.18 The exploitation of the electric contributions