Usability Testing for e-Resource Discovery: How Students Find and Choose e-Resources Using Library Web Sites

ERIC Educational Resources Information Center

Fry, Amy; Rich, Linda

2011-01-01

In early 2010, library staff at Bowling Green State University (BGSU) in Ohio designed and conducted a usability study of key parts of the library web site, focusing on the web pages generated by the library's electronic resources management system (ERM) that list and describe the library's databases. The goal was to discover how users find and…

Learning a Language with Web 2.0: Exploring the Use of Social Networking Features of Foreign Language Learning Websites

ERIC Educational Resources Information Center

Stevenson, Megan P.; Liu, Min

2010-01-01

This paper presents the results of an online survey and a usability test performed on three foreign language learning websites that use Web 2.0 technology. The online survey was conducted to gain an understanding of how current users of language learning websites use them for learning and social purposes. The usability test was conducted to gain…

Evaluating a Web-Based Interface for Internet Telemedicine

NASA Technical Reports Server (NTRS)

Lathan, Corinna E.; Newman, Dava J.; Sebrechts, Marc M.; Doarn, Charles R.

1997-01-01

The objective is to introduce the usability engineering methodology, heuristic evaluation, to the design and development of a web-based telemedicine system. Using a set of usability criteria, or heuristics, one evaluator examined the Spacebridge to Russia web-site for usability problems. Thirty-four usability problems were found in this preliminary study and all were assigned a severity rating. The value of heuristic analysis in the iterative design of a system is shown because the problems can be fixed before deployment of a system and the problems are of a different nature than those found by actual users of the system. It was therefore determined that there is potential value of heuristic evaluation paired with user testing as a strategy for optimal system performance design.

Testing of a prototype Web based intervention for adolescent mothers on postpartum depression.

PubMed

Logsdon, M Cynthia; Barone, Michael; Lynch, Tania; Robertson, Ashley; Myers, John; Morrison, David; York, Sara; Gregg, Jennifer

2013-08-01

This article describes testing of a prototype Web site for adolescent mothers with postpartum depression; providing proof of concept. Participants (N=138) were recruited from a public school-based program for adolescent parents and completed the Mental Health Acceptability Scale, Stigma Scale for Receiving Psychological Help, and Attitudes Towards Seeking Professional Psychological Help Scale before, and after, the Web site intervention. They also provided feedback on the usability of the Web site. Attitudes related to depression and treatment (ATSPPH) improved after viewing the Web site (p=.023). Feedback on the Web site indicated that it was easy to use (77%), reflecting highly acceptable score for product usability. The data provide the foundation for the launch of the Web site from prototype to product and more comprehensive testing. The creation and testing of informational text messages will be added to the Web site to increase the interactivity and dose of the intervention. Copyright © 2013 Elsevier Inc. All rights reserved.

'Televaluation' of clinical information systems: an integrative approach to assessing Web-based systems.

PubMed

Kushniruk, A W; Patel, C; Patel, V L; Cimino, J J

2001-04-01

The World Wide Web provides an unprecedented opportunity for widespread access to health-care applications by both patients and providers. The development of new methods for assessing the effectiveness and usability of these systems is becoming a critical issue. This paper describes the distance evaluation (i.e. 'televaluation') of emerging Web-based information technologies. In health informatics evaluation, there is a need for application of new ideas and methods from the fields of cognitive science and usability engineering. A framework is presented for conducting evaluations of health-care information technologies that integrates a number of methods, ranging from deployment of on-line questionnaires (and Web-based forms) to remote video-based usability testing of user interactions with clinical information systems. Examples illustrating application of these techniques are presented for the assessment of a patient clinical information system (PatCIS), as well as an evaluation of use of Web-based clinical guidelines. Issues in designing, prototyping and iteratively refining evaluation components are discussed, along with description of a 'virtual' usability laboratory.

Validating a Web-based Diabetes Education Program in continuing nursing education: knowledge and competency change and user perceptions on usability and quality

PubMed Central

2014-01-01

Background Nurses as the members of health care professionals need to improve their knowledge and competencies particularly in diabetes mellitus through continuing nursing education programs. E-learning is an indirect method of training that can meet nurses’ educational needs. This study is aimed at validating a web-based diabetes education program through measurement of nurses’ knowledge and clinical competency in diabetes and nurses’ perception about its usability and quality. Methods This Quasi-experimental research was conducted on a single group of 31 nurses employed in hospitals affiliated with Shiraz University of Medical Sciences. We used a 125 MCQ knowledge test and Objective Structured Clinical Exam (OSCE) to measure knowledge and clinical competency of nurses in diabetes before and after intervention. A Learning Management System (LMS) was designed to provide educational content in the form of 12 multimedia electronic modules, interactive tests; a forum and learning activities. Nurses were trained for two months in this system after which the post-test was administered. Each nurse completed two questionnaires for measurement of their perceptions on usability and quality. We used descriptive statistics for demographic and descriptive data analysis. Paired t-test was used to compare pre- and post-data using SPSS. Results The findings showed significant differences in knowledge scores (p < 0.001), total score of clinical competencies (p < 0.001), and all ten assessed clinical competencies. The range of ratings given by participants varied on the six usability variables of Web-based training (2.96-4.23 from 5) and eight quality variables of Web-based training (3.58-4.37 from 5). Conclusion Web-based education increased nurses’ knowledge and competencies in diabetes. They positively evaluated Web-based learning usability and quality. It is hoped that this course will have a positive clinical outcomes. PMID:26086025

Validating a Web-based Diabetes Education Program in continuing nursing education: knowledge and competency change and user perceptions on usability and quality.

PubMed

Moattari, Marzieh; Moosavinasab, Elham; Dabbaghmanesh, Mohammad Hossein; ZarifSanaiey, Nahid

2014-01-01

Nurses as the members of health care professionals need to improve their knowledge and competencies particularly in diabetes mellitus through continuing nursing education programs. E-learning is an indirect method of training that can meet nurses' educational needs. This study is aimed at validating a web-based diabetes education program through measurement of nurses' knowledge and clinical competency in diabetes and nurses' perception about its usability and quality. This Quasi-experimental research was conducted on a single group of 31 nurses employed in hospitals affiliated with Shiraz University of Medical Sciences. We used a 125 MCQ knowledge test and Objective Structured Clinical Exam (OSCE) to measure knowledge and clinical competency of nurses in diabetes before and after intervention. A Learning Management System (LMS) was designed to provide educational content in the form of 12 multimedia electronic modules, interactive tests; a forum and learning activities. Nurses were trained for two months in this system after which the post-test was administered. Each nurse completed two questionnaires for measurement of their perceptions on usability and quality. We used descriptive statistics for demographic and descriptive data analysis. Paired t-test was used to compare pre- and post-data using SPSS. The findings showed significant differences in knowledge scores (p < 0.001), total score of clinical competencies (p < 0.001), and all ten assessed clinical competencies. The range of ratings given by participants varied on the six usability variables of Web-based training (2.96-4.23 from 5) and eight quality variables of Web-based training (3.58-4.37 from 5). Web-based education increased nurses' knowledge and competencies in diabetes. They positively evaluated Web-based learning usability and quality. It is hoped that this course will have a positive clinical outcomes.

Usability Testing: A Case Study.

ERIC Educational Resources Information Center

Chisman, Janet; Walbridge, Sharon; Diller, Karen

1999-01-01

Discusses the development and results of usability testing of Washington State University's Web-based OPAC (online public access catalog); examines how easily users could navigate the catalog and whether they understood what they were seeing; and identifies problems and what action if any was taken. (LRW)

Evaluation of expert system application based on usability aspects

NASA Astrophysics Data System (ADS)

Munaiseche, C. P. C.; Liando, O. E. S.

2016-04-01

Usability usually defined as a point of human acceptance to a product or a system based on understands and right reaction to an interface. The performance of web application has been influence by the quality of the interface of that web to supporting information transfer process. Preferably, before the applications of expert systems were installed in the operational environment, these applications must be evaluated first by usability testing. This research aimed to measure the usability of the expert system application using tasks as interaction media. This study uses an expert system application to diagnose skin disease in human using questionnaire method which utilize the tasks as interaction media in measuring the usability. Certain tasks were executed by the participants in observing usability value of the application. The usability aspects observed were learnability, efficiency, memorability, errors, and satisfaction. Each questionnaire question represent aspects of usability. The results present the usability value for each aspect and the total average merit for all the five-usability aspect was 4.28, this indicated that the tested expert system application is in the range excellent for the usability level, so the application can be implemented as the operated system by user. The main contribution of the study is the research became the first step in using task model in the usability evaluation for the expert system application software.

Development and preliminary testing of a web-based, self-help application for disaster-affected families

PubMed Central

Yuen, Erica K; Gros, Kirstin; Welsh, Kyleen E; McCauley, Jenna; Resnick, Heidi S; Danielson, Carla K; Price, Matthew; Ruggiero, Kenneth J

2015-01-01

Technology-based self-help interventions have the potential to increase access to evidence-based mental healthcare, especially for families affected by natural disasters. However, development of these interventions is a complex process and poses unique challenges. Usability testing, which assesses the ability of individuals to use an application successfully, can have a significant impact on the quality of a self-help intervention. This article describes (a) the development of a novel web-based multi-module self-help intervention for disaster-affected adolescents and their parents and (b) a mixed-methods formal usability study to evaluate user response. A total of 24 adolescents were observed, videotaped, and interviewed as they used the depressed mood component of the self-help intervention. Quantitative results indicated an above-average user experience, and qualitative analysis identified 120 unique usability issues. We discuss the challenges of developing self-help applications, including design considerations and the value of usability testing in technology-based interventions, as well as our plan for widespread dissemination. PMID:25933798

A web-based program for informal caregivers of persons with Alzheimer's disease: an iterative user-centered design.

PubMed

Cristancho-Lacroix, Victoria; Moulin, Florence; Wrobel, Jérémy; Batrancourt, Bénédicte; Plichart, Matthieu; De Rotrou, Jocelyne; Cantegreil-Kallen, Inge; Rigaud, Anne-Sophie

2014-09-15

Web-based programs have been developed for informal caregivers of people with Alzheimer's disease (PWAD). However, these programs can prove difficult to adopt, especially for older people, who are less familiar with the Internet than other populations. Despite the fundamental role of usability testing in promoting caregivers' correct use and adoption of these programs, to our knowledge, this is the first study describing this process before evaluating a program for caregivers of PWAD in a randomized clinical trial. The objective of the study was to describe the development process of a fully automated Web-based program for caregivers of PWAD, aiming to reduce caregivers' stress, and based on the user-centered design approach. There were 49 participants (12 health care professionals, 6 caregivers, and 31 healthy older adults) that were involved in a double iterative design allowing for the adaptation of program content and for the enhancement of website usability. This process included three component parts: (1) project team workshops, (2) a proof of concept, and (3) two usability tests. The usability tests were based on a mixed methodology using behavioral analysis, semistructured interviews, and a usability questionnaire. The user-centered design approach provided valuable guidelines to adapt the content and design of the program, and to improve website usability. The professionals, caregivers (mainly spouses), and older adults considered that our project met the needs of isolated caregivers. Participants underlined that contact between caregivers would be desirable. During usability observations, the mistakes of users were also due to ergonomics issues from Internet browsers and computer interfaces. Moreover, negative self-stereotyping was evidenced, when comparing interviews and results of behavioral analysis. Face-to-face psycho-educational programs may be used as a basis for Web-based programs. Nevertheless, a user-centered design approach involving targeted users (or their representatives) remains crucial for their correct use and adoption. For future user-centered design studies, we recommend to involve end-users from preconception stages, using a mixed research method in usability evaluations, and implementing pilot studies to evaluate acceptability and feasibility of programs.

Sociotechnical Human Factors Involved in Remote Online Usability Testing of Two eHealth Interventions.

PubMed

Wozney, Lori M; Baxter, Pamela; Fast, Hilary; Cleghorn, Laura; Hundert, Amos S; Newton, Amanda S

2016-02-03

Research in the fields of human performance technology and human computer interaction are challenging the traditional macro focus of usability testing arguing for methods that help test moderators assess "use in context" (ie, cognitive skills, usability understood over time) and in authentic "real world" settings. Human factors in these complex test scenarios may impact on the quality of usability results being derived yet there is a lack of research detailing moderator experiences in these test environments. Most comparative research has focused on the impact of the physical environment on results, and rarely on how the sociotechnical elements of the test environment affect moderator and test user performance. Improving our understanding of moderator roles and experiences with conducting "real world" usability testing can lead to improved techniques and strategies To understand moderator experiences of using Web-conferencing software to conduct remote usability testing of 2 eHealth interventions. An exploratory case study approach was used to study 4 moderators' experiences using Blackboard Collaborate for remote testing sessions of 2 different eHealth interventions. Data collection involved audio-recording iterative cycles of test sessions, collecting summary notes taken by moderators, and conducting 2 90-minute focus groups via teleconference. A direct content analysis with an inductive coding approach was used to explore personal accounts, assess the credibility of data interpretation, and generate consensus on the thematic structure of the results. Following the convergence of data from the various sources, 3 major themes were identified: (1) moderators experienced and adapted to unpredictable changes in cognitive load during testing; (2) moderators experienced challenges in creating and sustaining social presence and untangling dialogue; and (3) moderators experienced diverse technical demands, but were able to collaboratively troubleshoot with test users. Results highlight important human-computer interactions and human factor qualities that impact usability testing processes. Moderators need an advanced skill and knowledge set to address the social interaction aspects of Web-based usability testing and technical aspects of conferencing software during test sessions. Findings from moderator-focused studies can inform the design of remote testing platforms and real-time usability evaluation processes that place less cognitive burden on moderators and test users.

Usability testing of ANSWER: a web-based methotrexate decision aid for patients with rheumatoid arthritis

PubMed Central

2013-01-01

Background Decision aids are evidence-based tools designed to inform people of the potential benefit and harm of treatment options, clarify their preferences and provide a shared decision-making structure for discussion at a clinic visit. For patients with rheumatoid arthritis (RA) who are considering methotrexate, we have developed a web-based patient decision aid called the ANSWER (Animated, Self-serve, Web-based Research Tool). This study aimed to: 1) assess the usability of the ANSWER prototype; 2) identify strengths and limitations of the ANSWER from the patient’s perspective. Methods The ANSWER prototype consisted of: 1) six animated patient stories and narrated information on the evidence of methotrexate for RA; 2) interactive questionnaires to clarify patients’ treatment preferences. Eligible participants for the usability test were patients with RA who had been prescribed methotrexate. They were asked to verbalize their thoughts (i.e., think aloud) while using the ANSWER, and to complete the System Usability Scale (SUS) to assess overall usability (range = 0-100; higher = more user friendly). Participants were audiotaped and observed, and field notes were taken. The testing continued until no new modifiable issues were found. We used descriptive statistics to summarize participant characteristics and the SUS scores. Content analysis was used to identified usability issues and navigation problems. Results 15 patients participated in the usability testing. The majority were aged 50 or over and were university/college graduates (n = 8, 53.4%). On average they took 56 minutes (SD = 34.8) to complete the tool. The mean SUS score was 81.2 (SD = 13.5). Content analysis of audiotapes and field notes revealed four categories of modifiable usability issues: 1) information delivery (i.e., clarity of the information and presentation style); 2) navigation control (i.e., difficulties in recognizing and using the navigation control buttons); 3) layout (i.e., position of the videos, text, diagrams and navigation buttons); 4) aesthetic (i.e., the colour, look and feel of the online tool). Conclusions Although the SUS score indicated high usability before and after major modification, findings from the think-aloud sessions illustrated areas that required further refinement. Our results highlight the importance of formative evaluation in usability testing. PMID:24289731

Usability testing of ANSWER: a web-based methotrexate decision aid for patients with rheumatoid arthritis.

PubMed

Li, Linda C; Adam, Paul M; Townsend, Anne F; Lacaille, Diane; Yousefi, Charlene; Stacey, Dawn; Gromala, Diane; Shaw, Chris D; Tugwell, Peter; Backman, Catherine L

2013-12-01

Decision aids are evidence-based tools designed to inform people of the potential benefit and harm of treatment options, clarify their preferences and provide a shared decision-making structure for discussion at a clinic visit. For patients with rheumatoid arthritis (RA) who are considering methotrexate, we have developed a web-based patient decision aid called the ANSWER (Animated, Self-serve, Web-based Research Tool). This study aimed to: 1) assess the usability of the ANSWER prototype; 2) identify strengths and limitations of the ANSWER from the patient's perspective. The ANSWER prototype consisted of: 1) six animated patient stories and narrated information on the evidence of methotrexate for RA; 2) interactive questionnaires to clarify patients' treatment preferences. Eligible participants for the usability test were patients with RA who had been prescribed methotrexate. They were asked to verbalize their thoughts (i.e., think aloud) while using the ANSWER, and to complete the System Usability Scale (SUS) to assess overall usability (range = 0-100; higher = more user friendly). Participants were audiotaped and observed, and field notes were taken. The testing continued until no new modifiable issues were found. We used descriptive statistics to summarize participant characteristics and the SUS scores. Content analysis was used to identified usability issues and navigation problems. 15 patients participated in the usability testing. The majority were aged 50 or over and were university/college graduates (n = 8, 53.4%). On average they took 56 minutes (SD = 34.8) to complete the tool. The mean SUS score was 81.2 (SD = 13.5). Content analysis of audiotapes and field notes revealed four categories of modifiable usability issues: 1) information delivery (i.e., clarity of the information and presentation style); 2) navigation control (i.e., difficulties in recognizing and using the navigation control buttons); 3) layout (i.e., position of the videos, text, diagrams and navigation buttons); 4) aesthetic (i.e., the colour, look and feel of the online tool). Although the SUS score indicated high usability before and after major modification, findings from the think-aloud sessions illustrated areas that required further refinement. Our results highlight the importance of formative evaluation in usability testing.

Web-Based Intervention for Nutritional Management in Cystic Fibrosis: Development, Usability, and Pilot Trial.

PubMed

Stark, Lori J; Opipari-Arrigan, Lisa; Filigno, Stephanie S; Simon, Stacey L; Leonard, Amanda; Mogayzel, Peter J; Rausch, Joseph; Zion, Cynthia; Powers, Scott W

2016-06-01

Usability and pilot testing of a web intervention (BeInCharge.org [BIC]) of behavior plus nutrition intervention for children with cystic fibrosis (CF) ages 4-9 years. Think Aloud methodology was used with five mothers to assess usability and refine the intervention. A pilot trial was then conducted with 10 mothers of children with CF ages 4-9 years randomized to the web-based BIC or a Standard Care Control (STC). Change in weight gain for each group was compared in a pre-to-post design. Mothers rated the usability and clarity of BIC highly. The pilot trial showed children of mothers who received BIC had a significant change in weight pre-to-post-treatment (0.67 kg, p = .04). Change for the STC was not significant (0.41 kg, p = .10). A web-based behavior plus nutrition intervention appears promising in increasing weight gain in children with CF. © The Author 2015. Published by Oxford University Press on behalf of the Society of Pediatric Psychology. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

Exploring the Role of Usability in the Software Process: A Study of Irish Software SMEs

NASA Astrophysics Data System (ADS)

O'Connor, Rory V.

This paper explores the software processes and usability techniques used by Small and Medium Enterprises (SMEs) that develop web applications. The significance of this research is that it looks at development processes used by SMEs in order to assess to what degree usability is integrated into the process. This study seeks to gain an understanding into the level of awareness of usability within SMEs today and their commitment to usability in practice. The motivation for this research is to explore the current development processes used by SMEs in developing web applications and to understand how usability is represented in those processes. The background for this research is provided by the growth of the web application industry beyond informational web sites to more sophisticated applications delivering a broad range of functionality. This paper presents an analysis of the practices of several Irish SMEs that develop web applications through a series of case studies. With the focus on SMEs that develop web applications as Management Information Systems and not E-Commerce sites, informational sites, online communities or web portals. This study gathered data about the usability techniques practiced by these companies and their awareness of usability in the context of the software process in those SMEs. The contribution of this study is to further the understanding of the current role of usability within the software development processes of SMEs that develop web applications.

Get out of Fines Free: Recruiting Student Usability Testers via Fine Waivers

ERIC Educational Resources Information Center

Hockenberry, Benjamin; Blackburn, Kourtney

2016-01-01

St. John Fisher College's Lavery Library's Access Services and Systems departments began a pilot project in which students with overdue fines tested usability of library Web sites in exchange for fine waivers. Circulation staff promoted the program and redeemed fine waiver vouchers at the Checkout Desk, while Systems staff administered testing and…

Usability and Gratifications--Towards a Website Analysis Model.

ERIC Educational Resources Information Center

Bunz, Ulla K.

This paper discusses Web site usability issues. Specifically, it assumes that the usability of a Web site depends more on the perception of the user than on the objectively assessable usability criteria of the Web site. Two pilot studies, based on theoretical notions of uses and gratifications theory and similar theories, are presented. In the…

Development and usability testing of a web-based decision support for users and health professionals in psychiatric services.

PubMed

Grim, Katarina; Rosenberg, David; Svedberg, Petra; Schön, Ulla-Karin

2017-09-01

Shared decision making (SMD) related to treatment and rehabilitation is considered a central component in recovery-oriented practice. Although decision aids are regarded as an essential component for successfully implementing SDM, these aids are often lacking within psychiatric services. The aim of this study was to use a participatory design to facilitate the development of a user-generated, web-based decision aid for individuals receiving psychiatric services. The results of this effort as well as the lessons learned during the development and usability processes are reported. The participatory design included 4 iterative cycles of development. Various qualitative methods for data collection were used with potential end users participating as informants in focus group and individual interviews and as usability and pilot testers. Interviewing and testing identified usability problems that then led to refinements and making the subsequent prototypes increasingly user-friendly and relevant. In each phase of the process, feedback from potential end-users provided guidance in developing the formation of the web-based decision aid that strengthens the position of users by integrating access to information regarding alternative supports, interactivity between staff and users, and user preferences as a continual focus in the tool. This web-based decision aid has the potential to strengthen service users' experience of self-efficacy and control as well as provide staff access to user knowledge and preferences. Studies employing participatory models focusing on usability have potential to significantly contribute to the development and implementation of tools that reflect user perspectives. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

Development and preliminary testing of a web-based, self-help application for disaster-affected families.

PubMed

Yuen, Erica K; Gros, Kirstin; Welsh, Kyleen E; McCauley, Jenna; Resnick, Heidi S; Danielson, Carla K; Price, Matthew; Ruggiero, Kenneth J

2016-09-01

Technology-based self-help interventions have the potential to increase access to evidence-based mental healthcare, especially for families affected by natural disasters. However, development of these interventions is a complex process and poses unique challenges. Usability testing, which assesses the ability of individuals to use an application successfully, can have a significant impact on the quality of a self-help intervention. This article describes (a) the development of a novel web-based multi-module self-help intervention for disaster-affected adolescents and their parents and (b) a mixed-methods formal usability study to evaluate user response. A total of 24 adolescents were observed, videotaped, and interviewed as they used the depressed mood component of the self-help intervention. Quantitative results indicated an above-average user experience, and qualitative analysis identified 120 unique usability issues. We discuss the challenges of developing self-help applications, including design considerations and the value of usability testing in technology-based interventions, as well as our plan for widespread dissemination. © The Author(s) 2015.

Sociotechnical Human Factors Involved in Remote Online Usability Testing of Two eHealth Interventions

PubMed Central

2016-01-01

Background Research in the fields of human performance technology and human computer interaction are challenging the traditional macro focus of usability testing arguing for methods that help test moderators assess “use in context” (ie, cognitive skills, usability understood over time) and in authentic “real world” settings. Human factors in these complex test scenarios may impact on the quality of usability results being derived yet there is a lack of research detailing moderator experiences in these test environments. Most comparative research has focused on the impact of the physical environment on results, and rarely on how the sociotechnical elements of the test environment affect moderator and test user performance. Improving our understanding of moderator roles and experiences with conducting “real world” usability testing can lead to improved techniques and strategies Objective To understand moderator experiences of using Web-conferencing software to conduct remote usability testing of 2 eHealth interventions. Methods An exploratory case study approach was used to study 4 moderators’ experiences using Blackboard Collaborate for remote testing sessions of 2 different eHealth interventions. Data collection involved audio-recording iterative cycles of test sessions, collecting summary notes taken by moderators, and conducting 2 90-minute focus groups via teleconference. A direct content analysis with an inductive coding approach was used to explore personal accounts, assess the credibility of data interpretation, and generate consensus on the thematic structure of the results. Results Following the convergence of data from the various sources, 3 major themes were identified: (1) moderators experienced and adapted to unpredictable changes in cognitive load during testing; (2) moderators experienced challenges in creating and sustaining social presence and untangling dialogue; and (3) moderators experienced diverse technical demands, but were able to collaboratively troubleshoot with test users. Conclusions Results highlight important human-computer interactions and human factor qualities that impact usability testing processes. Moderators need an advanced skill and knowledge set to address the social interaction aspects of Web-based usability testing and technical aspects of conferencing software during test sessions. Findings from moderator-focused studies can inform the design of remote testing platforms and real-time usability evaluation processes that place less cognitive burden on moderators and test users. PMID:27026291

Development of a web-based executive functioning intervention for adolescents with epilepsy: The Epilepsy Journey.

PubMed

Modi, Avani C; Schmidt, Matthew; Smith, Aimee W; Turnier, Luke; Glaser, Noah; Wade, Shari L

2017-07-01

Youth with epilepsy exhibit significant deficits in executive functioning (EF), yet there are few interventions to improve EF for adolescents. The aims of the current study were to develop an individually-tailored intervention, called Epilepsy Journey, to improve aspects of EF through an iterative, patient-centered process including focus groups and usability testing. Five adolescents and caregivers participated in focus groups. This input was used to develop ten learning modules based on subscales of the Behavioral Rating Inventory of Executive Functions and key issues that may impact EF in adolescents. Six adolescents participated in usability testing and a usability expert conducted a heuristic evaluation. Demographic information, chart reviews and measures of EF were also completed. Focus group participants and their parents reported difficulties with memory, attention, organization, monitoring, initiation, impulsivity, emotional control, sleep, awareness in schools and managing stress. They also identified successful strategies to address memory and organizational difficulties. Usability testing of the resultant Epilepsy Journey modules revealed problems with navigation and identified features that promoted usability, including progress bars and interactive modules. Program modifications were made after each usability trial resulting in a relatively brief, interactive and readily navigable program. Perceived utility was high with all but one participant. Participants rated the content as helpful and indicated they would recommend Epilepsy Journey to others. Feedback from the focus group and usability testing yielded a feasible, acceptable, relevant and user-friendly web-based intervention for adolescents with epilepsy. The Epilepsy Journey program will be further tested in an open pilot with adolescents with epilepsy and associated EF deficits. Copyright © 2017 Elsevier Inc. All rights reserved.

The Value of Web Log Data in Use-based Design and Testing.

ERIC Educational Resources Information Center

Burton, Mary C.; Walther, Joseph B.

2001-01-01

Suggests Web-based logs contain useful empirical data with which World Wide Web designers and design theorists can assess usability and effectiveness of design choices. Enumerates identification of types of Web server logs, client logs, types and uses of log data, and issues associated with the validity of these data. Presents an approach to…

Effect of font size, italics, and colour count on web usability.

PubMed

Bhatia, Sanjiv K; Samal, Ashok; Rajan, Nithin; Kiviniemi, Marc T

2011-04-01

Web usability measures the ease of use of a website. This study attempts to find the effect of three factors - font size, italics, and colour count - on web usability. The study was performed using a set of tasks and developing a survey questionnaire. We performed the study using a set of human subjects, selected from the undergraduate students taking courses in psychology. The data computed from the tasks and survey questionnaire were statistically analysed to find if there was any effect of font size, italics, and colour count on the three web usability dimensions. We found that for the student population considered, there was no significant effect of font size on usability. However, the manipulation of italics and colour count did influence some aspects of usability. The subjects performed better for pages with no italics and high italics compared to moderate italics. The subjects rated the pages that contained only one colour higher than the web pages with four or six colours. This research will help web developers better understand the effect of font size, italics, and colour count on web usability in general, and for young adults, in particular.

Effect of font size, italics, and colour count on web usability

PubMed Central

Samal, Ashok; Rajan, Nithin; Kiviniemi, Marc T.

2013-01-01

Web usability measures the ease of use of a website. This study attempts to find the effect of three factors – font size, italics, and colour count – on web usability. The study was performed using a set of tasks and developing a survey questionnaire. We performed the study using a set of human subjects, selected from the undergraduate students taking courses in psychology. The data computed from the tasks and survey questionnaire were statistically analysed to find if there was any effect of font size, italics, and colour count on the three web usability dimensions. We found that for the student population considered, there was no significant effect of font size on usability. However, the manipulation of italics and colour count did influence some aspects of usability. The subjects performed better for pages with no italics and high italics compared to moderate italics. The subjects rated the pages that contained only one colour higher than the web pages with four or six colours. This research will help web developers better understand the effect of font size, italics, and colour count on web usability in general, and for young adults, in particular. PMID:24358055

Getting a Technology-based Diabetes Intervention Ready for Primetime: A Review of Usability Testing Studies

PubMed Central

Lyles, Courtney R.; Sarkar, Urmimala; Osborn, Chandra Y.

2014-01-01

Consumer health technologies can educate patients about diabetes and support their self-management, yet usability evidence is rarely published even though it determines patient engagement, optimal benefit of any intervention, and an understanding of generalizability. Therefore, we conducted a narrative review of peer-reviewed articles published from 2009–2013 that tested the usability of a web- or mobile-delivered system/application designed to educate and support patients with diabetes. Overall, the 23 papers included in our review used mixed (n=11), descriptive quantitative (n=9), and qualitative methods (n=3) to assess usability, such as documenting which features performed as intended and how patients rated their experiences. More sophisticated usability evaluations combined several complementary approaches to elucidate more aspects of functionality. Future work pertaining to the design and evaluation of technology-delivered diabetes education/support interventions should aim to standardize the usability testing processes, and publish usability findings to inform interpretation of why an intervention succeeded or failed, and for whom. PMID:25173689

Improving a Counselor Education Web Site through Usability Testing: The Bibliotherapy Education Project

ERIC Educational Resources Information Center

McMillen, Paula S.; Pehrsson, Dale-Elizabeth

2009-01-01

Technology proficiency expectations have proliferated in counselor education; however, limited information in the counseling literature details how to effectively evaluate or refine online resources from a design/utility standpoint. This description of a small-scale usability study demonstrates a cost-effective strategy for improving counselor…

CUNY+ Web: Usability Study of the Web-Based GUI Version of the Bibliographic Database of the City University of New York (CUNY).

ERIC Educational Resources Information Center

Oulanov, Alexei; Pajarillo, Edmund J. Y.

2002-01-01

Describes the usability evaluation of the CUNY (City University of New York) information system in Web and Graphical User Interface (GUI) versions. Compares results to an earlier usability study of the basic information database available on CUNY's wide-area network and describes the applicability of the previous usability instrument to this…

Usability testing of a Falls Prevention Tool Kit for an inpatient acute care setting.

PubMed

Goldsmith, Denise; Zuyev, Lyubov; Benoit, Angie; Chang, Frank Y; Horsky, Jan; Dykes, Patricia

2009-01-01

Efforts to prevent falls in the hospital setting involves identifying patients at risk of falling and implementing fall prevention strategies. This poster describes the method and results of Performance Usability Testing on a web-based Fall Prevention Tool Kit (FPTK) developed as part of a research study, (Falls TIPS-Tailoring Interventions for Patient Safety) funded by The Robert Wood Johnson Foundation.

The Interface Design and the Usability Testing of a Fossilization Web-Based Learning Environment

ERIC Educational Resources Information Center

Wang, Shiang-Kwei; Yang, Chiachi

2005-01-01

This article describes practical issues related to the design and the development of a Web-Based Learning Environment (Web-LE) for high school students. The purpose of the Fossilization Web-LE was to help students understand the process of fossilization, which is a complex phenomenon and is affected by many factors. The instructional design team…

Using Web Metric Software to Drive: Mobile Website Development

ERIC Educational Resources Information Center

Tidal, Junior

2011-01-01

Many libraries have developed mobile versions of their websites. In order to understand their users, web developers have conducted both usability tests and focus groups, yet analytical software and web server logs can also be used to better understand users. Using data collected from these tools, the Ursula C. Schwerin Library has made informed…

Usability testing of indonesia tourism promotion website

NASA Astrophysics Data System (ADS)

Yunus, U.; Anindito; Tanuar, E.; Maryani

2018-03-01

Indonesian tourism has been viewed as one of the source of foreign exchange, therefore visit Indonesia campaign through Wonderful Indonesia should be given attention. This research aims to test the usability of web http://www.indonesia.travel/en, at the end can give input to the Tourism Ministry of the Republic of Indonesia. The concept used based on usabilitygeek.com which mentions the three main categories for usability testing, i. e. explorative, assessment and comparative with the users are three classes of Communication Department students of Bina Nusantara University with a total of 120 students, however finally only 22 students were elected because of the criteria are the students should be like travelling and access to the tourism website more than 12 times. The methodology used is qualitative descriptive and experiments, with data collection techniques through observation and interviews after participants’ access to the web: Due to their one-on-one nature, interviews enable the observer to ask direct questions to the user and the participants posted their opinion in online discussion forum. The results mentioned that the elements web of Wonderful Indonesia has a high learning ability and memorability but less efficiency and satisfaction, as well as several times errors when used. In conclusion, to maximize about the visit of tourism to Indonesia, this web is only able to learn and impress the visitor, but do not give satisfaction to users.

Usability testing of existing type 2 diabetes mellitus websites.

PubMed

Davis, Dorian; Jiang, Steven

2016-08-01

Given the significant increase in the use of the internet as an educational tool for diabetes, very little research has been published on the usability of healthcare websites, even though it is a determining factor for user satisfaction. The aim of this study is to evaluate and critique the interfaces of existing diabetes websites for usability concerns and provide design solutions for improvement. Emphasis is placed on Type 2 Diabetes Mellitus since it is the most common and life threatening form of diabetes. A usability test was performed on the interfaces of three existing diabetes websites, American Diabetes Association (www.diabetes.org), WebMD (www.webmd.com) and the National Diabetes Education Program (ndep.nih.gov). The goal was to collect qualitative and quantitative data to determine: (1) if participants are able to complete specified tasks successfully; (2) the length of time it takes participants to complete the specified tasks and; (3) participants' satisfaction with the three websites. Twenty adults, 18 years of age and older participated in the study. The results from the MANOVA test revealed a significant difference between the three websites for number of clicks, number of errors and completion time when analyzed simultaneously. The ANOVA tests revealed a significant difference for all three variables. The Student-Newman-Keuls (SNK) test shows a significant difference for completion time between American Diabetes Association and WebMD. A significant difference was found for the number of clicks for the National Diabetes Education Program compared to the American Diabetes Association and WebMD. However, no significant difference was found for the number of clicks between American Diabetes Association and WebMD. Lastly, a significant difference was found between each interface for number of errors. Although, the American Diabetes Association web-interface was most favorable, there were many positive design elements for each interface. On the other hand, the significant amount of information overload experienced for each website left participants feeling perplexed. Thus, innovative solutions are needed to reduce information overload and ensure users are engaged and empowered to make informed decisions about their healthcare. Copyright © 2016 Elsevier Ireland Ltd. All rights reserved.

Creating Patient and Family Education Web Sites

PubMed Central

YADRICH, DONNA MACAN; FITZGERALD, SHARON A.; WERKOWITCH, MARILYN; SMITH, CAROL E.

2013-01-01

This article gives details about the methods and processes used to ensure that usability and accessibility were achieved during development of the Home Parenteral Nutrition Family Caregivers Web site, an evidence-based health education Web site for the family members and caregivers of chronically ill patients. This article addresses comprehensive definitions of usability and accessibility and illustrates Web site development according to Section 508 standards and the national Health and Human Services’ Research-Based Web Design and Usability Guidelines requirements. PMID:22024970

Usability Evaluation of a Web-Based Learning System

ERIC Educational Resources Information Center

Nguyen, Thao

2012-01-01

The paper proposes a contingent, learner-centred usability evaluation method and a prototype tool of such systems. This is a new usability evaluation method for web-based learning systems using a set of empirically-supported usability factors and can be done effectively with limited resources. During the evaluation process, the method allows for…

The Role of Human Web Assistants in E-Commerce: An Analysis and a Usability Study.

ERIC Educational Resources Information Center

Aberg, Johan; Shahmehri, Nahid

2000-01-01

Discusses electronic commerce and presents the concept of Web assistants, human assistants working in an electronic Web shop. Presents results of a usability study of a prototype adaptive Web assistant system that show users were enthusiastic about the concept of Web assistants and its implications. (Author/LRW)

Assessing the Usability of University Websites: An Empirical Study on Namik Kemal University

ERIC Educational Resources Information Center

Mentes, S. Ahmet; Turan, Aykut H.

2012-01-01

Web sites are emerging as a key component of an organization's survival in our ever globalizing competitive world. Usability of a web site has assumed a great deal of importance in terms of satisfying web site users' needs and expectations. The aim of the study is to evaluate and to explore the usability level of Namik Kemal University (NKU)…

The Accessibility and Usability of College Websites: Is Your Website Presenting Barriers to Potential Students?

ERIC Educational Resources Information Center

Erickson, William; Trerise, Sharon; Lee, Camille; VanLooy, Sara; Knowlton, Samuel; Bruyère, Susanne

2013-01-01

Thirty community college websites were evaluated for compliance with federal web accessibility standards found in Section 508 of the Rehabilitation Act of 1973 (29 U.S.C. 794d). Two typical sites were tested for usability by individuals with visual impairments, individuals with reading-related learning disabilities (LD), and a control group of…

Does Your Library's Web Site Pass the Usability Test? Online Treasures

ERIC Educational Resources Information Center

Balas, Janet L.

2005-01-01

In days that seem very long ago, when the card catalog was the only way to search a library's collection, there was very little debate about the usability of the catalog. Librarians were most concerned about properly formatting catalog cards and, of course, ensuring that the cards were filed correctly. Today, the card catalog has been replaced in…

Usability evaluation of cloud-based mapping tools for the display of very large datasets

NASA Astrophysics Data System (ADS)

Stotz, Nicole Marie

The elasticity and on-demand nature of cloud services have made it easier to create web maps. Users only need access to a web browser and the Internet to utilize cloud based web maps, eliminating the need for specialized software. To encourage a wide variety of users, a map must be well designed; usability is a very important concept in designing a web map. Fusion Tables, a new product from Google, is one example of newer cloud-based distributed GIS services. It allows for easy spatial data manipulation and visualization, within the Google Maps framework. ESRI has also introduced a cloud based version of their software, called ArcGIS Online, built on Amazon's EC2 cloud. Utilizing a user-centered design framework, two prototype maps were created with data from the San Diego East County Economic Development Council. One map was built on Fusion Tables, and another on ESRI's ArcGIS Online. A usability analysis was conducted and used to compare both map prototypes in term so of design and functionality. Load tests were also ran, and performance metrics gathered on both map prototypes. The usability analysis was taken by 25 geography students, and consisted of time based tasks and questions on map design and functionality. Survey participants completed the time based tasks for the Fusion Tables map prototype quicker than those of the ArcGIS Online map prototype. While response was generally positive towards the design and functionality of both prototypes, overall the Fusion Tables map prototype was preferred. For the load tests, the data set was broken into 22 groups for a total of 44 tests. While the Fusion Tables map prototype performed more efficiently than the ArcGIS Online prototype, differences are almost unnoticeable. A SWOT analysis was conducted for each prototype. The results from this research point to the Fusion Tables map prototype. A redesign of this prototype would incorporate design suggestions from the usability survey, while some functionality would need to be dropped. This is a free product and would therefore be the best option if cost is an issue, but this map may not be supported in the future.

Usability of American Nurses Association State Web Sites: A Follow-up Evaluation.

PubMed

Koch, Gina; Wakefield, Bonnie J; Alexander, Gregory L; Wilson, Melissa A; Becker, Colleen

2016-05-01

The American Nurses Association supports professional nurses through Web sites administered by state nursing associations, providing important information for current and potential members. Optimal usability of these Web sites is critical for nurses to obtain the information they seek. Heuristic evaluations are general criteria used to evaluate the usability of technology such as Web sites. A study published in 2014, using heuristic criteria from Nielsen's 10 principles and Health on The Web, evaluated 27 state nursing Web sites to identify usability concerns that could prevent nurses from obtaining accurate information regarding state nursing practice. The purpose of this study is to conduct a second heuristic evaluation to assess for changes in a subset of 12 Web sites. The analysis comparing the evaluation from 2012 to 2014 found that mean scores increased and variance decreased; however, no statistically significant difference was found between the two studies. Scores increased in 2014 for "help users to diagnose, and recover from errors," "match between the system and real world," and "consistency and standards." Scores decreased due to absence of mission statements and identification of intended audience. Ideally, Web site designers will use the feedback from this study and make changes that improve their usability to provide information to nurses.

Non-visual Web Browsing: Beyond Web Accessibility

PubMed Central

Ramakrishnan, I.V.; Ashok, Vikas

2017-01-01

People with vision impairments typically use screen readers to browse the Web. To facilitate non-visual browsing, web sites must be made accessible to screen readers, i.e., all the visible elements in the web site must be readable by the screen reader. But even if web sites are accessible, screen-reader users may not find them easy to use and/or easy to navigate. For example, they may not be able to locate the desired information without having to listen to a lot of irrelevant contents. These issues go beyond web accessibility and directly impact web usability. Several techniques have been reported in the accessibility literature for making the Web usable for screen reading. This paper is a review of these techniques. Interestingly, the review reveals that understanding the semantics of the web content is the overarching theme that drives these techniques for improving web usability. PMID:29202137

Non-visual Web Browsing: Beyond Web Accessibility.

PubMed

Ramakrishnan, I V; Ashok, Vikas; Billah, Syed Masum

2017-07-01

People with vision impairments typically use screen readers to browse the Web. To facilitate non-visual browsing, web sites must be made accessible to screen readers, i.e., all the visible elements in the web site must be readable by the screen reader. But even if web sites are accessible, screen-reader users may not find them easy to use and/or easy to navigate. For example, they may not be able to locate the desired information without having to listen to a lot of irrelevant contents. These issues go beyond web accessibility and directly impact web usability. Several techniques have been reported in the accessibility literature for making the Web usable for screen reading. This paper is a review of these techniques. Interestingly, the review reveals that understanding the semantics of the web content is the overarching theme that drives these techniques for improving web usability.

A usability evaluation exploring the design of American Nurses Association state web sites.

PubMed

Alexander, Gregory L; Wakefield, Bonnie J; Anbari, Allison B; Lyons, Vanessa; Prentice, Donna; Shepherd, Marilyn; Strecker, E Bradley; Weston, Marla J

2014-08-01

National leaders are calling for opportunities to facilitate the Future of Nursing. Opportunities can be encouraged through state nurses association Web sites, which are part of the American Nurses Association, that are well designed, with appropriate content, and in a language professional nurses understand. The American Nurses Association and constituent state nurses associations provide information about nursing practice, ethics, credentialing, and health on Web sites. We conducted usability evaluations to determine compliance with heuristic and ethical principles for Web site design. We purposefully sampled 27 nursing association Web sites and used 68 heuristic and ethical criteria to perform systematic usability assessments of nurse association Web sites. Web site analysis included seven double experts who were all RNs trained in usability analysis. The extent to which heuristic and ethical criteria were met ranged widely from one state that met 0% of the criteria for "help and documentation" to states that met greater than 92% of criteria for "visibility of system status" and "aesthetic and minimalist design." Suggested improvements are simple yet make an impact on a first-time visitor's impression of the Web site. For example, adding internal navigation and tracking features and providing more details about the application process through help and frequently asked question documentation would facilitate better use. Improved usability will improve effectiveness, efficiency, and consumer satisfaction with these Web sites.

Translating access into utilization: lessons from the design and evaluation of a health insurance Web site to promote reproductive health care for young women in Massachusetts.

PubMed

Janiak, Elizabeth; Rhodes, Elizabeth; Foster, Angel M

2013-12-01

Following state-level health care reform in Massachusetts, young women reported confusion over coverage of contraception and other sexual and reproductive health services under newly available health insurance products. To address this gap, a plain-language Web site titled "My Little Black Book for Sexual Health" was developed by a statewide network of reproductive health stakeholders. The purpose of this evaluation was to assess the health literacy demands and usability of the site among its target audience, women ages 18-26 years. We performed an evaluation of the literacy demands of the Web site's written content and tested the Web site's usability in a health communications laboratory. Participants found the Web site visually appealing and its overall design concept accessible. However, the Web site's literacy demands were high, and all participants encountered problems navigating through the Web site. Following this evaluation, the Web site was modified to be more usable and more comprehensible to women of all health literacy levels. To avail themselves of sexual and reproductive health services newly available under expanded health insurance coverage, young women require customized educational resources that are rigorously evaluated to ensure accessibility. To maximize utilization of reproductive health services under expanded health insurance coverage, US women require customized educational resources commensurate with their literacy skills. The application of established research methods from the field of health communications will enable advocates to evaluate and adapt these resources to best serve their targeted audiences. © 2013.

Building a Playground: General Guidelines for Creating Educational Web Sites for Children

PubMed Central

Meloncon, Lisa; Haynes, Erin; Varelmann, Megan; Groh, Lisa

2015-01-01

Purpose Since 2004, the number of children online has increased 18%, compared with a 10% increase in total users. Not only do children represent a growing segment of Internet users, much of what they do online has a specific purpose: education. To help technical communicators create educational Web sites for children, we offer a set of guidelines to direct the design process. Method Nine children participated in a usability test of the CARES Playground, an educational Web site geared toward 7- to 9-year-olds. The site was designed by a group of graduate students in professional writing based on a review of the (admittedly limited) literature dealing with designing Web sites for children. This paper matches common themes from existing literature to the results of the usability tests. Results Since all the information on designing Web sites for children emerged from the literature of designing Web sites for adults, the themes of navigation, appearance, and content are not unfamiliar. However, the interpretation of those common issues for children—as well as the children’s reaction to them—may be surprising. Conclusion Technical communicators need to be conscious and deliberate when designing Web sites for children. To ensure that educational Web sites are able to meet their learning goals, careful consideration of children’s developmental abilities and Web preferences must be considered. We present several guidelines as a starting point, though further research is needed to confirm and expand upon them. PMID:26633909

Does Branding Need Web Usability? A Value-Oriented Empirical Study

NASA Astrophysics Data System (ADS)

Bolchini, Davide; Garzotto, Franca; Sorce, Fabio

Does usability of a web-based communication artifact affect brand, i.e., the set of beliefs, emotions, attitudes, or qualities that people mentally associate to the entity behind that artifact? Intuitively, the answer is “yes”: usability is a fundamental aspect of the quality of the experience with a website, and a “good” experience with a “product” or its reifications tends to translate into “good” brand perception. To date, however, the existence of a connection between web usability and brand perception is shown through anecdotic arguments, and is not supported by published systematic research. This paper discusses a study that empirically investigates this correlation in a more rigorous, analytical, and replicable way. Our main contribution is twofold: on the one hand, we provide empirical evidence to the heuristic principle that web usability influences branding, and we do that through four between subjects controlled experiments that involved 120 subjects. On the other hand, we inform the study with a systematic value-oriented approach to the user experience, and thus provide a conceptual framework that can be reused in other experimental settings, either for replicating our study, or for designing similar studies focusing on the correlation of web branding vs. design factors other than usability.

Review Question Formats and Web Design Usability in Computer-Assisted Instruction

ERIC Educational Resources Information Center

Green, Rebecca S.; Eppler, Marion A.; Ironsmith, Marsha; Wuensch, Karl L.

2007-01-01

We tested the effects of two embedded review question formats and the application of web design guidelines in a computer-assisted mastery learning course in developmental psychology. Students used either a branching review question format that redirected them to relevant portions of the study module after incorrect answers or a linear format that…

Computer Administered Safety Planning for Individuals at Risk for Suicide: Development and Usability Testing.

PubMed

Boudreaux, Edwin D; Brown, Gregory K; Stanley, Barbara; Sadasivam, Rajani S; Camargo, Carlos A; Miller, Ivan W

2017-05-15

Safety planning is a brief intervention that has become an accepted practice in many clinical settings to help prevent suicide. Even though it is quick compared to other approaches, it frequently requires 20 min or more to complete, which can impede adoption. A self-administered, Web-based safety planning application could potentially reduce clinician time, help promote standardization and quality, and provide enhanced ability to share the created plan. The aim of this study was to design, build, and test the usability of a Web-based, self-administered safety planning application. We employed a user-centered software design strategy led by a multidisciplinary team. The application was tested for usability with a target sample of suicidal patients. Detailed observations, structured usability ratings, and Think Aloud procedures were used. Suicidal ideation intensity and perceived ability to cope were assessed pre-post engagement with the Web application. A total of 30 participants were enrolled. Usability ratings were generally strong, and all patients successfully built a safety plan. However, the completeness of the safety plan varied. The mean number of steps completed was 5.5 (SD 0.9) out of 6, with 90% (27/30) of participants completing at least 5 steps and 67% (20/30) completing all 6 steps. Some safety planning steps were viewed as inapplicable to some individuals. Some confusion in instructions led to modifications to improve understandability of each step. Ratings of suicide intensity after completion of the application were significantly lower than preratings, pre: mean 5.11 (SD 2.9) versus post: mean 4.46 (SD 3.0), t 27 =2.49, P=.02. Ratings of ability to cope with suicidal thoughts after completion of the application were higher than preratings, with the difference approaching statistical significance, pre: mean 5.93 (SD 2.9), post: mean 6.64 (SD 2.4), t 27 =-2.03, P=.05. We have taken the first step toward identifying the components needed to maximize usability of a self-administered, Web-based safety planning application. Results support initial consideration of the application as an adjunct to clinical contact. This allows for the clinician or other personnel to provide clarification, when needed, to help the patient build the plan, and to help review and revise the draft. ©Edwin D Boudreaux, Gregory K Brown, Barbara Stanley, Rajani S Sadasivam, Carlos A Camargo Jr, Ivan W Miller. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 15.05.2017.

The Usability of Diabetes MAP: A Web-delivered Intervention for Improving Medication Adherence.

PubMed

Nelson, Lyndsay A; Bethune, Magaela C; Lagotte, Andrea E; Osborn, Chandra Y

2016-05-12

Web-delivered interventions are a feasible approach to health promotion. However, if a website is poorly designed, difficult to navigate, and has technical bugs, it will not be used as intended. Usability testing prior to evaluating a website's benefits can identify barriers to user engagement and maximize future use. We developed a Web-delivered intervention called Diabetes Medication Adherence Promotion (Diabetes MAP) and used a mixed-methods approach to test its usability prior to evaluating its efficacy on medication adherence and glycemic control in a randomized controlled trial. We recruited English-speaking adults with type 2 diabetes mellitus (T2DM) from an academic medical center who were prescribed diabetes medications. A trained research assistant administered a baseline survey, collected medical record information, and instructed participants on how to access Diabetes MAP. Participants were asked to use the site independently for 2 weeks and to provide survey and/or focus group feedback on their experience. We analyzed survey data descriptively and qualitative data thematically to identify participants' favorable and unfavorable experiences, characterize usability concerns, and solicit recommendations for improving Diabetes MAP. Enrolled participants (N=32) were an average of 51.7 ± 11.8 years old, 66% (21/32) female, 60% (19/32) non-Hispanic White, 88% (28/32) had more than 12 years of education, half had household incomes over $50,000, and 78% (25/32) were privately insured. Average duration of diagnosed diabetes was 7.8 ± 6.3 years, average A1c was 7.4 ± 2.0, and 38% (12/32) were prescribed insulin. Of enrolled participants, 91% (29/32) provided survey and/or focus group feedback about Diabetes MAP. On the survey, participants agreed website information was clear and easy to understand, but in focus groups they reported navigational challenges and difficulty overcoming user errors (eg, entering data in an unspecified format). Participants also reported difficulty accessing the site and, once accessed, using all of its features. Participants recommended improving the site's user interface to facilitate quick, efficient access to all features and content. Adults with T2DM rated the Diabetes MAP website favorably on surveys, but focus groups gave more in-depth feedback on the user experience (eg, difficulty accessing the site, maximizing all of the site's features and content, and recovering from errors). Appropriate usability testing methods ensure Web-delivered interventions work as intended and any benefits are not diminished by usability challenges.

The Usability of Diabetes MAP: A Web-delivered Intervention for Improving Medication Adherence

PubMed Central

Nelson, Lyndsay A; Bethune, Magaela C; Lagotte, Andrea E

2016-01-01

Background Web-delivered interventions are a feasible approach to health promotion. However, if a website is poorly designed, difficult to navigate, and has technical bugs, it will not be used as intended. Usability testing prior to evaluating a website’s benefits can identify barriers to user engagement and maximize future use. Objective We developed a Web-delivered intervention called Diabetes Medication Adherence Promotion (Diabetes MAP) and used a mixed-methods approach to test its usability prior to evaluating its efficacy on medication adherence and glycemic control in a randomized controlled trial. Methods We recruited English-speaking adults with type 2 diabetes mellitus (T2DM) from an academic medical center who were prescribed diabetes medications. A trained research assistant administered a baseline survey, collected medical record information, and instructed participants on how to access Diabetes MAP. Participants were asked to use the site independently for 2 weeks and to provide survey and/or focus group feedback on their experience. We analyzed survey data descriptively and qualitative data thematically to identify participants’ favorable and unfavorable experiences, characterize usability concerns, and solicit recommendations for improving Diabetes MAP. Results Enrolled participants (N=32) were an average of 51.7 ± 11.8 years old, 66% (21/32) female, 60% (19/32) non-Hispanic White, 88% (28/32) had more than 12 years of education, half had household incomes over $50,000, and 78% (25/32) were privately insured. Average duration of diagnosed diabetes was 7.8 ± 6.3 years, average A1c was 7.4 ± 2.0, and 38% (12/32) were prescribed insulin. Of enrolled participants, 91% (29/32) provided survey and/or focus group feedback about Diabetes MAP. On the survey, participants agreed website information was clear and easy to understand, but in focus groups they reported navigational challenges and difficulty overcoming user errors (eg, entering data in an unspecified format). Participants also reported difficulty accessing the site and, once accessed, using all of its features. Participants recommended improving the site’s user interface to facilitate quick, efficient access to all features and content. Conclusions Adults with T2DM rated the Diabetes MAP website favorably on surveys, but focus groups gave more in-depth feedback on the user experience (eg, difficulty accessing the site, maximizing all of the site’s features and content, and recovering from errors). Appropriate usability testing methods ensure Web-delivered interventions work as intended and any benefits are not diminished by usability challenges. PMID:27174496

Exploring the Relationships between Web Usability and Students' Perceived Learning in Web-Based Multimedia (WBMM) Tutorials

ERIC Educational Resources Information Center

Mackey, Thomas P.; Ho, Jinwon

2008-01-01

The purpose of this case study is to better understand the relationships between Web usability and students' perceived learning in the design and implementation of Web-based multimedia (WBMM) tutorials in blended courses. Much of the current research in this area focuses on the use of multimedia as a replacement for classroom instruction rather…

Evaluating the Usability of a Museum Web Site.

ERIC Educational Resources Information Center

Harms, Ilse; Schweibenz, Werner

This paper presents a research project conducted by the Department of Information Science in cooperation with the Saarland Museum, the art museum of the Federal State of Saarland, Germany. The study had two aims. The first was to evaluate some methods of usability engineering for the Web, and the second was to evaluate the usability of the…

Factors Affecting Faculty Web Portal Usability

ERIC Educational Resources Information Center

Bringula, Rex P.; Basa, Roselle S.

2011-01-01

The study investigated the factors that might significantly affect web portal usability. Results of the study were intended to serve as inputs for faculty web portal development of the University of the East-Manila. Descriptive statistics utilized questionnaire data from 82 faculty members. The data showed that most of the respondents were…

Sign language Web pages.

PubMed

Fels, Deborah I; Richards, Jan; Hardman, Jim; Lee, Daniel G

2006-01-01

The WORLD WIDE WEB has changed the way people interact. It has also become an important equalizer of information access for many social sectors. However, for many people, including some sign language users, Web accessing can be difficult. For some, it not only presents another barrier to overcome but has left them without cultural equality. The present article describes a system that allows sign language-only Web pages to be created and linked through a video-based technique called sign-linking. In two studies, 14 Deaf participants examined two iterations of signlinked Web pages to gauge the usability and learnability of a signing Web page interface. The first study indicated that signing Web pages were usable by sign language users but that some interface features required improvement. The second study showed increased usability for those features; users consequently couldnavigate sign language information with ease and pleasure.

Mobile Web and Accessibility

NASA Astrophysics Data System (ADS)

Hori, Masahiro; Kato, Takashi

While focusing on the human-computer interaction side of the Web content delivery, this article discusses problems and prospects of the mobile Web and Web accessibility in terms of what lessons and experiences we have gained from Web accessibility and what they can say about the mobile Web. One aim is to draw particular attention to the importance of explicitly distinguishing between perceptual and cognitive aspects of the users’ interactions with the Web. Another is to emphasize the increased importance of scenario-based evaluation and remote testing for the mobile Web where the limited screen space and a variety of environmental factors of mobile use are critical design issues. A newly devised inspection type of evaluation method that focuses on the perceptual-cognitive distinction of accessibility and usability issues is presented as a viable means of scenario-based, remote testing for the Web.

Computer problem-solving coaches for introductory physics: Design and usability studies

NASA Astrophysics Data System (ADS)

Ryan, Qing X.; Frodermann, Evan; Heller, Kenneth; Hsu, Leonardo; Mason, Andrew

2016-06-01

The combination of modern computing power, the interactivity of web applications, and the flexibility of object-oriented programming may finally be sufficient to create computer coaches that can help students develop metacognitive problem-solving skills, an important competence in our rapidly changing technological society. However, no matter how effective such coaches might be, they will only be useful if they are attractive to students. We describe the design and testing of a set of web-based computer programs that act as personal coaches to students while they practice solving problems from introductory physics. The coaches are designed to supplement regular human instruction, giving students access to effective forms of practice outside class. We present results from large-scale usability tests of the computer coaches and discuss their implications for future versions of the coaches.

The development and preliminary testing of a multimedia patient-provider survivorship communication module for breast cancer survivors.

PubMed

Wen, Kuang-Yi; Miller, Suzanne M; Stanton, Annette L; Fleisher, Linda; Morra, Marion E; Jorge, Alexandra; Diefenbach, Michael A; Ropka, Mary E; Marcus, Alfred C

2012-08-01

This paper describes the development of a theory-guided and evidence-based multimedia training module to facilitate breast cancer survivors' preparedness for effective communication with their health care providers after active treatment. The iterative developmental process used included: (1) theory and evidence-based content development and vetting; (2) user testing; (3) usability testing; and (4) participant module utilization. Formative evaluation of the training module prototype occurred through user testing (n = 12), resulting in modification of the content and layout. Usability testing (n = 10) was employed to improve module functionality. Preliminary web usage data (n = 256, mean age = 53, 94.5% White, 75% college graduate and above) showed that 59% of the participants accessed the communication module, for an average of 7 min per login. The iterative developmental process was informative in enhancing the relevance of the communication module. Preliminary web usage results demonstrate the potential feasibility of such a program. Our study demonstrates survivors' openness to the use of a web-based communication skills training module and outlines a systematic iterative user and interface program development and testing process, which can serve as a prototype for others considering such an approach. Copyright © 2012. Published by Elsevier Ireland Ltd.

The development and preliminary testing of a multimedia patient–provider survivorship communication module for breast cancer survivors

PubMed Central

Wen, Kuang-Yi; Miller, Suzanne M.; Stanton, Annette L.; Fleisher, Linda; Morra, Marion E.; Jorge, Alexandra; Diefenbach, Michael A.; Ropka, Mary E.; Marcus, Alfred C.

2012-01-01

Objective This paper describes the development of a theory-guided and evidence-based multimedia training module to facilitate breast cancer survivors’ preparedness for effective communication with their health care providers after active treatment. Methods The iterative developmental process used included: (1) theory and evidence-based content development and vetting; (2) user testing; (3) usability testing; and (4) participant module utilization. Results Formative evaluation of the training module prototype occurred through user testing (n = 12), resulting in modification of the content and layout. Usability testing (n = 10) was employed to improve module functionality. Preliminary web usage data (n = 256, mean age = 53, 94.5% White, 75% college graduate and above) showed that 59% of the participants accessed the communication module, for an average of 7 min per login. Conclusion The iterative developmental process was informative in enhancing the relevance of the communication module. Preliminary web usage results demonstrate the potential feasibility of such a program. Practice implications Our study demonstrates survivors’ openness to the use of a web-based communication skills training module and outlines a systematic iterative user and interface program development and testing process, which can serve as a prototype for others considering such an approach. PMID:22770812

Discovering How Students Search a University Web Site: A Comparative Usability Case Study for PC and Mobile Devices

ERIC Educational Resources Information Center

Sengel, Erhan

2014-01-01

This study aims to investigate the usability level of web site of a university by observing 10 participants who are required to complete 11 tasks, which have been defined by the researchers before to gather data about effectiveness, efficiency and satisfaction. System Usability Scale was used to collect data about satisfaction. The research…

Improving Accessibility for Seniors in a Life-Long Learning Network: A Usability Study of Learning Websites

ERIC Educational Resources Information Center

Gu, Xiaoqing; Ding, Rui; Fu, Shirong

2011-01-01

Senior citizens are comparatively vulnerable in accessing learning opportunities offered on the Internet due to usability problems in current web design. In an effort to build a senior-friendly learning web as a part of the Life-long Learning Network in Shanghai, usability studies of two websites currently available to Shanghai senior citizens…

Discovering How Students Search a Library Web Site: A Usability Case Study.

ERIC Educational Resources Information Center

Augustine, Susan; Greene, Courtney

2002-01-01

Discusses results of a usability study at the University of Illinois Chicago that investigated whether Internet search engines have influenced the way students search library Web sites. Results show students use the Web site's internal search engine rather than navigating through the pages; have difficulty interpreting library terminology; and…

Improving Public Relations Web Sites through Usability Research.

ERIC Educational Resources Information Center

Hallahan, Kirk

2001-01-01

Argues that usability research has particular relevance for enhancing the effectiveness of websites. Examines the nature and value of usability research, and the elements of an effective website based on usability principles. (SR)

Farm Mapping to Assist, Protect, and Prepare Emergency Responders: Farm MAPPER.

PubMed

Reyes, Iris; Rollins, Tami; Mahnke, Andrea; Kadolph, Christopher; Minor, Gerald; Keifer, Matthew

2014-01-01

Responders such as firefighters and emergency medical technicians who respond to farm emergencies often face complex and unknown environments. They may encounter hazards such as fuels, solvents, pesticides, caustics, and exploding gas storage cylinders. Responders may be unaware of dirt roads within the farm that can expedite their arrival at critical sites or snow-covered manure pits that act as hidden hazards. A response to a farm, unless guided by someone familiar with the operation, may present a risk to responders and post a challenge in locating the victim. This project explored the use of a Web-based farm-mapping application optimized for tablets and accessible via easily accessible on-site matrix barcodes, or quick response codes (QR codes), to provide emergency responders with hazard and resource information to agricultural operations. Secured portals were developed for both farmers and responders, allowing both parties to populate and customize farm maps with icons. Data were stored online and linked to QR codes attached to mailbox posts where emergency responders may read them with a mobile device. Mock responses were conducted on dairy farms to test QR code linking efficacy, Web site security, and field usability. Findings from farmer usability tests showed willingness to enter data as well as ease of Web site navigation and data entry even with farmers who had limited computer knowledge. Usability tests with emergency responders showed ease of QR code connectivity to the farm maps and ease of Web site navigation. Further research is needed to improve data security as well as assess the program's applicability to nonfarm environments and integration with existing emergency response systems. The next phases of this project will expand the program for regional and national use, develop QR code-linked, Web-based extrication guidance for farm machinery for victim entrapment rescue, and create QR code-linked online training videos and materials for limited English proficient immigrant farm workers.

Designing mobile dietary management support technologies for people with diabetes.

PubMed

Arsand, Eirik; Tufano, James T; Ralston, James D; Hjortdahl, Per

2008-01-01

We performed two cycles of laboratory-based usability testing of three food registration prototypes for people with diabetes. The design concepts were a commercial web application, various smartphones and a mobile phone photo blogging approach. Six adults with Type 1 diabetes and three adults with Type 2 diabetes participated in the usability tests. The results provided five distinct implications for devices for the future dietary management support of people with diabetes. Study participants valued many of the features offered by the three systems that were tested, although the usability tests also revealed several opportunities to enhance their design. Our findings suggest that further development is justified of mobile dietary and nutritional support for individuals living with diabetes. Applications that support healthy eating habits should be integrated with applications for managing blood glucose data and physical activity data, and potentially medication data as well.

An Exploratory Usability Evaluation of Colorado State University Libraries' Digital Collections and the Western Waters Digital Library Web Sites

ERIC Educational Resources Information Center

Zimmerman, Don; Paschal, Dawn Bastian

2009-01-01

In an exploratory study, participants (n = 18) completed 11 usability tasks to assess ease of use of two Web sites, and then a Web site perception questionnaire for each. Participants rated both Web sites positively, but 25% and 36% could not complete all tasks; doing so required more than a minute to complete. (Contains 2 figures and 7 tables.)

Web Accessibility and Usability of the Homepages from Academy of Human Resource Development Members' Institutions

ERIC Educational Resources Information Center

Zeng, Xiaoming; Sligar, Steven R.

2008-01-01

Human resource development programs in various institutions communicate with their constituencies including persons with disabilities through websites. Web sites need to be accessible for legal, economic and ethical reasons. We used an automated web usability evaluation tool, aDesigner, to evaluate 205 home pages from the organizations of AHRD…

Accessibility, usability, and usefulness of a Web-based clinical decision support tool to enhance provider-patient communication around Self-management TO Prevent (STOP) Stroke.

PubMed

Anderson, Jane A; Godwin, Kyler M; Saleem, Jason J; Russell, Scott; Robinson, Joshua J; Kimmel, Barbara

2014-12-01

This article reports redesign strategies identified to create a Web-based user-interface for the Self-management TO Prevent (STOP) Stroke Tool. Members of a Stroke Quality Improvement Network (N = 12) viewed a visualization video of a proposed prototype and provided feedback on implementation barriers/facilitators. Stroke-care providers (N = 10) tested the Web-based prototype in think-aloud sessions of simulated clinic visits. Participants' dialogues were coded into themes. Access to comprehensive information and the automated features/systematized processes were the primary accessibility and usability facilitator themes. The need for training, time to complete the tool, and computer-centric care were identified as possible usability barriers. Patient accountability, reminders for best practice, goal-focused care, and communication/counseling themes indicate that the STOP Stroke Tool supports the paradigm of patient-centered care. The STOP Stroke Tool was found to prompt clinicians on secondary stroke-prevention clinical-practice guidelines, facilitate comprehensive documentation of evidence-based care, and support clinicians in providing patient-centered care through the shared decision-making process that occurred while using the action-planning/goal-setting feature of the tool. © The Author(s) 2013.

A Pedagogical Approach toward Teaching an Information Systems Student How to Conduct a Web Usability Study for an Honors Project: A Case Study

ERIC Educational Resources Information Center

Jesse, Gayle

2013-01-01

The purpose of this paper is to provide educators with a course model and pedagogy to teach a computer information systems usability course. This paper offers a case study based on an honors student project titled "Web Usability: Phases of Developing an Interactive Event Database." Each individual phase--creating a prototype along with…

What a User Wants: Redesigning a Library's Web Site Based on a Card-Sort Analysis

ERIC Educational Resources Information Center

Robbins, Laura Pope; Esposito, Lisa; Kretz, Chris; Aloi, Michael

2007-01-01

Web site usability concerns anyone with a Web site to maintain. Libraries, however, are often the biggest offenders in terms of usability. In our efforts to provide users with everything they need for research, we often overwhelm them with sites that are confusing in structure, difficult to navigate, and weighed down with jargon. Dowling College…

Why We Are Not Google: Lessons from a Library Web Site Usability Study

ERIC Educational Resources Information Center

Swanson, Troy A.; Green, Jeremy

2011-01-01

In the Fall of 2009, the Moraine Valley Community College Library, using guidelines developed by Jakob Nielsen, conducted a usability study to determine how students were using the library Web site and to inform the redesign of the Web site. The authors found that Moraine Valley's current gateway design was a more effective access point to library…

Usability evaluation of mobile applications; where do we stand?

NASA Astrophysics Data System (ADS)

Zahra, Fatima; Hussain, Azham; Mohd, Haslina

2017-10-01

The range and availability of mobile applications is expanding rapidly. With the increased processing power available on portable devices, developers are increasing the range of services by embracing smartphones in their extensive and diverse practices. While usability testing and evaluations of mobile applications have not yet touched the accuracy level of other web based applications. The existing usability models do not adequately capture the complexities of interacting with applications on a mobile platform. Therefore, this study aims to presents review on existing usability models for mobile applications. These models are in their infancy but with time and more research they may eventually be adopted. Moreover, different categories of mobile apps (medical, entertainment, education) possess different functional and non-functional requirements thus customized models are required for diverse mobile applications.

The Information Architecture of E-Commerce: An Experimental Study on User Performance and Preference

NASA Astrophysics Data System (ADS)

Wan Mohd, Wan Abdul Rahim; Md Noor, Nor Laila; Mehad, Shafie

Too often, designers of e-commerce web sites use models, concepts, guidelines, and designs that focus on the artifacts while ignoring the context in which the artifacts will be used. Furthermore, the link between culture and usability in web site IA phenomenon is still considered as uncharted area, as it lacks much theoretical consideration. In an effort toward addressing the aforementioned issues, our study provides a theoretical and empirical link between cultural and usability through the application of ‘Venustas' (Delight) drawn from the architectural field and Hofstede's cultural dimensions. We use Islamic culture as the case study and report on the experiment to investigate the effect of the IA designs based on the cultural dimensions on e-commerce web sites. The result provides partial empirical support to the theorized link between culture and usability based on the usability measurement on user performance and preference. In addition, practical web site IA cultural design prescriptions are also provided.

Usability evaluation of the interactive Personal Patient Profile-Prostate decision support system with African American men.

PubMed

Jaja, Cheedy; Pares-Avila, Jose; Wolpin, Seth; Berry, Donna

2010-04-01

The Personal Patient Profile-Prostate (P4) program is an interactive Web-based decision support system that provides men with localized prostate cancer customized education and coaching with which to make the best personal treatment decision. This study assessed functionality and usability of the P4 program and identified problems in user-computer interaction in a sample of African American men. Usability testing was conducted with 12 community-dwelling African American adult men. The health status of participants was not known or collected by the research team. Each participant worked with the P4 program and provided simultaneous feedback using the "think aloud" technique. Handwritten field notes were collated and assigned to 3 standard coded categories. Aspects of P4 program usability was made based on common issues in the assigned categories. Summary statistics were derived for types and frequency of usability issues noted in the coded data. Twelve participants reported a total of 122 usability comments, with a mean of 9 usability comments. The most common usability issue by participant was completeness of information content, which comprised 53 (43%) of the total issues. Comprehensibility of text and graphics was second, comprising 51 (42%) of the total issues. This study provided initial inventory of usability issues for community African American men that may potentially interfere with application of the P4 system in the community setting and overall system usability, confirming the need for usability testing of a culturally appropriate Internet-based decision support system before community application.

Web usability evaluation with screen reader users: implementation of the partial concurrent thinking aloud technique.

PubMed

Federici, Stefano; Stefano, Federici; Borsci, Simone; Stamerra, Gianluca

2010-08-01

A verbal protocol technique, adopted for a web usability evaluation, requires that the users are able to perform a double task: surfing and talking. Nevertheless, when blind users surf by using a screen reader and talk about the way they interact with the computer, the evaluation is influenced by a structural interference: users are forced to think aloud and listen to the screen reader at the same time. The aim of this study is to build up a verbal protocol technique for samples of visual impaired users in order to overcome the limits of concurrent and retrospective protocols. The technique we improved, called partial concurrent thinking aloud (PCTA), integrates a modified set of concurrent verbalization and retrospective analysis. One group of 6 blind users and another group of 6 sighted users evaluated the usability of a website using PCTA. By estimating the number of necessary users by the means of an asymptotic test, it was found out that the two groups had an equivalent ability of identifying usability problems, both over 80%. The result suggests that PCTA, while respecting the properties of classic verbal protocols, also allows to overcome the structural interference and the limits of concurrent and retrospective protocols when used with screen reader users. In this way, PCTA reduces the efficiency difference of usability evaluation between blind and sighted users.

Web-Based Intervention to Reduce Substance Abuse and Depressive Symptoms in Mexico: Development and Usability Test.

PubMed

Tiburcio, Marcela; Lara, Ma Asunción; Aguilar Abrego, Araceli; Fernández, Morise; Martínez Vélez, Nora; Sánchez, Alejandro

2016-09-29

The development of Web-based interventions for substance abuse in Latin America is a new field of interest with great potential for expansion to other Spanish-speaking countries. This paper describes a project aimed to develop and evaluate the usability of the Web-based Help Program for Drug Abuse and Depression (Programa de Ayuda para Abuso de Drogas y Depresión, PAADD, in Spanish) and also to construct a systematic frame of reference for the development of future Web-based programs. The PAADD aims to reduce substance use and depressive symptoms with cognitive behavioral techniques translated into Web applications, aided by the participation of a counselor to provide support and guidance. This Web-based intervention includes 4 steps: (1) My Starting Point, (2) Where Do I Want to Be? (3) Strategies for Change, and (4) Maintaining Change. The development of the program was an interactive multistage process. The first stage defined the core structure and contents, which were validated in stage 2 by a group of 8 experts in addiction treatment. Programming of the applications took place in stage 3, taking into account 3 types of end users: administrators, counselors, and substance users. Stage 4 consisted of functionality testing. In stage 5, a total of 9 health professionals and 20 drug users currently in treatment voluntarily interacted with the program in a usability test, providing feedback about adjustments needed to improve users' experience. The main finding of stage 2 was the consensus of the health professionals about the cognitive behavioral strategies and techniques included in PAADD being appropriate for changing substance use behaviors. In stage 5, the health professionals found the functionalities easy to learn; their suggestions were related to the page layout, inclusion of confirmation messages at the end of activities, avoiding "read more" links, and providing feedback about every activity. On the other hand, the users said the information presented within the modules was easy to follow and suggested more dynamic features with concrete instructions and feedback. The resulting Web-based program may have advantages over traditional face-to-face therapies owing to its low cost, wide accessibility, anonymity, and independence of time and distance factors. The detailed description of the process of designing a Web-based program is an important contribution to others interested in this field. The potential benefits must be verified in specific studies. International Standard Randomized Controlled Trial Number (ISRCTN): 25429892; http://www.controlled-trials.com/ISRCTN25429892 (Archived by WebCite at http://www.webcitation.org/6ko1Fsvym).

Usability of a CKD educational website targeted to patients and their family members.

PubMed

Diamantidis, Clarissa J; Zuckerman, Marni; Fink, Wanda; Hu, Peter; Yang, Shiming; Fink, Jeffrey C

2012-10-01

Web-based technology is critical to the future of healthcare. As part of the Safe Kidney Care cohort study evaluating patient safety in CKD, this study determined how effectively a representative sample of patients with CKD or family members could interpret and use the Safe Kidney Care website (www.safekidneycare.org), an informational website on safety in CKD. Between November of 2011 and January of 2012, persons with CKD or their family members underwent formal usability testing administered by a single interviewer with a second recording observer. Each participant was independently provided a list of 21 tasks to complete, with each task rated as either easily completed/noncritical error or critical error (user cannot complete the task without significant interviewer intervention). Twelve participants completed formal usability testing. Median completion time for all tasks was 17.5 minutes (range=10-44 minutes). In total, 10 participants had greater than or equal to one critical error. There were 55 critical errors in 252 tasks (22%), with the highest proportion of critical errors occurring when participants were asked to find information on treatments that may damage kidneys, find the website on the internet, increase font size, and scroll to the bottom of the webpage. Participants were generally satisfied with the content and usability of the website. Web-based educational materials for patients with CKD should target a wide range of computer literacy levels and anticipate variability in competency in use of the computer and internet.

Designing and evaluating a web-based self-management site for patients with type 2 diabetes--systematic website development and study protocol.

PubMed

Yu, Catherine H; Parsons, Janet; Mamdani, Muhammad; Lebovic, Gerald; Shah, Baiju R; Bhattacharyya, Onil; Laupacis, Andreas; Straus, Sharon E

2012-06-24

Given that patients provide the majority of their own diabetes care, patient self-management training has increasingly become recognized as an important strategy with which to improve quality of care. However, participation in self management programs is low. In addition, the efficacy of current behavioural interventions wanes over time, reducing the impact of self-management interventions on patient health. Web-based interventions have the potential to bridge the gaps in diabetes care and self-management. Our objective is to improve self-efficacy, quality of life, self-care, blood pressure, cholesterol and glycemic control and promote exercise in people with type 2 diabetes through the rigorous development and use of a web-based patient self-management intervention. This study consists of five phases: (1) intervention development; (2) feasibility testing; (3) usability testing; (4) intervention refinement; and (5) intervention evaluation using mixed methods. We will employ evidence-based strategies and tools, using a theoretical framework of self-efficacy, then elicit user feedback through focus groups and individual user testing sessions. Using iterative redesign the intervention will be refined. Once finalized, the impact of the website on patient self-efficacy, quality of life, self-care, HbA1c, LDL-cholesterol, blood pressure and weight will be assessed through a non-randomized observational cohort study using repeated measures modeling and individual interviews. Increasing use of the World Wide Web by consumers for health information and ongoing revolutions in social media are strong indicators that users are primed to welcome a new era of technology in health care. However, their full potential is hindered by limited knowledge regarding their effectiveness, poor usability, and high attrition rates. Our development and research agenda aims to address these limitations by improving usability, identifying characteristics associated with website use and attrition, and developing strategies to sustain patient use in order to maximize clinical outcomes.

Defining Usability: How Library Practice Differs from Published Research

ERIC Educational Resources Information Center

Chen, Yu-Hui; Germain, Carol Anne; Rorissa, Abebe

2011-01-01

Library/information science professionals need a clearly articulated definition of usability/Web usability to implement intuitive websites. In this study, the authors analyzed usability definitions provided by the ARL library professionals and those found in the library/information science and computer science-information systems literature.…

MusiCat System Makes Library Searches More Fruitful.

ERIC Educational Resources Information Center

Hansen, Per Hofman

2002-01-01

Describes MusiCat, an experimental user interface designed in Denmark that reflects the different ways that patrons think when searching for musical material on the Web. Discusses technology versus content; search trees that use a hierarchy of subject terms; and usability testing. (LRW)

Design and Evaluation of a Web-Based Symptom Monitoring Tool for Heart Failure.

PubMed

Wakefield, Bonnie J; Alexander, Gregory; Dohrmann, Mary; Richardson, James

2017-05-01

Heart failure is a chronic condition where symptom recognition and between-visit communication with providers are critical. Patients are encouraged to track disease-specific data, such as weight and shortness of breath. Use of a Web-based tool that facilitates data display in graph form may help patients recognize exacerbations and more easily communicate out-of-range data to clinicians. The purposes of this study were to (1) design a Web-based tool to facilitate symptom monitoring and symptom recognition in patients with chronic heart failure and (2) conduct a usability evaluation of the Web site. Patient participants generally had a positive view of the Web site and indicated it would support recording their health status and communicating with their doctors. Clinician participants generally had a positive view of the Web site and indicated it would be a potentially useful adjunct to electronic health delivery systems. Participants expressed a need to incorporate decision support within the site and wanted to add other data, for example, blood pressure, and have the ability to adjust font size. A few expressed concerns about data privacy and security. Technologies require careful design and testing to ensure they are useful, usable, and safe for patients and do not add to the burden of busy providers.

Qualitative and quantitative evaluation of EHR-integrated mobile patient questionnaires regarding usability and cost-efficiency.

PubMed

Fritz, Fleur; Balhorn, Sebastian; Riek, Markus; Breil, Bernhard; Dugas, Martin

2012-05-01

The objective of this evaluation study is to assess a web-based application, currently available on iPad, to document questionnaires regarding patient reported outcomes such as quality of life. Based on the single source approach, the results of these questionnaires are available in the electronic health record to be used for treatment and research purposes. The assessment focuses on the usability and efficiency of the system. The system usability scale questionnaire with seven additional items was used to rate the usability by the patients. It was formally validated by a Cronbach Alpha test. In addition, semi-structured interviews were conducted with patients and medical staff. Time and cost measures, based on official tables of costs, were taken through workflow observations. This study was conducted in the department of dermatology at the University Hospital of Münster, Germany from April to June 2011. Using the web-based application questionnaire, results about patient reported outcomes like quality of life are immediately available in the electronic health record and can be used for treatment or research purposes. 118 patients and four staff members participated in the study. The usability score reached 80 from 100 points and patients as well as medical staff stated in the interviews that the usability of the web-based system was high, and they preferred it to the previously used paper-based questionnaires. In the setting of our pilot department the mobile devices amortized their costs after 6.7 months. In general, depending on the professional group who are going to post process the paper-based forms, the earliest break-even point to use mobile questionnaires is at 1737 paper sheets per year. The mobile patient questionnaires, integrated into the electronic health record, were well accepted in our pilot setting with high usability scores from patients and medical staff alike. The system has also proved to be cost-efficient compared to the paper-based workflow, given that a certain number of questionnaires is used per year. Copyright © 2011 Elsevier Ireland Ltd. All rights reserved.

Semantic Indexing of Medical Learning Objects: Medical Students' Usage of a Semantic Network

PubMed Central

Gießler, Paul; Ohnesorge-Radtke, Ursula; Spreckelsen, Cord

2015-01-01

Background The Semantically Annotated Media (SAM) project aims to provide a flexible platform for searching, browsing, and indexing medical learning objects (MLOs) based on a semantic network derived from established classification systems. Primarily, SAM supports the Aachen emedia skills lab, but SAM is ready for indexing distributed content and the Simple Knowledge Organizing System standard provides a means for easily upgrading or even exchanging SAM’s semantic network. There is a lack of research addressing the usability of MLO indexes or search portals like SAM and the user behavior with such platforms. Objective The purpose of this study was to assess the usability of SAM by investigating characteristic user behavior of medical students accessing MLOs via SAM. Methods In this study, we chose a mixed-methods approach. Lean usability testing was combined with usability inspection by having the participants complete four typical usage scenarios before filling out a questionnaire. The questionnaire was based on the IsoMetrics usability inventory. Direct user interaction with SAM (mouse clicks and pages accessed) was logged. Results The study analyzed the typical usage patterns and habits of students using a semantic network for accessing MLOs. Four scenarios capturing characteristics of typical tasks to be solved by using SAM yielded high ratings of usability items and showed good results concerning the consistency of indexing by different users. Long-tail phenomena emerge as they are typical for a collaborative Web 2.0 platform. Suitable but nonetheless rarely used keywords were assigned to MLOs by some users. Conclusions It is possible to develop a Web-based tool with high usability and acceptance for indexing and retrieval of MLOs. SAM can be applied to indexing multicentered repositories of MLOs collaboratively. PMID:27731860

Semantic Indexing of Medical Learning Objects: Medical Students' Usage of a Semantic Network.

PubMed

Tix, Nadine; Gießler, Paul; Ohnesorge-Radtke, Ursula; Spreckelsen, Cord

2015-11-11

The Semantically Annotated Media (SAM) project aims to provide a flexible platform for searching, browsing, and indexing medical learning objects (MLOs) based on a semantic network derived from established classification systems. Primarily, SAM supports the Aachen emedia skills lab, but SAM is ready for indexing distributed content and the Simple Knowledge Organizing System standard provides a means for easily upgrading or even exchanging SAM's semantic network. There is a lack of research addressing the usability of MLO indexes or search portals like SAM and the user behavior with such platforms. The purpose of this study was to assess the usability of SAM by investigating characteristic user behavior of medical students accessing MLOs via SAM. In this study, we chose a mixed-methods approach. Lean usability testing was combined with usability inspection by having the participants complete four typical usage scenarios before filling out a questionnaire. The questionnaire was based on the IsoMetrics usability inventory. Direct user interaction with SAM (mouse clicks and pages accessed) was logged. The study analyzed the typical usage patterns and habits of students using a semantic network for accessing MLOs. Four scenarios capturing characteristics of typical tasks to be solved by using SAM yielded high ratings of usability items and showed good results concerning the consistency of indexing by different users. Long-tail phenomena emerge as they are typical for a collaborative Web 2.0 platform. Suitable but nonetheless rarely used keywords were assigned to MLOs by some users. It is possible to develop a Web-based tool with high usability and acceptance for indexing and retrieval of MLOs. SAM can be applied to indexing multicentered repositories of MLOs collaboratively.

Visualization of usability and functionality of a professional website through web-mining.

PubMed

Jones, Josette F; Mahoui, Malika; Gopa, Venkata Devi Pragna

2007-10-11

Functional interface design requires understanding of the information system structure and the user. Web logs record user interactions with the interface, and thus provide some insight into user search behavior and efficiency of the search process. The present study uses a data-mining approach with techniques such as association rules, clustering and classification, to visualize the usability and functionality of a digital library through in depth analyses of web logs.

Development of the Lupus Interactive Navigator as an Empowering Web-Based eHealth Tool to Facilitate Lupus Management: Users Perspectives on Usability and Acceptability.

PubMed

Neville, Carolyn; Da Costa, Deborah; Rochon, Murray; Peschken, Christine A; Pineau, Christian A; Bernatsky, Sasha; Keeling, Stephanie; Avina-Zubieta, Antonio; Lye, Elizabeth; Eng, Davy; Fortin, Paul R

2016-05-30

Systemic Lupus Erythematosus (SLE) is a serious, complex, and chronic illness. Similar to most other chronic illness states, there is great interest in helping persons with SLE engage in their disease management. The objectives of this study were to (1) develop the Lupus Interactive Navigator (LIN), a web-based self-management program for persons with SLE, and (2) test the LIN for usability and acceptability. The LIN development platform was based on the results of preliminary comprehensive needs assessments and adapted from the Oncology Interactive Navigator, a web-based tool developed for persons with cancer. Medical researchers, writers, designers, and programmers worked with clinical experts and persons with SLE to develop content for the LIN. Usability and acceptability of the LIN was tested on individuals with SLE meeting American College of Rheumatology criteria, who were recruited from five Canadian SLE clinics. Participants were provided with access to the LIN and were asked to use it over a two-week period. Following the testing period, participants were contacted for a 30-minute telephone interview to assess usability and acceptability. The content for the LIN was subdivided into six primary information topics with interview videos featuring rheumatologists, allied health professionals, and persons with SLE. Usability and acceptability of the LIN was tested on 43 females with SLE. Of these, 37 (86%) completed telephone interviews. The average age was 43.6 (SD 15.9) years and disease duration averaged 14.1 (SD 10.8) years. Median time spent on LIN was 16.3 (interquartile range [IQR]:13.7, 53.5) minutes and median number of sessions was 2 (IQR: 1, 3). Overall, Likert ratings (0=strongly disagree; 7=strongly agree) of website usability and content were very high, with 75% scoring >6 out of 7 on all items. All participants agreed that LIN was easy to use, would recommend it to others with SLE, and would refer to it for future questions about SLE. Very high ratings were also given to relevancy, credibility, and usefulness of the information provided. Overall, 73% of the participants rated all topics helpful to very helpful. Participants who reported more prior knowledge about SLE rated items regarding improvement in knowledge and helpfulness relatively lower than persons with less prior knowledge. Most participants commented that the LIN would be very useful to those newly diagnosed with SLE. Minor revisions were recommended. This study furthers the understanding of the needs in the SLE community and delivers a unique eHealth tool to promote self-management in persons with SLE. The LIN was found to be highly acceptable in content and usability. The information provided on LIN may be most helpful for individuals with less experience with the disease, such as those newly diagnosed, indicating the need to tailor the content for persons with more SLE experience.

WriteSim TCExam - An open source text simulation environment for training novice researchers in scientific writing

PubMed Central

2010-01-01

Background The ability to write clearly and effectively is of central importance to the scientific enterprise. Encouraged by the success of simulation environments in other biomedical sciences, we developed WriteSim TCExam, an open-source, Web-based, textual simulation environment for teaching effective writing techniques to novice researchers. We shortlisted and modified an existing open source application - TCExam to serve as a textual simulation environment. After testing usability internally in our team, we conducted formal field usability studies with novice researchers. These were followed by formal surveys with researchers fitting the role of administrators and users (novice researchers) Results The development process was guided by feedback from usability tests within our research team. Online surveys and formal studies, involving members of the Research on Research group and selected novice researchers, show that the application is user-friendly. Additionally it has been used to train 25 novice researchers in scientific writing to date and has generated encouraging results. Conclusion WriteSim TCExam is the first Web-based, open-source textual simulation environment designed to complement traditional scientific writing instruction. While initial reviews by students and educators have been positive, a formal study is needed to measure its benefits in comparison to standard instructional methods. PMID:20509946

Development and Usability Testing of a Web-based Self-management Intervention for Oral Cancer Survivors and their Family Caregivers

PubMed Central

Badr, Hoda; Lipnick, Daniella; Diefenbach, Michael A; Posner, Marshall; Kotz, Tamar; Miles, Brett; Genden, Eric

2016-01-01

Oral cancer (OC) survivors experience debilitating side effects that affect their quality of life (QOL) and that of their caregivers. This study aimed to develop and evaluate a dyadic, web-based intervention to improve survivor self-management and survivor/caregiver QOL. A qualitative needs assessment (semi-structured interviews) with 13 OC survivors and 12 caregivers was conducted to discern information and support needs as well as preferences regarding website features and tools. Results using Grounded Theory analysis showed that OC survivors and caregivers: 1) want and need practical advice about managing side effects; 2) want to reach out to other survivors/caregivers for information and support; and, 3) have both overlapping and unique needs and preferences regarding website features. Usability testing (N=6 survivors; 5 caregivers) uncovered problems with the intuitiveness, navigation, and design of the website that were subsequently addressed. Users rated the website favorably on the dimensions of attractiveness, controllability, efficiency, intuitiveness, and learnability, and gave it a total usability score of 80/100. Overall, this study demonstrates that OC survivors and caregivers are interested in using an online program to improve QOL, and that providing tailored website content and features based on the person’s role as survivor or caregiver is important in this population. PMID:26507369

A Usability Study of Interactive Web-Based Modules

ERIC Educational Resources Information Center

Girard, Tulay; Pinar, Musa

2011-01-01

This research advances the understanding of the usability of marketing case study modules in the area of interactive web-based technologies through the assignment of seven interactive case modules in a Principles of Marketing course. The case modules were provided for marketing students by the publisher, McGraw Hill Irwin, of the…

Effectiveness and Usability of a Web-Based Mindfulness Intervention for Families Living with Mental Illness.

PubMed

Stjernswärd, Sigrid; Hansson, Lars

2017-01-01

Families living with mental illness express needs of support and experiences of burden that may affect their own health detrimentally and hence also their ability to support the patient. Mindfulness-based interventions have shown beneficial health effects in both clinical and healthy populations. The aim of the current study was to explore the effectiveness and usability of a web-based mindfulness program for families living with mental illness, which was first tested in a feasibility study. The study was designed as a randomized controlled trial with an experiment group and a wait-list control group with assessments on primary and secondary outcomes at baseline, post-intervention, and at a 3-month follow-up. Significant positive improvements in mindfulness and self-compassion, and significant decreases in perceived stress and in certain dimensions of caregiver burden were found, with good program usability. Easily accessible mindfulness-based interventions may be useful in addressing caregivers' needs of support and in preventing further ill health in caregivers. Further studies are needed, among others, to further customize interventions and to investigate the cost-effectiveness of such programs.

Assessment of diet and physical activity of brazilian schoolchildren: usability testing of a web-based questionnaire.

PubMed

da Costa, Filipe Ferreira; Schmoelz, Camilie Pacheco; Davies, Vanessa Fernandes; Di Pietro, Patrícia Faria; Kupek, Emil; de Assis, Maria Alice Altenburg

2013-08-19

Information and communication technology (ICT) has been used with increasing frequency for the assessment of diet and physical activity in health surveys. A number of Web-based questionnaires have been developed for children and adolescents. However, their usability characteristics have scarcely been reported, despite their potential importance for improving the feasibility and validity of ICT-based methods. The objective of this study was to describe the usability evaluation of the Consumo Alimentar e Atividade Física de Escolares (CAAFE) questionnaire (Food Consumption and Physical Activity Questionnaire for schoolchildren), a new Web-based survey tool for the self-assessment of diet and physical activity by schoolchildren. A total of 114 schoolchildren aged 6 to 12 years took part in questionnaire usability testing carried out in computer classrooms at five elementary schools in the city of Florianopolis, Brazil. Schoolchildren used a personal computer (PC) equipped with software for recording what is on the computer screen and the children's speech during usability testing. Quantitative and qualitative analyses took into account objective usability metrics such as error counts and time to complete a task. Data on the main difficulties in accomplishing the task and the level of satisfaction expressed by the children were assessed by the observers using a standardized form and interviews with the children. Descriptive statistics and content analysis were used to summarize both the quantitative and the qualitative aspects of the data obtained. The mean time for completing the questionnaire was 13.7 minutes (SD 3.68). Compared to the children in 2nd or 3rd grades, those in 4th or 5th grades spent less time completing the questionnaire (median 12.4 vs 13.3 minutes, P=.022), asked for help less frequently (median 0 vs 1.0 count, P=.005), had a lower error count (median 2.0 vs 8.0 count, P<.001), and obtained a higher overall performance score (median 73.0 vs 68.0, P=.005). Children with a PC at home spent less time completing the questionnaire (median 12.3 vs 14.9 minutes, P<.001), had a lower overall error count (median 2.0 vs 9.0 count, P=.03), and had a higher performance score (median 72.0 vs 64.0, P=.005) compared to the children without a PC at home. The most common difficulty in completing the questionnaire was in using the scroll bar. The majority of children reported a positive evaluation (liked a lot or liked) for the four design elements, which were evaluated. The results of the present study provided feedback to improve the final version of the CAAFE questionnaire. Quantitative data showed minor errors and system failures, while qualitative data indicated that, overall, the children enjoyed the CAAFE questionnaire. Grade levels and PC use must be taken into account in Web-based tools designed for children.

User experiences of evidence-based online resources for health professionals: User testing of The Cochrane Library

PubMed Central

Rosenbaum, Sarah E; Glenton, Claire; Cracknell, Jane

2008-01-01

Background Evidence-based decision making relies on easy access to trustworthy research results. The Cochrane Library is a key source of evidence about the effect of interventions and aims to "promote the accessibility of systematic reviews to anyone wanting to make a decision about health care". We explored how health professionals found, used and experienced The Library, looking at facets of user experience including findability, usability, usefulness, credibility, desirability and value. Methods We carried out 32 one-hour usability tests on participants from Norway and the UK. Participants both browsed freely and attempted to perform individually tailored tasks while "thinking aloud". Sessions were recorded and viewed in real time by researchers. Transcriptions and videos were reviewed by one researcher and one designer. Findings reported here reflect issues receiving a high degree of saturation and that we judge to be critical to the user experience of evidence-based web sites, based on principles for usability heuristics, web guidelines and evidence-based practice. Results Participants had much difficulty locating both the site and its contents. Non-native English speakers were at an extra disadvantage when retrieving relevant documents despite high levels of English-language skills. Many participants displayed feelings of ineptitude, alienation and frustration. Some made serious mistakes in correctly distinguishing between different information types, for instance reviews, review protocols, and individual studies. Although most expressed a high regard for the site's credibility, some later displayed a mistrust of the independence of the information. Others were overconfident, thinking everything on The Cochrane Library site shared the same level of quality approval. Conclusion Paradoxically, The Cochrane Library, established to support easy access to research evidence, has its own problems of accessibility. Health professionals' experiences of this and other evidence-based online resources can be improved by applying existing principles for web usability, prioritizing the development of simple search functionality, emitting "researcher" jargon, consistent marking of site ownership, and clear signposting of different document types and different content quality. PMID:18662382

Harnessing scientific literature reports for pharmacovigilance. Prototype software analytical tool development and usability testing.

PubMed

Sorbello, Alfred; Ripple, Anna; Tonning, Joseph; Munoz, Monica; Hasan, Rashedul; Ly, Thomas; Francis, Henry; Bodenreider, Olivier

2017-03-22

We seek to develop a prototype software analytical tool to augment FDA regulatory reviewers' capacity to harness scientific literature reports in PubMed/MEDLINE for pharmacovigilance and adverse drug event (ADE) safety signal detection. We also aim to gather feedback through usability testing to assess design, performance, and user satisfaction with the tool. A prototype, open source, web-based, software analytical tool generated statistical disproportionality data mining signal scores and dynamic visual analytics for ADE safety signal detection and management. We leveraged Medical Subject Heading (MeSH) indexing terms assigned to published citations in PubMed/MEDLINE to generate candidate drug-adverse event pairs for quantitative data mining. Six FDA regulatory reviewers participated in usability testing by employing the tool as part of their ongoing real-life pharmacovigilance activities to provide subjective feedback on its practical impact, added value, and fitness for use. All usability test participants cited the tool's ease of learning, ease of use, and generation of quantitative ADE safety signals, some of which corresponded to known established adverse drug reactions. Potential concerns included the comparability of the tool's automated literature search relative to a manual 'all fields' PubMed search, missing drugs and adverse event terms, interpretation of signal scores, and integration with existing computer-based analytical tools. Usability testing demonstrated that this novel tool can automate the detection of ADE safety signals from published literature reports. Various mitigation strategies are described to foster improvements in design, productivity, and end user satisfaction.

Engaging Stakeholders in the Development of an eHealth Intervention for Cancer Symptom Management for Rural Residents.

PubMed

Gilbertson-White, Stephanie; Yeung, Chi W; Saeidzadeh, Seyedehtanaz; Tykol, Hannah; Vikas, Praveen; Cannon, Ashley

2018-04-25

Late-stage cancer diagnoses disproportionately occur in rural residents, frequently resulting in increased need for symptom management support with minimal access to these services. Oncology Associated Symptoms and Individualized Strategies (OASIS) is an eHealth symptom self-management intervention that was developed to provide cancer symptom self-management support and address this disparity. To engage stakeholders about the symptom management needs and concerns of patients with advanced cancer living in rural areas. A 3-phased, mixed-methods design was used to (1) assess stakeholder needs and opinions; (2) develop a symptom self-management website; and (3) obtain usability feedback from potential users. Interviews with stakeholders (patients and clinic staff) from rural areas using a descriptive qualitative approach were analyzed; cross-cutting themes were identified; a symptom management web application was developed; and stakeholders completed a 12-item usability survey about the web application. Patients (n = 16) and clinical staff (n = 10) participated in phase 1. Three major themes were identified: "symptom experience," "symptom management," and "technology." Through an iterative process using these results and evidence from the literature, the OASIS web application was developed. Usability testing with N = 126 stakeholders demonstrated that the web application is easy to use, contains relevant content, and has pleasing graphics. No differences were found among patients, family/friends, and staff. Both frequent and infrequent internet users positively evaluated the web application.  CONCLUSIONS: Rural stakeholders report significant symptom management needs, are interested in eHealth technologies, and perceived OASIS positively. Future research is needed to evaluate the feasibility, acceptability, and efficacy of OASIS. © 2018 National Rural Health Association.

Examining Mathematical Task and Pedagogical Usability of Web Contents Authored by Prospective Mathematics Teachers

ERIC Educational Resources Information Center

Akayuure, Peter; Apawu, Jones

2015-01-01

The study was designed to engage prospective mathematics teachers in creating web learning modules. The aim was to examine the mathematical task and perceived pedagogical usability of the modules for mathematics instructions in Ghana. The study took place at University of Education, Winneba. Classes of 172 prospective mathematics teachers working…

Web-Based Teaching and Learning Approach (WBTLA) Usability in Institutions of Higher Learning in Malaysia

ERIC Educational Resources Information Center

Nordin, Abu Bakar; Alias, Norlidah

2013-01-01

Today teachers in schools and lecturers in institutions of higher learning are endowed with a wide range of new teaching experiences through web-based teaching and learning approaches (WBTLA), which was not possible before through the traditional classroom approach. With the use of WBTLA emerged problems related to usability in technical,…

Web Site Usability: A Case Study of Student Perceptions of Educational Web Sites

ERIC Educational Resources Information Center

Ballard, Joyce Kimberly

2010-01-01

The purpose of this research study was to understand the construct of usability from the perspective of 74 students enrolled in six online courses offered by one online and distance learning program at a large, public university in the Midwest. Six courses, designed and developed by two different groups, professional and nonprofessional…

Usability of a Web-Based School Experience System: Opinions of IT Teachers and Teacher Candidates

ERIC Educational Resources Information Center

Genç, Zülfü

2015-01-01

With advances in information and communication technologies, the classical nature of educational institutions has changed. One innovative effort within teacher training is the Web-Based School Experience System (WBSES) developed by the researcher. In this study, the usability of an existing WBSES is evaluated from both teachers' (n = 13) and…

Evaluating CSL/CFL Website Usability: A User-Centered Design Approach

ERIC Educational Resources Information Center

Huang, Chung-Kai; Hsin, Ching-O; Chiu, Chiung-Hui

2010-01-01

With the widespread availability of Internet and computer technology, on-line web-based learning has become prevalent in the field of teaching Chinese as a second/foreign language (CSL/CFL). This study examined the concepts of usability and types of design elements that help construct an effective web-based learning environment, as well as their…

A health literacy and usability heuristic evaluation of a mobile consumer health application.

PubMed

Monkman, Helen; Kushniruk, Andre

2013-01-01

Usability and health literacy are two critical factors in the design and evaluation of consumer health information systems. However, methods for evaluating these two factors in conjunction remain limited. This study adapted a set of existing guidelines for the design of consumer health Web sites into evidence-based evaluation heuristics tailored specifically for mobile consumer health applications. In order to test the approach, a mobile consumer health application (app) was then evaluated using these heuristics. In addition to revealing ways to improve the usability of the system, this analysis identified opportunities to augment the content to make it more understandable by users with limited health literacy. This study successfully demonstrated the utility of converting existing design guidelines into heuristics for the evaluation of usability and health literacy. The heuristics generated could be applied for assessing and revising other existing consumer health information systems.

Using health communication best practices to develop a web-based provider-patient communication aid: the CONNECT study.

PubMed

Fleisher, Linda; Buzaglo, Joanne; Collins, Michael; Millard, Jennifer; Miller, Suzanne M; Egleston, Brian L; Solarino, Nicholas; Trinastic, Jonathan; Cegala, Donald J; Benson, Al B; Schulman, Kevin A; Weinfurt, Kevin P; Sulmasy, Daniel; Diefenbach, Michael A; Meropol, Neal J

2008-06-01

Although there is broad consensus that careful content vetting and user testing is important in the development of technology-based educational interventions, often these steps are overlooked. This paper highlights the development of a theory-guided, web-based communication aid (CONNECT), designed to facilitate treatment decision-making among patients with advanced cancer. The communication aid included an on-line survey, patient skills training module and an automated physician report. Development steps included: (1) evidence-based content development; (2) usability testing; (3) pilot testing; and (4) patient utilization and satisfaction. Usability testing identified some confusing directions and navigation for the on-line survey and validated the relevance of the "patient testimonials" in the skills module. Preliminary satisfaction from the implementation of the communication aid showed that 66% found the survey length reasonable and 70% found it helpful in talking with the physician. Seventy percent reported the skills module helpful and about half found it affected the consultation. Designing patient education interventions for translation into practice requires the integration of health communication best practice including user feedback along the developmental process. This developmental process can be translated to a broad array of community-based patient and provider educational interventions.

Usability of a CKD Educational Website Targeted to Patients and Their Family Members

PubMed Central

Zuckerman, Marni; Fink, Wanda; Hu, Peter; Yang, Shiming; Fink, Jeffrey C.

2012-01-01

Summary Background and objectives Web-based technology is critical to the future of healthcare. As part of the Safe Kidney Care cohort study evaluating patient safety in CKD, this study determined how effectively a representative sample of patients with CKD or family members could interpret and use the Safe Kidney Care website (www.safekidneycare.org), an informational website on safety in CKD. Design, setting, participants, & measurements Between November of 2011 and January of 2012, persons with CKD or their family members underwent formal usability testing administered by a single interviewer with a second recording observer. Each participant was independently provided a list of 21 tasks to complete, with each task rated as either easily completed/noncritical error or critical error (user cannot complete the task without significant interviewer intervention). Results Twelve participants completed formal usability testing. Median completion time for all tasks was 17.5 minutes (range=10–44 minutes). In total, 10 participants had greater than or equal to one critical error. There were 55 critical errors in 252 tasks (22%), with the highest proportion of critical errors occurring when participants were asked to find information on treatments that may damage kidneys, find the website on the internet, increase font size, and scroll to the bottom of the webpage. Participants were generally satisfied with the content and usability of the website. Conclusions Web-based educational materials for patients with CKD should target a wide range of computer literacy levels and anticipate variability in competency in use of the computer and internet. PMID:22798537

Web-Based Intervention to Reduce Substance Abuse and Depressive Symptoms in Mexico: Development and Usability Test

PubMed Central

2016-01-01

Background The development of Web-based interventions for substance abuse in Latin America is a new field of interest with great potential for expansion to other Spanish-speaking countries. Objective This paper describes a project aimed to develop and evaluate the usability of the Web-based Help Program for Drug Abuse and Depression (Programa de Ayuda para Abuso de Drogas y Depresión, PAADD, in Spanish) and also to construct a systematic frame of reference for the development of future Web-based programs. Methods The PAADD aims to reduce substance use and depressive symptoms with cognitive behavioral techniques translated into Web applications, aided by the participation of a counselor to provide support and guidance. This Web-based intervention includes 4 steps: (1) My Starting Point, (2) Where Do I Want to Be? (3) Strategies for Change, and (4) Maintaining Change. The development of the program was an interactive multistage process. The first stage defined the core structure and contents, which were validated in stage 2 by a group of 8 experts in addiction treatment. Programming of the applications took place in stage 3, taking into account 3 types of end users: administrators, counselors, and substance users. Stage 4 consisted of functionality testing. In stage 5, a total of 9 health professionals and 20 drug users currently in treatment voluntarily interacted with the program in a usability test, providing feedback about adjustments needed to improve users’ experience. Results The main finding of stage 2 was the consensus of the health professionals about the cognitive behavioral strategies and techniques included in PAADD being appropriate for changing substance use behaviors. In stage 5, the health professionals found the functionalities easy to learn; their suggestions were related to the page layout, inclusion of confirmation messages at the end of activities, avoiding “read more” links, and providing feedback about every activity. On the other hand, the users said the information presented within the modules was easy to follow and suggested more dynamic features with concrete instructions and feedback. Conclusions The resulting Web-based program may have advantages over traditional face-to-face therapies owing to its low cost, wide accessibility, anonymity, and independence of time and distance factors. The detailed description of the process of designing a Web-based program is an important contribution to others interested in this field. The potential benefits must be verified in specific studies. Trial Registration International Standard Randomized Controlled Trial Number (ISRCTN): 25429892; http://www.controlled-trials.com/ISRCTN25429892 (Archived by WebCite at http://www.webcitation.org/6ko1Fsvym) PMID:27687965

Written online situational feedback via mobile phone to support self-management of chronic widespread pain: a usability study of a Web-based intervention

PubMed Central

2011-01-01

Background This pretrial study aimed to develop and test the usability of a four-week Internet intervention delivered by a Web-enabled mobile phone to support self-management of chronic widespread pain. Methods The intervention included daily online entries and individualized written feedback, grounded in a mindfulness-based cognitive behavioral approach. The participants registered activities, emotions and pain cognitions three times daily using the mobile device. The therapist had immediate access to this information through a secure Web site. The situational information was used to formulate and send a personalized text message to the participant with the aim of stimulating effective self-management of the current situation. Six women participated and evaluated the experience. Results The intervention was rated as supportive, meaningful and user-friendly by the majority of the women. The response rate to the daily registration entries was high and technical problems were few. Conclusion The results indicate a feasible intervention. Web-applications are fast becoming standard features of mobile phones and interventions of this kind can therefore be more available than before. Trial registration number ClinicalTrials.gov: NCT01236209 PMID:21352516

AISI/DOE Technology Roadmap Program: Development of Cost-effective, Energy-efficient Steel Framing

DOE Office of Scientific and Technical Information (OSTI.GOV)

Nader R. Elhajj

2003-01-06

Steel members in wall construction form a thermal bridge that interrupts the insulation layer of a wall. This causes higher rate of heat transfer by conduction through the wall framing than through other parts of the wall. One method to reduce the thermal bridging effect is to provide a break, such as insulating sheathing. A thermally efficient slit-web and stud was developed in this program to mitigate the conductivity of steel. The thermal performance of the slit-web stud was evaluated at Oak Ridge National Laboratory using hotbox testing. The thermal test results showed that the prototype slit-web stud performed 17%more » better than the solid-web stud, using R-13 fiber glass batts with exterior OSB sheathing and interior drywall. The structural behavior of this slit-web stud was evaluated in axial, bending, shear, shearwall, and stub-column tests. Test results indicated that the slitweb stud performed similarly or better than the solid-web stud in most structural performance characteristics investigated. Thus, the prototype slit-web stud has been shown to be thermally efficient, economiexecy viable, structurally sound, easily manufactured and usable in a range of residential installations.« less

A Survey and Empirical Study of Virtual Reference Service in Academic Libraries

ERIC Educational Resources Information Center

Mu, Xiangming; Dimitroff, Alexandra; Jordan, Jeanette; Burclaff, Natalie

2011-01-01

Virtual Reference Services (VRS) have high user satisfaction. The main problem is its low usage. We surveyed 100 academic library web sites to understand how VRS are presented. We then conducted a usability study to further test an active VRS model regarding its effectiveness.

Evaluation of the usability of a serious game aiming to teach facial expressions to schizophrenic patients.

PubMed

Isleyen, Filiz; Gulkesen, K Hakan; Cinemre, Buket; Samur, M Kemal; Zayim, Nese; Sen Kaya, Semiha

2014-01-01

In some psychological disorders such as autism and schizophrenia, loss of facial expression recognition skill may complicate patient's daily life. Information technology may help to develop facial expression recognition skill by educational software and games. We designed and developed an interactive web-based educational program with which we performed a usability study before investigating its effectiveness on the schizophrenia patients' ability of emotion perception. The purpose of this study is to describe the usability evaluation for a web-based game set that has been designed to teach facial expressions to schizophrenic patients. The usability study was done at two steps; first, we applied heuristic evaluation and the violations were rated in a scale from most to least severe and the major problems were solved. In the second step, think-aloud method was used and the web site was assessed by five schizophrenic patients. Eight experts participated in the heuristic evaluation, in which a total of 60 violations were identified with a mean severity of 2.77 (range: 0-4). All of the major problems (severity over 2.5) were listed and the usability problems were solved by the development team. After solving the problems, five users with a diagnosis of schizophrenia used the web site with the same scenario. They reported to have experienced minor, but different problems. In conclusion, we suggest that a combination of heuristic evaluation and think-aloud method may be an effective and efficient way for usability evaluations for the serious games that have been designed for special patient groups.

In the Loop: The Organization of Team-Based Communication in a Patient-Centered Clinical Collaboration System.

PubMed

Kurahashi, Allison M; Weinstein, Peter B; Jamieson, Trevor; Stinson, Jennifer N; Cafazzo, Joseph A; Lokuge, Bhadra; Morita, Plinio P; Cohen, Eyal; Rapoport, Adam; Bezjak, Andrea; Husain, Amna

2016-03-24

We describe the development and evaluation of a secure Web-based system for the purpose of collaborative care called Loop. Loop assembles the team of care with the patient as an integral member of the team in a secure space. The objectives of this paper are to present the iterative design of the separate views for health care providers (HCPs) within each patient's secure space and examine patients', caregivers', and HCPs' perspectives on this separate view for HCP-only communication. The overall research program includes cycles of ethnography, prototyping, usability testing, and pilot testing. This paper describes the usability testing phase that directly informed development. A descriptive qualitative approach was used to analyze participant perspectives that emerged during usability testing. During usability testing, we sampled 89 participants from three user groups: 23 patients, 19 caregivers, and 47 HCPs. Almost all perspectives from the three user groups supported the need for an HCP-only communication view. In an earlier prototype, the visual presentation caused confusion among HCPs when reading and composing messages about whether a message was visible to the patient. Usability testing guided us to design a more deliberate distinction between posting in the Patient and Team view and the Health Care Provider Only view at the time of composing a message, which once posted is distinguished by an icon. The team made a decision to incorporate an HCP-only communication view based on findings during earlier phases of work. During usability testing we tested the separate communication views, and all groups supported this partition. We spent considerable effort designing the partition; however, preliminary findings from the next phase of evaluation, pilot testing, show that the Patient and Team communication is predominantly being used. This demonstrates the importance of a subsequent phase of the clinical trial of Loop to validate the concept and design.

User value and usability of a web-based mindfulness intervention for families living with mental health problems.

PubMed

Stjernswärd, Sigrid; Hansson, Lars

2017-03-01

Mental health problems affect the patients and their families, who may also need therapeutic interventions. Mindfulness interventions have shown beneficial health effects for clinical and healthy populations. A web-based mindfulness intervention was tailored to address families' needs of support and tested in a pilot intervention study. The aim of this study was to explore the participants' experiences of using an 8-week web-based mindfulness programme in terms of user value and usability. Qualitative semi-structured interviews were carried out over the phone (Spring 2015, Sweden) with 15 randomly selected participants after the 3-month follow-up as part of the pilot study. Data were also collected through usability surveys online post intervention and at the 3-month follow-up. Qualitative data were analysed with content analysis and quantitative data with descriptive statistics. The analysis of the interviews resulted in four categories describing the participants' experiences of the programme's usability and value: A valuable and flexible tool that requires time and discipline, New perspective and coping strategies for an enhanced well-being, I'm important too - my limits, my responsibility, and Taming the inner critic. The programme's usability was satisfactory and largely corroborated by the surveys. The programme was experienced as a valuable tool to cope with stress in both private and professional contexts, making it a viable option to support families living with mental health problems. Time for self-care, a widened perspective, a less judgmental and more accepting attitude, deterring automatic reactions and setting limits helped the participants to deal with their situation and health. The programme's ease and flexibility of use were major advantages, although the training requires discipline. Motivators and barriers to use were illuminated, which should be considered in the development of further online services and study designs. © 2016 John Wiley & Sons Ltd.

Advanced Weather Awareness and Reporting Enhancements

NASA Technical Reports Server (NTRS)

Busquets, Anthony M. (Technical Monitor); Ruokangas, Corinne Clinton; Kelly, Wallace E., III

2005-01-01

AWARE (Aviation Weather Awareness and Reporting Enhancements) was a NASA Cooperative Research and Development program conducted jointly by Rockwell Scientific, Rockwell Collins, and NASA. The effort culminated in an enhanced weather briefing and reporting tool prototype designed to integrate graphical and text-based aviation weather data to provide clear situational awareness in the context of a specific pilot, flight and equipment profile. The initial implementation of AWARE was as a web-based preflight planning tool, specifically for general aviation pilots, who do not have access to support such as the dispatchers available for commercial airlines. Initial usability tests showed that for VFR (Visual Flight Rules) pilots, AWARE provided faster and more effective weather evaluation. In a subsequent formal usability test for IFR (Instrument Flight Rules) pilots, all users finished the AWARE tests faster than the parallel DUAT tests, and all subjects graded AWARE higher for effectiveness, efficiency, and usability. The decision analysis basis of AWARE differentiates it from other aviation safety programs, providing analysis of context-sensitive data in a personalized graphical format to aid pilots/dispatchers in their complex flight requirements.

Developing an Understanding of the Nature of Accessibility and Usability Problems Blind Students Face in Web-Enhanced Instruction Environments

ERIC Educational Resources Information Center

Babu, Rakesh

2011-01-01

The central premise of this research is that blind and visually impaired (BVI) people cannot use the Internet effectively due to accessibility and usability problems. Use of the Internet is indispensable in today's education system that relies on Web-enhanced instruction (WEI). Therefore, BVI students cannot participate effectively in WEI. Extant…

Better bioinformatics through usability analysis.

PubMed

Bolchini, Davide; Finkelstein, Anthony; Perrone, Vito; Nagl, Sylvia

2009-02-01

Improving the usability of bioinformatics resources enables researchers to find, interact with, share, compare and manipulate important information more effectively and efficiently. It thus enables researchers to gain improved insights into biological processes with the potential, ultimately, of yielding new scientific results. Usability 'barriers' can pose significant obstacles to a satisfactory user experience and force researchers to spend unnecessary time and effort to complete their tasks. The number of online biological databases available is growing and there is an expanding community of diverse users. In this context there is an increasing need to ensure the highest standards of usability. Using 'state-of-the-art' usability evaluation methods, we have identified and characterized a sample of usability issues potentially relevant to web bioinformatics resources, in general. These specifically concern the design of the navigation and search mechanisms available to the user. The usability issues we have discovered in our substantial case studies are undermining the ability of users to find the information they need in their daily research activities. In addition to characterizing these issues, specific recommendations for improvements are proposed leveraging proven practices from web and usability engineering. The methods and approach we exemplify can be readily adopted by the developers of bioinformatics resources.

The McMaster Optimal Aging Portal: Usability Evaluation of a Unique Evidence-Based Health Information Website.

PubMed

Barbara, Angela M; Dobbins, Maureen; Haynes, R Brian; Iorio, Alfonso; Lavis, John N; Raina, Parminder; Levinson, Anthony J

2016-05-11

Increasingly, older adults and their informal caregivers are using the Internet to search for health-related information. There is a proliferation of health information online, but the quality of this information varies, often based on exaggerated or dramatic findings, and not easily comprehended by consumers. The McMaster Optimal Aging Portal (Portal) was developed to provide Internet users with high-quality evidence about aging and address some of these current limitations of health information posted online. The Portal includes content for health professionals coming from three best-in-class resources (MacPLUS, Health Evidence, and Health Systems Evidence) and four types of content specifically prepared for the general public (Evidence Summaries, Web Resource Ratings, Blog Posts, and Twitter messages). Our objectives were to share the findings of the usability evaluation of the Portal with particular focus on the content features for the general public and to inform designers of health information websites and online resources for older adults about key usability themes. Data analysis included task performance during usability testing and qualitative content analyses of both the usability sessions and interviews to identify core themes. A total of 37 participants took part in 33 usability testing sessions and 21 focused interviews. Qualitative analysis revealed common themes regarding the Portal's strengths and challenges to usability. The strengths of the website were related to credibility, applicability, browsing function, design, and accessibility. The usability challenges included reluctance to register, process of registering, searching, terminology, and technical features. The study reinforced the importance of including end users during the development of this unique, dynamic, evidence-based health information website. The feedback was applied to iteratively improve website usability. Our findings can be applied by designers of health-related websites.

The McMaster Optimal Aging Portal: Usability Evaluation of a Unique Evidence-Based Health Information Website

PubMed Central

Dobbins, Maureen; Haynes, R. Brian; Iorio, Alfonso; Lavis, John N; Raina, Parminder

2016-01-01

Background Increasingly, older adults and their informal caregivers are using the Internet to search for health-related information. There is a proliferation of health information online, but the quality of this information varies, often based on exaggerated or dramatic findings, and not easily comprehended by consumers. The McMaster Optimal Aging Portal (Portal) was developed to provide Internet users with high-quality evidence about aging and address some of these current limitations of health information posted online. The Portal includes content for health professionals coming from three best-in-class resources (MacPLUS, Health Evidence, and Health Systems Evidence) and four types of content specifically prepared for the general public (Evidence Summaries, Web Resource Ratings, Blog Posts, and Twitter messages). Objective Our objectives were to share the findings of the usability evaluation of the Portal with particular focus on the content features for the general public and to inform designers of health information websites and online resources for older adults about key usability themes. Methods Data analysis included task performance during usability testing and qualitative content analyses of both the usability sessions and interviews to identify core themes. Results A total of 37 participants took part in 33 usability testing sessions and 21 focused interviews. Qualitative analysis revealed common themes regarding the Portal’s strengths and challenges to usability. The strengths of the website were related to credibility, applicability, browsing function, design, and accessibility. The usability challenges included reluctance to register, process of registering, searching, terminology, and technical features. Conclusions The study reinforced the importance of including end users during the development of this unique, dynamic, evidence-based health information website. The feedback was applied to iteratively improve website usability. Our findings can be applied by designers of health-related websites. PMID:27170443

Using participative inquiry in usability analysis to align a development team's mental model with its users' needs

NASA Technical Reports Server (NTRS)

Kneifel, A. A.; Guerrero, C.

2003-01-01

In this web site usability case study, two methods of participative inquiry are used to align a development team's objectives with their users' needs and to promote the team awareness of the benefit of qualitative usability analysis.

Usability factors of mobile health application for chronic diseases

NASA Astrophysics Data System (ADS)

Zahra, Fatima; Hussain, Azham; Mohd, Haslina

2016-08-01

M-health has changed the conventional delivery system of health-care, permitting continuous, pervasive Health-care anywhere, anytime. Chronic disease apps are increasing, as many health workers, patients and clinicians already embracing smartphones in their comprehensive and diverse practices. There are lots of challenges and requirements that need to be addressed for mobile health applications to prevent or eliminate design problems and minimize potential threats for users, the proposed factors for chronic disease mobile applications can be used as a guide for app developers While, the usability testing, and evaluations of chronic disease apps have not yet touched the accuracy level of other web based applications. This study is being conducted to learn about challenges of m-health apps and to identify the factors that affect the usability of such applications.

onlineDeCISion.org: a web-based decision aid for DCIS treatment.

PubMed

Ozanne, Elissa M; Schneider, Katharine H; Soeteman, Djøra; Stout, Natasha; Schrag, Deborah; Fordis, Michael; Punglia, Rinaa S

2015-11-01

Women diagnosed with DCIS face complex treatment decisions and often do so with inaccurate and incomplete understanding of the risks and benefits involved. Our objective was to create a tool to guide these decisions for both providers and patients. We developed a web-based decision aid designed to provide clinicians with tailored information about a patient’s recurrence risks and survival outcomes following different treatment strategies for DCIS. A theoretical framework, microsimulation model (Soeteman et al., J Natl Cancer 105:774–781, 2013) and best practices for web-based decision tools guided the development of the decision aid. The development process used semi-structured interviews and usability testing with key stakeholders, including a diverse group of multidisciplinary clinicians and a patient advocate. We developed onlineDeCISion.​org to include the following features that were rated as important by the stakeholders: (1) descriptions of each of the standard treatment options available; (2) visual projections of the likelihood of time-specific (10-year and lifetime) breast-preservation, recurrence, and survival outcomes; and (3) side-by-side comparisons of down-stream effects of each treatment choice. All clinicians reviewing the decision aid in usability testing were interested in using it in their clinical practice. The decision aid is available in a web-based format and is planned to be publicly available. To improve treatment decision making in patients with DCIS, we have developed a web-based decision aid onlineDeCISion.​org that conforms to best practices and that clinicians are interested in using in their clinics with patients to better inform treatment decisions.

Web-Based Intervention for Postpartum Depression: Formative Research and Design of the MomMoodBooster Program.

PubMed

Danaher, Brian G; Milgrom, Jeannette; Seeley, John R; Stuart, Scott; Schembri, Charlene; Tyler, Milagra S; Ericksen, Jennifer; Lester, Whitney; Gemmill, Alan W; Lewinsohn, Peter

2012-11-22

Postpartum depression is a significant public health problem affecting approximately 13% of women. There is strong evidence supporting Cognitive Behavioral Therapy (CBT) for successful psychosocial treatment. This treatment model combines cognitive and behavioral strategies to address pessimism, attributions for failure, low self-esteem, low engagement in pleasant activities, social withdrawal, anxiety, and low social support. Encouraging results have been reported for using Web-based CBT interventions for mental health domains, including the treatment of panic disorder, post-traumatic stress disorder, and complicated grief and depression. To date, however, Web-based interventions have not been used and evaluated specifically for the treatment of postpartum depression. We describe the formative work that contributed to the development of our Web-based intervention for helping to ameliorate symptoms of postpartum depression, and the design and key components of the program. A total of 17 focus group participants and 22 usability testers, who shared key characteristics with the participants of our planned feasibility study, took part. The proposed structure and ingredients of the program and mock-ups of selected webpages were presented to focus group participants. At various points, participants were asked a series of thought questions designed to elicit opinions and set the occasion for group discussion. At the end of the session, participants were asked to describe their overall reaction to the proposed features of the program emphasizing candid opinions about what they did not like and features they thought were missing and should be added. Usability testers were asked to interact with a series of seven different Web-based interactions planned for the program while receiving minimal direction. Each tester was asked to describe her thoughts using a think-aloud technique. They were then asked to consider all that they had learned about the program and complete the System Usability Scale that we adapted slightly to be appropriate for evaluating the proposed website. Transcripts from the focus groups and usability tests were reviewed by research team members for overarching themes with particular emphasis on suggested changes. A list emerged, and iterative and incremental adjustments were made as a result. The qualitative and quantitative data gathered in the focus groups and usability sessions reported here suggest that the new mothers involved had largely positive reactions to the major features of the program and that those program features performed well in terms of usability. An overview of the eventual design, architecture, and key program ingredients of the MomMoodBooster program is provided including innovative features supplementing 6 core CBT sessions, which include a partner's website, a library, and individual feedback by a personal coach.

TRAK App Suite: A Web-Based Intervention for Delivering Standard Care for the Rehabilitation of Knee Conditions.

PubMed

Spasić, Irena; Button, Kate; Divoli, Anna; Gupta, Satyam; Pataky, Tamas; Pizzocaro, Diego; Preece, Alun; van Deursen, Robert; Wilson, Chris

2015-10-16

Standard care for the rehabilitation of knee conditions involves exercise programs and information provision. Current methods of rehabilitation delivery struggle to keep up with large volumes of patients and the length of treatment required to maximize the recovery. Therefore, the development of novel interventions to support self-management is strongly recommended. Such interventions need to include information provision, goal setting, monitoring, feedback, and support groups, but the most effective methods of their delivery are poorly understood. The Internet provides a medium for intervention delivery with considerable potential for meeting these needs. The objective of this study was to demonstrate the feasibility of a Web-based app and to conduct a preliminary review of its practicability as part of a complex medical intervention in the rehabilitation of knee disorders. This paper describes the development, implementation, and usability of such an app. An interdisciplinary team of health care professionals and researchers, computer scientists, and app developers developed the TRAK app suite. The key functionality of the app includes information provision, a three-step exercise program based on a standard care for the rehabilitation of knee conditions, self-monitoring with visual feedback, and a virtual support group. There were two types of stakeholders (patients and physiotherapists) that were recruited for the usability study. The usability questionnaire was used to collect both qualitative and quantitative information on computer and Internet usage, task completion, and subjective user preferences. A total of 16 patients and 15 physiotherapists participated in the usability study. Based on the System Usability Scale, the TRAK app has higher perceived usability than 70% of systems. Both patients and physiotherapists agreed that the given Web-based approach would facilitate communication, provide information, help recall information, improve understanding, enable exercise progression, and support self-management in general. The Web app was found to be easy to use and user satisfaction was very high. The TRAK app suite can be accessed at http://apps.facebook.com/kneetrak/. The usability study suggests that a Web-based intervention is feasible and acceptable in supporting self-management of knee conditions.

TRAK App Suite: A Web-Based Intervention for Delivering Standard Care for the Rehabilitation of Knee Conditions

PubMed Central

Divoli, Anna; Gupta, Satyam; Pataky, Tamas; Pizzocaro, Diego; Preece, Alun; van Deursen, Robert; Wilson, Chris

2015-01-01

Background Standard care for the rehabilitation of knee conditions involves exercise programs and information provision. Current methods of rehabilitation delivery struggle to keep up with large volumes of patients and the length of treatment required to maximize the recovery. Therefore, the development of novel interventions to support self-management is strongly recommended. Such interventions need to include information provision, goal setting, monitoring, feedback, and support groups, but the most effective methods of their delivery are poorly understood. The Internet provides a medium for intervention delivery with considerable potential for meeting these needs. Objective The objective of this study was to demonstrate the feasibility of a Web-based app and to conduct a preliminary review of its practicability as part of a complex medical intervention in the rehabilitation of knee disorders. This paper describes the development, implementation, and usability of such an app. Methods An interdisciplinary team of health care professionals and researchers, computer scientists, and app developers developed the TRAK app suite. The key functionality of the app includes information provision, a three-step exercise program based on a standard care for the rehabilitation of knee conditions, self-monitoring with visual feedback, and a virtual support group. There were two types of stakeholders (patients and physiotherapists) that were recruited for the usability study. The usability questionnaire was used to collect both qualitative and quantitative information on computer and Internet usage, task completion, and subjective user preferences. Results A total of 16 patients and 15 physiotherapists participated in the usability study. Based on the System Usability Scale, the TRAK app has higher perceived usability than 70% of systems. Both patients and physiotherapists agreed that the given Web-based approach would facilitate communication, provide information, help recall information, improve understanding, enable exercise progression, and support self-management in general. The Web app was found to be easy to use and user satisfaction was very high. The TRAK app suite can be accessed at http://apps.facebook.com/kneetrak/. Conclusions The usability study suggests that a Web-based intervention is feasible and acceptable in supporting self-management of knee conditions. PMID:26474643

An experiment with content distribution methods in touchscreen mobile devices.

PubMed

Garcia-Lopez, Eva; Garcia-Cabot, Antonio; de-Marcos, Luis

2015-09-01

This paper compares the usability of three different content distribution methods (scrolling, paging and internal links) in touchscreen mobile devices as means to display web documents. Usability is operationalized in terms of effectiveness, efficiency and user satisfaction. These dimensions are then measured in an experiment (N = 23) in which users are required to find words in regular-length web documents. Results suggest that scrolling is statistically better in terms of efficiency and user satisfaction. It is also found to be more effective but results were not significant. Our findings are also compared with existing literature to propose the following guideline: "try to use vertical scrolling in web pages for mobile devices instead of paging or internal links, except when the content is too large, then paging is recommended". With an ever increasing number of touchscreen web-enabled mobile devices, this new guideline can be relevant for content developers targeting the mobile web as well as institutions trying to improve the usability of their content for mobile platforms. Copyright © 2015 Elsevier Ltd and The Ergonomics Society. All rights reserved.

Usability evaluation with mental health professionals and young people to develop an Internet-based cognitive-behaviour therapy program for adolescents with anxiety disorders.

PubMed

Wozney, Lori; Baxter, Pamela; Newton, Amanda S

2015-12-16

Use of the Internet to deliver cognitive behavioural therapy, a frontline treatment for anxiety disorders, is emerging as an option to increase access to treatment among adolescents with anxiety disorders. This study examined the usability of the Internet-based component of Breathe, a CBT program designed for adolescents with mild to moderate anxiety and impairments. A mixed-method usability testing design with semi-structured interviews, task completion, and survey by trained usability moderators was undertaken with two interactive cycles to determine the usability (ease of use, efficiency, errors, and user satisfaction) of the user interface and content areas of the program. Purposeful sampling was used to recruit mental health clinicians with expertise in treating adolescent anxiety disorders and young people aged 15 to 24 years involved. Testing involved using Web-conferencing software that allowed remote participation through personal computers. Two testing cycles involved participants completing structured 'think aloud' and 'cognitive walkthrough' tasks within the program. At the end of each cycle participants completed a 15-item global usability evaluation survey and were asked a series of open-ended questions. Descriptive and simple content analyses were used to identify and score usability issues for frequency and severity. Five clinicians and four young people (all < 20 years of age) participated. Most participants described their computer skills as 'good' (60% clinicians, 50% young people), and attitudes toward Internet-based health care ranged from negative (75% young people) to positive (60% clinicians, 25% young people). Scores from the global usability evaluation after both testing cycles ranged from 3.5 to 5 out of 5 in strong agreement/support of the program in terms of user performance indicators (i.e., learnability, efficiency and number of errors) and user satisfaction. Participants were able to complete all critical tasks with minimal errors. Errors and issues identified during testing were predominantly around enhancements to the visual design and navigational support. Opinions across usability elements did not differ between young people and clinician participants. A multi-method remote usability approach provided the opportunity to improve the technical interface, therapeutic messaging and user experience of an Internet-based treatment program for adolescent anxiety disorders.

Development of an Interactive Social Media Tool for Parents with Concerns about Vaccines

ERIC Educational Resources Information Center

Shoup, Jo Ann; Wagner, Nicole M.; Kraus, Courtney R.; Narwaney, Komal J.; Goddard, Kristin S.; Glanz, Jason M.

2015-01-01

Objective: Describe a process for designing, building, and evaluating a theory-driven social media intervention tool to help reduce parental concerns about vaccination. Method: We developed an interactive web-based tool using quantitative and qualitative methods (e.g., survey, focus groups, individual interviews, and usability testing). Results:…

Reliability, Validity, and Usability of Data Extraction Programs for Single-Case Research Designs.

PubMed

Moeyaert, Mariola; Maggin, Daniel; Verkuilen, Jay

2016-11-01

Single-case experimental designs (SCEDs) have been increasingly used in recent years to inform the development and validation of effective interventions in the behavioral sciences. An important aspect of this work has been the extension of meta-analytic and other statistical innovations to SCED data. Standard practice within SCED methods is to display data graphically, which requires subsequent users to extract the data, either manually or using data extraction programs. Previous research has examined issues of reliability and validity of data extraction programs in the past, but typically at an aggregate level. Little is known, however, about the coding of individual data points. We focused on four different software programs that can be used for this purpose (i.e., Ungraph, DataThief, WebPlotDigitizer, and XYit), and examined the reliability of numeric coding, the validity compared with real data, and overall program usability. This study indicates that the reliability and validity of the retrieved data are independent of the specific software program, but are dependent on the individual single-case study graphs. Differences were found in program usability in terms of user friendliness, data retrieval time, and license costs. Ungraph and WebPlotDigitizer received the highest usability scores. DataThief was perceived as unacceptable and the time needed to retrieve the data was double that of the other three programs. WebPlotDigitizer was the only program free to use. As a consequence, WebPlotDigitizer turned out to be the best option in terms of usability, time to retrieve the data, and costs, although the usability scores of Ungraph were also strong. © The Author(s) 2016.

An appraisal of published usability evaluations of electronic health records via systematic review.

PubMed

Ellsworth, Marc A; Dziadzko, Mikhail; O'Horo, John C; Farrell, Ann M; Zhang, Jiajie; Herasevich, Vitaly

2017-01-01

In this systematic review, we aimed to evaluate methodological and reporting trends present in the current literature by investigating published usability studies of electronic health records (EHRs). A literature search was conducted for articles published through January 2015 using MEDLINE (Ovid), EMBASE, Scopus, and Web of Science, supplemented by citation and reference list reviews. Studies were included if they tested the usability of hospital and clinic EHR systems in the inpatient, outpatient, emergency department, or operating room setting. A total of 4848 references were identified for title and abstract screening. Full text screening was performed for 197 articles, with 120 meeting the criteria for study inclusion. A review of the literature demonstrates a paucity of quality published studies describing scientifically valid and reproducible usability evaluations at various stages of EHR system development. A lack of formal and standardized reporting of EHR usability evaluation results is a major contributor to this knowledge gap, and efforts to improve this deficiency will be one step of moving the field of usability engineering forward. © The Author 2016. Published by Oxford University Press on behalf of the American Medical Informatics Association. All rights reserved. For Permissions, please email: journals.permissions@oup.com.

The Perceived Ease of Use and Usefulness of Loop: Evaluation and Content Analysis of a Web-Based Clinical Collaboration System

PubMed Central

Kurahashi, Allison M; Stinson, Jennifer N; van Wyk, Margaret; Luca, Stephanie; Jamieson, Trevor; Weinstein, Peter; Cafazzo, Joseph A; Lokuge, Bhadra; Cohen, Eyal; Rapoport, Adam

2018-01-01

Background Patients with complex health care needs require the expertise of many health care providers. Communication, collaboration, and patient-centered care positively impact care quality and patient outcomes. Few technologies exist that facilitate collaboration between providers across settings of care and also engage the patient. We developed a Web-based clinical collaboration system, Loop, to address this gap. The likelihood of a technological system’s uptake is associated with its perceived ease of use and perceived usefulness. We engaged stakeholders in the conceptualization and development of Loop in an effort to maximize its intuitiveness and utility. Objective This study aimed to report end users’ perceptions about the ease of use and usefulness of Loop captured during usability tests of Loop. Methods Participants represented three user types (patients, caregivers, and health care providers) recruited from three populations (adults with cancer, adolescents and young adults with cancer, and children with medical complexity). We conducted usability testing over three iterative cycles of testing and development in both laboratory-based and off-site environments. We performed a content analysis of usability testing transcripts to summarize and describe participant perceptions about the ease of use and usefulness of Loop. Results Participants enjoyed testing Loop and were able to use the core functions—composing, posting, and reading messages—with little difficulty. They had difficulty interpreting certain visual cues and design elements or the purpose of some features. This difficulty negatively impacted perceived ease of use but was primarily limited to auxiliary features. Participants predicted that Loop could improve the efficiency and effectiveness of communication between care team members; however, this perceived usefulness could be compromised by disruptions to personal workflow such as additional time or task requirements. Conclusions Loop was perceived to have value as a collaboration system; however, usability testing findings indicate that some design and functional elements need to be addressed to improve ease of use. Additionally, participant concerns highlight the need to consider how a system can be implemented so as to minimize impact on workflow and optimize usefulness. PMID:29317386

Feasibility of a Web-Based Self-Management Intervention for Intermittent Urinary Catheter Users with Spinal Cord Injury

PubMed Central

Wilde, Mary H.; McMahon, James M.; Fairbanks, Eileen; Brasch, Judith; Parshall, Robert; Zhang, Feng; Miner, Sarah; Thayer, Deborah; Schneiderman, Dan; Harrington, Brian

2016-01-01

Purpose The purpose of this study was to evaluate the feasibility of a new web-based intermittent catheter self-management intervention. Design We tested the acceptability and usability of intervention components, which included multiple web-based materials (an online urinary diary adapted for mobile phone use and an educational booklet), three phone calls with a nurse, and a peer led discussion forum. Subjects and setting Thirty adults with spinal cord injury using an intermittent catheter for bladder drainage were enrolled; 26 participants received the nurses’ phone based consultations. Methods Preliminary effectiveness of new self-efficacy and self-management scales were evaluated using baseline and three month online surveys. Participants’ perceived value of the intervention components, self-management changes, and suggestions were assessed with data from the three month surveys followed by brief tape-recorded interviews. Results Several catheter practices improved somewhat over three months including. The frequency of catheterizations every 4–6 hours increased from 71% to 77%. Self-management of neurogenic bladder dysfunction increased significantly (P= .032); participant comments indicated that fluid intake was the biggest change. Catheter related self-efficacy and quality of life scores increased. The frequency of urinary tract infection and pain did not change significantly. For feasibility, intervention components, with the exception of the forum, were rated highly by the majority of participants for usefulness, satisfaction (desired information), and web-based usability. Conclusion Further testing of this intervention is recommended in a multi-site randomized clinical trial. PMID:27488740

DADOS-Survey: an open-source application for CHERRIES-compliant Web surveys

PubMed Central

Shah, Anand; Jacobs, Danny O; Martins, Henrique; Harker, Matthew; Menezes, Andreia; McCready, Mariana; Pietrobon, Ricardo

2006-01-01

Background The Internet has been increasingly utilized in biomedical research. From online searching for literature to data sharing, the Internet has emerged as a primary means of research for many physicians and scientists. As a result, Web-based surveys have been employed as an alternative to traditional, paper-based surveys. We describe DADOS-Survey, an open-source Web-survey application developed at our institution that, to the best of our knowledge, is the first to be compliant with the Checklist for Reporting Results of Internet E-Surveys (CHERRIES). DADOS-Survey was designed with usability as a priority, allowing investigators to design and execute their own studies with minimal technical difficulties in doing so. Results To date, DADOS-Survey has been successfully implemented in five Institutional Review Board-approved studies conducted by various departments within our academic center. Each of these studies employed a Web-survey design as their primary methodology. Our initial experience indicates that DADOS-Survey has been used with relative ease by each of the investigators and survey recipients. This has been further demonstrated through formal and field usability testing, during which time suggestions for improvement were incorporated into the software design. Conclusion DADOS-Survey has the potential to have an important role in the future direction of Web-survey administration in biomedical research. This CHERRIES-compliant application is tailored to the emerging requirements of quality data collection in medicine. PMID:16978409

Quality of vascular surgery Web sites on the Internet.

PubMed

Grewal, Perbinder; Williams, Bryn; Alagaratnam, Swethan; Neffendorf, James; Soobrah, Ritish

2012-11-01

This study evaluated the readability, accessibility, usability, and reliability of vascular surgery information on the Internet in the English language. The Google, Yahoo, and MSN/Bing search engines were searched for "carotid endarterectomy," "EVAR or endovascular aneurysm repair," and "varicose veins or varicose veins surgery." The first 50 Web sites from each search engine for each topic were analyzed. The Flesch Reading Ease Score and Gunning Fog Index were calculated to assess readability. The LIDA tool (Minervation Ltd, Oxford, UK) was used to assess accessibility, usability, and reliability. The Web sites were difficult to read and comprehend. The mean Flesch Reading Ease scores were 53.53 for carotid endarterectomy, 50.53 for endovascular aneurysm repair, and 58.59 for varicose veins. The mean Gunning Fog Index scores were 12.3 for carotid endarterectomy, 12.12 for endovascular aneurysm repair, and 10.69 for varicose veins. The LIDA values for accessibility were good, but the results for usability and reliability were poor. Internet information on vascular surgical conditions and procedures is poorly written and unreliable. We suggest that health professionals should recommend Web sites that are easy to read and contain high-quality surgical information. Medical information on the Internet must be readable, accessible, usable, and reliable. Copyright © 2012 Society for Vascular Surgery. Published by Mosby, Inc. All rights reserved.

Usability and feasibility of health IT interventions to enhance Self-Care for Lymphedema Symptom Management in breast cancer survivors.

PubMed

Fu, Mei R; Axelrod, Deborah; Guth, Amber A; Wang, Yao; Scagliola, Joan; Hiotis, Karen; Rampertaap, Kavita; El-Shammaa, Nardin

2016-09-01

The-Optimal-Lymph-Flow health IT system (TOLF) is a patient-centered, web-and-mobile-based educational and behavioral health IT system focusing on safe, innovative, and pragmatic self-care strategies for lymphedema symptom management. The purpose of this study was to evaluate usability, feasibility, and acceptability of TOLF among the end-user of breast cancer survivors. Two types of usability testing were completed with 30 breast cancer survivors: heuristic evaluation and end-user testing. Each participant was asked to think aloud while completing a set of specified tasks designed to explicate and freely explore the system features. A heuristic evaluation checklist, the Perceived Ease of Use and Usefulness Questionnaire, and The Post Study System Usability Questionnaire were used to evaluate usability of the system. Open-ended questions were used to gather qualitative data. Quantitative data were analyzed using descriptive statistics and qualitative data were summarized thematically. Breast cancer survivors were very satisfied with the system: 90% (n = 27) rated the system having no usability problems; 10% (n = 3) noted minor cosmetic problems: spelling errors or text font size. The majority of participants 96.6% (n = 29) strongly agreed that the system was easy to use and effective in helping to learn about lymphedema, symptoms and self-care strategies. Themes from the qualitative data included empowerment, high quality information, loving avatar simulation videos, easy accessibility, and user-friendliness. This usability study provided evidence on breast cancer survivor's acceptance and highly positive evaluation of TOLF's usability as well as feasibility of using technologically-driven delivery model to enhance self-care strategies for lymphedema symptom management.

Health literacy and usability of clinical trial search engines.

PubMed

Utami, Dina; Bickmore, Timothy W; Barry, Barbara; Paasche-Orlow, Michael K

2014-01-01

Several web-based search engines have been developed to assist individuals to find clinical trials for which they may be interested in volunteering. However, these search engines may be difficult for individuals with low health and computer literacy to navigate. The authors present findings from a usability evaluation of clinical trial search tools with 41 participants across the health and computer literacy spectrum. The study consisted of 3 parts: (a) a usability study of an existing web-based clinical trial search tool; (b) a usability study of a keyword-based clinical trial search tool; and (c) an exploratory study investigating users' information needs when deciding among 2 or more candidate clinical trials. From the first 2 studies, the authors found that users with low health literacy have difficulty forming queries using keywords and have significantly more difficulty using a standard web-based clinical trial search tool compared with users with adequate health literacy. From the third study, the authors identified the search factors most important to individuals searching for clinical trials and how these varied by health literacy level.

Validation and testing of the Acceptability E-scale for Web-based patient-reported outcomes in cancer care

PubMed Central

Tariman, Joseph D.; Berry, Donna L.; Halpenny, Barbara; Wolpin, Seth; Schepp, Karen

2010-01-01

The performance of the Acceptability E-scale was tested in a sample of 627 adult and older adult patients from various oncology clinics who completed an electronic symptoms survey. The revised Acceptability E-scale has strong psychometric properties and can be useful in assessing the acceptability and usability of computerized health-related programs in oncology and other health population. PMID:20974066

Using Health Communication Best Practices to Develop a Web-Based Provider-Patient Communication Aid: The CONNECT™ Study

PubMed Central

Fleisher, Linda; Buzaglo, Joanne; Collins, Michael; Millard, Jennifer; Miller, Suzanne M.; Egleston, Brian L.; Solarino, Nicholas; Trinastic, Jonathan; Cegala, Donald J.; Benson, Al B.; Schulman, Kevin A.; Weinfurt, Kevin P.; Sulmasy, Daniel; Diefenbach, Michael A.; Meropol, Neal J.

2008-01-01

Objective Although there is broad consensus that careful content vetting and user testing is important in the development of technology-based educational interventions, often these steps are overlooked. This paper highlights the development of a theory-guided, web-based communication aid (CONNECT™), designed to facilitate treatment decision making among patients with advanced cancer. Methods The communication aid included an online survey, patient skills training module and an automated physician report. Development steps included: 1) evidence-based content development, 2) usability testing, 3) pilot testing, and 4) patient utilization and satisfaction. Results Usability testing identified some confusing directions and navigation for the on-line survey and validated the relevance of the “patient testimonials” in the skills module. Preliminary satisfaction from the implementation of the communication aid showed that 66% found the survey length reasonable and 70% found it helpful in talking with the physician. Seventy percent reported the skills module helpful and about half found it affected the consultation. Conclusion Designing patient education interventions for translation into practice requires the integration of health communication best practice including user feedback along the developmental process. Practice Implications This developmental process can be translated to a broad array of community based patient and provider educational interventions. PMID:18417312

Iconic hyperlinks on e-commerce websites.

PubMed

Cheng, Hong-In; Patterson, Patrick E

2007-01-01

The proper use of iconic interfaces reduces system complexity and helps users interact with systems more easily. However, due to carelessness, inadequate research, and the web's relatively short history, the icons used on web sites often are ambiguous. Because non-identifiable icons may convey meanings other than those intended, designers must consider whether icons are easily identifiable when creating web sites. In this study, visual icons used on e-business web sites were examined by population stereotypy and categorized into three groups: identifiable, medium, and vague. Representative icons from each group were tested by comparing selection performance in groups of student volunteers, with identifiable and medium icons improving performance. We found that only easily identifiable icons can reduce complexity and increase system usability.

Implementing Recommendations From Web Accessibility Guidelines: A Comparative Study of Nondisabled Users and Users With Visual Impairments.

PubMed

Schmutz, Sven; Sonderegger, Andreas; Sauer, Juergen

2017-09-01

The present study examined whether implementing recommendations of Web accessibility guidelines would have different effects on nondisabled users than on users with visual impairments. The predominant approach for making Web sites accessible for users with disabilities is to apply accessibility guidelines. However, it has been hardly examined whether this approach has side effects for nondisabled users. A comparison of the effects on both user groups would contribute to a better understanding of possible advantages and drawbacks of applying accessibility guidelines. Participants from two matched samples, comprising 55 participants with visual impairments and 55 without impairments, took part in a synchronous remote testing of a Web site. Each participant was randomly assigned to one of three Web sites, which differed in the level of accessibility (very low, low, and high) according to recommendations of the well-established Web Content Accessibility Guidelines 2.0 (WCAG 2.0). Performance (i.e., task completion rate and task completion time) and a range of subjective variables (i.e., perceived usability, positive affect, negative affect, perceived aesthetics, perceived workload, and user experience) were measured. Higher conformance to Web accessibility guidelines resulted in increased performance and more positive user ratings (e.g., perceived usability or aesthetics) for both user groups. There was no interaction between user group and accessibility level. Higher conformance to WCAG 2.0 may result in benefits for nondisabled users and users with visual impairments alike. Practitioners may use the present findings as a basis for deciding on whether and how to implement accessibility best.

Usability of patient-centered health IT: mixed-methods usability study of ePill.

PubMed

Schmidt-Kraepelin, Manuel; Dehling, Tobias; Sunyaev, Ali

2014-01-01

To facilitate use of patient-centered health IT applications in everyday life, a high degree of usability is required. Based on the example of a patient-centered web application, we propose a usability study design enabling developers and researchers to assess usability of patient-centered health IT applications and derive implications for their improvement. Our study design integrates tasks that subjects have to process, an associated questionnaire based on Perceived Ease of Use, Perceived Usefulness, Attitude Toward Using, and Behavioral Intention to Use, a System Usability Scale questionnaire, and focus groups. Application of the usability study design demonstrates its feasibility and provides insights for assessment of usability in related projects in research and practice.

75 FR 17204 - Submission for OMB Review; Comment Request

Federal Register 2010, 2011, 2012, 2013, 2014

2010-04-05

...--Application Website Content and Usability. Description: Information will be collected on a voluntary basis from new Treasury hires for the purpose of assessing the content and usability of the application Web...

The role of video technology in on-line lectures for the deaf.

PubMed

Debevc, Matjaz; Peljhan, Ziva

2004-09-02

The purpose of this paper is to determine the effectiveness of web-based video lectures on demand for the deaf in comparison to the traditional method of teaching using a sign language interpreter. The web-based lectures presented are specifically designed for the deaf in education and in rehabilitation. Sixty-three deaf students and adults were divided into four groups. All of the groups were made up of users who shared similar knowledge in the field of computers, but with different abilities in using computers, from beginners to advanced users. All of the groups were of mixed gender. The first two groups (consisting of 23 test users) graded the usability of the user interface for web-based lecture on demand with the help of the standardized SUMI questionnaire. After that, two groups (20 students from high school and 20 adults) joined in a 45-min informational program on the history of the deaf. Both groups were then divided into two smaller subgroups of 10 participants. The first subgroup in the first part of the learning program followed a traditional teaching style with the help of a teacher and an interpreter for Slovenian sign language. Meanwhile, the second group observed a 12-min web-based video lecture on demand and still had available an additional 18 min for a more detailed observation of the video. At the end of the lecture, the teacher used the questionnaire to review the participants' understanding of the content of the lecture in both of the groups. During the entire testing period, the interpreter used Slovenian sign language. By using the SUMI questionnaire, we determined the usability of the user interface for comprehension and gathering of knowledge. We discovered that the system was usable according to the standards. The global Median results (Global Median=51) were in the range of 50. In the second part of testing, we determined the level of significance between the traditional and web-based lectures. The results were statistically evaluated using the t-tests and the ANOVA test. From the t-tests we established the hypothesis that the number of correct answers for both groups (group 1: web-based, group 2: traditional) differed. The t-test used for the age groups rejected the hypothesis that the number of correct answers for both groups differed, where group 1 was comprised of adults and group 2 was comprised of students. Additionally, the ANOVA test showed that the number of correct answers for adults using traditional lectures differed significantly from the number of correct answers for both adult and student web-based users. The ANOVA test showed no differences between any of the remaining groups. We can conclude that for deaf people it is extremely important to introduce the use of information and communications technology on all levels of education and rehabilitation. This increases their ability to learn and improves their understanding of learning materials, especially if the applications are designed specifically for their needs. Through daily exposure to a larger number of such materials, we can positively influence the literacy (reading and writing skills) of the deaf. With increased literacy, the deaf would be able to read literature, and subtitles, enabling them to receive information through written sources. Therefore, we can expect them to have a higher self-esteem, more easily integrate into society and have more opportunities for employment.

Technology Review: Website Usability Testing Software-Improving User Experience and Satisfaction with Community College Websites

ERIC Educational Resources Information Center

Dishman, Marcie

2015-01-01

The Internet is a critical tool for higher education institutions as they rely upon their web presence for interaction with multiple stakeholders, including current and prospective students, parents, faculty and staff, and the community (Hong & Kiousis, 2007). As colleges count upon their websites to serve as the primary medium for presenting…

Web Site Usability Testing Involving People with Learning Disabilities Using Only Images and Audio to Access Information

ERIC Educational Resources Information Center

Williams, Peter

2013-01-01

The need for social inclusion, informed choice and the facilitation of independent living for people with learning disabilities (LD) is being emphasised ever more by government, professionals, academics and, indeed, by people with LD themselves, particularly in self-advocacy groups. Achieving goals around inclusion and autonomy requires access to…

The North Carolina State University Libraries Search Experience: Usability Testing Tabbed Search Interfaces for Academic Libraries

ERIC Educational Resources Information Center

Teague-Rector, Susan; Ballard, Angela; Pauley, Susan K.

2011-01-01

Creating a learnable, effective, and user-friendly library Web site hinges on providing easy access to search. Designing a search interface for academic libraries can be particularly challenging given the complexity and range of searchable library collections, such as bibliographic databases, electronic journals, and article search silos. Library…

Developing a Web Platform to Support a Community of Practice: A Mixed Methods Study in Pediatric Physiotherapy.

PubMed

Pratte, Gabrielle; Hurtubise, Karen; Rivard, Lisa; Berbari, Jade; Camden, Chantal

2018-01-01

Web platforms are increasingly used to support virtual interactions between members of communities of practice (CoP). However, little is known about how to develop these platforms to support the implementation of best practices for health care professionals. The aim of this article is to explore pediatric physiotherapists' (PTs) perspectives regarding the utility and usability of the characteristic of a web platform developed to support virtual communities of practice (vCoP). This study adopted an explanatory sequential mixed methods design. A web platform supporting the interactions of vCoP members was developed for PTs working with children with developmental coordination disorder. Specific strategies and features were created to support the effectiveness of the platform across three domains: social, information-quality, and system-quality factors. Quantitative data were collected from a cross-sectional survey (n = 41) after 5 months of access to the web platform. Descriptive statistics were calculated. Qualitative data were also collected from semistructured interviews (n = 9), which were coded, interpreted, and analyzed by using Boucher's Web Ergonomics Conceptual Framework. The utility of web platform characteristics targeting the three key domain factors were generally perceived positively by PTs. However, web platform usability issues were noted by PTs, including problems with navigation and information retrieval. Web platform aiming to support vCoP should be carefully developed to target potential users' needs. Whenever possible, users should co-construct the web platform with vCoP developers. Moreover, each of the developed characteristics (eg, newsletter, search function) should be evaluated in terms of utility and usability for the users.

Development of a Web-based Family Intervention for BRCA Carriers and Their Biological Relatives: Acceptability, Feasibility, and Usability Study.

PubMed

Katapodi, Maria C; Jung, Miyeon; Schafenacker, Ann M; Milliron, Kara J; Mendelsohn-Victor, Kari E; Merajver, Sofia D; Northouse, Laurel L

2018-04-13

Carriers of breast cancer gene (BRCA) mutations are asked to communicate genetic test results to their biological relatives to increase awareness of cancer risk and promote use of genetic services. This process is highly variable from family to family. Interventions that support communication of genetic test results, coping, and offer decision support in families harboring a pathogenic variant may contribute to effective management of hereditary cancer. The aim of this paper was to describe the development of the Family Gene Toolkit, a Web-based intervention targeting BRCA carriers and untested blood relatives, designed to enhance coping, family communication, and decision making. We present findings from focus groups regarding intervention acceptability and participant satisfaction and from a pre-post pilot study with random allocation to a wait-listed control group regarding intervention feasibility and usability. The Family Gene Toolkit was developed by a multidisciplinary team as a psycho-educational and skills-building intervention. It includes two live webinar sessions and a follow-up phone call guided by a certified genetic counselor and a master's prepared oncology nurse. Each live webinar includes two modules (total four modules) presenting information about BRCA mutations, a decision aid for genetic testing, and two skill-building modules for effective coping and family communication. Participants in focus groups (n=11) were highly satisfied with the intervention, reporting it to be useful and describing clearly the important issues. From the 12 dyads recruited in the pre-post pilot study (response rate 12/52, 23%), completion rate was 71% (10/14) for intervention and 40% (4/10) for wait-listed control groups. Acceptability and satisfaction with the Family Gene Toolkit is high. On the basis of the findings from usability and feasibility testing, modifications on timing, delivery mode, and recruitment methods have been implemented. ClinicalTrials.gov NCT02154633; https://clinicaltrials.gov/ct2/show/NCT02154633 (Archived by WebCite at http://www.webcitation.org/6yYNvLPjv). ©Maria C Katapodi, Miyeon Jung, Ann M Schafenacker, Kara J Milliron, Kari E Mendelsohn-Victor, Sofia D Merajver, Laurel L Northouse. Originally published in JMIR Cancer (http://cancer.jmir.org), 13.04.2018.

Development and evaluation of a web-based application for digital findings and documentation in physiotherapy education.

PubMed

Spieler, Bernadette; Burgsteiner, Harald; Messer-Misak, Karin; Gödl-Purrer, Barbara; Salchinger, Beate

2015-01-01

Findings in physiotherapy have standardized approaches in treatment, but there is also a significant margin of differences in how to implement these standards. Clinical decisions require experience and continuous learning processes to consolidate personal values and opinions and studies suggest that lecturers can influence students positively. Recently, the study course of Physiotherapy at the University of Applied Science in Graz has offered a paper based finding document. This document supported decisions through the adaption of the clinical reasoning process. The document was the starting point for our learning application called "EasyAssess", a Java based web-application for a digital findings documentation. A central point of our work was to ensure efficiency, effectiveness and usability of the web-application through usability tests utilized by both students and lecturers. Results show that our application fulfills the previously defined requirements and can be efficiently used in daily routine largely because of its simple user interface and its modest design. Due to the close cooperation with the study course Physiotherapy, the application has incorporated the various needs of the target audiences and confirmed the usefulness of our application.

Usability evaluation and adaptation of the e-health Personal Patient Profile-Prostate decision aid for Spanish-speaking Latino men.

PubMed

Berry, Donna L; Halpenny, Barbara; Bosco, Jaclyn L F; Bruyere, John; Sanda, Martin G

2015-07-24

The Personal Patient Profile-Prostate (P3P), a web-based decision aid, was demonstrated to reduce decisional conflict in English-speaking men with localized prostate cancer early after initial diagnosis. The purpose of this study was to explore and enhance usability and cultural appropriateness of a Spanish P3P by Latino men with a diagnosis of prostate cancer. P3P was translated to Spanish and back-translated by three native Spanish-speaking translators working independently. Spanish-speaking Latino men with a diagnosis of localized prostate cancer, who had made treatment decisions in the past 24 months, were recruited from two urban clinical care sites. Individual cognitive interviews were conducted by two bilingual research assistants as each participant used the Spanish P3P. Notes of user behavior, feedback, and answers to direct questions about comprehension, usability and perceived usefulness were analyzed and categorized. Seven participants with a range of education levels identified 25 unique usability issues in navigation, content comprehension and completeness, sociocultural appropriateness, and methodology. Revisions were prioritized to refine the usability and cultural and linguistic appropriateness of the decision aid. Usability issues were discovered that are potential barriers to effective decision support. Successful use of decision aids requires adaptation and testing beyond translation. Our findings led to revisions further refining the usability and linguistic and cultural appropriateness of Spanish P3P.

BIOSMILE web search: a web application for annotating biomedical entities and relations.

PubMed

Dai, Hong-Jie; Huang, Chi-Hsin; Lin, Ryan T K; Tsai, Richard Tzong-Han; Hsu, Wen-Lian

2008-07-01

BIOSMILE web search (BWS), a web-based NCBI-PubMed search application, which can analyze articles for selected biomedical verbs and give users relational information, such as subject, object, location, manner, time, etc. After receiving keyword query input, BWS retrieves matching PubMed abstracts and lists them along with snippets by order of relevancy to protein-protein interaction. Users can then select articles for further analysis, and BWS will find and mark up biomedical relations in the text. The analysis results can be viewed in the abstract text or in table form. To date, BWS has been field tested by over 30 biologists and questionnaires have shown that subjects are highly satisfied with its capabilities and usability. BWS is accessible free of charge at http://bioservices.cse.yzu.edu.tw/BWS.

Developing and Validation a Usability Evaluation Tools for Distance Education Websites: Persian Version

ERIC Educational Resources Information Center

Hafezi, Soheila; Farahi, Ahmad; Mehri, Soheil Najafi; Mahmoodi, Hosein

2010-01-01

The web is playing a central role in distance education. The word "usability" is usually synonymous with functionality of the system for the user. Also, usability of a website is defined as something that can be used by a specific group of people to carry out specific objectives in an effective way, with efficiency and satisfaction.…

Editing Wikipedia content by screen reader: easier interaction with the Accessible Rich Internet Applications suite.

PubMed

Buzzi, Marina; Leporini, Barbara

2009-07-01

This study aims to improve Wikipedia usability for the blind and promote the application of standards relating to Web accessibility and usability. First, accessibility and usability of Wikipedia home, search result and edit pages are analysed using the JAWS screen reader; next, suggestions for improving interaction are proposed and a new Wikipedia editing interface built. Most of the improvements were obtained using the Accessible Rich Internet Applications (WAI-ARIA) suite, developed by the World Wide Web Consortium (W3C) within the framework of the Web Accessibility Initiative (WAI). Last, a scenario of use compares interaction of blind people with the original and the modified interfaces. Our study highlights that although all contents are accessible via screen reader, usability issues exist due to the user's difficulties when interacting with the interface. The scenario of use shows how building an editing interface with the W3C WAI-ARIA suite eliminates many obstacles that can prevent blind users from actively contributing to Wikipedia. The modified Wikipedia editing page is simpler to use via a screen reader than the original one because ARIA ensures a page overview, rapid navigation, and total control of what is happening in the interface.

Development and usability testing of a web-based cancer symptom and quality-of-life support intervention.

PubMed

Wolpin, S E; Halpenny, B; Whitman, G; McReynolds, J; Stewart, M; Lober, W B; Berry, D L

2015-03-01

The feasibility and acceptability of computerized screening and patient-reported outcome measures have been demonstrated in the literature. However, patient-centered management of health information entails two challenges: gathering and presenting data using "patient-tailored" methods and supporting "patient-control" of health information. The design and development of many symptom and quality-of-life information systems have not included opportunities for systematically collecting and analyzing user input. As part of a larger clinical trial, the Electronic Self-Report Assessment for Cancer-II project, participatory design approaches were used to build and test new features and interfaces for patient/caregiver users. The research questions centered on patient/caregiver preferences with regard to the following: (a) content, (b) user interface needs, (c) patient-oriented summary, and (d) patient-controlled sharing of information with family, caregivers, and clinicians. Mixed methods were used with an emphasis on qualitative approaches; focus groups and individual usability tests were the primary research methods. Focus group data were content analyzed, while individual usability sessions were assessed with both qualitative and quantitative methods. We identified 12 key patient/caregiver preferences through focus groups with 6 participants. We implemented seven of these preferences during the iterative design process. We deferred development for some of the preferences due to resource constraints. During individual usability testing (n = 8), we were able to identify 65 usability issues ranging from minor user confusion to critical errors that blocked task completion. The participatory development model that we used led to features and design revisions that were patient centered. We are currently evaluating new approaches for the application interface and for future research pathways. We encourage other researchers to adopt user-centered design approaches when building patient-centered technologies. © The Author(s) 2014.

Harnessing Scientific Literature Reports for Pharmacovigilance

PubMed Central

Ripple, Anna; Tonning, Joseph; Munoz, Monica; Hasan, Rashedul; Ly, Thomas; Francis, Henry; Bodenreider, Olivier

2017-01-01

Summary Objectives We seek to develop a prototype software analytical tool to augment FDA regulatory reviewers’ capacity to harness scientific literature reports in PubMed/MEDLINE for pharmacovigilance and adverse drug event (ADE) safety signal detection. We also aim to gather feedback through usability testing to assess design, performance, and user satisfaction with the tool. Methods A prototype, open source, web-based, software analytical tool generated statistical disproportionality data mining signal scores and dynamic visual analytics for ADE safety signal detection and management. We leveraged Medical Subject Heading (MeSH) indexing terms assigned to published citations in PubMed/MEDLINE to generate candidate drug-adverse event pairs for quantitative data mining. Six FDA regulatory reviewers participated in usability testing by employing the tool as part of their ongoing real-life pharmacovigilance activities to provide subjective feedback on its practical impact, added value, and fitness for use. Results All usability test participants cited the tool’s ease of learning, ease of use, and generation of quantitative ADE safety signals, some of which corresponded to known established adverse drug reactions. Potential concerns included the comparability of the tool’s automated literature search relative to a manual ‘all fields’ PubMed search, missing drugs and adverse event terms, interpretation of signal scores, and integration with existing computer-based analytical tools. Conclusions Usability testing demonstrated that this novel tool can automate the detection of ADE safety signals from published literature reports. Various mitigation strategies are described to foster improvements in design, productivity, and end user satisfaction. PMID:28326432

Comprehensive verticality analysis and web-based rehabilitation system for people with multiple sclerosis with supervised medical monitoring.

PubMed

Eguiluz-Perez, Gonzalo; Garcia-Zapirain, Begonya

2014-01-01

People with Multiple Sclerosis (MS) need regular physical activities along with medical treatment despite their ability or disability level. However, poorly performed exercises could aggravate muscle imbalances and worsen their health. The goal of our work is to create a comprehensive system, encompassing a face-to-face sessions performed by MS patients one day a week at the medical center with exercises at home the rest of the week through a web platform in combination with a tracking tool to analyze the position of patients during exercise and correct them in real-time. The whole system is currently testing during six months with ten participants, five persons with MS and 5 professionals related with MS. Two tests, the Functional Independence Measure and the Berg Balance Scale will be act as a barometer for measuring the degree of independence obtained by the people with MS and also the validity of the whole system as a rehabilitation tool. Preliminary results about the usability of the system using SUS scale, 72 and 76 points over 100 (patients and professionals respectively), demonstrate that our system is usable for both patients and professionals.

Duke Surgery Research Central: an open-source Web application for the improvement of compliance with research regulation.

PubMed

Pietrobon, Ricardo; Shah, Anand; Kuo, Paul; Harker, Matthew; McCready, Mariana; Butler, Christeen; Martins, Henrique; Moorman, C T; Jacobs, Danny O

2006-07-27

Although regulatory compliance in academic research is enforced by law to ensure high quality and safety to participants, its implementation is frequently hindered by cost and logistical barriers. In order to decrease these barriers, we have developed a Web-based application, Duke Surgery Research Central (DSRC), to monitor and streamline the regulatory research process. The main objective of DSRC is to streamline regulatory research processes. The application was built using a combination of paper prototyping for system requirements and Java as the primary language for the application, in conjunction with the Model-View-Controller design model. The researcher interface was designed for simplicity so that it could be used by individuals with different computer literacy levels. Analogously, the administrator interface was designed with functionality as its primary goal. DSRC facilitates the exchange of regulatory documents between researchers and research administrators, allowing for tasks to be tracked and documents to be stored in a Web environment accessible from an Intranet. Usability was evaluated using formal usability tests and field observations. Formal usability results demonstrated that DSRC presented good speed, was easy to learn and use, had a functionality that was easily understandable, and a navigation that was intuitive. Additional features implemented upon request by initial users included: extensive variable categorization (in contrast with data capture using free text), searching capabilities to improve how research administrators could search an extensive number of researcher names, warning messages before critical tasks were performed (such as deleting a task), and confirmatory e-mails for critical tasks (such as completing a regulatory task). The current version of DSRC was shown to have excellent overall usability properties in handling research regulatory issues. It is hoped that its release as an open-source application will promote improved and streamlined regulatory processes for individual academic centers as well as larger research networks.

Duke Surgery Research Central: an open-source Web application for the improvement of compliance with research regulation

PubMed Central

Pietrobon, Ricardo; Shah, Anand; Kuo, Paul; Harker, Matthew; McCready, Mariana; Butler, Christeen; Martins, Henrique; Moorman, CT; Jacobs, Danny O

2006-01-01

Background Although regulatory compliance in academic research is enforced by law to ensure high quality and safety to participants, its implementation is frequently hindered by cost and logistical barriers. In order to decrease these barriers, we have developed a Web-based application, Duke Surgery Research Central (DSRC), to monitor and streamline the regulatory research process. Results The main objective of DSRC is to streamline regulatory research processes. The application was built using a combination of paper prototyping for system requirements and Java as the primary language for the application, in conjunction with the Model-View-Controller design model. The researcher interface was designed for simplicity so that it could be used by individuals with different computer literacy levels. Analogously, the administrator interface was designed with functionality as its primary goal. DSRC facilitates the exchange of regulatory documents between researchers and research administrators, allowing for tasks to be tracked and documents to be stored in a Web environment accessible from an Intranet. Usability was evaluated using formal usability tests and field observations. Formal usability results demonstrated that DSRC presented good speed, was easy to learn and use, had a functionality that was easily understandable, and a navigation that was intuitive. Additional features implemented upon request by initial users included: extensive variable categorization (in contrast with data capture using free text), searching capabilities to improve how research administrators could search an extensive number of researcher names, warning messages before critical tasks were performed (such as deleting a task), and confirmatory e-mails for critical tasks (such as completing a regulatory task). Conclusion The current version of DSRC was shown to have excellent overall usability properties in handling research regulatory issues. It is hoped that its release as an open-source application will promote improved and streamlined regulatory processes for individual academic centers as well as larger research networks. PMID:16872540

Development of an interactive social media tool for parents with concerns about vaccines.

PubMed

Shoup, Jo Ann; Wagner, Nicole M; Kraus, Courtney R; Narwaney, Komal J; Goddard, Kristin S; Glanz, Jason M

2015-06-01

Describe a process for designing, building, and evaluating a theory-driven social media intervention tool to help reduce parental concerns about vaccination. We developed an interactive web-based tool using quantitative and qualitative methods (e.g., survey, focus groups, individual interviews, and usability testing). Survey results suggested that social media may represent an effective intervention tool to help parents make informed decisions about vaccination for their children. Focus groups and interviews revealed four main themes for development of the tool: Parents wanted information describing both benefits and risks of vaccination, transparency of sources of information, moderation of the tool by an expert, and ethnic and racial diversity in the visual display of people. Usability testing showed that parents were satisfied with the usability of the tool but had difficulty with performing some of the informational searches. Based on focus groups, interviews, and usability evaluations, we made additional revisions to the tool's content, design, functionality, and overall look and feel. Engaging parents at all stages of development is critical when designing a tool to address concerns about childhood vaccines. Although this can be both resource- and time-intensive, the redesigned tool is more likely to be accepted and used by parents. Next steps involve a formal evaluation through a randomized trial. © 2014 Society for Public Health Education.

Knowledge management impact of information technology Web 2.0/3.0. The case study of agent software technology usability in knowledge management system

NASA Astrophysics Data System (ADS)

Sołtysik-Piorunkiewicz, Anna

2015-02-01

How we can measure the impact of internet technology Web 2.0/3.0 for knowledge management? How we can use the Web 2.0/3.0 technologies for generating, evaluating, sharing, organizing knowledge in knowledge-based organization? How we can evaluate it from user-centered perspective? Article aims to provide a method for evaluate the usability of web technologies to support knowledge management in knowledge-based organizations of the various stages of the cycle knowledge management, taking into account: generating knowledge, evaluating knowledge, sharing knowledge, etc. for the modern Internet technologies based on the example of agent technologies. The method focuses on five areas of evaluation: GUI, functional structure, the way of content publication, organizational aspect, technological aspect. The method is based on the proposed indicators relating respectively to assess specific areas of evaluation, taking into account the individual characteristics of the scoring. Each of the features identified in the evaluation is judged first point wise, then this score is subject to verification and clarification by means of appropriate indicators of a given feature. The article proposes appropriate indicators to measure the impact of Web 2.0/3.0 technologies for knowledge management and verification them in an example of agent technology usability in knowledge management system.

A Grounded Theory Approach to Examining Design and Usability Guidelines for Four-Year Tribal College Web Sites

ERIC Educational Resources Information Center

Broberg, Loretta L.

2011-01-01

With the increasing awareness of design and usability issues in regards to websites, in this case tribal college websites, there is an increasing desire to have a set of guidelines to assist in determining design and usability for academic websites. Though there is an overwhelming amount of information available to researchers in this subject area…

Web-Based Cognitive Behavioral Relapse Prevention Program With Tailored Feedback for People With Methamphetamine and Other Drug Use Problems: Development and Usability Study.

PubMed

Takano, Ayumi; Miyamoto, Yuki; Kawakami, Norito; Matsumoto, Toshihiko

2016-01-06

Although drug abuse has been a serious public health concern, there have been problems with implementation of treatment for drug users in Japan because of poor accessibility to treatment, concerns about stigma and confidentiality, and costs. Therapeutic interventions using the Internet and computer technologies could improve this situation and provide more feasible and acceptable approaches. The objective of the study was to show how we developed a pilot version of a new Web-based cognitive behavioral relapse prevention program with tailored feedback to assist people with drug problems and assessed its acceptance and usability. We developed the pilot program based on existing face-to-face relapse prevention approaches using an open source Web application to build an e-learning website, including relapse prevention sessions with videos, exercises, a diary function, and self-monitoring. When users submitted exercise answers and their diary, researchers provided them with personalized feedback comments using motivational interviewing skills. People diagnosed with drug dependence were recruited in this pilot study from a psychiatric outpatient ward and nonprofit rehabilitation facilities and usability was evaluated using Internet questionnaires. Overall, website usability was assessed by the Web Usability Scale. The adequacy of procedures in the program, ease of use, helpfulness of content, and adverse effects, for example, drug craving, mental distress, were assessed by original structured questionnaires and descriptive form questions. In total, 10 people participated in the study and completed the baseline assessment, 60% completed all relapse prevention sessions within the expected period. The time needed to complete one session was about 60 minutes and most of the participants took 2 days to complete the session. Overall website usability was good, with reasonable scores on subscales of the Web Usability Scale. The participants felt that the relapse prevention sessions were easy to use and helpful, but that the length of the videos was too long. The participant who until recently used drugs was satisfied with the self-monitoring, but others that had already maintained abstinence for more than a year felt this activity was unhelpful and were bored tracking and recording information on daily drug use. Feedback comments from researchers enhanced participants' motivation and further insight into the disease. Serious adverse effects caused by the intervention were not observed. Some possible improvements to the program were suggested. The Web-based relapse prevention program was easy to use and acceptable to drug users in this study. This program will be helpful for drug users who do not receive behavioral therapy. After the pilot program is revised, further large-scale research is needed to assess its efficacy among drug users who have recently used drugs.

Simple Web-based interactive key development software (WEBiKEY) and an example key for Kuruna (Poaceae: Bambusoideae).

PubMed

Attigala, Lakshmi; De Silva, Nuwan I; Clark, Lynn G

2016-04-01

Programs that are user-friendly and freely available for developing Web-based interactive keys are scarce and most of the well-structured applications are relatively expensive. WEBiKEY was developed to enable researchers to easily develop their own Web-based interactive keys with fewer resources. A Web-based multiaccess identification tool (WEBiKEY) was developed that uses freely available Microsoft ASP.NET technologies and an SQL Server database for Windows-based hosting environments. WEBiKEY was tested for its usability with a sample data set, the temperate woody bamboo genus Kuruna (Poaceae). WEBiKEY is freely available to the public and can be used to develop Web-based interactive keys for any group of species. The interactive key we developed for Kuruna using WEBiKEY enables users to visually inspect characteristics of Kuruna and identify an unknown specimen as one of seven possible species in the genus.

The Shared Decision Making Frontier: a Feasibility and Usability Study for Managing Non-Critical Chronic Illness by Combining Behavioural & Decision Theory with Online Technology.

PubMed

Russell, Amina; Van Woensel, William; Abidi, Samina Raza

2015-01-01

The objective of this study is to determine if shared decisions for managing non-critical chronic illness, made through an online biomedical technology intervention, us feasible and usable. The technology intervention incorporates behavioural and decision theories to increase patient engagement, and ultimately long term adherence to health behaviour change. We devised the iheart web intervention as a "proof of concept" in five phases. The implementation incorporates the Vaadin web application framework, Drools, EclipseLink and a MySQL database. Two-thirds of the study participants favoured the technology intervention, based on Likert-scale questions from a post-study questionnaire. Qualitative analysis of think aloud feedback, video screen captures and open-ended questions from the post-study questionnaire uncovered six main areas or themes for improvement. We conclude that online shared decisions for managing a non-critical chronic illness are feasible and usable through the iheart web intervention.

Making Web 2.0 Work--From "Librarian Habilis" to "Librarian Sapiens"

ERIC Educational Resources Information Center

Cvetkovic, Milica

2009-01-01

When people look back at the World Wide Web of 1996, there can be no doubt that today's web is better and more useful. Hyperlinking webpages and bookmarking were two of the most important aspects of the Web 1.0 world. Soon, though, usability and sharing became very high priorities, and Web 2.0 evolved. Information published in the Web 2.0 world…

Web-Based Versus Conventional Training for Medical Students on Infant Gross Motor Screening.

PubMed

Pusponegoro, Hardiono D; Soebadi, Amanda; Surya, Raymond

2015-12-01

Early detection of developmental abnormalities is important for early intervention. A simple screening method is needed for use by general practitioners, as is an effective and efficient training method. This study aims to evaluate the effectiveness, acceptability, and usability of Web-based training for medical students on a simple gross motor screening method in infants. Fifth-year medical students at University of Indonesia in Jakarta were randomized into two groups. A Web-based training group received online video modules, discussions, and assessments (at www.schoology.com ). A conventional training group received a 1-day live training using the same module. Both groups completed identical pre- and posttests and the User Satisfaction Questionnaire (USQ). The Web-based group also completed the System Usability Scale (SUS). The module was based on a gross motor screening method used in the World Health Organization Multicentre Growth Reference Study. There were 39 and 32 subjects in the Web-based and conventional groups, respectively. Mean pretest versus posttest scores (correct answers out of 20) were 9.05 versus 16.95 (p=0.0001) in the Web-based group and 9.31 versus 16.88 (p=0.0001) in the conventional group. Mean difference between pre- and posttest scores did not differ significantly between the Web-based and conventional groups (mean [standard deviation], 7.56 [3.252] versus 7.90 [5.170]; p=0.741]. Both training methods were acceptable based on USQ scores. Based on SUS scores, the Web-based training had good usability. Web-based training is an effective, efficient, and acceptable training method for medical students on simple infant gross motor screening and is as effective as conventional training.

Validating the usability of an interactive Earth Observation based web service for landslide investigation

NASA Astrophysics Data System (ADS)

Albrecht, Florian; Weinke, Elisabeth; Eisank, Clemens; Vecchiotti, Filippo; Hölbling, Daniel; Friedl, Barbara; Kociu, Arben

2017-04-01

Regional authorities and infrastructure maintainers in almost all mountainous regions of the Earth need detailed and up-to-date landslide inventories for hazard and risk management. Landslide inventories usually are compiled through ground surveys and manual image interpretation following landslide triggering events. We developed a web service that uses Earth Observation (EO) data to support the mapping and monitoring tasks for improving the collection of landslide information. The planned validation of the EO-based web service does not only cover the analysis of the achievable landslide information quality but also the usability and user friendliness of the user interface. The underlying validation criteria are based on the user requirements and the defined tasks and aims in the work description of the FFG project Land@Slide (EO-based landslide mapping: from methodological developments to automated web-based information delivery). The service will be validated in collaboration with stakeholders, decision makers and experts. Users are requested to test the web service functionality and give feedback with a web-based questionnaire by following the subsequently described workflow. The users will operate the web-service via the responsive user interface and can extract landslide information from EO data. They compare it to reference data for quality assessment, for monitoring changes and for assessing landslide-affected infrastructure. An overview page lets the user explore a list of example projects with resulting landslide maps and mapping workflow descriptions. The example projects include mapped landslides in several test areas in Austria and Northern Italy. Landslides were extracted from high resolution (HR) and very high resolution (VHR) satellite imagery, such as Landsat, Sentinel-2, SPOT-5, WorldView-2/3 or Pléiades. The user can create his/her own project by selecting available satellite imagery or by uploading new data. Subsequently, a new landslide extraction workflow can be initiated through the functionality that the web service provides: (1) a segmentation of the image into spectrally homogeneous objects, (2) a classification of the objects into landslide and non-landslide areas and (3) an editing tool for the manual refinement of extracted landslide boundaries. In addition, the user interface of the web service provides tools that enable the user (4) to perform a monitoring that identifies changes between landslide maps of different points in time, (5) to perform a validation of the landslide maps by comparing them to reference data, and (6) to perform an assessment of affected infrastructure by comparing the landslide maps to respective infrastructure data. After exploring the web service functionality, the users are asked to fill in the online validation protocol in form of a questionnaire in order to provide their feedback. Concerning usability, we evaluate how intuitive the web service functionality can be operated, how well the integrated help information guides the users, and what kind of background information, e.g. remote sensing concepts and theory, is necessary for a practitioner to fully exploit the value of EO data. The feedback will be used for improving the user interface and for the implementation of additional functionality.

Reinventing Image Detective: An Evidence-Based Approach to Citizen Science Online

NASA Astrophysics Data System (ADS)

Romano, C.; Graff, P. V.; Runco, S.

2017-12-01

Usability studies demonstrate that web users are notoriously impatient, spending as little as 15 seconds on a home page. How do you get users to stay long enough to understand a citizen science project? How do you get users to complete complex citizen science tasks online?Image Detective, a citizen science project originally developed by scientists and science engagement specialists at the NASA Johnson Space center to engage the public in the analysis of images taken from space by astronauts to help enhance NASA's online database of astronaut imagery, partnered with the CosmoQuest citizen science platform to modernize, offering new and improved options for participation in Image Detective. The challenge: to create a web interface that builds users' skills and knowledge, creating engagement while learning complex concepts essential to the accurate completion of tasks. The project team turned to usability testing for an objective understanding of how users perceived Image Detective and the steps required to complete required tasks. A group of six users was recruited online for unmoderated and initial testing. The users followed a think-aloud protocol while attempting tasks, and were recorded on video and audio. The usability test examined users' perception of four broad areas: the purpose of and context for Image Detective; the steps required to successfully complete the analysis (differentiating images of Earth's surface from those showing outer space and identifying common surface features); locating the image center point on a map of Earth; and finally, naming geographic locations or natural events seen in the image.Usability test findings demonstrated that the following best practices can increase participation in Image Detective and can be applied to the successful implementation of any citizen science project:• Concise explanation of the project, its context, and its purpose;• Including a mention of the funding agency (in this case, NASA);• A preview of the specific tasks required of participants;• A dedicated user interface for the actual citizen science interaction.In addition, testing revealed that users may require additional context when a task is complex, difficult, or unusual (locating a specific image and its center point on a map of Earth). Video evidence will be made available with this presentation.

Reinventing Image Detective: An Evidence-Based Approach to Citizen Science Online

NASA Technical Reports Server (NTRS)

Romano, Cia; Graff, Paige V.; Runco, Susan

2017-01-01

Usability studies demonstrate that web users are notoriously impatient, spending as little as 15 seconds on a home page. How do you get users to stay long enough to understand a citizen science project? How do you get users to complete complex citizen science tasks online? Image Detective, a citizen science project originally developed by scientists and science engagement specialists at the NASA Johnson Space center to engage the public in the analysis of images taken from space by astronauts to help enhance NASA's online database of astronaut imagery, partnered with the CosmoQuest citizen science platform to modernize, offering new and improved options for participation in Image Detective. The challenge: to create a web interface that builds users' skills and knowledge, creating engagement while learning complex concepts essential to the accurate completion of tasks. The project team turned to usability testing for an objective understanding of how users perceived Image Detective and the steps required to complete required tasks. A group of six users was recruited online for unmoderated and initial testing. The users followed a think-aloud protocol while attempting tasks, and were recorded on video and audio. The usability test examined users' perception of four broad areas: the purpose of and context for Image Detective; the steps required to successfully complete the analysis (differentiating images of Earth's surface from those showing outer space and identifying common surface features); locating the image center point on a map of Earth; and finally, naming geographic locations or natural events seen in the image. Usability test findings demonstrated that the following best practices can increase participation in Image Detective and can be applied to the successful implementation of any citizen science project: (1) Concise explanation of the project, its context, and its purpose; (2) Including a mention of the funding agency (in this case, NASA); (3) A preview of the specific tasks required of participants; (4) A dedicated user interface for the actual citizen science interaction. In addition, testing revealed that users may require additional context when a task is complex, difficult, or unusual (locating a specific image and its center point on a map of Earth). Video evidence will be made available with this presentation.

Staples.com: Focus on Usability.

ERIC Educational Resources Information Center

McCann, Tom; Hynes, Colin

2002-01-01

Describes the Staples.com electronic commerce Web site; discusses its steady growth rate; and details two case studies in which data from a variety of sources were used to identify and resolve site usability issues and which are supported by compelling ROI (return on investment) figures. (Author/LRW)

Interaction Design and Usability of Learning Spaces in 3D Multi-user Virtual Worlds

NASA Astrophysics Data System (ADS)

Minocha, Shailey; Reeves, Ahmad John

Three-dimensional virtual worlds are multimedia, simulated environments, often managed over the Web, which users can 'inhabit' and interact via their own graphical, self-representations known as 'avatars'. 3D virtual worlds are being used in many applications: education/training, gaming, social networking, marketing and commerce. Second Life is the most widely used 3D virtual world in education. However, problems associated with usability, navigation and way finding in 3D virtual worlds may impact on student learning and engagement. Based on empirical investigations of learning spaces in Second Life, this paper presents design guidelines to improve the usability and ease of navigation in 3D spaces. Methods of data collection include semi-structured interviews with Second Life students, educators and designers. The findings have revealed that design principles from the fields of urban planning, Human- Computer Interaction, Web usability, geography and psychology can influence the design of spaces in 3D multi-user virtual environments.

Total Access: Making College Web Sites Accessible to Students with Disabilities

ERIC Educational Resources Information Center

Bruyere, Susanne

2008-01-01

Colleges increasingly rely on the Web to attract, inform, and interact with students. This makes Web site accessibility and usability critical concerns, particularly for public community colleges, which educate sizable numbers of students with disabilities. As committed providers of postsecondary education to students with disabilities and thus a…

Analyzing Web Server Logs to Improve a Site's Usage. The Systems Librarian

ERIC Educational Resources Information Center

Breeding, Marshall

2005-01-01

This column describes ways to streamline and optimize how a Web site works in order to improve both its usability and its visibility. The author explains how to analyze logs and other system data to measure the effectiveness of the Web site design and search engine.

Usability Definitions in a Dynamically Changing Information Environment

ERIC Educational Resources Information Center

Chen, Yu-Hui; Rorissa, Abebe; Germain, Carol Anne

2015-01-01

The authors compared Web usability definitions, collected from library professionals at academic institutions of the Association of Research Libraries (ARL) through online surveys in 2007 and 2012, to determine whether library practitioners' perspectives had altered as information technologies evolved during this time. The authors applied three…

Ensuring quality Website redesign: the University of Maryland's experience.

PubMed

Fuller, D M; Hinegardner, P G

2001-10-01

The Web Redesign Committee at the Health Sciences and Human Services Library (HS/HSL) of the University of Maryland was formed to evaluate its site and oversee the site's redesign. The committee's goal was to design a site that would be functional, be usable, and provide the library with a more current image. Based on a literature review and discussions with colleagues, a usability study was conducted to gain a better understanding of how the Website was used. Volunteers from across the campus participated in the study. A Web-based survey was also used to gather feedback. To complement user input, library staff were asked to review the existing site. A prototype site was developed incorporating suggestions obtained from the evaluation mechanisms. The usability study was particularly useful because it identified problem areas, including terminology, which would have been overlooked by library staff. A second usability study was conducted to refine the prototype. The new site was launched in the spring of 2000. The usability studies were valuable mechanisms in designing the site. Users felt invested in the project, and the committee received valuable feedback. This process led to an improved Website and higher visibility for the library on campus.

Side by Side: What a Comparative Usability Study Told Us about a Web Site Redesign

ERIC Educational Resources Information Center

Dougan, Kirstin; Fulton, Camilla

2009-01-01

Library Web sites must compete against easy-to-use sites, such as Google Scholar, Google Books, and Wikipedia, for students' time and attention. Library Web sites must therefore be designed with aesthetics and user perceptions at the forefront. The Music and Performing Arts Library at Urbana-Champaign's Web site was overcrowded and in much need of…

Increasing Complexity in Rule-Based Clinical Decision Support: The Symptom Assessment and Management Intervention.

PubMed

Lobach, David F; Johns, Ellis B; Halpenny, Barbara; Saunders, Toni-Ann; Brzozowski, Jane; Del Fiol, Guilherme; Berry, Donna L; Braun, Ilana M; Finn, Kathleen; Wolfe, Joanne; Abrahm, Janet L; Cooley, Mary E

2016-11-08

Management of uncontrolled symptoms is an important component of quality cancer care. Clinical guidelines are available for optimal symptom management, but are not often integrated into the front lines of care. The use of clinical decision support (CDS) at the point-of-care is an innovative way to incorporate guideline-based symptom management into routine cancer care. The objective of this study was to develop and evaluate a rule-based CDS system to enable management of multiple symptoms in lung cancer patients at the point-of-care. This study was conducted in three phases involving a formative evaluation, a system evaluation, and a contextual evaluation of clinical use. In Phase 1, we conducted iterative usability testing of user interface prototypes with patients and health care providers (HCPs) in two thoracic oncology clinics. In Phase 2, we programmed complex algorithms derived from clinical practice guidelines into a rules engine that used Web services to communicate with the end-user application. Unit testing of algorithms was conducted using a stack-traversal tree-spanning methodology to identify all possible permutations of pathways through each algorithm, to validate accuracy. In Phase 3, we evaluated clinical use of the system among patients and HCPs in the two clinics via observations, structured interviews, and questionnaires. In Phase 1, 13 patients and 5 HCPs engaged in two rounds of formative testing, and suggested improvements leading to revisions until overall usability scores met a priori benchmarks. In Phase 2, symptom management algorithms contained between 29 and 1425 decision nodes, resulting in 19 to 3194 unique pathways per algorithm. Unit testing required 240 person-hours, and integration testing required 40 person-hours. In Phase 3, both patients and HCPs found the system usable and acceptable, and offered suggestions for improvements. A rule-based CDS system for complex symptom management was systematically developed and tested. The complexity of the algorithms required extensive development and innovative testing. The Web service-based approach allowed remote access to CDS knowledge, and could enable scaling and sharing of this knowledge to accelerate availability, and reduce duplication of effort. Patients and HCPs found the system to be usable and useful. ©David F Lobach, Ellis B Johns, Barbara Halpenny, Toni-Ann Saunders, Jane Brzozowski, Guilherme Del Fiol, Donna L Berry, Ilana M Braun, Kathleen Finn, Joanne Wolfe, Janet L Abrahm, Mary E Cooley. Originally published in JMIR Medical Informatics (http://medinform.jmir.org), 08.11.2016.

Usability and acceptance evaluation of ACESO: a Web-based breast cancer survivorship tool.

PubMed

Kapoor, Akshat; Nambisan, Priya

2018-06-01

The specific objective of this research is to design and develop a personalized Web application to support breast cancer survivors after treatment, as they deal with post-treatment challenges, such as comorbidities and side effects of treatment. A mixed-methods approach, utilizing a combination of think-aloud analysis, personal interviews, and surveys, was adopted for user acceptance and usability testing among a group of breast cancer survivors. User feedback was gathered on their perceived value of the application, and any user-interface issues that may hinder the overall usability were identified. The application's portability and capability of organizing their entire breast cancer-related medical history as well as tracking various quality of life indicators were perceived to be valuable features. The application had an overall high usability; however, certain sections of the application were not as intuitive to locate. Visual elements of the website were appreciated; however, overall experience would benefit from incorporating more sociable elements that exhibit positive re-enforcement within the end user and provide a friendlier experience. The results of the study showcase the need for more personalized tools and resources to support survivors in self-management. It also demonstrates the ability to integrate breast cancer survivorship care plans from diverse providers and paves the way to add further value-added features in consumer health applications, such as personal decision support. Using a personal decision support-based tool can serve as a training tool and resource, providing these patients with pertinent information about the various aspects of their long-term health, while educating them about any related side effects and symptoms. It is hoped that making such tools more accessible could help in engaging survivors to play an active role in managing their health and encourage shared decision-making with their providers.

Dosvox Usability: recommendations for improving interaction of blind people with the web using the system.

PubMed

de Souza, Edson Rufino; de Freitas, Sydney Fernandes

2012-01-01

At present, it is recognized that the Internet plays key role in universalization of opportunities in society in which we live. For people with disabilities, the content must be accessible in all websites, but the assistive technologies used must be adequate to the specific needs of people with disabilities. Dosvox is a free system developed in the Universidade Federal do Rio de Janeiro (UFRJ) specially designed for blind people and used by them in the performance of their tasks with the use of computers. Previously, through exploratory research based on the observation of the interaction of blind students with the Web, usability problems were identified in the Dosvox interface and in the Webvox, the Web browser included in the system, and these problems were related to the fact that the interface is designed in accordance with the mental model of these Information Technology professionals. This study consolidate the problems in earlier phases of the research, link the results with usability heuristics of Nielsen and propose several improvements to Dosvox and its development process.

MIIP: a web-based platform for medical image interpretation training and evaluation focusing on ultrasound

NASA Astrophysics Data System (ADS)

Lindseth, Frank; Nordrik Hallan, Marte; Schiller Tønnessen, Martin; Smistad, Erik; Vâpenstad, Cecilie

2017-03-01

Introduction: Medical imaging technology has revolutionized health care over the past 30 years. This is especially true for ultrasound, a modality that an increasing amount of medical personal is starting to use. Purpose: The purpose of this study was to develop and evaluate a platform for improving medical image interpretation skills regardless of time and space and without the need for expensive imaging equipment or a patient to scan. Methods, results and conclusions: A stable web application with the needed functionality for image interpretation training and evaluation has been implemented. The system has been extensively tested internally and used during an international course in ultrasound-guided neurosurgery. The web application was well received and got very good System Usability Scale (SUS) scores.

Family perceptions of the usability and value of chronic disease web-based patient portals.

PubMed

Byczkowski, Terri L; Munafo, Jennifer K; Britto, Maria T

2014-06-01

The objective of this study was to understand perceptions of the usability and value of web-based patient portals among parents of children with a chronic condition (diabetes, juvenile idiopathic arthritis, and cystic fibrosis). The design was a cross-sectional telephone survey with semistructured interviews and was conducted at a tertiary children's hospital. Parent ratings of their experiences with and the value of a web-based portal and reasons for not using the portal were ascertained. Most parents agreed that the portal information was accurate, timely, and useful. Confidentiality and seeing worrisome health-related information about their child was not a major concern, and parents felt that the portal helped to improve their understanding of and ability to manage their child's condition. In conclusion, the results of this study support the notion that web-based patient portals have the potential to be a useful tool for parents of children with a chronic disease.

A multimethod approach to examining usability of Web privacy polices and user agents for specifying privacy preferences.

PubMed

Proctor, Robert W; Vu, Kim-Phuong L

2007-05-01

Because all research methods have strengths and weaknesses, a multimethod approach often provides the best way to understand human behavior in applied settings. We describe how a multimethod approach was employed in a series of studies designed to examine usability issues associated with two aspects of online privacy: comprehension of privacy policies and configuration of privacy preferences for an online user agent. Archival research, user surveys, data mining, quantitative observations, and controlled experiments each yielded unique findings that, together, contributed to increased understanding of online-privacy issues for users. These findings were used to evaluate the accessibility of Web privacy policies to computer-literate users, determine whether people can configure user agents to achieve specific privacy goals, and discover ways in which the usability of those agents can be improved.

Usability evaluation of the SMART application for youth with mTBI.

PubMed

Dexheimer, Judith W; Kurowski, Brad G; Anders, Shilo H; McClanahan, Nicole; Wade, Shari L; Babcock, Lynn

2017-01-01

There is a dearth of evidence-based treatments available to address the significant morbidity associated with mild traumatic brain injury (mTBI). To address this gap, we designed a novel user-friendly, web-based application. We describe the preliminary evaluation of feasibility and usability of the application to promote recovery following mTBI in youth, the Self-Monitoring Activity-Restriction and Relaxation Treatment (SMART). SMART incorporates real-time recommendations for individualized symptom management and activity restriction along with training in cognitive-behavioral coping strategies. We conducted a usability evaluation to assess and modify the SMART system prior to further study and deployment. Children ages 11-18 years presenting to the emergency department were recruited after symptoms resolved. Usability was assessed using a 60-min think-aloud protocol of teens and parents describing their interaction with the application. Upon completion of the tasks, each participant also completed the system usability scale (SUS). We performed tests with 4 parent/child dyads. The average age of the children was 13 years (standard deviation=1.8). The parents were an average of 41.5 years old (standard deviation=6.2). Research revealed that the participants were enthusiastic about the interactive portions of the tool particularly the video based sessions. Parents were concerned about the speed at which their child might move through the program and the children thought that the system required large amounts of reading. Based on user feedback, researchers modified SMART to include an audio file in every module and improved the system's aesthetic properties. The mean SUS score was 85, with high SUS scores (>68) indicating satisfactory usability. High initial usability and favorable user feedback provide a foundation for further iterative development and testing of the SMART application as a tool for managing recovery from concussion. Copyright © 2016 Elsevier Ireland Ltd. All rights reserved.

Web-based Education for Low-literate Parents in Neonatal Intensive Care Unit: Development of a Website and Heuristic Evaluation and Usability Testing

PubMed Central

Choi, Jeungok; Bakken, Suzanne

2010-01-01

Purpose Low health literacy has been associated with poor health-related outcomes. The purposes are to report the development of a website for low-literate parents in the Neonatal Intensive Care Unit (NICU), and the findings of heuristic evaluation and a usability testing of this website. Methods To address low literacy of NICU parents, multimedia educational Website using visual aids (e.g., pictographs, photographs), voice-recorded text message in addition to a simplified text was developed. The text was created at the 5th grade readability level. The heuristic evaluation was conducted by three usability experts using 10 heuristics. End-users’ performance was measured by counting the time spent completing tasks and number of errors, as well as recording users’ perception of ease of use and usefulness (PEUU) in a sample of 10 NICU parents. Results Three evaluators identified 82 violations across the 10 heuristics. All violations, however, received scores <2, indicating minor usability problems. Participants’ time to complete task varies from 81.2 seconds (SD=30.9) to 2.2 seconds (SD=1.3). Participants rated the Website as easy to use and useful (PEUU Mean= 4.52, SD=0.53). Based on the participants’ comments, appropriate modifications were made. Discussion and Conclusions Different types of visuals on the Website were well accepted by low-literate users and agreement of visuals with text improved understanding of the educational materials over that with text alone. The findings suggest that using concrete and realistic pictures and pictographs with clear captions would maximize the benefit of visuals. One emerging theme was “simplicity” in design (e.g., limited use of colors, one font type and size), content (e.g., avoid lengthy text), and technical features (e.g., limited use of pop-ups). The heuristic evaluation by usability experts and the usability test with actual users provided complementary expertise, which can give a richer assessment of a design for low literacy Website. These results facilitated design modification and implementation of solutions by categorizing and prioritizing the usability problems. PMID:20617546

Web-based education for low-literate parents in Neonatal Intensive Care Unit: development of a website and heuristic evaluation and usability testing.

PubMed

Choi, Jeungok; Bakken, Suzanne

2010-08-01

Low health literacy has been associated with poor health-related outcomes. The purposes are to report the development of a website for low-literate parents in the Neonatal Intensive Care Unit (NICU), and the findings of heuristic evaluation and a usability testing of this website. To address low literacy of NICU parents, multimedia educational Website using visual aids (e.g., pictographs, photographs), voice-recorded text message in addition to a simplified text was developed. The text was created at the 5th grade readability level. The heuristic evaluation was conducted by three usability experts using 10 heuristics. End-users' performance was measured by counting the time spent completing tasks and number of errors, as well as recording users' perception of ease of use and usefulness (PEUU) in a sample of 10 NICU parents. Three evaluators identified 82 violations across the 10 heuristics. All violations, however, received scores <2, indicating minor usability problems. Participants' time to complete task varies from 81.2 s (SD = 30.9) to 2.2 s (SD = 1.3). Participants rated the Website as easy to use and useful (PEUU mean = 4.52, SD = 0.53). Based on the participants' comments, appropriate modifications were made. Different types of visuals on the Website were well accepted by low-literate users and agreement of visuals with text improved understanding of the educational materials over that with text alone. The findings suggest that using concrete and realistic pictures and pictographs with clear captions would maximize the benefit of visuals. One emerging theme was "simplicity" in design (e.g., limited use of colors, one font type and size), content (e.g., avoid lengthy text), and technical features (e.g., limited use of pop-ups). The heuristic evaluation by usability experts and the usability test with actual users provided complementary expertise, which can give a richer assessment of a design for low literacy Website. These results facilitated design modification and implementation of solutions by categorizing and prioritizing the usability problems.

Safety and usability evaluation of a web-based insulin self-titration system for patients with type 2 diabetes mellitus.

PubMed

Simon, Airin C R; Holleman, Frits; Gude, Wouter T; Hoekstra, Joost B L; Peute, Linda W; Jaspers, Monique W M; Peek, Niels

2013-09-01

The rising incidence of type 2 diabetes mellitus (T2DM) induces severe challenges for the health care system. Our research group developed a web-based system named PANDIT that provides T2DM patients with insulin dosing advice using state of the art clinical decision support technology. The PANDIT interface resembles a glucose diary and provides advice through pop-up messages. Diabetes nurses (DNs) also have access to the system, allowing them to intervene when needed. The objective of this study was to establish whether T2DM patients can safely use PANDIT at home. To this end, we assessed whether patients experience usability problems with a high risk of compromising patient safety when interacting with the system, and whether PANDIT's insulin dosing advice are clinically safe. The study population consisted of patients with T2DM (aged 18-80) who used a once daily basal insulin as well as DNs from a university hospital. The usability evaluation consisted of think-aloud sessions with four patients and three DNs. Video data, audio data and verbal utterances were analyzed for usability problems encountered during PANDIT interactions. Usability problems were rated by a physician and a usability expert according to their potential impact on patient safety. The usability evaluation was followed by an implementation with a duration of four weeks. This implementation took place at the patients' homes with ten patients to evaluate clinical safety of PANDIT advice. PANDIT advice were systematically compared with DN advice. Deviating advice were evaluated with respect to patient safety by a panel of experienced physicians, which specialized in diabetes care. We detected seventeen unique usability problems, none of which was judged to have a high risk of compromising patient safety. Most usability problems concerned the lay-out of the diary, which did not clearly indicate which data entry fields had to be entered in order to obtain an advice. 27 out of 74 (36.5%) PANDIT advice differed from those provided by DNs. However, only one of these (1.4%) was considered unsafe by the panel. T2DM patients with no prior experience with the web-based self-management system were capable of consulting the system without encountering significant usability problems. Furthermore, the large majority of PANDIT advice were considered clinically safe according to the expert panel. One advice was considered unsafe. This could however easily be corrected by implementing a small modification to the system's knowledge base. Copyright © 2013 Elsevier B.V. All rights reserved.

Health literacy and patient web portals.

PubMed

Coughlin, Steven S; Stewart, Jessica L; Young, Lufei; Heboyan, Vahé; De Leo, Gianluca

2018-05-01

There is limited evidence about the association between health literacy and use of patient web portals in patients with chronic illnesses. The objective of this review was to learn more about health literacy and use of patient web portals. Bibliographic searches were conducted in PubMed and CINAHL using relevant MeSH search terms and Boolean algebra commands. Qualitative studies and studies with a cross-sectional, cohort, or pre-/post-test design have shown that persons with limited health literacy are less likely to use patient web portals, although there is inconsistency in the association across studies. The conflicting findings may be partially due to racial and ethnic differences in health literacy or level of comfort in sharing private health information using mobile technologies. Several opportunities exist to improve the usability and acceptability of web portals for patients with limited health literacy including enhancements in the design of the portals, patient and provider education and training, and engagement of proxies such as caregivers and close family members. Copyright © 2018 Elsevier B.V. All rights reserved.

Simple Web-based interactive key development software (WEBiKEY) and an example key for Kuruna (Poaceae: Bambusoideae)1

PubMed Central

Attigala, Lakshmi; De Silva, Nuwan I.; Clark, Lynn G.

2016-01-01

Premise of the study: Programs that are user-friendly and freely available for developing Web-based interactive keys are scarce and most of the well-structured applications are relatively expensive. WEBiKEY was developed to enable researchers to easily develop their own Web-based interactive keys with fewer resources. Methods and Results: A Web-based multiaccess identification tool (WEBiKEY) was developed that uses freely available Microsoft ASP.NET technologies and an SQL Server database for Windows-based hosting environments. WEBiKEY was tested for its usability with a sample data set, the temperate woody bamboo genus Kuruna (Poaceae). Conclusions: WEBiKEY is freely available to the public and can be used to develop Web-based interactive keys for any group of species. The interactive key we developed for Kuruna using WEBiKEY enables users to visually inspect characteristics of Kuruna and identify an unknown specimen as one of seven possible species in the genus. PMID:27144109

Design and Aesthetics in E-Learning: A Usability and Credibility Perspective

ERIC Educational Resources Information Center

Glore, Peyton; David, Alicia

2012-01-01

This article reviews research pertaining to the use aesthetics design, and usability in education. This article focuses on defining the role of visual elements and aesthetics in the user interface while exploring the importance of their application in a web-based learning environment. Research demonstrates that aesthetics are pivotal in…

Usability Evaluation of a Research Repository and Collaboration Web Site

ERIC Educational Resources Information Center

Zhang, Tao; Maron, Deborah J.; Charles, Christopher C.

2013-01-01

This article reports results from an empirical usability evaluation of Human-Animal Bond Research Initiative Central as part of the effort to develop an open access research repository and collaboration platform for human-animal bond researchers. By repurposing and altering key features of the original HUBzero system, Human-Animal Bond Research…

Usability Level of Distance Education Website (Sakarya University Sample)

ERIC Educational Resources Information Center

Isman, Aytekin; Isbulan, Onur

2010-01-01

The main goal of this research is to determine the usability of Sakarya University Adapazari Vocational Two-Year Community College's Web Site. A scale was developed to the evaluation and applied to 1512 students. From the applied questionnaire only appropriate ones were selected to be evaluated and 1229 questionnaires were analysed. Finally,…

Conferences as Information Grounds: Web Site Evaluation with a Mobile Usability Laboratory

ERIC Educational Resources Information Center

Bossaller, Jenny S.; Paul, Anindita; Hill, Heather; Wang, Jiazhen; Erdelez, Sanda

2008-01-01

This article describes an "on-the-road" usability study and explains the study's methodological challenges, solutions, and recommendations. The study concerned a library-consortium website, which is a communication and educational tool for librarians who are physically dispersed throughout the state, and an intranet for remote users.…

Usability Testing and Redesign of Library Web Pages at Lund University, Faculty of Engineering: A Case Study Applying a Two-Phase, Systematic Quality Approach

ERIC Educational Resources Information Center

Persson, Ann-Christin; Langh, Maria; Nilsson, Jessica

2010-01-01

Introduction: The Lund University Faculty of Engineering's LibQual+[R] survey 2007 showed that students and faculty had difficulties finding the information they needed at the libraries' Websites. To be able to improve the Websites, we needed to find out how the users navigated the Websites, as well as what content they needed. Method: Twenty-four…

Naval Oceanography Portal

Science.gov Websites

accessible and usable, working in accordance with the Web Content Accessibility Guidelines (WCAG v1.0). If navigation device enabling you to get around this web site using your keyboard. Available access keys This develop a web site that is clear and simple for everybody to use. Validation We have used XHTML 1.0 and

Measuring Law Library Catalog Web Site Usability: A Web Analytic Approach

ERIC Educational Resources Information Center

Fang, Wei; Crawford, Marjorie E.

2008-01-01

Although there is a proliferation of information available on the Web, and law professors, students, and other users have a variety of channels to locate information and complete their research activities, the law library catalog still remains an important source for offering users access to information that has been evaluated and cataloged by…

When He Said Linking, He Really Meant Linking

ERIC Educational Resources Information Center

Chudnov, Daniel

2009-01-01

There are many reasons to improve web links, starting with their design. The author tends to think about "design" on the web in terms of two things: (1) graphic/industrial design; and (2) human usability. A nice, clean URI (uniform resource identifier) that does not change, is readable to humans, is amenable to common web behaviors such as…

Usability Evaluation of Clinical Guidelines on the Web Using Eye-Tracker.

PubMed

Khodambashi, Soudabeh; Gilstad, Heidi; Nytrø, Øystein

2016-01-01

Publishing clinical guidelines (GLs) on the web increases their accessibility. However, evaluating their usability and understanding how users interact with the websites has been neglected. In this study we used Tobii eye-tracker to analyse users' interaction with five commercial and public GL sites popular in Norway (four in Norwegian and one English of US origin (UpToDate)). We measured number of clicks and usage rate for search functions, task completion time, users' objective and perception of task success rate. We also measured learning effect for inexperienced users. We found a direct correlation between participant's satisfaction regarding website usability and the time spent, number of mouse clicks and use of search function to obtain the desired results. Our study showed that users' perceived success rate was not reliable and GL publishers should evaluate their website regarding presentation format, layout, navigation bar and search function.

User-centered design of a web-based self-management site for individuals with type 2 diabetes – providing a sense of control and community

PubMed Central

2014-01-01

Background To design and test a web-based self-management tool for patients with type 2 diabetes for its usability and feasibility. Methods An evidence-based, theory-driven website was created for patients with type 2 diabetes. Twenty-three patients with type 2 diabetes aged ≥ 25 years were recruited from 2 diabetes care centers in Toronto, Canada. We employed focus group methodology to assess acceptability, sustainability, strengths and weaknesses of the self-management website. Based on these results, revisions were made to the website. Three cycles of individual usability testing sessions using cognitive task analysis were conducted with patients with type 2 diabetes. Revisions to the website were made based on results from this testing. Results We identified five themes concerning participants’ experiences of health care and related unmet needs: 1) Desire for information and for greater access to timely and personalized care to gain a sense of control of their disease; 2) Desire for community (sharing experiences with others) to fulfill practical and emotional needs; 3) Potential roles of an online self-management website in self-empowerment, behavior change, self-management and health care delivery; 4) Importance of a patient-centered perspective in presenting content (e.g. common assumptions, medical nomenclature, language, messaging, sociocultural context); 5) Barriers and facilitators to use of a self-management website (including perceived relevance of content, incorporation into usual routine, availability for goal-directed use, usability issues). Conclusions Participants outlined a series of unmet health care needs, and stated that they wanted timely access to tailored knowledge about their condition, mechanisms to control and track their disease, and opportunities to share experiences with other patients. These findings have implications for patients with type 2 diabetes of diverse ages, socioeconomic backgrounds, and disease severity, as well as to the design of other computer-based resources for chronic disease management. PMID:25056379

User-centered design of a web-based self-management site for individuals with type 2 diabetes - providing a sense of control and community.

PubMed

Yu, Catherine H; Parsons, Janet A; Hall, Susan; Newton, David; Jovicic, Aleksandra; Lottridge, Danielle; Shah, Baiju R; Straus, Sharon E

2014-07-23

To design and test a web-based self-management tool for patients with type 2 diabetes for its usability and feasibility. An evidence-based, theory-driven website was created for patients with type 2 diabetes. Twenty-three patients with type 2 diabetes aged ≥ 25 years were recruited from 2 diabetes care centers in Toronto, Canada. We employed focus group methodology to assess acceptability, sustainability, strengths and weaknesses of the self-management website. Based on these results, revisions were made to the website. Three cycles of individual usability testing sessions using cognitive task analysis were conducted with patients with type 2 diabetes. Revisions to the website were made based on results from this testing. We identified five themes concerning participants' experiences of health care and related unmet needs: 1) Desire for information and for greater access to timely and personalized care to gain a sense of control of their disease; 2) Desire for community (sharing experiences with others) to fulfill practical and emotional needs; 3) Potential roles of an online self-management website in self-empowerment, behavior change, self-management and health care delivery; 4) Importance of a patient-centered perspective in presenting content (e.g. common assumptions, medical nomenclature, language, messaging, sociocultural context); 5) Barriers and facilitators to use of a self-management website (including perceived relevance of content, incorporation into usual routine, availability for goal-directed use, usability issues). Participants outlined a series of unmet health care needs, and stated that they wanted timely access to tailored knowledge about their condition, mechanisms to control and track their disease, and opportunities to share experiences with other patients. These findings have implications for patients with type 2 diabetes of diverse ages, socioeconomic backgrounds, and disease severity, as well as to the design of other computer-based resources for chronic disease management.

Reactome diagram viewer: data structures and strategies to boost performance.

PubMed

Fabregat, Antonio; Sidiropoulos, Konstantinos; Viteri, Guilherme; Marin-Garcia, Pablo; Ping, Peipei; Stein, Lincoln; D'Eustachio, Peter; Hermjakob, Henning

2018-04-01

Reactome is a free, open-source, open-data, curated and peer-reviewed knowledgebase of biomolecular pathways. For web-based pathway visualization, Reactome uses a custom pathway diagram viewer that has been evolved over the past years. Here, we present comprehensive enhancements in usability and performance based on extensive usability testing sessions and technology developments, aiming to optimize the viewer towards the needs of the community. The pathway diagram viewer version 3 achieves consistently better performance, loading and rendering of 97% of the diagrams in Reactome in less than 1 s. Combining the multi-layer html5 canvas strategy with a space partitioning data structure minimizes CPU workload, enabling the introduction of new features that further enhance user experience. Through the use of highly optimized data structures and algorithms, Reactome has boosted the performance and usability of the new pathway diagram viewer, providing a robust, scalable and easy-to-integrate solution to pathway visualization. As graph-based visualization of complex data is a frequent challenge in bioinformatics, many of the individual strategies presented here are applicable to a wide range of web-based bioinformatics resources. Reactome is available online at: https://reactome.org. The diagram viewer is part of the Reactome pathway browser (https://reactome.org/PathwayBrowser/) and also available as a stand-alone widget at: https://reactome.org/dev/diagram/. The source code is freely available at: https://github.com/reactome-pwp/diagram. fabregat@ebi.ac.uk or hhe@ebi.ac.uk. Supplementary data are available at Bioinformatics online.

User Interface Requirements for Web-Based Integrated Care Pathways: Evidence from the Evaluation of an Online Care Pathway Investigation Tool.

PubMed

Balatsoukas, Panos; Williams, Richard; Davies, Colin; Ainsworth, John; Buchan, Iain

2015-11-01

Integrated care pathways (ICPs) define a chronological sequence of steps, most commonly diagnostic or treatment, to be followed in providing care for patients. Care pathways help to ensure quality standards are met and to reduce variation in practice. Although research on the computerisation of ICP progresses, there is still little knowledge on what are the requirements for designing user-friendly and usable electronic care pathways, or how users (normally health care professionals) interact with interfaces that support design, analysis and visualisation of ICPs. The purpose of the study reported in this paper was to address this gap by evaluating the usability of a novel web-based tool called COCPIT (Collaborative Online Care Pathway Investigation Tool). COCPIT supports the design, analysis and visualisation of ICPs at the population level. In order to address the aim of this study, an evaluation methodology was designed based on heuristic evaluations and a mixed method usability test. The results showed that modular visualisation and direct manipulation of information related to the design and analysis of ICPs is useful for engaging and stimulating users. However, designers should pay attention to issues related to the visibility of the system status and the match between the system and the real world, especially in relation to the display of statistical information about care pathways and the editing of clinical information within a care pathway. The paper concludes with recommendations for interface design.

Older Cancer Patients’ User Experiences With Web-Based Health Information Tools: A Think-Aloud Study

PubMed Central

Romijn, Geke; Smets, Ellen M A; Loos, Eugene F; Kunneman, Marleen; van Weert, Julia C M

2016-01-01

Background Health information is increasingly presented on the Internet. Several Web design guidelines for older Web users have been proposed; however, these guidelines are often not applied in website development. Furthermore, although we know that older individuals use the Internet to search for health information, we lack knowledge on how they use and evaluate Web-based health information. Objective This study evaluates user experiences with existing Web-based health information tools among older (≥ 65 years) cancer patients and survivors and their partners. The aim was to gain insight into usability issues and the perceived usefulness of cancer-related Web-based health information tools. Methods We conducted video-recorded think-aloud observations for 7 Web-based health information tools, specifically 3 websites providing cancer-related information, 3 Web-based question prompt lists (QPLs), and 1 values clarification tool, with colorectal cancer patients or survivors (n=15) and their partners (n=8) (median age: 73; interquartile range 70-79). Participants were asked to think aloud while performing search, evaluation, and application tasks using the Web-based health information tools. Results Overall, participants perceived Web-based health information tools as highly useful and indicated a willingness to use such tools. However, they experienced problems in terms of usability and perceived usefulness due to difficulties in using navigational elements, shortcomings in the layout, a lack of instructions on how to use the tools, difficulties with comprehensibility, and a large amount of variety in terms of the preferred amount of information. Although participants frequently commented that it was easy for them to find requested information, we observed that the large majority of the participants were not able to find it. Conclusions Overall, older cancer patients appreciate and are able to use cancer information websites. However, this study shows the importance of maintaining awareness of age-related problems such as cognitive and functional decline and navigation difficulties with this target group in mind. The results of this study can be used to design usable and useful Web-based health information tools for older (cancer) patients. PMID:27457709

A Student-Focused Usability Study of the Western Michigan University Libraries Home Page

ERIC Educational Resources Information Center

Whang, Michael; Ring, Donna M.

2007-01-01

Three sources indicated the need for designing a usability study of the Western Michigan University Libraries' Web site: the results of the 2004 LibQUAL+ survey; the completion of the library's new strategic planning document; and suggestions by library customers and library staff. LibQUAL+ findings and customer comments suggested customers…

General Practitioners' Understanding Pertaining to Reliability, Interactive and Usability Components Associated with Health Websites

ERIC Educational Resources Information Center

Usher, Wayne

2009-01-01

This study was undertaken to determine the level of understanding of Gold Coast general practitioners (GPs) pertaining to such criteria as reliability, interactive and usability components associated with health websites. These are important considerations due to the increased levels of computer and World Wide Web (WWW)/Internet use and health…

Towards an Understanding of Mobile Website Contextual Usability and Its Impact on Mobile Commerce

ERIC Educational Resources Information Center

Hyman, Jack Alan

2012-01-01

An increasing number of technologies and applications have begun to focus on mobile computing and the wireless Web as a way to conduct commerce-oriented transactions. M-commerce Websites that are usability friendly must emphasize information quality, system quality, and service quality, as these are proxy measures to mobile commerce user…

Usability and Acceptability of a Web-Based Program for Chemotherapy-Induced Peripheral Neuropathy.

PubMed

Tofthagen, Cindy; Kip, Kevin E; Passmore, Denise; Loy, Ian; Berry, Donna L

2016-07-01

Chemotherapy-induced neuropathy is a painful and debilitating adverse effect of certain chemotherapy drugs. There have not been any patient-centered, easily accessible Web-based interventions to assist with self-management of chemotherapy-induced neuropathy. The aims of this study were to evaluate usability and acceptability and to estimate an effect size of a Web-based intervention for assessing and managing chemotherapy-induced neuropathy. Participants (N = 14) were instructed to complete the Creativity, Optimism, Planning, and Expert Information for Chemotherapy-Induced Peripheral Neuropathy program and provide verbal responses to the program. Participants completed the Chemotherapy Induced Peripheral Neuropathy Assessment Tool and Post-Study System Usability Questionnaire. Iterative changes were made to the COPE-CIPN. Participants were asked to provide feedback on the revised COPE-CIPN, repeat the Chemotherapy Induced Peripheral Neuropathy Assessment Tool, and evaluate acceptability using the Acceptability e-Scale. The COPE-CIPN demonstrated high usability (mean, 1.98 [SD, 1.12]) and acceptability (mean, 4.40 [SD, 0.52]). Comments indicated that the interface was easy to use, and the information was helpful. While neuropathy symptoms continued to increase in this group of patients receiving neurotoxic chemotherapy, there was a decrease in mean level of interference with activities from 53.71 to 39.29 over 3 to 4 months, which indicated a moderate effect (d = 0.39) size. The COPE-CIPN may be a useful intervention to support self-management of chemotherapy-induced neuropathy.

Evaluation of Quality, Content, and Use of the Web Site Prepared for Family Members Giving Care to Stroke Patients.

PubMed

Demir, Yasemin; Gozum, Sebahat

2015-09-01

This study was designed to evaluate the quality, content, usability, and efficacy of a Web site prepared for the purpose of improving the caregiving capability of family members who provide care for stroke survivors at home. The DISCERN score for the Web site was found to be 4.35 over 5. The first section that assesses reliability of the Web site was 4.38 over 5; mean score of the second section that measures the quality of the provided information on treatment/care options was 4.30, and mean score of the third section that gives a general evaluation of the material was 4.1. The Web site content achieved an average score of 3.47 over 4 after evaluation by experts. The Web site system usability score was found to be 79.4 over 100. The Web site was utilized mostly for exercises in bed (76.3%; n = 29), use of medications, and patient safety (68.4%; n = 26). It was determined that those who were younger and employed and had no previous experience of nursing any patient utilized relatively more from the section of patient nutrition and oral care and married family caregivers from the body hygiene section. The Web site quality and content were judged to be good and reliable to use. The Web site was efficiently used by caregivers.

Quality of information available on the World Wide Web for patients undergoing thyroidectomy: review.

PubMed

Muthukumarasamy, S; Osmani, Z; Sharpe, A; England, R J A

2012-02-01

This study aimed to assess the quality of information available on the World Wide Web for patients undergoing thyroidectomy. The first 50 web-links generated by internet searches using the five most popular search engines and the key word 'thyroidectomy' were evaluated using the Lida website validation instrument (assessing accessibility, usability and reliability) and the Flesch Reading Ease Score. We evaluated 103 of a possible 250 websites. Mean scores (ranges) were: Lida accessibility, 48/63 (27-59); Lida usability, 36/54 (21-50); Lida reliability, 21/51 (4-38); and Flesch Reading Ease, 43.9 (2.6-77.6). The quality of internet health information regarding thyroidectomy is variable. High ranking and popularity are not good indicators of website quality. Overall, none of the websites assessed achieved high Lida scores. In order to prevent the dissemination of inaccurate or commercially motivated information, we recommend independent labelling of medical information available on the World Wide Web.

Mind the Gap. A systematic review to identify usability and safety challenges and practices during electronic health record implementation.

PubMed

Ratwani, Raj; Fairbanks, Terry; Savage, Erica; Adams, Katie; Wittie, Michael; Boone, Edna; Hayden, Andrew; Barnes, Janey; Hettinger, Zach; Gettinger, Andrew

2016-11-16

Decisions made during electronic health record (EHR) implementations profoundly affect usability and safety. This study aims to identify gaps between the current literature and key stakeholders' perceptions of usability and safety practices and the challenges encountered during the implementation of EHRs. Two approaches were used: a literature review and interviews with key stakeholders. We performed a systematic review of the literature to identify usability and safety challenges and best practices during implementation. A total of 55 articles were reviewed through searches of PubMed, Web of Science and Scopus. We used a qualitative approach to identify key stakeholders' perceptions; semi-structured interviews were conducted with a diverse set of health IT stakeholders to understand their current practices and challenges related to usability during implementation. We used a grounded theory approach: data were coded, sorted, and emerging themes were identified. Conclusions from both sources of data were compared to identify areas of misalignment. We identified six emerging themes from the literature and stakeholder interviews: cost and resources, risk assessment, governance and consensus building, customization, clinical workflow and usability testing, and training. Across these themes, there were misalignments between the literature and stakeholder perspectives, indicating major gaps. Major gaps identified from each of six emerging themes are discussed as critical areas for future research, opportunities for new stakeholder initiatives, and opportunities to better disseminate resources to improve the implementation of EHRs. Our analysis identified practices and challenges across six different emerging themes, illustrated important gaps, and results suggest critical areas for future research and dissemination to improve EHR implementation.

Usability and Safety in Electronic Medical Records Interface Design: A Review of Recent Literature and Guideline Formulation.

PubMed

Zahabi, Maryam; Kaber, David B; Swangnetr, Manida

2015-08-01

The objectives of this study were to (a) review electronic medical record (EMR) and related electronic health record (EHR) interface usability issues, (b) review how EMRs have been evaluated with safety analysis techniques along with any hazard recognition, and (c) formulate design guidelines and a concept for enhanced EMR interfaces with a focus on diagnosis and documentation processes. A major impact of information technology in health care has been the introduction of EMRs. Although numerous studies indicate use of EMRs to increase health care quality, there remain concerns with usability issues and safety. A literature search was conducted using Compendex, PubMed, CINAHL, and Web of Science databases to find EMR research published since 2000. Inclusion criteria included relevant English-language papers with subsets of keywords and any studies (manually) identified with a focus on EMR usability. Fifty studies met the inclusion criteria. Results revealed EMR and EHR usability problems to include violations of natural dialog, control consistency, effective use of language, effective information presentation, and customization principles as well as a lack of error prevention, minimization of cognitive load, and feedback. Studies focusing on EMR system safety made no objective assessments and applied only inductive reasoning methods for hazard recognition. On the basis of the identified usability problems and structure of safety analysis techniques, we provide EMR design guidelines and a design concept focused on the diagnosis process and documentation. The design guidelines and new interface concept can be used for prototyping and testing enhanced EMRs. © 2015, Human Factors and Ergonomics Society.

iCHAMPSS: Usability and Psychosocial Impact for Increasing Implementation of Sexual Health Education.

PubMed

Hernandez, Belinda F; Peskin, Melissa F; Shegog, Ross; Gabay, Efrat K; Cuccaro, Paula M; Addy, Robert C; Ratliff, Eric; Emery, Susan T; Markham, Christine M

2017-05-01

Diffusion of sexual health evidence-based programs (EBPs) in schools is a complex and challenging process. iCHAMPSS ( CHoosing And Maintaining effective Programs for Sex education in Schools) is an innovative theory- and Web-based decision support system that may help facilitate this process. The purpose of this study was to pilot-test iCHAMPSS for usability and short-term psychosocial impact. School district stakeholders from across Texas were recruited ( N = 16) and given access to iCHAMPSS for 3 weeks in fall 2014. Pre- and posttests were administered to measure usability parameters and short-term psychosocial outcomes. Data were analyzed using descriptive statistics and the Wilcoxon signed-rank test. Most participants reported that iCHAMPSS was easy to use, credible, helpful, and of sufficient motivational appeal. iCHAMPSS significantly increased participants' self-efficacy to obtain approval from their board of trustees to implement a sexual health EBP. Positive, though nonsignificant, trends included increased knowledge to locate EBPs, skills to prioritize sexual health education at the district level, and ability to choose an EBP that best meets district needs. iCHAMPSS is an innovative decision support system that could accelerate uptake of EBPs by facilitating diffusion and advance the field of dissemination and implementation science for the promotion of sexual health EBPs.

Bryophytes for Beginners: The Usability of a Printed Dichotomous Key versus a Multi-Access Computer-Based Key for Bryophyte Identification

ERIC Educational Resources Information Center

Stagg, Bethan C.; Donkin, Maria E.; Smith, Alison M.

2015-01-01

Bryophytes are a rewarding study group in field biology and the UK bryophyte flora has international importance to biodiversity conservation. We designed an identification key to common woodland moss species and compared the usability of two formats, web-based multi-access and printed dichotomous key, with undergraduate students. The rate of…

Formative Evaluation of a Web-Based Course in Meteorology.

ERIC Educational Resources Information Center

Phelps, Julia; Reynolds, Ross

1999-01-01

Describes the formative-evaluation process for the EuroMET (European Meteorological Education and Training) project, Web-Based university courses in meteorology that were created to address the education and training needs of professional meteorologists and students throughout Europe. Usability and interactive and multimedia elements are…

The Direction of Web-based Training: A Practitioner's View.

ERIC Educational Resources Information Center

Kilby, Tim

2001-01-01

Web-based training has had achievements and disappointments as online learning has matured. Best practices include user-centered design, knowledge object structures, usability engineering, and formal evaluation. Knowledge management, peer-to-peer learning, and personal learning appliances will continue to alter the online learning landscape. (SK)

Learning to Be an Information Architect

ERIC Educational Resources Information Center

Wusteman, Judith

2013-01-01

This article describes a recently introduced module at University College Dublin School of Information and Library Studies (SILS), entitled "Information Architecture: Designing the Web." The module provides students with a realistic experience of how information architects apply their skills to produce usable web sites, via a project to…

Designing websites for persons with cognitive deficits: Design and usability of a psychoeducational intervention for persons with severe mental illness.

PubMed Central

Rotondi, Armando J.; Sinkule, Jennifer; Haas, Gretchen L.; Spring, Michael B.; Litschge, Christine M.; Newhill, Christina E.; Ganguli, Rohan; Anderson, Carol M.

2013-01-01

The purpose of this study was to develop an understanding of the design elements that influence the ability of persons with severe mental illness (SMI) and cognitive deficits to use a website, and to use this knowledge to design a web-based telehealth application to deliver a psychoeducation program to persons with schizophrenia and their families. Usability testing was conducted with 98 persons with SMI. First, individual website design elements were tested. Based on these results, theoretical website design models were used to create several alternative websites. These designs were tested for their ability to facilitate use by persons with SMI. The final website design is presented. The results indicate that commonly prescribed design models and guidelines produce websites that are poorly suited and confusing to persons with SMI. Our findings suggest an alternative model that should be considered when designing websites and other telehealth interventions for this population. Implications for future studies addressing the characteristics of accessible designs for persons with SMI and cognitive deficits are discussed. PMID:26321884

Rayyan-a web and mobile app for systematic reviews.

PubMed

Ouzzani, Mourad; Hammady, Hossam; Fedorowicz, Zbys; Elmagarmid, Ahmed

2016-12-05

Synthesis of multiple randomized controlled trials (RCTs) in a systematic review can summarize the effects of individual outcomes and provide numerical answers about the effectiveness of interventions. Filtering of searches is time consuming, and no single method fulfills the principal requirements of speed with accuracy. Automation of systematic reviews is driven by a necessity to expedite the availability of current best evidence for policy and clinical decision-making. We developed Rayyan ( http://rayyan.qcri.org ), a free web and mobile app, that helps expedite the initial screening of abstracts and titles using a process of semi-automation while incorporating a high level of usability. For the beta testing phase, we used two published Cochrane reviews in which included studies had been selected manually. Their searches, with 1030 records and 273 records, were uploaded to Rayyan. Different features of Rayyan were tested using these two reviews. We also conducted a survey of Rayyan's users and collected feedback through a built-in feature. Pilot testing of Rayyan focused on usability, accuracy against manual methods, and the added value of the prediction feature. The "taster" review (273 records) allowed a quick overview of Rayyan for early comments on usability. The second review (1030 records) required several iterations to identify the previously identified 11 trials. The "suggestions" and "hints," based on the "prediction model," appeared as testing progressed beyond five included studies. Post rollout user experiences and a reflexive response by the developers enabled real-time modifications and improvements. The survey respondents reported 40% average time savings when using Rayyan compared to others tools, with 34% of the respondents reporting more than 50% time savings. In addition, around 75% of the respondents mentioned that screening and labeling studies as well as collaborating on reviews to be the two most important features of Rayyan. As of November 2016, Rayyan users exceed 2000 from over 60 countries conducting hundreds of reviews totaling more than 1.6M citations. Feedback from users, obtained mostly through the app web site and a recent survey, has highlighted the ease in exploration of searches, the time saved, and simplicity in sharing and comparing include-exclude decisions. The strongest features of the app, identified and reported in user feedback, were its ability to help in screening and collaboration as well as the time savings it affords to users. Rayyan is responsive and intuitive in use with significant potential to lighten the load of reviewers.

Engaging Local Communities in Arctic Observing Networks: A Collaborative Shoreline Change Risk WebGIS for Alaska's Arctic Slope Region

NASA Astrophysics Data System (ADS)

Brady, M.

2017-12-01

This study engaged local community stakeholders in Alaska's Arctic Slope Region to develop a web-based shoreline change risk geographic information system (WebGIS) in collaboration with the North Slope Borough and its residents. The value of the effort includes rich spatial documentation of local risks across the vast, remote, and rapidly changing shoreline, and identification of local manager information needs to direct WebGIS development. The study advances our understanding of shoreline change problems from the perspective of local Arctic communities beyond municipal impacts while building decision support. Over fifty local residents in three communities with collective coastal knowledge that extends across the National Petroleum Reserve - Alaska and Arctic National Wildlife Refuge shared their perspectives on hard copy maps. Sixteen managers provided usability perceptions of a beta WebGIS with shoreline change susceptibility information summarized at relevant asset locations such as subsistence camps. The hard copy maps with 300 "problem places" were digitized for analysis, which revealed problems across the coastline, especially challenges to boating for subsistence hunting such as shoaling cutting off access and creating hazards. The usability workshop revealed specific information needs including the need to monitor impacts at decommissioned national defense radar sites repurposed by locals to centralize oil and gas activity. These results were analyzed using an Instructional Systems Design (ISD) framework consisting of front-end and formative WebGIS evaluation phases. The front-end evaluation is the local input on hard copy maps, which provided local verification of coastal risks. The formative evaluation is the usability workshop with managers, which informed WebGIS development while promoting user buy-in. In terms of product and process, the local knowledge and information needs collected are significant because they establish local engagement with the WebGIS. The engagement is significant because the WebGIS can link local communities with Arctic Observing Networks (AON) that monitor the environmental factors used in the system. This engagement is important for advancing the dual role of AONs for providing both environmental understanding and stakeholder decision support.

Implementing Recommendations From Web Accessibility Guidelines: Would They Also Provide Benefits to Nondisabled Users.

PubMed

Schmutz, Sven; Sonderegger, Andreas; Sauer, Juergen

2016-06-01

We examined the consequences of implementing Web accessibility guidelines for nondisabled users. Although there are Web accessibility guidelines for people with disabilities available, they are rarely used in practice, partly due to the fact that practitioners believe that such guidelines provide no benefits, or even have negative consequences, for nondisabled people, who represent the main user group of Web sites. Despite these concerns, there is a lack of empirical research on the effects of current Web accessibility guidelines on nondisabled users. Sixty-one nondisabled participants used one of three Web sites differing in levels of accessibility (high, low, and very low). Accessibility levels were determined by following established Web accessibility guidelines (WCAG 2.0). A broad methodological approach was used, including performance measures (e.g., task completion time) and user ratings (e.g., perceived usability). A high level of Web accessibility led to better performance (i.e., task completion time and task completion rate) than low or very low accessibility. Likewise, high Web accessibility improved user ratings (i.e., perceived usability, aesthetics, workload, and trustworthiness) compared to low or very low Web accessibility. There was no difference between the very low and low Web accessibility conditions for any of the outcome measures. Contrary to some concerns in the literature and among practitioners, high conformance with Web accessibility guidelines may provide benefits to users without disabilities. The findings may encourage more practitioners to implement WCAG 2.0 for the benefit of users with disabilities and nondisabled users. © 2016, Human Factors and Ergonomics Society.

Manuscript Architect: a Web application for scientific writing in virtual interdisciplinary groups

PubMed Central

Pietrobon, Ricardo; Nielsen, Karen C; Steele, Susan M; Menezes, Andreia P; Martins, Henrique; Jacobs, Danny O

2005-01-01

Background Although scientific writing plays a central role in the communication of clinical research findings and consumes a significant amount of time from clinical researchers, few Web applications have been designed to systematically improve the writing process. This application had as its main objective the separation of the multiple tasks associated with scientific writing into smaller components. It was also aimed at providing a mechanism where sections of the manuscript (text blocks) could be assigned to different specialists. Manuscript Architect was built using Java language in conjunction with the classic lifecycle development method. The interface was designed for simplicity and economy of movements. Manuscripts are divided into multiple text blocks that can be assigned to different co-authors by the first author. Each text block contains notes to guide co-authors regarding the central focus of each text block, previous examples, and an additional field for translation when the initial text is written in a language different from the one used by the target journal. Usability was evaluated using formal usability tests and field observations. Results The application presented excellent usability and integration with the regular writing habits of experienced researchers. Workshops were developed to train novice researchers, presenting an accelerated learning curve. The application has been used in over 20 different scientific articles and grant proposals. Conclusion The current version of Manuscript Architect has proven to be very useful in the writing of multiple scientific texts, suggesting that virtual writing by interdisciplinary groups is an effective manner of scientific writing when interdisciplinary work is required. PMID:15960855

Design for Connecting Spatial Data Infrastructures with Sensor Web (sensdi)

NASA Astrophysics Data System (ADS)

Bhattacharya, D.; M., M.

2016-06-01

Integrating Sensor Web With Spatial Data Infrastructures (SENSDI) aims to extend SDIs with sensor web enablement, converging geospatial and built infrastructure, and implement test cases with sensor data and SDI. It is about research to harness the sensed environment by utilizing domain specific sensor data to create a generalized sensor webframework. The challenges being semantic enablement for Spatial Data Infrastructures, and connecting the interfaces of SDI with interfaces of Sensor Web. The proposed research plan is to Identify sensor data sources, Setup an open source SDI, Match the APIs and functions between Sensor Web and SDI, and Case studies like hazard applications, urban applications etc. We take up co-operative development of SDI best practices to enable a new realm of a location enabled and semantically enriched World Wide Web - the "Geospatial Web" or "Geosemantic Web" by setting up one to one correspondence between WMS, WFS, WCS, Metadata and 'Sensor Observation Service' (SOS); 'Sensor Planning Service' (SPS); 'Sensor Alert Service' (SAS); a service that facilitates asynchronous message interchange between users and services, and between two OGC-SWE services, called the 'Web Notification Service' (WNS). Hence in conclusion, it is of importance to geospatial studies to integrate SDI with Sensor Web. The integration can be done through merging the common OGC interfaces of SDI and Sensor Web. Multi-usability studies to validate integration has to be undertaken as future research.

Measurement of Usability for Multimedia Interactive Learning Based on Website in Mathematics for SMK

NASA Astrophysics Data System (ADS)

Sukardjo, Moch.; Sugiyanta, Lipur

2018-04-01

Web usability, if evaluation done correctly, can significantly improve the quality of the website. Website containing multimedia for education shoud apply user interfaces that are both easy to learn and easy to use. Multimedia has big role in changing the mindset of a person in learning. Using multimedia, learners get easy to obtain information, adjust information and empower information. Therefore, multimedia is utilized by teachers in developing learning techniques to improve student learning outcomes. For students with self-directed learning, multimedia provides the ease and completeness of the courses in such a way that students can complete the learning independently both at school and at home without the guidance of teachers. The learning independence takes place in how students choose, absorb information, and follow the evaluation quickly and efficiently. The 2013 Curriculum 2013 for Vocational High School (SMK) requires teachers to create engaging teaching and learning activities that students enjoy in the classroom (also called invitation learning environment). The creation of learning activity environment is still problem for most teachers. Various researches reveal that teaching and learning activities will be more effective and easy when assisted by visual tools. Using multimedia, learning material can be presented more attractively that help students understand the material easily. The opposite is found in the learning activity environment who only rely on ordinary lectures. Usability is a quality level of multimedia with easy to learn, easy to use and encourages users to use it. The website Multimedia Interactive Learning for Mathematics SMK Class X is targeted object. Usability website in Multimedia Interactive Learning for Mathematics SMK Class X is important indicators to measure effectiveness, efficiency, and student satisfaction to access the functionality of website. This usability measurement should be done carefully before the design is implemented thoroughly. The only way to get test with high quality results is to start testing at the beginning of the design process and continuously testing each of the next steps. This research performs usability testing on of website by using WAMMI criterion (Website Analysis and Measurement Inventory) and will be focused on how convenience using the website application. Components of Attractiveness, Controllability, Efficiency, Helpfulness, and Learnability are applied. The website in Multimedia Interactive Learning for Mathematics SMK Class X can be in accordance with the purpose to be accepted by student to improve student learning outcomes. The results show that WAMMI method show the usability value of Multimedia Mathematics SMK Class X is about from 70% to 90%.

Usability Testing of a Smartphone for Accessing a Web-Based e-Diary for Self-Monitoring of Pain and Symptoms in Sickle Cell Disease

PubMed Central

Jacob, Eufemia; Stinson, Jennifer; Duran, Joana; Gupta, Ankur; Gerla, Mario; Lewis, Mary Ann; Zeltzer, Lonnie

2012-01-01

We examined the usability of smartphones for accessing a web-based e-Diary for self-monitoring symptoms in children and adolescents with sickle cell disease (SCD). One group of participants (n=10; mean age 13.1 ± 2.4 years; 5M; 5F) responded to questions using pre-completed paper-based measures. A second group (n=21; mean age 13.4 ± 2.4 years; 10M;11F) responded based on pain and symptoms they experienced over the previous 12 hours. The e-Diary was completed with at least 80% accuracy when compared to paper-based measures. Symptoms experienced over the previous 12 hours included feeling tired (33.3%), headache (28.6%), coughing (23.8%), lack of energy/fatigue (19.0%), yellowing of the eyes (19.0%), pallor (19.0%), irritability (19.0%), stiffness in joints (19.0%), general weakness (14.3%), and pain (14.3%), rating on average as 2.0 ± 1.7 (on 0 to 10 scale). Overall, sleep was good (8.1 ± 1.4 on the 0 to 10 scale). In conclusion, children with SCD were able to use smartphones to access a web-based e-Diary for reporting pain and symptoms. Smartphones may improve self-reporting of symptoms and communication between patients and their health care providers, who may consequently be able to improve pain and symptom management in children and adolescents with SCD in a timely manner. PMID:22627570

Interactivity Centered Usability Evaluation (ICUE) for Course Management Systems

ERIC Educational Resources Information Center

Yoon, Sangil

2010-01-01

ICUE (Interactivity Centered Usability Evaluation) is an enhanced usability testing protocol created by the researcher. ICUE augments the facilitator's role for usability testing, and offers strategies in developing and presenting usability tasks during a testing session. ICUE was designed to address weaknesses found in the usability evaluation of…

Healthy Beyond Pregnancy, a Web-Based Intervention to Improve Adherence to Postpartum Care: Randomized Controlled Feasibility Trial

PubMed Central

Donovan, Heidi; Wang, Stephanie; Weaver, Carrie; Grove, Jillian Rae; Facco, Francesca Lucia

2017-01-01

Background During the postpartum visit, health care providers address issues with short- and long-term implications for maternal and child health. Women with Medicaid insurance are less likely to return for a postpartum visit compared with women with private insurance. Behavioral economics acknowledges that people do not make exclusively rational choices, rather immediate gratification, cognitive and psychological biases, and social norms influence decision making. Drawing on insights from decision science, behavioral economists have examined how these biases can be modulated through carefully designed interventions. We have developed a Web-based tool, Healthy Beyond Pregnancy, that incorporates empirically derived concepts of behavioral economics to improve adherence rates to the postpartum visit. Objectives The primary objectives of this pilot study were to (1) refine and assess the usability of Healthy Beyond Pregnancy and (2) assess the feasibility of a randomized controlled trial (RCT) of the intervention. Methods We used a multistep process and multidisciplinary team of maternal-fetal medicine physicians, a behavioral economist, and researchers with expertise in behavioral interventions to design Healthy Beyond Pregnancy. We assessed the usability of the program with the Post-Study System Usability Questionnaire (PSSUQ), a validated 7-point scale, and semistructured interviews with postpartum women. We then conducted a feasibility trial to determine the proportion of eligible women who were willing to participate in an RCT of Healthy Beyond Pregnancy and the proportion of women willing to complete the Web-based program. Exploratory outcomes of the pilot trial included attendance at the postpartum visit, uptake of long-acting reversible contraception, and uptake of any contraception. Results The median PSSUQ score for Healthy Beyond Pregnancy was 6.5 (interquartile range: 6.1-7) demonstrating high usability. Semistructured interviews (n=10) provided in-depth comments about users’ experience and further improved the program. A total of 34 postpartum women with Medicaid insurance were approached for the pilot trial, and 30 (88%) were consented and randomized. All women randomized to Healthy Beyond Pregnancy completed the Web-based program, had text-enabled cell phones, and were willing to receive text messages from the study team. Women in the Healthy Beyond Pregnancy arm were more likely to return for a postpartum visit compared with women in the control arm with 85% of women in Healthy Beyond Pregnancy returning versus 53% in the control arm (odds ratio in the Healthy Beyond Pregnancy group: 5.3; 95% CI 0.9-32.0; P=.06). Conclusions We have developed a highly usable and acceptable Web-based program designed to increase attendance at the postpartum visit. Our pilot trial demonstrates that women are willing and able to participate in a randomized trial of a Web-based program and text messaging system. Trial Registration Clinicaltrials.gov NCT03296774; https://clinicaltrials.gov/ct2/show/NCT03296774 (Archived by WebCite at http://www.webcitation.org/6tpgXFzyk) PMID:29017990

Evaluating the Usability of a Free Electronic Health Record for Training

PubMed Central

Hoyt, Robert; Adler, Kenneth; Ziesemer, Brandy; Palombo, Georgina

2013-01-01

The United States will need to train a large workforce of skilled health information technology (HIT) professionals in order to meet the US government's goal of universal electronic health records (EHRs) for all patients and widespread health information exchange. The Health Information Technology for Economic and Clinical Health (HITECH) Act established several HIT workforce educational programs to accomplish this goal. Recent studies have shown that EHR usability is a significant concern of physicians and is a potential obstacle to EHR adoption. It is important to have a highly usable EHR to train both clinicians and students. In this article, we report a qualitative-quantitative usability analysis of a web-based EHR for training health informatics and health information management students. PMID:23805062

Accessibility and usability OCW data: The UTPL OCW.

PubMed

Rodríguez, Germania; Perez, Jennifer; Cueva, Samanta; Torres, Rommel

2017-08-01

This data article provides a data description on article entitled "A framework for improving web accessibility and usability of Open Course Ware sites" [3] This Data in Brief presents the data obtained from the accessibility and usability evaluation of the UTPL OCW. The data obtained from the framework evaluation consists of the manual evaluation of the standards criteria and the automatic evaluation of the tools Google PageSpeed and Google Analytics. In addition, this article presents the synthetized tables from standards that are used by the framework to evaluate the accessibility and usability of OCW, and the questionnaires required to extract the data. As a result, the article also provides the data required to reproduce the evaluation of other OCW.

Beyond Effectiveness: A Pragmatic Evaluation Framework for Learning and Continuous Quality Improvement of e-Learning Interventions in Healthcare.

PubMed

Dafalla, Tarig Dafalla Mohamed; Kushniruk, Andre W; Borycki, Elizabeth M

2015-01-01

A pragmatic evaluation framework for evaluating the usability and usefulness of an e-learning intervention for a patient clinical information scheduling system is presented in this paper. The framework was conceptualized based on two different but related concepts (usability and usefulness) and selection of appropriate and valid methods of data collection and analysis that included: (1) Low-Cost Rapid Usability Engineering (LCRUE), (2) Cognitive Task Analysis (CTA), (3) Heuristic Evaluation (HE) criteria for web-based learning, and (4) Software Usability Measurement Inventory (SUMI). The results of the analysis showed some areas where usability that were related to General Interface Usability (GIU), instructional design and content was problematic; some of which might account for the poorly rated aspects of usability when subjectively measured. This paper shows that using a pragmatic framework can be a useful way, not only for measuring the usability and usefulness, but also for providing a practical objective evidences for learning and continuous quality improvement of e-learning systems. The findings should be of interest to educators, developers, designers, researchers, and usability practitioners involved in the development of e-learning systems in healthcare. This framework could be an appropriate method for assessing the usability, usefulness and safety of health information systems both in the laboratory and in the clinical context.

Web service activities at the IRIS DMC to support federated and multidisciplinary access

NASA Astrophysics Data System (ADS)

Trabant, Chad; Ahern, Timothy K.

2013-04-01

At the IRIS Data Management Center (DMC) we have developed a suite of web service interfaces to access our large archive of, primarily seismological, time series data and related metadata. The goals of these web services include providing: a) next-generation and easily used access interfaces for our current users, b) access to data holdings in a form usable for non-seismologists, c) programmatic access to facilitate integration into data processing workflows and d) a foundation for participation in federated data discovery and access systems. To support our current users, our services provide access to the raw time series data and metadata or conversions of the raw data to commonly used formats. Our services also support simple, on-the-fly signal processing options that are common first steps in many workflows. Additionally, high-level data products derived from raw data are available via service interfaces. To support data access by researchers unfamiliar with seismic data we offer conversion of the data to broadly usable formats (e.g. ASCII text) and data processing to convert the data to Earth units. By their very nature, web services are programmatic interfaces. Combined with ubiquitous support for web technologies in programming & scripting languages and support in many computing environments, web services are very well suited for integrating data access into data processing workflows. As programmatic interfaces that can return data in both discipline-specific and broadly usable formats, our services are also well suited for participation in federated and brokered systems either specific to seismology or multidisciplinary. Working within the International Federation of Digital Seismograph Networks, the DMC collaborated on the specification of standardized web service interfaces for use at any seismological data center. These data access interfaces, when supported by multiple data centers, will form a foundation on which to build discovery and access mechanisms for data sets spanning multiple centers. To promote the adoption of these standardized services the DMC has developed portable implementations of the software needed to host these interfaces, minimizing the work required at each data center. Within the COOPEUS project framework, the DMC is working with EU partners to install web services implementations at multiple data centers in Europe.

Students' Usability Evaluation of a Web-Based Tutorial Program for College Biology Problem Solving

ERIC Educational Resources Information Center

Kim, H. S.; Prevost, L.; Lemons, P. P.

2015-01-01

The understanding of core concepts and processes of science in solving problems is important to successful learning in biology. We have designed and developed a Web-based, self-directed tutorial program, "SOLVEIT," that provides various scaffolds (e.g., prompts, expert models, visual guidance) to help college students enhance their…

WebDASC: a web-based dietary assessment software for 8-11-year-old Danish children.

PubMed

Biltoft-Jensen, A; Trolle, E; Christensen, T; Islam, N; Andersen, L F; Egenfeldt-Nielsen, S; Tetens, I

2014-01-01

  The present study describes the development and formative evaluation of the Web-based Dietary Assessment Software for Children (WebDASC). WebDASC is part of the OPUS project ('Optimal well-being, development and health for Danish children through a healthy New Nordic Diet') and was intended to measure dietary change resulting from a school-based intervention.   WebDASC was developed as a self-administered tool that could be used by 8-11-year-old children with or without parent's aid. The development of WebDASC followed a prototyping approach: focus groups, informal interviews, literature review, and usability tests preceded its release. Special consideration was given to age-appropriate design issues.   In WebDASC an animated armadillo guides respondents through six daily eating occasions and helps them report foods and beverages previously consumed. A database of 1300 food items is available either through category browse or free text search, aided by a spell check application. A type-in format is available for foods not otherwise found through category browse or text search. Amount consumed is estimated by selecting the closest portion size among four different digital images. WebDASC includes internal checks for frequently forgotten foods, and the following features to create motivation: a food-meter displaying cumulative weight of foods reported, a most popular food ranking, and a computer game with a high score list.   WebDASC was developed as an intuitive, cost-effective, and engaging method to collect detailed dietary data from 8- to 11-year-old children. Preliminary testing demonstrated that it was well accepted among children. © 2012 The Authors. Journal of Human Nutrition and Dietetics © 2012 The British Dietetic Association Ltd.

A Study on the Usability of a University Registrar's Office Website through the Methods of Authentic Tasks and Eye-Tracking

ERIC Educational Resources Information Center

Tuzun, Hakan; Akinci, Ahmet; Kurtoglu, Meltem; Atal, Deniz; Pala, Ferkat Kadir

2013-01-01

Universities are one of the most important institutions that offer online services. It is observed that one of the most used web pages by university students is the registrar's office website, since students can access a great deal of information they need through this page. In this study, the usability of the registrar's office website, which can…

Evaluation of a Telerehabilitation System for Community-Based Rehabilitation

PubMed Central

Schutte, Jamie; Gales, Sara; Filippone, Ashlee; Saptono, Andi; Parmanto, Bambang; McCue, Michael

2012-01-01

The use of web-based portals, while increasing in popularity in the fields of medicine and research, are rarely reported on in community-based rehabilitation programs. A program within the Pennsylvania Office of Vocational Rehabilitation’s Hiram G. Andrews Center, the Cognitive Skills Enhancement Program (CSEP), sought to enhance organization of program and participant information and communication between part- and full-time employees, supervisors and consultants. A telerehabilitation system was developed consisting of (1) a web-based portal to support a variety of clinical activities, and (2) the Versatile Integrated System for Telerehabilitation (VISYTER) video-conferencing system to support the collaboration and delivery of rehabilitation services remotely. This descriptive evaluation examines the usability of the telerehabilitation system incorporating both the portal and VISYTER. Telerehabilitation system users include CSEP staff members from three geographical locations and employed by two institutions. The IBM After-Scenario Questionnaire (ASQ) and Post-Study System Usability Questionnaire (PSSUQ), the Telehealth Usability Questionnaire (TUQ), and two demographic surveys were administered to gather both objective and subjective information. Results showed generally high levels of usability. Users commented that the telerehabilitation system improved communication, increased access to information, improved speed of completing tasks, and had an appealing interface. Areas where users would like to see improvements, including ease of accessing/editing documents and searching for information, are discussed. PMID:25945193

Usability and utility evaluation of the web-based "Should I Start Insulin?" patient decision aid for patients with type 2 diabetes among older people.

PubMed

Lee, Yew Kong; Lee, Ping Yein; Ng, Chirk Jenn; Teo, Chin Hai; Abu Bakar, Ahmad Ihsan; Abdullah, Khatijah Lim; Khoo, Ee Ming; Hanafi, Nik Sherina; Low, Wah Yun; Chiew, Thiam Kian

2018-01-01

This study aimed to evaluate the usability (ease of use) and utility (impact on user's decision-making process) of a web-based patient decision aid (PDA) among older-age users. A pragmatic, qualitative research design was used. We recruited patients with type 2 diabetes who were at the point of making a decision about starting insulin from a tertiary teaching hospital in Malaysia in 2014. Computer screen recording software was used to record the website browsing session and in-depth interviews were conducted while playing back the website recording. The interviews were analyzed using the framework approach to identify usability and utility issues. Three cycles of iteration were conducted until no more major issues emerged. Thirteen patients participated: median age 65 years old, 10 men, and nine had secondary education/diploma, four were graduates/had postgraduate degree. Four usability issues were identified (navigation between pages and sections, a layout with open display, simple language, and equipment preferences). For utility, participants commented that the website influenced their decision about insulin in three ways: it had provided information about insulin, it helped them deliberate choices using the option-attribute matrix, and it allowed them to involve others in their decision making by sharing the PDA summary printout.

Advancements in Data Access at the IRIS Data Management Center to Broaden Data Use

NASA Astrophysics Data System (ADS)

Benson, R. B.; Trabant, C. M.; Ahern, T. K.

2013-12-01

The IRIS Data Management Center (DMC) has been serving digital seismic data for more than 20 years and has offered a variety of access mechanisms that have stood the test of time. However, beginning in 2010, and in response to multiple needs being requested from the IRIS DMC, we have developed web service interfaces to access our primary data repository. These new interfaces have rapidly grown in popularity. In 2013, the third full year of their operation, these services were responsible for half of all the data shipped from the DMC. In the same time period, the amount of data shipped from the other data access mechanisms has also increased. This non-linear growth of data shipments reflects the increased data usage by the research community. We believe that our new web service interfaces are well suited to fit future data access needs and signify a significant evolution in integrating different scientific data sets. Based on standardized web technologies, support for writing access software is ubiquitous. As fundamentally programmatic interfaces, the services are well suited for integration into data processing systems, in particular large-scale data processing systems. Their programmatic nature also makes then well suited for use with brokering systems where, for example, data from multiple disciplines can be integrated. In addition to providing access to raw data, the DMC created web services that apply simple, on-the-fly processing and format conversion. Processing the data (e.g. converting to Earth units) and formatting the result into something generally usable (e.g. ASCII) removes important barriers for users working in other disciplines. The end result is that we are shipping a much larger amount of data in a manner more directly usable by users. Many of these principles will be applied to the DMC's future work in the NSF's EarthCube Web Service Building Blocks project.

Pilot Testing a Web-Based System for the Assessment and Management of Chemotherapy-Induced Peripheral Neuropathy.

PubMed

Knoerl, Robert; Dudley, William N; Smith, Gloria; Bridges, Celia; Kanzawa-Lee, Grace; Lavoie Smith, Ellen M

2017-04-01

Because numerous barriers hinder the assessment and management of chemotherapy-induced peripheral neuropathy in clinical practice, the Carevive Care Planning System, a novel Web-based platform, was developed to address these barriers. It provides patients an opportunity to report their symptoms before their clinic visit and generates customizable care plans composed of evidence-based management strategies. The purpose of this study was to evaluate patient and provider perspectives of feasibility, usability, acceptability, and satisfaction with the Carevive platform. We used a single-arm, pretest/posttest, prospective design and recruited 25 women with breast cancer who were receiving neurotoxic chemotherapy and six advanced practice providers from an academic hospital. At three consecutive clinical visits, patients reported their neuropathy symptoms on a tablet via the Carevive system. The Diffusion of Innovations Theory served as an overarching evaluation framework. The Carevive platform was feasible to use. However, patients had higher ratings of usability, acceptability, and satisfaction with the platform than did the providers, who disliked the amount of time required to use the platform and had difficulty logging into Carevive. If issues regarding provider dissatisfaction can be addressed, the Carevive platform may aid in the screening of neuropathy symptoms and facilitate the use of evidence-based management strategies.

An optimized web-based approach for collaborative stereoscopic medical visualization

PubMed Central

Kaspar, Mathias; Parsad, Nigel M; Silverstein, Jonathan C

2013-01-01

Objective Medical visualization tools have traditionally been constrained to tethered imaging workstations or proprietary client viewers, typically part of hospital radiology systems. To improve accessibility to real-time, remote, interactive, stereoscopic visualization and to enable collaboration among multiple viewing locations, we developed an open source approach requiring only a standard web browser with no added client-side software. Materials and Methods Our collaborative, web-based, stereoscopic, visualization system, CoWebViz, has been used successfully for the past 2 years at the University of Chicago to teach immersive virtual anatomy classes. It is a server application that streams server-side visualization applications to client front-ends, comprised solely of a standard web browser with no added software. Results We describe optimization considerations, usability, and performance results, which make CoWebViz practical for broad clinical use. We clarify technical advances including: enhanced threaded architecture, optimized visualization distribution algorithms, a wide range of supported stereoscopic presentation technologies, and the salient theoretical and empirical network parameters that affect our web-based visualization approach. Discussion The implementations demonstrate usability and performance benefits of a simple web-based approach for complex clinical visualization scenarios. Using this approach overcomes technical challenges that require third-party web browser plug-ins, resulting in the most lightweight client. Conclusions Compared to special software and hardware deployments, unmodified web browsers enhance remote user accessibility to interactive medical visualization. Whereas local hardware and software deployments may provide better interactivity than remote applications, our implementation demonstrates that a simplified, stable, client approach using standard web browsers is sufficient for high quality three-dimensional, stereoscopic, collaborative and interactive visualization. PMID:23048008

Mind the Gap

PubMed Central

Fairbanks, Terry; Savage, Erica; Adams, Katie; Wittie, Michael; Boone, Edna; Hayden, Andrew; Barnes, Janey; Hettinger, Zach; Gettinger, Andrew

2016-01-01

Summary Objective Decisions made during electronic health record (EHR) implementations profoundly affect usability and safety. This study aims to identify gaps between the current literature and key stakeholders’ perceptions of usability and safety practices and the challenges encountered during the implementation of EHRs. Materials and Methods Two approaches were used: a literature review and interviews with key stakeholders. We performed a systematic review of the literature to identify usability and safety challenges and best practices during implementation. A total of 55 articles were reviewed through searches of PubMed, Web of Science and Scopus. We used a qualitative approach to identify key stakeholders’ perceptions; semi-structured interviews were conducted with a diverse set of health IT stakeholders to understand their current practices and challenges related to usability during implementation. We used a grounded theory approach: data were coded, sorted, and emerging themes were identified. Conclusions from both sources of data were compared to identify areas of misalignment. Results We identified six emerging themes from the literature and stakeholder interviews: cost and resources, risk assessment, governance and consensus building, customization, clinical work-flow and usability testing, and training. Across these themes, there were misalignments between the literature and stakeholder perspectives, indicating major gaps. Discussion Major gaps identified from each of six emerging themes are discussed as critical areas for future research, opportunities for new stakeholder initiatives, and opportunities to better disseminate resources to improve the implementation of EHRs. Conclusion Our analysis identified practices and challenges across six different emerging themes, illustrated important gaps, and results suggest critical areas for future research and dissemination to improve EHR implementation. PMID:27847961

Are Pretty Interfaces Worth the Time? The Effects of User Interface Types on Web-Based Instruction

ERIC Educational Resources Information Center

Cheon, Jongpil; Grant, Michael M.

2009-01-01

The purpose of this study was to examine the effectiveness of three different interface types on Web-based instruction: a text-based interface, a graphical interface and a metaphorical interface. In order to determine differences among three interface groups, we compared learning performance, cognitive load, usability, and appeal with various data…

A Survey of the Usability of Digital Reference Services on Academic Health Science Library Web Sites

ERIC Educational Resources Information Center

Dee, Cheryl; Allen, Maryellen

2006-01-01

Reference interactions with patrons in a digital library environment using digital reference services (DRS) has become widespread. However, such services in many libraries appear to be underutilized. A study surveying the ease and convenience of such services for patrons in over 100 academic health science library Web sites suggests that…

"UML Quiz": Automatic Conversion of Web-Based E-Learning Content in Mobile Applications

ERIC Educational Resources Information Center

von Franqué, Alexander; Tellioglu, Hilda

2014-01-01

Many educational institutions use Learning Management Systems to provide e-learning content to their students. This often includes quizzes that can help students to prepare for exams. However, the content is usually web-optimized and not very usable on mobile devices. In this work a native mobile application ("UML Quiz") that imports…

Now That Your Students Have Created Web-Based Digital Portfolios, How Do You Evaluate Them?

ERIC Educational Resources Information Center

Goldsby, Dianne; Fazal, Minaz

2001-01-01

Discussion of the growing use of digital portfolios for student assessment focuses on a program at Iona College to develop a four-point rubric to evaluate students' Web-based digital portfolios. Considers form (design and aesthetics), function and usability (ease of use), and components (presence and communication of the required samples).…

Usability and trust in e-banking.

PubMed

Pravettoni, Gabriella; Leotta, Salvatore Nuccio; Lucchiari, Claudio; Misuraca, Raffaella

2007-12-01

This study assessed the role of usability in trust of e-banking services. A questionnaire was administered to 185 Italian undergraduate working students who volunteered for the experiment (M age = 30.5 yr., SD = 3.1). Participants were differentiated on computer ability (Expert, n = 104; Nonexpert, n = 81) and e-banking use (User, n = 93; Nonusers, n = 92). Analysis showed that the website usability of e-banking services did not play a very important role for the User group. Instead, institution-based trust, e.g., the trust in the security policy of the Web merchant, customers, and the overall trust of the bank were the crucial factors in the adoption of e-banking.

Ten factors to consider when developing usability scenarios and tasks for health information technology.

PubMed

Russ, Alissa L; Saleem, Jason J

2018-02-01

The quality of usability testing is highly dependent upon the associated usability scenarios. To promote usability testing as part of electronic health record (EHR) certification, the Office of the National Coordinator (ONC) for Health Information Technology requires that vendors test specific capabilities of EHRs with clinical end-users and report their usability testing process - including the test scenarios used - along with the results. The ONC outlines basic expectations for usability testing, but there is little guidance in usability texts or scientific literature on how to develop usability scenarios for healthcare applications. The objective of this article is to outline key factors to consider when developing usability scenarios and tasks to evaluate computer-interface based health information technologies. To achieve this goal, we draw upon a decade of our experience conducting usability tests with a variety of healthcare applications and a wide range of end-users, to include healthcare professionals as well as patients. We discuss 10 key factors that influence scenario development: objectives of usability testing; roles of end-user(s); target performance goals; evaluation time constraints; clinical focus; fidelity; scenario-related bias and confounders; embedded probes; minimize risks to end-users; and healthcare related outcome measures. For each factor, we present an illustrative example. This article is intended to aid usability researchers and practitioners in their efforts to advance health information technologies. The article provides broad guidance on usability scenario development and can be applied to a wide range of clinical information systems and applications. Published by Elsevier Inc.

Usage and Usability of a Web-based Program for Family Caregivers of Older People in Three European Countries: A Mixed-Methods Evaluation.

PubMed

Barbabella, Francesco; Poli, Arianna; Hanson, Elizabeth; Andréasson, Frida; Salzmann, Benjamin; Döhner, Hanneli; Papa, Roberta; Efthymiou, Areti; Valenza, Silvia; Pelliccioni, Giuseppe; Lamura, Giovanni

2018-05-01

InformCare is a European Web platform that supports informal caregivers of older people by providing access to online information and professional and peer support. The aim of this study was to assess the usage and usability of a psychosocial Web-based program carried out in three European countries (Italy, Sweden, and Germany). A mixed-methods sequential explanatory design was adopted, comprising baseline and postintervention assessments, as well as combined thematic content analysis of results and focus group findings. A convenience sample of 118 caregivers was enrolled, of whom 94 used the services offered by the program at least once. The subsamples in the three countries used the platform in different ways, with a predominance of passive strategies (eg, seeking information and reading other people's comments) for Italian caregivers, and more active usage by Swedish and German caregivers. The usability assessment showed that the platform was perceived well by Italian and German caregivers, whereas technical problems affected the Swedish sample's experiences. Focus group data highlighted user satisfaction with the online support and reliability of the environment. Recommendations for practitioners are to ensure digital training for caregivers who have lower confidence in use of the Internet, to involve different healthcare professionals in the provision of professional support, and to adequately manage online community building.

Competency-Based Assessment for Clinical Supervisors: Design-Based Research on a Web-Delivered Program

PubMed Central

Williams, Lauren Therese; Grealish, Laurie; Jamieson, Maggie

2015-01-01

Background Clinicians need to be supported by universities to use credible and defensible assessment practices during student placements. Web-based delivery of clinical education in student assessment offers professional development regardless of the geographical location of placement sites. Objective This paper explores the potential for a video-based constructivist Web-based program to support site supervisors in their assessments of student dietitians during clinical placements. Methods This project was undertaken as design-based research in two stages. Stage 1 describes the research consultation, development of the prototype, and formative feedback. In Stage 2, the program was pilot-tested and evaluated by a purposeful sample of nine clinical supervisors. Data generated as a result of user participation during the pilot test is reported. Users’ experiences with the program were also explored via interviews (six in a focus group and three individually). The interviews were transcribed verbatim and thematic analysis conducted from a pedagogical perspective using van Manen’s highlighting approach. Results This research succeeded in developing a Web-based program, “Feed our Future”, that increased supervisors’ confidence with their competency-based assessments of students on clinical placements. Three pedagogical themes emerged: constructivist design supports transformative Web-based learning; videos make abstract concepts tangible; and accessibility, usability, and pedagogy are interdependent. Conclusions Web-based programs, such as Feed our Future, offer a viable means for universities to support clinical supervisors in their assessment practices during clinical placements. A design-based research approach offers a practical process for such Web-based tool development, highlighting pedagogical barriers for planning purposes. PMID:25803172

Image processing and applications based on visualizing navigation service

NASA Astrophysics Data System (ADS)

Hwang, Chyi-Wen

2015-07-01

When facing the "overabundant" of semantic web information, in this paper, the researcher proposes the hierarchical classification and visualizing RIA (Rich Internet Application) navigation system: Concept Map (CM) + Semantic Structure (SS) + the Knowledge on Demand (KOD) service. The aim of the Multimedia processing and empirical applications testing, was to investigating the utility and usability of this visualizing navigation strategy in web communication design, into whether it enables the user to retrieve and construct their personal knowledge or not. Furthermore, based on the segment markets theory in the Marketing model, to propose a User Interface (UI) classification strategy and formulate a set of hypermedia design principles for further UI strategy and e-learning resources in semantic web communication. These research findings: (1) Irrespective of whether the simple declarative knowledge or the complex declarative knowledge model is used, the "CM + SS + KOD navigation system" has a better cognition effect than the "Non CM + SS + KOD navigation system". However, for the" No web design experience user", the navigation system does not have an obvious cognition effect. (2) The essential of classification in semantic web communication design: Different groups of user have a diversity of preference needs and different cognitive styles in the CM + SS + KOD navigation system.

Satisfaction with web-based training in an integrated healthcare delivery network: do age, education, computer skills and attitudes matter?

PubMed Central

Atreja, Ashish; Mehta, Neil B; Jain, Anil K; Harris, CM; Ishwaran, Hemant; Avital, Michel; Fishleder, Andrew J

2008-01-01

Background Healthcare institutions spend enormous time and effort to train their workforce. Web-based training can potentially streamline this process. However the deployment of web-based training in a large-scale setting with a diverse healthcare workforce has not been evaluated. The aim of this study was to evaluate the satisfaction of healthcare professionals with web-based training and to determine the predictors of such satisfaction including age, education status and computer proficiency. Methods Observational, cross-sectional survey of healthcare professionals from six hospital systems in an integrated delivery network. We measured overall satisfaction to web-based training and response to survey items measuring Website Usability, Course Usefulness, Instructional Design Effectiveness, Computer Proficiency and Self-learning Attitude. Results A total of 17,891 healthcare professionals completed the web-based training on HIPAA Privacy Rule; and of these, 13,537 completed the survey (response rate 75.6%). Overall course satisfaction was good (median, 4; scale, 1 to 5) with more than 75% of the respondents satisfied with the training (rating 4 or 5) and 65% preferring web-based training over traditional instructor-led training (rating 4 or 5). Multivariable ordinal regression revealed 3 key predictors of satisfaction with web-based training: Instructional Design Effectiveness, Website Usability and Course Usefulness. Demographic predictors such as gender, age and education did not have an effect on satisfaction. Conclusion The study shows that web-based training when tailored to learners' background, is perceived as a satisfactory mode of learning by an interdisciplinary group of healthcare professionals, irrespective of age, education level or prior computer experience. Future studies should aim to measure the long-term outcomes of web-based training. PMID:18922178

Healthy Beyond Pregnancy, a Web-Based Intervention to Improve Adherence to Postpartum Care: Randomized Controlled Feasibility Trial.

PubMed

Himes, Katherine Park; Donovan, Heidi; Wang, Stephanie; Weaver, Carrie; Grove, Jillian Rae; Facco, Francesca Lucia

2017-10-10

During the postpartum visit, health care providers address issues with short- and long-term implications for maternal and child health. Women with Medicaid insurance are less likely to return for a postpartum visit compared with women with private insurance. Behavioral economics acknowledges that people do not make exclusively rational choices, rather immediate gratification, cognitive and psychological biases, and social norms influence decision making. Drawing on insights from decision science, behavioral economists have examined how these biases can be modulated through carefully designed interventions. We have developed a Web-based tool, Healthy Beyond Pregnancy, that incorporates empirically derived concepts of behavioral economics to improve adherence rates to the postpartum visit. The primary objectives of this pilot study were to (1) refine and assess the usability of Healthy Beyond Pregnancy and (2) assess the feasibility of a randomized controlled trial (RCT) of the intervention. We used a multistep process and multidisciplinary team of maternal-fetal medicine physicians, a behavioral economist, and researchers with expertise in behavioral interventions to design Healthy Beyond Pregnancy. We assessed the usability of the program with the Post-Study System Usability Questionnaire (PSSUQ), a validated 7-point scale, and semistructured interviews with postpartum women. We then conducted a feasibility trial to determine the proportion of eligible women who were willing to participate in an RCT of Healthy Beyond Pregnancy and the proportion of women willing to complete the Web-based program. Exploratory outcomes of the pilot trial included attendance at the postpartum visit, uptake of long-acting reversible contraception, and uptake of any contraception. The median PSSUQ score for Healthy Beyond Pregnancy was 6.5 (interquartile range: 6.1-7) demonstrating high usability. Semistructured interviews (n=10) provided in-depth comments about users' experience and further improved the program. A total of 34 postpartum women with Medicaid insurance were approached for the pilot trial, and 30 (88%) were consented and randomized. All women randomized to Healthy Beyond Pregnancy completed the Web-based program, had text-enabled cell phones, and were willing to receive text messages from the study team. Women in the Healthy Beyond Pregnancy arm were more likely to return for a postpartum visit compared with women in the control arm with 85% of women in Healthy Beyond Pregnancy returning versus 53% in the control arm (odds ratio in the Healthy Beyond Pregnancy group: 5.3; 95% CI 0.9-32.0; P=.06). We have developed a highly usable and acceptable Web-based program designed to increase attendance at the postpartum visit. Our pilot trial demonstrates that women are willing and able to participate in a randomized trial of a Web-based program and text messaging system. Clinicaltrials.gov NCT03296774; https://clinicaltrials.gov/ct2/show/NCT03296774 (Archived by WebCite at http://www.webcitation.org/6tpgXFzyk). ©Katherine Park Himes, Heidi Donovan, Stephanie Wang, Carrie Weaver, Jillian Rae Grove, Francesca Lucia Facco. Originally published in JMIR Human Factors (http://humanfactors.jmir.org), 10.10.2017.

Quality of online pediatric orthopaedic education materials.

PubMed

Feghhi, Daniel P; Komlos, Daniel; Agarwal, Nitin; Sabharwal, Sanjeev

2014-12-03

Increased availability of medical information on the Internet empowers patients to look up answers to questions about their medical conditions. However, the quality of medical information available on the Internet is highly variable. Various tools for the assessment of online medical information have been developed and used to assess the quality and accuracy of medical web sites. In this study we used the LIDA tool (Minervation) to assess the quality of pediatric patient information on the AAOS (American Academy of Orthopaedic Surgeons) and POSNA (Pediatric Orthopaedic Society of North America) web sites. The accessibility, usability, and reliability of online medical information in the "Children" section of the AAOS web site and on the POSNA web site were assessed with use of the LIDA tool. Flesch-Kincaid (FK) and Flesch Reading Ease (FRE) values were also calculated to assess the readability of the pediatric education material. Patient education materials on each web site scored in the moderate range in assessments of accessibility, usability, and reliability. FK and FRE values indicated that the readability of each web site remained at a somewhat higher (more difficult) level than the recommended benchmark. The quality and readability of online information for children on the AAOS and POSNA web sites are acceptable but can be improved further. The quality of online pediatric orthopaedic patient education materials may affect communication with patients and their caregivers, and further investigation and modification of quality are needed. Copyright © 2014 by The Journal of Bone and Joint Surgery, Incorporated.

A Web-Based Training Resource for Therapists to Deliver an Evidence-Based Exercise Program for Rheumatoid Arthritis of the Hand (iSARAH): Design, Development, and Usability Testing.

PubMed

Srikesavan, Cynthia Swarnalatha; Williamson, Esther; Eldridge, Lucy; Heine, Peter; Adams, Jo; Cranston, Tim; Lamb, Sarah E

2017-12-13

The Strengthening and Stretching for Rheumatoid Arthritis of the Hand (SARAH) is a tailored, progressive exercise program for people having difficulties with wrist and hand function due to rheumatoid arthritis (RA). The program was evaluated in a large-scale clinical trial and was found to improve hand function, was safe to deliver, and was cost-effective. These findings led to the SARAH program being recommended in the UK National Institute for Health and Care Excellence guidelines for the management of adults with RA. To facilitate the uptake of this evidence-based program by clinicians, we proposed a Web-based training program for SARAH (iSARAH) to educate and train physiotherapists and occupational therapists on delivering the SARAH program in their practice. The overall iSARAH implementation project was guided by the 5 phases of the analysis, design, development, implementation, and evaluation (ADDIE) system design model. The objective of our study was to conduct the first 3 phases of the model in the development of the iSARAH project. Following publication of the trial, the SARAH program materials were made available to therapists to download from the trial website for use in clinical practice. A total of 35 therapists who downloaded these materials completed an online survey to provide feedback on practice trends in prescribing hand exercises for people with RA, perceived barriers and facilitators to using the SARAH program in clinical practice, and their preferences for the content and Web features of iSARAH. The development and design of iSARAH were further guided by a team of multidisciplinary health professionals (n=17) who took part in a half-day development meeting. We developed the preliminary version of iSARAH and tested it among therapists (n=10) to identify and rectify usability issues and to produce the final version. The major recommendations made by therapists and the multidisciplinary team were having a simple Web design and layout, clear exercise pictures and videos, and compatibility of iSARAH on various browsers and devices. We rectified all usability issues in the preliminary version to develop the final version of iSARAH, which included 4 short modules and additional sections on self-assessment, frequently asked questions, and a resource library. The use of the ADDIE design model and engagement of end users in the development and evaluation phases have rendered iSARAH a convenient, easy-to-use, and effective Web-based learning resource for therapists on how to deliver the SARAH program. There is also huge potential for adapting iSARAH across different cultures and languages, thus opening more opportunities for wider uptake and application of the SARAH program into practice. ©Cynthia Swarnalatha Srikesavan, Esther Williamson, Lucy Eldridge, Peter Heine, Jo Adams, Tim Cranston, Sarah E Lamb. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 13.12.2017.

A Web-Based Training Resource for Therapists to Deliver an Evidence-Based Exercise Program for Rheumatoid Arthritis of the Hand (iSARAH): Design, Development, and Usability Testing

PubMed Central

Williamson, Esther; Eldridge, Lucy; Heine, Peter; Adams, Jo; Cranston, Tim; Lamb, Sarah E

2017-01-01

Background The Strengthening and Stretching for Rheumatoid Arthritis of the Hand (SARAH) is a tailored, progressive exercise program for people having difficulties with wrist and hand function due to rheumatoid arthritis (RA). The program was evaluated in a large-scale clinical trial and was found to improve hand function, was safe to deliver, and was cost-effective. These findings led to the SARAH program being recommended in the UK National Institute for Health and Care Excellence guidelines for the management of adults with RA. To facilitate the uptake of this evidence-based program by clinicians, we proposed a Web-based training program for SARAH (iSARAH) to educate and train physiotherapists and occupational therapists on delivering the SARAH program in their practice. The overall iSARAH implementation project was guided by the 5 phases of the analysis, design, development, implementation, and evaluation (ADDIE) system design model. Objective The objective of our study was to conduct the first 3 phases of the model in the development of the iSARAH project. Methods Following publication of the trial, the SARAH program materials were made available to therapists to download from the trial website for use in clinical practice. A total of 35 therapists who downloaded these materials completed an online survey to provide feedback on practice trends in prescribing hand exercises for people with RA, perceived barriers and facilitators to using the SARAH program in clinical practice, and their preferences for the content and Web features of iSARAH. The development and design of iSARAH were further guided by a team of multidisciplinary health professionals (n=17) who took part in a half-day development meeting. We developed the preliminary version of iSARAH and tested it among therapists (n=10) to identify and rectify usability issues and to produce the final version. Results The major recommendations made by therapists and the multidisciplinary team were having a simple Web design and layout, clear exercise pictures and videos, and compatibility of iSARAH on various browsers and devices. We rectified all usability issues in the preliminary version to develop the final version of iSARAH, which included 4 short modules and additional sections on self-assessment, frequently asked questions, and a resource library. Conclusions The use of the ADDIE design model and engagement of end users in the development and evaluation phases have rendered iSARAH a convenient, easy-to-use, and effective Web-based learning resource for therapists on how to deliver the SARAH program. There is also huge potential for adapting iSARAH across different cultures and languages, thus opening more opportunities for wider uptake and application of the SARAH program into practice. PMID:29237581

Development and Testing of a Multidimensional iPhone Pain Assessment Application for Adolescents with Cancer

PubMed Central

Jibb, Lindsay A; Nguyen, Cynthia; Nathan, Paul C; Maloney, Anne Marie; Dupuis, L Lee; Gerstle, J Ted; Alman, Benjamin; Hopyan, Sevan; Strahlendorf, Caron; Portwine, Carol; Johnston, Donna L; Orr, Mike

2013-01-01

Background Pain is one of the most common and distressing symptoms reported by adolescents with cancer. Despite advancements in pain assessment and management research, pain due to cancer and/or its treatments continues to be poorly managed. Our research group has developed a native iPhone application (app) called Pain Squad to tackle the problem of poorly managed pain in the adolescent with cancer group. The app functions as an electronic pain diary and is unique in its ability to collect data on pain intensity, duration, location, and the impact pain has on an adolescent’s life (ie, relationships, school work, sleep, mood). It also evaluates medications and other physical and psychological pain management strategies used. Users are prompted twice daily at configurable times to complete 20 questions characterizing their pain and the app transmits results to a database for aggregate reporting through a Web interface. Each diary entry represents a pain case filed by an adolescent with cancer and a reward system (ie, moving up through law-enforcement team ranks, built-in videotaped acknowledgements from fictitious officers) encourages consistent use of the diary. Objective Our objective was to design, develop, and test the usability, feasibility, compliance, and satisfaction of a game-based smartphone pain assessment tool for adolescents with cancer. Methods We used both low- and high-fidelity qualitative usability testing with qualitative semi-structured, audio-taped interviews and iterative cycles to design and refine the iPhone based Pain Squad app. Qualitative thematic analysis of interviews using constant comparative methodology captured emergent themes related to app usability. Content validity was assessed using question importance-rating surveys completed by participants. Compliance and satisfaction data were collected following a 2-week feasibility trial where users were alarmed to record their pain twice daily on the app. Results Thematic analysis of usability interviews showed the app to be appealing overall to adolescents. Analyses of both low- and high-fidelity testing resulted in minor revisions to the app to refine the theme and improve its usability. Adolescents resoundingly endorsed the game-based nature of the app and its virtual reward system. The importance of app pain diary questions was established by content validity analysis. Compliance with the app, assessed during feasibility testing, was high (mean 81%, SD 22%) and adolescents from this phase of the study found the app likeable, easy to use, and not bothersome to complete. Conclusions A multifaceted usability approach demonstrated how the Pain Squad app could be made more appealing to children and adolescents with cancer. The game-based nature and built-in reward system of the app was appealing to adolescents and may have resulted in the high compliance rates and satisfaction ratings observed during clinical feasibility testing. PMID:23475457

Development and testing of a multidimensional iPhone pain assessment application for adolescents with cancer.

PubMed

Stinson, Jennifer N; Jibb, Lindsay A; Nguyen, Cynthia; Nathan, Paul C; Maloney, Anne Marie; Dupuis, L Lee; Gerstle, J Ted; Alman, Benjamin; Hopyan, Sevan; Strahlendorf, Caron; Portwine, Carol; Johnston, Donna L; Orr, Mike

2013-03-08

Pain is one of the most common and distressing symptoms reported by adolescents with cancer. Despite advancements in pain assessment and management research, pain due to cancer and/or its treatments continues to be poorly managed. Our research group has developed a native iPhone application (app) called Pain Squad to tackle the problem of poorly managed pain in the adolescent with cancer group. The app functions as an electronic pain diary and is unique in its ability to collect data on pain intensity, duration, location, and the impact pain has on an adolescent's life (ie, relationships, school work, sleep, mood). It also evaluates medications and other physical and psychological pain management strategies used. Users are prompted twice daily at configurable times to complete 20 questions characterizing their pain and the app transmits results to a database for aggregate reporting through a Web interface. Each diary entry represents a pain case filed by an adolescent with cancer and a reward system (ie, moving up through law-enforcement team ranks, built-in videotaped acknowledgements from fictitious officers) encourages consistent use of the diary. Our objective was to design, develop, and test the usability, feasibility, compliance, and satisfaction of a game-based smartphone pain assessment tool for adolescents with cancer. We used both low- and high-fidelity qualitative usability testing with qualitative semi-structured, audio-taped interviews and iterative cycles to design and refine the iPhone based Pain Squad app. Qualitative thematic analysis of interviews using constant comparative methodology captured emergent themes related to app usability. Content validity was assessed using question importance-rating surveys completed by participants. Compliance and satisfaction data were collected following a 2-week feasibility trial where users were alarmed to record their pain twice daily on the app. Thematic analysis of usability interviews showed the app to be appealing overall to adolescents. Analyses of both low- and high-fidelity testing resulted in minor revisions to the app to refine the theme and improve its usability. Adolescents resoundingly endorsed the game-based nature of the app and its virtual reward system. The importance of app pain diary questions was established by content validity analysis. Compliance with the app, assessed during feasibility testing, was high (mean 81%, SD 22%) and adolescents from this phase of the study found the app likeable, easy to use, and not bothersome to complete. A multifaceted usability approach demonstrated how the Pain Squad app could be made more appealing to children and adolescents with cancer. The game-based nature and built-in reward system of the app was appealing to adolescents and may have resulted in the high compliance rates and satisfaction ratings observed during clinical feasibility testing.

A Multimedia Child Developmental Screening Checklist: Design and Validation

PubMed Central

Cheng, Hsin-Yi Kathy; Chen, Li-Ying; Cheng, Chih-Hsiu; Ju, Yan-Ying; Chen, Chia-Ling

2016-01-01

Background Identifying disability early in life confers long-term benefits for children. The Taipei City Child Development Screening tool, second version (Taipei II) provides checklists for 13 child age groups from 4 months to 6 years. However, the usability of a text-based screening tool largely depends on the literacy level and logical reasoning ability of the caregivers, as well as language barriers caused by increasing numbers of immigrants. Objective The objectives of this study were to (1) design and develop a Web-based multimedia version of the current Taipei II developmental screening tool, and (2) investigate the measurement equivalence of this multimedia version to the original paper-based version. Methods To develop the multimedia version of Taipei II, a team of experts created illustrations, translations, and dubbing of the original checklists. The developmental screening test was administered to a total of 390 primary caregivers of children aged between 4 months and 6 years. Results Psychometric testing revealed excellent agreement between the paper and multimedia versions of Taipei II. Good to excellent reliabilities were demonstrated for all age groups for both the cross-mode similarity (mode intraclass correlation range 0.85-0.96) and the test-retest reliability (r=.93). Regarding the usability, the mean score was 4.80 (SD 0.03), indicating that users were satisfied with their multimedia website experience. Conclusions The multimedia tool produced essentially equivalent results to the paper-based tool. In addition, it had numerous advantages, such as it can facilitate active participation and promote early screening of target populations. ClinicalTrial Clinicaltrials.gov NCT02359591; https://clinicaltrials.gov/ct2/show/NCT02359591 (Archived by WebCite at http://www.webcitation.org/6l21mmdNn) PMID:27777218

A Multimedia Child Developmental Screening Checklist: Design and Validation.

PubMed

Cheng, Hsin-Yi Kathy; Chen, Li-Ying; Cheng, Chih-Hsiu; Ju, Yan-Ying; Chen, Chia-Ling; Tseng, Kevin C

2016-10-24

Identifying disability early in life confers long-term benefits for children. The Taipei City Child Development Screening tool, second version (Taipei II) provides checklists for 13 child age groups from 4 months to 6 years. However, the usability of a text-based screening tool largely depends on the literacy level and logical reasoning ability of the caregivers, as well as language barriers caused by increasing numbers of immigrants. The objectives of this study were to (1) design and develop a Web-based multimedia version of the current Taipei II developmental screening tool, and (2) investigate the measurement equivalence of this multimedia version to the original paper-based version. To develop the multimedia version of Taipei II, a team of experts created illustrations, translations, and dubbing of the original checklists. The developmental screening test was administered to a total of 390 primary caregivers of children aged between 4 months and 6 years. Psychometric testing revealed excellent agreement between the paper and multimedia versions of Taipei II. Good to excellent reliabilities were demonstrated for all age groups for both the cross-mode similarity (mode intraclass correlation range 0.85-0.96) and the test-retest reliability (r=.93). Regarding the usability, the mean score was 4.80 (SD 0.03), indicating that users were satisfied with their multimedia website experience. The multimedia tool produced essentially equivalent results to the paper-based tool. In addition, it had numerous advantages, such as it can facilitate active participation and promote early screening of target populations. Clinicaltrials.gov NCT02359591; https://clinicaltrials.gov/ct2/show/NCT02359591 (Archived by WebCite at http://www.webcitation.org/6l21mmdNn).

Critical design elements of e-health applications for users with severe mental illness: singular focus, simple architecture, prominent contents, explicit navigation, and inclusive hyperlinks.

PubMed

Rotondi, Armando J; Eack, Shaun M; Hanusa, Barbara H; Spring, Michael B; Haas, Gretchen L

2015-03-01

E-health applications are becoming integral components of general medical care delivery models and emerging for mental health care. Few exist for treatment of those with severe mental illness (SMI). In part, this is due to a lack of models to design such technologies for persons with cognitive impairments and lower technology experience. This study evaluated the effectiveness of an e-health design model for persons with SMI termed the Flat Explicit Design Model (FEDM). Persons with schizophrenia (n = 38) performed tasks to evaluate the effectiveness of 5 Web site designs: 4 were prominent public Web sites, and 1 was designed according to the FEDM. Linear mixed-effects regression models were used to examine differences in usability between the Web sites. Omnibus tests of between-site differences were conducted, followed by post hoc pairwise comparisons of means to examine specific Web site differences when omnibus tests reached statistical significance. The Web site designed using the FEDM required less time to find information, had a higher success rate, and was rated easier to use and less frustrating than the other Web sites. The home page design of one of the other Web sites provided the best indication to users about a Web site's contents. The results are consistent with and were used to expand the FEDM. The FEDM provides evidence-based guidelines to design e-health applications for person with SMI, including: minimize an application's layers or hierarchy, use explicit text, employ navigational memory aids, group hyperlinks in 1 area, and minimize the number of disparate subjects an application addresses. © The Author 2013. Published by Oxford University Press on behalf of the Maryland Psychiatric Research Center. All rights reserved. For permissions, please email: journals.permissions@oup.com.

The Development of Delta: Using Agile to Develop a Decision Aid for Pediatric Oncology Clinical Trial Enrollment.

PubMed

Robertson, Eden G; Wakefield, Claire E; Cohn, Richard J; O'Brien, Tracey; Ziegler, David S; Fardell, Joanna E

2018-05-04

The internet is increasingly being used to disseminate health information. Given the complexity of pediatric oncology clinical trials, we developed Delta, a Web-based decision aid to support families deciding whether or not to enroll their child with cancer in a clinical trial. This paper details the Agile development process of Delta and user testing results of Delta. Development was iterative and involved 5 main stages: a requirements analysis, planning, design, development, and user testing. For user testing, we conducted 13 eye-tracking analyses and think-aloud interviews with health care professionals (n=6) and parents (n=7). Results suggested that there was minimal rereading of content and a high level of engagement in content. However, there were some navigational problems. Participants reported high acceptability (12/13) and high usability of the website (8/13). Delta demonstrates the utility for the use of Agile in the development of a Web-based decision aid for health purposes. Our study provides a clear step-by-step guide to develop a Web-based psychosocial tool within the health setting. ©Eden G Robertson, Claire E Wakefield, Richard J Cohn, Tracey O'Brien, David S Ziegler, Joanna E Fardell. Originally published in JMIR Research Protocols (http://www.researchprotocols.org), 04.05.2018.

The Secret to Patron-Centered Web Design: Cheap, Easy, and Powerful Usability Techniques

ERIC Educational Resources Information Center

Reynolds, Erica

2008-01-01

When the Johnson County Library (JoCo Library), a midsize suburban public library in Kansas City, Kansas, completely rebuilt its 2,000-plus-page website--one that had remained relatively stable for almost 5 years--the reaction from patrons and staff members was overwhelmingly positive. The web development team at the JoCo Library realized that the…

Self-presentation on the Web: agencies serving abused and assaulted women.

PubMed

Sorenson, Susan B; Shi, Rui; Zhang, Jingwen; Xue, Jia

2014-04-01

We examined the content and usability of the Web sites of agencies serving women victims of violence. We entered the names of a systematic 10% sample of 3774 agencies listed in 2 national directories into a search engine. We took (in April 2012) and analyzed screenshots of the 261 resulting home pages and the readability of 193 home and first-level pages. Victims (94%) and donors (68%) were the primary intended audiences. About one half used social media and one third provided cues to action. Almost all (96.4%) of the Web pages were rated "fairly difficult" to "very confusing" to read, and 81.4% required more than a ninth-grade education to understand. The service and marketing functions were met fairly well by the agency home pages, but usability (particularly readability and offer of a mobile version) and efforts to increase user safety could be improved. Internet technologies are an essential platform for public health. They are particularly useful for reaching people with stigmatized health conditions because of the anonymity allowed. The one third of agencies that lack a Web site will not reach the substantial portion of the population that uses the Internet to find health information and other resources.

Locating and Searching Electronic Documents: A User Study of Supply Publications in the United States Marine Corps

DTIC Science & Technology

2007-12-01

Boyle, “Important issues in hypertext documentation usability,” In Proceedings of the 9th Annual international Conference on Systems Documentation...Tufte’s principles of information design to creating effective Web sites.” In Proceedings of the 15th Annual international Conference on Computer...usability,” In Proceedings of the 9th Annual international Conference on Systems Documentation (Chicago, Illinois, 1991). SIGDOC 󈨟. ACM, New York, NY

Exploring NASA GES DISC Data with Interoperable Services

NASA Technical Reports Server (NTRS)

Zhao, Peisheng; Yang, Wenli; Hegde, Mahabal; Wei, Jennifer C.; Kempler, Steven; Pham, Long; Teng, William; Savtchenko, Andrey

2015-01-01

Overview of NASA GES DISC (NASA Goddard Earth Science Data and Information Services Center) data with interoperable services: Open-standard and Interoperable Services Improve data discoverability, accessibility, and usability with metadata, catalogue and portal standards Achieve data, information and knowledge sharing across applications with standardized interfaces and protocols Open Geospatial Consortium (OGC) Data Services and Specifications Web Coverage Service (WCS) -- data Web Map Service (WMS) -- pictures of data Web Map Tile Service (WMTS) --- pictures of data tiles Styled Layer Descriptors (SLD) --- rendered styles.

Acceptance of New Technology: A Usability Test of a Computerized Adaptive Test for Fatigue in Rheumatoid Arthritis.

PubMed

Nikolaus, Stephanie; Bode, Christina; Taal, Erik; Vonkeman, Harald E; Glas, Cees Aw; van de Laar, Mart Afj

2014-12-04

Little is known about the acceptance and usability of computerized adaptive tests (CATs) among patients with rheumatoid arthritis (RA). The main difference between completing a CAT and a traditional questionnaire concerns item presentation. CATs only provide one item at a time on the screen, and skipping forward or backward to review and change already given answers is often not possible. The objective of this study was to examine how patients with RA experience a Web-based CAT for fatigue. In individual sessions, participants filled in the CAT while thinking aloud, and were subsequently interviewed about their experience with the new instrument. The technology acceptance model (TAM) was used to structure the results. The participants were 15 patients with RA. They perceived the CAT as clear, brief, and easy to use. They were positive about answering one question per screen, the changing response options, layout, progress bar, and item number. There were 40% (6/15) of the participants that also mentioned that they experienced the completion of the CAT as useful and pleasant, and liked the adaptive test mechanism. However, some participants noted that not all items were applicable to everybody, and that the wordings of questions within the severity dimension were often similar. Participants perceived the "CAT Fatigue RA" as easy to use, and also its usefulness was expressed. A 2.0 version has been improved according to the participants' comments, and is currently being used in a validation study before it will be implemented in daily clinical practice. Our results give a first indication that CAT methodology may outperform traditional questionnaires not merely on measurement precision, but also on usability and acceptance valuation.

Robotic Prostatectomy on the Web: A Cross-Sectional Qualitative Assessment.

PubMed

Borgmann, Hendrik; Mager, René; Salem, Johannes; Bründl, Johannes; Kunath, Frank; Thomas, Christian; Haferkamp, Axel; Tsaur, Igor

2016-08-01

Many patients diagnosed with prostate cancer search for information on robotic prostatectomy (RobP) on the Web. We aimed to evaluate the qualitative characteristics of the mostly frequented Web sites on RobP with a particular emphasis on provider-dependent issues. Google was searched for the term "robotic prostatectomy" in Europe and North America. The mostly frequented Web sites were selected and classified as physician-provided and publically-provided. Quality was measured using Journal of the American Medical Association (JAMA) benchmark criteria, DISCERN score, and addressing of Trifecta surgical outcomes. Popularity was analyzed using Google PageRank and Alexa tool. Accessibility, usability, and reliability were investigated using the LIDA tool and readability was assessed using readability indices. Twenty-eight Web sites were physician-provided and 15 publically-provided. For all Web sites, 88% of JAMA benchmark criteria were fulfilled, DISCERN quality score was high, and 81% of Trifecta outcome measurements were addressed. Popularity was average according to Google PageRank (mean 2.9 ± 1.5) and Alexa Traffic Rank (median, 49,109; minimum, 7; maximum, 8,582,295). Accessibility (85 ± 7%), usability (92 ± 3%), and reliability scores (88 ± 8%) were moderate to high. Automated Readability Index was 7.2 ± 2.1 and Flesch-Kincaid Grade Level was 9 ± 2, rating the Web sites as difficult to read. Physician-provided Web sites had higher quality scores and lower readability compared with publically-provided Web sites. Websites providing information on RobP obtained medium to high ratings in all domains of quality in the current assessment. In contrast, readability needs to be significantly improved so that this content can become available for the populace. Copyright © 2015 Elsevier Inc. All rights reserved.

Understanding reactions to an internet-delivered health-care intervention: accommodating user preferences for information provision.

PubMed

Yardley, Lucy; Morrison, Leanne G; Andreou, Panayiota; Joseph, Judith; Little, Paul

2010-09-17

It is recognised as good practice to use qualitative methods to elicit users' views of internet-delivered health-care interventions during their development. This paper seeks to illustrate the advantages of combining usability testing with 'theoretical modelling', i.e. analyses that relate the findings of qualitative studies during intervention development to social science theory, in order to gain deeper insights into the reasons and context for how people respond to the intervention. This paper illustrates how usability testing may be enriched by theoretical modelling by means of two qualitative studies of users' views of the delivery of information in an internet-delivered intervention to help users decide whether they needed to seek medical care for their cold or flu symptoms. In Study 1, 21 participants recruited from a city in southern England were asked to 'think aloud' while viewing draft web-pages presented in paper format. In Study 2, views of our prototype website were elicited, again using think aloud methods, in a sample of 26 participants purposively sampled for diversity in education levels. Both data-sets were analysed by thematic analysis. Study 1 revealed that although the information provided by the draft web-pages had many of the intended empowering benefits, users often felt overwhelmed by the quantity of information. Relating these findings to theory and research on factors influencing preferences for information-seeking we hypothesised that to meet the needs of different users (especially those with lower literacy levels) our website should be designed to provide only essential personalised advice, but with options to access further information. Study 2 showed that our website design did prove accessible to users with different literacy levels. However, some users seemed to want still greater control over how information was accessed. Educational level need not be an insuperable barrier to appreciating web-based access to detailed health-related information, provided that users feel they can quickly gain access to the specific information they seek.

Understanding reactions to an internet-delivered health-care intervention: accommodating user preferences for information provision

PubMed Central

2010-01-01

Background It is recognised as good practice to use qualitative methods to elicit users' views of internet-delivered health-care interventions during their development. This paper seeks to illustrate the advantages of combining usability testing with 'theoretical modelling', i.e. analyses that relate the findings of qualitative studies during intervention development to social science theory, in order to gain deeper insights into the reasons and context for how people respond to the intervention. This paper illustrates how usability testing may be enriched by theoretical modelling by means of two qualitative studies of users' views of the delivery of information in an internet-delivered intervention to help users decide whether they needed to seek medical care for their cold or flu symptoms. Methods In Study 1, 21 participants recruited from a city in southern England were asked to 'think aloud' while viewing draft web-pages presented in paper format. In Study 2, views of our prototype website were elicited, again using think aloud methods, in a sample of 26 participants purposively sampled for diversity in education levels. Both data-sets were analysed by thematic analysis. Results Study 1 revealed that although the information provided by the draft web-pages had many of the intended empowering benefits, users often felt overwhelmed by the quantity of information. Relating these findings to theory and research on factors influencing preferences for information-seeking we hypothesised that to meet the needs of different users (especially those with lower literacy levels) our website should be designed to provide only essential personalised advice, but with options to access further information. Study 2 showed that our website design did prove accessible to users with different literacy levels. However, some users seemed to want still greater control over how information was accessed. Conclusions Educational level need not be an insuperable barrier to appreciating web-based access to detailed health-related information, provided that users feel they can quickly gain access to the specific information they seek. PMID:20849599

A Web-Based Common Framework to Support the Test and Evaluation Process Any Time, Anywhere, and Anyhow

DOE Office of Scientific and Technical Information (OSTI.GOV)

Schur, Anne; Brown, James C.; Eaton, Sharon L.

Test and evaluation (T and E) is an enterprise. For any product, large or small, performance data is desired on many aspects to evaluate the product?s effectiveness for the intended users. Representing the many T and E facets without bewildering the user is challenging when there is a range of people, from the system developers to the manager of the organization, that want specific feedback. A web-based One-Stop Evaluation Center was created to meet these needs for a particular project. The evaluation center is usable at any time in the systems development lifecycle and streamlines the T and E enterprise.more » This paper discusses a common framework that unifies the T and E process with many stakeholders involved and is flexible to accommodate each stakeholders?specific evaluative processes and content. Our success has translated to many cost savings by enabling quick responses to change and a better line of communication between the users, developers, and managers.« less

Evaluation of a web-based lifestyle coach designed to maintain a healthy bodyweight.

PubMed

Kelders, Saskia M; van Gemert-Pijnen, Julia E W C; Werkman, Andrea; Seydel, Erwin R

2010-01-01

We evaluated a web-based intervention, the Healthy Weight Assistant (HWA), which was designed to help people with a healthy bodyweight, or those who are slightly overweight, to achieve and maintain a healthy weight. Four evaluation methods were used: (1) pre- and post-test questionnaires; (2) real time usability-tests; (3) log-file analysis; (4) qualitative analysis of forum posts, email messages and free-text responses in the questionnaires. A total of 703 respondents received access to the HWA. Six weeks after receiving access, 431 respondents completed a second questionnaire. The enthusiastic responses showed that many people were interested in using an interactive online application to support achieving and maintaining a healthy weight. The preliminary results suggest that improvements with respect to motivation may lead to large effects, yet require only small changes in the design of the HWA. Sending automatic tailored reminders may enhance motivation to keep using the application. Motivation to change behaviour may be enhanced by emphasizing goal setting and visualizing progress.

Validation of the three web quality dimensions of a minimally invasive surgery e-learning platform.

PubMed

Ortega-Morán, Juan Francisco; Pagador, J Blas; Sánchez-Peralta, Luisa Fernanda; Sánchez-González, Patricia; Noguera, José; Burgos, Daniel; Gómez, Enrique J; Sánchez-Margallo, Francisco M

2017-11-01

E-learning web environments, including the new TELMA platform, are increasingly being used to provide cognitive training in minimally invasive surgery (MIS) to surgeons. A complete validation of this MIS e-learning platform has been performed to determine whether it complies with the three web quality dimensions: usability, content and functionality. 21 Surgeons participated in the validation trials. They performed a set of tasks in the TELMA platform, where an e-MIS validity approach was followed. Subjective (questionnaires and checklists) and objective (web analytics) metrics were analysed to achieve the complete validation of usability, content and functionality. The TELMA platform allowed access to didactic content with easy and intuitive navigation. Surgeons performed all tasks with a close-to-ideal number of clicks and amount of time. They considered the design of the website to be consistent (95.24%), organised (90.48%) and attractive (85.71%). Moreover, they gave the content a high score (4.06 out of 5) and considered it adequate for teaching purposes. The surgeons scored the professional language and content (4.35), logo (4.24) and recommendations (4.20) the highest. Regarding functionality, the TELMA platform received an acceptance of 95.24% for navigation and 90.48% for interactivity. According to the study, it seems that TELMA had an attractive design, innovative content and interactive navigation, which are three key features of an e-learning platform. TELMA successfully met the three criteria necessary for consideration as a website of quality by achieving more than 70% of agreements regarding all usability, content and functionality items validated; this constitutes a preliminary requirement for an effective e-learning platform. However, the content completeness, authoring tool and registration process required improvement. Finally, the e-MIS validity methodology used to measure the three dimensions of web quality in this work can be applied to other clinical areas or training fields. Copyright © 2017 Elsevier B.V. All rights reserved.

Audiovisual Speech Web-Lab: an Internet teaching and research laboratory.

PubMed

Gordon, M S; Rosenblum, L D

2001-05-01

Internet resources now enable laboratories to make full-length experiments available on line. A handful of existing web sites offer users the ability to participate in experiments and generate usable data. We have integrated this technology into a web site that also provides full discussion of the theoretical and methodological aspects of the experiments using text and simple interactive demonstrations. The content of the web site (http://www.psych.ucr.edu/avspeech/lab) concerns audiovisual speech perception and its relation to face perception. The site is designed to be useful for users of multiple interests and levels of expertise.

An Integrated Software Package to Enable Predictive Simulation Capabilities

DOE Office of Scientific and Technical Information (OSTI.GOV)

Chen, Yousu; Fitzhenry, Erin B.; Jin, Shuangshuang

The power grid is increasing in complexity due to the deployment of smart grid technologies. Such technologies vastly increase the size and complexity of power grid systems for simulation and modeling. This increasing complexity necessitates not only the use of high-performance-computing (HPC) techniques, but a smooth, well-integrated interplay between HPC applications. This paper presents a new integrated software package that integrates HPC applications and a web-based visualization tool based on a middleware framework. This framework can support the data communication between different applications. Case studies with a large power system demonstrate the predictive capability brought by the integrated software package,more » as well as the better situational awareness provided by the web-based visualization tool in a live mode. Test results validate the effectiveness and usability of the integrated software package.« less

A Comparison of What Is Part of Usability Testing in Three Countries

NASA Astrophysics Data System (ADS)

Clemmensen, Torkil

The cultural diversity of users of technology challenges our methods for usability evaluation. In this paper we report and compare three ethnographic interview studies of what is a part of a standard (typical) usability test in a company in Mumbai, Beijing and Copenhagen. At each of these three locations, we use structural and contrast questions do a taxonomic and paradigm analysis of a how a company performs a usability test. We find similar parts across the three locations. We also find different results for each location. In Mumbai, most parts of the usability test are not related to the interactive application that is tested, but to differences in user characteristics, test preparation, method, and location. In Copenhagen, considerations about the client's needs are part of a usability test. In Beijing, the only varying factor is the communication pattern and relation to the user. These results are then contrasted in a cross cultural matrix to identify cultural themes that can help interpret results from existing laboratory research in usability test methods.

Integration of MSFC Usability Lab with Usability Testing

NASA Technical Reports Server (NTRS)

Cheng, Yiwei; Richardson, Sally

2010-01-01

As part of the Stage Analysis Branch, human factors engineering plays an important role in relating humans to the systems of hardware and structure designs of the new launch vehicle. While many branches are involved in the technical aspects of creating a launch vehicle, human factors connects humans to the scientific systems with the goal of improving operational performance and safety while reducing operational error and damage to the hardware. Human factors engineers use physical and computerized models to visualize possible areas for improvements to ensure human accessibility to components requiring maintenance and that the necessary maintenance activities can be accomplished with minimal risks to human and hardware. Many methods of testing are used to fulfill this goal, such as physical mockups, computerized visualization, and usability testing. In this analysis, a usability test is conducted to test how usable a website is to users who are and are not familiar with it. The testing is performed using participants and Morae software to record and analyze the results. This analysis will be a preliminary test of the usability lab in preparation for use in new spacecraft programs, NASA Enterprise, or other NASA websites. The usability lab project is divided into two parts: integration of the usability lab and a preliminary test of the usability lab.

Increasing the availability and usability of terrestrial ecology data through geospatial Web services and visualization tools (Invited)

NASA Astrophysics Data System (ADS)

Santhana Vannan, S.; Cook, R. B.; Wilson, B. E.; Wei, Y.

2010-12-01

Terrestrial ecology data sets are produced from diverse data sources such as model output, field data collection, laboratory analysis and remote sensing observation. These data sets can be created, distributed, and consumed in diverse ways as well. However, this diversity can hinder the usability of the data, and limit data users’ abilities to validate and reuse data for science and application purposes. Geospatial web services, such as those described in this paper, are an important means of reducing this burden. Terrestrial ecology researchers generally create the data sets in diverse file formats, with file and data structures tailored to the specific needs of their project, possibly as tabular data, geospatial images, or documentation in a report. Data centers may reformat the data to an archive-stable format and distribute the data sets through one or more protocols, such as FTP, email, and WWW. Because of the diverse data preparation, delivery, and usage patterns, users have to invest time and resources to bring the data into the format and structure most useful for their analysis. This time-consuming data preparation process shifts valuable resources from data analysis to data assembly. To address these issues, the ORNL DAAC, a NASA-sponsored terrestrial ecology data center, has utilized geospatial Web service technology, such as Open Geospatial Consortium (OGC) Web Map Service (WMS) and OGC Web Coverage Service (WCS) standards, to increase the usability and availability of terrestrial ecology data sets. Data sets are standardized into non-proprietary file formats and distributed through OGC Web Service standards. OGC Web services allow the ORNL DAAC to store data sets in a single format and distribute them in multiple ways and formats. Registering the OGC Web services through search catalogues and other spatial data tools allows for publicizing the data sets and makes them more available across the Internet. The ORNL DAAC has also created a Web-based graphical user interface called Spatial Data Access Tool (SDAT) that utilizes OGC Web services standards and allows data distribution and consumption for users not familiar with OGC standards. SDAT also allows for users to visualize the data set prior to download. Google Earth visualizations of the data set are also provided through SDAT. The use of OGC Web service standards at the ORNL DAAC has enabled an increase in data consumption. In one case, a data set had ~10 fold increase in download through OGC Web service in comparison to the conventional FTP and WWW method of access. The increase in download suggests that users are not only finding the data sets they need but also able to consume them readily in the format they need.

Investigation of the Usability of Computerized Critical Care Information Systems in Germany.

PubMed

von Dincklage, Falk; Suchodolski, Klaudiusz; Lichtner, Gregor; Friesdorf, Wolfgang; Podtschaske, Beatrice; Ragaller, Maximilian

2017-01-01

The term "usability" describes how effectively, efficiently, and with what level of user satisfaction an information system can be used to accomplish specific goals. Computerized critical care information systems (CCISs) with high usability increase quality of care and staff satisfaction, while reducing medication errors. Conversely, systems lacking usability can interrupt clinical workflow, facilitate errors, and increase charting time. The aim of this study was to investigate and compare usability across CCIS currently used in Germany. In this study, German intensive care unit (ICU) nurses and physicians completed a specialized, previously validated, web-based questionnaire. The questionnaire assessed CCIS usability based on three rating models: an overall rating of the systems, a model rating technical usability, and a model rating task-specific usability. We analyzed results from 535 survey participants and compared eight different CCIS commonly used in Germany. Our results showed that usability strongly differs across the compared systems. The system ICUData had the best overall rating and technical usability, followed by the platforms ICM and MetaVision. The same three systems performed best in the rating of task-specific usability without significant differences between each other. Across all systems, overall ratings were more dependent on ease-of-use aspects than on aspects of utility/functionality, and the general scope of the functions offered was rated better than how well the functions are realized. Our results suggest that manufacturers should shift some of their effort away from the development of new features and focus more on improving the ease-of-use and quality of existing features.

Development of an Interactive, Web-Delivered System to Increase Provider–Patient Engagement in Smoking Cessation

PubMed Central

Delaughter, Kathryn; Crenshaw, Katie; Sobko, Heather J; Williams, Jessica H; Coley, Heather L; Ray, Midge N; Ford, Daniel E; Allison, Jeroan J; Houston, Thomas K

2011-01-01

Background Patient self-management interventions for smoking cessation are effective but underused. Health care providers do not routinely refer smokers to these interventions. Objective The objective of our study was to uncover barriers and facilitators to the use of an e-referral system that will be evaluated in a community-based randomized trial. The e-referral system will allow providers to refer smokers to an online smoking intervention during routine clinical care. Methods We devised a four-step development and pilot testing process: (1) system conceptualization using Delphi to identify key functionalities that would overcome barriers in provider referrals for smoking cessation, (2) Web system programming using agile software development and best programming practices with usability refinement using think-aloud testing, (3) implementation planning using the nominal group technique for the effective integration of the system into the workflow of practices, and (4) pilot testing to identify practice recruitment and system-use barriers in real-world settings. Results Our Delphi process (step 1) conceptualized three key e-referral functions: (1) Refer Your Smokers, allowing providers to e-refer patients at the point of care by entering their emails directly into the system, (2) practice reports, providing feedback regarding referrals and impact of smoking-cessation counseling, and (3) secure messaging, facilitating provider–patient communication. Usability testing (step 2) suggested the system was easy to use, but implementation planning (step 3) suggested several important approaches to encourage use (eg, proactive email cues to encourage practices to participate). Pilot testing (step 4) in 5 practices had limited success, with only 2 patients referred; we uncovered important recruitment and system-use barriers (eg, lack of study champion, training, and motivation, registration difficulties, and forgetting to refer). Conclusions Implementing a system to be used in a clinical setting is complex, as several issues can affect system use. In our ongoing large randomized trial, preliminary analysis with the first 50 practices using the system for 3 months demonstrated that our rigorous preimplementation evaluation helped us successfully identify and overcome these barriers before the main trial. Trial Clinicaltrials.gov NCT00797628; http://clinicaltrials.gov/ct2/show/NCT00797628 (Archived by WebCite at http://www.webcitation.org/61feCfjCy) PMID:22011394

An Evaluation of Gas Law Webquest Based on Active Learning Style in a Secondary School in Malaysia

ERIC Educational Resources Information Center

Alias, Norlidah; DeWitt, Dorothy; Siraj, Saedah

2014-01-01

In this study, the PTEchLS WebQuest on Gas Laws was evaluated. It was designed for Form Four students with active learning styles. The focus of the evaluation was on the usability and effectiveness of the PTechLS WebQuest. Data were collected from interviews and students' achievement scores. Two teachers and eight students volunteered to…

Navigational Structure on the World Wide Web: Usability Concerns, User Preferences, and "Browsing Behavior."

ERIC Educational Resources Information Center

Frick, Theodore; Monson, John A.; Xaver, Richard F.; Kilic, Gulsen; Conley, Aaron T.; Wamey, Beatrice

There are several approaches a World Wide Web site designer considers in developing a menu structure. One consideration is the content of the menus (what choices are available to the user). Another consideration is the physical layout of the menu structure. The physical layout of a menu may be described as being one of at least three different…

Emergency department knowledge management in the age of Web 2.0: evaluation of a new concept.

PubMed

Dinh, Michael; Tan, Timothy; Bein, Kendall; Hayman, Jon; Wong, Yuk Kuen; Dinh, David

2011-02-01

The objective of the present study was to describe the implementation of an organizational learning model and evaluate the effectiveness and usability of an application used to facilitate it in an ED setting. This was an implementation case study and technology evaluation. The organizational learning model was implemented using an online Web 2.0 collaborative learning application developed by the investigating team. Online use was tracked over a 9-month period. At the end of the study period, a usability assessment was conducted as well as a semistructured interview of participants to assess perceptions of usefulness and effect on learning capacity in the ED. Over a period of 9 months, a total of 54 individual sites from 74 eligible staff members were created within a specific web domain. There were 251 registered users including users outside the ED, who accessed learning materials within these sites 7494 times. The majority of staff members interviewed agreed or strongly agreed that the collaborative learning application had improved learning capacity within this ED (88%, 95% CI 74-94%). We demonstrate the implementation of an organizational learning model based on independent online sites networking together within an organization. This appears to be both usable and acceptable to staff members working in a large ED as a means of knowledge management. © 2011 The Authors. EMA © 2011 Australasian College for Emergency Medicine and Australasian Society for Emergency Medicine.

A Tailored Web-Based Psycho-Educational Intervention for Cancer Patients and Their Family Caregivers

PubMed Central

Northouse, Laurel; Schafenacker, Ann; Barr, Kathryn L.C.; Katapodi, Maria; Yoon, Hyojin; Brittain, Kelly; Song, Lixin; Ronis, David L.; An, Larry

2014-01-01

Background Most programs addressing psychosocial concerns of cancer survivors are in-person programs that are expensive to deliver, have limited availability, and seldom deal with caregivers’ concerns. Objective This study examined the feasibility of translating an efficacious nurse-delivered program (FOCUS Program) for patients and their caregivers to a tailored, dyadic web-based format. Specific aims were to: (i) test the preliminary effects of the web-based intervention on patient and caregiver outcomes, (ii) examine participants’ program satisfaction, and (iii) determine the feasibility of using a web-based delivery format. Intervention/Methods A Phase II feasibility study was conducted with cancer patients (lung, breast, colorectal, prostate) and their family caregivers (N=38 dyads). The web-based intervention provided information and support tailored to the unique characteristics of each patient, caregiver, and their dyadic relationship. Primary outcomes were emotional distress and quality of life (QOL). Secondary outcomes were benefits of illness/caregiving, communication, support, and self-efficacy. Analyses included descriptive statistics and repeated measures ANOVA. Results Dyads had a significant decrease in emotional distress, increase in QOL, and perceived more benefits of illness/caregiving. Caregivers also had significant improvement in self-efficacy. There were no changes in communication. Participants were satisfied with program usability, but recommended additional content. Conclusions It was possible to translate a clinician-delivered program to a web-based format that was easy to use and had positive effects on dyadic outcomes. Implications for Practice The web-based program is a promising way to provide psychosocial care to more patients and caregivers using fewer personnel. It needs further testing in a larger RCT. PMID:24945270

Usability Methods for Ensuring Health Information Technology Safety: Evidence-Based Approaches. Contribution of the IMIA Working Group Health Informatics for Patient Safety.

PubMed

Borycki, E; Kushniruk, A; Nohr, C; Takeda, H; Kuwata, S; Carvalho, C; Bainbridge, M; Kannry, J

2013-01-01

Issues related to lack of system usability and potential safety hazards continue to be reported in the health information technology (HIT) literature. Usability engineering methods are increasingly used to ensure improved system usability and they are also beginning to be applied more widely for ensuring the safety of HIT applications. These methods are being used in the design and implementation of many HIT systems. In this paper we describe evidence-based approaches to applying usability engineering methods. A multi-phased approach to ensuring system usability and safety in healthcare is described. Usability inspection methods are first described including the development of evidence-based safety heuristics for HIT. Laboratory-based usability testing is then conducted under artificial conditions to test if a system has any base level usability problems that need to be corrected. Usability problems that are detected are corrected and then a new phase is initiated where the system is tested under more realistic conditions using clinical simulations. This phase may involve testing the system with simulated patients. Finally, an additional phase may be conducted, involving a naturalistic study of system use under real-world clinical conditions. The methods described have been employed in the analysis of the usability and safety of a wide range of HIT applications, including electronic health record systems, decision support systems and consumer health applications. It has been found that at least usability inspection and usability testing should be applied prior to the widespread release of HIT. However, wherever possible, additional layers of testing involving clinical simulations and a naturalistic evaluation will likely detect usability and safety issues that may not otherwise be detected prior to widespread system release. The framework presented in the paper can be applied in order to develop more usable and safer HIT, based on multiple layers of evidence.

Network Computing Infrastructure to Share Tools and Data in Global Nuclear Energy Partnership

NASA Astrophysics Data System (ADS)

Kim, Guehee; Suzuki, Yoshio; Teshima, Naoya

CCSE/JAEA (Center for Computational Science and e-Systems/Japan Atomic Energy Agency) integrated a prototype system of a network computing infrastructure for sharing tools and data to support the U.S. and Japan collaboration in GNEP (Global Nuclear Energy Partnership). We focused on three technical issues to apply our information process infrastructure, which are accessibility, security, and usability. In designing the prototype system, we integrated and improved both network and Web technologies. For the accessibility issue, we adopted SSL-VPN (Security Socket Layer-Virtual Private Network) technology for the access beyond firewalls. For the security issue, we developed an authentication gateway based on the PKI (Public Key Infrastructure) authentication mechanism to strengthen the security. Also, we set fine access control policy to shared tools and data and used shared key based encryption method to protect tools and data against leakage to third parties. For the usability issue, we chose Web browsers as user interface and developed Web application to provide functions to support sharing tools and data. By using WebDAV (Web-based Distributed Authoring and Versioning) function, users can manipulate shared tools and data through the Windows-like folder environment. We implemented the prototype system in Grid infrastructure for atomic energy research: AEGIS (Atomic Energy Grid Infrastructure) developed by CCSE/JAEA. The prototype system was applied for the trial use in the first period of GNEP.

Family history assessment for colorectal cancer (CRC) risk analysis - comparison of diagram- and questionnaire-based web interfaces.

PubMed

Schultz, Michael; Seo, Steven Bohwan; Holt, Alec; Regenbrecht, Holger

2015-11-18

Colorectal cancer (CRC) has a high incidence, especially in New Zealand. The reasons for this are unknown. While most cancers develop sporadically, a positive family history, determined by the number and age at diagnosis of affected first and second degree relatives with CRC is one of the major factors, which may increase an individual's lifetime risk. Before a patient can be enrolled in a surveillance program a detailed assessment and documentation of the family history is important but time consuming and often inaccurate. The documentation is usually paper-based. Our aim was therefore to develop and validate the usability and efficacy of a web-based family history assessment tool for CRC suitable for the general population. The tool was also to calculate the risk and make a recommendation for surveillance. Two versions of an electronic assessment tool, diagram-based and questionnaire-based, were developed with the risk analysis and recommendations for surveillance based on the New Zealand Guidelines Group recommendations. Accuracy of our tool was tested prior to the study by comparing risk calculations based on family history by experienced gastroenterologists with the electronic assessment. The general public, visiting a local science fair were asked to use and comment on the usability of the two interfaces. Ninety people assessed and commented on the two interfaces. Both interfaces were effective in assessing the risk to develop CRC through their familial history for CRC. However, the questionnaire-based interface performed with significantly better satisfaction (p = 0.001) than the diagram-based interface. There was no difference in efficacy though. We conclude that a web-based questionnaire tool can assist in the accurate documentation and analysis of the family history relevant to determine the individual risk of CRC based on local guidelines. The calculator is now implemented and assessable through the web-page of a local charity for colorectal cancer awareness and integral part of the local general practitioners' e-referral system for colonic imaging.

Using a fuzzy comprehensive evaluation method to determine product usability: A test case

PubMed Central

Zhou, Ronggang; Chan, Alan H. S.

2016-01-01

BACKGROUND: In order to take into account the inherent uncertainties during product usability evaluation, Zhou and Chan [1] proposed a comprehensive method of usability evaluation for products by combining the analytic hierarchy process (AHP) and fuzzy evaluation methods for synthesizing performance data and subjective response data. This method was designed to provide an integrated framework combining the inevitable vague judgments from the multiple stages of the product evaluation process. OBJECTIVE AND METHODS: In order to illustrate the effectiveness of the model, this study used a summative usability test case to assess the application and strength of the general fuzzy usability framework. To test the proposed fuzzy usability evaluation framework [1], a standard summative usability test was conducted to benchmark the overall usability of a specific network management software. Based on the test data, the fuzzy method was applied to incorporate both the usability scores and uncertainties involved in the multiple components of the evaluation. Then, with Monte Carlo simulation procedures, confidence intervals were used to compare the reliabilities among the fuzzy approach and two typical conventional methods combining metrics based on percentages. RESULTS AND CONCLUSIONS: This case study showed that the fuzzy evaluation technique can be applied successfully for combining summative usability testing data to achieve an overall usability quality for the network software evaluated. Greater differences of confidence interval widths between the method of averaging equally percentage and weighted evaluation method, including the method of weighted percentage averages, verified the strength of the fuzzy method. PMID:28035942

Using a fuzzy comprehensive evaluation method to determine product usability: A test case.

PubMed

Zhou, Ronggang; Chan, Alan H S

2017-01-01

In order to take into account the inherent uncertainties during product usability evaluation, Zhou and Chan [1] proposed a comprehensive method of usability evaluation for products by combining the analytic hierarchy process (AHP) and fuzzy evaluation methods for synthesizing performance data and subjective response data. This method was designed to provide an integrated framework combining the inevitable vague judgments from the multiple stages of the product evaluation process. In order to illustrate the effectiveness of the model, this study used a summative usability test case to assess the application and strength of the general fuzzy usability framework. To test the proposed fuzzy usability evaluation framework [1], a standard summative usability test was conducted to benchmark the overall usability of a specific network management software. Based on the test data, the fuzzy method was applied to incorporate both the usability scores and uncertainties involved in the multiple components of the evaluation. Then, with Monte Carlo simulation procedures, confidence intervals were used to compare the reliabilities among the fuzzy approach and two typical conventional methods combining metrics based on percentages. This case study showed that the fuzzy evaluation technique can be applied successfully for combining summative usability testing data to achieve an overall usability quality for the network software evaluated. Greater differences of confidence interval widths between the method of averaging equally percentage and weighted evaluation method, including the method of weighted percentage averages, verified the strength of the fuzzy method.

Impact of design features upon perceived tool usability and safety

NASA Astrophysics Data System (ADS)

Wiker, Steven F.; Seol, Mun-Su

2005-11-01

While injuries from powered hand tools are caused by a number of factors, this study looks specifically at the impact of the tools design features on perceived tool usability and safety. The tools used in this study are circular saws, power drills and power nailers. Sixty-nine males and thirty-two females completed an anonymous web-based questionnaire that provided orthogonal view photographs of the various tools. Subjects or raters provided: 1) description of the respondents or raters, 2) description of the responses from the raters, and 3) analysis of the interrelationships among respondent ratings of tool safety and usability, physical metrics of the tool, and rater demographic information. The results of the study found that safety and usability were dependent materially upon rater history of use and experience, but not upon training in safety and usability, or quality of design features of the tools (e.g., grip diameters, trigger design, guards, etc.). Thus, positive and negative transfer of prior experience with use of powered hand tools is far more important than any expectancy that may be driven by prior safety and usability training, or from the visual cues that are provided by the engineering design of the tool.

Development and process evaluation of a Web-based responsible beverage service training program.

PubMed

Danaher, Brian G; Dresser, Jack; Shaw, Tracy; Severson, Herbert H; Tyler, Milagra S; Maxwell, Elisabeth D; Christiansen, Steve M

2012-09-22

Responsible beverage service (RBS) training designed to improve the appropriate service of alcohol in commercial establishments is typically delivered in workshops. Recently, Web-based RBS training programs have emerged. This report describes the formative development and subsequent design of an innovative Web-delivered RBS program, and evaluation of the impact of the program on servers' knowledge, attitudes, and self-efficacy. Formative procedures using focus groups and usability testing were used to develop a Web-based RBS training program. Professional alcohol servers (N = 112) who worked as servers and/or mangers in alcohol service settings were recruited to participate. A pre-post assessment design was used to assess changes associated with using the program. Participants who used the program showed significant improvements in their RBS knowledge, attitudes, and self-efficacy. Although the current study did not directly observe and determine impact of the intervention on server behaviors, it demonstrated that the development process incorporating input from a multidisciplinary team in conjunction with feedback from end-users resulted in creation of a Web-based RBS program that was well-received by servers and that changed relevant knowledge, attitudes, and self-efficacy. The results also help to establish a needed evidence base in support of the use of online RBS training, which has been afforded little research attention.

Building a Tailored, Patient-Guided, Web-Based Self-Management Intervention 'ReumaUitgedaagd!' for Adults With a Rheumatic Disease: Results of a Usability Study and Design for a Randomized Control Trail.

PubMed

Ammerlaan, Judy W; Mulder, Olga K; de Boer-Nijhof, Nienke C; Maat, Bertha; Kruize, Aike A; van Laar, Jaap; van Os-Medendorp, Harmieke; Geenen, Rinie

2016-06-23

The chronic nature of rheumatic diseases imposes daily challenges upon those affected and causes patients to make daily decisions about the way they self-manage their illness. Although there is attention to self-management and evidence for the desirability of tailored interventions to support people with a rheumatic disease, interventions based on individual needs and preferences are scarce. To provide a systematic and comprehensive description of the theoretical considerations for building a Web-based, expert, patient-guided, and tailored intervention for adult patients with a rheumatic disease. Also, to present the results of a usability study on the feasibility of this intervention, and its study design in order to measure the effectiveness. To fit the intervention closely to the autonomy, needs, and preferences of the individual patient, a research team comprising patient representatives, health professionals, Web technicians, and communication experts was formed. The research team followed the new guidance by the Medical Research Council (MRC) for developing and evaluating complex interventions as a guide for the design of the intervention. Considerations from self-determination theory and a comprehensive assessment of preferences and needs in patients with a rheumatic disease guided the development of the Web-based intervention. The usability study showed that the intervention was useful, easy to use, and accepted and appreciated by the target group of patients. The planned randomized controlled trial is designed to be conducted among 120 adults with a rheumatic disease, who are assigned to the self-management intervention or a self-help control group. Both groups will be asked to formulate personal goals they want to achieve concerning their self-management. Progress toward the personal goal is the primary outcome measure of this study. Self-reported Web-based measures will be assessed before randomization at baseline, and 3 and 6 months after randomization. Also, feasibility and adherence to the Web-based self-management intervention as process outcomes will be evaluated. By identifying the individual goals at the beginning of the intervention and customizing the intervention to the individual patient, we aim to improve the usefulness and effectiveness of the Web-based self-management intervention. If proven effective, ReumaUitgedaagd! Online will be implemented in the Netherlands.

Moving Real Exergaming Engines on the Web: The webFitForAll Case Study in an Active and Healthy Ageing Living Lab Environment.

PubMed

Konstantinidis, Evdokimos I; Bamparopoulos, Giorgos; Bamidis, Panagiotis D

2017-05-01

Exergames have been the subject of research and technology innovations for a number of years. Different devices and technologies have been utilized to train the body and the mind of senior people or different patient groups. In the past, we presented FitForAll, the protocol efficacy of which was proven through widely taken (controlled) pilots with more than 116 seniors for a period of two months. The current piece of work expands this and presents the first truly web exergaming platform, which is solely based on HTML5 and JavaScript without any browser plugin requirements. The adopted architecture (controller application communication framework) combines a unified solution for input devices such as MS Kinect and Wii Balance Βoard which may seamlessly be exploited through standard physical exercise protocols (American College of Sports Medicine guidelines) and accommodate high detail logging; this allows for proper pilot testing and usability evaluations in ecologically valid Living Lab environments. The latter type of setups is also used herein for evaluating the web application with more than a dozen of real elderly users following quantitative approaches.

Using qualitative studies to improve the usability of an EMR.

PubMed

Rose, Alan F; Schnipper, Jeffrey L; Park, Elyse R; Poon, Eric G; Li, Qi; Middleton, Blackford

2005-02-01

The adoption of electronic medical records (EMRs) and user satisfaction are closely associated with the system's usability. To improve the usability of a results management module of a widely deployed web-based EMR, we conducted two qualitative studies that included multiple focus group and field study sessions. Qualitative research can help focus attention on user tasks and goals and identify patterns of care that can be visualized through task modeling exercises. Findings from both studies raised issues with the amount and organization of information in the display, interference with workflow patterns of primary care physicians, and the availability of visual cues and feedback. We used the findings of these studies to recommend design changes to the user interface of the results management module.

Development, Feasibility, and Small-Scale Implementation of a Web-Based Prognostic Tool—Surveillance, Epidemiology, and End Results Cancer Survival Calculator

PubMed Central

2017-01-01

Background Population datasets and the Internet are playing an ever-growing role in the way cancer information is made available to providers, patients, and their caregivers. The Surveillance, Epidemiology, and End Results Cancer Survival Calculator (SEER*CSC) is a Web-based cancer prognostic tool that uses SEER data, a large population dataset, to provide physicians with highly valid, evidence-based prognostic estimates for increasing shared decision-making and improving patient-provider communication of complex health information. Objective The aim of this study was to develop, test, and implement SEER*CSC. Methods An iterative approach was used to develop the SEER*CSC. Based on input from cancer patient advocacy groups and physicians, an initial version of the tool was developed. Next, providers from 4 health care delivery systems were recruited to do formal usability testing of SEER*CSC. A revised version of SEER*CSC was then implemented in two health care delivery sites using a real-world clinical implementation approach, and usage data were collected. Post-implementation follow-up interviews were conducted with site champions. Finally, patients from two cancer advocacy groups participated in usability testing. Results Overall feedback of SEER*CSC from both providers and patients was positive, with providers noting that the tool was professional and reliable, and patients finding it to be informational and helpful to use when discussing their diagnosis with their provider. However, use during the small-scale implementation was low. Reasons for low usage included time to enter data, not having treatment options in the tool, and the tool not being incorporated into the electronic health record (EHR). Patients found the language in its current version to be too complex. Conclusions The implementation and usability results showed that participants were enthusiastic about the use and features of SEER*CSC, but sustained implementation in a real-world clinical setting faced significant challenges. As a result of these findings, SEER*CSC is being redesigned with more accessible language for a public facing release. Meta-tools, which put different tools in context of each other, are needed to assist in understanding the strengths and limitations of various tools and their place in the clinical decision-making pathway. The continued development and eventual release of prognostic tools should include feedback from multidisciplinary health care teams, various stakeholder groups, patients, and caregivers. PMID:28729232

Self-Presentation on the Web: Agencies Serving Abused and Assaulted Women

PubMed Central

Shi, Rui; Zhang, Jingwen; Xue, Jia

2014-01-01

Objectives. We examined the content and usability of the Web sites of agencies serving women victims of violence. Methods. We entered the names of a systematic 10% sample of 3774 agencies listed in 2 national directories into a search engine. We took (in April 2012) and analyzed screenshots of the 261 resulting home pages and the readability of 193 home and first-level pages. Results. Victims (94%) and donors (68%) were the primary intended audiences. About one half used social media and one third provided cues to action. Almost all (96.4%) of the Web pages were rated “fairly difficult” to “very confusing” to read, and 81.4% required more than a ninth-grade education to understand. Conclusions. The service and marketing functions were met fairly well by the agency home pages, but usability (particularly readability and offer of a mobile version) and efforts to increase user safety could be improved. Internet technologies are an essential platform for public health. They are particularly useful for reaching people with stigmatized health conditions because of the anonymity allowed. The one third of agencies that lack a Web site will not reach the substantial portion of the population that uses the Internet to find health information and other resources. PMID:24524489

Service quality of Early Childhood Education web portals in Finnish municipalities

NASA Astrophysics Data System (ADS)

Koskivaara, Eija; Pihlaja, Päivi

Increasing number of governmental organizations have transformed material on their web sites as a way of providing users with information about their products and services. In this paper, we apply Yang et al (2005) instrument for analyzing municipal early childhood education (ECE) web sites in Finland. The objective of the study was to find out the quality of ECE web portals as well as to give hints to improve their value from users' point of view. In general the five dimensions, usability, usefulness of content, adequacy of information, accessibility, and interaction, of the Yang et al model seems to be applicable also in the early childhood education environment.

Scaffolding knowledge building in a Web-based communication and cultural competence program for international medical graduates.

PubMed

Lax, Leila R; Russell, M Lynn; Nelles, Laura J; Smith, Cathy M

2009-10-01

Professional behaviors, tacitly understood by Canadian-trained physicians, are difficult to teach and often create practice barriers for IMGs. The purpose of this design research study was to develop a Web-based program simulating Canadian medical literacy and culture, and to evaluate strategies of scaffolding individual knowledge building. Study 1 (N = 20) examined usability and pedagogic design. Studies 2 (N = 39) and 3 (N = 33) examined case participation patterns. Model design was validated in Study 1. Studies 2 and 3 demonstrated high levels of participation, on unprompted third tries, on knowledge tests. Recursive patterns were strongest on Reflective Exercises. Five strategies scaffolded knowledge building: (1) video simulations, (2) contextualized resources, (3) concurrent feedback, (4) Reflective Exercises, and (5) commentaries prompting "reflection on reflection." Scaffolded design supports complex knowledge building. These findings are concurrent with educational research on the importance of recursion and revision of knowledge for improvable and relational understanding.

Feasibility of an acceptance and commitment therapy adjunctive web-based program for counseling centers.

PubMed

Levin, Michael E; Pistorello, Jacqueline; Hayes, Steven C; Seeley, John R; Levin, Crissa

2015-07-01

Web-based adjunctive tools provide a promising method for addressing the challenges college counseling centers face in meeting the mental health needs of students. The current study tested an initial adjunctive prototype based on acceptance and commitment therapy (ACT) in a pre-post open trial with 30 counselors and 82 student clients across 4 counseling centers. Results indicated high ratings of program satisfaction and usability with counselors and students. The majority of students completed at least part of the program. Significant improvements were found across almost all outcome and ACT process measures with student clients. Improvements in student outcomes were predicted by both changes in psychological inflexibility and how often counselors discussed the program with students. Results are discussed in relation to support for and future development of a flexible, adjunctive ACT program for counseling centers. (c) 2015 APA, all rights reserved).

Web-scale discovery in an academic health sciences library: development and implementation of the EBSCO Discovery Service.

PubMed

Thompson, Jolinda L; Obrig, Kathe S; Abate, Laura E

2013-01-01

Funds made available at the close of the 2010-11 fiscal year allowed purchase of the EBSCO Discovery Service (EDS) for a year-long trial. The appeal of this web-scale discovery product that offers a Google-like interface to library resources was counter-balanced by concerns about quality of search results in an academic health science setting and the challenge of configuring an interface that serves the needs of a diverse group of library users. After initial configuration, usability testing with library users revealed the need for further work before general release. Of greatest concern were continuing issues with the relevance of items retrieved, appropriateness of system-supplied facet terms, and user difficulties with navigating the interface. EBSCO has worked with the library to better understand and identify problems and solutions. External roll-out to users occurred in June 2012.

Demonstration of New OLAF Capabilities and Technologies

NASA Astrophysics Data System (ADS)

Kingston, C.; Palmer, E.; Stone, J.; Neese, C.; Mueller, B.

2017-06-01

Upgrades to the On-Line Archiving Facility (OLAF) PDS tool are leading to improved usability and additional functionality by integration of JavaScript web app frameworks. Also included is the capability to upload tabular data as CSV files.

Tabs and Accordions

EPA Pesticide Factsheets

While tabs and accordions were once common across the Web, we no longer recommend their use on EPA pages. Research has demonstrated that the use of tabs and accordions on websites can cause a number of search, access, and usability problems.

Why Citizen Science Without Usability Testing Will Underperform

NASA Astrophysics Data System (ADS)

Romano, C.; Gay, P.; Owens, R.; Burlea, G.

2017-12-01

Citizen science projects must undergo usability testing and optimization if they are to meet their stated goals. This presentation will include video of usability tests conducted upon citizen science websites. Usability testing is essential to the success of online interaction, however, citizen science projects have just begun to include this critical activity. Interaction standards in citizen science lag behind those of commercial interests, and published research on this topic is limited. Since online citizen science is by definition, an exchange of information, a clear understanding of how users experience an online project is essential to informed decision-making. Usability testing provides that insight. Usability testing collects data via direct observation of a person while she interacts with a digital product, such as a citizen science website. The test participant verbalizes her thoughts while using the website or application; the moderator follows the participant and captures quantitative measurement of the participant's confidence of success as she advances through the citizen science project. Over 15 years of usability testing, we have observed that users who do not report a consistent sense of progress are likely to abandon a website after as few as three unrewarding interactions. Since citizen science is also a voluntary activity, ensuring seamless interaction for users is mandatory. Usability studies conducted on citizen science websites demonstrate that project teams frequently underestimate a user's need for context and ease of use. Without usability testing, risks to online citizen science projects include high bounce rate (users leave the website without taking any action), abandonment (of the website, tutorials, registration), misunderstanding instructions (causing disorientation and erroneous conclusions), and ultimately, underperforming projects.

Towards a Usability and Error "Safety Net": A Multi-Phased Multi-Method Approach to Ensuring System Usability and Safety.

PubMed

Kushniruk, Andre; Senathirajah, Yalini; Borycki, Elizabeth

2017-01-01

The usability and safety of health information systems have become major issues in the design and implementation of useful healthcare IT. In this paper we describe a multi-phased multi-method approach to integrating usability engineering methods into system testing to ensure both usability and safety of healthcare IT upon widespread deployment. The approach involves usability testing followed by clinical simulation (conducted in-situ) and "near-live" recording of user interactions with systems. At key stages in this process, usability problems are identified and rectified forming a usability and technology-induced error "safety net" that catches different types of usability and safety problems prior to releasing systems widely in healthcare settings.

The E-health Literacy Demands of Australia's My Health Record: A Heuristic Evaluation of Usability.

PubMed

Walsh, Louisa; Hemsley, Bronwyn; Allan, Meredith; Adams, Natalie; Balandin, Susan; Georgiou, Andrew; Higgins, Isabel; McCarthy, Shaun; Hill, Sophie

2017-01-01

My Health Record is Australia's electronic personal health record system, which was introduced in July 2012. As of August 2017, approximately 21 percent of Australia's total population was registered to use My Health Record. Internationally, usability issues have been shown to negatively influence the uptake and use of electronic health record systems, and this scenario may particularly affect people who have low e-health literacy. It is likely that usability issues are negatively affecting the uptake and use of My Health Record in Australia. To identify potential e-health literacy-related usability issues within My Health Record through a heuristic evaluation method. Between September 14 and October 12, 2016, three of the authors conducted a heuristic evaluation of the two consumer-facing components of My Health Record-the information website and the electronic health record itself. These two components were evaluated against two sets of heuristics-the Health Literacy Online checklist and the Monkman Heuristics. The Health Literacy Online checklist and Monkman Heuristics are evidence-based checklists of web design elements with a focus on design for audiences with low health literacy. During this heuristic evaluation, the investigators individually navigated through the consumer-facing components of My Health Record, recording instances where the My Health Record did not conform to the checklist criteria. After the individual evaluations were completed, the investigators conferred and aggregated their results. From this process, a list of usability violations was constructed. When evaluated against the Health Literacy Online Checklist, the information website demonstrated violations in 12 of 35 criteria, and the electronic health record demonstrated violations in 16 of 35 criteria. When evaluated against the Monkman Heuristics, the information website demonstrated violations in 7 of 11 criteria, and the electronic health record demonstrated violations in 9 of 11 criteria. The identified violations included usability issues with the reading levels used within My Health Record, the graphic design elements, the layout of web pages, and a lack of images and audiovisual tools to support learning. Other important usability issues included a lack of translated resources, difficulty using accessibility tools, and complexity of the registration processes. My Health Record is an important piece of technology that has the potential to facilitate better communication between consumers and their health providers. However, this heuristic evaluation demonstrated that many usability-related elements of My Health Record cater poorly to users at risk of having low e-health literacy. Usability issues have been identified as an important barrier to use of personal health records internationally, and the findings of this heuristic evaluation demonstrate that usability issues may be substantial barriers to the uptake and use of My Health Record.

The E-health Literacy Demands of Australia's My Health Record: A Heuristic Evaluation of Usability

PubMed Central

Walsh, Louisa; Hemsley, Bronwyn; Allan, Meredith; Adams, Natalie; Balandin, Susan; Georgiou, Andrew; Higgins, Isabel; McCarthy, Shaun; Hill, Sophie

2017-01-01

Background My Health Record is Australia's electronic personal health record system, which was introduced in July 2012. As of August 2017, approximately 21 percent of Australia's total population was registered to use My Health Record. Internationally, usability issues have been shown to negatively influence the uptake and use of electronic health record systems, and this scenario may particularly affect people who have low e-health literacy. It is likely that usability issues are negatively affecting the uptake and use of My Health Record in Australia. Objective To identify potential e-health literacy–related usability issues within My Health Record through a heuristic evaluation method. Methods Between September 14 and October 12, 2016, three of the authors conducted a heuristic evaluation of the two consumer-facing components of My Health Record—the information website and the electronic health record itself. These two components were evaluated against two sets of heuristics—the Health Literacy Online checklist and the Monkman Heuristics. The Health Literacy Online checklist and Monkman Heuristics are evidence-based checklists of web design elements with a focus on design for audiences with low health literacy. During this heuristic evaluation, the investigators individually navigated through the consumer-facing components of My Health Record, recording instances where the My Health Record did not conform to the checklist criteria. After the individual evaluations were completed, the investigators conferred and aggregated their results. From this process, a list of usability violations was constructed. Results When evaluated against the Health Literacy Online Checklist, the information website demonstrated violations in 12 of 35 criteria, and the electronic health record demonstrated violations in 16 of 35 criteria. When evaluated against the Monkman Heuristics, the information website demonstrated violations in 7 of 11 criteria, and the electronic health record demonstrated violations in 9 of 11 criteria. The identified violations included usability issues with the reading levels used within My Health Record, the graphic design elements, the layout of web pages, and a lack of images and audiovisual tools to support learning. Other important usability issues included a lack of translated resources, difficulty using accessibility tools, and complexity of the registration processes. Conclusion My Health Record is an important piece of technology that has the potential to facilitate better communication between consumers and their health providers. However, this heuristic evaluation demonstrated that many usability-related elements of My Health Record cater poorly to users at risk of having low e-health literacy. Usability issues have been identified as an important barrier to use of personal health records internationally, and the findings of this heuristic evaluation demonstrate that usability issues may be substantial barriers to the uptake and use of My Health Record. PMID:29118683

WEbcoli: an interactive and asynchronous web application for in silico design and analysis of genome-scale E.coli model.

PubMed

Jung, Tae-Sung; Yeo, Hock Chuan; Reddy, Satty G; Cho, Wan-Sup; Lee, Dong-Yup

2009-11-01

WEbcoli is a WEb application for in silico designing, analyzing and engineering Escherichia coli metabolism. It is devised and implemented using advanced web technologies, thereby leading to enhanced usability and dynamic web accessibility. As a main feature, the WEbcoli system provides a user-friendly rich web interface, allowing users to virtually design and synthesize mutant strains derived from the genome-scale wild-type E.coli model and to customize pathways of interest through a graph editor. In addition, constraints-based flux analysis can be conducted for quantifying metabolic fluxes and charactering the physiological and metabolic states under various genetic and/or environmental conditions. WEbcoli is freely accessible at http://webcoli.org. cheld@nus.edu.sg.

Training Teachers and Serving Students: Applying Usability Testing in Writing Programs

ERIC Educational Resources Information Center

McGovern, Heather

2007-01-01

Teachers often test course materials by using them in class. Usability testing provides an alternative: teachers receive student feedback and revise materials "before" teaching a class. Case studies based on interviews and observations with two teaching assistants who usability tested materials before teaching introductory technical writing…

An Iterative, Mixed Usability Approach Applied to the Telekit System from the Danish TeleCare North Trial

PubMed Central

Schaarup, Clara; Hejlesen, Ole Kristian

2016-01-01

Objective. The aim of the present study is to evaluate the usability of the telehealth system, coined Telekit, by using an iterative, mixed usability approach. Materials and Methods. Ten double experts participated in two heuristic evaluations (HE1, HE2), and 11 COPD patients attended two think-aloud tests. The double experts identified usability violations and classified them into Jakob Nielsen's heuristics. These violations were then translated into measurable values on a scale of 0 to 4 indicating degree of severity. In the think-aloud tests, COPD participants were invited to verbalise their thoughts. Results. The double experts identified 86 usability violations in HE1 and 101 usability violations in HE2. The majority of the violations were rated in the 0–2 range. The findings from the think-aloud tests resulted in 12 themes and associated examples regarding the usability of the Telekit system. The use of the iterative, mixed usability approach produced both quantitative and qualitative results. Conclusion. The iterative, mixed usability approach yields a strong result owing to the high number of problems identified in the tests because the double experts and the COPD participants focus on different aspects of Telekit's usability. This trial is registered with Clinicaltrials.gov, NCT01984840, November 14, 2013. PMID:27974888

An Iterative, Mixed Usability Approach Applied to the Telekit System from the Danish TeleCare North Trial.

PubMed

Lilholt, Pernille Heyckendorff; Schaarup, Clara; Hejlesen, Ole Kristian

2016-01-01

Objective . The aim of the present study is to evaluate the usability of the telehealth system, coined Telekit, by using an iterative, mixed usability approach. Materials and Methods . Ten double experts participated in two heuristic evaluations (HE1, HE2), and 11 COPD patients attended two think-aloud tests. The double experts identified usability violations and classified them into Jakob Nielsen's heuristics. These violations were then translated into measurable values on a scale of 0 to 4 indicating degree of severity. In the think-aloud tests, COPD participants were invited to verbalise their thoughts. Results . The double experts identified 86 usability violations in HE1 and 101 usability violations in HE2. The majority of the violations were rated in the 0-2 range. The findings from the think-aloud tests resulted in 12 themes and associated examples regarding the usability of the Telekit system. The use of the iterative, mixed usability approach produced both quantitative and qualitative results. Conclusion . The iterative, mixed usability approach yields a strong result owing to the high number of problems identified in the tests because the double experts and the COPD participants focus on different aspects of Telekit's usability. This trial is registered with Clinicaltrials.gov, NCT01984840, November 14, 2013.

A continuous usability evaluation of an electronic medication administration record application.

PubMed

Vicente Oliveros, Noelia; Gramage Caro, Teresa; Pérez Menéndez-Conde, Covadonga; Álvarez-Diaz, Ana María; Martín-Aragón Álvarez, Sagrario; Bermejo Vicedo, Teresa; Delgado Silveira, Eva

2017-12-01

The complexity of an electronic medication administration record (eMAR) has been underestimated by most designers in the past. Usability issues, such as poorly designed user application flow in eMAR, are therefore of vital importance, since they can have a negative impact on nursing activities and result in poor outcomes. The purpose of this study was to evaluate the usability of an eMAR application during its development. A usability evaluation was conducted during the development of the eMAR application. Two usability methods were used: a heuristic evaluation complemented by usability testing. Each eMAR application version provided by the vendor was evaluated by 2 hospital pharmacists, who applied the heuristic method. They reviewed the eMAR tasks, detected usability problems and their heuristic violations, and rated the severity of the usability problems. Usability testing was used to assess the final application version by observing how 3 nurses interacted with the application. Thirty-four versions were assessed before the eMAR application was considered usable. During the heuristic evaluation, the usability problems decreased from 46 unique usability problems in version 1 (V1) to 9 in version 34 (V34). In V1, usability problems were categorized into 154 heuristic violations, which decreased to 27 in V34. The average severity rating also decreased from major usability problem (2.96) to no problem (0.23). During usability testing, the 3 nurses did not encounter new usability problems. A thorough heuristic evaluation is a good method for obtaining a usable eMAR application. This evaluation points key areas for improvement and decreases usability problems and their severity. © 2017 John Wiley & Sons, Ltd.

Using Semantic Web technologies for the generation of domain-specific templates to support clinical study metadata standards.

PubMed

Jiang, Guoqian; Evans, Julie; Endle, Cory M; Solbrig, Harold R; Chute, Christopher G

2016-01-01

The Biomedical Research Integrated Domain Group (BRIDG) model is a formal domain analysis model for protocol-driven biomedical research, and serves as a semantic foundation for application and message development in the standards developing organizations (SDOs). The increasing sophistication and complexity of the BRIDG model requires new approaches to the management and utilization of the underlying semantics to harmonize domain-specific standards. The objective of this study is to develop and evaluate a Semantic Web-based approach that integrates the BRIDG model with ISO 21090 data types to generate domain-specific templates to support clinical study metadata standards development. We developed a template generation and visualization system based on an open source Resource Description Framework (RDF) store backend, a SmartGWT-based web user interface, and a "mind map" based tool for the visualization of generated domain-specific templates. We also developed a RESTful Web Service informed by the Clinical Information Modeling Initiative (CIMI) reference model for access to the generated domain-specific templates. A preliminary usability study is performed and all reviewers (n = 3) had very positive responses for the evaluation questions in terms of the usability and the capability of meeting the system requirements (with the average score of 4.6). Semantic Web technologies provide a scalable infrastructure and have great potential to enable computable semantic interoperability of models in the intersection of health care and clinical research.

Distributed usability evaluation of the Pennsylvania Cancer Atlas

PubMed Central

Bhowmick, Tanuka; Robinson, Anthony C; Gruver, Adrienne; MacEachren, Alan M; Lengerich, Eugene J

2008-01-01

Background The Pennsylvania Cancer Atlas (PA-CA) is an interactive online atlas to help policy-makers, program managers, and epidemiologists with tasks related to cancer prevention and control. The PA-CA includes maps, graphs, tables, that are dynamically linked to support data exploration and decision-making with spatio-temporal cancer data. Our Atlas development process follows a user-centered design approach. To assess the usability of the initial versions of the PA-CA, we developed and applied a novel strategy for soliciting user feedback through multiple distributed focus groups and surveys. Our process of acquiring user feedback leverages an online web application (e-Delphi). In this paper we describe the PA-CA, detail how we have adapted e-Delphi web application to support usability and utility evaluation of the PA-CA, and present the results of our evaluation. Results We report results from four sets of users. Each group provided structured individual and group assessments of the PA-CA as well as input on the kinds of users and applications for which it is best suited. Overall reactions to the PA-CA are quite positive. Participants did, however, provide a range of useful suggestions. Key suggestions focused on improving interaction functions, enhancing methods of temporal analysis, addressing data issues, and providing additional data displays and help functions. These suggestions were incorporated in each design and implementation iteration for the PA-CA and used to inform a set of web-atlas design principles. Conclusion For the Atlas, we find that a design that utilizes linked map, graph, and table views is understandable to and perceived to be useful by the target audience of cancer prevention and control professionals. However, it is clear that considerable variation in experience using maps and graphics exists and for those with less experience, integrated tutorials and help features are needed. In relation to our usability assessment strategy, we find that our distributed, web-based method for soliciting user input is generally effective. Advantages include the ability to gather information from users distributed in time and space and the relative anonymity of the participants while disadvantages include less control over when and how often participants provide input and challenges for obtaining rich input. PMID:18620565

Earthdata Search Usability Study Process

NASA Technical Reports Server (NTRS)

Reese, Mark

2016-01-01

User experience (UX) design is the process of enhancing user satisfaction by improving various aspects of the user's interaction with an application or website. One aspect of UX design is usability, or the extent to which an application can be used to to accomplish tasks efficiently, effectively, and with satisfaction. NASA's Earthdata Search Client recently underwent a focused usability testing project to measure usability and gain valuable user feedback and insights to increase usability for its end-users. This presentation focuses on the process by which the usability tests were administered and the lessons learned throughout the process.

A smartphone-based platform to test the performance of wireless mobile networks and preliminary findings

NASA Astrophysics Data System (ADS)

Geng, Xinli; Xu, Hao; Qin, Xiaowei

2016-10-01

During the last several years, the amount of wireless network traffic data increased fast and relative technologies evolved rapidly. In order to improve the performance and Quality of Experience (QoE) of wireless network services, the analysis of field network data and existing delivery mechanisms comes to be a promising research topic. In order to achieve this goal, a smartphone based platform named Monitor and Diagnosis of Mobile Applications (MDMA) was developed to collect field data. Based on this tool, the web browsing service of High Speed Downlink Packet Access (HSDPA) network was tested. The top 200 popular websites in China were selected and loaded on smartphone for thousands times automatically. Communication packets between the smartphone and the cell station were captured for various scenarios (e.g. residential area, urban roads, bus station etc.) in the selected city. A cross-layer database was constructed to support the off-line analysis. Based on the results of client-side experiments and analysis, the usability of proposed portable tool was verified. The preliminary findings and results for existing web browsing service were also presented.

Applying usability testing techniques to improve a health promotion website.

PubMed

Hinchliffe, Anetta; Mummery, W Kerry

2008-04-01

Use of the Internet for health promotion is increasing; however, the lack of published research regarding website usability suggests that health promotion websites are being developed without consultation with their users or formal evaluation. This study conducted usability testing of an existing health promotion website to inform modifications and to identify common usability themes that should be addressed by organisations developing or maintaining a health promotion website. A combination of qualitative and quantitative techniques were implemented during the usability testing sessions to gather data from users while completing tasks on the website. Techniques included performance measures (time taken), direct observation (participant observation) and subjective user preferences (questionnaire and interview). Improvements to the website were measured in terms of reduced problems reported, reduced time taken to complete tasks and increased subjective reports. Seven usability themes emerged from the data: design, feedback, format, instructions, navigation, terminology and learnability. This study demonstrates the application of usability testing to the design and modification of a health promotion website and illustrates the areas or themes that can be used as a framework for testing and modification.

Metadata squared: enhancing its usability for volunteered geographic information and the GeoWeb

USGS Publications Warehouse

Poore, Barbara S.; Wolf, Eric B.; Sui, Daniel Z.; Elwood, Sarah; Goodchild, Michael F.

2013-01-01

The Internet has brought many changes to the way geographic information is created and shared. One aspect that has not changed is metadata. Static spatial data quality descriptions were standardized in the mid-1990s and cannot accommodate the current climate of data creation where nonexperts are using mobile phones and other location-based devices on a continuous basis to contribute data to Internet mapping platforms. The usability of standard geospatial metadata is being questioned by academics and neogeographers alike. This chapter analyzes current discussions of metadata to demonstrate how the media shift that is occurring has affected requirements for metadata. Two case studies of metadata use are presented—online sharing of environmental information through a regional spatial data infrastructure in the early 2000s, and new types of metadata that are being used today in OpenStreetMap, a map of the world created entirely by volunteers. Changes in metadata requirements are examined for usability, the ease with which metadata supports coproduction of data by communities of users, how metadata enhances findability, and how the relationship between metadata and data has changed. We argue that traditional metadata associated with spatial data infrastructures is inadequate and suggest several research avenues to make this type of metadata more interactive and effective in the GeoWeb.

The Accessibility, Usability, and Reliability of Chinese Web-Based Information on HIV/AIDS.

PubMed

Niu, Lu; Luo, Dan; Liu, Ying; Xiao, Shuiyuan

2016-08-20

The present study was designed to assess the quality of Chinese-language Internet-based information on HIV/AIDS. We entered the following search terms, in Chinese, into Baidu and Sogou: "HIV/AIDS", "symptoms", and "treatment", and evaluated the first 50 hits of each query using the Minervation validation instrument (LIDA tool) and DISCERN instrument. Of the 900 hits identified, 85 websites were included in this study. The overall score of the LIDA tool was 63.7%; the mean score of accessibility, usability, and reliability was 82.2%, 71.5%, and 27.3%, respectively. Of the top 15 sites according to the LIDA score, the mean DISCERN score was calculated at 43.1 (95% confidence intervals (CI) = 37.7-49.5). Noncommercial websites showed higher DISCERN scores than commercial websites; whereas commercial websites were more likely to be found in the first 20 links obtained from each search engine than the noncommercial websites. In general, the HIV/AIDS related Chinese-language websites have poor reliability, although their accessibility and usability are fair. In addition, the treatment information presented on Chinese-language websites is far from sufficient. There is an imperative need for professionals and specialized institutes to improve the comprehensiveness of web-based information related to HIV/AIDS.

The Accessibility, Usability, and Reliability of Chinese Web-Based Information on HIV/AIDS

PubMed Central

Niu, Lu; Luo, Dan; Liu, Ying; Xiao, Shuiyuan

2016-01-01

Objective: The present study was designed to assess the quality of Chinese-language Internet-based information on HIV/AIDS. Methods: We entered the following search terms, in Chinese, into Baidu and Sogou: “HIV/AIDS”, “symptoms”, and “treatment”, and evaluated the first 50 hits of each query using the Minervation validation instrument (LIDA tool) and DISCERN instrument. Results: Of the 900 hits identified, 85 websites were included in this study. The overall score of the LIDA tool was 63.7%; the mean score of accessibility, usability, and reliability was 82.2%, 71.5%, and 27.3%, respectively. Of the top 15 sites according to the LIDA score, the mean DISCERN score was calculated at 43.1 (95% confidence intervals (CI) = 37.7–49.5). Noncommercial websites showed higher DISCERN scores than commercial websites; whereas commercial websites were more likely to be found in the first 20 links obtained from each search engine than the noncommercial websites. Conclusions: In general, the HIV/AIDS related Chinese-language websites have poor reliability, although their accessibility and usability are fair. In addition, the treatment information presented on Chinese-language websites is far from sufficient. There is an imperative need for professionals and specialized institutes to improve the comprehensiveness of web-based information related to HIV/AIDS. PMID:27556475

Evaluation of Web-Based Consumer Medication Information: Content and Usability of 4 Australian Websites.

PubMed

Raban, Magdalena Z; Tariq, Amina; Richardson, Lauren; Byrne, Mary; Robinson, Maureen; Li, Ling; Westbrook, Johanna I; Baysari, Melissa T

2016-07-21

Medication is the most common intervention in health care, and written medication information can affect consumers' medication-related behavior. Research has shown that a large proportion of Australians search for medication information on the Internet. To evaluate the medication information content, based on consumer medication information needs, and usability of 4 Australian health websites: Better Health Channel, myDr, healthdirect, and NPS MedicineWise . To assess website content, the most common consumer medication information needs were identified using (1) medication queries to the healthdirect helpline (a telephone helpline available across most of Australia) and (2) the most frequently used medications in Australia. The most frequently used medications were extracted from Australian government statistics on use of subsidized medicines in the community and the National Census of Medicines Use. Each website was assessed to determine whether it covered or partially covered information and advice about these medications. To assess website usability, 16 consumers participated in user testing wherein they were required to locate 2 pieces of medication information on each website. Brief semistructured interviews were also conducted with participants to gauge their opinions of the websites. Information on prescription medication was more comprehensively covered on all websites (3 of 4 websites covered 100% of information) than nonprescription medication (websites covered 0%-67% of information). Most websites relied on consumer medicines information leaflets to convey prescription medication information to consumers. Information about prescription medication classes was less comprehensive, with no website providing all information examined about antibiotics and antidepressants. Participants (n=16) were able to locate medication information on websites in most cases (accuracy ranged from 84% to 91%). However, a number of usability issues relating to website navigation and information display were identified. For example, websites not allowing combinations of search terms to be entered in search boxes and continuous blocks of text without subheadings. Of the 4 Australian health information websites tested, none provided consumers with comprehensive medication information on both prescription and nonprescription medications in a user-friendly way. Using data on consumer information needs and user testing to guide medication information content and website design is a useful approach to inform consumer website development.

Heuristic evaluation of online COPD respiratory therapy and education video resource center.

PubMed

Stellefson, Michael; Chaney, Beth; Chaney, Don

2014-10-01

Abstract Purpose: Because of limited accessibility to pulmonary rehabilitation programs, patients with chronic obstructive pulmonary disease (COPD) are infrequently provided with patient education resources. To help educate patients with COPD on how to live a better life with diminished breathing capacity, we developed a novel social media resource center containing COPD respiratory therapy and education videos called "COPDFlix." A heuristic evaluation of COPDFlix was conducted as part of a larger study to determine whether the prototype was successful in adhering to formal Web site usability guidelines for older adults. A purposive sample of three experts, with expertise in Web design and health communications technology, was recruited (a) to identify usability violations and (b) to propose solutions to improve the functionality of the COPDFlix prototype. Each expert evaluated 18 heuristics in four categories of task-based criteria (i.e., interaction and navigation, information architecture, presentation design, and information design). Seventy-six subcriteria across these four categories were assessed. Quantitative ratings and qualitative comments from each expert were compiled into a single master list, noting the violated heuristic and type/location of problem(s). Sixty-one usability violations were identified across the 18 heuristics. Evaluators rated the majority of heuristic subcriteria as either a "minor hindrance" (n=32) or "no problem" (n=132). Moreover, only 2 of the 18 heuristic categories were noted as "major" violations, with mean severity scores of ≥3. Mixed-methods data analysis helped the multidisciplinary research team to categorize and prioritize usability problems and solutions, leading to 26 discrete design modifications within the COPDFlix prototype.

Virtual reality on the web: the potentials of different methodologies and visualization techniques for scientific research and medical education.

PubMed

Kling-Petersen, T; Pascher, R; Rydmark, M

1999-01-01

Academic and medical imaging are increasingly using computer based 3D reconstruction and/or visualization. Three-dimensional interactive models play a major role in areas such as preclinical medical education, clinical visualization and medical research. While 3D is comparably easy to do on a high end workstations, distribution and use of interactive 3D graphics necessitate the use of personal computers and the web. Several new techniques have been demonstrated providing interactive 3D via a web browser thereby allowing a limited version of VR to be experienced by a larger majority of students, medical practitioners and researchers. These techniques include QuickTimeVR2 (QTVR), VRML2, QuickDraw3D, OpenGL and Java3D. In order to test the usability of the different techniques, Mednet have initiated a number of projects designed to evaluate the potentials of 3D techniques for scientific reporting, clinical visualization and medical education. These include datasets created by manual tracing followed by triangulation, smoothing and 3D visualization, MRI or high-resolution laserscanning. Preliminary results indicate that both VRML and QTVR fulfills most of the requirements of web based, interactive 3D visualization, whereas QuickDraw3D is too limited. Presently, the JAVA 3D has not yet reached a level where in depth testing is possible. The use of high-resolution laserscanning is an important addition to 3D digitization.

Usability testing for the rest of us: the application of discount usability principles in the development of an online communications assessment application.

PubMed

Brock, Douglas; Kim, Sara; Palmer, Odawni; Gallagher, Thomas; Holmboe, Eric

2013-01-01

Usability evaluation provides developers and educators with the means to understand user needs, improve overall product utility, and increase user satisfaction. The application of "discount usability" principles developed to make usability testing more practical and useful may improve user experience at minimal cost and require little existing expertise to conduct. We describe an application of discount usability to a high-fidelity online communications assessment application developed by the University of Washington for the American Board of Internal Medicine. Eight internal medicine physicians completed a discount usability test. Sessions were recorded and the videos analyzed for significant usability concerns. Concerns were identified, summarized, discussed, and prioritized by the authors in collaboration with the software developers before implementing any changes to the interface. Thirty-eight significant usability issues were detected and four technical problems were identified. Each issue was responded to through modification of the software, by providing additional instruction, or delayed for a later version to be developed. Discount usability can be easily implemented in academic developmental activities. Our study resulted in the discovery and remediation of significant user problems, in addition to giving important insight into the novel methods built into the application.

SPARQLGraph: a web-based platform for graphically querying biological Semantic Web databases.

PubMed

Schweiger, Dominik; Trajanoski, Zlatko; Pabinger, Stephan

2014-08-15

Semantic Web has established itself as a framework for using and sharing data across applications and database boundaries. Here, we present a web-based platform for querying biological Semantic Web databases in a graphical way. SPARQLGraph offers an intuitive drag & drop query builder, which converts the visual graph into a query and executes it on a public endpoint. The tool integrates several publicly available Semantic Web databases, including the databases of the just recently released EBI RDF platform. Furthermore, it provides several predefined template queries for answering biological questions. Users can easily create and save new query graphs, which can also be shared with other researchers. This new graphical way of creating queries for biological Semantic Web databases considerably facilitates usability as it removes the requirement of knowing specific query languages and database structures. The system is freely available at http://sparqlgraph.i-med.ac.at.

SU-F-T-249: Application of Human Factors Methods: Usability Testing in the Radiation Oncology Environment

DOE Office of Scientific and Technical Information (OSTI.GOV)

Warkentin, H; Bubric, K; Giovannetti, H

2016-06-15

Purpose: As a quality improvement measure, we undertook this work to incorporate usability testing into the implementation procedures for new electronic documents and forms used by four affiliated radiation therapy centers. Methods: A human factors specialist provided training in usability testing for a team of medical physicists, radiation therapists, and radiation oncologists from four radiotherapy centers. A usability testing plan was then developed that included controlled scenarios and standardized forms for qualitative and quantitative feedback from participants, including patients. Usability tests were performed by end users using the same hardware and viewing conditions that are found in the clinical environment.more » A pilot test of a form used during radiotherapy CT simulation was performed in a single department; feedback informed adaptive improvements to the electronic form, hardware requirements, resource accessibility and the usability testing plan. Following refinements to the testing plan, usability testing was performed at three affiliated cancer centers with different vault layouts and hardware. Results: Feedback from the testing resulted in the detection of 6 critical errors (omissions and inability to complete task without assistance), 6 non-critical errors (recoverable), and multiple suggestions for improvement. Usability problems with room layout were detected at one center and problems with hardware were detected at one center. Upon amalgamation and summary of the results, three key recommendations were presented to the document’s authors for incorporation into the electronic form. Documented inefficiencies and patient safety concerns related to the room layout and hardware were presented to administration along with a request for funding to purchase upgraded hardware and accessories to allow a more efficient workflow within the simulator vault. Conclusion: By including usability testing as part of the process when introducing any new document or procedure into clinical use, associated risks can be identified and mitigated before patient care and clinical workflow are impacted.« less

Development and process evaluation of a web-based responsible beverage service training program

PubMed Central

2012-01-01

Background Responsible beverage service (RBS) training designed to improve the appropriate service of alcohol in commercial establishments is typically delivered in workshops. Recently, Web-based RBS training programs have emerged. This report describes the formative development and subsequent design of an innovative Web-delivered RBS program, and evaluation of the impact of the program on servers’ knowledge, attitudes, and self-efficacy. Methods Formative procedures using focus groups and usability testing were used to develop a Web-based RBS training program. Professional alcohol servers (N = 112) who worked as servers and/or mangers in alcohol service settings were recruited to participate. A pre-post assessment design was used to assess changes associated with using the program. Results Participants who used the program showed significant improvements in their RBS knowledge, attitudes, and self-efficacy. Conclusions Although the current study did not directly observe and determine impact of the intervention on server behaviors, it demonstrated that the development process incorporating input from a multidisciplinary team in conjunction with feedback from end-users resulted in creation of a Web-based RBS program that was well-received by servers and that changed relevant knowledge, attitudes, and self-efficacy. The results also help to establish a needed evidence base in support of the use of online RBS training, which has been afforded little research attention. PMID:22999419

An evaluation of patients' experienced usability of a diabetes mHealth system using a multi-method approach.

PubMed

Georgsson, Mattias; Staggers, Nancy

2016-02-01

mHealth systems are becoming more common to aid patients in their diabetes self-management, but recent studies indicate a need for thorough evaluation of patients' experienced usability. Current evaluations lack a multi-method design for data collection and structured methods for data analyses. The purpose of this study was to provide a feasibility test of a multi-method approach for both data collection and data analyses for patients' experienced usability of a mHealth system for diabetes type 2 self-management. A random sample of 10 users was selected from a larger clinical trial. Data collection methods included user testing with eight representative tasks and Think Aloud protocol, a semi-structured interview and a questionnaire on patients' experiences using the system. The Framework Analysis (FA) method and Usability Problem Taxonomy (UPT) were used to structure, code and analyze the results. A usability severity rating was assigned after classification. The combined methods resulted in a total of 117 problems condensed into 19 usability issues with an average severity rating of 2.47 or serious. The usability test detected 50% of the initial usability problems, followed by the post-interview at 29%. The usability test found 18 of 19 consolidated usability problems while the questionnaire uncovered one unique issue. Patients experienced most usability problems (8) in the Glucose Readings View when performing complex tasks such as adding, deleting, and exporting glucose measurements. The severity ratings were the highest for the Glucose Diary View, Glucose Readings View, and Blood Pressure View with an average severity rating of 3 (serious). Most of the issues were classified under the artifact component of the UPT and primary categories of Visualness (7) and Manipulation (6). In the UPT task component, most issues were in the primary category Task-mapping (12). Multiple data collection methods yielded a more comprehensive set of usability issues. Usability testing uncovered the largest volume of usability issues, followed by interviewing and then the questionnaire. The interview did not surface any unique consolidated usability issues while the questionnaire surfaced one. The FA and UPT were valuable in structuring and classifying problems. The resulting descriptions serve as a communication tool in problem solving and programming. We recommend the usage of multiple methods in data collection and employing the FA and UPT in data analyses for future usability testing. Copyright © 2015 The Authors. Published by Elsevier Inc. All rights reserved.

Usability Assessment of the Missouri Cancer Registry's Published Interactive Mapping Reports: Round One.

PubMed

Ben Ramadan, Awatef Ahmed; Jackson-Thompson, Jeannette; Schmaltz, Chester Lee

2017-08-04

 Many users of spatial data have difficulty interpreting information in health-related spatial reports. The Missouri Cancer Registry and Research Center (MCR-ARC) has produced interactive reports for several years. These reports have never been tested for usability.  The aims of this study were to: (1) conduct a multi-approach usability testing study to understand ease of use (user friendliness) and user satisfaction; and (2) evaluate the usability of MCR-ARC's published InstantAtlas reports.   An institutional review board (IRB) approved mixed methodology usability testing study using a convenience sample of health professionals. A recruiting email was sent to faculty in the Master of Public Health program and to faculty and staff in the Department of Health Management and Informatics at the University of Missouri-Columbia. The study included 7 participants. The test included a pretest questionnaire, a multi-task usability test, and the System Usability Scale (SUS). Also, the researchers collected participants' comments about the tested maps immediately after every trial. Software was used to record the computer screen during the trial and the participants' spoken comments. Several performance and usability metrics were measured to evaluate the usability of MCR-ARC's published mapping reports. Of the 10 assigned tasks, 6 reached a 100% completion success rate, and this outcome was relative to the complexity of the tasks. The simple tasks were handled more efficiently than the complicated tasks. The SUS score ranged between 20-100 points, with an average of 62.7 points and a median of 50.5 points. The tested maps' effectiveness outcomes were better than the efficiency and satisfaction outcomes. There was a statistically significant relationship between the subjects' performance on the study test and the users' previous experience with geographic information system (GIS) tools (P=.03). There were no statistically significant relationships between users' performance and satisfaction and their education level, work type, or previous experience in health care (P>.05). There were strong positive correlations between the three measured usability elements. The tested maps should undergo an extensive refining and updating to overcome all the discovered usability issues and meet the perspectives and needs of the tested maps' potential users. The study results might convey the perspectives of academic health professionals toward GIS health data. We need to conduct a second-round usability study with public health practitioners and cancer professionals who use GIS tools on a routine basis. Usability testing should be conducted before and after releasing MCR-ARC's maps in the future. ©Awatef Ahmed Ben Ramadan, Jeannette Jackson-Thompson, Chester Lee Schmaltz. Originally published in JMIR Human Factors (http://humanfactors.jmir.org), 04.08.2017.

Usability Assessment of the Missouri Cancer Registry’s Published Interactive Mapping Reports: Round One

PubMed Central

Jackson-Thompson, Jeannette; Schmaltz, Chester Lee

2017-01-01

Background  Many users of spatial data have difficulty interpreting information in health-related spatial reports. The Missouri Cancer Registry and Research Center (MCR-ARC) has produced interactive reports for several years. These reports have never been tested for usability. Objective  The aims of this study were to: (1) conduct a multi-approach usability testing study to understand ease of use (user friendliness) and user satisfaction; and (2) evaluate the usability of MCR-ARC’s published InstantAtlas reports. Methods   An institutional review board (IRB) approved mixed methodology usability testing study using a convenience sample of health professionals. A recruiting email was sent to faculty in the Master of Public Health program and to faculty and staff in the Department of Health Management and Informatics at the University of Missouri-Columbia. The study included 7 participants. The test included a pretest questionnaire, a multi-task usability test, and the System Usability Scale (SUS). Also, the researchers collected participants’ comments about the tested maps immediately after every trial. Software was used to record the computer screen during the trial and the participants’ spoken comments. Several performance and usability metrics were measured to evaluate the usability of MCR-ARC’s published mapping reports. Results Of the 10 assigned tasks, 6 reached a 100% completion success rate, and this outcome was relative to the complexity of the tasks. The simple tasks were handled more efficiently than the complicated tasks. The SUS score ranged between 20-100 points, with an average of 62.7 points and a median of 50.5 points. The tested maps’ effectiveness outcomes were better than the efficiency and satisfaction outcomes. There was a statistically significant relationship between the subjects’ performance on the study test and the users’ previous experience with geographic information system (GIS) tools (P=.03). There were no statistically significant relationships between users’ performance and satisfaction and their education level, work type, or previous experience in health care (P>.05). There were strong positive correlations between the three measured usability elements. Conclusions The tested maps should undergo an extensive refining and updating to overcome all the discovered usability issues and meet the perspectives and needs of the tested maps’ potential users. The study results might convey the perspectives of academic health professionals toward GIS health data. We need to conduct a second-round usability study with public health practitioners and cancer professionals who use GIS tools on a routine basis. Usability testing should be conducted before and after releasing MCR-ARC’s maps in the future. PMID:28778842

Evolution of System Architectures: Where Do We Need to Fail Next?

NASA Astrophysics Data System (ADS)

Bermudez, Luis; Alameh, Nadine; Percivall, George

2013-04-01

Innovation requires testing and failing. Thomas Edison was right when he said "I have not failed. I've just found 10,000 ways that won't work". For innovation and improvement of standards to happen, service Architectures have to be tested and tested. Within the Open Geospatial Consortium (OGC), testing of service architectures has occurred for the last 15 years. This talk will present an evolution of these service architectures and a possible future path. OGC is a global forum for the collaboration of developers and users of spatial data products and services, and for the advancement and development of international standards for geospatial interoperability. The OGC Interoperability Program is a series of hands-on, fast paced, engineering initiatives to accelerate the development and acceptance of OGC standards. Each initiative is organized in threads that provide focus under a particular theme. The first testbed, OGC Web Services phase 1, completed in 2003 had four threads: Common Architecture, Web Mapping, Sensor Web and Web Imagery Enablement. The Common Architecture was a cross-thread theme, to ensure that the Web Mapping and Sensor Web experiments built on a base common architecture. The architecture was based on the three main SOA components: Broker, Requestor and Provider. It proposed a general service model defining service interactions and dependencies; categorization of service types; registries to allow discovery and access of services; data models and encodings; and common services (WMS, WFS, WCS). For the latter, there was a clear distinction on the different services: Data Services (e.g. WMS), Application services (e.g. Coordinate transformation) and server-side client applications (e.g. image exploitation). The latest testbed, OGC Web Service phase 9, completed in 2012 had 5 threads: Aviation, Cross-Community Interoperability (CCI), Security and Services Interoperability (SSI), OWS Innovations and Compliance & Interoperability Testing & Evaluation (CITE). Compared to the first testbed, OWS-9 did not have a separate common architecture thread. Instead the emphasis was on brokering information models, securing them and making data available efficiently on mobile devices. The outcome is an architecture based on usability and non-intrusiveness while leveraging mediation of information models from different communities. This talk will use lessons learned from the evolution from OGC Testbed phase 1 to phase 9 to better understand how global and complex infrastructures evolve to support many communities including the Earth System Science Community.

What words and where? Applying usability testing techniques to name a new live reference service.

PubMed

Duncan, Vicky; Fichter, Darlene M

2004-04-01

A user-focused design approach was taken to develop a new "live reference" service at the Health Sciences Library, University of Saskatchewan. The name of the service, the placement of the links, and the design of a graphical button were seen as key elements in creating service awareness and its subsequent use. To ensure library users recognized and understood the label for the new service, selected library users were given an opportunity to choose a phrase that would best describe the service. The top two preferred phrases were then placed on the library Web pages as text and graphic images for further testing. Some pages had links in multiple locations to determine which placement worked best. Task-based usability testing was carried out with participants who were unaware of the new service. Participants were observed as they completed seven Website tasks arranged in increasing levels of difficulty to see whether they would notice the live reference service and seek assistance. The high level of recognition and use of the service indicate that the label name and link placement were effective with library Website users. Using user-centered design methodology helped ensure that the new live reference service was visible and used and demonstrated the effectiveness of the user-centered design approach for adding new services to an existing Website.

B-SAFER: A Web-Based Intervention for Drug Use and Intimate Partner Violence Demonstrates Feasibility and Acceptability Among Women in the Emergency Department

PubMed Central

Choo, Esther K.; Zlotnick, Caron; Strong, David R.; Squires, Daniel D.; Tapé, Chantal; Mello, Michael J.

2016-01-01

Background Addressing violence along with drug use change goals is critical for women with coexisting intimate partner violence (IPV) and substance use disorders (SUD). Methods This was an acceptability and feasibility study of BSAFER, a brief Web-based program and booster phone call addressing violence and drug use. A screening survey identified women with recent drug use and IPV in the emergency department (ED). Participants were randomized to BSAFER or a Web-based control program and booster call providing education about home fire safety. Program completion, usability, satisfaction and MI adherence were primary outcomes. Drug use and IPV outcomes were measured at baseline, one and three months. Results Forty women were enrolled (21 BSAFER, 19 control); 50% were non-white and mean age was 30 years. Most commonly used drugs were marijuana (88%) and cocaine (30%); 45% reported physical abuse and 33% severe combined physical and sexual abuse. Thirty-nine (98%) completed the Web program, 30 (75%) completed the booster, and 29 (73%) completed 3-month follow up. Mean System Usability Scale (SUS) for the BSAFER Web program was 84 (95% CI 78–89) of 100; mean Client Satisfaction Questionnaire (CSQ-8) was 28 (95% CI 26–29) of 32. MI adherence scores were high and similar for both the Web program and the booster. Both intervention and control groups had small mean decreases in weekly drug use days (0.7 days vs. 1.5 days); participants using drugs other than marijuana demonstrated greater average reductions in drug use than those using marijuana only. Conclusions An ED Web-based intervention for SUD and IPV in women demonstrated feasibility and acceptability. Future studies will examine efficacy of the BSAFER program and investigate whether specific subgroups of drug using women may be most responsive to ED-based Web interventions. PMID:26714233

Usability of a New Writing Assistive Device for Persons with Cervical Spinal Cord Injury.

PubMed

Lim, MyungJoon; Park, Jiyoung; Lee, Kuem Ju; Kweon, Hyosun; Kim, Byungchul; Cho, Kyujin; Choi, Hyun

2015-01-01

The hand function for persons with cervical spinal cord injury (PCSCI) is most frequently cause difficulties in leading normal lives. The purpose of this study was to test the usability of a new writing assistive device (NWAD) for PCSCI. To access its usability, the authors design usability testing method and test the NWAD to five individuals with cervical spinal cord injury. From the usability testing, we have found number of issues that lead us to key design concept about developing the NWAD. The NWAD will be redesigned based on the result of the present study. We expect that the NWAD will help PCSCI use their affected hand better and improve the level of independence and quality of life.

Assessing the standards of online oral hygiene instructions for patients with fixed orthodontic appliances.

PubMed

Verhoef, Willem A; Livas, Christos; Delli, Konstantina; Ren, Yijin

2015-05-01

The authors conducted this study to assess the quality of the information available on the Web about oral hygiene for patients with fixed orthodontic appliances. The authors entered the search terms "cleaning braces," "brushing braces," and "oral hygiene and braces" into Google, Yahoo, and Bing search engines. They analyzed Web sites satisfying the inclusion criteria from the first 20 hits of each search for accessibility, usability, and reliability by using the LIDA instrument; for readability by using the Flesch Reading Ease (FRE) score; and for the completeness of oral hygiene instructions. Sixty-two Web sites met the inclusion criteria. The mean total LIDA score of 71.2 indicated the moderate quality of the design of the reviewed Web sites. The mean (standard deviation [SD]) values of LIDA scores for accessibility, usability, and reliability were 85.9 (7.0), 63.4 (16.1), and 48.0 (10.4), respectively. The mean (SD) FRE Score of 68.6 (9.7) applied to standard reading skills. The completeness of information (mean [SD] = 67.1 [27.8]) presented the highest variability. Overall, the authors found that the standards of online oral hygiene materials for orthodontic patients with fixed appliances exhibited modest scores. Readability appeared to be appropriate for young adolescents, whereas the comprehensiveness of the displayed information was highly variable. Further improvement of the infrastructure of electronic health information (that is, e-health) in orthodontics is necessary to meet patients' needs. Given the moderate quality of oral hygiene instruction available on the Web for patients with fixed appliances, orthodontic patients and caregivers should be cautious when browsing the Internet for relevant information. Dental professionals should refer patients to valid Web-based educational materials. Copyright © 2015 American Dental Association. Published by Elsevier Inc. All rights reserved.

Usability Assessment of Secure Messaging for Clinical Document Sharing between Health Care Providers and Patients.

PubMed

Jahn, Michelle A; Porter, Brian W; Patel, Himalaya; Zillich, Alan J; Simon, Steven R; Russ, Alissa L

2018-04-01

 Web-based patient portals feature secure messaging systems that enable health care providers and patients to communicate information. However, little is known about the usability of these systems for clinical document sharing.  This article evaluates the usability of a secure messaging system for providers and patients in terms of its ability to support sharing of electronic clinical documents.  We conducted usability testing with providers and patients in a human-computer interaction laboratory at a Midwestern U.S. hospital. Providers sent a medication list document to a fictitious patient via secure messaging. Separately, patients retrieved the clinical document from a secure message and returned it to a fictitious provider. We collected use errors, task completion, task time, and satisfaction.  Twenty-nine individuals participated: 19 providers (6 physicians, 6 registered nurses, and 7 pharmacists) and 10 patients. Among providers, 11 (58%) attached and sent the clinical document via secure messaging without requiring assistance, in a median (range) of 4.5 (1.8-12.7) minutes. No patients completed tasks without moderator assistance. Patients accessed the secure messaging system within 3.6 (1.2-15.0) minutes; retrieved the clinical document within 0.8 (0.5-5.7) minutes; and sent the attached clinical document in 6.3 (1.5-18.1) minutes. Although median satisfaction ratings were high, with 5.8 for providers and 6.0 for patients (scale, 0-7), we identified 36 different use errors. Physicians and pharmacists requested additional features to support care coordination via health information technology, while nurses requested features to support efficiency for their tasks.  This study examined the usability of clinical document sharing, a key feature of many secure messaging systems. Our results highlight similarities and differences between provider and patient end-user groups, which can inform secure messaging design to improve learnability and efficiency. The observations suggest recommendations for improving the technical aspects of secure messaging for clinical document sharing. Schattauer GmbH Stuttgart.

New Options for Usability Testing Projects in Business Communication Courses

ERIC Educational Resources Information Center

Jameson, Daphne A.

2013-01-01

The increasing availability of recording technologies makes it easier to include usability testing projects in business communication courses. Usability testing is a method of discovering whether people can navigate, read, and understand a print or electronic communication well enough to achieve a particular purpose in a reasonable time frame.…

Collecting and Applying Usability Data from Distance Learners

ERIC Educational Resources Information Center

Mitchell, Emily; West, Brandon

2017-01-01

Growth of their college's off-campus and online course offerings led librarians at SUNY Oswego to run usability tests with off-campus students to compensate for a lack of responses from this population during earlier usability testing. Constraints on testing with off-campus students included lack of funding and librarian time, as well as…

Adding Users to the Website Design Process

ERIC Educational Resources Information Center

Tomeo, Megan L.

2012-01-01

Alden Library began redesigning its website over a year ago. Throughout the redesign process the students, faculty, and staff that make up the user base were added to the conversation by utilizing several usability test methods. This article focuses on the usability testing conducted at Alden Library and delves into future usability testing, which…

The Virtual Anatomy Laboratory: Usability Testing to Improve an Online Learning Resource for Anatomy Education

ERIC Educational Resources Information Center

Doubleday, Eldridge G.; O'Loughlin, Valerie D.; Doubleday, Alison F.

2011-01-01

An increasing number of instructors are seeking to provide students with online anatomy resources. Many researchers have attempted to identify associations between resource use and student learning but few studies discuss the importance of usability testing in resource design and modification. Usability testing provides information about ease of…

Using Qualitative Methods to Create a Home Health Web Application User Interface for Patients with Low Computer Proficiency.

PubMed

Baier, Rosa R; Cooper, Emily; Wysocki, Andrea; Gravenstein, Stefan; Clark, Melissa

2015-01-01

Despite the investment in public reporting for a number of healthcare settings, evidence indicates that consumers do not routinely use available data to select providers. This suggests that existing reports do not adequately incorporate recommendations for consumer-facing reports or web applications. Healthcentric Advisors and Brown University undertook a multi-phased approach to create a consumer-facing home health web application in Rhode Island. This included reviewing the evidence base review to identify design recommendations and then creating a paper prototype and wireframe. We performed qualitative research to iteratively test our proposed user interface with two user groups, home health consumers and hospital case managers, refining our design to create the final web application. To test our prototype, we conducted two focus groups, with a total of 13 consumers, and 28 case manager interviews. Both user groups responded favorably to the prototype, with the majority commenting that they felt this type of tool would be useful. Case managers suggested revisions to ensure the application conformed to laws requiring Medicare patients to have the freedom to choose among providers and could be incorporated into hospital workflow. After incorporating changes and creating the wireframe, we conducted usability testing interviews with 14 home health consumers and six hospital case managers. We found that consumers needed prompting to navigate through the wireframe; they demonstrated confusion through both their words and body language. As a result, we modified the web application's sequence, navigation, and function to provide additional instructions and prompts. Although we designed our web application for low literacy and low health literacy, using recommendations from the evidence base, we overestimated the extent to which older adults were familiar with using computers. Some of our key learnings and recommendations run counter to general web design principles, leading us to believe that such guidelines need to be adapted for this user group. As web applications proliferate, it is important to ensure those who are most vulnerable-who have the least knowledge and the lowest literacy, health literacy, and computer proficiency-can access, understand, and use them. In order for the investment in public reporting to produce value, consumer-facing web applications need to be designed to address end users' unique strengths and limitations. Our findings may help others to build consumer-facing tools or technology targeted to a predominantly older population. We encourage others designing consumer-facing web technologies to critically evaluate their assumptions about user interface design, particularly if they are designing tools for older adults, and to test products with their end users.

Development of a personalized decision aid for breast cancer risk reduction and management.

PubMed

Ozanne, Elissa M; Howe, Rebecca; Omer, Zehra; Esserman, Laura J

2014-01-14

Breast cancer risk reduction has the potential to decrease the incidence of the disease, yet remains underused. We report on the development a web-based tool that provides automated risk assessment and personalized decision support designed for collaborative use between patients and clinicians. Under Institutional Review Board approval, we evaluated the decision tool through a patient focus group, usability testing, and provider interviews (including breast specialists, primary care physicians, genetic counselors). This included demonstrations and data collection at two scientific conferences (2009 International Shared Decision Making Conference, 2009 San Antonio Breast Cancer Symposium). Overall, the evaluations were favorable. The patient focus group evaluations and usability testing (N = 34) provided qualitative feedback about format and design; 88% of these participants found the tool useful and 94% found it easy to use. 91% of the providers (N = 23) indicated that they would use the tool in their clinical setting. BreastHealthDecisions.org represents a new approach to breast cancer prevention care and a framework for high quality preventive healthcare. The ability to integrate risk assessment and decision support in real time will allow for informed, value-driven, and patient-centered breast cancer prevention decisions. The tool is being further evaluated in the clinical setting.

The MedlinePlus public user interface: studies of design challenges and opportunities.

PubMed

Marill, Jennifer L; Miller, Naomi; Kitendaugh, Paula

2006-01-01

What are the challenges involved in designing, modifying, and improving a major health information portal that serves over sixty million page views a month? MedlinePlus, the National Library of Medicine's (NLM's) consumer health Website, is examined. Challenges are presented as six "studies," which describe selected design issues and how NLM staff resolved them. Improving MedlinePlus is an iterative process. Changes in the public user interface are ongoing, reflecting Web design trends, usability testing recommendations, user survey results, new technical requirements, and the need to grow the site in an orderly way. Testing and analysis should accompany Website design modifications. New technologies may enhance a site but also introduce problems. Further modifications to MedlinePlus will be informed by the experiences described here.

Low-Cost Rapid Usability Testing: Its Application in Both Product Development and System Implementation.

PubMed

Kushniruk, Andre; Borycki, Elizabeth

2017-01-01

In recent years there has been considerable discussion around the need for certification and regulation of healthcare information technology (IT). In particular, the usability of the products being developed needs to be evaluated. This has included the application of standards designed to ensure the process of system development is user-centered and takes usability into consideration while a product is being developed. In addition to this, in healthcare, organizations in the United States and Europe have also addressed the need and requirement for product certification. However, despite these efforts there are continued reports of unusable and unsafe implementations. In this paper we discuss the need to not only include (and require) usability testing in the one-time development process of health IT products (such as EHRs), but we also argue for the need to additionally develop specific usability standards and requirements for usability testing during the implementation of vendor products (i.e. post product development) in healthcare settings. It is further argued that health IT products that may have been certified regarding their development process will still require application of usability testing in the process of implementing them in real hospital settings in order to ensure usability and safety. This is needed in order to ensure that the final result of both product development and implementation processes take into account and apply the latest usability principles and methods.

Enhancing Access to Patient Education Information: A Pilot Usability Study

PubMed Central

Beaudoin, Denise E.; Rocha, Roberto A.; Tse, Tony

2005-01-01

Health care organizations are developing Web-based portals to provide patient access to personal health information and enhance patient-provider communication. This pilot study investigates two navigation models (“serial” and “menu-driven”) for improving access to education materials available through a portal. There was a trend toward greater user satisfaction with the menu-driven model. Model preference was influenced by frequency of Web use. Results should aid in the improvement of existing portals and in the development of new ones. PMID:16779179

IntegromeDB: an integrated system and biological search engine.

PubMed

Baitaluk, Michael; Kozhenkov, Sergey; Dubinina, Yulia; Ponomarenko, Julia

2012-01-19

With the growth of biological data in volume and heterogeneity, web search engines become key tools for researchers. However, general-purpose search engines are not specialized for the search of biological data. Here, we present an approach at developing a biological web search engine based on the Semantic Web technologies and demonstrate its implementation for retrieving gene- and protein-centered knowledge. The engine is available at http://www.integromedb.org. The IntegromeDB search engine allows scanning data on gene regulation, gene expression, protein-protein interactions, pathways, metagenomics, mutations, diseases, and other gene- and protein-related data that are automatically retrieved from publicly available databases and web pages using biological ontologies. To perfect the resource design and usability, we welcome and encourage community feedback.

Usability Evaluation of a Web-Based Symptom Monitoring Application for Heart Failure.

PubMed

Wakefield, Bonnie; Pham, Kassie; Scherubel, Melody

2015-07-01

Symptom recognition and reporting by patients with heart failure are critical to avoid hospitalization. This project evaluated a patient symptom tracking application. Fourteen end users (nine patients, five clinicians) from a Midwestern Veterans Affairs Medical Center evaluated the website using a think aloud protocol. A structured observation protocol was used to assess success or failure for each task. Measures included task time, success, and satisfaction. Patients had a mean age of 70 years; clinicians averaged 42 years in age. Patients took 9.3 min and clinicians took less than 3 min per scenario. Most patients needed some assistance, but few patients were completely unable to complete some tasks. Clinicians demonstrated few problems navigating the site. Patient System Usability Scale item scores ranged from 2.0 to 3.6; clinician item scores ranged from 1.8 to 4.0. Further work is needed to determine whether using the web-based tool improves symptom recognition and reporting. © The Author(s) 2015.

Towards usable and interdisciplinary e-infrastructure (Invited)

NASA Astrophysics Data System (ADS)

de Roure, D.

2010-12-01

e-Science and cyberinfrastucture at their outset tended to focus on ‘big science’ and cross-organisational infrastructures, demonstrating complex engineering with the promise of high returns. It soon became evident that the key to researchers harnessing new technology for everyday use is a user-centric approach which empowers the user - both from a developer and an end user viewpoint. For example, this philosophy is demonstrated in workflow systems for systematic data processing and in the Web 2.0 approach as exemplified by the myExperiment social web site for sharing workflows, methods and ‘research objects’. Hence the most disruptive aspect of Cloud and virtualisation is perhaps that they make new computational resources and applications usable, creating a flourishing ecosystem for routine processing and innovation alike - and in this we must consider software sustainability. This talk will discuss the changing nature of e-Science digital ecosystem, focus on the e-infrastructure for cross-disciplinary work, and highlight issues in sustainable software development in this context.

An overview of emerging technologies in contemporary decision support system development

NASA Astrophysics Data System (ADS)

Nursal, Ahmad Taufik; Omar, Mohd Faizal; Nawi, Mohd Nasrun Mohd

2014-12-01

The rapid development of Web technology has opened a new approach to Decision Support System (DSS) development. For instance, Social Media is one of the Web 2.0 digital platforms that allow the creation and exchanges of user-generate content through an interactive interface, high user control and mass participation. The concept and characteristics of Web 2.0 such as remote, platform-independent, context-rich and easy to use, which is fulfill the concept and purpose of DSS. This paper outlines some of the elementary concepts of Web 2.0 and social media technology which can be potentially integrated within DSS to enhance the decision-making process. Our initial investigation indicates that there is limited study attempt to embed Web 2.0 into DSS. Thus, this paper highlights the importance of Web 2.0 technology in order to foster the betterment of DSS development and its usability.

ASCOT: A Collaborative Platform for the Virtual Observatory

NASA Astrophysics Data System (ADS)

Marcos, D.; Connolly, A. J.; Krughoff, K. S.; Smith, I.; Wallace, S. C.

2012-09-01

The digital networks are changing the way that knowledge is created, structured, curated, consumed, archived and referenced. Projects like Wikipedia, Github or Galaxy Zoo have shown the potential of online communities to develop and communicate ideas. ASCOT is a web based framework that facilitates collaboration among astronomers providing a simple way to share, explore, interact and analyze large amounts of data from a broad range of sources available trough the Virtual Observatories (VO). Designed with a strong emphasis on usability, ASCOT takes advantage of the latest generation of web standards and cloud technologies to implement an extendable and customizable stack of web tools and services.

Web-Based Mapping Puts the World at Your Fingertips

NASA Technical Reports Server (NTRS)

2008-01-01

NASA's award-winning Earth Resources Laboratory Applications Software (ELAS) package was developed at Stennis Space Center. Since 1978, ELAS has been used worldwide for processing satellite and airborne sensor imagery data of the Earth's surface into readable and usable information. DATASTAR Inc., of Picayune, Mississippi, has used ELAS software in the DATASTAR Image Processing Exploitation (DIPEx) desktop and Internet image processing, analysis, and manipulation software. The new DIPEx Version III includes significant upgrades and improvements compared to its esteemed predecessor. A true World Wide Web application, this product evolved with worldwide geospatial dimensionality and numerous other improvements that seamlessly support the World Wide Web version.

The use of think-aloud and instant data analysis in evaluation research: Exemplar and lessons learned.

PubMed

Joe, Jonathan; Chaudhuri, Shomir; Le, Thai; Thompson, Hilaire; Demiris, George

2015-08-01

While health information technologies have become increasingly popular, many have not been formally tested to ascertain their usability. Traditional rigorous methods take significant amounts of time and manpower to evaluate the usability of a system. In this paper, we evaluate the use of instant data analysis (IDA) as developed by Kjeldskov et al. to perform usability testing on a tool designed for older adults and caregivers. The IDA method is attractive because it takes significantly less time and manpower than the traditional usability testing methods. In this paper we demonstrate how IDA was used to evaluate usability of a multifunctional wellness tool, discuss study results and lessons learned while using this method. We also present findings from an extension of the method which allows the grouping of similar usability problems in an efficient manner. We found that the IDA method is a quick, relatively easy approach to identifying and ranking usability issues among health information technologies. Copyright © 2015 Elsevier Inc. All rights reserved.

Using a medical simulation center as an electronic health record usability laboratory

PubMed Central

Landman, Adam B; Redden, Lisa; Neri, Pamela; Poole, Stephen; Horsky, Jan; Raja, Ali S; Pozner, Charles N; Schiff, Gordon; Poon, Eric G

2014-01-01

Usability testing is increasingly being recognized as a way to increase the usability and safety of health information technology (HIT). Medical simulation centers can serve as testing environments for HIT usability studies. We integrated the quality assurance version of our emergency department (ED) electronic health record (EHR) into our medical simulation center and piloted a clinical care scenario in which emergency medicine resident physicians evaluated a simulated ED patient and documented electronically using the ED EHR. Meticulous planning and close collaboration with expert simulation staff was important for designing test scenarios, pilot testing, and running the sessions. Similarly, working with information systems teams was important for integration of the EHR. Electronic tools are needed to facilitate entry of fictitious clinical results while the simulation scenario is unfolding. EHRs can be successfully integrated into existing simulation centers, which may provide realistic environments for usability testing, training, and evaluation of human–computer interactions. PMID:24249778

A systematic review of usability test metrics for mobile video streaming apps

NASA Astrophysics Data System (ADS)

Hussain, Azham; Mkpojiogu, Emmanuel O. C.

2016-08-01

This paper presents the results of a systematic review regarding the usability test metrics for mobile video streaming apps. In the study, 238 studies were found, but only 51 relevant papers were eventually selected for the review. The study reveals that time taken for video streaming and the video quality were the two most popular metrics used in the usability tests for mobile video streaming apps. Besides, most of the studies concentrated on the usability of mobile TV as users are switching from traditional TV to mobile TV.

Heuristic Evaluation of Online COPD Respiratory Therapy and Education Video Resource Center

PubMed Central

Chaney, Beth; Chaney, Don

2014-01-01

Abstract Purpose: Because of limited accessibility to pulmonary rehabilitation programs, patients with chronic obstructive pulmonary disease (COPD) are infrequently provided with patient education resources. To help educate patients with COPD on how to live a better life with diminished breathing capacity, we developed a novel social media resource center containing COPD respiratory therapy and education videos called “COPDFlix.” Methodology: A heuristic evaluation of COPDFlix was conducted as part of a larger study to determine whether the prototype was successful in adhering to formal Web site usability guidelines for older adults. A purposive sample of three experts, with expertise in Web design and health communications technology, was recruited (a) to identify usability violations and (b) to propose solutions to improve the functionality of the COPDFlix prototype. Each expert evaluated 18 heuristics in four categories of task-based criteria (i.e., interaction and navigation, information architecture, presentation design, and information design). Seventy-six subcriteria across these four categories were assessed. Quantitative ratings and qualitative comments from each expert were compiled into a single master list, noting the violated heuristic and type/location of problem(s). Results: Sixty-one usability violations were identified across the 18 heuristics. Evaluators rated the majority of heuristic subcriteria as either a “minor hindrance” (n=32) or “no problem” (n=132). Moreover, only 2 of the 18 heuristic categories were noted as “major” violations, with mean severity scores of ≥3. Conclusions: Mixed-methods data analysis helped the multidisciplinary research team to categorize and prioritize usability problems and solutions, leading to 26 discrete design modifications within the COPDFlix prototype. PMID:24650318

Situated Usability Testing for Security Systems

DOE Office of Scientific and Technical Information (OSTI.GOV)

Greitzer, Frank L.

2011-03-02

While usability testing is well established, assessing the usability of security software, tools, or methods deserves more careful consideration. It has been argued that dealing with security has become too difficult for individuals or organizations to manage effectively or to use conveniently. As difficult as it is for system administrators and developers to deal with, security is even more challenging for casual users. Indeed, it is much too easy for casual/home users to configure the security of their systems in non-optimal ways that leave their systems inadvertently insecure. This is exacerbated by the fact that casual users are focused onmore » matters other than security, and likely would prefer not even to think about security. This brief report argues that when security and/or privacy are part of the equation, traditional methods for usability testing should be re-considered. The purpose of this brief report is to argue for and outline a method associated with a new approach to usability testing for examining usable security issues.« less

Designing Telemedicine Systems for Geriatric Patients: A Review of the Usability Studies.

PubMed

Narasimha, Shraddhaa; Madathil, Kapil Chalil; Agnisarman, Sruthy; Rogers, Hunter; Welch, Brandon; Ashok, Aparna; Nair, Aswathi; McElligott, James

2017-06-01

One area where telemedicine may prove to be highly effective is in providing medical care to the geriatric population, an age group predicted to account for 20% of the population in the near future. However, even though telemedicine has certain advantages, the usability of these systems with this population merits investigation. This article reviews the literature published from 2000 to 2016 with the goal of analyzing the characteristics of usability-related studies conducted using geriatric participants and the subsequent usability challenges identified. Articles were found using Web of Knowledge and PubMed citation indexing portals using the keywords (1) Telemedicine* AND Geriatrics* (2) Telemedicine* AND Usability* (3) Telemedicine* AND Usability* AND Older Adults*. A total of 297 articles were obtained from the initial search. After further detailed screening, 16 articles were selected for review based on the inclusion criteria. Of these, 60% of the studies focused on the overall usability of telemedicine systems; 6.25% focused on the usability of a telepresence robot; 12.5% compared a face-to-face medical consultation with the use of telemedicine systems, and 25% focused on the study of other aspects of telemedicine in addition to its usability. Findings reported in the studies included high patient satisfaction with telemedicine in 31.25%, whereas another 31.25% indicated a high acceptance of this method of medical consultation. Care coordination in 6.25% of the studies; confidence in telemedicine in 6.25%; trust, privacy, and reliability in 6.25%; and increased convenience when compared to personal visits in 18.75% were also reported. This review suggests limited research providing scientifically valid and reproducible usability evaluation at various stages of telemedicine system development. Telemedicine system designers need to consider the age-related issues in cognition, perception, and behavior of geriatric patients while designing telemedicine applications. Future directions for research were developed based on the limitations as well as other results found in this systematic review.

Technical Considerations in Remote LIMS Access via the World Wide Web

PubMed Central

Schlabach, David M.

2005-01-01

The increased dependency on the World Wide Web by both laboratories and their customers has led LIMS developers to take advantage of thin-client web applications that provide both remote data entry and manipulation, along with remote reporting functionality. Use of an LIMS through a web browser allows a person to interact with a distant application, providing both remote administration and real-time analytical result delivery from virtually anywhere in the world. While there are many benefits of web-based LIMS applications, some concern must be given to these new methods of system architecture before justifying them as a suitable replacement for their traditional client-server systems. Developers and consumers alike must consider the security aspects of introducing a wide area network capable system into a production environment, as well as the concerns of data integrity and usability. PMID:18924736

Web GIS in practice IV: publishing your health maps and connecting to remote WMS sources using the Open Source UMN MapServer and DM Solutions MapLab

PubMed Central

Boulos, Maged N Kamel; Honda, Kiyoshi

2006-01-01

Open Source Web GIS software systems have reached a stage of maturity, sophistication, robustness and stability, and usability and user friendliness rivalling that of commercial, proprietary GIS and Web GIS server products. The Open Source Web GIS community is also actively embracing OGC (Open Geospatial Consortium) standards, including WMS (Web Map Service). WMS enables the creation of Web maps that have layers coming from multiple different remote servers/sources. In this article we present one easy to implement Web GIS server solution that is based on the Open Source University of Minnesota (UMN) MapServer. By following the accompanying step-by-step tutorial instructions, interested readers running mainstream Microsoft® Windows machines and with no prior technical experience in Web GIS or Internet map servers will be able to publish their own health maps on the Web and add to those maps additional layers retrieved from remote WMS servers. The 'digital Asia' and 2004 Indian Ocean tsunami experiences in using free Open Source Web GIS software are also briefly described. PMID:16420699

Professional Writing in the English Classroom: Let's Get Real--Using Usability to Connect Writers, Readers, and Texts

ERIC Educational Resources Information Center

Bush, Jonathan, Ed.; Zuidema, Leah, Ed.

2012-01-01

In professional writing, usability testing investigates how well users can find, understand, and use a document (Lannon). Usability testing involves gathering feedback from users, analyzing how successfully they used the document, and drawing on the test results to change or refine the design. From the authors' experiences as writers and teachers,…

Resource Discovery within the Networked "Hybrid" Library.

ERIC Educational Resources Information Center

Leigh, Sally-Anne

This paper focuses on the development, adoption, and integration of resource discovery, knowledge management, and/or knowledge sharing interfaces such as interactive portals, and the use of the library's World Wide Web presence to increase the availability and usability of information services. The introduction addresses changes in library…

ProjectHeartforGirls.com: Development of a Web-Based HIV/STD Prevention Program for Adolescent Girls Emphasizing Sexual Communication Skills.

PubMed

Widman, Laura; Golin, Carol E; Noar, Seth M; Massey, Joy; Prinstein, Mitchell J

2016-10-01

This article describes the development of ProjectHeartforGirls.com , an interactive web-based program designed to improve sexual communication skills and reduce the risk of HIV/STDs among adolescent girls, a population at heightened risk for negative sexual health outcomes (Centers for Disease Control and Prevention, 2013). Although sexual communication is a critical predictor of safer sex among teens, there are few online interventions that target these skills as a central program component. We developed ProjectHeartforGirls.com to fill this gap. Program development involved (1) identifying the target population (ethnically diverse high school girls), (2) clarifying the theoretical foundation (Reasoned Action Model), (3) conducting formative qualitative research (n = 25 girls), (4) drafting initial program content, (5) receiving ongoing feedback from a teen advisory board (n = 5 girls), (6) programming online content, and (7) conducting usability testing (n = 6 girls). These steps are described along with the final intervention product, which is currently being evaluated in a randomized controlled trial.

ProjectHeartForGirls.com: Development of a web-based HIV/STD prevention program for adolescent girls emphasizing sexual communication skills

PubMed Central

Widman, Laura; Golin, Carol E.; Noar, Seth M.; Massey, Joy; Prinstein, Mitchell J.

2017-01-01

This article describes the development of ProjectHeartforGirls.com, an interactive web-based program designed to improve sexual communication skills and reduce the risk of HIV/STDs among adolescent girls, a population at heightened risk for negative sexual health outcomes (CDC, 2013). Although sexual communication is a critical predictor of safer sex among teens, there are few online interventions that target these skills as a central program component. We developed ProjectHeartforGirls.com to fill this gap. Program development involved 1) identifying the target population (ethnically-diverse high school girls); 2) clarifying the theoretical foundation (Reasoned Action Model); 3) conducting formative qualitative research (n=25 girls); 4) drafting initial program content; 5) receiving ongoing feedback from a teen advisory board (n=5 girls); 6) programming online content; and 7) conducting usability testing (n=6 girls). These steps are described along with the final intervention product, which is currently being evaluated in a randomized controlled trial. PMID:27710087

Assessment of the usability and impact of the Idaho Health Data Exchange (IHDE).

PubMed

Reis, Janet; MacKenzie, Lisa; Soelberg, Terri; Smith, Jennifer

2016-04-01

Eighty four health care professionals participated in an online survey assessing the usability, and clinical and administrative impact of the Idaho Health Data Exchange's (IHDE) Virtual Health Record (VHR). The IHDE VHR allows authorized users to use a secure web interface to view lab, radiology and transcribed reports from multiple facilities and view medical histories on patients in the data exchange. Results indicate the usability of the IHDE VHR was almost universally positively rated with the Software Usability Measurement Inventory (SUMI) utilized as the assessment method. Medical providers however had the lowest rating of the exchange, raising concerns about the need for additional training and support. The addition of other Idaho health care organizations to the health data exchange was most widely desired, with the most frequently cited benefit being more comprehensive access to patients' records. In contrast to other published evaluations of health data exchanges in the U.S., few of the concerns emerged about cost of implementation of the data exchange or trust in the quality of information contained therein.

Evaluating the Effectiveness of Web-based Climate Resilience Decision Support Tools: Insights from Coastal New Jersey

NASA Astrophysics Data System (ADS)

Brady, M.; Lathrop, R.; Auermuller, L. M.; Leichenko, R.

2016-12-01

Despite the recent surge of Web-based decision support tools designed to promote resiliency in U.S. coastal communities, to-date there has been no systematic study of their effectiveness. This study demonstrates a method to evaluate important aspects of effectiveness of four Web map tools designed to promote consideration of climate risk information in local decision-making and planning used in coastal New Jersey. In summer 2015, the research team conducted in-depth phone interviews with users of one regulatory and three non-regulatory Web map tools using a semi-structured questionnaire. The interview and analysis design drew from a combination of effectiveness evaluation approaches developed in software and information usability, program evaluation, and management information system (MIS) research. Effectiveness assessment results were further analyzed and discussed in terms of conceptual hierarchy of system objectives defined by respective tool developer and user organizations represented in the study. Insights from the interviews suggest that users rely on Web tools as a supplement to desktop and analog map sources because they provide relevant and up-to-date information in a highly accessible and mobile format. The users also reported relying on multiple information sources and comparison between digital and analog sources for decision support. However, with respect to this decision support benefit, users were constrained by accessibility factors such as lack of awareness and training with some tools, lack of salient information such as planning time horizons associated with future flood scenarios, and environmental factors such as mandates restricting some users to regulatory tools. Perceptions of Web tool credibility seem favorable overall, but factors including system design imperfections and inconsistencies in data and information across platforms limited trust, highlighting a need for better coordination between tools. Contributions of the study include user feedback on web-tool system designs consistent with collaborative methods for enhancing usability and a systematic look at effectiveness that includes both user perspectives and consideration of developer and organizational objectives.

Development of a web-based intervention for the indicated prevention of depression.

PubMed

Kelders, Saskia M; Pots, Wendy T M; Oskam, Maarten Jan; Bohlmeijer, Ernst T; van Gemert-Pijnen, Julia E W C

2013-02-20

To reduce the large public health burden of the high prevalence of depression, preventive interventions targeted at people at risk are essential and can be cost-effective. Web-based interventions are able to provide this care, but there is no agreement on how to best develop these applications and often the technology is seen as a given. This seems to be one of the main reasons that web-based interventions do not reach their full potential. The current study describes the development of a web-based intervention for the indicated prevention of depression, employing the CeHRes (Center for eHealth Research and Disease Management) roadmap. The goals are to create a user-friendly application which fits the values of the stakeholders and to evaluate the process of development. The employed methods are a literature scan and discussion in the contextual inquiry; interviews, rapid prototyping and a requirement session in the value specification stage; and user-based usability evaluation, expert-based usability inspection and a requirement session in the design stage. The contextual inquiry indicated that there is a need for easily accessible interventions for the indicated prevention of depression and web-based interventions are seen as potentially meeting this need. The value specification stage yielded expected needs of potential participants, comments on the usefulness of the proposed features and comments on two proposed designs of the web-based intervention. The design stage yielded valuable comments on the system, content and service of the web-based intervention. Overall, we found that by developing the technology, we successfully (re)designed the system, content and service of the web-based intervention to match the values of stakeholders. This study has shown the importance of a structured development process of a web-based intervention for the indicated prevention of depression because: (1) it allows the development team to clarify the needs that have to be met for the intervention to be of use to the target audience; and (2) it yields feedback on the design of the application that is broader than color and buttons, but encompasses comments on the quality of the service that the application offers.

Development of a web-based intervention for the indicated prevention of depression

PubMed Central

2013-01-01

Background To reduce the large public health burden of the high prevalence of depression, preventive interventions targeted at people at risk are essential and can be cost-effective. Web-based interventions are able to provide this care, but there is no agreement on how to best develop these applications and often the technology is seen as a given. This seems to be one of the main reasons that web-based interventions do not reach their full potential. The current study describes the development of a web-based intervention for the indicated prevention of depression, employing the CeHRes (Center for eHealth Research and Disease Management) roadmap. The goals are to create a user-friendly application which fits the values of the stakeholders and to evaluate the process of development. Methods The employed methods are a literature scan and discussion in the contextual inquiry; interviews, rapid prototyping and a requirement session in the value specification stage; and user-based usability evaluation, expert-based usability inspection and a requirement session in the design stage. Results The contextual inquiry indicated that there is a need for easily accessible interventions for the indicated prevention of depression and web-based interventions are seen as potentially meeting this need. The value specification stage yielded expected needs of potential participants, comments on the usefulness of the proposed features and comments on two proposed designs of the web-based intervention. The design stage yielded valuable comments on the system, content and service of the web-based intervention. Conclusions Overall, we found that by developing the technology, we successfully (re)designed the system, content and service of the web-based intervention to match the values of stakeholders. This study has shown the importance of a structured development process of a web-based intervention for the indicated prevention of depression because: (1) it allows the development team to clarify the needs that have to be met for the intervention to be of use to the target audience; and (2) it yields feedback on the design of the application that is broader than color and buttons, but encompasses comments on the quality of the service that the application offers. PMID:23425322

Can social semantic web techniques foster collaborative curriculum mapping in medicine?

PubMed

Spreckelsen, Cord; Finsterer, Sonja; Cremer, Jan; Schenkat, Hennig

2013-08-15

Curriculum mapping, which is aimed at the systematic realignment of the planned, taught, and learned curriculum, is considered a challenging and ongoing effort in medical education. Second-generation curriculum managing systems foster knowledge management processes including curriculum mapping in order to give comprehensive support to learners, teachers, and administrators. The large quantity of custom-built software in this field indicates a shortcoming of available IT tools and standards. The project reported here aims at the systematic adoption of techniques and standards of the Social Semantic Web to implement collaborative curriculum mapping for a complete medical model curriculum. A semantic MediaWiki (SMW)-based Web application has been introduced as a platform for the elicitation and revision process of the Aachen Catalogue of Learning Objectives (ACLO). The semantic wiki uses a domain model of the curricular context and offers structured (form-based) data entry, multiple views, structured querying, semantic indexing, and commenting for learning objectives ("LOs"). Semantic indexing of learning objectives relies on both a controlled vocabulary of international medical classifications (ICD, MeSH) and a folksonomy maintained by the users. An additional module supporting the global checking of consistency complements the semantic wiki. Statements of the Object Constraint Language define the consistency criteria. We evaluated the application by a scenario-based formative usability study, where the participants solved tasks in the (fictional) context of 7 typical situations and answered a questionnaire containing Likert-scaled items and free-text questions. At present, ACLO contains roughly 5350 operational (ie, specific and measurable) objectives acquired during the last 25 months. The wiki-based user interface uses 13 online forms for data entry and 4 online forms for flexible searches of LOs, and all the forms are accessible by standard Web browsers. The formative usability study yielded positive results (median rating of 2 ("good") in all 7 general usability items) and produced valuable qualitative feedback, especially concerning navigation and comprehensibility. Although not asked to, the participants (n=5) detected critical aspects of the curriculum (similar learning objectives addressed repeatedly and missing objectives), thus proving the system's ability to support curriculum revision. The SMW-based approach enabled an agile implementation of computer-supported knowledge management. The approach, based on standard Social Semantic Web formats and technology, represents a feasible and effectively applicable compromise between answering to the individual requirements of curriculum management at a particular medical school and using proprietary systems.

Usability evaluation of a web-based support system for people with a schizophrenia diagnosis.

PubMed

van der Krieke, Lian; Emerencia, Ando C; Aiello, Marco; Sytema, Sjoerd

2012-02-06

Routine Outcome Monitoring (ROM) is a systematic way of assessing service users' health conditions for the purpose of better aiding their care. ROM consists of various measures used to assess a service user's physical, psychological, and social condition. While ROM is becoming increasingly important in the mental health care sector, one of its weaknesses is that ROM is not always sufficiently service user-oriented. First, clinicians tend to concentrate on those ROM results that provide information about clinical symptoms and functioning, whereas it has been suggested that a service user-oriented approach needs to focus on personal recovery. Second, service users have limited access to ROM results and they are often not equipped to interpret them. These problems need to be addressed, as access to resources and the opportunity to share decision making has been indicated as a prerequisite for service users to become a more equal partner in communication with their clinicians. Furthermore, shared decision making has been shown to improve the therapeutic alliance and to lead to better care. Our aim is to build a web-based support system which makes ROM results more accessible to service users and to provide them with more concrete and personalized information about their functioning (ie, symptoms, housing, social contacts) that they can use to discuss treatment options with their clinician. In this study, we will report on the usability of the web-based support system for service users with schizophrenia. First, we developed a prototype of a web-based support system in a multidisciplinary project team, including end-users. We then conducted a usability study of the support system consisting of (1) a heuristic evaluation, (2) a qualitative evaluation and (3) a quantitative evaluation. Fifteen service users with a schizophrenia diagnosis and four information and communication technology (ICT) experts participated in the study. The results show that people with a schizophrenia diagnosis were able to use the support system easily. Furthermore, the content of the advice generated by the support system was considered meaningful and supportive. This study shows that the support system prototype has valuable potential to improve the ROM practice and it is worthwhile to further develop it into a more mature system. Furthermore, the results add to prior research into web applications for people with psychotic disorders, in that it shows that this group of end users can work with web-based and computer-based systems, despite the cognitive problems they experience.

Development of a Video Coding Scheme for Analyzing the Usability and Usefulness of Health Information Systems.

PubMed

Kushniruk, Andre W; Borycki, Elizabeth M

2015-01-01

Usability has been identified as a key issue in health informatics. Worldwide numerous projects have been carried out in an attempt to increase and optimize health system usability. Usability testing, involving observing end users interacting with systems, has been widely applied and numerous publications have appeared describing such studies. However, to date, fewer works have been published describing methodological approaches to analyzing the rich data stream that results from usability testing. This includes analysis of video, audio and screen recordings. In this paper we describe our work in the development and application of a coding scheme for analyzing the usability of health information systems. The phases involved in such analyses are described.

Writing Commons: A Model for the Creation, Usability, and Evaluation of OERs

ERIC Educational Resources Information Center

Herron, Josh

2016-01-01

As Open Educational Resources (OER) increasingly receive attention from academics, educational foundations, and government agencies, exemplars will emerge that lower student textbook costs by moving away from commercial publishers through self-publishing or curating web-based resources. Joe Moxley's "Writing Commons" serves as a scaled…

Computer Problem-Solving Coaches for Introductory Physics: Design and Usability Studies

ERIC Educational Resources Information Center

Ryan, Qing X.; Frodermann, Evan; Heller, Kenneth; Hsu, Leonardo; Mason, Andrew

2016-01-01

The combination of modern computing power, the interactivity of web applications, and the flexibility of object-oriented programming may finally be sufficient to create computer coaches that can help students develop metacognitive problem-solving skills, an important competence in our rapidly changing technological society. However, no matter how…

75 FR 8725 - Agency Forms Undergoing Paperwork Reduction Act Review

Federal Register 2010, 2011, 2012, 2013, 2014

2010-02-25

.... Proposed Project CDC Web site and Communication Channels Usability Evaluation, (OMB no. 0925-0735, exp. 3/31/2010)--Revision--National Center for Health Marketing (NCHM), Centers for Disease Control and..., mobile-based or other electronic communication channels hosting CDC content on an ongoing basis. It is...

Digitized Special Collections and Multiple User Groups

ERIC Educational Resources Information Center

Gueguen, Gretchen

2010-01-01

Many organizations have evolved since their early attempts to mount digital exhibits on the Web and are experimenting with ways to increase the scale of their digitized collections by utilizing archival finding aid description rather than resource-intensive collections and exhibits. This article examines usability research to predict how such…

The development of a clinical outcomes survey research application: Assessment Center.

PubMed

Gershon, Richard; Rothrock, Nan E; Hanrahan, Rachel T; Jansky, Liz J; Harniss, Mark; Riley, William

2010-06-01

The National Institutes of Health sponsored Patient-Reported Outcome Measurement Information System (PROMIS) aimed to create item banks and computerized adaptive tests (CATs) across multiple domains for individuals with a range of chronic diseases. Web-based software was created to enable a researcher to create study-specific Websites that could administer PROMIS CATs and other instruments to research participants or clinical samples. This paper outlines the process used to develop a user-friendly, free, Web-based resource (Assessment Center) for storage, retrieval, organization, sharing, and administration of patient-reported outcomes (PRO) instruments. Joint Application Design (JAD) sessions were conducted with representatives from numerous institutions in order to supply a general wish list of features. Use Cases were then written to ensure that end user expectations matched programmer specifications. Program development included daily programmer "scrum" sessions, weekly Usability Acceptability Testing (UAT) and continuous Quality Assurance (QA) activities pre- and post-release. Assessment Center includes features that promote instrument development including item histories, data management, and storage of statistical analysis results. This case study of software development highlights the collection and incorporation of user input throughout the development process. Potential future applications of Assessment Center in clinical research are discussed.

"Think aloud" and "Near live" usability testing of two complex clinical decision support tools.

PubMed

Richardson, Safiya; Mishuris, Rebecca; O'Connell, Alexander; Feldstein, David; Hess, Rachel; Smith, Paul; McCullagh, Lauren; McGinn, Thomas; Mann, Devin

2017-10-01

Low provider adoption continues to be a significant barrier to realizing the potential of clinical decision support. "Think Aloud" and "Near Live" usability testing were conducted on two clinical decision support tools. Each was composed of an alert, a clinical prediction rule which estimated risk of either group A Streptococcus pharyngitis or pneumonia and an automatic order set based on risk. The objective of this study was to further understanding of the facilitators of usability and to evaluate the types of additional information gained from proceeding to "Near Live" testing after completing "Think Aloud". This was a qualitative observational study conducted at a large academic health care system with 12 primary care providers. During "Think Aloud" testing, participants were provided with written clinical scenarios and asked to verbalize their thought process while interacting with the tool. During "Near Live" testing participants interacted with a mock patient. Morae usability software was used to record full screen capture and audio during every session. Participant comments were placed into coding categories and analyzed for generalizable themes. Themes were compared across usability methods. "Think Aloud" and "Near Live" usability testing generated similar themes under the coding categories visibility, workflow, content, understand-ability and navigation. However, they generated significantly different themes under the coding categories usability, practical usefulness and medical usefulness. During both types of testing participants found the tool easier to use when important text was distinct in its appearance, alerts were passive and appropriately timed, content was up to date, language was clear and simple, and each component of the tool included obvious indicators of next steps. Participant comments reflected higher expectations for usability and usefulness during "Near Live" testing. For example, visit aids, such as automatically generated order sets, were felt to be less useful during "Near-Live" testing because they would not be all inclusive for the visit. These complementary types of usability testing generated unique and generalizable insights. Feedback during "Think Aloud" testing primarily helped to improve the tools' ease of use. The additional feedback from "Near Live" testing, which mimics a real clinical encounter, was helpful for eliciting key barriers and facilitators to provider workflow and adoption. Copyright © 2017 Elsevier B.V. All rights reserved.

Robust image obfuscation for privacy protection in Web 2.0 applications

NASA Astrophysics Data System (ADS)

Poller, Andreas; Steinebach, Martin; Liu, Huajian

2012-03-01

We present two approaches to robust image obfuscation based on permutation of image regions and channel intensity modulation. The proposed concept of robust image obfuscation is a step towards end-to-end security in Web 2.0 applications. It helps to protect the privacy of the users against threats caused by internet bots and web applications that extract biometric and other features from images for data-linkage purposes. The approaches described in this paper consider that images uploaded to Web 2.0 applications pass several transformations, such as scaling and JPEG compression, until the receiver downloads them. In contrast to existing approaches, our focus is on usability, therefore the primary goal is not a maximum of security but an acceptable trade-off between security and resulting image quality.

IntegromeDB: an integrated system and biological search engine

PubMed Central

2012-01-01

Background With the growth of biological data in volume and heterogeneity, web search engines become key tools for researchers. However, general-purpose search engines are not specialized for the search of biological data. Description Here, we present an approach at developing a biological web search engine based on the Semantic Web technologies and demonstrate its implementation for retrieving gene- and protein-centered knowledge. The engine is available at http://www.integromedb.org. Conclusions The IntegromeDB search engine allows scanning data on gene regulation, gene expression, protein-protein interactions, pathways, metagenomics, mutations, diseases, and other gene- and protein-related data that are automatically retrieved from publicly available databases and web pages using biological ontologies. To perfect the resource design and usability, we welcome and encourage community feedback. PMID:22260095

Integrating Low-Cost Rapid Usability Testing into Agile System Development of Healthcare IT: A Methodological Perspective.

PubMed

Kushniruk, Andre W; Borycki, Elizabeth M

2015-01-01

The development of more usable and effective healthcare information systems has become a critical issue. In the software industry methodologies such as agile and iterative development processes have emerged to lead to more effective and usable systems. These approaches highlight focusing on user needs and promoting iterative and flexible development practices. Evaluation and testing of iterative agile development cycles is considered an important part of the agile methodology and iterative processes for system design and re-design. However, the issue of how to effectively integrate usability testing methods into rapid and flexible agile design cycles has remained to be fully explored. In this paper we describe our application of an approach known as low-cost rapid usability testing as it has been applied within agile system development in healthcare. The advantages of the integrative approach are described, along with current methodological considerations.

Design and Development of a Linked Open Data-Based Health Information Representation and Visualization System: Potentials and Preliminary Evaluation

PubMed Central

Kauppinen, Tomi; Keßler, Carsten; Fritz, Fleur

2014-01-01

Background Healthcare organizations around the world are challenged by pressures to reduce cost, improve coordination and outcome, and provide more with less. This requires effective planning and evidence-based practice by generating important information from available data. Thus, flexible and user-friendly ways to represent, query, and visualize health data becomes increasingly important. International organizations such as the World Health Organization (WHO) regularly publish vital data on priority health topics that can be utilized for public health policy and health service development. However, the data in most portals is displayed in either Excel or PDF formats, which makes information discovery and reuse difficult. Linked Open Data (LOD)—a new Semantic Web set of best practice of standards to publish and link heterogeneous data—can be applied to the representation and management of public level health data to alleviate such challenges. However, the technologies behind building LOD systems and their effectiveness for health data are yet to be assessed. Objective The objective of this study is to evaluate whether Linked Data technologies are potential options for health information representation, visualization, and retrieval systems development and to identify the available tools and methodologies to build Linked Data-based health information systems. Methods We used the Resource Description Framework (RDF) for data representation, Fuseki triple store for data storage, and Sgvizler for information visualization. Additionally, we integrated SPARQL query interface for interacting with the data. We primarily use the WHO health observatory dataset to test the system. All the data were represented using RDF and interlinked with other related datasets on the Web of Data using Silk—a link discovery framework for Web of Data. A preliminary usability assessment was conducted following the System Usability Scale (SUS) method. Results We developed an LOD-based health information representation, querying, and visualization system by using Linked Data tools. We imported more than 20,000 HIV-related data elements on mortality, prevalence, incidence, and related variables, which are freely available from the WHO global health observatory database. Additionally, we automatically linked 5312 data elements from DBpedia, Bio2RDF, and LinkedCT using the Silk framework. The system users can retrieve and visualize health information according to their interests. For users who are not familiar with SPARQL queries, we integrated a Linked Data search engine interface to search and browse the data. We used the system to represent and store the data, facilitating flexible queries and different kinds of visualizations. The preliminary user evaluation score by public health data managers and users was 82 on the SUS usability measurement scale. The need to write queries in the interface was the main reported difficulty of LOD-based systems to the end user. Conclusions The system introduced in this article shows that current LOD technologies are a promising alternative to represent heterogeneous health data in a flexible and reusable manner so that they can serve intelligent queries, and ultimately support decision-making. However, the development of advanced text-based search engines is necessary to increase its usability especially for nontechnical users. Further research with large datasets is recommended in the future to unfold the potential of Linked Data and Semantic Web for future health information systems development. PMID:25601195

Design and development of a linked open data-based health information representation and visualization system: potentials and preliminary evaluation.

PubMed

Tilahun, Binyam; Kauppinen, Tomi; Keßler, Carsten; Fritz, Fleur

2014-10-25

Healthcare organizations around the world are challenged by pressures to reduce cost, improve coordination and outcome, and provide more with less. This requires effective planning and evidence-based practice by generating important information from available data. Thus, flexible and user-friendly ways to represent, query, and visualize health data becomes increasingly important. International organizations such as the World Health Organization (WHO) regularly publish vital data on priority health topics that can be utilized for public health policy and health service development. However, the data in most portals is displayed in either Excel or PDF formats, which makes information discovery and reuse difficult. Linked Open Data (LOD)-a new Semantic Web set of best practice of standards to publish and link heterogeneous data-can be applied to the representation and management of public level health data to alleviate such challenges. However, the technologies behind building LOD systems and their effectiveness for health data are yet to be assessed. The objective of this study is to evaluate whether Linked Data technologies are potential options for health information representation, visualization, and retrieval systems development and to identify the available tools and methodologies to build Linked Data-based health information systems. We used the Resource Description Framework (RDF) for data representation, Fuseki triple store for data storage, and Sgvizler for information visualization. Additionally, we integrated SPARQL query interface for interacting with the data. We primarily use the WHO health observatory dataset to test the system. All the data were represented using RDF and interlinked with other related datasets on the Web of Data using Silk-a link discovery framework for Web of Data. A preliminary usability assessment was conducted following the System Usability Scale (SUS) method. We developed an LOD-based health information representation, querying, and visualization system by using Linked Data tools. We imported more than 20,000 HIV-related data elements on mortality, prevalence, incidence, and related variables, which are freely available from the WHO global health observatory database. Additionally, we automatically linked 5312 data elements from DBpedia, Bio2RDF, and LinkedCT using the Silk framework. The system users can retrieve and visualize health information according to their interests. For users who are not familiar with SPARQL queries, we integrated a Linked Data search engine interface to search and browse the data. We used the system to represent and store the data, facilitating flexible queries and different kinds of visualizations. The preliminary user evaluation score by public health data managers and users was 82 on the SUS usability measurement scale. The need to write queries in the interface was the main reported difficulty of LOD-based systems to the end user. The system introduced in this article shows that current LOD technologies are a promising alternative to represent heterogeneous health data in a flexible and reusable manner so that they can serve intelligent queries, and ultimately support decision-making. However, the development of advanced text-based search engines is necessary to increase its usability especially for nontechnical users. Further research with large datasets is recommended in the future to unfold the potential of Linked Data and Semantic Web for future health information systems development.

Internationalization and localization: evaluating and testing a Website for Asian users.

PubMed

Rau, Pei-Luen Patrick; Liang, Sheau-Farn Max

2003-01-15

The objective of this study was to combine internationalization and localization of Websites and improvement of Website usability with user-centred design methods. This study designed for internationalization and localization of Websites for Asian users, and implemented usability engineering into every phase of Website usability testing, based on the internationalization and localization perspectives of the honeywell.com/your home Website. The first step was to develop the usage scenarios. Three Asian usability specialists carried out one heuristic evaluation session for the current honeywell.com/your home Website. The usability problems were analysed and possible solutions to these problems were discussed. In the next phase, cluster analysis was utilized to test current information architecture. The results provided options for future information architecture development for this Website. Finally, a performance measurement test was conducted to investigate the performance for Asian users. Based on the results, suggestions for improving the Website usability from the localization perspective were provided. The results demonstrate the user-centred design (UCD) approach and stress international and local issues in Website development to Website designers.

The influence of socio-cultural background and product value in usability testing.

PubMed

Sonderegger, Andreas; Sauer, Juergen

2013-05-01

This article examines the influence of socio-cultural background and product value on different outcomes of usability tests. A study was conducted in two different socio-cultural regions, Switzerland and East Germany, which differed in a number of aspects (e.g. economic power, price sensitivity and culture). Product value (high vs. low) was varied by manipulating the price of the product. Sixty-four test participants were asked to carry out five typical user tasks in the context of coffee machine usage, measuring performance, perceived usability, and emotion. The results showed that in Switzerland, high-value products were rated higher in usability than low-value products whereas in East Germany, high-value products were evaluated lower in usability. A similar interaction effect of socio-cultural background and product value was observed for user emotion. Implications are that the outcomes of usability tests do not allow for a simple transfer across cultures and that the mediating influence of perceived product value needs to be taken into consideration. Copyright © 2012 Elsevier Ltd and The Ergonomics Society. All rights reserved.

Deploying and sharing U-Compare workflows as web services.

PubMed

Kontonatsios, Georgios; Korkontzelos, Ioannis; Kolluru, Balakrishna; Thompson, Paul; Ananiadou, Sophia

2013-02-18

U-Compare is a text mining platform that allows the construction, evaluation and comparison of text mining workflows. U-Compare contains a large library of components that are tuned to the biomedical domain. Users can rapidly develop biomedical text mining workflows by mixing and matching U-Compare's components. Workflows developed using U-Compare can be exported and sent to other users who, in turn, can import and re-use them. However, the resulting workflows are standalone applications, i.e., software tools that run and are accessible only via a local machine, and that can only be run with the U-Compare platform. We address the above issues by extending U-Compare to convert standalone workflows into web services automatically, via a two-click process. The resulting web services can be registered on a central server and made publicly available. Alternatively, users can make web services available on their own servers, after installing the web application framework, which is part of the extension to U-Compare. We have performed a user-oriented evaluation of the proposed extension, by asking users who have tested the enhanced functionality of U-Compare to complete questionnaires that assess its functionality, reliability, usability, efficiency and maintainability. The results obtained reveal that the new functionality is well received by users. The web services produced by U-Compare are built on top of open standards, i.e., REST and SOAP protocols, and therefore, they are decoupled from the underlying platform. Exported workflows can be integrated with any application that supports these open standards. We demonstrate how the newly extended U-Compare enhances the cross-platform interoperability of workflows, by seamlessly importing a number of text mining workflow web services exported from U-Compare into Taverna, i.e., a generic scientific workflow construction platform.

Deploying and sharing U-Compare workflows as web services

PubMed Central

2013-01-01

Background U-Compare is a text mining platform that allows the construction, evaluation and comparison of text mining workflows. U-Compare contains a large library of components that are tuned to the biomedical domain. Users can rapidly develop biomedical text mining workflows by mixing and matching U-Compare’s components. Workflows developed using U-Compare can be exported and sent to other users who, in turn, can import and re-use them. However, the resulting workflows are standalone applications, i.e., software tools that run and are accessible only via a local machine, and that can only be run with the U-Compare platform. Results We address the above issues by extending U-Compare to convert standalone workflows into web services automatically, via a two-click process. The resulting web services can be registered on a central server and made publicly available. Alternatively, users can make web services available on their own servers, after installing the web application framework, which is part of the extension to U-Compare. We have performed a user-oriented evaluation of the proposed extension, by asking users who have tested the enhanced functionality of U-Compare to complete questionnaires that assess its functionality, reliability, usability, efficiency and maintainability. The results obtained reveal that the new functionality is well received by users. Conclusions The web services produced by U-Compare are built on top of open standards, i.e., REST and SOAP protocols, and therefore, they are decoupled from the underlying platform. Exported workflows can be integrated with any application that supports these open standards. We demonstrate how the newly extended U-Compare enhances the cross-platform interoperability of workflows, by seamlessly importing a number of text mining workflow web services exported from U-Compare into Taverna, i.e., a generic scientific workflow construction platform. PMID:23419017

Development, Construction, and Content Validation of a Questionnaire to Test Mobile Shower Commode Usability

PubMed Central

Theodoros, Deborah G.; Russell, Trevor G.

2015-01-01

Background: Usability is an emerging domain of outcomes measurement in assistive technology provision. Currently, no questionnaires exist to test the usability of mobile shower commodes (MSCs) used by adults with spinal cord injury (SCI). Objective: To describe the development, construction, and initial content validation of an electronic questionnaire to test mobile shower commode usability for this population. Methods: The questionnaire was constructed using a mixed-methods approach in 5 phases: determining user preferences for the questionnaire’s format, developing an item bank of usability indicators from the literature and judgement of experts, constructing a preliminary questionnaire, assessing content validity with a panel of experts, and constructing the final questionnaire. Results: The electronic Mobile Shower Commode Assessment Tool Version 1.0 (eMAST 1.0) questionnaire tests MSC features and performance during activities identified using a mixed-methods approach and in consultation with users. It confirms that usability is complex and multidimensional. The final questionnaire contains 25 questions in 3 sections. The eMAST 1.0 demonstrates excellent content validity as determined by a small sample of expert clinicians. Conclusion: The eMAST 1.0 tests usability of MSCs from the perspective of adults with SCI and may be used to solicit feedback during MSC design, assessment, prescription, and ongoing use. Further studies assessing the eMAST’s psychometric properties, including studies with users of MSCs, are needed. PMID:25762862

Applying usability methods to identify health literacy issues: an example using a Personal Health Record.

PubMed

Monkman, Helen; Kushniruk, Andre

2013-01-01

The prevalence of consumer health information systems is increasing. However, usability and health literacy impact both the value and adoption of these systems. Health literacy and usability are closely related in that systems may not be used accurately if users cannot understand the information therein. Thus, it is imperative to focus on mitigating the demands on health literacy in consumer health information systems. This study modified two usability evaluation methods (heuristic evaluation and usability testing) to incorporate the identification of potential health literacy issues in a Personal Health Record (PHR). Heuristic evaluation is an analysis of a system performed by a usability specialist who evaluates how well the system abides by usability principles. In contrast, a usability test involves a post hoc analysis of a representative user interacting with the system. These two methods revealed several health literacy issues and suggestions to ameliorate them were made. Thus, it was demonstrated that usability methods could be successfully augmented for the purpose of investigating health literacy issues. To improve users' health knowledge, the adoption of consumer health information systems, and the accuracy of the information contained therein, it is encouraged that usability methods be applied with an added focus on health literacy.

Usability evaluation techniques in mobile commerce applications: A systematic review

NASA Astrophysics Data System (ADS)

Hussain, Azham; Mkpojiogu, Emmanuel O. C.

2016-08-01

Obviously, there are a number of literatures concerning the usability of mobile commerce (m-commerce) applications and related areas, but they do not adequately provide knowledge about usability techniques used in most of the empirical usability evaluation for m-commerce application. Therefore, this paper is aimed at producing the usability techniques frequently used in the aspect of usability evaluation for m-commerce applications. To achieve the stated objective, systematic literature review was employed. Sixty seven papers were downloaded in usability evaluation for m-commerce and related areas; twenty one most relevant studies were selected for review in order to extract the appropriate information. The results from the review shows that heuristic evaluation, formal test and think aloud methods are the most commonly used methods in m-commerce application in comparison to cognitive walkthrough and the informal test methods. Moreover, most of the studies applied control experiment (33.3% of the total studies); other studies that applied case study for usability evaluation are 14.28%. The results from this paper provide additional knowledge to the usability practitioners and research community for the current state and use of usability techniques in m-commerce application.

Usability testing of a prototype multi-user telehealth kiosk.

PubMed

Courtney, Karen L; Matthews, Judith T; McMillan, Julie M; Person Mecca, Laurel; Smailagic, Asim; Siewiorek, Daniel

2015-01-01

The overall purpose of this study was to learn how community-dwelling older adults would interact with our prototype multi-user telehealth kiosk and their views about its usability. Seven subjects participated in laboratory-based usability sessions to evaluate the physical design, appearance, functionality and perceived ease of use of a multi-user telehealth kiosk prototype. During usability testing participants recommended 18 new features (29% of comments), identified 15 software errors (23% of comments) and 29 user interface errors (47% of comments).

Usability: Human Research Program - Space Human Factors and Habitability

NASA Technical Reports Server (NTRS)

Sandor, Aniko; Holden, Kritina L.

2009-01-01

The Usability project addresses the need for research in the area of metrics and methodologies used in hardware and software usability testing in order to define quantifiable and verifiable usability requirements. A usability test is a human-in-the-loop evaluation where a participant works through a realistic set of representative tasks using the hardware/software under investigation. The purpose of this research is to define metrics and methodologies for measuring and verifying usability in the aerospace domain in accordance with FY09 focus on errors, consistency, and mobility/maneuverability. Usability metrics must be predictive of success with the interfaces, must be easy to obtain and/or calculate, and must meet the intent of current Human Systems Integration Requirements (HSIR). Methodologies must work within the constraints of the aerospace domain, be cost and time efficient, and be able to be applied without extensive specialized training.

Usability Testing For Android Based Application “Jogja Smart Tourism”

NASA Astrophysics Data System (ADS)

Harwati; Djati Widodo, Imam

2017-06-01

The android based application “Jogja Smart Tourism (JST)” is designed to help everyone who visited Yogyakarta to enjoy their travel. As new application, it is need to be tested for its usability before launched. Usability testing will show how easy user interfaces are to used. The objective of this research is to demonstrate the result of usability testing for application JST based on five characteristics: learnability, effectiveness, memorability, errors, and satisfaction. About 30 respondents were involved to test the usability of this application. Learnability and effectiveness is calculated from some task that should be finished by respondents, and the rest aspects are calculated from questionnaires that should be answered after simulation. There are 14 functions bound in this usability testing. The result shows total usability level is in 81.75%. Learnability testing shows that 98.8% of respondent could finish the task successfully with 87.5% in efficiency. The memorability level of respondents is good (84.5%) where their ability to fix the errors is 71.5%. And the last for satisfaction level of application interface is 66.25%. Low level of satisfaction occurred because most of respondent felt uncomfortable with landscape interface of application because they should turn their mobile phone while using JST application and also it happened because the lack of using picture and colour inside the application. Both of these becomes important note for the improvement of further applications where the interface in a portrait version is more comfort the use and also utilization of colour and the image will be the main focus to improve customer satisfaction.

Mobile medical visual information retrieval.

PubMed

Depeursinge, Adrien; Duc, Samuel; Eggel, Ivan; Müller, Henning

2012-01-01

In this paper, we propose mobile access to peer-reviewed medical information based on textual search and content-based visual image retrieval. Web-based interfaces designed for limited screen space were developed to query via web services a medical information retrieval engine optimizing the amount of data to be transferred in wireless form. Visual and textual retrieval engines with state-of-the-art performance were integrated. Results obtained show a good usability of the software. Future use in clinical environments has the potential of increasing quality of patient care through bedside access to the medical literature in context.

Evaluation of Web-Based Consumer Medication Information: Content and Usability of 4 Australian Websites

PubMed Central

Tariq, Amina; Richardson, Lauren; Byrne, Mary; Robinson, Maureen; Li, Ling; Westbrook, Johanna I; Baysari, Melissa T

2016-01-01

Background Medication is the most common intervention in health care, and written medication information can affect consumers’ medication-related behavior. Research has shown that a large proportion of Australians search for medication information on the Internet. Objective To evaluate the medication information content, based on consumer medication information needs, and usability of 4 Australian health websites: Better Health Channel, myDr, healthdirect, and NPS MedicineWise . Methods To assess website content, the most common consumer medication information needs were identified using (1) medication queries to the healthdirect helpline (a telephone helpline available across most of Australia) and (2) the most frequently used medications in Australia. The most frequently used medications were extracted from Australian government statistics on use of subsidized medicines in the community and the National Census of Medicines Use. Each website was assessed to determine whether it covered or partially covered information and advice about these medications. To assess website usability, 16 consumers participated in user testing wherein they were required to locate 2 pieces of medication information on each website. Brief semistructured interviews were also conducted with participants to gauge their opinions of the websites. Results Information on prescription medication was more comprehensively covered on all websites (3 of 4 websites covered 100% of information) than nonprescription medication (websites covered 0%-67% of information). Most websites relied on consumer medicines information leaflets to convey prescription medication information to consumers. Information about prescription medication classes was less comprehensive, with no website providing all information examined about antibiotics and antidepressants. Participants (n=16) were able to locate medication information on websites in most cases (accuracy ranged from 84% to 91%). However, a number of usability issues relating to website navigation and information display were identified. For example, websites not allowing combinations of search terms to be entered in search boxes and continuous blocks of text without subheadings. Conclusions Of the 4 Australian health information websites tested, none provided consumers with comprehensive medication information on both prescription and nonprescription medications in a user-friendly way. Using data on consumer information needs and user testing to guide medication information content and website design is a useful approach to inform consumer website development. PMID:27443680

The Influence of Product Aesthetics and User State in Usability Testing

ERIC Educational Resources Information Center

Sauer, Juergen; Sonderegger, Andreas

2011-01-01

An empirical study examined the effects of two influencing factors in usability tests on user performance and usability ratings. Product aesthetics (high vs. low) as the main independent factor and prior usage event (positive vs. negative) as a subsidiary independent factor were varied in a between-participants design. 60 participants took part in…

mHealth or eHealth? Efficacy, Use, and Appreciation of a Web-Based Computer-Tailored Physical Activity Intervention for Dutch Adults: A Randomized Controlled Trial.

PubMed

Gomez Quiñonez, Stefanie; Walthouwer, Michel Jean Louis; Schulz, Daniela Nadine; de Vries, Hein

2016-11-09

Until a few years ago, Web-based computer-tailored interventions were almost exclusively delivered via computer (eHealth). However, nowadays, interventions delivered via mobile phones (mHealth) are an interesting alternative for health promotion, as they may more easily reach people 24/7. The first aim of this study was to compare the efficacy of an mHealth and an eHealth version of a Web-based computer-tailored physical activity intervention with a control group. The second aim was to assess potential differences in use and appreciation between the 2 versions. We collected data among 373 Dutch adults at 5 points in time (baseline, after 1 week, after 2 weeks, after 3 weeks, and after 6 months). We recruited participants from a Dutch online research panel and randomly assigned them to 1 of 3 conditions: eHealth (n=138), mHealth (n=108), or control condition (n=127). All participants were asked to complete questionnaires at the 5 points in time. Participants in the eHealth and mHealth group received fully automated tailored feedback messages about their current level of physical activity. Furthermore, they received personal feedback aimed at increasing their amount of physical activity when needed. We used analysis of variance and linear regression analyses to examine differences between the 2 study groups and the control group with regard to efficacy, use, and appreciation. Participants receiving feedback messages (eHealth and mHealth together) were significantly more physically active after 6 months than participants in the control group (B=8.48, df=2, P=.03, Cohen d=0.27). We found a small effect size favoring the eHealth condition over the control group (B=6.13, df=2, P=.09, Cohen d=0.21). The eHealth condition had lower dropout rates (117/138, 84.8%) than the mHealth condition (81/108, 75.0%) and the control group (91/127, 71.7%). Furthermore, in terms of usability and appreciation, the eHealth condition outperformed the mHealth condition with regard to participants receiving (t 182 =3.07, P=.002) and reading the feedback messages (t 181 =2.34, P=.02), as well as the clarity of the messages (t 181 =1.99, P=.049). We tested 2 Web-based computer-tailored physical activity intervention versions (mHealth and eHealth) against a control condition with regard to efficacy, use, usability, and appreciation. The overall effect was mainly caused by the more effective eHealth intervention. The mHealth app was rated inferior to the eHealth version with regard to usability and appreciation. More research is needed to assess how both methods can complement each other. Netherlands Trial Register: NTR4503; http://www.trialregister.nl/trialreg/admin/rctview.asp?TC=4503 (Archived by WebCite at http://www.webcitation.org/6lEi1x40s). ©Stefanie Gomez Quiñonez, Michel Jean Louis Walthouwer, Daniela Nadine Schulz, Hein de Vries. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 09.11.2016.

A tailored Internet-delivered intervention for smoking cessation designed to encourage social support and treatment seeking: usability testing and user tracing.

PubMed

Houston, Tom K; Ford, Daniel E

2008-03-01

While Internet technologies show promise for changing behavior, new methods for engaging individuals are needed to maximize effectiveness. The aim of this study is to design and evaluate an Internet-delivered intervention for smoking cessation that encouraged seeking support from family and treatment from doctors. To evaluate different introductions to the Internet site. We conducted usability testing and analyzed server logs to trace user participation in the website. Two groups of users (current smokers) were recruited using Google advertisements. In Phase 1, 58% (75/126) of users accessed the self-management strategies, but few users accessed the social support (28%) and treatment-seeking modules (33%). Then, a brief motivational introduction was added, stating the proven effectiveness of content in the unused modules, low use of these modules, and recommendations by two doctors to use all modules. Compared with Phase 1, in Phase 2 the mean time spent on the website per session increased (8 to 18 min, p = 0.01) and use of the social support (50%) and treatment seeking modules (56%) increased (both p < 0.01). At 1-month follow-up, reports of talking to family about smoking cessation also increased from 84% to 100% (p = 0.038). Changing the rationale and context of Web-based health information using a motivational introduction can change user behavior.

Integrating cancer survivors' experiences into UK cancer registries: design and development of the ePOCS system (electronic Patient-reported Outcomes from Cancer Survivors)

PubMed Central

Ashley, L; Jones, H; Thomas, J; Forman, D; Newsham, A; Morris, E; Johnson, O; Velikova, G; Wright, P

2011-01-01

Background: Understanding the psychosocial challenges of cancer survivorship, and identifying which patients experience ongoing difficulties, is a key priority. The ePOCS (electronic patient-reported outcomes from cancer survivors) project aims to develop and evaluate a cost-efficient, UK-scalable electronic system for collecting patient-reported outcome measures (PROMs), at regular post-diagnostic timepoints, and linking these with clinical data in cancer registries. Methods: A multidisciplinary team developed the system using agile methods. Design entailed process mapping the system's constituent parts, data flows and involved human activities, and undertaking usability testing. Informatics specialists built new technical components, including a web-based questionnaire tool and tracking database, and established component-connecting data flows. Development challenges were overcome, including patient usability and data linkage and security. Results: We have developed a system in which PROMs are completed online, using a secure questionnaire administration tool, accessed via a public-facing website, and the responses are linked and stored with clinical registry data. Patient monitoring and communications are semiautomated via a tracker database, and patient correspondence is primarily Email-based. The system is currently honed for clinician-led hospital-based patient recruitment. Conclusions: A feasibility test study is underway. Although there are possible challenges to sustaining and scaling up ePOCS, the system has potential to support UK epidemiological PROMs collection and clinical data linkage. PMID:22048035

AsthmaWise - a field of dreams? The results of an online education program targeting older adults with asthma.

PubMed

Burns, Pippa; Jones, Sandra C; Iverson, Don; Caputi, Peter

2013-09-01

The aim of this study was to establish the feasibility and acceptability of an online asthma self-management program developed for older Australians with asthma. AsthmaWise, an internet education self-management program, was piloted for a 3-month period at the beginning of 2012. Participants were recruited using both online and offline strategies and were required to complete surveys, both pre- and post-intervention, in a repeated measures design. Matched data were collected from 51 participants; the results showed AsthmaWise to be a feasible and acceptable method of delivering asthma education to the target population. Self-reported measures showed an increase in participants' asthma knowledge, asthma control and quality of life. Results from the Perceived Health Web Site Usability Questionnaire (PHWSUQ) showed improvements between usability testing and implementation. The need for asthma self-management education will continue to increase as the population ages and a greater number of older adults are living with asthma. This small pilot study indicates that an online asthma self-management education program can result in improved outcome measures in a target group not normally considered technologically literate.

Usability Testing of a National Substance Use Screening Tool Embedded in Electronic Health Records.

PubMed

Press, Anne; DeStio, Catherine; McCullagh, Lauren; Kapoor, Sandeep; Morley, Jeanne; Conigliaro, Joseph

2016-07-08

Screening, brief intervention, and referral to treatment (SBIRT) is currently being implemented into health systems nationally via paper and electronic methods. The purpose of this study was to evaluate the integration of an electronic SBIRT tool into an existing paper-based SBIRT clinical workflow in a patient-centered medical home. Usability testing was conducted in an academic ambulatory clinic. Two rounds of usability testing were done with medical office assistants (MOAs) using a paper and electronic version of the SBIRT tool, with two and four participants, respectively. Qualitative and quantitative data was analyzed to determine the impact of both tools on clinical workflow. A second round of usability testing was done with the revised electronic version and compared with the first version. Personal workflow barriers cited in the first round of testing were that the electronic health record (EHR) tool was disruptive to patient's visits. In Round 2 of testing, MOAs reported favoring the electronic version due to improved layout and the inclusion of an alert system embedded in the EHR. For example, using the system usability scale (SUS), MOAs reported a grade "1" for the statement, "I would like to use this system frequently" during the first round of testing but a "5" during the second round of analysis. The importance of testing usability of various mediums of tools used in health care screening is highlighted by the findings of this study. In the first round of testing, the electronic tool was reported as less user friendly, being difficult to navigate, and time consuming. Many issues faced in the first generation of the tool were improved in the second generation after usability was evaluated. This study demonstrates how usability testing of an electronic SBRIT tool can help to identify challenges that can impact clinical workflow. However, a limitation of this study was the small sample size of MOAs that participated. The results may have been biased to Northwell Health workers' perceptions of the SBIRT tool and their specific clinical workflow.

Usability test of an internet-based informatics tool for diabetes care providers: the comprehensive diabetes management program.

PubMed

Fonda, Stephanie J; Paulsen, Christine A; Perkins, Joan; Kedziora, Richard J; Rodbard, David; Bursell, Sven-Erik

2008-02-01

Research suggests Internet-based care management tools are associated with improvements in care and patient outcomes. However, although such tools change workflow, rarely is their usability addressed and reported. This article presents a usability study of an Internet-based informatics application called the Comprehensive Diabetes Management Program (CDMP), developed by content experts and technologists. Our aim is to demonstrate a process for conducting a usability study of such a tool and to report results. We conducted the usability test with six diabetes care providers under controlled conditions. Each provider worked with the CDMP in a single session using a "think aloud" process. Providers performed standardized tasks with fictitious patient data, and we observed how they approached these tasks, documenting verbalizations and subjective ratings. The providers then completed a usability questionnaire and interviews. Overall, the scores on the usability questionnaire were neutral to favorable. For specific subdomains of the questionnaire, the providers' reported problems with the application's ease of use, performance, and support features, but were satisfied with its visual appeal and content. The results from the observational and interview data indicated areas for improvement, particularly in navigation and terminology. The usability study identified several issues for improvement, confirming the need for usability testing of Internet-based informatics applications, even those developed by experts. To our knowledge, there have been no other usability studies of an Internet-based informatics application with the functionality of the CDMP. Such studies can form the foundation for translation of Internet-based medical informatics tools into clinical practice.

Analysis of governmental Web sites on food safety issues: a global perspective.

PubMed

Namkung, Young; Almanza, Barbara A

2006-10-01

Despite a growing concern over food safety issues, as well as a growing dependence on the Internet as a source of information, little research has been done to examine the presence and relevance of food safety-related information on Web sites. The study reported here conducted Web site analysis in order to examine the current operational status of governmental Web sites on food safety issues. The study also evaluated Web site usability, especially information dimensionalities such as utility, currency, and relevance of content, from the perspective of the English-speaking consumer. Results showed that out of 192 World Health Organization members, 111 countries operated governmental Web sites that provide information about food safety issues. Among 171 searchable Web sites from the 111 countries, 123 Web sites (71.9 percent) were accessible, and 81 of those 123 (65.9 percent) were available in English. The majority of Web sites offered search engine tools and related links for more information, but their availability and utility was limited. In terms of content, 69.9 percent of Web sites offered information on foodborne-disease outbreaks, compared with 31.5 percent that had travel- and health-related information.

What Iswebmapping Anyway?

NASA Astrophysics Data System (ADS)

Veenendaal, B.; Brovelli, M. A.; Li, S.; Ivánová, I.

2017-09-01

Although maps have been around for a very long time, web maps are yet very young in their origin. Despite their relatively short history, web maps have been developing very rapidly over the past few decades. The use, users and usability of web maps have rapidly expanded along with developments in web technologies and new ways of mapping. In the process of these developments, the terms and terminology surrounding web mapping have also changed and evolved, often relating to the new technologies or new uses. Examples include web mapping, web GIS, cloud mapping, internet mapping, internet GIS, geoweb, map mashup, online mapping etc., not to mention those with prefixes such as "web-based" and "internet-based". So, how do we keep track of these terms, relate them to each other and have common understandings of their meanings so that references to them are not ambiguous, misunderstood or even different? This paper explores the terms surrounding web mapping and web GIS, and the development of their meaning over time. The paper then suggests the current context in which these terms are used and provides meanings that may assist in better understanding and communicating using these terms in the future.

Usability and reliability of a remotely administered adult autism assessment, the autism diagnostic observation schedule (ADOS) module 4.

PubMed

Schutte, Jamie L; McCue, Michael P; Parmanto, Bambang; McGonigle, John; Handen, Benjamin; Lewis, Allen; Pulantara, I Wayan; Saptono, Andi

2015-03-01

The Autism Diagnostic Observation Schedule (ADOS) Module 4 is an autism assessment designed for verbally fluent adolescents and adults. Because of a shortage of available clinical expertise, it can be difficult for adults to receive a proper autism spectrum disorder (ASD) diagnostic assessment. A potential option to address this shortage is remote assessment. The objective of this study was to examine the feasibility, usability, and reliability of administering the ADOS Module 4 remotely using the Versatile and Integrated System for Telerehabilitation (VISYTER). VISYTER consists of computer stations at the client site and clinician site for video communication and a Web portal for managing and coordinating the assessment process. Twenty-three adults with an ASD diagnosis participated in a within-subject crossover design study in which both a remote ADOS and a face-to-face ADOS were administered. After completing the remote ADOS, participants completed a satisfaction survey. Participant satisfaction with the remote ADOS delivery system was high. The kappa value was greater than 0.61 on 21 of 31 ADOS items. There was substantial agreement on ADOS classification (i.e., diagnosis) between assessments delivered face-to-face versus assessments delivered remotely (interclass coefficient=0.92). Non-agreement may have been due to outside factors or practice effect despite a washout period. The results of this study demonstrate that an autism assessment designed to be delivered face to face can be administered remotely using an integrated Web-based system with high levels of usability and reliability.

Computerized and Networked Government Information Column

ERIC Educational Resources Information Center

Stratford, Juri

2004-01-01

The efforts of the U.S. federal government to develop E-Government services have been the subject of many recent news stories. In February 2002, Arthur Andersen's Office of Government Services released a usability analysis of federal government Web sites. In addition, in February, Vice-President Cheney announced the release of a report detailing…

Rating the Accessibility of Library Tutorials from Leading Research Universities

ERIC Educational Resources Information Center

Clossen, Amanda; Proces, Paul

2017-01-01

Video and Web-based tutorials created by libraries from 71 public universities designated by the Carnegie Classification as having the Highest Research Activity (R1) were reviewed for accessibility and usability by disabled people. The results of this review indicate that a large portion of library tutorial content meets neither the minimum legal…

Web 2.0 Impact on Business Value at a Federal Government Housing Agency

ERIC Educational Resources Information Center

Lavender, Anthony L.

2013-01-01

The idea of Open Government is an extension of the Electronic Government Act of 2002 which addresses the accessibility, usability, and preservation of government information. The concept of Open Government has evolved into the open government directive that mandates Executive Departments and Agencies to become more open and transparent while…

Real-Time Interactive Social Environments: A Review of BT's Generic Learning Platform.

ERIC Educational Resources Information Center

Gardner, Michael; Ward, Holly

1999-01-01

Describes the development of a generic learning platform for online distance learning and explains RISE (Real-time Interactive Social Environments), a Web-based system. Reports results of trials at the University of Hull Language Institute in an English as a Foreign Language course that investigated system usability, teacher roles, and student…

Usability of Browser-Based Tools for Web-Search Privacy

DTIC Science & Technology

2010-03-01

What might Italians call maize? — Polenta From which country do french fries originate? — Belgium In Peru, which color potatoes are grown, in addition...What is kartofflen? — Potato Dumplings What is the name of the flatbread eaten with most Indian cuisine ? — Naan What type of cuisine offers Dim Sum

Towards a framework for geospatial tangible user interfaces in collaborative urban planning

NASA Astrophysics Data System (ADS)

Maquil, Valérie; Leopold, Ulrich; De Sousa, Luís Moreira; Schwartz, Lou; Tobias, Eric

2018-04-01

The increasing complexity of urban planning projects today requires new approaches to better integrate stakeholders with different professional backgrounds throughout a city. Traditional tools used in urban planning are designed for experts and offer little opportunity for participation and collaborative design. This paper introduces the concept of geospatial tangible user interfaces (GTUI) and reports on the design and implementation as well as the usability of such a GTUI to support stakeholder participation in collaborative urban planning. The proposed system uses physical objects to interact with large digital maps and geospatial data projected onto a tabletop. It is implemented using a PostGIS database, a web map server providing OGC web services, the computer vision framework reacTIVision, a Java-based TUIO client, and GeoTools. We describe how a GTUI has be instantiated and evaluated within the scope of two case studies related to real world collaborative urban planning scenarios. Our results confirm the feasibility of our proposed GTUI solutions to (a) instantiate different urban planning scenarios, (b) support collaboration, and (c) ensure an acceptable usability.

Heuristic evaluation of paper-based Web pages: a simplified inspection usability methodology.

PubMed

Allen, Mureen; Currie, Leanne M; Bakken, Suzanne; Patel, Vimla L; Cimino, James J

2006-08-01

Online medical information, when presented to clinicians, must be well-organized and intuitive to use, so that the clinicians can conduct their daily work efficiently and without error. It is essential to actively seek to produce good user interfaces that are acceptable to the user. This paper describes the methodology used to develop a simplified heuristic evaluation (HE) suitable for the evaluation of screen shots of Web pages, the development of an HE instrument used to conduct the evaluation, and the results of the evaluation of the aforementioned screen shots. In addition, this paper presents examples of the process of categorizing problems identified by the HE and the technological solutions identified to resolve these problems. Four usability experts reviewed 18 paper-based screen shots and made a total of 108 comments. Each expert completed the task in about an hour. We were able to implement solutions to approximately 70% of the violations. Our study found that a heuristic evaluation using paper-based screen shots of a user interface was expeditious, inexpensive, and straightforward to implement.

Towards a framework for geospatial tangible user interfaces in collaborative urban planning

NASA Astrophysics Data System (ADS)

Maquil, Valérie; Leopold, Ulrich; De Sousa, Luís Moreira; Schwartz, Lou; Tobias, Eric

2018-03-01

The increasing complexity of urban planning projects today requires new approaches to better integrate stakeholders with different professional backgrounds throughout a city. Traditional tools used in urban planning are designed for experts and offer little opportunity for participation and collaborative design. This paper introduces the concept of geospatial tangible user interfaces (GTUI) and reports on the design and implementation as well as the usability of such a GTUI to support stakeholder participation in collaborative urban planning. The proposed system uses physical objects to interact with large digital maps and geospatial data projected onto a tabletop. It is implemented using a PostGIS database, a web map server providing OGC web services, the computer vision framework reacTIVision, a Java-based TUIO client, and GeoTools. We describe how a GTUI has be instantiated and evaluated within the scope of two case studies related to real world collaborative urban planning scenarios. Our results confirm the feasibility of our proposed GTUI solutions to (a) instantiate different urban planning scenarios, (b) support collaboration, and (c) ensure an acceptable usability.

Combining usability evaluations to highlight the chain that leads from usability flaws to usage problems and then negative outcomes.

PubMed

Watbled, Ludivine; Marcilly, Romaric; Guerlinger, Sandra; Bastien, J-M Christian; Beuscart-Zéphir, Marie-Catherine; Beuscart, Régis

2018-02-01

Poor usability of health technology is thought to diminish work system performance, increase error rates and, potentially, harm patients. The present study (i) used a combination of usability evaluation methods to highlight the chain that leads from usability flaws to usage problems experienced by users and, ultimately, to negative patient outcomes, and (ii) validated this approach by studying two different discharge summary production systems. To comply with quality guidelines, the process of drafting and sending discharge summaries is increasingly being automated. However, the usability of these systems may modify their impact (or the absence thereof) in terms of production times and quality, and must therefore be evaluated. Here, we applied three successive techniques for usability evaluation (heuristic evaluation, user testing and field observation) to two discharge summary production systems (underpinned by different technologies). The systems' main usability flaws led respectively to an increase in the time need to produce a discharge summary and the risk of patient misidentification. Our results are discussed with regard to the possibility of linking the usability flaws, usage problems and the negative outcomes by successively applying three methods for evaluating usability (heuristic evaluation, user testing and in situ observations) throughout the system development life cycle. Copyright © 2018 Elsevier Inc. All rights reserved.

Computer-facilitated rapid HIV testing in emergency care settings: provider and patient usability and acceptability.

PubMed

Spielberg, Freya; Kurth, Ann E; Severynen, Anneleen; Hsieh, Yu-Hsiang; Moring-Parris, Daniel; Mackenzie, Sara; Rothman, Richard

2011-06-01

Providers in emergency care settings (ECSs) often face barriers to expanded HIV testing. We undertook formative research to understand the potential utility of a computer tool, "CARE," to facilitate rapid HIV testing in ECSs. Computer tool usability and acceptability were assessed among 35 adult patients, and provider focus groups were held, in two ECSs in Washington State and Maryland. The computer tool was usable by patients of varying computer literacy. Patients appreciated the tool's privacy and lack of judgment and their ability to reflect on HIV risks and create risk reduction plans. Staff voiced concerns regarding ECS-based HIV testing generally, including resources for follow-up of newly diagnosed people. Computer-delivered HIV testing support was acceptable and usable among low-literacy populations in two ECSs. Such tools may help circumvent some practical barriers associated with routine HIV testing in busy settings though linkages to care will still be needed.

The Development of MSFC Usability Lab

NASA Technical Reports Server (NTRS)

Cheng, Yiwei; Richardson, Sally

2010-01-01

This conference poster reviews the development of the usability lab at Marshall Space Flight Center. The purpose of the lab was to integrate a fully functioning usability laboratory to provide a resource for future human factor assessments. and to implement preliminary usability testing on a MSFC website to validate the functionality of the lab.

The quality of orthodontic practice websites.

PubMed

Parekh, J; Gill, D S

2014-05-01

To evaluate orthodontic practice websites for the reliability of information presented, accessibility, usability for patients and compliance to General Dental Council (GDC) regulations on ethical advertising. World Wide Web. The term 'orthodontic practice' was entered into three separate search engines. The 30 websites from the UK were selected and graded according to the LIDA tool (a validated method of evaluating healthcare websites) for accessibility, usability of the website and reliability of information on orthodontic treatment. The websites were then evaluated against the GDC's Principles for ethical advertising in nine different criteria. On average, each website fulfilled six out of nine points of the GDC's criteria, with inclusion of a complaints policy being the most poorly fulfilled criteria. The mean LIDA score (a combination of usability, reliability and accessibility) was 102/144 (standard deviation 8.38). The websites scored most poorly on reliability (average 43% SD 11.7), with no single website reporting a clear, reliable method of content production. Average accessibility was 81% and usability 73%. In general, websites did not comply with GDC guidelines on ethical advertising. Furthermore, practitioners should consider reporting their method of information production, particularly when making claims about efficiency and speed of treatment in order to improve reliability.

Adequate number of clinicians on usability tests lacking, says study.

PubMed

2015-12-01

A new study reveals that some of the largest EMR vendors failed to meet certification standards, specifying that they state their user-centered design processes, and that they include at least 15 representative end-user participants in their usability tests. It is not clear why these vendors were certified despite not meeting the standards established by Office of the National Coordinator for Health Information Technology (ONC), but investigators suggest that emergency clinicians and administrators should engage with vendors early on, querying them about their user-centered processes. An analysis of the usability tests performed by 41 of some the largest EMR vendors found that 34% of them did not meet certification standards, specifying that they state their user-centered design process. Also, 63% of the vendors failed to include at least 15 representative end-users in their usability tests. Only 15% of the vendors used at least 15 participants who had clinical backgrounds in their usability tests. Experts urge clinicians to engage with EMR user groups to share best practices for optimizing specific EMR products.

Tuberculosis-Diagnostic Expert System: an architecture for translating patients information from the web for use in tuberculosis diagnosis.

PubMed

Osamor, Victor C; Azeta, Ambrose A; Ajulo, Oluseyi O

2014-12-01

Over 1.5-2 million tuberculosis deaths occur annually. Medical professionals are faced with a lot of challenges in delivering good health-care with unassisted automation in hospitals where there are several patients who need the doctor's attention. To automate the pre-laboratory screening process against tuberculosis infection to aid diagnosis and make it fast and accessible to the public via the Internet. The expert system we have built is designed to also take care of people who do not have access to medical experts, but would want to check their medical status. A rule-based approach has been used, and unified modeling language and the client-server architecture technique were applied to model the system and to develop it as a web-based expert system for tuberculosis diagnosis. Algorithmic rules in the Tuberculosis-Diagnosis Expert System necessitate decision coverage where tuberculosis is either suspected or not suspected. The architecture consists of a rule base, knowledge base, and patient database. These units interact with the inference engine, which receives patient' data through the Internet via a user interface. We present the architecture of the Tuberculosis-Diagnosis Expert System and its implementation. We evaluated it for usability to determine the level of effectiveness, efficiency and user satisfaction. The result of the usability evaluation reveals that the system has a usability of 4.08 out of a scale of 5. This is an indication of a more-than-average system performance. Several existing expert systems have been developed for the purpose of supporting different medical diagnoses, but none is designed to translate tuberculosis patients' symptomatic data for online pre-laboratory screening. Our Tuberculosis-Diagnosis Expert System is an effective solution for the implementation of the needed web-based expert system diagnosis. © The Author(s) 2013.

General surgery residency program websites: usefulness and usability for resident applicants.

PubMed

Reilly, Eugene F; Leibrandt, Thomas J; Zonno, Alan J; Simpson, Mary Christina; Morris, Jon B

2004-01-01

To assess the content of general surgery residency program websites, the websites' potential as tools in resident recruitment, and their "usability." The homepages of general surgery residency programs were evaluated for accessibility, ease-of-use, adherence to established principles of website design, and content. Investigators completed a questionnaire on aspects of their online search, including number of mouse-clicks used, number of errors encountered, and number of returns to the residency homepage. The World Wide Web listings on the Fellowship and Residency Electronic Interactive Database (FREIDA) of the American Medical Association (AMA). A total of 251 ACGME-accredited general surgery residency programs. One hundred sixty-seven programs (67%) provided a viable link to the program's website. Evaluators found an average of 5.9 of 16 content items; 2 (1.2%) websites provided as many as 12 content items. Five of the 16 content items (program description, conference schedules, listing of faculty, caseload, and salary) were found on more than half of the sites. An average of 24 mouse-clicks was required to complete the questionnaire for each site. Forty-six sites (28%) generated at least 1 error during our search. The residency homepage was revisited an average of 5 times during each search. On average, programs adhered to 6 of the 10 design principles; only 6 (3.6%) sites adhered to all 10 design principles. Two of the 10 design principles (use of familiar fonts, absence of frames) were adhered to in more than half of the sites. Our overall success rate when searching residency websites was 38%. General surgery residency programs do not use the World Wide Web optimally, particularly for users who are potential residency candidates. The usability of these websites could be increased by providing relevant content, making that content easier to find, and adhering to established web design principles.

The development and evaluation of a web-based programme to support problem-solving skills following brain injury.

PubMed

Powell, Laurie Ehlhardt; Wild, Michelle R; Glang, Ann; Ibarra, Summer; Gau, Jeff M; Perez, Amanda; Albin, Richard W; O'Neil-Pirozzi, Therese M; Wade, Shari L; Keating, Tom; Saraceno, Carolyn; Slocumb, Jody

2017-10-24

Cognitive impairments following brain injury, including difficulty with problem solving, can pose significant barriers to successful community reintegration. Problem-solving strategy training is well-supported in the cognitive rehabilitation literature. However, limitations in insurance reimbursement have resulted in fewer services to train such skills to mastery and to support generalization of those skills into everyday environments. The purpose of this project was to develop and evaluate an integrated, web-based programme, ProSolv, which uses a small number of coaching sessions to support problem solving in everyday life following brain injury. We used participatory action research to guide the iterative development, usability testing, and within-subject pilot testing of the ProSolv programme. The finalized programme was then evaluated in a between-subjects group study and a non-experimental single case study. Results were mixed across studies. Participants demonstrated that it was feasible to learn and use the ProSolv programme for support in problem solving. They highly recommended the programme to others and singled out the importance of the coach. Limitations in app design were cited as a major reason for infrequent use of the app outside of coaching sessions. Results provide mixed evidence regarding the utility of web-based mobile apps, such as ProSolv to support problem solving following brain injury. Implications for Rehabilitation People with cognitive impairments following brain injury often struggle with problem solving in everyday contexts. Research supports problem solving skills training following brain injury. Assistive technology for cognition (smartphones, selected apps) offers a means of supporting problem solving for this population. This project demonstrated the feasibility of a web-based programme to address this need.

Usability Evaluation of a Clinical Decision Support System for Geriatric ED Pain Treatment.

PubMed

Genes, Nicholas; Kim, Min Soon; Thum, Frederick L; Rivera, Laura; Beato, Rosemary; Song, Carolyn; Soriano, Jared; Kannry, Joseph; Baumlin, Kevin; Hwang, Ula

2016-01-01

Older adults are at risk for inadequate emergency department (ED) pain care. Unrelieved acute pain is associated with poor outcomes. Clinical decision support systems (CDSS) hold promise to improve patient care, but CDSS quality varies widely, particularly when usability evaluation is not employed. To conduct an iterative usability and redesign process of a novel geriatric abdominal pain care CDSS. We hypothesized this process would result in the creation of more usable and favorable pain care interventions. Thirteen emergency physicians familiar with the Electronic Health Record (EHR) in use at the study site were recruited. Over a 10-week period, 17 1-hour usability test sessions were conducted across 3 rounds of testing. Participants were given 3 patient scenarios and provided simulated clinical care using the EHR, while interacting with the CDSS interventions. Quantitative System Usability Scores (SUS), favorability scores and qualitative narrative feedback were collected for each session. Using a multi-step review process by an interdisciplinary team, positive and negative usability issues in effectiveness, efficiency, and satisfaction were considered, prioritized and incorporated in the iterative redesign process of the CDSS. Video analysis was used to determine the appropriateness of the CDS appearances during simulated clinical care. Over the 3 rounds of usability evaluations and subsequent redesign processes, mean SUS progressively improved from 74.8 to 81.2 to 88.9; mean favorability scores improved from 3.23 to 4.29 (1 worst, 5 best). Video analysis revealed that, in the course of the iterative redesign processes, rates of physicians' acknowledgment of CDS interventions increased, however most rates of desired actions by physicians (such as more frequent pain score updates) decreased. The iterative usability redesign process was instrumental in improving the usability of the CDSS; if implemented in practice, it could improve geriatric pain care. The usability evaluation process led to improved acknowledgement and favorability. Incorporating usability testing when designing CDSS interventions for studies may be effective to enhance clinician use.

Current State of Agile User-Centered Design: A Survey

NASA Astrophysics Data System (ADS)

Hussain, Zahid; Slany, Wolfgang; Holzinger, Andreas

Agile software development methods are quite popular nowadays and are being adopted at an increasing rate in the industry every year. However, these methods are still lacking usability awareness in their development lifecycle, and the integration of usability/User-Centered Design (UCD) into agile methods is not adequately addressed. This paper presents the preliminary results of a recently conducted online survey regarding the current state of the integration of agile methods and usability/UCD. A world wide response of 92 practitioners was received. The results show that the majority of practitioners perceive that the integration of agile methods with usability/UCD has added value to their adopted processes and to their teams; has resulted in the improvement of usability and quality of the product developed; and has increased the satisfaction of the end-users of the product developed. The top most used HCI techniques are low-fidelity prototyping, conceptual designs, observational studies of users, usability expert evaluations, field studies, personas, rapid iterative testing, and laboratory usability testing.

Usability Evaluation of a Private Social Network on Mental Health for Relatives.

PubMed

Toribio-Guzmán, José Miguel; García-Holgado, Alicia; Soto Pérez, Felipe; García-Peñalvo, Francisco J; Franco Martín, Manuel

2017-09-01

Usability is one of the most prominent criteria that must be fulfilled by a software product. This study aims to evaluate the usability of SocialNet, a private social network for monitoring the daily progress of patients by their relatives, using a mixed usability approach: heuristic evaluation conducted by experts and user testing. A double heuristic evaluation with one expert evaluator identified the issues related to consistency, design, and privacy. User testing was conducted on 20 users and one evaluator using observation techniques and questionnaires. The main usability problems were found to be related to the structure of SocialNet, and the users presented some difficulties in locating the buttons or links. The results show a high level of usability and satisfaction with the product. This evaluation provides data on the usability of SocialNet based on the difficulties experienced by the users and the expert. The results help in redesigning the tool to resolve the identified problems as part of an iterative process.

Usability Laboratory Test of a Novel Mobile Homecare Application with Experienced Home Help Service Staff

PubMed Central

Scandurra, I; Hägglund, M; Koch, S; Lind, M

2008-01-01

Using participatory design, we developed and deployed a mobile Virtual Health Record (VHR) on a personal digital assistant (PDA) together with experienced homecare staff. To assess transferability to a second setting and usability when used by novice users with limited system education the application was tested in a usability lab. Eight participants from another homecare district performed tasks related to daily homecare work using the VHR. Test protocols were analyzed with regard to effectiveness, potential usability problems and user satisfaction. Usability problems having impact on system performance and contextual factors affecting system transferability were uncovered. Questionnaires revealed that the participants frequently used computers, but never PDAs. Surprisingly there were only minor differences in input efficiency between novice and experienced users. The participants were overall satisfied with the application. However, transfer to another district can not be performed, unless by means of careful field observations of contextual differences. PMID:19415140

Usability Testing of a Complex Clinical Decision Support Tool in the Emergency Department: Lessons Learned.

PubMed

Press, Anne; McCullagh, Lauren; Khan, Sundas; Schachter, Andy; Pardo, Salvatore; McGinn, Thomas

2015-09-10

As the electronic health record (EHR) becomes the preferred documentation tool across medical practices, health care organizations are pushing for clinical decision support systems (CDSS) to help bring clinical decision support (CDS) tools to the forefront of patient-physician interactions. A CDSS is integrated into the EHR and allows physicians to easily utilize CDS tools. However, often CDSS are integrated into the EHR without an initial phase of usability testing, resulting in poor adoption rates. Usability testing is important because it evaluates a CDSS by testing it on actual users. This paper outlines the usability phase of a study, which will test the impact of integration of the Wells CDSS for pulmonary embolism (PE) diagnosis into a large urban emergency department, where workflow is often chaotic and high stakes decisions are frequently made. We hypothesize that conducting usability testing prior to integration of the Wells score into an emergency room EHR will result in increased adoption rates by physicians. The objective of the study was to conduct usability testing for the integration of the Wells clinical prediction rule into a tertiary care center's emergency department EHR. We conducted usability testing of a CDS tool in the emergency department EHR. The CDS tool consisted of the Wells rule for PE in the form of a calculator and was triggered off computed tomography (CT) orders or patients' chief complaint. The study was conducted at a tertiary hospital in Queens, New York. There were seven residents that were recruited and participated in two phases of usability testing. The usability testing employed a "think aloud" method and "near-live" clinical simulation, where care providers interacted with standardized patients enacting a clinical scenario. Both phases were audiotaped, video-taped, and had screen-capture software activated for onscreen recordings. Phase I: Data from the "think-aloud" phase of the study showed an overall positive outlook on the Wells tool in assessing a patient for a PE diagnosis. Subjects described the tool as "well-organized" and "better than clinical judgment". Changes were made to improve tool placement into the EHR to make it optimal for decision-making, auto-populating boxes, and minimizing click fatigue. Phase II: After incorporating the changes noted in Phase 1, the participants noted tool improvements. There was less toggling between screens, they had all the clinical information required to complete the tool, and were able to complete the patient visit efficiently. However, an optimal location for triggering the tool remained controversial. This study successfully combined "think-aloud" protocol analysis with "near-live" clinical simulations in a usability evaluation of a CDS tool that will be implemented into the emergency room environment. Both methods proved useful in the assessment of the CDS tool and allowed us to refine tool usability and workflow.

Earthdata Search Client: Usability Review Process, Results, and Implemented Changes, Using Earthdata Search Client as a Case Study

NASA Technical Reports Server (NTRS)

Siarto, Jeff; Reese, Mark; Shum, Dana; Baynes, Katie

2016-01-01

User experience and visual design are greatly improved when usability testing is performed on a periodic basis. Design decisions should be tested by real users so that application owners can understand the effectiveness of each decision and identify areas for improvement. It is important that applications be tested not just once, but as a part of a continuing process that looks to build upon previous tests. NASA's Earthdata Search Client has undergone a usability study to ensure its users' needs are being met and that users understand how to use the tool efficiently and effectively. This poster will highlight the process followed for usability study, the results of the study, and what has been implemented in light of the results to improve the application's interface.

The use of fault reporting of medical equipment to identify latent design flaws.

PubMed

Flewwelling, C J; Easty, A C; Vicente, K J; Cafazzo, J A

2014-10-01

Poor device design that fails to adequately account for user needs, cognition, and behavior is often responsible for use errors resulting in adverse events. This poor device design is also often latent, and could be responsible for "No Fault Found" (NFF) reporting, in which medical devices sent for repair by clinical users are found to be operating as intended. Unresolved NFF reports may contribute to incident under reporting, clinical user frustration, and biomedical engineering technologist inefficacy. This study uses human factors engineering methods to investigate the relationship between NFF reporting frequency and device usability. An analysis of medical equipment maintenance data was conducted to identify devices with a high NFF reporting frequency. Subsequently, semi-structured interviews and heuristic evaluations were performed in order to identify potential usability issues. Finally, usability testing was conducted in order to validate that latent usability related design faults result in a higher frequency of NFF reporting. The analysis of medical equipment maintenance data identified six devices with a high NFF reporting frequency. Semi-structured interviews, heuristic evaluations and usability testing revealed that usability issues caused a significant portion of the NFF reports. Other factors suspected to contribute to increased NFF reporting include accessory issues, intermittent faults and environmental issues. Usability testing conducted on three of the devices revealed 23 latent usability related design faults. These findings demonstrate that latent usability related design faults manifest themselves as an increase in NFF reporting and that devices containing usability related design faults can be identified through an analysis of medical equipment maintenance data. Copyright © 2014 The Authors. Published by Elsevier Inc. All rights reserved.

Using Cluster Analysis to Extend Usability Testing to Instructional Content. CRESST Report 816

ERIC Educational Resources Information Center

Kerr, Deirdre S.; Chung, Gregory K. W. K.

2012-01-01

Commercial video games undergo usability studies to determine the degree to which the player is able to learn, control, and understand the game. Usability studies allow game designers to improve their games before they are released to the public. If usability studies could be expanded to include information about the presentation of the…

Usability Testing of a Multimedia e-Learning Resource for Electrolyte and Acid-Base Disorders

ERIC Educational Resources Information Center

Davids, Mogamat Razeen; Chikte, Usuf; Grimmer-Somers, Karen; Halperin, Mitchell L.

2014-01-01

The usability of computer interfaces may have a major influence on learning. Design approaches that optimize usability are commonplace in the software development industry but are seldom used in the development of e-learning resources, especially in medical education. We conducted a usability evaluation of a multimedia resource for teaching…

Doodle Health: A Crowdsourcing Game for the Co-design and Testing of Pictographs to Reduce Disparities in Healthcare Communication.

PubMed

Christensen, Carrie; Redd, Doug; Lake, Erica; Shipman, Jean P; Aiono, Heather; Altizer, Roger; Bray, Bruce E; Zeng, Qing T

2017-01-01

Supplementing patient education content with pictographs can improve the comprehension and recall of information, especially patients with low health literacy. Pictograph design and testing, however, are costly and time consuming. We created a Web-based game, Doodle Health, for crowdsourcing the drawing and validation of pictographs. The objective of this pilot study was to test the usability of the game and its appeal to healthcare consumers. The chief purpose of the game is to involve a diverse population in the co-design and evaluation of pictographs. We conducted a community-based focus group to inform the game design. Game designers, health sciences librarians, informatics researchers, clinicians, and community members participated in two Design Box meetings. The results of the meetings were used to create the Doodle Health crowdsourcing game. The game was presented and tested at two public fairs. Initial testing indicates crowdsourcing is a promising approach to pictograph development and testing for relevancy and comprehension. Over 596 drawings were collected and 1,758 guesses were performed to date with 70-90% accuracies, which are satisfactorily high.

Development of a patient decision aid prototype for adults with obstructive sleep apnea.

PubMed

Trenaman, Logan; Munro, Sarah; Almeida, Fernanda; Ayas, Najib; Hicklin, James; Bansback, Nick

2016-05-01

To describe the development and assess the usability of a patient decision aid (PtDA) prototype designed for newly diagnosed, treatment-naïve, obstructive sleep apnea (OSA) patients. A web-based PtDA was developed which focuses on two first-line treatment options: continuous positive airway pressure (CPAP) and mandibular advancement splints (MAS). Development was guided by the International Patient Decision Aid Standards (IPDAS). Usability was assessed in individuals at high risk for OSA based on the STOP-Bang questionnaire, the patient acceptance of decision aid, the System Usability Scale (SUS), and content analysis of open-ended user feedback. Eighty eligible participants completed the survey. The mean age was 54 years (SD = 8.9), 60 % of the sample was male, 78 % were university-educated, and 64 % were employed full-time. Participants took an average of 13.7 min (SD = 9.6) to complete the PtDA, with 39 participants choosing CPAP, 25 choosing MAS, and 16 choosing no treatment. The mean SUS score was 78.22 (SD = 15.13). The majority of individuals thought the PtDA was useful in making a decision (n = 77, 96 %) and would recommend it to others (n = 77, 96 %), while a third (n = 26, 33 %) thought it was slanted towards CPAP. The SUS indicated that the PtDA was acceptable and useful for participants. And useful for participants. User feedback has been used to improve the prototype, which will now undergo further testing in patients at the Vancouver Sleep Disorders Clinic.

Development and evaluation of a multimedia e-learning resource for electrolyte and acid-base disorders.

PubMed

Davids, Mogamat Razeen; Chikte, Usuf M E; Halperin, Mitchell L

2011-09-01

This article reports on the development and evaluation of a Web-based application that provides instruction and hands-on practice in managing electrolyte and acid-base disorders. Our teaching approach, which focuses on concepts rather than details, encourages quantitative analysis and a logical problem-solving approach. Identifying any dangers to the patient is a vital first step. Concepts such as an "appropriate response" to a given perturbation and the need for electroneutrality in body fluids are used repeatedly. Our Electrolyte Workshop was developed using Flash and followed an iterative design process. Two case-based tutorials were built in this first phase, with one tutorial including an interactive treatment simulation. Users select from a menu of therapies and see the impact of their choices on the patient. Appropriate text messages are displayed, and changes in body compartment sizes, brain size, and plasma sodium concentrations are illustrated via Flash animation. Challenges encountered included a shortage of skilled Flash developers, budgetary constraints, and challenges in communication between the authors and the developers. The application was evaluated via user testing by residents and specialists in internal medicine. Satisfaction was measured with a questionnaire based on the System Usability Scale. The mean System Usability Scale score was 78.4 ± 13.8, indicating a good level of usability. Participants rated the content as being scientifically sound; they liked the teaching approach and felt that concepts were conveyed clearly. They indicated that the application held their interest, that it increased their understanding of hyponatremia, and that they would recommend this learning resource to others.

Using Cesium for 3D Thematic Visualisations on the Web

NASA Astrophysics Data System (ADS)

Gede, Mátyás

2018-05-01

Cesium (http://cesiumjs.org) is an open source, WebGL-based JavaScript library for virtual globes and 3D maps. It is an excellent tool for 3D thematic visualisations, but to use its full functionality it has to be feed with its own file format, CZML. Unfortunately, this format is not yet supported by any major GIS software. This paper intro- duces a plugin for QGIS, developed by the author, which facilitates the creation of CZML file for various types of visualisations. The usability of Cesium is also examined in various hardware/software environments.

How Do Clinical Information Systems Affect the Cognitive Demands of General Practitioners?: Usability Study with a Focus on Cognitive Workload.

PubMed

Ariza, Ferran; Kalra, Dipak; Potts, Henry Ww

2015-11-20

Clinical information systems in the National Health Service do not need to conform to any explicit usability requirements. Poor usability can increase the mental workload experienced by clinicians and cause fatigue, increase error rates and impact the overall patient safety. Mental workload can be used as a measure of usability. To assess the subjective cognitive workload experienced by general practitioners (GPs) with their systems. To raise awareness of the importance of usability in system design among users, designers, developers and policymakers. We used a modified version of the NASA Task Load Index, adapted for web. We developed a set of common clinical scenarios and computer tasks on an online survey. We emailed the study link to 199 clinical commissioning groups and 1,646 GP practices in England. Sixty-seven responders completed the survey. The respondents had spent an average of 17 years in general practice, had experience of using a mean of 1.5 GP computer systems and had used their current system for a mean time of 6.7 years. The mental workload score was not different among systems. There were significant differences among the task scores, but these differences were not specific to particular systems. The overall score and task scores were related to the length of experience with their present system. Four tasks imposed a higher mental workload on GPs: 'repeat prescribing', 'find episode', 'drug management' and 'overview records'. Further usability studies on GP systems should focus on these tasks. Users, policymakers, designers and developers should remain aware of the importance of usability in system design.What does this study add?• Current GP systems in England do not need to conform to explicit usability requirements. Poor usability can increase the mental workload of clinicians and lead to errors.• Some clinical computer tasks incur more cognitive workload than others and should be considered carefully during the design of a system.• GPs did not report overall very high levels of subjective cognitive workload when undertaking common clinical tasks with their systems.• Further usability studies on GP systems should focus on the tasks incurring higher cognitive workload.• Users, policymakers, and designers and developers should remain aware of the importance of usability in system design.

UserTesting.com: A Tool for Usability Testing of Online Resources

ERIC Educational Resources Information Center

Koundinya, Vikram; Klink, Jenna; Widhalm, Melissa

2017-01-01

Extension educators are increasingly using online resources in their program design and delivery. Usability testing is essential for ensuring that these resources are relevant and useful to learners. On the basis of our experiences with iteratively developing products using a testing service called UserTesting, we promote the use of fee-based…

Assessment of the quality of patient-oriented information over internet on testicular cancer.

PubMed

Prasanth, Anton S; Jayarajah, Umesh; Mohanappirian, Ranganathan; Seneviratne, Sanjeewa A

2018-05-02

This study aimed to assess the quality and readability of patient education information available on the internet on testicular cancer. Internet searches were performed using the keywords 'testicular cancer', 'testicular tumour', 'testicular tumor', 'testicular malignancy', 'germ cell tumour' and 'germ cell tumor' using Google, Yahoo! And Bing search engines with default settings. The first 50 web links appeared in each search engine were evaluated for their readability by using the validated Flesch Reading Ease Score (FRES) while accessibility, usability and reliability were assessed using the LIDA tool. The quality was assessed using DISCERN instrument. Non-parametric tests were used for statistical analysis. Overall, 900 websites were assessed and 62 websites were included in the analysis. Twenty two (22) websites (35.5%) were certified by Health on the Net Foundation code of conduct (HON code). The majority (n = 57, 91.9%) were non-governmental websites. The median FRES score was 51.6 (range: 28.1-74.1), the overall median LIDA score was 115 (range: 81-147); accessibility 55 (range: 46-61), reliability 22 (range: 8-45) and usability 38.5 (range: 21-50), while the median DISCERN score was 43.5 (range: 16-69). The DISCERN score was significantly associated with the overall LIDA score and usability and reliability components of the LIDA score (p < 0.001). However, no significant associations were observed between readability and accessibility. A significant correlation was noted between usability and reliability components of the LIDA score (Spearman's rho: 0.789, p < 0.001). In this study, the readability, reliability and quality scores of most websites were found to be suboptimal and hence, there is potential for improvement. As the internet is expanding rapidly as a readily available source of information to the public, it is essential to implement steps to ensure that highest quality information is provided without any commercial motivation or bias.

Tree Testing of Hierarchical Menu Structures for Health Applications

PubMed Central

Le, Thai; Chaudhuri, Shomir; Chung, Jane; Thompson, Hilaire J; Demiris, George

2014-01-01

To address the need for greater evidence-based evaluation of Health Information Technology (HIT) systems we introduce a method of usability testing termed tree testing. In a tree test, participants are presented with an abstract hierarchical tree of the system taxonomy and asked to navigate through the tree in completing representative tasks. We apply tree testing to a commercially available health application, demonstrating a use case and providing a comparison with more traditional in-person usability testing methods. Online tree tests (N=54) and in-person usability tests (N=15) were conducted from August to September 2013. Tree testing provided a method to quantitatively evaluate the information structure of a system using various navigational metrics including completion time, task accuracy, and path length. The results of the analyses compared favorably to the results seen from the traditional usability test. Tree testing provides a flexible, evidence-based approach for researchers to evaluate the information structure of HITs. In addition, remote tree testing provides a quick, flexible, and high volume method of acquiring feedback in a structured format that allows for quantitative comparisons. With the diverse nature and often large quantities of health information available, addressing issues of terminology and concept classifications during the early development process of a health information system will improve navigation through the system and save future resources. Tree testing is a usability method that can be used to quickly and easily assess information hierarchy of health information systems. PMID:24582924

Design and implementation of a hospital-based usability laboratory: insights from a Department of Veterans Affairs laboratory for health information technology.

PubMed

Russ, Alissa L; Weiner, Michael; Russell, Scott A; Baker, Darrell A; Fahner, W Jeffrey; Saleem, Jason J

2012-12-01

Although the potential benefits of more usable health information technologies (HIT) are substantial-reduced HIT support costs, increased work efficiency, and improved patient safety--human factors methods to improve usability are rarely employed. The US Department of Veterans Affairs (VA) has emerged as an early leader in establishing usability laboratories to inform the design of HIT, including its electronic health record. Experience with a usability laboratory at a VA Medical Center provides insights on how to design, implement, and leverage usability laboratories in the health care setting. The VA Health Services Research and Development Service Human-Computer Interaction & Simulation Laboratory emerged as one of the first VA usability laboratories and was intended to provide research-based findings about HIT designs. This laboratory supports rapid prototyping, formal usability testing, and analysis tools to assess existing technologies, alternative designs, and potential future technologies. RESULTS OF IMPLEMENTATION: Although the laboratory has maintained a research focus, it has become increasingly integrated with VA operations, both within the medical center and on a national VA level. With this resource, data-driven recommendations have been provided for the design of HIT applications before and after implementation. The demand for usability testing of HIT is increasing, and information on how to develop usability laboratories for the health care setting is often needed. This article may assist other health care organizations that want to invest in usability resources to improve HIT. The establishment and utilization of usability laboratories in the health care setting may improve HIT designs and promote safe, high-quality care for patients.

Website Analysis in an EFL Context: Content Comprehension, Perceptions on Web Usability and Awareness of Reading Strategies

ERIC Educational Resources Information Center

Roy, Debopriyo; Crabbe, Stephen

2015-01-01

Website analysis is an interdisciplinary field of inquiry that focuses on both digital literacy and language competence (Brugger, 2009). Website analysis in an EFL learning context has the potential to facilitate logical thinking and in the process develop functional language proficiency. This study reported on an English language website…

Investigating Pre-Service Mathematics Teachers' Innovation Awareness and Views Regarding Intelligent Tutoring Systems

ERIC Educational Resources Information Center

Erdemir, Mustafa; Ingeç, Sebnem Kandil

2016-01-01

The purpose of this study is to identify pre-service primary mathematics teachers' views regarding on Web-based Intelligent Tutoring Systems (WBITS) in relation to its usability and influence on teaching. A survey method was used. The study was conducted with 43 students attending the mathematics teaching program under the department of elementary…

A Tale of Two Discoveries: Comparing the Usability of Summon and EBSCO Discovery Service

ERIC Educational Resources Information Center

Foster, Anita K.; MacDonald, Jean B.

2013-01-01

Web-scale discovery systems are gaining momentum among academic libraries as libraries seek a means to provide their users with a one-stop searching experience. Illinois State University's Milner Library found itself in the unique position of having access to two distinct discovery products, EBSCO Discovery Service and Serials Solutions' Summon.…

Digital Library Services: Perceptions and Expectations of User Communities and Librarians in a New Zealand Academic Library.

ERIC Educational Resources Information Center

Xia, Wei

2003-01-01

Provides an overview of research conducted at Victoria University of Wellington regarding differing perceptions and expectations of user communities and librarians related to the usability of digital services. Considers access to services, currency of information on the Web site, the online public access catalog, databases, electronic journals,…

From Reload to ReCourse: Learning from IMS Learning Design Implementations

ERIC Educational Resources Information Center

Griffiths, David; Beauvoir, Phillip; Liber, Oleg; Barrett-Baxendale, Mark

2009-01-01

The use of the Web to deliver open, distance, and flexible learning has opened up the potential for social interaction and adaptive learning, but the usability, expressivity, and interoperability of the available tools leave much to be desired. This article explores these issues as they relate to teachers and learning designers through the case of…

Raising Students' Awareness of the Implications of Multimodality for Content Design and Usability: The Web Site Project

ERIC Educational Resources Information Center

Planken, Brigitte; Kreps, Arnold J.

2006-01-01

As advances in information communication technology have continued to affect business communication, the challenge for teachers over the past decade has been to stay abreast of new developments by integrating into the curriculum current theoretical and practice-based perspectives that can inform their students how to effectively create, manage,…

Can Social Semantic Web Techniques Foster Collaborative Curriculum Mapping In Medicine?

PubMed Central

Finsterer, Sonja; Cremer, Jan; Schenkat, Hennig

2013-01-01

Background Curriculum mapping, which is aimed at the systematic realignment of the planned, taught, and learned curriculum, is considered a challenging and ongoing effort in medical education. Second-generation curriculum managing systems foster knowledge management processes including curriculum mapping in order to give comprehensive support to learners, teachers, and administrators. The large quantity of custom-built software in this field indicates a shortcoming of available IT tools and standards. Objective The project reported here aims at the systematic adoption of techniques and standards of the Social Semantic Web to implement collaborative curriculum mapping for a complete medical model curriculum. Methods A semantic MediaWiki (SMW)-based Web application has been introduced as a platform for the elicitation and revision process of the Aachen Catalogue of Learning Objectives (ACLO). The semantic wiki uses a domain model of the curricular context and offers structured (form-based) data entry, multiple views, structured querying, semantic indexing, and commenting for learning objectives (“LOs”). Semantic indexing of learning objectives relies on both a controlled vocabulary of international medical classifications (ICD, MeSH) and a folksonomy maintained by the users. An additional module supporting the global checking of consistency complements the semantic wiki. Statements of the Object Constraint Language define the consistency criteria. We evaluated the application by a scenario-based formative usability study, where the participants solved tasks in the (fictional) context of 7 typical situations and answered a questionnaire containing Likert-scaled items and free-text questions. Results At present, ACLO contains roughly 5350 operational (ie, specific and measurable) objectives acquired during the last 25 months. The wiki-based user interface uses 13 online forms for data entry and 4 online forms for flexible searches of LOs, and all the forms are accessible by standard Web browsers. The formative usability study yielded positive results (median rating of 2 (“good”) in all 7 general usability items) and produced valuable qualitative feedback, especially concerning navigation and comprehensibility. Although not asked to, the participants (n=5) detected critical aspects of the curriculum (similar learning objectives addressed repeatedly and missing objectives), thus proving the system’s ability to support curriculum revision. Conclusions The SMW-based approach enabled an agile implementation of computer-supported knowledge management. The approach, based on standard Social Semantic Web formats and technology, represents a feasible and effectively applicable compromise between answering to the individual requirements of curriculum management at a particular medical school and using proprietary systems. PMID:23948519

Usability testing of a monitoring and feedback tool to stimulate physical activity.

PubMed

van der Weegen, Sanne; Verwey, Renée; Tange, Huibert J; Spreeuwenberg, Marieke D; de Witte, Luc P

2014-01-01

A MONITORING AND FEEDBACK TOOL TO STIMULATE PHYSICAL ACTIVITY, CONSISTING OF AN ACTIVITY SENSOR, SMARTPHONE APPLICATION (APP), AND WEBSITE FOR PATIENTS AND THEIR PRACTICE NURSES, HAS BEEN DEVELOPED: the 'It's LiFe!' tool. In this study the usability of the tool was evaluated by technology experts and end users (people with chronic obstructive pulmonary disease or type 2 diabetes, with ages from 40-70 years), to improve the user interfaces and content of the tool. THE STUDY HAD FOUR PHASES: 1) a heuristic evaluation with six technology experts; 2) a usability test in a laboratory by five patients; 3) a pilot in real life wherein 20 patients used the tool for 3 months; and 4) a final lab test by five patients. In both lab tests (phases 2 and 4) qualitative data were collected through a thinking-aloud procedure and video recordings, and quantitative data through questions about task complexity, text comprehensiveness, and readability. In addition, the post-study system usability questionnaire (PSSUQ) was completed for the app and the website. In the pilot test (phase 3), all patients were interviewed three times and the Software Usability Measurement Inventory (SUMI) was completed. After each phase, improvements were made, mainly to the layout and text. The main improvement was a refresh button for active data synchronization between activity sensor, app, and server, implemented after connectivity problems in the pilot test. The mean score on the PSSUQ for the website improved from 5.6 (standard deviation [SD] 1.3) to 6.5 (SD 0.5), and for the app from 5.4 (SD 1.5) to 6.2 (SD 1.1). Satisfaction in the pilot was not very high according to the SUMI. The use of laboratory versus real-life tests and expert-based versus user-based tests revealed a wide range of usability issues. The usability of the It's LiFe! tool improved considerably during the study.

A presentation system for just-in-time learning in radiology.

PubMed

Kahn, Charles E; Santos, Amadeu; Thao, Cheng; Rock, Jayson J; Nagy, Paul G; Ehlers, Kevin C

2007-03-01

There is growing interest in bringing medical educational materials to the point of care. We sought to develop a system for just-in-time learning in radiology. A database of 34 learning modules was derived from previously published journal articles. Learning objectives were specified for each module, and multiple-choice test items were created. A web-based system-called TEMPO-was developed to allow radiologists to select and view the learning modules. Web services were used to exchange clinical context information between TEMPO and the simulated radiology work station. Preliminary evaluation was conducted using the System Usability Scale (SUS) questionnaire. TEMPO identified learning modules that were relevant to the age, sex, imaging modality, and body part or organ system of the patient being viewed by the radiologist on the simulated clinical work station. Users expressed a high degree of satisfaction with the system's design and user interface. TEMPO enables just-in-time learning in radiology, and can be extended to create a fully functional learning management system for point-of-care learning in radiology.

Determining the Number of Participants Needed for the Usability Evaluation of E-Learning Resources: A Monte Carlo Simulation

ERIC Educational Resources Information Center

Davids, Mogamat Razeen; Harvey, Justin; Halperin, Mitchell L.; Chikte, Usuf M. E.

2015-01-01

The usability of computer interfaces has a major influence on learning. Optimising the usability of e-learning resources is therefore essential. However, this may be neglected because of time and monetary constraints. User testing is a common approach to usability evaluation and involves studying typical end-users interacting with the application…

Usability of a home-based test for the measurement of fecal calprotectin in asymptomatic IBD patients.

PubMed

Bello, Caroline; Roseth, Arne; Guardiola, Jordi; Reenaers, Catherine; Ruiz-Cerulla, Alexandra; Van Kemseke, Catherine; Arajol, Claudia; Reinhard, Christian; Seidel, Laurence; Louis, Edouard

2017-09-01

The aim of our work was to test the usability of fecal calprotectin (FC) home-based test in inflammatory bowel disease (IBD) patients. IBD patients were prospectively recruited. They had to measure FC with a dedicated tool and smartphone application, 5 times at two weeks intervals over an 8 weeks period. They had to fill in a usability questionnaire at the first and the last FC measurement. A System Usability Scale (SUS: 0-100) and the Global Score of Usability (GSU: 0-85) were calculated. FC was also centrally measured by ELISA. Fifty-eight patients were recruited. Forty-two performed at least one FC measurement and 27 performed all the FC requested measurements. The median (IQR) SUS (0-100) at the first and last use were 85 (78-90) and 81 (70-88), respectively; the median (IQR) GSU (0-85) at the first and last use were 74 (69-80) and 77 (68-83), respectively. Adherence to the planned measurements and usability of the tool were higher in females and in less severe disease. The intra-class correlation coefficient between home-based and centrally measured FC was 0.88. The adherence to home-based measurement of FC was fair. Usability scores for the home-based test were high. There was a good correlation with the centrally measured FC by ELISA. Copyright © 2017 Editrice Gastroenterologica Italiana S.r.l. Published by Elsevier Ltd. All rights reserved.

HDF-EOS Web Server

NASA Technical Reports Server (NTRS)

Ullman, Richard; Bane, Bob; Yang, Jingli

2008-01-01

A shell script has been written as a means of automatically making HDF-EOS-formatted data sets available via the World Wide Web. ("HDF-EOS" and variants thereof are defined in the first of the two immediately preceding articles.) The shell script chains together some software tools developed by the Data Usability Group at Goddard Space Flight Center to perform the following actions: Extract metadata in Object Definition Language (ODL) from an HDF-EOS file, Convert the metadata from ODL to Extensible Markup Language (XML), Reformat the XML metadata into human-readable Hypertext Markup Language (HTML), Publish the HTML metadata and the original HDF-EOS file to a Web server and an Open-source Project for a Network Data Access Protocol (OPeN-DAP) server computer, and Reformat the XML metadata and submit the resulting file to the EOS Clearinghouse, which is a Web-based metadata clearinghouse that facilitates searching for, and exchange of, Earth-Science data.

The UMLS Knowledge Source Server: an experience in Web 2.0 technologies.

PubMed

Thorn, Karen E; Bangalore, Anantha K; Browne, Allen C

2007-10-11

The UMLS Knowledge Source Server (UMLSKS), developed at the National Library of Medicine (NLM), makes the knowledge sources of the Unified Medical Language System (UMLS) available to the research community over the Internet. In 2003, the UMLSKS was redesigned utilizing state-of-the-art technologies available at that time. That design offered a significant improvement over the prior version but presented a set of technology-dependent issues that limited its functionality and usability. Four areas of desired improvement were identified: software interfaces, web interface content, system maintenance/deployment, and user authentication. By employing next generation web technologies, newer authentication paradigms and further refinements in modular design methods, these areas could be addressed and corrected to meet the ever increasing needs of UMLSKS developers. In this paper we detail the issues present with the existing system and describe the new system's design using new technologies considered entrants in the Web 2.0 development era.

Credibility judgments in web page design - a brief review.

PubMed

Selejan, O; Muresanu, D F; Popa, L; Muresanu-Oloeriu, I; Iudean, D; Buzoianu, A; Suciu, S

2016-01-01

Today, more than ever, knowledge that interfaces appearance analysis is a crucial point in human-computer interaction field has been accepted. As nowadays virtually anyone can publish information on the web, the credibility role has grown increasingly important in relation to the web-based content. Areas like trust, credibility, and behavior, doubled by overall impression and user expectation are today in the spotlight of research compared to the last period, when other pragmatic areas such as usability and utility were considered. Credibility has been discussed as a theoretical construct in the field of communication in the past decades and revealed that people tend to evaluate the credibility of communication primarily by the communicator's expertise. Other factors involved in the content communication process are trustworthiness and dynamism as well as various other criteria but to a lower extent. In this brief review, factors like web page aesthetics, browsing experiences and user experience are considered.

Credibility judgments in web page design – a brief review

PubMed Central

Selejan, O; Muresanu, DF; Popa, L; Muresanu-Oloeriu, I; Iudean, D; Buzoianu, A; Suciu, S

2016-01-01

Today, more than ever, knowledge that interfaces appearance analysis is a crucial point in human-computer interaction field has been accepted. As nowadays virtually anyone can publish information on the web, the credibility role has grown increasingly important in relation to the web-based content. Areas like trust, credibility, and behavior, doubled by overall impression and user expectation are today in the spotlight of research compared to the last period, when other pragmatic areas such as usability and utility were considered. Credibility has been discussed as a theoretical construct in the field of communication in the past decades and revealed that people tend to evaluate the credibility of communication primarily by the communicator’s expertise. Other factors involved in the content communication process are trustworthiness and dynamism as well as various other criteria but to a lower extent. In this brief review, factors like web page aesthetics, browsing experiences and user experience are considered. PMID:27453738

Human Factors for Nursing: From In-Situ Testing to Mobile Usability Engineering.

PubMed

Kushniruk, Andre W; Borycki, Elizabeth M; Solvoll, Terje; Hullin, Carola

2016-01-01

The tutorial goal is to familiarize participants with human aspects of health informatics and human-centered approaches to the design, evaluation and deployment of both usable and safe healthcare information systems. The focus will be on demonstrating and teaching practical and low-cost methods for evaluating mobile applications in nursing. Basic background to testing methods will be provided, followed by live demonstration of the methods. Then the audience will break into small groups to explore the application of the methods to applications of interest (there will be a number of possible applications that will be available for applications in areas such as electronic health records and decision support, however, if the groups have applications of specific interest to them that will be possible). The challenges of conducting usability testing, and in particular mobile usability testing will be discussed along with practical solutions. The target audience includes practicing nurses and nurse researchers, nursing informatics specialists, nursing students, nursing managers and health informatics professionals interested in improving the usability and safety of healthcare applications.

Applying User-Centered Design Methods to the Development of an mHealth Application for Use in the Hospital Setting by Patients and Care Partners.

PubMed

Couture, Brittany; Lilley, Elizabeth; Chang, Frank; DeBord Smith, Ann; Cleveland, Jessica; Ergai, Awatef; Katsulis, Zachary; Benneyan, James; Gershanik, Esteban; Bates, David W; Collins, Sarah A

2018-04-01

 Developing an optimized and user-friendly mHealth application for patients and family members in the hospital environment presents unique challenges given the diverse patient population and patients' various states of well-being.  This article describes user-centered design methods and results for developing the patient and family facing user interface and functionality of MySafeCare, a safety reporting tool for hospitalized patients and their family members.  Individual and group usability sessions were conducted with specific testing scenarios for participants to follow to test the usability and functionality of the tool. Participants included patients, family members, and Patient and Family Advisory Council (PFAC) members. Engagement rounds were also conducted on study units and lessons learned provided additional information to the usability work. Usability results were aligned with Nielsen's Usability Heuristics.  Eleven patients and family members and 25 PFAC members participated in usability testing and over 250 patients and family members were engaged during research team rounding. Specific themes resulting from the usability testing sessions influenced the changes made to the user interface design, workflow functionality, and terminology.  User-centered design should focus on workflow functionality, terminology, and user interface issues for mHealth applications. These themes illustrated issues aligned with four of Nielsen's Usability Heuristics: match between system and the real world, consistency and standards, flexibility and efficiency of use, and aesthetic and minimalist design. We identified workflow and terminology issues that may be specific to the use of an mHealth application focused on safety and used by hospitalized patients and their families. Schattauer GmbH Stuttgart.

The development of a clinical outcomes survey research application: Assessment CenterSM

PubMed Central

Rothrock, Nan E.; Hanrahan, Rachel T.; Jansky, Liz J.; Harniss, Mark; Riley, William

2013-01-01

Introduction The National Institutes of Health sponsored Patient-Reported Outcome Measurement Information System (PROMIS) aimed to create item banks and computerized adaptive tests (CATs) across multiple domains for individuals with a range of chronic diseases. Purpose Web-based software was created to enable a researcher to create study-specific Websites that could administer PROMIS CATs and other instruments to research participants or clinical samples. This paper outlines the process used to develop a user-friendly, free, Web-based resource (Assessment CenterSM) for storage, retrieval, organization, sharing, and administration of patient-reported outcomes (PRO) instruments. Methods Joint Application Design (JAD) sessions were conducted with representatives from numerous institutions in order to supply a general wish list of features. Use Cases were then written to ensure that end user expectations matched programmer specifications. Program development included daily programmer “scrum” sessions, weekly Usability Acceptability Testing (UAT) and continuous Quality Assurance (QA) activities pre- and post-release. Results Assessment Center includes features that promote instrument development including item histories, data management, and storage of statistical analysis results. Conclusions This case study of software development highlights the collection and incorporation of user input throughout the development process. Potential future applications of Assessment Center in clinical research are discussed. PMID:20306332

Translation, Cross-Cultural Adaptation, and Validation of the Malay Version of the System Usability Scale Questionnaire for the Assessment of Mobile Apps.

PubMed

Mohamad Marzuki, Muhamad Fadhil; Yaacob, Nor Azwany; Yaacob, Najib Majdi

2018-05-14

A mobile app is a programmed system designed to be used by a target user on a mobile device. The usability of such a system refers not only to the extent to which product can be used to achieve the task that it was designed for, but also its effectiveness and efficiency, as well as user satisfaction. The System Usability Scale is one of the most commonly used questionnaires used to assess the usability of a system. The original 10-item version of System Usability Scale was developed in English and thus needs to be adapted into local languages to assess the usability of a mobile apps developed in other languages. The aim of this study is to translate and validate (with cross-cultural adaptation) the English System Usability Scale questionnaire into Malay, the main language spoken in Malaysia. The development of a translated version will allow the usability of mobile apps to be assessed in Malay. Forward and backward translation of the questionnaire was conducted by groups of Malay native speakers who spoke English as their second language. The final version was obtained after reconciliation and cross-cultural adaptation. The content of the Malay System Usability Scale questionnaire for mobile apps was validated by 10 experts in mobile app development. The efficacy of the questionnaire was further probed by testing the face validity on 10 mobile phone users, followed by reliability testing involving 54 mobile phone users. The content validity index was determined to be 0.91, indicating good relevancy of the 10 items used to assess the usability of a mobile app. Calculation of the face validity index resulted in a value of 0.94, therefore indicating that the questionnaire was easily understood by the users. Reliability testing showed a Cronbach alpha value of .85 (95% CI 0.79-0.91) indicating that the translated System Usability Scale questionnaire is a reliable tool for the assessment of usability of a mobile app. The Malay System Usability Scale questionnaire is a valid and reliable tool to assess the usability of mobile app in Malaysia. ©Muhamad Fadhil Mohamad Marzuki, Nor Azwany Yaacob, Najib Majdi Yaacob. Originally published in JMIR Human Factors (http://humanfactors.jmir.org), 14.05.2018.

Simulation of patient encounters using a virtual patient in periodontology instruction of dental students: design, usability, and learning effect in history-taking skills.

PubMed

Schittek Janda, M; Mattheos, N; Nattestad, A; Wagner, A; Nebel, D; Färbom, C; Lê, D-H; Attström, R

2004-08-01

Simulations are important educational tools in the development of health care competence. This study describes a virtual learning environment (VLE) for diagnosis and treatment planning in oral health care. The VLE is a web-based, database application where the learner uses free text communication on the screen to interact with patient data. The VLE contains forms for history taking, clinical images, clinical data and X-rays. After reviewing the patient information, the student proposes therapy and makes prognostic evaluations of the case in free text. A usability test of the application was performed with seven dental students. The usability test showed that the software responded with correct answers to the majority of the free text questions. The application is generic in its basic functions and can be adapted to other dental or medical subject areas. A randomised controlled trial was carried out with 39 students who attended instruction in history taking with problem-based learning cases, lectures and seminars. In addition, 16 of the 39 students were randomly chosen to practise history taking using the virtual patient prior to their first patient encounter. The performance of each student was recorded on video during the patient sessions. The type and order of the questions asked by the student and the degree of empathy displayed towards the patient were analysed systematically on the videos. The data indicate that students who also undertook history taking with a virtual patient asked more relevant questions, spent more time on patient issues, and performed a more complete history interview compared with students who had only undergone standard teaching. The students who had worked with the virtual patient also seemed to have more empathy for the patients than the students who had not. The practising of history taking with a virtual patient appears to improve the capability of dental students to take a relevant oral health history.

Web-Based Communication Strategies Designed to Improve Intention to Minimize Risk for Colorectal Cancer: Randomized Controlled Trial

PubMed Central

Flight, Ingrid; Zajac, Ian T; Turnbull, Deborah; Young, Graeme P; Olver, Ian

2018-01-01

Background People seek information on the Web for managing their colorectal cancer (CRC) risk but retrieve much personally irrelevant material. Targeting information pertinent to this cohort via a frequently asked question (FAQ) format could improve outcomes. Objective We identified and prioritized colorectal cancer information for men and women aged 35 to 74 years (study 1) and built a website containing FAQs ordered by age and gender. In study 2, we conducted a randomized controlled trial (RCT) to test whether targeted FAQs were more influential on intention to act on CRC risk than the same information accessed via a generic topic list. Secondary analyses compared preference for information delivery, usability, relevance, and likelihood of recommendation of FAQ and LIST websites. Methods Study 1 determined the colorectal cancer information needs of Australians (N=600) by sex and age group (35-49, 50-59, 60-74) through a Web-based survey. Free-text responses were categorized as FAQs: the top 5 issues within each of the 6 cohorts were identified. Study 2 (N=240) compared the impact of presentation as targeted FAQ links to information with links presented as a generic list (LIST) and a CONTROL (no information) condition. We also tested preference for presentation of access to information as FAQ or LIST by adding a CHOICE condition (a self-selected choice of FAQs or a list of information topics). Results Study 1 showed considerable consistency in information priorities among all 6 cohorts with 2 main concerns: treatment of CRC and risk factors. Some differences included a focus on general risk factors, excluding diet and lifestyle, in the younger cohort, and on the existence of a test for CRC in the older cohorts. Study 2 demonstrated that, although respondents preferred information access ordered by FAQs over a list, presentation in this format had limited impact on readiness to act on colorectal cancer risk compared with the list or a no-information control (P=.06). Both FAQ and LIST were evaluated as equally usable. Those aged 35 to 49 years rated the information less relevant to them and others in their age group, and information ordered by FAQs was rated, across all age groups and both sexes, as less relevant to people outside the age group targeted within the FAQs. Conclusions FAQs are preferred over a list as a strategy for presenting access to information about CRC. They may improve intention to act on risk, although further research is required. Future research should aim to identify better the characteristics of information content and presentation that optimize perceived relevance and fully engage the target audience. Trial Registration Australian New Zealand Clinical Trials Registry: ACTRN12618000137291; https://www.anzctr.org. au/Trial/Registration/TrialReview.aspx?id=374129 (Archived by WebCite at http://www.webcitation.org/6x2Mr6rPC) PMID:29434013

Designing an Affordable Usability Test for E-Learning Modules

ERIC Educational Resources Information Center

O'Bryan, Corliss A.; Johnson, Donald M.; Shores-Ellis, Katrina D.; Crandall, Philip G.; Marcy, John A.; Seideman, Steve C.; Ricke, Steven C.

2010-01-01

This article provides background and an introduction to a user-centered design and usability test in an inexpensive format that allows content experts who are novices in e-learning development to perform testing on newly developed technical training modules prior to their release. The use of a small number of test participants, avoidance of…

Enhancing the Usability of an Optical Reader System to Support Point-of-Care Rapid Diagnostic Testing: An Iterative Design Approach.

PubMed

Hohenstein, Jess; O'Dell, Dakota; Murnane, Elizabeth L; Lu, Zhengda; Erickson, David; Gay, Geri

2017-11-21

In today's health care environment, increasing costs and inadequate medical resources have created a worldwide need for more affordable diagnostic tools that are also portable, fast, and easy to use. To address this issue, numerous research and commercial efforts have focused on developing rapid diagnostic technologies; however, the efficacy of existing systems has been hindered by usability problems or high production costs, making them infeasible for deployment in at-home, point-of-care (POC), or resource-limited settings. The aim of this study was to create a low-cost optical reader system that integrates with any smart device and accepts any type of rapid diagnostic test strip to provide fast and accurate data collection, sample analysis, and diagnostic result reporting. An iterative design methodology was employed by a multidisciplinary research team to engineer three versions of a portable diagnostic testing device that were evaluated for usability and overall user receptivity. Repeated design critiques and usability studies identified a number of system requirements and considerations (eg, software compatibility, biomatter contamination, and physical footprint) that we worked to incrementally incorporate into successive system variants. Our final design phase culminated in the development of Tidbit, a reader that is compatible with any Wi-Fi-enabled device and test strip format. The Tidbit includes various features that support intuitive operation, including a straightforward test strip insertion point, external indicator lights, concealed electronic components, and an asymmetric shape, which inherently signals correct device orientation. Usability testing of the Tidbit indicates high usability for potential user communities. This study presents the design process, specification, and user reception of the Tidbit, an inexpensive, easy-to-use, portable optical reader for fast, accurate quantification of rapid diagnostic test results. Usability testing suggests that the reader is usable among and can benefit a wide group of potential users, including in POC contexts. Generally, the methodology of this study demonstrates the importance of testing these types of systems with potential users and exemplifies how iterative design processes can be employed by multidisciplinary research teams to produce compelling technological solutions. ©Jess Hohenstein, Dakota O'Dell, Elizabeth L Murnane, Zhengda Lu, David Erickson, Geri Gay. Originally published in JMIR Human Factors (http://humanfactors.jmir.org), 21.11.2017.

Implementation of a guideline for local health policy making by regional health services: exploring determinants of use by a web survey.

PubMed

Kuunders, Theo J M; Jacobs, Monique A M; Goor, Ien A M van de; Bon-Martens, Marja J H van; Oers, Hans A M van; Paulussen, Theo G W M

2017-08-15

Previous evaluation showed insufficient use of a national guideline for integrated local health policy by Regional Health Services (RHS) in the Netherlands. The guideline focuses on five health topics and includes five checklists to support integrated municipal health policies. This study explores the determinants of guideline use by regional Dutch health professionals. A web survey was send to 304 RHS health professionals. The questionnaire was based on a theory- and research-based framework of determinants of public health innovations. Main outcomes were guideline use and completeness of use, defined as the number of health topics and checklists used. Associations between determinants and (completeness of) guideline use were explored by multivariate regression models. The survey was started by 120 professionals (39%). Finally, results from 73 respondents (24%) were eligible for analyses. All 28 Dutch RHS organizations were represented in the final dataset. About half of the respondents (48%) used the guideline. The average score for completeness of use (potential range 1-10) was 2.37 (sd = 1.78; range 1-7). Knowledge, perceived task responsibility and usability were significantly related to guideline use in univariate analyses. Only usability remained significant in the multivariate model on guideline use. Only self-efficacy accounted for significant proportions of variance in completeness of use. The results imply that strategies to improve guideline use by RHSs should primarily target perceived usability. Self-efficacy appeared the primary target for improving completeness of guideline use. Methods for targeting these determinants in RHSs are discussed.

VoIP Accessibility: A Usability Study of Voice over Internet Protocol (VoIP) Systems and A Survey of VoIP Users with Vision Loss

ERIC Educational Resources Information Center

Packer, Jaclyn; Reuschel, William

2018-01-01

Introduction: Accessibility of Voice over Internet Protocol (VoIP) systems was tested with a hands-on usability study and an online survey of VoIP users who are visually impaired. The survey examined the importance of common VoIP features, and both methods assessed difficulty in using those features. Methods: The usability test included four paid…

jORCA: easily integrating bioinformatics Web Services.

PubMed

Martín-Requena, Victoria; Ríos, Javier; García, Maximiliano; Ramírez, Sergio; Trelles, Oswaldo

2010-02-15

Web services technology is becoming the option of choice to deploy bioinformatics tools that are universally available. One of the major strengths of this approach is that it supports machine-to-machine interoperability over a network. However, a weakness of this approach is that various Web Services differ in their definition and invocation protocols, as well as their communication and data formats-and this presents a barrier to service interoperability. jORCA is a desktop client aimed at facilitating seamless integration of Web Services. It does so by making a uniform representation of the different web resources, supporting scalable service discovery, and automatic composition of workflows. Usability is at the top of the jORCA agenda; thus it is a highly customizable and extensible application that accommodates a broad range of user skills featuring double-click invocation of services in conjunction with advanced execution-control, on the fly data standardization, extensibility of viewer plug-ins, drag-and-drop editing capabilities, plus a file-based browsing style and organization of favourite tools. The integration of bioinformatics Web Services is made easier to support a wider range of users. .

Iterative Design and Usability Testing of the Imhere System for Managing Chronic Conditions and Disability

PubMed Central

FAIRMAN, ANDREA D.; YIH, ERIKA T.; MCCOY, DANIEL F.; LOPRESTI, EDMUND F.; MCCUE, MICHAEL P.; PARMANTO, BAMBANG; DICIANNO, BRAD E.

2016-01-01

A novel mobile health platform, Interactive Mobile Health and Rehabilitation (iMHere), is being developed to support wellness and self-management among people with chronic disabilities. The iMHere system currently includes a smartphone app with six modules for use by persons with disabilities and a web portal for use by medical and rehabilitation professionals or other support personnel. Our initial clinical research applying use of this system provides insight into the feasibility of employing iMHere in the development of self-management skills in young adults (ages 18–40 years) with spina bifida (SB) (Dicianno, Fairman, et al., 2015). This article describes the iterative design of the iMHere system including usability testing of both the app modules and clinician portal. Our pilot population of persons with SB fostered the creation of a system appropriate for people with a wide variety of functional abilities and needs. As a result, the system is appropriate for use by persons with various disabilities and chronic conditions, not only SB. In addition, the diversity of professionals and support personnel involved in the care of persons with SB also enabled the design and implementation of the iMHere system to meet the needs of an interdisciplinary team of providers who treat various conditions. The iMHere system has the potential to foster communication and collaboration among members of an interdisciplinary healthcare team, including individuals with chronic conditions and disabilities, for a client-centered approach to support self-management skills. PMID:27563387

Usability in the real world: assessing medical information technologies in patients' homes.

PubMed

Kaufman, David R; Patel, Vimla L; Hilliman, Charlyn; Morin, Philip C; Pevzner, Jenia; Weinstock, Ruth S; Goland, Robin; Shea, Steven; Starren, Justin

2003-01-01

This paper presents an approach to usability evaluation of computer-based health care systems designed for patient use in their homes. Although such devices are becoming more prevalent, there is very little known about their usability. The theoretical foundations for the methods are discussed. The approach incorporates a cognitive walkthrough usability evaluation and new methods for usability testing that can be conducted in patient's homes. The method was applied to the IDEATel intervention, a multi-institution randomized controlled trial of the feasibility, acceptability, and clinical utility of a home-based telemedicine system for diabetic Medicare population. The usability study was designed to assess barriers to optimal use of the system. The focus was both on dimensions of the interface and on dimensions of patient skills and competency. The usability field research involved testing 25 patients in their homes using the system. The analysis included a range of video-analytic methods of varying levels of granularity. The usability evaluation revealed aspects of the interface that were sub-optimal and impeded the performance of certain tasks. It also found a range of patient-related factors such as numeracy and psychomotor skills that constituted barriers to productive use. A multifaceted usability approach provided important insight regarding use of technology by an elderly chronic-care patient population and more generally, for understanding how home health initiatives can more effectively use such technology.

The value of usability testing for Internet-based adolescent self-management interventions: "Managing Hemophilia Online".

PubMed

Breakey, Vicky R; Warias, Ashley V; Ignas, Danial M; White, Meghan; Blanchette, Victor S; Stinson, Jennifer N

2013-10-04

As adolescents with hemophilia approach adulthood, they are expected to assume responsibility for their disease management. A bilingual (English and French) Internet-based self-management program, "Teens Taking Charge: Managing Hemophilia Online," was developed to support adolescents with hemophilia in this transition. This study explored the usability of the website and resulted in refinement of the prototype. A purposive sample (n=18; age 13-18; mean age 15.5 years) was recruited from two tertiary care centers to assess the usability of the program in English and French. Qualitative observations using a "think aloud" usability testing method and semi-structured interviews were conducted in four iterative cycles, with changes to the prototype made as necessary following each cycle. This study was approved by research ethics boards at each site. Teens responded positively to the content and appearance of the website and felt that it was easy to navigate and understand. The multimedia components (videos, animations, quizzes) were felt to enrich the experience. Changes to the presentation of content and the website user-interface were made after the first, second and third cycles of testing in English. Cycle four did not result in any further changes. Overall, teens found the website to be easy to use. Usability testing identified end-user concerns that informed improvements to the program. Usability testing is a crucial step in the development of Internet-based self-management programs to ensure information is delivered in a manner that is accessible and understood by users.

Digital casts in orthodontics: a comparison of 4 software systems.

PubMed

Westerlund, Anna; Tancredi, Weronika; Ransjö, Maria; Bresin, Andrea; Psonis, Spyros; Torgersson, Olof

2015-04-01

The introduction of digital cast models is inevitable in the otherwise digitized everyday life of orthodontics. The introduction of this new technology, however, is not straightforward, and selecting an appropriate system can be difficult. The aim of the study was to compare 4 orthodontic digital software systems regarding service, features, and usability. Information regarding service offered by the companies was obtained from questionnaires and Web sites. The features of each software system were collected by exploring the user manuals and the software programs. Replicas of pretreatment casts were sent to Cadent (OrthoCAD; Cadent, Carlstadt, NJ), OthoLab (O3DM; OrthoLab, Poznan, Poland), OrthoProof (DigiModel; OrthoProof, Nieuwegein, The Netherlands), and 3Shape (OrthoAnalyzer; 3Shape, Copenhagen, Denmark). The usability of the programs was assessed by experts in interaction design and usability using the "enhanced cognitive walkthrough" method: 4 tasks were defined and performed by a group of domain experts while they were observed by usability experts. The services provided by the companies were similar. Regarding the features, all 4 systems were able to perform basic measurements; however, not all provided the peer assessment rating index or the American Board of Orthodontics analysis, simulation of the treatment with braces, or digital articulation of the casts. All systems demonstrated weaknesses in usability. However, OrthoCAD and 03DM were considered to be easier to learn for first-time users. In general, the usability of these programs was poor and needs to be further developed. Hands-on training supervised by the program experts is recommended for beginners. Copyright © 2015 American Association of Orthodontists. Published by Elsevier Inc. All rights reserved.

A Cross-Cultural Usability Study on the Internationalization of User Interfaces Based on an Empirical Five Factor Model

ERIC Educational Resources Information Center

Chakraborty, Joyram

2009-01-01

With the internationalization of e-commerce, it is no longer viable to design one user interface for all environments. Web-based applications and services can be accessed from all over the globe. To account for this globalization process, software developers need to understand that simply accounting for language translation of their websites for…

A socialization intervention in remote health coaching for older adults in the home.

PubMed

Jimison, Holly B; Klein, Krystal A; Marcoe, Jennifer L

2013-01-01

Previous studies have shown that social ties enhance both physical and mental health, and that social isolation has been linked to increased cognitive decline. As part of our cognitive training platform, we created a socialization intervention to address these issues. The intervention is designed to improve social contact time of older adults with remote family members and friends using a variety of technologies, including Web cameras, Skype software, email and phone. We used usability testing, surveys, interviews and system usage monitoring to develop design guidance for socialization protocols that were appropriate for older adults living independently in their homes. Our early results with this intervention show increased number of social contacts, total communication time (we measure email, phone, and Skype usage) and significant participant satisfaction with the intervention.

Ruby on Rails Issue Tracker

NASA Technical Reports Server (NTRS)

Rodriguez, Juan Jared

2014-01-01

The purpose of this report is to detail the tasks accomplished as a NASA NIFS intern for the summer 2014 session. This internship opportunity is to develop an issue tracker Ruby on Rails web application to improve the communication of developmental anomalies between the Support Software Computer Software Configuration Item (CSCI) teams, System Build and Information Architecture. As many may know software development is an arduous, time consuming, collaborative effort. It involves nearly as much work designing, planning, collaborating, discussing, and resolving issues as effort expended in actual development. This internship opportunity was put in place to help alleviate the amount of time spent discussing issues such as bugs, missing tests, new requirements, and usability concerns that arise during development and throughout the life cycle of software applications once in production.

Software architecture and engineering for patient records: current and future.

PubMed

Weng, Chunhua; Levine, Betty A; Mun, Seong K

2009-05-01

During the "The National Forum on the Future of the Defense Health Information System," a track focusing on "Systems Architecture and Software Engineering" included eight presenters. These presenters identified three key areas of interest in this field, which include the need for open enterprise architecture and a federated database design, net centrality based on service-oriented architecture, and the need for focus on software usability and reusability. The eight panelists provided recommendations related to the suitability of service-oriented architecture and the enabling technologies of grid computing and Web 2.0 for building health services research centers and federated data warehouses to facilitate large-scale collaborative health care and research. Finally, they discussed the need to leverage industry best practices for software engineering to facilitate rapid software development, testing, and deployment.

A Socialization Intervention in Remote Health Coaching for Older Adults in the Home*

PubMed Central

Jimison, Holly B.; Klein, Krystal A.; Marcoe, Jennifer L.

2014-01-01

Previous studies have shown that social ties enhance both physical and mental health, and that social isolation has been linked to increased cognitive decline. As part of our cognitive training platform, we created a socialization intervention to address these issues. The intervention is designed to improve social contact time of older adults with remote family members and friends using a variety of technologies, including Web cameras, Skype software, email and phone. We used usability testing, surveys, interviews and system usage monitoring to develop design guidance for socialization protocols that were appropriate for older adults living independently in their homes. Our early results with this intervention show increased number of social contacts, total communication time (we measure email, phone, and Skype usage) and significant participant satisfaction with the intervention. PMID:24111362

Customizable scientific web-portal for DIII-D nuclear fusion experiment

NASA Astrophysics Data System (ADS)

Abla, G.; Kim, E. N.; Schissel, D. P.

2010-04-01

Increasing utilization of the Internet and convenient web technologies has made the web-portal a major application interface for remote participation and control of scientific instruments. While web-portals have provided a centralized gateway for multiple computational services, the amount of visual output often is overwhelming due to the high volume of data generated by complex scientific instruments and experiments. Since each scientist may have different priorities and areas of interest in the experiment, filtering and organizing information based on the individual user's need can increase the usability and efficiency of a web-portal. DIII-D is the largest magnetic nuclear fusion device in the US. A web-portal has been designed to support the experimental activities of DIII-D researchers worldwide. It offers a customizable interface with personalized page layouts and list of services for users to select. Each individual user can create a unique working environment to fit his own needs and interests. Customizable services are: real-time experiment status monitoring, diagnostic data access, interactive data analysis and visualization. The web-portal also supports interactive collaborations by providing collaborative logbook, and online instant announcement services. The DIII-D web-portal development utilizes multi-tier software architecture, and Web 2.0 technologies and tools, such as AJAX and Django, to develop a highly-interactive and customizable user interface.

Advocating for Greater Usability in Clinical Technologies: The Role of the Practicing Nurse.

PubMed

Lopez, Karen Dunn; Fahey, Linda

2018-06-01

Health care, especially ICUs, rely on multiple types of technology to promote the best patient outcomes. Unfortunately, too often these technologies are poorly designed, causing errors, additional workload, and unnecessary frustration. The purpose of this article is to (1) empower nurses with the needed usability and usability testing vocabulary to identify and articulate clinical technology usability problems and (2) provide ideas on ways nurses can advocate to have an impact on positive change related to technology usability within a health care organization. Copyright © 2018 Elsevier Inc. All rights reserved.

Big Data Discovery and Access Services through NOAA OneStop

NASA Astrophysics Data System (ADS)

Casey, K. S.; Neufeld, D.; Ritchey, N. A.; Relph, J.; Fischman, D.; Baldwin, R.

2017-12-01

The NOAA OneStop Project was created as a pathfinder effort to to improve the discovery of, access to, and usability of NOAA's vast and diverse collection of big data. OneStop is led by the NOAA/NESDIS National Centers for Environmental Information (NCEI), and is seen as a key NESDIS contribution to NOAA's open data and data stewardship efforts. OneStop consists of an entire framework of services, from storage and interoperable access services at the base, through metadata and catalog services in the middle, to a modern user interface experience at the top. Importantly, it is an open framework where external tools and services can connect at whichever level is most appropriate. Since the beta release of the OneStop user interface at the 2016 Fall AGU meeting, significant progress has been made improving and modernizing many NOAA data collections to optimize their use within the framework. In addition, OneStop has made progress implementing robust metadata management and catalog systems at the collection and granule level and improving the user experience with the web interface. This progress will be summarized and the results of extensive user testing including professional usability studies will be reviewed. Key big data technologies supporting the framework will be presented and a community input sought on the future directions of the OneStop Project.

Usability of a Culturally Informed mHealth Intervention for Symptoms of Anxiety and Depression: Feedback From Young Sexual Minority Men

PubMed Central

Hill, Yvette N; Burns, Michelle Nicole

2017-01-01

Background To date, we are aware of no interventions for anxiety and depression developed as mobile phone apps and tailored to young sexual minority men, a group especially at risk of anxiety and depression. We developed TODAY!, a culturally informed mobile phone intervention for young men who are attracted to men and who have clinically significant symptoms of anxiety or depression. The core of the intervention consists of daily psychoeducation informed by transdiagnostic cognitive behavioral therapy (CBT) and a set of tools to facilitate putting these concepts into action, with regular mood ratings that result in tailored feedback (eg, tips for current distress and visualizations of mood by context). Objective The aim of this study was to conduct usability testing to understand how young sexual minority men interact with the app, to inform later stages of intervention development. Methods Participants (n=9) were young sexual minority men aged 18-20 years (Mean=19.00, standard deviation [SD]=0.71; 44% black, 44% white, and 11.1% Latino), who endorsed at least mild depression and anxiety symptoms. Participants were recruited via flyers, emails to college lesbian, gay, bisexual, and transgender (LGBT) organizations, Web-based advertisements, another researcher’s database of sexual minority youth interested in research participation, and word of mouth. During recorded interviews, participants were asked to think out loud while interacting with the TODAY! app on a mobile phone or with paper prototypes. Feedback identified from these recordings and from associated field notes were subjected to thematic analysis using a general inductive approach. To aid interpretation of results, methods and results are reported according to the consolidated criteria for reporting qualitative research (COREQ). Results Thematic analysis of usability feedback revealed a theme of general positive feedback, as well as six recurring themes that informed continued development: (1) functionality (eg, highlight new material when available), (2) personalization (eg, more tailored feedback), (3) presentation (eg, keep content brief), (4) aesthetics (eg, use brighter colors), (5) LGBT or youth content (eg, add content about coming out), and (6) barriers to use (eg, perceiving psychoeducation as homework). Conclusions Feedback from usability testing was vital to understanding what young sexual minority men desire from a mobile phone intervention for symptoms of anxiety and depression and was used to inform the ongoing development of such an intervention. PMID:28842389

Barriers to comparing the usability of electronic health records.

PubMed

Ratwani, Raj M; Hettinger, A Zachary; Fairbanks, Rollin J

2017-04-01

Despite the widespread adoption of electronic health records (EHRs), usability of many EHRs continues to be suboptimal, with some vendors failing to meet usability standards, resulting in clinician frustration and patient safety hazards. In an effort to increase EHR vendor competition on usability, recommendations have been made and legislation drafted to develop comparison tools that would allow purchasers to better understand the usability of EHR products prior to purchase. Usability comparison can be based on EHR vendor design and development processes, vendor usability testing as part of the Office of the National Coordinator for Health Information Technology certification program, and usability of implemented products. Barriers exist within the current certified health technology program that prevent effective comparison of usability during each of these stages. We describe the importance of providing purchasers with improved information about EHR usability, barriers to making usability comparisons, and solutions to overcome these barriers. © The Author 2016. Published by Oxford University Press on behalf of the American Medical Informatics Association. All rights reserved. For Permissions, please email: journals.permissions@oup.com.

Usability study of a computer-based self-management system for older adults with chronic diseases.

PubMed

Or, Calvin; Tao, Da

2012-11-08

Usability can influence patients' acceptance and adoption of a health information technology. However, little research has been conducted to study the usability of a self-management health care system, especially one geared toward elderly patients. This usability study evaluated a new computer-based self-management system interface for older adults with chronic diseases, using a paper prototype approach. Fifty older adults with different chronic diseases participated. Two usability evaluation methods were involved: (1) a heuristics evaluation and (2) end-user testing with a think-aloud testing method, audio recording, videotaping, and interviewing. A set of usability metrics was employed to determine the overall system usability, including task incompletion rate, task completion time, frequency of error, frequency of help, satisfaction, perceived usefulness, and perceived ease of use. Interviews were used to elicit participants' comments on the system design. The quantitative data were analyzed using descriptive statistics and the qualitative data were analyzed for content. The participants were able to perform the predesigned self-management tasks with the current system design and they expressed mostly positive responses about the perceived usability measures regarding the system interface. However, the heuristics evaluation, performance measures, and interviews revealed a number of usability problems related to system navigation, information search and interpretation, information presentation, and readability. Design recommendations for further system interface modifications were discussed. This study verified the usability of the self-management system developed for older adults with chronic diseases. Also, we demonstrated that our usability evaluation approach could be used to quickly and effectively identify usability problems in a health care information system at an early stage of the system development process using a paper prototype. Conducting a usability evaluation is an essential step in system development to ensure that the system features match the users' true needs, expectations, and characteristics, and also to minimize the likelihood of the users committing user errors and having difficulties using the system.

Usability Study of a Computer-Based Self-Management System for Older Adults with Chronic Diseases

PubMed Central

Tao, Da

2012-01-01

Background Usability can influence patients’ acceptance and adoption of a health information technology. However, little research has been conducted to study the usability of a self-management health care system, especially one geared toward elderly patients. Objective This usability study evaluated a new computer-based self-management system interface for older adults with chronic diseases, using a paper prototype approach. Methods Fifty older adults with different chronic diseases participated. Two usability evaluation methods were involved: (1) a heuristics evaluation and (2) end-user testing with a think-aloud testing method, audio recording, videotaping, and interviewing. A set of usability metrics was employed to determine the overall system usability, including task incompletion rate, task completion time, frequency of error, frequency of help, satisfaction, perceived usefulness, and perceived ease of use. Interviews were used to elicit participants’ comments on the system design. The quantitative data were analyzed using descriptive statistics and the qualitative data were analyzed for content. Results The participants were able to perform the predesigned self-management tasks with the current system design and they expressed mostly positive responses about the perceived usability measures regarding the system interface. However, the heuristics evaluation, performance measures, and interviews revealed a number of usability problems related to system navigation, information search and interpretation, information presentation, and readability. Design recommendations for further system interface modifications were discussed. Conclusions This study verified the usability of the self-management system developed for older adults with chronic diseases. Also, we demonstrated that our usability evaluation approach could be used to quickly and effectively identify usability problems in a health care information system at an early stage of the system development process using a paper prototype. Conducting a usability evaluation is an essential step in system development to ensure that the system features match the users’ true needs, expectations, and characteristics, and also to minimize the likelihood of the users committing user errors and having difficulties using the system. PMID:23612015

Perceptions of Older Adults with Heart Failure on Playing an Interactive Digital e-Health Game (IDEG) for Learning About Heart Failure (HF): Prototype Development and Usability Testing.

PubMed

Radhakrishnan, Kavita; Toprac, Paul; O'Hair, Matt; Bias, Randolph; Mackert, Mike; Xie, Bo; Kim, Miyong; Bradley, Paul

2016-01-01

Effective self-management can decrease up to 50% of heart failure (HF) hospitalizations. However, self-management by patients with HF remains poor. We describe the development and usability testing of an interactive digital e-health game (IDEG) for older patients with HF in Central Texas, USA. Majority of the participants (5 out of 6) who participated in the usability testing found the game interesting, enjoyable and helpful to play. Developing an IDEG that is satisfying and acceptable to older adults with HF is feasible.

APRN Usability Testing of a Tailored Computer-Mediated Health Communication Program

PubMed Central

Lin, Carolyn A.; Neafsey, Patricia J.; Anderson, Elizabeth

2010-01-01

This study tested the usability of a touch-screen enabled “Personal Education Program” (PEP) with Advanced Practice Registered Nurses (APRN). The PEP is designed to enhance medication adherence and reduce adverse self-medication behaviors in older adults with hypertension. An iterative research process was employed, which involved the use of: (1) pre-trial focus groups to guide the design of system information architecture, (2) two different cycles of think-aloud trials to test the software interface, and (3) post-trial focus groups to gather feedback on the think-aloud studies. Results from this iterative usability testing process were utilized to systematically modify and improve the three PEP prototype versions—the pilot, Prototype-1 and Prototype-2. Findings contrasting the two separate think-aloud trials showed that APRN users rated the PEP system usability, system information and system-use satisfaction at a moderately high level between trials. In addition, errors using the interface were reduced by 76 percent and the interface time was reduced by 18.5 percent between the two trials. The usability testing processes employed in this study ensured an interface design adapted to APRNs' needs and preferences to allow them to effectively utilize the computer-mediated health-communication technology in a clinical setting. PMID:19940619

A web based tool for storing and visualising data generated within a smart home.

PubMed

McDonald, H A; Nugent, C D; Moore, G; Finlay, D D; Hallberg, J

2011-01-01

There is a growing need to re-assess the current approaches available to researchers for storing and managing heterogeneous data generated within a smart home environment. In our current work we have developed the homeML Application; a web based tool to support researchers engaged in the area of smart home research as they perform experiments. Within this paper the homeML Application is presented which includes the fundamental components of the homeML Repository and the homeML Toolkit. Results from a usability study conducted by 10 computer science researchers are presented; the initial results of which have been positive.

A Digital Framework to Support Providers and Patients in Diabetes Related Behavior Modification.

PubMed

Abidi, Samina; Vallis, Michael; Piccinini-Vallis, Helena; Imran, Syed Ali; Abidi, Syed Sibte Raza

2017-01-01

We present Diabetes Web-Centric Information and Support Environment (D-WISE) that features: (a) Decision support tool to assist family physicians to administer Behavior Modification (BM) strategies to patients; and (b) Patient BM application that offers BM strategies and motivational interventions to engage patients. We take a knowledge management approach, using semantic web technologies, to model the social cognition theory constructs, Canadian diabetes guidelines and BM protocols used locally, in terms of a BM ontology that drives the BM decision support to physicians and BM strategy adherence monitoring and messaging to patients. We present the qualitative analysis of D-WISE usability by both physicians and patients.

Measuring the Usability of Augmented Reality e-Learning Systems: A User-Centered Evaluation Approach

NASA Astrophysics Data System (ADS)

Pribeanu, Costin; Balog, Alexandru; Iordache, Dragoş Daniel

The development of Augmented Reality (AR) systems is creating new challenges and opportunities for the designers of e-learning systems. The mix of real and virtual requires appropriate interaction techniques that have to be evaluated with users in order to avoid usability problems. Formative usability aims at finding usability problems as early as possible in the development life cycle and is suitable to support the development of such novel interactive systems. This work presents an approach to the user-centered usability evaluation of an e-learning scenario for Biology developed on an Augmented Reality educational platform. The evaluation has been carried on during and after a summer school held within the ARiSE research project. The basic idea was to perform usability evaluation twice. In this respect, we conducted user testing with a small number of students during the summer school in order to get a fast feedback from users having good knowledge in Biology. Then, we repeated the user testing in different conditions and with a relatively larger number of representative users. In this paper we describe both experiments and compare the usability evaluation results.

A Guided Online and Mobile Self-Help Program for Individuals With Eating Disorders: An Iterative Engagement and Usability Study.

PubMed

Nitsch, Martina; Dimopoulos, Christina N; Flaschberger, Edith; Saffran, Kristina; Kruger, Jenna F; Garlock, Lindsay; Wilfley, Denise E; Taylor, Craig B; Jones, Megan

2016-01-11

Numerous digital health interventions have been developed for mental health promotion and intervention, including eating disorders. Efficacy of many interventions has been evaluated, yet knowledge about reasons for dropout and poor adherence is scarce. Most digital health intervention studies lack appropriate research design and methods to investigate individual engagement issues. User engagement and program usability are inextricably linked, making usability studies vital in understanding and improving engagement. The aim of this study was to explore engagement and corresponding usability issues of the Healthy Body Image Program-a guided online intervention for individuals with body image concerns or eating disorders. The secondary aim was to demonstrate the value of usability research in order to investigate engagement. We conducted an iterative usability study based on a mixed-methods approach, combining cognitive and semistructured interviews as well as questionnaires, prior to program launch. Two separate rounds of usability studies were completed, testing a total of 9 potential users. Thematic analysis and descriptive statistics were used to analyze the think-aloud tasks, interviews, and questionnaires. Participants were satisfied with the overall usability of the program. The average usability score was 77.5/100 for the first test round and improved to 83.1/100 after applying modifications for the second iteration. The analysis of the qualitative data revealed five central themes: layout, navigation, content, support, and engagement conditions. The first three themes highlight usability aspects of the program, while the latter two highlight engagement issues. An easy-to-use format, clear wording, the nature of guidance, and opportunity for interactivity were important issues related to usability. The coach support, time investment, and severity of users' symptoms, the program's features and effectiveness, trust, anonymity, and affordability were relevant to engagement. This study identified salient usability and engagement features associated with participant motivation to use the Healthy Body Image Program and ultimately helped improve the program prior to its implementation. This research demonstrates that improvements in usability and engagement can be achieved by testing and adjusting intervention design and content prior to program launch. The results are consistent with related research and reinforce the need for further research to identify usage patterns and effective means for reducing dropout. Digital health research should include usability studies prior to efficacy trials to help create more user-friendly programs that have a higher likelihood of "real-world" adoption.

Development of Web-Based Computer-Tailored Advice to Promote Physical Activity Among People Older Than 50 Years

PubMed Central

van Stralen, Maartje M; Bolman, Catherine; Golsteijn, Rianne HJ; de Vries, Hein; Mudde, Aart N; Lechner, Lilian

2012-01-01

Background The Active Plus project is a systematically developed theory- and evidence-based, computer-tailored intervention, which was found to be effective in changing physical activity behavior in people aged over 50 years. The process and effect outcomes of the first version of the Active Plus project were translated into an adapted intervention using the RE-AIM framework. The RE-AIM model is often used to evaluate the potential public health impact of an intervention and distinguishes five dimensions: reach, effectiveness, adoption, implementation, and maintenance. Objective To gain insight into the systematic translation of the first print-delivered version of the Active Plus project into an adapted (Web-based) follow-up project. The focus of this study was on the reach and effectiveness dimensions, since these dimensions are most influenced by the results from the original Active Plus project. Methods We optimized the potential reach and effect of the interventions by extending the delivery mode of the print-delivered intervention into an additional Web-based intervention. The interventions were adapted based on results of the process evaluation, analyses of effects within subgroups, and evaluation of the working mechanisms of the original intervention. We pretested the new intervention materials and the Web-based versions of the interventions. Subsequently, the new intervention conditions were implemented in a clustered randomized controlled trial. Results Adaptations resulted in four improved tailoring interventions: (1) a basic print-delivered intervention, (2) a basic Web-based intervention, (3) a print-delivered intervention with an additional environmental component, and (4) a Web-based version with an additional environmental component. Pretest results with participants showed that all new intervention materials had modest usability and relatively high appreciation, and that filling in an online questionnaire and performing the online tasks was not problematic. We used the pretest results to improve the usability of the different interventions. Implementation of the new interventions in a clustered randomized controlled trial showed that the print-delivered interventions had a higher response rate than the Web-based interventions. Participants of both low and high socioeconomic status were reached by both print-delivered and Web-based interventions. Conclusions Translation of the (process) evaluation of an effective intervention into an adapted intervention is challenging and rarely reported. We discuss several major lessons learned from our experience. Trial Registration Nederlands Trial Register (NTR): 2297; http://www.trialregister.nl/trialreg/admin/rctview.asp?TC=2297 (Archived by WebCite at http://www.webcitation.org/65TkwoESp). PMID:22390878

Development of web-based computer-tailored advice to promote physical activity among people older than 50 years.

PubMed

Peels, Denise A; van Stralen, Maartje M; Bolman, Catherine; Golsteijn, Rianne Hj; de Vries, Hein; Mudde, Aart N; Lechner, Lilian

2012-03-02

The Active Plus project is a systematically developed theory- and evidence-based, computer-tailored intervention, which was found to be effective in changing physical activity behavior in people aged over 50 years. The process and effect outcomes of the first version of the Active Plus project were translated into an adapted intervention using the RE-AIM framework. The RE-AIM model is often used to evaluate the potential public health impact of an intervention and distinguishes five dimensions: reach, effectiveness, adoption, implementation, and maintenance. To gain insight into the systematic translation of the first print-delivered version of the Active Plus project into an adapted (Web-based) follow-up project. The focus of this study was on the reach and effectiveness dimensions, since these dimensions are most influenced by the results from the original Active Plus project. We optimized the potential reach and effect of the interventions by extending the delivery mode of the print-delivered intervention into an additional Web-based intervention. The interventions were adapted based on results of the process evaluation, analyses of effects within subgroups, and evaluation of the working mechanisms of the original intervention. We pretested the new intervention materials and the Web-based versions of the interventions. Subsequently, the new intervention conditions were implemented in a clustered randomized controlled trial. Adaptations resulted in four improved tailoring interventions: (1) a basic print-delivered intervention, (2) a basic Web-based intervention, (3) a print-delivered intervention with an additional environmental component, and (4) a Web-based version with an additional environmental component. Pretest results with participants showed that all new intervention materials had modest usability and relatively high appreciation, and that filling in an online questionnaire and performing the online tasks was not problematic. We used the pretest results to improve the usability of the different interventions. Implementation of the new interventions in a clustered randomized controlled trial showed that the print-delivered interventions had a higher response rate than the Web-based interventions. Participants of both low and high socioeconomic status were reached by both print-delivered and Web-based interventions. Translation of the (process) evaluation of an effective intervention into an adapted intervention is challenging and rarely reported. We discuss several major lessons learned from our experience. Nederlands Trial Register (NTR): 2297; http://www.trialregister.nl/trialreg/admin/rctview.asp?TC=2297 (Archived by WebCite at http://www.webcitation.org/65TkwoESp).

Addressing critical issues in the development of an Oncology Information System.

PubMed

Urda, D; Ribelles, N; Subirats, J L; Franco, L; Alba, E; Jerez, J M

2013-05-01

This paper presents the experience on the design and implementation of a user-centered Oncology Information System developed for the Medical Oncology Department at the "Hospital Universitario Virgen de la Victoria", in Málaga, Spain. The project focused on the aspects considered in the literature as critical factors for a successful deployment and usage of a health information system. System usability, adequate technology, integration of clinical routines, real-time statistical analysis of data, information confidentiality and standard protocol-based external interconnection were the key aspects considered. The developed system is based on a web application with a modular and layered architecture accounting for usability, ease of maintenance and further system development. Evaluation of system usability was carried at three and fifteen months after system deployment to analyze the advantages/disadvantages experienced by the end-users. A thorough prior analysis of clinical activities and workflows, the use of the adequate technology, and the availability of data analysis tools will almost guarantee success in the deployment of an Oncology Information System. Copyright © 2012 Elsevier Ireland Ltd. All rights reserved.

Development of a Teen-Friendly Health Education Program on Facebook: Lessons Learned.

PubMed

Park, Bu Kyung; Nahm, Eun-Shim; Rogers, Valerie E

2016-01-01

Facebook is the most popular online platform among adolescents and can be an effective medium to deliver health education. Although Korean American (KA) adolescents are at risk of obesity, a culturally tailored health education program is not available for them. Thus, our research team developed a health education program for KA adolescents on Facebook called "Healthy Teens." The aim of this study was to discuss important lessons learned through the program development process. This program includes culturally tailored learning modules about healthy eating and physical activity. The program was developed on the basis of the social cognitive theory, and the online program was developed by applying Web usability principles for adolescents. Upon completion, the usability of the program was assessed using heuristic evaluation. The findings from the heuristic evaluation showed that the Healthy Teens program was usable for KA adolescents. The findings from this study will assist researchers who are planning to build similar Facebook-based health education programs. Copyright © 2016 National Association of Pediatric Nurse Practitioners. Published by Elsevier Inc. All rights reserved.

Does user-centred design affect the efficiency, usability and safety of CPOE order sets?

PubMed

Chan, Julie; Shojania, Kaveh G; Easty, Anthony C; Etchells, Edward E

2011-05-01

Application of user-centred design principles to Computerized provider order entry (CPOE) systems may improve task efficiency, usability or safety, but there is limited evaluative research of its impact on CPOE systems. We evaluated the task efficiency, usability, and safety of three order set formats: our hospital's planned CPOE order sets (CPOE Test), computer order sets based on user-centred design principles (User Centred Design), and existing pre-printed paper order sets (Paper). 27 staff physicians, residents and medical students. Sunnybrook Health Sciences Centre, an academic hospital in Toronto, Canada. Methods Participants completed four simulated order set tasks with three order set formats (two CPOE Test tasks, one User Centred Design, and one Paper). Order of presentation of order set formats and tasks was randomized. Users received individual training for the CPOE Test format only. Completion time (efficiency), requests for assistance (usability), and errors in the submitted orders (safety). 27 study participants completed 108 order sets. Mean task times were: User Centred Design format 273 s, Paper format 293 s (p=0.73 compared to UCD format), and CPOE Test format 637 s (p<0.0001 compared to UCD format). Users requested assistance in 31% of the CPOE Test format tasks, whereas no assistance was needed for the other formats (p<0.01). There were no significant differences in number of errors between formats. The User Centred Design format was more efficient and usable than the CPOE Test format even though training was provided for the latter. We conclude that application of user-centred design principles can enhance task efficiency and usability, increasing the likelihood of successful implementation.