Mobile Phone Apps for Smoking Cessation: Quality and Usability Among Smokers With Psychosis

PubMed Central

Brunette, Mary F; Geiger, Pamela; Marsch, Lisa A; Adachi-Mejia, Anna M; Bartels, Stephen J

2017-01-01

Background Smoking is one of the top preventable causes of mortality in people with psychotic disorders such as schizophrenia. Cessation treatment improves abstinence outcomes, but access is a barrier. Mobile phone apps are one way to increase access to cessation treatment; however, whether they are usable by people with psychotic disorders, who often have special learning needs, is not known. Objective Researchers reviewed 100 randomly selected apps for smoking cessation to rate them based on US guidelines for nicotine addiction treatment and to categorize them based on app functions. We aimed to test the usability and usefulness of the top-rated apps in 21 smokers with psychotic disorders. Methods We identified 766 smoking cessation apps and randomly selected 100 for review. Two independent reviewers rated each app with the Adherence Index to US Clinical Practice Guideline for Treating Tobacco Use and Dependence. Then, smokers with psychotic disorders evaluated the top 9 apps within a usability testing protocol. We analyzed quantitative results using descriptive statistics and t tests. Qualitative data were open-coded and analyzed for themes. Results Regarding adherence to practice guidelines, most of the randomly sampled smoking cessation apps scored poorly—66% rated lower than 10 out of 100 on the Adherence Index (Mean 11.47, SD 11.8). Regarding usability, three common usability problems emerged: text-dense content, abstract symbols on the homepage, and subtle directions to edit features. Conclusions In order for apps to be effective and usable for this population, developers should utilize a balance of text and simple design that facilitate ease of navigation and content comprehension that will help people learn quit smoking skills. PMID:28258047

Facilitating Secure Sharing of Personal Health Data in the Cloud

PubMed Central

Nepal, Surya; Glozier, Nick

2016-01-01

Background Internet-based applications are providing new ways of promoting health and reducing the cost of care. Although data can be kept encrypted in servers, the user does not have the ability to decide whom the data are shared with. Technically this is linked to the problem of who owns the data encryption keys required to decrypt the data. Currently, cloud service providers, rather than users, have full rights to the key. In practical terms this makes the users lose full control over their data. Trust and uptake of these applications can be increased by allowing patients to feel in control of their data, generally stored in cloud-based services. Objective This paper addresses this security challenge by providing the user a way of controlling encryption keys independently of the cloud service provider. We provide a secure and usable system that enables a patient to share health information with doctors and specialists. Methods We contribute a secure protocol for patients to share their data with doctors and others on the cloud while keeping complete ownership. We developed a simple, stereotypical health application and carried out security tests, performance tests, and usability tests with both students and doctors (N=15). Results We developed the health application as an app for Android mobile phones. We carried out the usability tests on potential participants and medical professionals. Of 20 participants, 14 (70%) either agreed or strongly agreed that they felt safer using our system. Using mixed methods, we show that participants agreed that privacy and security of health data are important and that our system addresses these issues. Conclusions We presented a security protocol that enables patients to securely share their eHealth data with doctors and nurses and developed a secure and usable system that enables patients to share mental health information with doctors. PMID:27234691

The N-CODES project moves to user testing.

PubMed

Chin, Elizabeth F; Sosa, Mary-Elizabeth; O'Neill, Eileen S

2006-01-01

For a technology to be implemented successfully, it must be thoroughly tested by the stakeholders who will use it in practice. This article reports on the user testing of the Nurse Computer Decision Support working prototype. Ten acute care nurses with varying levels of education and experience participated in the testing. The study's protocol consisted of a series of tasks requiring the participants to use the system while solving patient problems. Both quantitative and qualitative data on usability, ease of navigation, and nurse satisfaction were collected. The nurses ranked usability and ease of navigation highly. Nurses were excited about the system's clinical potential and felt that it would be useful to all practitioners regardless of experience. Testing the system in an actual clinical setting is the next step, but it is clear that the system has extraordinary potential to improve clinical decision making and patient outcomes.

Design Rationale Behind the Serious Self-Regulation Game Intervention "Balance It": Overweight Prevention Among Secondary Vocational Education Students in The Netherlands.

PubMed

Spook, Jorinde E; Paulussen, Theo; Paulissen, Rosie; Visschedijk, Gillian; Kok, Gerjo; van Empelen, Pepijn

2015-10-01

This article describes the design rationale behind a serious self-regulation game intervention. The aim of the game is to promote healthy dietary intake and physical activity among secondary vocational educational students in The Netherlands (approximately 16-20 years of age). The game "Balance It" was developed according to an intervention mapping (IM) protocol. Following IM, we specified health promotion and usability objectives and linked these objectives to selected behavior change and persuasive methods. Accordingly, these methods were translated into a coherent intervention program. The health behavior change objectives were derived from the determinants of the behavior and from Self-Regulation Theory (e.g., students are asked to set goals, monitor and evaluate their behavior, and create coping plans). Usability objectives were derived from the RE-AIM model (i.e., Reach, Effectiveness, Adoption, Implementation, and Maintenance). Next, behavior change and persuasive techniques were selected (e.g., goal setting and prompting, respectively) that did fit with the targeted change objectives and were translated in the design of a (mobile) serious self-regulation game intervention. Subsequently, three concept and usability tests were performed to improve intervention usability, and an evaluation plan was developed. The aim of this study was to provide a design rationale for game interventions targeting health-related behaviors. We developed a coherent program design in which both health behavior change and usability factors are addressed. The IM protocol can serve as a useful guide for decision making in program development and evaluation.

Protocol for Usability Testing and Validation of the ISO Draft International Standard 19223 for Lung Ventilators

PubMed Central

2017-01-01

Background Clinicians, such as respiratory therapists and physicians, are often required to set up pieces of medical equipment that use inconsistent terminology. Current lung ventilator terminology that is used by different manufacturers contributes to the risk of usage errors, and in turn the risk of ventilator-associated lung injuries and other conditions. Human factors and communication issues are often associated with ventilator-related sentinel events, and inconsistent ventilator terminology compounds these issues. This paper describes our proposed protocol, which will be implemented at the University of Waterloo, Canada when this project is externally funded. Objective We propose to determine whether a standardized vocabulary improves the ease of use, safety, and utility as it relates to the usability of medical devices, compared to legacy medical devices from multiple manufacturers, which use different terms. Methods We hypothesize that usage errors by clinicians will be lower when standardization is consistently applied by all manufacturers. The proposed study will experimentally examine the impact of standardized nomenclature on performance declines in the use of an unfamiliar ventilator product in clinically relevant scenarios. Participants will be respiratory therapy practitioners and trainees, and we propose studying approximately 60 participants. Results The work reported here is in the proposal phase. Once the protocol is implemented, we will report the results in a follow-up paper. Conclusions The proposed study will help us better understand the effects of standardization on medical device usability. The study will also help identify any terms in the International Organization for Standardization (ISO) Draft International Standard (DIS) 19223 that may be associated with recurrent errors. Amendments to the standard will be proposed if recurrent errors are identified. This report contributes a protocol that can be used to assess the effect of standardization in any given domain that involves equipment, multiple manufacturers, inconsistent vocabulary, symbology, audio tones, or patterns in interface navigation. Second, the protocol can be used to experimentally evaluate the ISO DIS 19223 for its effectiveness, as researchers around the world may wish to conduct such tests and compare results. PMID:28887292

Usability Testing of a Complex Clinical Decision Support Tool in the Emergency Department: Lessons Learned.

PubMed

Press, Anne; McCullagh, Lauren; Khan, Sundas; Schachter, Andy; Pardo, Salvatore; McGinn, Thomas

2015-09-10

As the electronic health record (EHR) becomes the preferred documentation tool across medical practices, health care organizations are pushing for clinical decision support systems (CDSS) to help bring clinical decision support (CDS) tools to the forefront of patient-physician interactions. A CDSS is integrated into the EHR and allows physicians to easily utilize CDS tools. However, often CDSS are integrated into the EHR without an initial phase of usability testing, resulting in poor adoption rates. Usability testing is important because it evaluates a CDSS by testing it on actual users. This paper outlines the usability phase of a study, which will test the impact of integration of the Wells CDSS for pulmonary embolism (PE) diagnosis into a large urban emergency department, where workflow is often chaotic and high stakes decisions are frequently made. We hypothesize that conducting usability testing prior to integration of the Wells score into an emergency room EHR will result in increased adoption rates by physicians. The objective of the study was to conduct usability testing for the integration of the Wells clinical prediction rule into a tertiary care center's emergency department EHR. We conducted usability testing of a CDS tool in the emergency department EHR. The CDS tool consisted of the Wells rule for PE in the form of a calculator and was triggered off computed tomography (CT) orders or patients' chief complaint. The study was conducted at a tertiary hospital in Queens, New York. There were seven residents that were recruited and participated in two phases of usability testing. The usability testing employed a "think aloud" method and "near-live" clinical simulation, where care providers interacted with standardized patients enacting a clinical scenario. Both phases were audiotaped, video-taped, and had screen-capture software activated for onscreen recordings. Phase I: Data from the "think-aloud" phase of the study showed an overall positive outlook on the Wells tool in assessing a patient for a PE diagnosis. Subjects described the tool as "well-organized" and "better than clinical judgment". Changes were made to improve tool placement into the EHR to make it optimal for decision-making, auto-populating boxes, and minimizing click fatigue. Phase II: After incorporating the changes noted in Phase 1, the participants noted tool improvements. There was less toggling between screens, they had all the clinical information required to complete the tool, and were able to complete the patient visit efficiently. However, an optimal location for triggering the tool remained controversial. This study successfully combined "think-aloud" protocol analysis with "near-live" clinical simulations in a usability evaluation of a CDS tool that will be implemented into the emergency room environment. Both methods proved useful in the assessment of the CDS tool and allowed us to refine tool usability and workflow.

A study of usability principles and interface design for mobile e-books.

PubMed

Wang, Chao-Ming; Huang, Ching-Hua

2015-01-01

This study examined usability principles and interface designs in order to understand the relationship between the intentions of mobile e-book interface designs and users' perceptions. First, this study summarised 4 usability principles and 16 interface attributes, in order to conduct usability testing and questionnaire survey by referring to Nielsen (1993), Norman (2002), and Yeh (2010), who proposed the usability principles. Second, this study used the interviews to explore the perceptions and behaviours of user operations through senior users of multi-touch prototype devices. The results of this study are as follows: (1) users' behaviour of operating an interactive interface is related to user prior experience; (2) users' rating of the visibility principle is related to users' subjective perception but not related to user prior experience; however, users' ratings of the ease, efficiency, and enjoyment principles are related to user prior experience; (3) the interview survey reveals that the key attributes affecting users' behaviour of operating an interface include aesthetics, achievement, and friendliness. This study conducts experiments to explore the effects of users’ prior multi-touch experience on users’ behaviour of operating a mobile e-book interface and users’ rating of usability principles. Both qualitative and quantitative data analyses were performed. By applying protocol analysis, key attributes affecting users’ behaviour of operation were determined.

Natural Language Processing-Enabled and Conventional Data Capture Methods for Input to Electronic Health Records: A Comparative Usability Study.

PubMed

Kaufman, David R; Sheehan, Barbara; Stetson, Peter; Bhatt, Ashish R; Field, Adele I; Patel, Chirag; Maisel, James Mark

2016-10-28

The process of documentation in electronic health records (EHRs) is known to be time consuming, inefficient, and cumbersome. The use of dictation coupled with manual transcription has become an increasingly common practice. In recent years, natural language processing (NLP)-enabled data capture has become a viable alternative for data entry. It enables the clinician to maintain control of the process and potentially reduce the documentation burden. The question remains how this NLP-enabled workflow will impact EHR usability and whether it can meet the structured data and other EHR requirements while enhancing the user's experience. The objective of this study is evaluate the comparative effectiveness of an NLP-enabled data capture method using dictation and data extraction from transcribed documents (NLP Entry) in terms of documentation time, documentation quality, and usability versus standard EHR keyboard-and-mouse data entry. This formative study investigated the results of using 4 combinations of NLP Entry and Standard Entry methods ("protocols") of EHR data capture. We compared a novel dictation-based protocol using MediSapien NLP (NLP-NLP) for structured data capture against a standard structured data capture protocol (Standard-Standard) as well as 2 novel hybrid protocols (NLP-Standard and Standard-NLP). The 31 participants included neurologists, cardiologists, and nephrologists. Participants generated 4 consultation or admission notes using 4 documentation protocols. We recorded the time on task, documentation quality (using the Physician Documentation Quality Instrument, PDQI-9), and usability of the documentation processes. A total of 118 notes were documented across the 3 subject areas. The NLP-NLP protocol required a median of 5.2 minutes per cardiology note, 7.3 minutes per nephrology note, and 8.5 minutes per neurology note compared with 16.9, 20.7, and 21.2 minutes, respectively, using the Standard-Standard protocol and 13.8, 21.3, and 18.7 minutes using the Standard-NLP protocol (1 of 2 hybrid methods). Using 8 out of 9 characteristics measured by the PDQI-9 instrument, the NLP-NLP protocol received a median quality score sum of 24.5; the Standard-Standard protocol received a median sum of 29; and the Standard-NLP protocol received a median sum of 29.5. The mean total score of the usability measure was 36.7 when the participants used the NLP-NLP protocol compared with 30.3 when they used the Standard-Standard protocol. In this study, the feasibility of an approach to EHR data capture involving the application of NLP to transcribed dictation was demonstrated. This novel dictation-based approach has the potential to reduce the time required for documentation and improve usability while maintaining documentation quality. Future research will evaluate the NLP-based EHR data capture approach in a clinical setting. It is reasonable to assert that EHRs will increasingly use NLP-enabled data entry tools such as MediSapien NLP because they hold promise for enhancing the documentation process and end-user experience. ©David R. Kaufman, Barbara Sheehan, Peter Stetson, Ashish R. Bhatt, Adele I. Field, Chirag Patel, James Mark Maisel. Originally published in JMIR Medical Informatics (http://medinform.jmir.org), 28.10.2016.

Usability Evaluation Methods for Gesture-Based Games: A Systematic Review.

PubMed

Simor, Fernando Winckler; Brum, Manoela Rogofski; Schmidt, Jaison Dairon Ebertz; Rieder, Rafael; De Marchi, Ana Carolina Bertoletti

2016-10-04

Gestural interaction systems are increasingly being used, mainly in games, expanding the idea of entertainment and providing experiences with the purpose of promoting better physical and/or mental health. Therefore, it is necessary to establish mechanisms for evaluating the usability of these interfaces, which make gestures the basis of interaction, to achieve a balance between functionality and ease of use. This study aims to present the results of a systematic review focused on usability evaluation methods for gesture-based games, considering devices with motion-sensing capability. We considered the usability methods used, the common interface issues, and the strategies adopted to build good gesture-based games. The research was centered on four electronic databases: IEEE, Association for Computing Machinery (ACM), Springer, and Science Direct from September 4 to 21, 2015. Within 1427 studies evaluated, 10 matched the eligibility criteria. As a requirement, we considered studies about gesture-based games, Kinect and/or Wii as devices, and the use of a usability method to evaluate the user interface. In the 10 studies found, there was no standardization in the methods because they considered diverse analysis variables. Heterogeneously, authors used different instruments to evaluate gesture-based interfaces and no default approach was proposed. Questionnaires were the most used instruments (70%, 7/10), followed by interviews (30%, 3/10), and observation and video recording (20%, 2/10). Moreover, 60% (6/10) of the studies used gesture-based serious games to evaluate the performance of elderly participants in rehabilitation tasks. This highlights the need for creating an evaluation protocol for older adults to provide a user-friendly interface according to the user's age and limitations. Through this study, we conclude this field is in need of a usability evaluation method for serious games, especially games for older adults, and that the definition of a methodology and a test protocol may offer the user more comfort, welfare, and confidence.

Usability Evaluation Methods for Gesture-Based Games: A Systematic Review

PubMed Central

Simor, Fernando Winckler; Brum, Manoela Rogofski; Schmidt, Jaison Dairon Ebertz; De Marchi, Ana Carolina Bertoletti

2016-01-01

Background Gestural interaction systems are increasingly being used, mainly in games, expanding the idea of entertainment and providing experiences with the purpose of promoting better physical and/or mental health. Therefore, it is necessary to establish mechanisms for evaluating the usability of these interfaces, which make gestures the basis of interaction, to achieve a balance between functionality and ease of use. Objective This study aims to present the results of a systematic review focused on usability evaluation methods for gesture-based games, considering devices with motion-sensing capability. We considered the usability methods used, the common interface issues, and the strategies adopted to build good gesture-based games. Methods The research was centered on four electronic databases: IEEE, Association for Computing Machinery (ACM), Springer, and Science Direct from September 4 to 21, 2015. Within 1427 studies evaluated, 10 matched the eligibility criteria. As a requirement, we considered studies about gesture-based games, Kinect and/or Wii as devices, and the use of a usability method to evaluate the user interface. Results In the 10 studies found, there was no standardization in the methods because they considered diverse analysis variables. Heterogeneously, authors used different instruments to evaluate gesture-based interfaces and no default approach was proposed. Questionnaires were the most used instruments (70%, 7/10), followed by interviews (30%, 3/10), and observation and video recording (20%, 2/10). Moreover, 60% (6/10) of the studies used gesture-based serious games to evaluate the performance of elderly participants in rehabilitation tasks. This highlights the need for creating an evaluation protocol for older adults to provide a user-friendly interface according to the user’s age and limitations. Conclusions Through this study, we conclude this field is in need of a usability evaluation method for serious games, especially games for older adults, and that the definition of a methodology and a test protocol may offer the user more comfort, welfare, and confidence. PMID:27702737

Prevention and treatment of hand oedema after stroke.

PubMed

Kuppens, Stefanie P M; Pijlman, Hanneke C P; Hitters, Minou W M G C; van Heugten, Caroline M

2014-01-01

As there is no evidence for a specific treatment for post-stroke-induced hand oedema, rehabilitation centre Blixembosch formalized a best practice protocol. We investigated whether the Blixembosch hand oedema protocol is usable in daily practice and leads to lower incidence (prevention) and shorter duration (treatment) compared with care as usual. In a non-randomised comparative trial, we investigated 206 post-stroke patients admitted to two Dutch rehabilitation centres. Hand volumes were measured at least bi-weekly using a volumeter. Treatment was started according the protocol (Blixembosch) or following care as usual (Leijpark). Usability was assessed with a survey among professionals. In the Blixembosch group, 16% developed oedema after admission, compared with 21% in the control group (p = 0.019). Average duration of oedema (both developed before and after admission) was 6.5 weeks in the Blixembosch group compared with 3.1 weeks in the control group (p = 0.000). Professionals were positive about the protocol. The study showed that the protocol is usable in daily practice and has a small beneficial effect on hand oedema incidence rates compared with care as usual. The negative effect on duration of hand oedema could also be caused by the difference in prognosis between the two groups.

Development of a digital clinical pathway for emergency medicine: Lessons from usability testing and implementation failure.

PubMed

Gutenstein, Marc; Pickering, John W; Than, Martin

2018-06-01

Clinical pathways are used to support the management of patients in emergency departments. An existing document-based clinical pathway was used as the foundation on which to design and build a digital clinical pathway for acute chest pain, with the aim of improving clinical calculations, clinician decision-making, documentation, and data collection. Established principles of decision support system design were used to build an application within the existing electronic health record, before testing with a multidisciplinary team of doctors using a think-aloud protocol. Technical authoring was successful, however, usability testing revealed that the user experience and the flexibility of workflow within the application were critical barriers to implementation. Emergency medicine and acute care decision support systems face particular challenges to existing models of linear workflow that should be deliberately addressed in digital pathway design. We make key recommendations regarding digital pathway design in emergency medicine.

Natural Language Processing–Enabled and Conventional Data Capture Methods for Input to Electronic Health Records: A Comparative Usability Study

PubMed Central

Sheehan, Barbara; Stetson, Peter; Bhatt, Ashish R; Field, Adele I; Patel, Chirag; Maisel, James Mark

2016-01-01

Background The process of documentation in electronic health records (EHRs) is known to be time consuming, inefficient, and cumbersome. The use of dictation coupled with manual transcription has become an increasingly common practice. In recent years, natural language processing (NLP)–enabled data capture has become a viable alternative for data entry. It enables the clinician to maintain control of the process and potentially reduce the documentation burden. The question remains how this NLP-enabled workflow will impact EHR usability and whether it can meet the structured data and other EHR requirements while enhancing the user’s experience. Objective The objective of this study is evaluate the comparative effectiveness of an NLP-enabled data capture method using dictation and data extraction from transcribed documents (NLP Entry) in terms of documentation time, documentation quality, and usability versus standard EHR keyboard-and-mouse data entry. Methods This formative study investigated the results of using 4 combinations of NLP Entry and Standard Entry methods (“protocols”) of EHR data capture. We compared a novel dictation-based protocol using MediSapien NLP (NLP-NLP) for structured data capture against a standard structured data capture protocol (Standard-Standard) as well as 2 novel hybrid protocols (NLP-Standard and Standard-NLP). The 31 participants included neurologists, cardiologists, and nephrologists. Participants generated 4 consultation or admission notes using 4 documentation protocols. We recorded the time on task, documentation quality (using the Physician Documentation Quality Instrument, PDQI-9), and usability of the documentation processes. Results A total of 118 notes were documented across the 3 subject areas. The NLP-NLP protocol required a median of 5.2 minutes per cardiology note, 7.3 minutes per nephrology note, and 8.5 minutes per neurology note compared with 16.9, 20.7, and 21.2 minutes, respectively, using the Standard-Standard protocol and 13.8, 21.3, and 18.7 minutes using the Standard-NLP protocol (1 of 2 hybrid methods). Using 8 out of 9 characteristics measured by the PDQI-9 instrument, the NLP-NLP protocol received a median quality score sum of 24.5; the Standard-Standard protocol received a median sum of 29; and the Standard-NLP protocol received a median sum of 29.5. The mean total score of the usability measure was 36.7 when the participants used the NLP-NLP protocol compared with 30.3 when they used the Standard-Standard protocol. Conclusions In this study, the feasibility of an approach to EHR data capture involving the application of NLP to transcribed dictation was demonstrated. This novel dictation-based approach has the potential to reduce the time required for documentation and improve usability while maintaining documentation quality. Future research will evaluate the NLP-based EHR data capture approach in a clinical setting. It is reasonable to assert that EHRs will increasingly use NLP-enabled data entry tools such as MediSapien NLP because they hold promise for enhancing the documentation process and end-user experience. PMID:27793791

Managing symptoms during cancer treatments: evaluating the implementation of evidence-informed remote support protocols

PubMed Central

2012-01-01

Background Management of cancer treatment-related symptoms is an important safety issue given that symptoms can become life-threatening and often occur when patients are at home. With funding from the Canadian Partnership Against Cancer, a pan-Canadian steering committee was established with representation from eight provinces to develop symptom protocols using a rigorous methodology (CAN-IMPLEMENT©). Each protocol is based on a systematic review of the literature to identify relevant clinical practice guidelines. Protocols were validated by cancer nurses from across Canada. The aim of this study is to build an effective and sustainable approach for implementing evidence-informed protocols for nurses to use when providing remote symptom assessment, triage, and guidance in self-management for patients experiencing symptoms while undergoing cancer treatments. Methods A prospective mixed-methods study design will be used. Guided by the Knowledge to Action Framework, the study will involve (a) establishing an advisory knowledge user team in each of three targeted settings; (b) assessing factors influencing nurses’ use of protocols using interviews/focus groups and a standardized survey instrument; (c) adapting protocols for local use, ensuring fidelity of the content; (d) selecting intervention strategies to overcome known barriers and implementing the protocols; (e) conducting think-aloud usability testing; (f) evaluating protocol use and outcomes by conducting an audit of 100 randomly selected charts at each of the three settings; and (g) assessing satisfaction with remote support using symptom protocols and change in nurses’ barriers to use using survey instruments. The primary outcome is sustained use of the protocols, defined as use in 75% of the calls. Descriptive analysis will be conducted for the barriers, use of protocols, and chart audit outcomes. Content analysis will be conducted on interviews/focus groups and usability testing with comparisons across settings. Discussion Given the importance of patient safety, patient-centered care, and delivery of quality services, learning how to effectively implement evidence-informed symptom protocols in oncology healthcare services is essential for ensuring safe, consistent, and effective care for individuals with cancer. This study is likely to have a significant contribution to the delivery of remote oncology services, as well as influence symptom management by patients at home. PMID:23164244

Eucapnic voluntary hyperventilation in diagnosing exercise-induced laryngeal obstructions.

PubMed

Christensen, Pernille M; Rasmussen, Niels

2013-11-01

Exercise-induced laryngeal obstructions (EILOs) cause exercise-related respiratory symptoms (ERRS) and are important differential diagnoses to exercise-induced asthma. The diagnostic method for EILOs includes provocation to induce the obstruction followed by a verification of the obstruction and the degree thereof. The objective of the present study was to examine if a eucapnic voluntary hyperventilation (EVH) test could induce laryngeal obstructions laryngoscopically identical in subtypes and development as seen during an exercise test. EVH and exercise testing with continuous laryngoscopy were performed during a screening of two national athletic teams (n = 67). The laryngoscopic recordings were examined for usability, abnormalities and maximal supraglottic and glottic obstruction using two currently available methods (Eilomea and CLE-score). The participants were asked questions on ERRS, and whether the symptoms experienced during each provocation matched those experienced during regular training. A total of 39 completed both tests. There were no significant differences in subtypes and development thereof, the experience of symptoms, and specificity and sensitivity between the methods. Significantly more recordings obtained during the exercise test were usable for evaluation primarily due to resilient mucus on the tip of the fiber-laryngoscope in the EVH test. Only recordings of six athletes from both provocation methods were usable for evaluation using the Eilomea method (high-quality demand). Amongst these, a linear correlation was found for the glottic obstruction. EVH tests can induce EILOs. However, the present test protocol needs adjustments to secure better visualisation of the larynx during provocation.

Usability evaluation of the SMART application for youth with mTBI.

PubMed

Dexheimer, Judith W; Kurowski, Brad G; Anders, Shilo H; McClanahan, Nicole; Wade, Shari L; Babcock, Lynn

2017-01-01

There is a dearth of evidence-based treatments available to address the significant morbidity associated with mild traumatic brain injury (mTBI). To address this gap, we designed a novel user-friendly, web-based application. We describe the preliminary evaluation of feasibility and usability of the application to promote recovery following mTBI in youth, the Self-Monitoring Activity-Restriction and Relaxation Treatment (SMART). SMART incorporates real-time recommendations for individualized symptom management and activity restriction along with training in cognitive-behavioral coping strategies. We conducted a usability evaluation to assess and modify the SMART system prior to further study and deployment. Children ages 11-18 years presenting to the emergency department were recruited after symptoms resolved. Usability was assessed using a 60-min think-aloud protocol of teens and parents describing their interaction with the application. Upon completion of the tasks, each participant also completed the system usability scale (SUS). We performed tests with 4 parent/child dyads. The average age of the children was 13 years (standard deviation=1.8). The parents were an average of 41.5 years old (standard deviation=6.2). Research revealed that the participants were enthusiastic about the interactive portions of the tool particularly the video based sessions. Parents were concerned about the speed at which their child might move through the program and the children thought that the system required large amounts of reading. Based on user feedback, researchers modified SMART to include an audio file in every module and improved the system's aesthetic properties. The mean SUS score was 85, with high SUS scores (>68) indicating satisfactory usability. High initial usability and favorable user feedback provide a foundation for further iterative development and testing of the SMART application as a tool for managing recovery from concussion. Copyright © 2016 Elsevier Ireland Ltd. All rights reserved.

A Pilot Study Using Mixed GPS/Narrative Interview Methods to Understand Geospatial Behavior in Homeless Populations.

PubMed

North, Carol S; Wohlford, Sarah E; Dean, Denis J; Black, Melissa; Balfour, Margaret E; Petrovich, James C; Downs, Dana L; Pollio, David E

2017-08-01

Tracking the movements of homeless populations presents methodological difficulties, but understanding their movements in space and time is needed to inform optimal placement of services. This pilot study developed, tested, and refined methods to apply global positioning systems (GPS) technology paired with individual narratives to chronicle the movements of homeless populations. Detail of methods development and difficulties encountered and addressed, and geospatial findings are provided. A pilot sample of 29 adults was recruited from a low-demand homeless shelter in the downtown area of Fort Worth, Texas. Pre- and post-deployment interviews provided participant characteristics and planned and retrospectively-reported travels. Only one of the first eight deployments returned with sufficient usable data. Ultimately 19 participants returned the GPS device with >20 h of usable data. Protocol adjustments addressing methodological difficulties achieved 81 % of subsequent participants returning with sufficient usable data. This study established methods and demonstrated feasibility for tracking homeless population travels.

Comparing usability testing outcomes and functions of six electronic nursing record systems.

PubMed

Cho, Insook; Kim, Eunman; Choi, Woan Heui; Staggers, Nancy

2016-04-01

This study examined the usability of six differing electronic nursing record (ENR) systems on the efficiency, proficiency and available functions for documenting nursing care and subsequently compared the results to nurses' perceived satisfaction from a previous study. The six hospitals had different ENR systems, all with narrative nursing notes in use for more than three years. Stratified by type of nursing unit, 54 staff nurses were digitally recorded during on-site usability testing by employing validated patient care scenarios and think-aloud protocols. The time to complete specific tasks was also measured. Qualitative performance data were converted into scores on efficiency (relevancy), proficiency (accuracy), and a competency index using scoring schemes described by McGuire and Babbott. Six nurse managers and the researchers completed assessments of available ENR functions and examined computerized nursing process components including the linkages among them. For the usability test, participants' mean efficiency score was 94.2% (95% CI, 91.4-96.9%). The mean proficiency was 60.6% (95% CI, 54.3-66.8%), and the mean competency index was 59.5% (95% CI, 52.9-66.0). Efficiency scores were significantly different across ENRs as was the time to complete tasks, ranging from 226.3 to 457.2s (χ(2)=12.3, P=0.031; χ(2)=11.2, P=0.048). No significant differences were seen for proficiency scores. The coverage of the various ENRs' nursing process ranged from 67% to 100%, but only two systems had complete integration of nursing components. Two systems with high efficiency and proficiency scores had much lower usability test scores and perceived user satisfaction along with more complex navigation patterns. In terms of system usability and functions, different levels of sophistication of and interaction performance with ENR systems exist in practice. This suggests that ENRs may have variable impacts on clinical outcomes and care quality. Future studies are needed to explore ENR impact on nursing care quality, efficiency, and safety. Copyright © 2016 Elsevier Ireland Ltd. All rights reserved.

Mobile PHRs compliance with Android and iOS usability guidelines.

PubMed

Cruz Zapata, Belén; Hernández Niñirola, Antonio; Idri, Ali; Fernández-Alemán, José Luis; Toval, Ambrosio

2014-08-01

Mobile Personal Health Records (PHRs) have achieved a particularly strong market share since the appearance of more powerful mobile devices and popular worldwide mobile application markets such as Apple's App Store and Android's Google Play. However, Android and Apple have a set of recommendations on design and usability targeted towards developers who wish to publish apps in their stores: Android Design Guidelines and iOS Human Interface Guidelines. This paper aims to evaluate compliance with these guidelines by assessing the usability recommendations of a set of 24 selected mobile PHR applications. An analysis process based on a well-known Systematic Literature Review (SLR) protocol was used. The results show that the 24 mobile PHR applications studied are not suitably structured. 46 % of these applications do not use any of the recommended patterns, using instead lists or springboards, which are deprecated patterns for top-level menus. 70 % of the PHRs require a registration to be able to test the application when these interactions should be delayed. Our study will help both PHR users to select user-friendly mobile PHRs and PHR providers and developers to identify the good usability practices implemented by the applications with the highest scores.

Design of a Channel Error Simulator using Virtual Instrument Techniques for the Initial Testing of TCP/IP and SCPS Protocols

NASA Technical Reports Server (NTRS)

Horan, Stephen; Wang, Ru-Hai

1999-01-01

There exists a need for designers and developers to have a method to conveniently test a variety of communications parameters for an overall system design. This is no different when testing network protocols as when testing modulation formats. In this report, we discuss a means of providing a networking test device specifically designed to be used for space communications. This test device is a PC-based Virtual Instrument (VI) programmed using the LabVIEW(TM) version 5 software suite developed by National Instruments(TM)TM. This instrument was designed to be portable and usable by others without special, additional equipment. The programming was designed to replicate a VME-based hardware module developed earlier at New Mexico State University (NMSU) and to provide expanded capabilities exceeding the baseline configuration existing in that module. This report describes the design goals for the VI module in the next section and follows that with a description of the design of the VI instrument. This is followed with a description of the validation tests run on the VI. An application of the error-generating VI to networking protocols is then given.

Usability and Instructional Design Heuristics for E-Learning Evaluation.

ERIC Educational Resources Information Center

Reeves, Thomas C.; Benson, Lisa; Elliott, Dean; Grant, Michael; Holschuh, Doug; Kim, Beaumie; Kim, Hyeonjin; Lauber, Erick; Loh, Sebastian

Heuristic evaluation is a methodology for investigating the usability of software originally developed by Nielsen (1993, 2000). Nielsen's protocol was modified and refined for evaluating e-learning programs by participants in a doctoral seminar held at the University of Georgia in 2001. The modifications primarily involved expanding Nielsen's…

Is the test of senior friendly/child resistant packaging ethical?

PubMed

Bix, Laura; de la Fuente, Javier; Pimple, Kenneth D; Kou, Eric

2009-12-01

Research has documented the drastic reduction of unintentional poisonings of children since the introduction of child resistant (CR) packaging. However, studies also indicate that consumers report difficulty using CR packages, in part because tests which determine the 'senior friendliness' of CR designs that are used throughout the world disallow people with 'overt or obvious' disabilities from being test subjects. Our review of drug package usability suggests that the current tests of CR packaging can and should be revised to correct this problem. We use US legislation, regulation and data to exemplify these points, but the conclusions are applicable to all protocols that include the exclusionary provision.

Development of a Prototype Continuity of Care Record with Context-Specific Links to Meet the Information Needs of Case Managers for Persons Living with HIV

PubMed Central

Cimino, James J.; Bakken, Suzanne

2012-01-01

Objectives (1) To develop a prototype Continuity of Care Record (CCR) with context-specific links to electronic HIV information resources; and (2) to assess case managers’ perceptions regarding the usability of the prototype. Methods We integrated context-specific links to HIV case management information resources into a prototype CCR using the Infobutton Manager and Librarian Infobutton Tailoring Environment (LITE). Case managers (N=9) completed a think-aloud protocol and the Computer System Usability Questionnaire (CSUQ) to evaluate the usability of the prototype. Verbalizations from the think-aloud protocol were summarized using thematic analysis. CSUQ data were analyzed with descriptive statistics. Results Although participants expressed positive comments regarding the usability of the prototype, the think-aloud protocol also identified the need for improvement in resource labels and for additional resources. On a scale ranging from 1 (strongly agree) to 7 (strongly disagree), the average CSUQ overall satisfaction was 2.25 indicating that users (n=9) were generally satisfied with the system. Mean CSUQ factor scores were: System Usefulness (M=2.13), Information Quality (M=2.46), and Interface Quality (M=2.26). Conclusion Our novel application of the Infobutton Manager and LITE in the context of case management for persons living with HIV in community-based settings resulted in a prototype CCR with infobuttons that met the majority of case managers’ information needs and received relatively positive usability ratings. Findings from this study inform future integration of context-specific links into CCRs and electronic health records and support their use for meeting end-users information needs. PMID:22632821

A Mobile App (BEDSide Mobility) to Support Nurses’ Tasks at the Patient's Bedside: Usability Study

PubMed Central

Weinhold, Thomas; Joe, Jonathan; Lovis, Christian; Blondon, Katherine

2018-01-01

Background The introduction of clinical information systems has increased the amount of clinical documentation. Although this documentation generally improves patient safety, it has become a time-consuming task for nurses, which limits their time with the patient. On the basis of a user-centered methodology, we have developed a mobile app named BEDSide Mobility to support nurses in their daily workflow and to facilitate documentation at the bedside. Objective The aim of the study was to assess the usability of the BEDSide Mobility app in terms of the navigation and interaction design through usability testing. Methods Nurses were asked to complete a scenario reflecting their daily work with patients. Their interactions with the app were captured with eye-tracking glasses and by using the think aloud protocol. After completing the tasks, participants filled out the system usability scale questionnaire. Descriptive statistics were used to summarize task completion rates and the users’ performance. Results A total of 10 nurses (aged 21-50) participated in the study. Overall, they were satisfied with the navigation, layout, and interaction design of the app, with the exception of one user who was unfamiliar with smartphones. The problems identified were related to the ambiguity of some icons, the navigation logic, and design inconsistency. Conclusions Besides the usability issues identified in the app, the participants’ results do indicate good usability, high acceptance, and high satisfaction with the developed app. However, the results must be taken with caution because of the poor ecological validity of the experimental setting. PMID:29563074

Performance of Charcoal Cookstoves for Haiti Part 1: Results from the Water Boiling Test

DOE Office of Scientific and Technical Information (OSTI.GOV)

Booker, Kayje; Han, Tae Won; Granderson, Jessica

2011-06-01

In April 2010, a team of scientists and engineers from Lawrence Berkeley National Lab (LBNL) and UC Berkeley, with support from the Darfur Stoves Project (DSP), undertook a fact-finding mission to Haiti in order to assess needs and opportunities for cookstove intervention. Based on data collected from informal interviews with Haitians and NGOs, the team, Scott Sadlon, Robert Cheng, and Kayje Booker, identified and recommended stove testing and comparison as a high priority need that could be filled by LBNL. In response to that recommendation, five charcoal stoves were tested at the LBNL stove testing facility using a modified formmore » of version 3 of the Shell Foundation Household Energy Project Water Boiling Test (WBT). The original protocol is available online. Stoves were tested for time to boil, thermal efficiency, specific fuel consumption, and emissions of CO, CO{sub 2}, and the ratio of CO/CO{sub 2}. In addition, Haitian user feedback and field observations over a subset of the stoves were combined with the experiences of the laboratory testing technicians to evaluate the usability of the stoves and their appropriateness for Haitian cooking. The laboratory results from emissions and efficiency testing and conclusions regarding usability of the stoves are presented in this report.« less

VoIP for Telerehabilitation: A Pilot Usability Study for HIPAA Compliance

PubMed Central

Watzlaf, Valerie R.; Ondich, Briana

2012-01-01

Consumer-based, free Voice and video over the Internet Protocol (VoIP) software systems such as Skype and others are used by health care providers to deliver telerehabilitation and other health-related services to clients. Privacy and security applications as well as HIPAA compliance within these protocols have been questioned by practitioners, health information managers, and other healthcare entities. This pilot usability study examined whether four respondents who used the top three, free consumer-based, VoIP software systems perceived these VoIP technologies to be private, secure, and HIPAA compliant; most did not. While the pilot study limitations include the number of respondents and systems assessed, the protocol can be applied to future research and replicated for instructional purposes. Recommendations are provided for VoIP companies, providers, and clients/consumers. PMID:25945194

The Deployment of IPv6 in an IPv4 World and Transition Strategies.

ERIC Educational Resources Information Center

Bouras, C.; Ganos, P.; Karaliotas, A.

2003-01-01

The current version of the IP protocol, IPv4, is the most widely used protocol in computer networks. This article describes mechanisms that can be used to facilitate the transition to the new version of the IP protocol, IPv6, and examines usability, usefulness and manageability. Describes how some of these mechanisms were applied to the Greek…

Is the test of senior friendly/child resistant packaging ethical?

PubMed Central

Bix, Laura; De La Fuente, Javier; Pimple, Kenneth D.; Kou, Eric

2009-01-01

Abstract Research has documented the drastic reduction of unintentional poisonings of children since the introduction of child resistant (CR) packaging. However, studies also indicate that consumers report difficulty using CR packages, in part because tests which determine the ‘senior friendliness’ of CR designs that are used throughout the world disallow people with ‘overt or obvious’ disabilities from being test subjects. Our review of drug package usability suggests that the current tests of CR packaging can and should be revised to correct this problem. We use US legislation, regulation and data to exemplify these points, but the conclusions are applicable to all protocols that include the exclusionary provision. PMID:19650857

A Mobile App (BEDSide Mobility) to Support Nurses' Tasks at the Patient's Bedside: Usability Study.

PubMed

Ehrler, Frederic; Weinhold, Thomas; Joe, Jonathan; Lovis, Christian; Blondon, Katherine

2018-03-21

The introduction of clinical information systems has increased the amount of clinical documentation. Although this documentation generally improves patient safety, it has become a time-consuming task for nurses, which limits their time with the patient. On the basis of a user-centered methodology, we have developed a mobile app named BEDSide Mobility to support nurses in their daily workflow and to facilitate documentation at the bedside. The aim of the study was to assess the usability of the BEDSide Mobility app in terms of the navigation and interaction design through usability testing. Nurses were asked to complete a scenario reflecting their daily work with patients. Their interactions with the app were captured with eye-tracking glasses and by using the think aloud protocol. After completing the tasks, participants filled out the system usability scale questionnaire. Descriptive statistics were used to summarize task completion rates and the users' performance. A total of 10 nurses (aged 21-50) participated in the study. Overall, they were satisfied with the navigation, layout, and interaction design of the app, with the exception of one user who was unfamiliar with smartphones. The problems identified were related to the ambiguity of some icons, the navigation logic, and design inconsistency. Besides the usability issues identified in the app, the participants' results do indicate good usability, high acceptance, and high satisfaction with the developed app. However, the results must be taken with caution because of the poor ecological validity of the experimental setting. ©Frederic Ehrler, Thomas Weinhold, Jonathan Joe, Christian Lovis, Katherine Blondon. Originally published in JMIR Mhealth and Uhealth (http://mhealth.jmir.org), 21.03.2018.

Ten factors to consider when developing usability scenarios and tasks for health information technology.

PubMed

Russ, Alissa L; Saleem, Jason J

2018-02-01

The quality of usability testing is highly dependent upon the associated usability scenarios. To promote usability testing as part of electronic health record (EHR) certification, the Office of the National Coordinator (ONC) for Health Information Technology requires that vendors test specific capabilities of EHRs with clinical end-users and report their usability testing process - including the test scenarios used - along with the results. The ONC outlines basic expectations for usability testing, but there is little guidance in usability texts or scientific literature on how to develop usability scenarios for healthcare applications. The objective of this article is to outline key factors to consider when developing usability scenarios and tasks to evaluate computer-interface based health information technologies. To achieve this goal, we draw upon a decade of our experience conducting usability tests with a variety of healthcare applications and a wide range of end-users, to include healthcare professionals as well as patients. We discuss 10 key factors that influence scenario development: objectives of usability testing; roles of end-user(s); target performance goals; evaluation time constraints; clinical focus; fidelity; scenario-related bias and confounders; embedded probes; minimize risks to end-users; and healthcare related outcome measures. For each factor, we present an illustrative example. This article is intended to aid usability researchers and practitioners in their efforts to advance health information technologies. The article provides broad guidance on usability scenario development and can be applied to a wide range of clinical information systems and applications. Published by Elsevier Inc.

A Comparison of What Is Part of Usability Testing in Three Countries

NASA Astrophysics Data System (ADS)

Clemmensen, Torkil

The cultural diversity of users of technology challenges our methods for usability evaluation. In this paper we report and compare three ethnographic interview studies of what is a part of a standard (typical) usability test in a company in Mumbai, Beijing and Copenhagen. At each of these three locations, we use structural and contrast questions do a taxonomic and paradigm analysis of a how a company performs a usability test. We find similar parts across the three locations. We also find different results for each location. In Mumbai, most parts of the usability test are not related to the interactive application that is tested, but to differences in user characteristics, test preparation, method, and location. In Copenhagen, considerations about the client's needs are part of a usability test. In Beijing, the only varying factor is the communication pattern and relation to the user. These results are then contrasted in a cross cultural matrix to identify cultural themes that can help interpret results from existing laboratory research in usability test methods.

Integration of MSFC Usability Lab with Usability Testing

NASA Technical Reports Server (NTRS)

Cheng, Yiwei; Richardson, Sally

2010-01-01

As part of the Stage Analysis Branch, human factors engineering plays an important role in relating humans to the systems of hardware and structure designs of the new launch vehicle. While many branches are involved in the technical aspects of creating a launch vehicle, human factors connects humans to the scientific systems with the goal of improving operational performance and safety while reducing operational error and damage to the hardware. Human factors engineers use physical and computerized models to visualize possible areas for improvements to ensure human accessibility to components requiring maintenance and that the necessary maintenance activities can be accomplished with minimal risks to human and hardware. Many methods of testing are used to fulfill this goal, such as physical mockups, computerized visualization, and usability testing. In this analysis, a usability test is conducted to test how usable a website is to users who are and are not familiar with it. The testing is performed using participants and Morae software to record and analyze the results. This analysis will be a preliminary test of the usability lab in preparation for use in new spacecraft programs, NASA Enterprise, or other NASA websites. The usability lab project is divided into two parts: integration of the usability lab and a preliminary test of the usability lab.

A Formative Evaluation of CU-SeeMe.

DTIC Science & Technology

1995-02-01

CU- SeeMe is a video conferencing software package that was designed and programmed at Cornell University. The program works with the TCP/IP network...protocol and allows two or more parties to conduct a real-time video conference with full audio support. In this paper we evaluate CU- SeeMe through...caused the problem and why This helps in the process of formulating solutions for observed usability problems. All the testing results are combined in the Appendix in an illustrated partial redesign of the CU- SeeMe Interface.

Usability Methods for Ensuring Health Information Technology Safety: Evidence-Based Approaches. Contribution of the IMIA Working Group Health Informatics for Patient Safety.

PubMed

Borycki, E; Kushniruk, A; Nohr, C; Takeda, H; Kuwata, S; Carvalho, C; Bainbridge, M; Kannry, J

2013-01-01

Issues related to lack of system usability and potential safety hazards continue to be reported in the health information technology (HIT) literature. Usability engineering methods are increasingly used to ensure improved system usability and they are also beginning to be applied more widely for ensuring the safety of HIT applications. These methods are being used in the design and implementation of many HIT systems. In this paper we describe evidence-based approaches to applying usability engineering methods. A multi-phased approach to ensuring system usability and safety in healthcare is described. Usability inspection methods are first described including the development of evidence-based safety heuristics for HIT. Laboratory-based usability testing is then conducted under artificial conditions to test if a system has any base level usability problems that need to be corrected. Usability problems that are detected are corrected and then a new phase is initiated where the system is tested under more realistic conditions using clinical simulations. This phase may involve testing the system with simulated patients. Finally, an additional phase may be conducted, involving a naturalistic study of system use under real-world clinical conditions. The methods described have been employed in the analysis of the usability and safety of a wide range of HIT applications, including electronic health record systems, decision support systems and consumer health applications. It has been found that at least usability inspection and usability testing should be applied prior to the widespread release of HIT. However, wherever possible, additional layers of testing involving clinical simulations and a naturalistic evaluation will likely detect usability and safety issues that may not otherwise be detected prior to widespread system release. The framework presented in the paper can be applied in order to develop more usable and safer HIT, based on multiple layers of evidence.

Using a fuzzy comprehensive evaluation method to determine product usability: A test case

PubMed Central

Zhou, Ronggang; Chan, Alan H. S.

2016-01-01

BACKGROUND: In order to take into account the inherent uncertainties during product usability evaluation, Zhou and Chan [1] proposed a comprehensive method of usability evaluation for products by combining the analytic hierarchy process (AHP) and fuzzy evaluation methods for synthesizing performance data and subjective response data. This method was designed to provide an integrated framework combining the inevitable vague judgments from the multiple stages of the product evaluation process. OBJECTIVE AND METHODS: In order to illustrate the effectiveness of the model, this study used a summative usability test case to assess the application and strength of the general fuzzy usability framework. To test the proposed fuzzy usability evaluation framework [1], a standard summative usability test was conducted to benchmark the overall usability of a specific network management software. Based on the test data, the fuzzy method was applied to incorporate both the usability scores and uncertainties involved in the multiple components of the evaluation. Then, with Monte Carlo simulation procedures, confidence intervals were used to compare the reliabilities among the fuzzy approach and two typical conventional methods combining metrics based on percentages. RESULTS AND CONCLUSIONS: This case study showed that the fuzzy evaluation technique can be applied successfully for combining summative usability testing data to achieve an overall usability quality for the network software evaluated. Greater differences of confidence interval widths between the method of averaging equally percentage and weighted evaluation method, including the method of weighted percentage averages, verified the strength of the fuzzy method. PMID:28035942

Using a fuzzy comprehensive evaluation method to determine product usability: A test case.

PubMed

Zhou, Ronggang; Chan, Alan H S

2017-01-01

In order to take into account the inherent uncertainties during product usability evaluation, Zhou and Chan [1] proposed a comprehensive method of usability evaluation for products by combining the analytic hierarchy process (AHP) and fuzzy evaluation methods for synthesizing performance data and subjective response data. This method was designed to provide an integrated framework combining the inevitable vague judgments from the multiple stages of the product evaluation process. In order to illustrate the effectiveness of the model, this study used a summative usability test case to assess the application and strength of the general fuzzy usability framework. To test the proposed fuzzy usability evaluation framework [1], a standard summative usability test was conducted to benchmark the overall usability of a specific network management software. Based on the test data, the fuzzy method was applied to incorporate both the usability scores and uncertainties involved in the multiple components of the evaluation. Then, with Monte Carlo simulation procedures, confidence intervals were used to compare the reliabilities among the fuzzy approach and two typical conventional methods combining metrics based on percentages. This case study showed that the fuzzy evaluation technique can be applied successfully for combining summative usability testing data to achieve an overall usability quality for the network software evaluated. Greater differences of confidence interval widths between the method of averaging equally percentage and weighted evaluation method, including the method of weighted percentage averages, verified the strength of the fuzzy method.

Clinical guideline representation in a CDS: a human information processing method.

PubMed

Kilsdonk, Ellen; Riezebos, Rinke; Kremer, Leontien; Peute, Linda; Jaspers, Monique

2012-01-01

The Dutch Childhood Oncology Group (DCOG) has developed evidence-based guidelines for screening childhood cancer survivors for possible late complications of treatment. These paper-based guidelines appeared to not suit clinicians' information retrieval strategies; it was thus decided to communicate the guidelines through a Computerized Decision Support (CDS) tool. To ensure high usability of this tool, an analysis of clinicians' cognitive strategies in retrieving information from the paper-based guidelines was used as requirements elicitation method. An information processing model was developed through an analysis of think aloud protocols and used as input for the design of the CDS user interface. Usability analysis of the user interface showed that the navigational structure of the CDS tool fitted well with the clinicians' mental strategies employed in deciding on survivors screening protocols. Clinicians were more efficient and more complete in deciding on patient-tailored screening procedures when supported by the CDS tool than by the paper-based guideline booklet. The think-aloud method provided detailed insight into users' clinical work patterns that supported the design of a highly usable CDS system.

Interdisciplinary Development of an Improved Emergency Department Procedural Work Surface Through Iterative Design and Use Testing in Simulated and Clinical Environments.

PubMed

Zhang, Xiao C; Bermudez, Ana M; Reddy, Pranav M; Sarpatwari, Ravi R; Chheng, Darin B; Mezoian, Taylor J; Schwartz, Victoria R; Simmons, Quinneil J; Jay, Gregory D; Kobayashi, Leo

2017-03-01

A stable and readily accessible work surface for bedside medical procedures represents a valuable tool for acute care providers. In emergency department (ED) settings, the design and implementation of traditional Mayo stands and related surface devices often limit their availability, portability, and usability, which can lead to suboptimal clinical practice conditions that may affect the safe and effective performance of medical procedures and delivery of patient care. We designed and built a novel, open-source, portable, bedside procedural surface through an iterative development process with use testing in simulated and live clinical environments. The procedural surface development project was conducted between October 2014 and June 2016 at an academic referral hospital and its affiliated simulation facility. An interdisciplinary team of emergency physicians, mechanical engineers, medical students, and design students sought to construct a prototype bedside procedural surface out of off-the-shelf hardware during a collaborative university course on health care design. After determination of end-user needs and core design requirements, multiple prototypes were fabricated and iteratively modified, with early variants featuring undermattress stabilizing supports or ratcheting clamp mechanisms. Versions 1 through 4 underwent 2 hands-on usability-testing simulation sessions; version 5 was presented at a design critique held jointly by a panel of clinical and industrial design faculty for expert feedback. Responding to select feedback elements over several surface versions, investigators arrived at a near-final prototype design for fabrication and use testing in a live clinical setting. This experimental procedural surface (version 8) was constructed and then deployed for controlled usability testing against the standard Mayo stands in use at the study site ED. Clinical providers working in the ED who opted to participate in the study were provided with the prototype surface and just-in-time training on its use when performing bedside procedures. Subjects completed the validated 10-point System Usability Scale postshift for the surface that they had used. The study protocol was approved by the institutional review board. Multiple prototypes and recursive design revisions resulted in a fully functional, portable, and durable bedside procedural surface that featured a stainless steel tray and intuitive hook-and-lock mechanisms for attachment to ED stretcher bed rails. Forty-two control and 40 experimental group subjects participated and completed questionnaires. The median System Usability Scale score (out of 100; higher scores associated with better usability) was 72.5 (interquartile range [IQR] 51.3 to 86.3) for the Mayo stand; the experimental surface was scored at 93.8 (IQR 84.4 to 97.5 for a difference in medians of 17.5 (95% confidence interval 10 to 27.5). Subjects reported several usability challenges with the Mayo stand; the experimental surface was reviewed as easy to use, simple, and functional. In accordance with experimental live environment deployment, questionnaire responses, and end-user suggestions, the project team finalized the design specification for the experimental procedural surface for open dissemination. An iterative, interdisciplinary approach was used to generate, evaluate, revise, and finalize the design specification for a new procedural surface that met all core end-user requirements. The final surface design was evaluated favorably on a validated usability tool against Mayo stands when use tested in simulated and live clinical settings. Copyright © 2016 American College of Emergency Physicians. Published by Elsevier Inc. All rights reserved.

Acceptance and usability of a home-based monitoring tool of health indicators in children of people with dementia: a Proof of Principle (POP) study.

PubMed

Boessen, April Bcg; Vermeulen, Joan; de Witte, Luc P

2017-01-01

Large-scale cohort studies are needed to confirm the relation between dementia and its possible risk factors. The inclusion of people with dementia in research is a challenge, however, children of people with dementia are at risk and are highly motivated to participate in dementia research. For technologies to support home-based data collection during large-scale studies, participants should be able and willing to use technology for a longer period of time. This study investigated acceptance and usability of iVitality, a research platform for home-based monitoring of dementia health indicators, in 151 children of people with dementia and investigated which frequency of measurements is acceptable for them. Participants were randomized to fortnightly or monthly measurements. At baseline and after 3 months, participants completed an online questionnaire regarding the acceptance (Technology Acceptance Model; 38 items) and usability (Post-Study System Usability Questionnaire; 24 items) of iVitality. Items were rated from 1 (I totally disagree) to 7 (I totally agree). Participants were also invited to take part in an online focus group (OFG) after 3 months of follow-up. Descriptive statistics and both two-sample/independent and paired t -tests were used to analyze the online questionnaires and a directed content analysis was used to analyze the OFGs. Children of people with dementia accept iVitality after long-term use and evaluate iVitality as a user-friendly, useful, and trusted technology, despite some suggestions for improvement. Overall, mean scores on acceptance and usability were higher than 5 (I somewhat agree), although the acceptance subscales "social influence" and "time" were rated somewhat lower. No significant differences in acceptance and usability were found between both protocol groups. Over time, "affect" significantly increased among participants measuring blood pressure fortnightly. iVitality has the potential to be used in large-scale studies for home-based monitoring of health indicators related to the development of dementia.

Why Citizen Science Without Usability Testing Will Underperform

NASA Astrophysics Data System (ADS)

Romano, C.; Gay, P.; Owens, R.; Burlea, G.

2017-12-01

Citizen science projects must undergo usability testing and optimization if they are to meet their stated goals. This presentation will include video of usability tests conducted upon citizen science websites. Usability testing is essential to the success of online interaction, however, citizen science projects have just begun to include this critical activity. Interaction standards in citizen science lag behind those of commercial interests, and published research on this topic is limited. Since online citizen science is by definition, an exchange of information, a clear understanding of how users experience an online project is essential to informed decision-making. Usability testing provides that insight. Usability testing collects data via direct observation of a person while she interacts with a digital product, such as a citizen science website. The test participant verbalizes her thoughts while using the website or application; the moderator follows the participant and captures quantitative measurement of the participant's confidence of success as she advances through the citizen science project. Over 15 years of usability testing, we have observed that users who do not report a consistent sense of progress are likely to abandon a website after as few as three unrewarding interactions. Since citizen science is also a voluntary activity, ensuring seamless interaction for users is mandatory. Usability studies conducted on citizen science websites demonstrate that project teams frequently underestimate a user's need for context and ease of use. Without usability testing, risks to online citizen science projects include high bounce rate (users leave the website without taking any action), abandonment (of the website, tutorials, registration), misunderstanding instructions (causing disorientation and erroneous conclusions), and ultimately, underperforming projects.

Towards a Usability and Error "Safety Net": A Multi-Phased Multi-Method Approach to Ensuring System Usability and Safety.

PubMed

Kushniruk, Andre; Senathirajah, Yalini; Borycki, Elizabeth

2017-01-01

The usability and safety of health information systems have become major issues in the design and implementation of useful healthcare IT. In this paper we describe a multi-phased multi-method approach to integrating usability engineering methods into system testing to ensure both usability and safety of healthcare IT upon widespread deployment. The approach involves usability testing followed by clinical simulation (conducted in-situ) and "near-live" recording of user interactions with systems. At key stages in this process, usability problems are identified and rectified forming a usability and technology-induced error "safety net" that catches different types of usability and safety problems prior to releasing systems widely in healthcare settings.

Development and preliminary user testing of the DCIDA (Dynamic computer interactive decision application) for 'nudging' patients towards high quality decisions.

PubMed

Bansback, Nick; Li, Linda C; Lynd, Larry; Bryan, Stirling

2014-08-01

Patient decision aids (PtDA) are developed to facilitate informed, value-based decisions about health. Research suggests that even when informed with necessary evidence and information, cognitive errors can prevent patients from choosing the option that is most congruent with their own values. We sought to utilize principles of behavioural economics to develop a computer application that presents information from conventional decision aids in a way that reduces these errors, subsequently promoting higher quality decisions. The Dynamic Computer Interactive Decision Application (DCIDA) was developed to target four common errors that can impede quality decision making with PtDAs: unstable values, order effects, overweighting of rare events, and information overload. Healthy volunteers were recruited to an interview to use three PtDAs converted to the DCIDA on a computer equipped with an eye tracker. Participants were first used a conventional PtDA, and then subsequently used the DCIDA version. User testing was assessed based on whether respondents found the software both usable: evaluated using a) eye-tracking, b) the system usability scale, and c) user verbal responses from a 'think aloud' protocol; and useful: evaluated using a) eye-tracking, b) whether preferences for options were changed, and c) and the decisional conflict scale. Of the 20 participants recruited to the study, 11 were male (55%), the mean age was 35, 18 had at least a high school education (90%), and 8 (40%) had a college or university degree. Eye-tracking results, alongside a mean system usability scale score of 73 (range 68-85), indicated a reasonable degree of usability for the DCIDA. The think aloud study suggested areas for further improvement. The DCIDA also appeared to be useful to participants wherein subjects focused more on the features of the decision that were most important to them (21% increase in time spent focusing on the most important feature). Seven subjects (25%) changed their preferred option when using DCIDA. Preliminary results suggest that DCIDA has potential to improve the quality of patient decision-making. Next steps include larger studies to test individual components of DCIDA and feasibility testing with patients making real decisions.

MoniQA: a general approach to monitor quality assurance

NASA Astrophysics Data System (ADS)

Jacobs, J.; Deprez, T.; Marchal, G.; Bosmans, H.

2006-03-01

MoniQA ("Monitor Quality Assurance") is a new, non-commercial, independent quality assurance software application developed in our medical physics team. It is a complete Java TM - based modular environment for the evaluation of radiological viewing devices and it thus fits in the global quality assurance network of our (film less) radiology department. The purpose of the software tool is to guide the medical physicist through an acceptance protocol and the radiologist through a constancy check protocol by presentation of the necessary test patterns and by automated data collection. Data are then sent to a central management system for further analysis. At the moment more than 55 patterns have been implemented, which can be grouped in schemes to implement protocols (i.e. AAPMtg18, DIN and EUREF). Some test patterns are dynamically created and 'drawn' on the viewing device with random parameters as is the case in a recently proposed new pattern for constancy testing. The software is installed on 35 diagnostic stations (70 monitors) in a film less radiology department. Learning time was very limited. A constancy check -with the new pattern that assesses luminance decrease, resolution problems and geometric distortion- takes only 2 minutes and 28 seconds per monitor. The modular approach of the software allows the evaluation of new or emerging test patterns. We will report on the software and its usability: practicality of the constancy check tests in our hospital and on the results from acceptance tests of viewing stations for digital mammography.

Training Teachers and Serving Students: Applying Usability Testing in Writing Programs

ERIC Educational Resources Information Center

McGovern, Heather

2007-01-01

Teachers often test course materials by using them in class. Usability testing provides an alternative: teachers receive student feedback and revise materials "before" teaching a class. Case studies based on interviews and observations with two teaching assistants who usability tested materials before teaching introductory technical writing…

An Iterative, Mixed Usability Approach Applied to the Telekit System from the Danish TeleCare North Trial

PubMed Central

Schaarup, Clara; Hejlesen, Ole Kristian

2016-01-01

Objective. The aim of the present study is to evaluate the usability of the telehealth system, coined Telekit, by using an iterative, mixed usability approach. Materials and Methods. Ten double experts participated in two heuristic evaluations (HE1, HE2), and 11 COPD patients attended two think-aloud tests. The double experts identified usability violations and classified them into Jakob Nielsen's heuristics. These violations were then translated into measurable values on a scale of 0 to 4 indicating degree of severity. In the think-aloud tests, COPD participants were invited to verbalise their thoughts. Results. The double experts identified 86 usability violations in HE1 and 101 usability violations in HE2. The majority of the violations were rated in the 0–2 range. The findings from the think-aloud tests resulted in 12 themes and associated examples regarding the usability of the Telekit system. The use of the iterative, mixed usability approach produced both quantitative and qualitative results. Conclusion. The iterative, mixed usability approach yields a strong result owing to the high number of problems identified in the tests because the double experts and the COPD participants focus on different aspects of Telekit's usability. This trial is registered with Clinicaltrials.gov, NCT01984840, November 14, 2013. PMID:27974888

An Iterative, Mixed Usability Approach Applied to the Telekit System from the Danish TeleCare North Trial.

PubMed

Lilholt, Pernille Heyckendorff; Schaarup, Clara; Hejlesen, Ole Kristian

2016-01-01

Objective . The aim of the present study is to evaluate the usability of the telehealth system, coined Telekit, by using an iterative, mixed usability approach. Materials and Methods . Ten double experts participated in two heuristic evaluations (HE1, HE2), and 11 COPD patients attended two think-aloud tests. The double experts identified usability violations and classified them into Jakob Nielsen's heuristics. These violations were then translated into measurable values on a scale of 0 to 4 indicating degree of severity. In the think-aloud tests, COPD participants were invited to verbalise their thoughts. Results . The double experts identified 86 usability violations in HE1 and 101 usability violations in HE2. The majority of the violations were rated in the 0-2 range. The findings from the think-aloud tests resulted in 12 themes and associated examples regarding the usability of the Telekit system. The use of the iterative, mixed usability approach produced both quantitative and qualitative results. Conclusion . The iterative, mixed usability approach yields a strong result owing to the high number of problems identified in the tests because the double experts and the COPD participants focus on different aspects of Telekit's usability. This trial is registered with Clinicaltrials.gov, NCT01984840, November 14, 2013.

Bacterial contamination of re-usable laryngoscope blades during the course of daily anaesthetic practice.

PubMed

Lowman, Warren; Venter, Laurissa; Scribante, Juan

2013-02-19

Hospital-acquired infections (HAIs) are largely preventable through risk analysis and modification of practice. Anaesthetic practice plays a limited role in the prevention of HAIs, although laryngoscope use and decontamination is an area of concern. We aimed to assess the level of microbial contamination of re-usable laryngoscope blades at a public hospital in South Africa. The theatre complex of a secondary-level public hospital in Johannesburg. Blades from two different theatres were sampled twice daily, using a standardised technique, over a 2-week period. Samples were quantitatively assessed for microbial contamination, and stratified by area on blade, theatre and time using Fisher's exact test. A contamination rate of 57.3% (63/110) was found, with high-level contamination accounting for 22.2% of these. Common commensals were the most frequently isolated micro-organisms (79.1%), but important hospital pathogens such as Enterobacter species and Acinetobacter baumannii were isolated from blades with high-level contamination. No significant difference in the level of microbial contamination by area on blade, theatre or time was found (p<0.05). A combination of sub-optimal decontamination and improper handling of laryngoscopes after decontamination results in significant microbial contamination of re-usable laryngoscope blades. There is an urgent need to review protocols and policies surrounding the use of these blades.

A continuous usability evaluation of an electronic medication administration record application.

PubMed

Vicente Oliveros, Noelia; Gramage Caro, Teresa; Pérez Menéndez-Conde, Covadonga; Álvarez-Diaz, Ana María; Martín-Aragón Álvarez, Sagrario; Bermejo Vicedo, Teresa; Delgado Silveira, Eva

2017-12-01

The complexity of an electronic medication administration record (eMAR) has been underestimated by most designers in the past. Usability issues, such as poorly designed user application flow in eMAR, are therefore of vital importance, since they can have a negative impact on nursing activities and result in poor outcomes. The purpose of this study was to evaluate the usability of an eMAR application during its development. A usability evaluation was conducted during the development of the eMAR application. Two usability methods were used: a heuristic evaluation complemented by usability testing. Each eMAR application version provided by the vendor was evaluated by 2 hospital pharmacists, who applied the heuristic method. They reviewed the eMAR tasks, detected usability problems and their heuristic violations, and rated the severity of the usability problems. Usability testing was used to assess the final application version by observing how 3 nurses interacted with the application. Thirty-four versions were assessed before the eMAR application was considered usable. During the heuristic evaluation, the usability problems decreased from 46 unique usability problems in version 1 (V1) to 9 in version 34 (V34). In V1, usability problems were categorized into 154 heuristic violations, which decreased to 27 in V34. The average severity rating also decreased from major usability problem (2.96) to no problem (0.23). During usability testing, the 3 nurses did not encounter new usability problems. A thorough heuristic evaluation is a good method for obtaining a usable eMAR application. This evaluation points key areas for improvement and decreases usability problems and their severity. © 2017 John Wiley & Sons, Ltd.

A usability evaluation of medical software at an expert conference setting.

PubMed

Bond, Raymond Robert; Finlay, Dewar D; Nugent, Chris D; Moore, George; Guldenring, Daniel

2014-01-01

A usability test was employed to evaluate two medical software applications at an expert conference setting. One software application is a medical diagnostic tool (electrocardiogram [ECG] viewer) and the other is a medical research tool (electrode misplacement simulator [EMS]). These novel applications have yet to be adopted by the healthcare domain, thus, (1) we wanted to determine the potential user acceptance of these applications and (2) we wanted to determine the feasibility of evaluating medical diagnostic and medical research software at a conference setting as opposed to the conventional laboratory setting. The medical diagnostic tool (ECG viewer) was evaluated using seven delegates and the medical research tool (EMS) was evaluated using 17 delegates that were recruited at the 2010 International Conference on Computing in Cardiology. Each delegate/participant was required to use the software and undertake a set of predefined tasks during the session breaks at the conference. User interactions with the software were recorded using screen-recording software. The 'think-aloud' protocol was also used to elicit verbal feedback from the participants whilst they attempted the pre-defined tasks. Before and after each session, participants completed a pre-test and a post-test questionnaire respectively. The average duration of a usability session at the conference was 34.69 min (SD=10.28). However, taking into account that 10 min was dedicated to the pre-test and post-test questionnaires, the average time dedication to user interaction of the medical software was 24.69 min (SD=10.28). Given we have shown that usability data can be collected at conferences, this paper details the advantages of conference-based usability studies over the laboratory-based approach. For example, given delegates gather at one geographical location, a conference-based usability evaluation facilitates recruitment of a convenient sample of international subject experts. This would otherwise be very expensive to arrange. A conference-based approach also allows for data to be collected over a few days as opposed to months by avoiding administration duties normally involved in laboratory based approach, e.g. mailing invitation letters as part of a recruitment campaign. Following analysis of the user video recordings, 41 (previously unknown) use errors were identified in the advanced ECG viewer and 29 were identified in the EMS application. All use errors were given a consensus severity rating from two independent usability experts. Out of a rating scale of 4 (where 1=cosmetic and 4=critical), the average severity rating for the ECG viewer was 2.24 (SD=1.09) and the average severity rating for the EMS application was 2.34 (SD=0.97). We were also able to extract task completion rates and times from the video recordings to determine the effectiveness of the software applications. For example, six out of seven tasks were completed by all participants when using both applications. This statistic alone suggests both applications already have a high degree of usability. As well as extracting data from the video recordings, we were also able to extract data from the questionnaires. Using a semantic differential scale (where 1=poor and 5=excellent), delegates highly rated the 'responsiveness', 'usefulness', 'learnability' and the 'look and feel' of both applications. This study has shown the potential user acceptance and user-friendliness of the novel EMS and the ECG viewer applications within the healthcare domain. It has also shown that both medical diagnostic software and medical research software can be evaluated for their usability at an expert conference setting. The primary advantage of a conference-based usability evaluation over a laboratory-based evaluation is the high concentration of experts at one location, which is convenient, less time consuming and less expensive. Copyright © 2013 Elsevier Ireland Ltd. All rights reserved.

Web usability testing with a Hispanic medically underserved population.

PubMed

Moore, Mary; Bias, Randolph G; Prentice, Katherine; Fletcher, Robin; Vaughn, Terry

2009-04-01

Skilled website developers value usability testing to assure user needs are met. When the target audience differs substantially from the developers, it becomes essential to tailor both design and evaluation methods. In this study, researchers carried out a multifaceted usability evaluation of a website (Healthy Texas) designed for Hispanic audiences with lower computer literacy and lower health literacy. METHODS INCLUDED: (1) heuristic evaluation by a usability engineer, (2) remote end-user testing using WebEx software; and (3) face-to-face testing in a community center where use of the website was likely. Researchers found standard usability testing methods needed to be modified to provide interpreters, increased flexibility for time on task, presence of a trusted intermediary such as a librarian, and accommodation for family members who accompanied participants. Participants offered recommendations for website redesign, including simplified language, engaging and relevant graphics, culturally relevant examples, and clear navigation. User-centered design is especially important when website developers are not representative of the target audience. Failure to conduct appropriate usability testing with a representative audience can substantially reduce use and value of the website. This thorough course of usability testing identified improvements that benefit all users but become crucial when trying to reach an underserved audience.

Earthdata Search Usability Study Process

NASA Technical Reports Server (NTRS)

Reese, Mark

2016-01-01

User experience (UX) design is the process of enhancing user satisfaction by improving various aspects of the user's interaction with an application or website. One aspect of UX design is usability, or the extent to which an application can be used to to accomplish tasks efficiently, effectively, and with satisfaction. NASA's Earthdata Search Client recently underwent a focused usability testing project to measure usability and gain valuable user feedback and insights to increase usability for its end-users. This presentation focuses on the process by which the usability tests were administered and the lessons learned throughout the process.

Applying usability testing techniques to improve a health promotion website.

PubMed

Hinchliffe, Anetta; Mummery, W Kerry

2008-04-01

Use of the Internet for health promotion is increasing; however, the lack of published research regarding website usability suggests that health promotion websites are being developed without consultation with their users or formal evaluation. This study conducted usability testing of an existing health promotion website to inform modifications and to identify common usability themes that should be addressed by organisations developing or maintaining a health promotion website. A combination of qualitative and quantitative techniques were implemented during the usability testing sessions to gather data from users while completing tasks on the website. Techniques included performance measures (time taken), direct observation (participant observation) and subjective user preferences (questionnaire and interview). Improvements to the website were measured in terms of reduced problems reported, reduced time taken to complete tasks and increased subjective reports. Seven usability themes emerged from the data: design, feedback, format, instructions, navigation, terminology and learnability. This study demonstrates the application of usability testing to the design and modification of a health promotion website and illustrates the areas or themes that can be used as a framework for testing and modification.

Sociotechnical Human Factors Involved in Remote Online Usability Testing of Two eHealth Interventions.

PubMed

Wozney, Lori M; Baxter, Pamela; Fast, Hilary; Cleghorn, Laura; Hundert, Amos S; Newton, Amanda S

2016-02-03

Research in the fields of human performance technology and human computer interaction are challenging the traditional macro focus of usability testing arguing for methods that help test moderators assess "use in context" (ie, cognitive skills, usability understood over time) and in authentic "real world" settings. Human factors in these complex test scenarios may impact on the quality of usability results being derived yet there is a lack of research detailing moderator experiences in these test environments. Most comparative research has focused on the impact of the physical environment on results, and rarely on how the sociotechnical elements of the test environment affect moderator and test user performance. Improving our understanding of moderator roles and experiences with conducting "real world" usability testing can lead to improved techniques and strategies To understand moderator experiences of using Web-conferencing software to conduct remote usability testing of 2 eHealth interventions. An exploratory case study approach was used to study 4 moderators' experiences using Blackboard Collaborate for remote testing sessions of 2 different eHealth interventions. Data collection involved audio-recording iterative cycles of test sessions, collecting summary notes taken by moderators, and conducting 2 90-minute focus groups via teleconference. A direct content analysis with an inductive coding approach was used to explore personal accounts, assess the credibility of data interpretation, and generate consensus on the thematic structure of the results. Following the convergence of data from the various sources, 3 major themes were identified: (1) moderators experienced and adapted to unpredictable changes in cognitive load during testing; (2) moderators experienced challenges in creating and sustaining social presence and untangling dialogue; and (3) moderators experienced diverse technical demands, but were able to collaboratively troubleshoot with test users. Results highlight important human-computer interactions and human factor qualities that impact usability testing processes. Moderators need an advanced skill and knowledge set to address the social interaction aspects of Web-based usability testing and technical aspects of conferencing software during test sessions. Findings from moderator-focused studies can inform the design of remote testing platforms and real-time usability evaluation processes that place less cognitive burden on moderators and test users.

Usability testing for the rest of us: the application of discount usability principles in the development of an online communications assessment application.

PubMed

Brock, Douglas; Kim, Sara; Palmer, Odawni; Gallagher, Thomas; Holmboe, Eric

2013-01-01

Usability evaluation provides developers and educators with the means to understand user needs, improve overall product utility, and increase user satisfaction. The application of "discount usability" principles developed to make usability testing more practical and useful may improve user experience at minimal cost and require little existing expertise to conduct. We describe an application of discount usability to a high-fidelity online communications assessment application developed by the University of Washington for the American Board of Internal Medicine. Eight internal medicine physicians completed a discount usability test. Sessions were recorded and the videos analyzed for significant usability concerns. Concerns were identified, summarized, discussed, and prioritized by the authors in collaboration with the software developers before implementing any changes to the interface. Thirty-eight significant usability issues were detected and four technical problems were identified. Each issue was responded to through modification of the software, by providing additional instruction, or delayed for a later version to be developed. Discount usability can be easily implemented in academic developmental activities. Our study resulted in the discovery and remediation of significant user problems, in addition to giving important insight into the novel methods built into the application.

SU-F-T-249: Application of Human Factors Methods: Usability Testing in the Radiation Oncology Environment

DOE Office of Scientific and Technical Information (OSTI.GOV)

Warkentin, H; Bubric, K; Giovannetti, H

2016-06-15

Purpose: As a quality improvement measure, we undertook this work to incorporate usability testing into the implementation procedures for new electronic documents and forms used by four affiliated radiation therapy centers. Methods: A human factors specialist provided training in usability testing for a team of medical physicists, radiation therapists, and radiation oncologists from four radiotherapy centers. A usability testing plan was then developed that included controlled scenarios and standardized forms for qualitative and quantitative feedback from participants, including patients. Usability tests were performed by end users using the same hardware and viewing conditions that are found in the clinical environment.more » A pilot test of a form used during radiotherapy CT simulation was performed in a single department; feedback informed adaptive improvements to the electronic form, hardware requirements, resource accessibility and the usability testing plan. Following refinements to the testing plan, usability testing was performed at three affiliated cancer centers with different vault layouts and hardware. Results: Feedback from the testing resulted in the detection of 6 critical errors (omissions and inability to complete task without assistance), 6 non-critical errors (recoverable), and multiple suggestions for improvement. Usability problems with room layout were detected at one center and problems with hardware were detected at one center. Upon amalgamation and summary of the results, three key recommendations were presented to the document’s authors for incorporation into the electronic form. Documented inefficiencies and patient safety concerns related to the room layout and hardware were presented to administration along with a request for funding to purchase upgraded hardware and accessories to allow a more efficient workflow within the simulator vault. Conclusion: By including usability testing as part of the process when introducing any new document or procedure into clinical use, associated risks can be identified and mitigated before patient care and clinical workflow are impacted.« less

Usability Assessment of the Missouri Cancer Registry's Published Interactive Mapping Reports: Round One.

PubMed

Ben Ramadan, Awatef Ahmed; Jackson-Thompson, Jeannette; Schmaltz, Chester Lee

2017-08-04

 Many users of spatial data have difficulty interpreting information in health-related spatial reports. The Missouri Cancer Registry and Research Center (MCR-ARC) has produced interactive reports for several years. These reports have never been tested for usability.  The aims of this study were to: (1) conduct a multi-approach usability testing study to understand ease of use (user friendliness) and user satisfaction; and (2) evaluate the usability of MCR-ARC's published InstantAtlas reports.   An institutional review board (IRB) approved mixed methodology usability testing study using a convenience sample of health professionals. A recruiting email was sent to faculty in the Master of Public Health program and to faculty and staff in the Department of Health Management and Informatics at the University of Missouri-Columbia. The study included 7 participants. The test included a pretest questionnaire, a multi-task usability test, and the System Usability Scale (SUS). Also, the researchers collected participants' comments about the tested maps immediately after every trial. Software was used to record the computer screen during the trial and the participants' spoken comments. Several performance and usability metrics were measured to evaluate the usability of MCR-ARC's published mapping reports. Of the 10 assigned tasks, 6 reached a 100% completion success rate, and this outcome was relative to the complexity of the tasks. The simple tasks were handled more efficiently than the complicated tasks. The SUS score ranged between 20-100 points, with an average of 62.7 points and a median of 50.5 points. The tested maps' effectiveness outcomes were better than the efficiency and satisfaction outcomes. There was a statistically significant relationship between the subjects' performance on the study test and the users' previous experience with geographic information system (GIS) tools (P=.03). There were no statistically significant relationships between users' performance and satisfaction and their education level, work type, or previous experience in health care (P>.05). There were strong positive correlations between the three measured usability elements. The tested maps should undergo an extensive refining and updating to overcome all the discovered usability issues and meet the perspectives and needs of the tested maps' potential users. The study results might convey the perspectives of academic health professionals toward GIS health data. We need to conduct a second-round usability study with public health practitioners and cancer professionals who use GIS tools on a routine basis. Usability testing should be conducted before and after releasing MCR-ARC's maps in the future. ©Awatef Ahmed Ben Ramadan, Jeannette Jackson-Thompson, Chester Lee Schmaltz. Originally published in JMIR Human Factors (http://humanfactors.jmir.org), 04.08.2017.

Usability Assessment of the Missouri Cancer Registry’s Published Interactive Mapping Reports: Round One

PubMed Central

Jackson-Thompson, Jeannette; Schmaltz, Chester Lee

2017-01-01

Background  Many users of spatial data have difficulty interpreting information in health-related spatial reports. The Missouri Cancer Registry and Research Center (MCR-ARC) has produced interactive reports for several years. These reports have never been tested for usability. Objective  The aims of this study were to: (1) conduct a multi-approach usability testing study to understand ease of use (user friendliness) and user satisfaction; and (2) evaluate the usability of MCR-ARC’s published InstantAtlas reports. Methods   An institutional review board (IRB) approved mixed methodology usability testing study using a convenience sample of health professionals. A recruiting email was sent to faculty in the Master of Public Health program and to faculty and staff in the Department of Health Management and Informatics at the University of Missouri-Columbia. The study included 7 participants. The test included a pretest questionnaire, a multi-task usability test, and the System Usability Scale (SUS). Also, the researchers collected participants’ comments about the tested maps immediately after every trial. Software was used to record the computer screen during the trial and the participants’ spoken comments. Several performance and usability metrics were measured to evaluate the usability of MCR-ARC’s published mapping reports. Results Of the 10 assigned tasks, 6 reached a 100% completion success rate, and this outcome was relative to the complexity of the tasks. The simple tasks were handled more efficiently than the complicated tasks. The SUS score ranged between 20-100 points, with an average of 62.7 points and a median of 50.5 points. The tested maps’ effectiveness outcomes were better than the efficiency and satisfaction outcomes. There was a statistically significant relationship between the subjects’ performance on the study test and the users’ previous experience with geographic information system (GIS) tools (P=.03). There were no statistically significant relationships between users’ performance and satisfaction and their education level, work type, or previous experience in health care (P>.05). There were strong positive correlations between the three measured usability elements. Conclusions The tested maps should undergo an extensive refining and updating to overcome all the discovered usability issues and meet the perspectives and needs of the tested maps’ potential users. The study results might convey the perspectives of academic health professionals toward GIS health data. We need to conduct a second-round usability study with public health practitioners and cancer professionals who use GIS tools on a routine basis. Usability testing should be conducted before and after releasing MCR-ARC’s maps in the future. PMID:28778842

Pattern mining of user interaction logs for a post-deployment usability evaluation of a radiology PACS client.

PubMed

Jorritsma, Wiard; Cnossen, Fokie; Dierckx, Rudi A; Oudkerk, Matthijs; van Ooijen, Peter M A

2016-01-01

To perform a post-deployment usability evaluation of a radiology Picture Archiving and Communication System (PACS) client based on pattern mining of user interaction log data, and to assess the usefulness of this approach compared to a field study. All user actions performed on the PACS client were logged for four months. A data mining technique called closed sequential pattern mining was used to automatically extract frequently occurring interaction patterns from the log data. These patterns were used to identify usability issues with the PACS. The results of this evaluation were compared to the results of a field study based usability evaluation of the same PACS client. The interaction patterns revealed four usability issues: (1) the display protocols do not function properly, (2) the line measurement tool stays active until another tool is selected, rather than being deactivated after one use, (3) the PACS's built-in 3D functionality does not allow users to effectively perform certain 3D-related tasks, (4) users underuse the PACS's customization possibilities. All usability issues identified based on the log data were also found in the field study, which identified 48 issues in total. Post-deployment usability evaluation based on pattern mining of user interaction log data provides useful insights into the way users interact with the radiology PACS client. However, it reveals few usability issues compared to a field study and should therefore not be used as the sole method of usability evaluation. Copyright © 2015 Elsevier Ireland Ltd. All rights reserved.

Usability of a New Writing Assistive Device for Persons with Cervical Spinal Cord Injury.

PubMed

Lim, MyungJoon; Park, Jiyoung; Lee, Kuem Ju; Kweon, Hyosun; Kim, Byungchul; Cho, Kyujin; Choi, Hyun

2015-01-01

The hand function for persons with cervical spinal cord injury (PCSCI) is most frequently cause difficulties in leading normal lives. The purpose of this study was to test the usability of a new writing assistive device (NWAD) for PCSCI. To access its usability, the authors design usability testing method and test the NWAD to five individuals with cervical spinal cord injury. From the usability testing, we have found number of issues that lead us to key design concept about developing the NWAD. The NWAD will be redesigned based on the result of the present study. We expect that the NWAD will help PCSCI use their affected hand better and improve the level of independence and quality of life.

Reinventing Image Detective: An Evidence-Based Approach to Citizen Science Online

NASA Astrophysics Data System (ADS)

Romano, C.; Graff, P. V.; Runco, S.

2017-12-01

Usability studies demonstrate that web users are notoriously impatient, spending as little as 15 seconds on a home page. How do you get users to stay long enough to understand a citizen science project? How do you get users to complete complex citizen science tasks online?Image Detective, a citizen science project originally developed by scientists and science engagement specialists at the NASA Johnson Space center to engage the public in the analysis of images taken from space by astronauts to help enhance NASA's online database of astronaut imagery, partnered with the CosmoQuest citizen science platform to modernize, offering new and improved options for participation in Image Detective. The challenge: to create a web interface that builds users' skills and knowledge, creating engagement while learning complex concepts essential to the accurate completion of tasks. The project team turned to usability testing for an objective understanding of how users perceived Image Detective and the steps required to complete required tasks. A group of six users was recruited online for unmoderated and initial testing. The users followed a think-aloud protocol while attempting tasks, and were recorded on video and audio. The usability test examined users' perception of four broad areas: the purpose of and context for Image Detective; the steps required to successfully complete the analysis (differentiating images of Earth's surface from those showing outer space and identifying common surface features); locating the image center point on a map of Earth; and finally, naming geographic locations or natural events seen in the image.Usability test findings demonstrated that the following best practices can increase participation in Image Detective and can be applied to the successful implementation of any citizen science project:• Concise explanation of the project, its context, and its purpose;• Including a mention of the funding agency (in this case, NASA);• A preview of the specific tasks required of participants;• A dedicated user interface for the actual citizen science interaction.In addition, testing revealed that users may require additional context when a task is complex, difficult, or unusual (locating a specific image and its center point on a map of Earth). Video evidence will be made available with this presentation.

Reinventing Image Detective: An Evidence-Based Approach to Citizen Science Online

NASA Technical Reports Server (NTRS)

Romano, Cia; Graff, Paige V.; Runco, Susan

2017-01-01

Usability studies demonstrate that web users are notoriously impatient, spending as little as 15 seconds on a home page. How do you get users to stay long enough to understand a citizen science project? How do you get users to complete complex citizen science tasks online? Image Detective, a citizen science project originally developed by scientists and science engagement specialists at the NASA Johnson Space center to engage the public in the analysis of images taken from space by astronauts to help enhance NASA's online database of astronaut imagery, partnered with the CosmoQuest citizen science platform to modernize, offering new and improved options for participation in Image Detective. The challenge: to create a web interface that builds users' skills and knowledge, creating engagement while learning complex concepts essential to the accurate completion of tasks. The project team turned to usability testing for an objective understanding of how users perceived Image Detective and the steps required to complete required tasks. A group of six users was recruited online for unmoderated and initial testing. The users followed a think-aloud protocol while attempting tasks, and were recorded on video and audio. The usability test examined users' perception of four broad areas: the purpose of and context for Image Detective; the steps required to successfully complete the analysis (differentiating images of Earth's surface from those showing outer space and identifying common surface features); locating the image center point on a map of Earth; and finally, naming geographic locations or natural events seen in the image. Usability test findings demonstrated that the following best practices can increase participation in Image Detective and can be applied to the successful implementation of any citizen science project: (1) Concise explanation of the project, its context, and its purpose; (2) Including a mention of the funding agency (in this case, NASA); (3) A preview of the specific tasks required of participants; (4) A dedicated user interface for the actual citizen science interaction. In addition, testing revealed that users may require additional context when a task is complex, difficult, or unusual (locating a specific image and its center point on a map of Earth). Video evidence will be made available with this presentation.

Macquarie Surgical Innovation Identification Tool (MSIIT): a study protocol for a usability and pilot test

PubMed Central

Blakely, Brette; Rogers, Wendy A; Clay-Williams, Robyn

2016-01-01

Introduction Medicine relies on innovation to continually improve. However, innovation is potentially risky, and not all innovations are successful. Therefore, it is important to identify innovations prospectively and provide support, to make innovation as safe and effective as possible. The Macquarie Surgical Innovation Identification Tool (MSIIT) is a simple checklist designed as a practical tool for hospitals to identify planned surgical innovations. This project aims to test the usability and pilot the use of the MSIIT in a surgical setting. Methods and analysis The project will run in two phases at two Australian hospitals, one public and one private. Phase I will involve interviews, focus groups and a survey of hospital administrators and surgical teams to assess the usability and system requirements for the use of the MSIIT. Current practice regarding surgical innovation within participating hospitals will be mapped, and the best implementation strategy for MSIIT completion will be established. Phase II will involve trialling the MSIIT for each surgery within the trial period by various surgical personnel. Follow-up interviews, focus groups and a survey will be conducted with trial participants to collect feedback on their experience of using the MSIIT during the trial period. Comparative data on rates of surgical innovation during the trial period will also be gathered from existing hospital systems and compared to the rates identified by the MSIIT. Ethics and dissemination Ethical approval has been obtained. The results of this study will be presented to interested health services and other stakeholders, presented at conferences and published in a peer-reviewed MEDLINE-indexed journal. PMID:27864253

User experiences of evidence-based online resources for health professionals: User testing of The Cochrane Library

PubMed Central

Rosenbaum, Sarah E; Glenton, Claire; Cracknell, Jane

2008-01-01

Background Evidence-based decision making relies on easy access to trustworthy research results. The Cochrane Library is a key source of evidence about the effect of interventions and aims to "promote the accessibility of systematic reviews to anyone wanting to make a decision about health care". We explored how health professionals found, used and experienced The Library, looking at facets of user experience including findability, usability, usefulness, credibility, desirability and value. Methods We carried out 32 one-hour usability tests on participants from Norway and the UK. Participants both browsed freely and attempted to perform individually tailored tasks while "thinking aloud". Sessions were recorded and viewed in real time by researchers. Transcriptions and videos were reviewed by one researcher and one designer. Findings reported here reflect issues receiving a high degree of saturation and that we judge to be critical to the user experience of evidence-based web sites, based on principles for usability heuristics, web guidelines and evidence-based practice. Results Participants had much difficulty locating both the site and its contents. Non-native English speakers were at an extra disadvantage when retrieving relevant documents despite high levels of English-language skills. Many participants displayed feelings of ineptitude, alienation and frustration. Some made serious mistakes in correctly distinguishing between different information types, for instance reviews, review protocols, and individual studies. Although most expressed a high regard for the site's credibility, some later displayed a mistrust of the independence of the information. Others were overconfident, thinking everything on The Cochrane Library site shared the same level of quality approval. Conclusion Paradoxically, The Cochrane Library, established to support easy access to research evidence, has its own problems of accessibility. Health professionals' experiences of this and other evidence-based online resources can be improved by applying existing principles for web usability, prioritizing the development of simple search functionality, emitting "researcher" jargon, consistent marking of site ownership, and clear signposting of different document types and different content quality. PMID:18662382

Evaluating Patient Usability of an Image-Based Mobile Health Platform for Postoperative Wound Monitoring

PubMed Central

Wiseman, Jason

2016-01-01

Background Surgical patients are increasingly using mobile health (mHealth) platforms to monitor recovery and communicate with their providers in the postdischarge period. Despite widespread enthusiasm for mHealth, few studies evaluate the usability or user experience of these platforms. Objective Our objectives were to (1) develop a novel image-based smartphone app for postdischarge surgical wound monitoring, and (2) rigorously user test it with a representative population of vascular and general surgery patients. Methods A total of 9 vascular and general surgery inpatients undertook usability testing of an internally developed smartphone app that allows patients to take digital images of their wound and answer a survey about their recovery. We followed the International Organization for Standardization (ISO) 9241-11 guidelines, focusing on effectiveness, efficiency, and user satisfaction. An accompanying training module was developed by applying tenets of adult learning. Sessions were audio-recorded, and the smartphone screen was mirrored onto a study computer. Digital image quality was evaluated by a physician panel to determine usefulness for clinical decision making. Results The mean length of time spent was 4.7 (2.1-12.8) minutes on the training session and 5.0 (1.4-16.6) minutes on app completion. 55.5% (5/9) of patients were able to complete the app independently with the most difficulty experienced in taking digital images of surgical wounds. Novice patients who were older, obese, or had groin wounds had the most difficulty. 81.8% of images were sufficient for diagnostic purposes. User satisfaction was high, with an average usability score of 83.3 out of 100. Conclusion Surgical patients can learn to use a smartphone app for postoperative wound monitoring with high user satisfaction. We identified design features and training approaches that can facilitate ease of use. This protocol illustrates an important, often overlooked, aspect of mHealth development to improve surgical care. PMID:27683059

New Options for Usability Testing Projects in Business Communication Courses

ERIC Educational Resources Information Center

Jameson, Daphne A.

2013-01-01

The increasing availability of recording technologies makes it easier to include usability testing projects in business communication courses. Usability testing is a method of discovering whether people can navigate, read, and understand a print or electronic communication well enough to achieve a particular purpose in a reasonable time frame.…

Collecting and Applying Usability Data from Distance Learners

ERIC Educational Resources Information Center

Mitchell, Emily; West, Brandon

2017-01-01

Growth of their college's off-campus and online course offerings led librarians at SUNY Oswego to run usability tests with off-campus students to compensate for a lack of responses from this population during earlier usability testing. Constraints on testing with off-campus students included lack of funding and librarian time, as well as…

Adding Users to the Website Design Process

ERIC Educational Resources Information Center

Tomeo, Megan L.

2012-01-01

Alden Library began redesigning its website over a year ago. Throughout the redesign process the students, faculty, and staff that make up the user base were added to the conversation by utilizing several usability test methods. This article focuses on the usability testing conducted at Alden Library and delves into future usability testing, which…

The Virtual Anatomy Laboratory: Usability Testing to Improve an Online Learning Resource for Anatomy Education

ERIC Educational Resources Information Center

Doubleday, Eldridge G.; O'Loughlin, Valerie D.; Doubleday, Alison F.

2011-01-01

An increasing number of instructors are seeking to provide students with online anatomy resources. Many researchers have attempted to identify associations between resource use and student learning but few studies discuss the importance of usability testing in resource design and modification. Usability testing provides information about ease of…

Low-Cost Rapid Usability Testing: Its Application in Both Product Development and System Implementation.

PubMed

Kushniruk, Andre; Borycki, Elizabeth

2017-01-01

In recent years there has been considerable discussion around the need for certification and regulation of healthcare information technology (IT). In particular, the usability of the products being developed needs to be evaluated. This has included the application of standards designed to ensure the process of system development is user-centered and takes usability into consideration while a product is being developed. In addition to this, in healthcare, organizations in the United States and Europe have also addressed the need and requirement for product certification. However, despite these efforts there are continued reports of unusable and unsafe implementations. In this paper we discuss the need to not only include (and require) usability testing in the one-time development process of health IT products (such as EHRs), but we also argue for the need to additionally develop specific usability standards and requirements for usability testing during the implementation of vendor products (i.e. post product development) in healthcare settings. It is further argued that health IT products that may have been certified regarding their development process will still require application of usability testing in the process of implementing them in real hospital settings in order to ensure usability and safety. This is needed in order to ensure that the final result of both product development and implementation processes take into account and apply the latest usability principles and methods.

Sociotechnical Human Factors Involved in Remote Online Usability Testing of Two eHealth Interventions

PubMed Central

2016-01-01

Background Research in the fields of human performance technology and human computer interaction are challenging the traditional macro focus of usability testing arguing for methods that help test moderators assess “use in context” (ie, cognitive skills, usability understood over time) and in authentic “real world” settings. Human factors in these complex test scenarios may impact on the quality of usability results being derived yet there is a lack of research detailing moderator experiences in these test environments. Most comparative research has focused on the impact of the physical environment on results, and rarely on how the sociotechnical elements of the test environment affect moderator and test user performance. Improving our understanding of moderator roles and experiences with conducting “real world” usability testing can lead to improved techniques and strategies Objective To understand moderator experiences of using Web-conferencing software to conduct remote usability testing of 2 eHealth interventions. Methods An exploratory case study approach was used to study 4 moderators’ experiences using Blackboard Collaborate for remote testing sessions of 2 different eHealth interventions. Data collection involved audio-recording iterative cycles of test sessions, collecting summary notes taken by moderators, and conducting 2 90-minute focus groups via teleconference. A direct content analysis with an inductive coding approach was used to explore personal accounts, assess the credibility of data interpretation, and generate consensus on the thematic structure of the results. Results Following the convergence of data from the various sources, 3 major themes were identified: (1) moderators experienced and adapted to unpredictable changes in cognitive load during testing; (2) moderators experienced challenges in creating and sustaining social presence and untangling dialogue; and (3) moderators experienced diverse technical demands, but were able to collaboratively troubleshoot with test users. Conclusions Results highlight important human-computer interactions and human factor qualities that impact usability testing processes. Moderators need an advanced skill and knowledge set to address the social interaction aspects of Web-based usability testing and technical aspects of conferencing software during test sessions. Findings from moderator-focused studies can inform the design of remote testing platforms and real-time usability evaluation processes that place less cognitive burden on moderators and test users. PMID:27026291

Rapid Evidence Review of Mobile Applications for Self-management of Diabetes.

PubMed

Veazie, Stephanie; Winchell, Kara; Gilbert, Jennifer; Paynter, Robin; Ivlev, Ilya; Eden, Karen B; Nussbaum, Kerri; Weiskopf, Nicole; Guise, Jeanne-Marie; Helfand, Mark

2018-05-08

Patients with diabetes lack information on which commercially available applications (apps) improve diabetes-related outcomes. We conducted a rapid evidence review to examine features, clinical efficacy, and usability of apps for self-management of type 1 and type 2 diabetes in adults. Ovid/Medline and the Cochrane Database of Systematic Reviews were searched for systematic reviews and technology assessments. Reference lists of relevant systematic reviews were examined for primary studies. Additional searches for primary studies were conducted online, through Ovid/Medline, Embase, CINAHL, and ClinicalTrials.gov . Studies were evaluated for eligibility based on predetermined criteria, data were extracted, study quality was assessed using a risk of bias tool, information on app features was collected, and app usability was assessed. Results are summarized qualitatively. Fifteen articles evaluating 11 apps were identified: six apps for type 1 and five apps for type 2 diabetes. Common features of apps included setting reminders and tracking blood glucose and hemoglobin A1c (HbA1c), medication use, physical activity, and weight. Compared with controls, use of eight apps, when paired with support from a healthcare provider or study staff, improved at least one outcome, most often HbA1c. Patients did not experience improvements in quality of life, blood pressure, or weight, regardless of app used or type of diabetes. Study quality was variable. Of the eight apps available for usability testing, two were scored "acceptable," three were "marginal," and three were "not acceptable." Limited evidence suggests that use of some commercially available apps, when combined with additional support from a healthcare provider or study staff, may improve some short-term diabetes-related outcomes. The impact of these apps on longer-term outcomes is unclear. More rigorous and longer-term studies of apps are needed. This review was funded by the Agency for Healthcare Research and Quality (AHRQ). The protocol is available at: http://www.effectivehealthcare.ahrq.gov/topics/diabetes-mobile-devices/research-protocol .

Card Sorting in an Online Environment: Key to Involving Online-Only Student Population in Usability Testing of an Academic Library Web Site?

ERIC Educational Resources Information Center

Paladino, Emily B.; Klentzin, Jacqueline C.; Mills, Chloe P.

2017-01-01

Based on in-person, task-based usability testing and interviews, the authors' library Web site was recently overhauled in order to improve user experience. This led to the authors' interest in additional usability testing methods and test environments that would most closely fit their library's goals and situation. The appeal of card sorting…

An investigation of the efficacy of collaborative virtual reality systems for moderated remote usability testing.

PubMed

Chalil Madathil, Kapil; Greenstein, Joel S

2017-11-01

Collaborative virtual reality-based systems have integrated high fidelity voice-based communication, immersive audio and screen-sharing tools into virtual environments. Such three-dimensional collaborative virtual environments can mirror the collaboration among usability test participants and facilitators when they are physically collocated, potentially enabling moderated usability tests to be conducted effectively when the facilitator and participant are located in different places. We developed a virtual collaborative three-dimensional remote moderated usability testing laboratory and employed it in a controlled study to evaluate the effectiveness of moderated usability testing in a collaborative virtual reality-based environment with two other moderated usability testing methods: the traditional lab approach and Cisco WebEx, a web-based conferencing and screen sharing approach. Using a mixed methods experimental design, 36 test participants and 12 test facilitators were asked to complete representative tasks on a simulated online shopping website. The dependent variables included the time taken to complete the tasks; the usability defects identified and their severity; and the subjective ratings on the workload index, presence and satisfaction questionnaires. Remote moderated usability testing methodology using a collaborative virtual reality system performed similarly in terms of the total number of defects identified, the number of high severity defects identified and the time taken to complete the tasks with the other two methodologies. The overall workload experienced by the test participants and facilitators was the least with the traditional lab condition. No significant differences were identified for the workload experienced with the virtual reality and the WebEx conditions. However, test participants experienced greater involvement and a more immersive experience in the virtual environment than in the WebEx condition. The ratings for the virtual environment condition were not significantly different from those for the traditional lab condition. The results of this study suggest that participants were productive and enjoyed the virtual lab condition, indicating the potential of a virtual world based approach as an alternative to conventional approaches for synchronous usability testing. Copyright © 2017 Elsevier Ltd. All rights reserved.

User-Centered Design and Usability Testing of a Web Site: An Illustrative Case Study.

ERIC Educational Resources Information Center

Corry, Michael D.; Frick, Theodore W.; Hansen, Lisa

1997-01-01

Presents an overview of user-centered design and usability testing. Describes a Web site evaluation project at a university, the iterative process of rapid prototyping and usability testing, and how the findings helped to improve the design. Discusses recommendations for university Web site design and reflects on problems faced in usability…

The use of think-aloud and instant data analysis in evaluation research: Exemplar and lessons learned.

PubMed

Joe, Jonathan; Chaudhuri, Shomir; Le, Thai; Thompson, Hilaire; Demiris, George

2015-08-01

While health information technologies have become increasingly popular, many have not been formally tested to ascertain their usability. Traditional rigorous methods take significant amounts of time and manpower to evaluate the usability of a system. In this paper, we evaluate the use of instant data analysis (IDA) as developed by Kjeldskov et al. to perform usability testing on a tool designed for older adults and caregivers. The IDA method is attractive because it takes significantly less time and manpower than the traditional usability testing methods. In this paper we demonstrate how IDA was used to evaluate usability of a multifunctional wellness tool, discuss study results and lessons learned while using this method. We also present findings from an extension of the method which allows the grouping of similar usability problems in an efficient manner. We found that the IDA method is a quick, relatively easy approach to identifying and ranking usability issues among health information technologies. Copyright © 2015 Elsevier Inc. All rights reserved.

Getting a Technology-based Diabetes Intervention Ready for Primetime: A Review of Usability Testing Studies

PubMed Central

Lyles, Courtney R.; Sarkar, Urmimala; Osborn, Chandra Y.

2014-01-01

Consumer health technologies can educate patients about diabetes and support their self-management, yet usability evidence is rarely published even though it determines patient engagement, optimal benefit of any intervention, and an understanding of generalizability. Therefore, we conducted a narrative review of peer-reviewed articles published from 2009–2013 that tested the usability of a web- or mobile-delivered system/application designed to educate and support patients with diabetes. Overall, the 23 papers included in our review used mixed (n=11), descriptive quantitative (n=9), and qualitative methods (n=3) to assess usability, such as documenting which features performed as intended and how patients rated their experiences. More sophisticated usability evaluations combined several complementary approaches to elucidate more aspects of functionality. Future work pertaining to the design and evaluation of technology-delivered diabetes education/support interventions should aim to standardize the usability testing processes, and publish usability findings to inform interpretation of why an intervention succeeded or failed, and for whom. PMID:25173689

Web usability evaluation on BloobIS website by using hallway usability testing method and ISO 9241:11

NASA Astrophysics Data System (ADS)

Dwi Susanto, Tony; Ingesti Prasetyo, Anisa; Astuti, Hanim Maria

2018-03-01

At this moment, the need for web as an information media is highly important. Not only confined in the infotainment area, government, and education, but health as well uses the web media as a medium for providing information effectively. BloobIS is a web based application which integrates blood supply and distribution information at the Blood Transfusion Unit. Knowing how easy information is on BloobIS is marked by how convenient the website is used. Up until now, the BloobIS website is nearing completion but testing has not yet been performed to users and is on the testing and development phase in the Development Life Cycle software. Thus, an evaluation namely the quality control software which focuses on the perspective of BloobIs web usability is required. Hallway Usability Testing and ISO 9241:11 are the methods chosen to measure the BloobIS application usability. The expected outputs of the quality control software focusing on the usability evaluation are being able to rectify the usability deficiencies on the BloobIs web and provide recommendations to develop the web as a basic BloobIS web quality upgraed which sets a goal to amplify the satisfaction of web users based on usability factors in ISO 9241:11.

Experience with HEP analysis on mounted filesystems.

NASA Astrophysics Data System (ADS)

Fuhrmann, Patrick; Gasthuber, Martin; Kemp, Yves; Ozerov, Dmitry

2012-12-01

We present results on different approaches on mounted filesystems in use or under investigation at DESY. dCache, established since long as a storage system for physics data has implemented the NFS v4.1/pNFS protocol. New performance results will be shown with the most current version of the dCache server. In addition to the native usage of the mounted filesystem in a LAN environment, the results are given for the performance of the dCache NFS v4.1/pNFS in WAN case. Several commercial vendors are currently in alpha or beta phase of adding the NFS v4.1/pNFS protocol to their storage appliances. We will test some of these vendor solutions for their readiness for HEP analysis. DESY has recently purchased an IBM Sonas system. We will present the result of a thorough performance evaluation using the native protocols NFS (v3 or v4) and GPFS. As the emphasis is on the usability for end user analysis, we will use latest ROOT versions and current end user analysis code for benchmark scenarios.

Using a medical simulation center as an electronic health record usability laboratory

PubMed Central

Landman, Adam B; Redden, Lisa; Neri, Pamela; Poole, Stephen; Horsky, Jan; Raja, Ali S; Pozner, Charles N; Schiff, Gordon; Poon, Eric G

2014-01-01

Usability testing is increasingly being recognized as a way to increase the usability and safety of health information technology (HIT). Medical simulation centers can serve as testing environments for HIT usability studies. We integrated the quality assurance version of our emergency department (ED) electronic health record (EHR) into our medical simulation center and piloted a clinical care scenario in which emergency medicine resident physicians evaluated a simulated ED patient and documented electronically using the ED EHR. Meticulous planning and close collaboration with expert simulation staff was important for designing test scenarios, pilot testing, and running the sessions. Similarly, working with information systems teams was important for integration of the EHR. Electronic tools are needed to facilitate entry of fictitious clinical results while the simulation scenario is unfolding. EHRs can be successfully integrated into existing simulation centers, which may provide realistic environments for usability testing, training, and evaluation of human–computer interactions. PMID:24249778

A systematic review of usability test metrics for mobile video streaming apps

NASA Astrophysics Data System (ADS)

Hussain, Azham; Mkpojiogu, Emmanuel O. C.

2016-08-01

This paper presents the results of a systematic review regarding the usability test metrics for mobile video streaming apps. In the study, 238 studies were found, but only 51 relevant papers were eventually selected for the review. The study reveals that time taken for video streaming and the video quality were the two most popular metrics used in the usability tests for mobile video streaming apps. Besides, most of the studies concentrated on the usability of mobile TV as users are switching from traditional TV to mobile TV.

Remote Usability Testing and Satisfaction with a Mobile Health Medication Inquiry System in CKD.

PubMed

Diamantidis, Clarissa J; Ginsberg, Jennifer S; Yoffe, Marni; Lucas, Lisa; Prakash, Divya; Aggarwal, Saurabh; Fink, Wanda; Becker, Stefan; Fink, Jeffrey C

2015-08-07

Inappropriate medication use is common in the care of patients with CKD. The feasibility of a simple mobile health tool designed to advise patients on safe medication usage in CKD was examined. Participants with predialysis CKD (defined as eGFR<60 ml/min per 1.73 m(2)) in the Safe Kidney Care Cohort Study were recruited for home usability testing of a novel medication inquiry system between January and September of 2013. Testing was through two mobile platforms: (1) short messaging service text or (2) personal digital assistant (e.g., iPod Touch). Twenty participants (one half assigned to one device and one half assigned to the other device) were enrolled and received an in-center tutorial on device usage before the end of the study visit. Participants were subsequently mailed three sample pill bottles with the name of randomly selected medications and asked to input these medications into the medication inquiry system. The medication inquiry system response options were as follows: (1) safe in CKD, (2) not safe in CKD, (3) use with caution/speak with your health care provider, or (4) error message (for an incorrectly inputted medication). Participants were asked to record the response issued by the medication inquiry system for each medication sent for usability testing. A user satisfaction survey was administered after completion of the protocol. All participants owned a mobile telephone, but few owned a smartphone. Of 60 total medication queries, there were only three recorded errors, two of which occurred in the short messaging service texting group. Overall satisfaction with the application was high, with slightly higher satisfaction noted in the personal digital assistant group compared with the short messaging service group. The mobile health medication inquiry system application had general ease of use and high acceptance across two platforms among individuals representative of the CKD population. Tailored mobile health technology may improve medication safety in CKD. Copyright © 2015 by the American Society of Nephrology.

E-Learning

ERIC Educational Resources Information Center

Buzzi, Marina, Ed.

2010-01-01

E-Learning is a vast and complex research topic that poses many challenges in every aspect: educational and pedagogical strategies and techniques and the tools for achieving them; usability, accessibility and user interface design; knowledge sharing and collaborative environments; technologies, architectures, and protocols; user activity…

The acceptability of an Internet-based exposure treatment for flying phobia with and without therapist guidance: patients’ expectations, satisfaction, treatment preferences, and usability

PubMed Central

Campos, Daniel; Mira, Adriana; Bretón-López, Juana; Castilla, Diana; Botella, Cristina; Baños, Rosa Maria; Quero, Soledad

2018-01-01

Purpose Internet-based treatments have been tested for several psychological disorders. However, few studies have directly assessed the acceptability of these self-applied interventions in terms of expectations, satisfaction, treatment preferences, and usability. Moreover, no studies provide this type of data on Internet-based treatment for flying phobia (FP), with or without therapist guidance. The aim of this study was to analyze the acceptability of an Internet-based treatment for FP (NO-FEAR Airlines) that includes exposure scenarios composed of images and real sounds. A secondary aim was to compare patients’ acceptance of two ways of delivering this treatment (with or without therapist guidance). Patients and methods The sample included 46 participants from a randomized controlled trial who had received the self-applied intervention with (n = 23) or without (n = 23) therapist guidance. All participants completed an assessment protocol conducted online and by telephone at both pre- and posttreatment. Results Results showed good expectations, satisfaction, opinion, and usability, regardless of the presence of therapist guidance, including low aversiveness levels from before to after the intervention. However, participants generally preferred the therapist-supported condition. Conclusion NO-FEAR Airlines is a well-accepted Internet-based treatment that can help enhance the application of the exposure technique, improving patient acceptance and access to FP treatment. PMID:29636613

Situated Usability Testing for Security Systems

DOE Office of Scientific and Technical Information (OSTI.GOV)

Greitzer, Frank L.

2011-03-02

While usability testing is well established, assessing the usability of security software, tools, or methods deserves more careful consideration. It has been argued that dealing with security has become too difficult for individuals or organizations to manage effectively or to use conveniently. As difficult as it is for system administrators and developers to deal with, security is even more challenging for casual users. Indeed, it is much too easy for casual/home users to configure the security of their systems in non-optimal ways that leave their systems inadvertently insecure. This is exacerbated by the fact that casual users are focused onmore » matters other than security, and likely would prefer not even to think about security. This brief report argues that when security and/or privacy are part of the equation, traditional methods for usability testing should be re-considered. The purpose of this brief report is to argue for and outline a method associated with a new approach to usability testing for examining usable security issues.« less

Usability of a mobile electronic medical record prototype: a verbal protocol analysis.

PubMed

Wu, Robert C; Orr, M Scott; Chignell, Mark; Straus, Sharon E

2008-06-01

Point of care access to electronic medical records may provide clinicians with the information they want when they need it and may in turn improve patient safety. Yet providing an electronic medical record on handheld devices presents many usability challenges, and it is unclear whether clinicians will use them. An iterative design process for the development and evaluation of a prototype of a mobile electronic medical record was performed. Usability sessions were conducted in which physicians were asked to 'think aloud' while working through clinical scenarios using the prototype. Verbal protocol analysis, which consists of coding utterances, was conducted on the transcripts from the sessions and common themes were extracted. Usability sessions were held with five family physicians and four internists with varying levels of computer expertise. Physicians were able to use the device to complete 52 of 54 required tasks. Users commented that it was intuitive (9/9), would increase accessibility (5/9) but for them to use it, it would need the system to be fast and time-saving (5/9). Users had difficulty entering information (5/9) and reading the screen (4/9). In terms of functionality, users had concerns about completeness of information (6/9), details of ordering (5/9) and desired billing functionality (5/9) and integration with other systems (4/9). While physicians can use mobile electronic medical records in realistic scenarios, certain requirements likely need to be met including a fast system with easy data selection, easy data entry and improved display before widespread adoption occurs.

Acceptance and usability of a home-based monitoring tool of health indicators in children of people with dementia: a Proof of Principle (POP) study

PubMed Central

Boessen, April BCG; Vermeulen, Joan; de Witte, Luc P

2017-01-01

Background Large-scale cohort studies are needed to confirm the relation between dementia and its possible risk factors. The inclusion of people with dementia in research is a challenge, however, children of people with dementia are at risk and are highly motivated to participate in dementia research. For technologies to support home-based data collection during large-scale studies, participants should be able and willing to use technology for a longer period of time. Objective This study investigated acceptance and usability of iVitality, a research platform for home-based monitoring of dementia health indicators, in 151 children of people with dementia and investigated which frequency of measurements is acceptable for them. Methods Participants were randomized to fortnightly or monthly measurements. At baseline and after 3 months, participants completed an online questionnaire regarding the acceptance (Technology Acceptance Model; 38 items) and usability (Post-Study System Usability Questionnaire; 24 items) of iVitality. Items were rated from 1 (I totally disagree) to 7 (I totally agree). Participants were also invited to take part in an online focus group (OFG) after 3 months of follow-up. Descriptive statistics and both two-sample/independent and paired t-tests were used to analyze the online questionnaires and a directed content analysis was used to analyze the OFGs. Results Children of people with dementia accept iVitality after long-term use and evaluate iVitality as a user-friendly, useful, and trusted technology, despite some suggestions for improvement. Overall, mean scores on acceptance and usability were higher than 5 (I somewhat agree), although the acceptance subscales “social influence” and “time” were rated somewhat lower. No significant differences in acceptance and usability were found between both protocol groups. Over time, “affect” significantly increased among participants measuring blood pressure fortnightly. Conclusion iVitality has the potential to be used in large-scale studies for home-based monitoring of health indicators related to the development of dementia. PMID:28814839

Professional Writing in the English Classroom: Let's Get Real--Using Usability to Connect Writers, Readers, and Texts

ERIC Educational Resources Information Center

Bush, Jonathan, Ed.; Zuidema, Leah, Ed.

2012-01-01

In professional writing, usability testing investigates how well users can find, understand, and use a document (Lannon). Usability testing involves gathering feedback from users, analyzing how successfully they used the document, and drawing on the test results to change or refine the design. From the authors' experiences as writers and teachers,…

Usability Evaluation of Public Web Mapping Sites

NASA Astrophysics Data System (ADS)

Wang, C.

2014-04-01

Web mapping sites are interactive maps that are accessed via Webpages. With the rapid development of Internet and Geographic Information System (GIS) field, public web mapping sites are not foreign to people. Nowadays, people use these web mapping sites for various reasons, in that increasing maps and related map services of web mapping sites are freely available for end users. Thus, increased users of web mapping sites led to more usability studies. Usability Engineering (UE), for instance, is an approach for analyzing and improving the usability of websites through examining and evaluating an interface. In this research, UE method was employed to explore usability problems of four public web mapping sites, analyze the problems quantitatively and provide guidelines for future design based on the test results. Firstly, the development progress for usability studies were described, and simultaneously several usability evaluation methods such as Usability Engineering (UE), User-Centered Design (UCD) and Human-Computer Interaction (HCI) were generally introduced. Then the method and procedure of experiments for the usability test were presented in detail. In this usability evaluation experiment, four public web mapping sites (Google Maps, Bing maps, Mapquest, Yahoo Maps) were chosen as the testing websites. And 42 people, who having different GIS skills (test users or experts), gender (male or female), age and nationality, participated in this test to complete the several test tasks in different teams. The test comprised three parts: a pretest background information questionnaire, several test tasks for quantitative statistics and progress analysis, and a posttest questionnaire. The pretest and posttest questionnaires focused on gaining the verbal explanation of their actions qualitatively. And the design for test tasks targeted at gathering quantitative data for the errors and problems of the websites. Then, the results mainly from the test part were analyzed. The success rate from different public web mapping sites was calculated and compared, and displayed by the means of diagram. And the answers from questionnaires were also classified and organized in this part. Moreover, based on the analysis, this paper expands the discussion about the layout, map visualization, map tools, search logic and etc. Finally, this paper closed with some valuable guidelines and suggestions for the design of public web mapping sites. Also, limitations for this research stated in the end.

Development and preliminary user testing of the DCIDA (Dynamic computer interactive decision application) for ‘nudging’ patients towards high quality decisions

PubMed Central

2014-01-01

Background Patient decision aids (PtDA) are developed to facilitate informed, value-based decisions about health. Research suggests that even when informed with necessary evidence and information, cognitive errors can prevent patients from choosing the option that is most congruent with their own values. We sought to utilize principles of behavioural economics to develop a computer application that presents information from conventional decision aids in a way that reduces these errors, subsequently promoting higher quality decisions. Method The Dynamic Computer Interactive Decision Application (DCIDA) was developed to target four common errors that can impede quality decision making with PtDAs: unstable values, order effects, overweighting of rare events, and information overload. Healthy volunteers were recruited to an interview to use three PtDAs converted to the DCIDA on a computer equipped with an eye tracker. Participants were first used a conventional PtDA, and then subsequently used the DCIDA version. User testing was assessed based on whether respondents found the software both usable: evaluated using a) eye-tracking, b) the system usability scale, and c) user verbal responses from a ‘think aloud’ protocol; and useful: evaluated using a) eye-tracking, b) whether preferences for options were changed, and c) and the decisional conflict scale. Results Of the 20 participants recruited to the study, 11 were male (55%), the mean age was 35, 18 had at least a high school education (90%), and 8 (40%) had a college or university degree. Eye-tracking results, alongside a mean system usability scale score of 73 (range 68–85), indicated a reasonable degree of usability for the DCIDA. The think aloud study suggested areas for further improvement. The DCIDA also appeared to be useful to participants wherein subjects focused more on the features of the decision that were most important to them (21% increase in time spent focusing on the most important feature). Seven subjects (25%) changed their preferred option when using DCIDA. Conclusion Preliminary results suggest that DCIDA has potential to improve the quality of patient decision-making. Next steps include larger studies to test individual components of DCIDA and feasibility testing with patients making real decisions. PMID:25084808

Development of a Video Coding Scheme for Analyzing the Usability and Usefulness of Health Information Systems.

PubMed

Kushniruk, Andre W; Borycki, Elizabeth M

2015-01-01

Usability has been identified as a key issue in health informatics. Worldwide numerous projects have been carried out in an attempt to increase and optimize health system usability. Usability testing, involving observing end users interacting with systems, has been widely applied and numerous publications have appeared describing such studies. However, to date, fewer works have been published describing methodological approaches to analyzing the rich data stream that results from usability testing. This includes analysis of video, audio and screen recordings. In this paper we describe our work in the development and application of a coding scheme for analyzing the usability of health information systems. The phases involved in such analyses are described.

"Think aloud" and "Near live" usability testing of two complex clinical decision support tools.

PubMed

Richardson, Safiya; Mishuris, Rebecca; O'Connell, Alexander; Feldstein, David; Hess, Rachel; Smith, Paul; McCullagh, Lauren; McGinn, Thomas; Mann, Devin

2017-10-01

Low provider adoption continues to be a significant barrier to realizing the potential of clinical decision support. "Think Aloud" and "Near Live" usability testing were conducted on two clinical decision support tools. Each was composed of an alert, a clinical prediction rule which estimated risk of either group A Streptococcus pharyngitis or pneumonia and an automatic order set based on risk. The objective of this study was to further understanding of the facilitators of usability and to evaluate the types of additional information gained from proceeding to "Near Live" testing after completing "Think Aloud". This was a qualitative observational study conducted at a large academic health care system with 12 primary care providers. During "Think Aloud" testing, participants were provided with written clinical scenarios and asked to verbalize their thought process while interacting with the tool. During "Near Live" testing participants interacted with a mock patient. Morae usability software was used to record full screen capture and audio during every session. Participant comments were placed into coding categories and analyzed for generalizable themes. Themes were compared across usability methods. "Think Aloud" and "Near Live" usability testing generated similar themes under the coding categories visibility, workflow, content, understand-ability and navigation. However, they generated significantly different themes under the coding categories usability, practical usefulness and medical usefulness. During both types of testing participants found the tool easier to use when important text was distinct in its appearance, alerts were passive and appropriately timed, content was up to date, language was clear and simple, and each component of the tool included obvious indicators of next steps. Participant comments reflected higher expectations for usability and usefulness during "Near Live" testing. For example, visit aids, such as automatically generated order sets, were felt to be less useful during "Near-Live" testing because they would not be all inclusive for the visit. These complementary types of usability testing generated unique and generalizable insights. Feedback during "Think Aloud" testing primarily helped to improve the tools' ease of use. The additional feedback from "Near Live" testing, which mimics a real clinical encounter, was helpful for eliciting key barriers and facilitators to provider workflow and adoption. Copyright © 2017 Elsevier B.V. All rights reserved.

Integrating Low-Cost Rapid Usability Testing into Agile System Development of Healthcare IT: A Methodological Perspective.

PubMed

Kushniruk, Andre W; Borycki, Elizabeth M

2015-01-01

The development of more usable and effective healthcare information systems has become a critical issue. In the software industry methodologies such as agile and iterative development processes have emerged to lead to more effective and usable systems. These approaches highlight focusing on user needs and promoting iterative and flexible development practices. Evaluation and testing of iterative agile development cycles is considered an important part of the agile methodology and iterative processes for system design and re-design. However, the issue of how to effectively integrate usability testing methods into rapid and flexible agile design cycles has remained to be fully explored. In this paper we describe our application of an approach known as low-cost rapid usability testing as it has been applied within agile system development in healthcare. The advantages of the integrative approach are described, along with current methodological considerations.

Design, Implementation, and Wide Pilot Deployment of FitForAll: An Easy to use Exergaming Platform Improving Physical Fitness and Life Quality of Senior Citizens.

PubMed

Konstantinidis, Evdokimos I; Billis, Antonis S; Mouzakidis, Christos A; Zilidou, Vasiliki I; Antoniou, Panagiotis E; Bamidis, Panagiotis D

2016-01-01

Many platforms have emerged as response to the call for technology supporting active and healthy aging. Key requirements for any such e-health systems and any subsequent business exploitation are tailor-made design and proper evaluation. This paper presents the design, implementation, wide deployment, and evaluation of the low cost, physical exercise, and gaming (exergaming) FitForAll (FFA) platform system usability, user adherence to exercise, and efficacy are explored. The design of FFA is tailored to elderly populations, distilling literature guidelines and recommendations. The FFA architecture introduces standard physical exercise protocols in exergaming software engineering, as well as, standard physical assessment tests for augmented adaptability through adjustable exercise intensity. This opens up the way to next generation exergaming software, which may be more automatically/smartly adaptive. 116 elderly users piloted FFA five times/week, during an eight-week controlled intervention. Usability evaluation was formally conducted (SUS, SUMI questionnaires). Control group consisted of a size-matched elderly group following cognitive training. Efficacy was assessed objectively through the senior fitness (Fullerton) test, and subjectively, through WHOQoL-BREF comparisons of pre-postintervention between groups. Adherence to schedule was measured by attendance logs. The global SUMI score was 68.33±5.85%, while SUS was 77.7. Good usability perception is reflected in relatively high adherence of 82% for a daily two months pilot schedule. Compared to control group, elderly using FFA improved significantly strength, flexibility, endurance, and balance while presenting a significant trend in quality of life improvements. This is the first elderly focused exergaming platform intensively evaluated with more than 100 participants. The use of formal tools makes the findings comparable to other studies and forms an elderly exergaming corpus.

Macquarie Surgical Innovation Identification Tool (MSIIT): a study protocol for a usability and pilot test.

PubMed

Blakely, Brette; Selwood, Amanda; Rogers, Wendy A; Clay-Williams, Robyn

2016-11-18

Medicine relies on innovation to continually improve. However, innovation is potentially risky, and not all innovations are successful. Therefore, it is important to identify innovations prospectively and provide support, to make innovation as safe and effective as possible. The Macquarie Surgical Innovation Identification Tool (MSIIT) is a simple checklist designed as a practical tool for hospitals to identify planned surgical innovations. This project aims to test the usability and pilot the use of the MSIIT in a surgical setting. The project will run in two phases at two Australian hospitals, one public and one private. Phase I will involve interviews, focus groups and a survey of hospital administrators and surgical teams to assess the usability and system requirements for the use of the MSIIT. Current practice regarding surgical innovation within participating hospitals will be mapped, and the best implementation strategy for MSIIT completion will be established. Phase II will involve trialling the MSIIT for each surgery within the trial period by various surgical personnel. Follow-up interviews, focus groups and a survey will be conducted with trial participants to collect feedback on their experience of using the MSIIT during the trial period. Comparative data on rates of surgical innovation during the trial period will also be gathered from existing hospital systems and compared to the rates identified by the MSIIT. Ethical approval has been obtained. The results of this study will be presented to interested health services and other stakeholders, presented at conferences and published in a peer-reviewed MEDLINE-indexed journal. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/.

Internationalization and localization: evaluating and testing a Website for Asian users.

PubMed

Rau, Pei-Luen Patrick; Liang, Sheau-Farn Max

2003-01-15

The objective of this study was to combine internationalization and localization of Websites and improvement of Website usability with user-centred design methods. This study designed for internationalization and localization of Websites for Asian users, and implemented usability engineering into every phase of Website usability testing, based on the internationalization and localization perspectives of the honeywell.com/your home Website. The first step was to develop the usage scenarios. Three Asian usability specialists carried out one heuristic evaluation session for the current honeywell.com/your home Website. The usability problems were analysed and possible solutions to these problems were discussed. In the next phase, cluster analysis was utilized to test current information architecture. The results provided options for future information architecture development for this Website. Finally, a performance measurement test was conducted to investigate the performance for Asian users. Based on the results, suggestions for improving the Website usability from the localization perspective were provided. The results demonstrate the user-centred design (UCD) approach and stress international and local issues in Website development to Website designers.

The influence of socio-cultural background and product value in usability testing.

PubMed

Sonderegger, Andreas; Sauer, Juergen

2013-05-01

This article examines the influence of socio-cultural background and product value on different outcomes of usability tests. A study was conducted in two different socio-cultural regions, Switzerland and East Germany, which differed in a number of aspects (e.g. economic power, price sensitivity and culture). Product value (high vs. low) was varied by manipulating the price of the product. Sixty-four test participants were asked to carry out five typical user tasks in the context of coffee machine usage, measuring performance, perceived usability, and emotion. The results showed that in Switzerland, high-value products were rated higher in usability than low-value products whereas in East Germany, high-value products were evaluated lower in usability. A similar interaction effect of socio-cultural background and product value was observed for user emotion. Implications are that the outcomes of usability tests do not allow for a simple transfer across cultures and that the mediating influence of perceived product value needs to be taken into consideration. Copyright © 2012 Elsevier Ltd and The Ergonomics Society. All rights reserved.

Development, Construction, and Content Validation of a Questionnaire to Test Mobile Shower Commode Usability

PubMed Central

Theodoros, Deborah G.; Russell, Trevor G.

2015-01-01

Background: Usability is an emerging domain of outcomes measurement in assistive technology provision. Currently, no questionnaires exist to test the usability of mobile shower commodes (MSCs) used by adults with spinal cord injury (SCI). Objective: To describe the development, construction, and initial content validation of an electronic questionnaire to test mobile shower commode usability for this population. Methods: The questionnaire was constructed using a mixed-methods approach in 5 phases: determining user preferences for the questionnaire’s format, developing an item bank of usability indicators from the literature and judgement of experts, constructing a preliminary questionnaire, assessing content validity with a panel of experts, and constructing the final questionnaire. Results: The electronic Mobile Shower Commode Assessment Tool Version 1.0 (eMAST 1.0) questionnaire tests MSC features and performance during activities identified using a mixed-methods approach and in consultation with users. It confirms that usability is complex and multidimensional. The final questionnaire contains 25 questions in 3 sections. The eMAST 1.0 demonstrates excellent content validity as determined by a small sample of expert clinicians. Conclusion: The eMAST 1.0 tests usability of MSCs from the perspective of adults with SCI and may be used to solicit feedback during MSC design, assessment, prescription, and ongoing use. Further studies assessing the eMAST’s psychometric properties, including studies with users of MSCs, are needed. PMID:25762862

Applying usability methods to identify health literacy issues: an example using a Personal Health Record.

PubMed

Monkman, Helen; Kushniruk, Andre

2013-01-01

The prevalence of consumer health information systems is increasing. However, usability and health literacy impact both the value and adoption of these systems. Health literacy and usability are closely related in that systems may not be used accurately if users cannot understand the information therein. Thus, it is imperative to focus on mitigating the demands on health literacy in consumer health information systems. This study modified two usability evaluation methods (heuristic evaluation and usability testing) to incorporate the identification of potential health literacy issues in a Personal Health Record (PHR). Heuristic evaluation is an analysis of a system performed by a usability specialist who evaluates how well the system abides by usability principles. In contrast, a usability test involves a post hoc analysis of a representative user interacting with the system. These two methods revealed several health literacy issues and suggestions to ameliorate them were made. Thus, it was demonstrated that usability methods could be successfully augmented for the purpose of investigating health literacy issues. To improve users' health knowledge, the adoption of consumer health information systems, and the accuracy of the information contained therein, it is encouraged that usability methods be applied with an added focus on health literacy.

Usability evaluation techniques in mobile commerce applications: A systematic review

NASA Astrophysics Data System (ADS)

Hussain, Azham; Mkpojiogu, Emmanuel O. C.

2016-08-01

Obviously, there are a number of literatures concerning the usability of mobile commerce (m-commerce) applications and related areas, but they do not adequately provide knowledge about usability techniques used in most of the empirical usability evaluation for m-commerce application. Therefore, this paper is aimed at producing the usability techniques frequently used in the aspect of usability evaluation for m-commerce applications. To achieve the stated objective, systematic literature review was employed. Sixty seven papers were downloaded in usability evaluation for m-commerce and related areas; twenty one most relevant studies were selected for review in order to extract the appropriate information. The results from the review shows that heuristic evaluation, formal test and think aloud methods are the most commonly used methods in m-commerce application in comparison to cognitive walkthrough and the informal test methods. Moreover, most of the studies applied control experiment (33.3% of the total studies); other studies that applied case study for usability evaluation are 14.28%. The results from this paper provide additional knowledge to the usability practitioners and research community for the current state and use of usability techniques in m-commerce application.

Usability testing of a prototype multi-user telehealth kiosk.

PubMed

Courtney, Karen L; Matthews, Judith T; McMillan, Julie M; Person Mecca, Laurel; Smailagic, Asim; Siewiorek, Daniel

2015-01-01

The overall purpose of this study was to learn how community-dwelling older adults would interact with our prototype multi-user telehealth kiosk and their views about its usability. Seven subjects participated in laboratory-based usability sessions to evaluate the physical design, appearance, functionality and perceived ease of use of a multi-user telehealth kiosk prototype. During usability testing participants recommended 18 new features (29% of comments), identified 15 software errors (23% of comments) and 29 user interface errors (47% of comments).

Usability: Human Research Program - Space Human Factors and Habitability

NASA Technical Reports Server (NTRS)

Sandor, Aniko; Holden, Kritina L.

2009-01-01

The Usability project addresses the need for research in the area of metrics and methodologies used in hardware and software usability testing in order to define quantifiable and verifiable usability requirements. A usability test is a human-in-the-loop evaluation where a participant works through a realistic set of representative tasks using the hardware/software under investigation. The purpose of this research is to define metrics and methodologies for measuring and verifying usability in the aerospace domain in accordance with FY09 focus on errors, consistency, and mobility/maneuverability. Usability metrics must be predictive of success with the interfaces, must be easy to obtain and/or calculate, and must meet the intent of current Human Systems Integration Requirements (HSIR). Methodologies must work within the constraints of the aerospace domain, be cost and time efficient, and be able to be applied without extensive specialized training.

Usability Testing For Android Based Application “Jogja Smart Tourism”

NASA Astrophysics Data System (ADS)

Harwati; Djati Widodo, Imam

2017-06-01

The android based application “Jogja Smart Tourism (JST)” is designed to help everyone who visited Yogyakarta to enjoy their travel. As new application, it is need to be tested for its usability before launched. Usability testing will show how easy user interfaces are to used. The objective of this research is to demonstrate the result of usability testing for application JST based on five characteristics: learnability, effectiveness, memorability, errors, and satisfaction. About 30 respondents were involved to test the usability of this application. Learnability and effectiveness is calculated from some task that should be finished by respondents, and the rest aspects are calculated from questionnaires that should be answered after simulation. There are 14 functions bound in this usability testing. The result shows total usability level is in 81.75%. Learnability testing shows that 98.8% of respondent could finish the task successfully with 87.5% in efficiency. The memorability level of respondents is good (84.5%) where their ability to fix the errors is 71.5%. And the last for satisfaction level of application interface is 66.25%. Low level of satisfaction occurred because most of respondent felt uncomfortable with landscape interface of application because they should turn their mobile phone while using JST application and also it happened because the lack of using picture and colour inside the application. Both of these becomes important note for the improvement of further applications where the interface in a portrait version is more comfort the use and also utilization of colour and the image will be the main focus to improve customer satisfaction.

Comparison of two DNA extraction protocols from leave samples of Cotinus coggygria, Citrus sinensis and Genus juglans.

PubMed

Fallah, F; Minaei Chenar, H; Amiri, H; Omodipour, S; Shirbande Ghods, F; Kahrizi, D; Sohrabi, M; Ghorbani, T; Kazemi, E

2017-02-28

High quality DNA is essential for molecular research. Secondary metabolites can affect the quantity and quality DNA. In current research two DNA isolation methods including CTAB and Delaporta (protocols 1 & 2 respectively) were applied in three leave samples from Cotinus coggygria, Citrus sinensis and Genus juglans that their leaves are rich of secondary metabolites. We successfully isolated DNA from C. coggygria, C. sinensis and Genus Juglans using the two protocols described above. Good quality DNA was isolated from C. coggygria, C. sinensis and Genus Juglans using protocol 1, while protocol 2 failed to produce usable DNA from these sources. The highest amount of DNA (1.3-1.6) was obtained from them using protocol 1. As we discovered, procedure 1 may work better for plants with secondary metabolites.

Evaluation of expert system application based on usability aspects

NASA Astrophysics Data System (ADS)

Munaiseche, C. P. C.; Liando, O. E. S.

2016-04-01

Usability usually defined as a point of human acceptance to a product or a system based on understands and right reaction to an interface. The performance of web application has been influence by the quality of the interface of that web to supporting information transfer process. Preferably, before the applications of expert systems were installed in the operational environment, these applications must be evaluated first by usability testing. This research aimed to measure the usability of the expert system application using tasks as interaction media. This study uses an expert system application to diagnose skin disease in human using questionnaire method which utilize the tasks as interaction media in measuring the usability. Certain tasks were executed by the participants in observing usability value of the application. The usability aspects observed were learnability, efficiency, memorability, errors, and satisfaction. Each questionnaire question represent aspects of usability. The results present the usability value for each aspect and the total average merit for all the five-usability aspect was 4.28, this indicated that the tested expert system application is in the range excellent for the usability level, so the application can be implemented as the operated system by user. The main contribution of the study is the research became the first step in using task model in the usability evaluation for the expert system application software.

The Influence of Product Aesthetics and User State in Usability Testing

ERIC Educational Resources Information Center

Sauer, Juergen; Sonderegger, Andreas

2011-01-01

An empirical study examined the effects of two influencing factors in usability tests on user performance and usability ratings. Product aesthetics (high vs. low) as the main independent factor and prior usage event (positive vs. negative) as a subsidiary independent factor were varied in a between-participants design. 60 participants took part in…

Usability Evaluation of a Web-Based Symptom Monitoring Application for Heart Failure.

PubMed

Wakefield, Bonnie; Pham, Kassie; Scherubel, Melody

2015-07-01

Symptom recognition and reporting by patients with heart failure are critical to avoid hospitalization. This project evaluated a patient symptom tracking application. Fourteen end users (nine patients, five clinicians) from a Midwestern Veterans Affairs Medical Center evaluated the website using a think aloud protocol. A structured observation protocol was used to assess success or failure for each task. Measures included task time, success, and satisfaction. Patients had a mean age of 70 years; clinicians averaged 42 years in age. Patients took 9.3 min and clinicians took less than 3 min per scenario. Most patients needed some assistance, but few patients were completely unable to complete some tasks. Clinicians demonstrated few problems navigating the site. Patient System Usability Scale item scores ranged from 2.0 to 3.6; clinician item scores ranged from 1.8 to 4.0. Further work is needed to determine whether using the web-based tool improves symptom recognition and reporting. © The Author(s) 2015.

Designing and evaluating a web-based self-management site for patients with type 2 diabetes--systematic website development and study protocol.

PubMed

Yu, Catherine H; Parsons, Janet; Mamdani, Muhammad; Lebovic, Gerald; Shah, Baiju R; Bhattacharyya, Onil; Laupacis, Andreas; Straus, Sharon E

2012-06-24

Given that patients provide the majority of their own diabetes care, patient self-management training has increasingly become recognized as an important strategy with which to improve quality of care. However, participation in self management programs is low. In addition, the efficacy of current behavioural interventions wanes over time, reducing the impact of self-management interventions on patient health. Web-based interventions have the potential to bridge the gaps in diabetes care and self-management. Our objective is to improve self-efficacy, quality of life, self-care, blood pressure, cholesterol and glycemic control and promote exercise in people with type 2 diabetes through the rigorous development and use of a web-based patient self-management intervention. This study consists of five phases: (1) intervention development; (2) feasibility testing; (3) usability testing; (4) intervention refinement; and (5) intervention evaluation using mixed methods. We will employ evidence-based strategies and tools, using a theoretical framework of self-efficacy, then elicit user feedback through focus groups and individual user testing sessions. Using iterative redesign the intervention will be refined. Once finalized, the impact of the website on patient self-efficacy, quality of life, self-care, HbA1c, LDL-cholesterol, blood pressure and weight will be assessed through a non-randomized observational cohort study using repeated measures modeling and individual interviews. Increasing use of the World Wide Web by consumers for health information and ongoing revolutions in social media are strong indicators that users are primed to welcome a new era of technology in health care. However, their full potential is hindered by limited knowledge regarding their effectiveness, poor usability, and high attrition rates. Our development and research agenda aims to address these limitations by improving usability, identifying characteristics associated with website use and attrition, and developing strategies to sustain patient use in order to maximize clinical outcomes.

Usability Testing of a National Substance Use Screening Tool Embedded in Electronic Health Records.

PubMed

Press, Anne; DeStio, Catherine; McCullagh, Lauren; Kapoor, Sandeep; Morley, Jeanne; Conigliaro, Joseph

2016-07-08

Screening, brief intervention, and referral to treatment (SBIRT) is currently being implemented into health systems nationally via paper and electronic methods. The purpose of this study was to evaluate the integration of an electronic SBIRT tool into an existing paper-based SBIRT clinical workflow in a patient-centered medical home. Usability testing was conducted in an academic ambulatory clinic. Two rounds of usability testing were done with medical office assistants (MOAs) using a paper and electronic version of the SBIRT tool, with two and four participants, respectively. Qualitative and quantitative data was analyzed to determine the impact of both tools on clinical workflow. A second round of usability testing was done with the revised electronic version and compared with the first version. Personal workflow barriers cited in the first round of testing were that the electronic health record (EHR) tool was disruptive to patient's visits. In Round 2 of testing, MOAs reported favoring the electronic version due to improved layout and the inclusion of an alert system embedded in the EHR. For example, using the system usability scale (SUS), MOAs reported a grade "1" for the statement, "I would like to use this system frequently" during the first round of testing but a "5" during the second round of analysis. The importance of testing usability of various mediums of tools used in health care screening is highlighted by the findings of this study. In the first round of testing, the electronic tool was reported as less user friendly, being difficult to navigate, and time consuming. Many issues faced in the first generation of the tool were improved in the second generation after usability was evaluated. This study demonstrates how usability testing of an electronic SBRIT tool can help to identify challenges that can impact clinical workflow. However, a limitation of this study was the small sample size of MOAs that participated. The results may have been biased to Northwell Health workers' perceptions of the SBIRT tool and their specific clinical workflow.

Usability test of an internet-based informatics tool for diabetes care providers: the comprehensive diabetes management program.

PubMed

Fonda, Stephanie J; Paulsen, Christine A; Perkins, Joan; Kedziora, Richard J; Rodbard, David; Bursell, Sven-Erik

2008-02-01

Research suggests Internet-based care management tools are associated with improvements in care and patient outcomes. However, although such tools change workflow, rarely is their usability addressed and reported. This article presents a usability study of an Internet-based informatics application called the Comprehensive Diabetes Management Program (CDMP), developed by content experts and technologists. Our aim is to demonstrate a process for conducting a usability study of such a tool and to report results. We conducted the usability test with six diabetes care providers under controlled conditions. Each provider worked with the CDMP in a single session using a "think aloud" process. Providers performed standardized tasks with fictitious patient data, and we observed how they approached these tasks, documenting verbalizations and subjective ratings. The providers then completed a usability questionnaire and interviews. Overall, the scores on the usability questionnaire were neutral to favorable. For specific subdomains of the questionnaire, the providers' reported problems with the application's ease of use, performance, and support features, but were satisfied with its visual appeal and content. The results from the observational and interview data indicated areas for improvement, particularly in navigation and terminology. The usability study identified several issues for improvement, confirming the need for usability testing of Internet-based informatics applications, even those developed by experts. To our knowledge, there have been no other usability studies of an Internet-based informatics application with the functionality of the CDMP. Such studies can form the foundation for translation of Internet-based medical informatics tools into clinical practice.

Combining usability evaluations to highlight the chain that leads from usability flaws to usage problems and then negative outcomes.

PubMed

Watbled, Ludivine; Marcilly, Romaric; Guerlinger, Sandra; Bastien, J-M Christian; Beuscart-Zéphir, Marie-Catherine; Beuscart, Régis

2018-02-01

Poor usability of health technology is thought to diminish work system performance, increase error rates and, potentially, harm patients. The present study (i) used a combination of usability evaluation methods to highlight the chain that leads from usability flaws to usage problems experienced by users and, ultimately, to negative patient outcomes, and (ii) validated this approach by studying two different discharge summary production systems. To comply with quality guidelines, the process of drafting and sending discharge summaries is increasingly being automated. However, the usability of these systems may modify their impact (or the absence thereof) in terms of production times and quality, and must therefore be evaluated. Here, we applied three successive techniques for usability evaluation (heuristic evaluation, user testing and field observation) to two discharge summary production systems (underpinned by different technologies). The systems' main usability flaws led respectively to an increase in the time need to produce a discharge summary and the risk of patient misidentification. Our results are discussed with regard to the possibility of linking the usability flaws, usage problems and the negative outcomes by successively applying three methods for evaluating usability (heuristic evaluation, user testing and in situ observations) throughout the system development life cycle. Copyright © 2018 Elsevier Inc. All rights reserved.

Computer-facilitated rapid HIV testing in emergency care settings: provider and patient usability and acceptability.

PubMed

Spielberg, Freya; Kurth, Ann E; Severynen, Anneleen; Hsieh, Yu-Hsiang; Moring-Parris, Daniel; Mackenzie, Sara; Rothman, Richard

2011-06-01

Providers in emergency care settings (ECSs) often face barriers to expanded HIV testing. We undertook formative research to understand the potential utility of a computer tool, "CARE," to facilitate rapid HIV testing in ECSs. Computer tool usability and acceptability were assessed among 35 adult patients, and provider focus groups were held, in two ECSs in Washington State and Maryland. The computer tool was usable by patients of varying computer literacy. Patients appreciated the tool's privacy and lack of judgment and their ability to reflect on HIV risks and create risk reduction plans. Staff voiced concerns regarding ECS-based HIV testing generally, including resources for follow-up of newly diagnosed people. Computer-delivered HIV testing support was acceptable and usable among low-literacy populations in two ECSs. Such tools may help circumvent some practical barriers associated with routine HIV testing in busy settings though linkages to care will still be needed.

The Development of MSFC Usability Lab

NASA Technical Reports Server (NTRS)

Cheng, Yiwei; Richardson, Sally

2010-01-01

This conference poster reviews the development of the usability lab at Marshall Space Flight Center. The purpose of the lab was to integrate a fully functioning usability laboratory to provide a resource for future human factor assessments. and to implement preliminary usability testing on a MSFC website to validate the functionality of the lab.

Adequate number of clinicians on usability tests lacking, says study.

PubMed

2015-12-01

A new study reveals that some of the largest EMR vendors failed to meet certification standards, specifying that they state their user-centered design processes, and that they include at least 15 representative end-user participants in their usability tests. It is not clear why these vendors were certified despite not meeting the standards established by Office of the National Coordinator for Health Information Technology (ONC), but investigators suggest that emergency clinicians and administrators should engage with vendors early on, querying them about their user-centered processes. An analysis of the usability tests performed by 41 of some the largest EMR vendors found that 34% of them did not meet certification standards, specifying that they state their user-centered design process. Also, 63% of the vendors failed to include at least 15 representative end-users in their usability tests. Only 15% of the vendors used at least 15 participants who had clinical backgrounds in their usability tests. Experts urge clinicians to engage with EMR user groups to share best practices for optimizing specific EMR products.

Developing a quit smoking website that is usable by people with severe mental illnesses.

PubMed

Ferron, Joelle C; Brunette, Mary F; McHugo, Gregory J; Devitt, Timothy S; Martin, Wendy M; Drake, Robert E

2011-01-01

Evidence-based treatments may be delivered in computerized, web-based formats. This strategy can deliver the intervention consistently with minimal treatment provider time and cost. However, standard web sites may not be usable by people with severe mental illnesses who may experience cognitive deficits and low computer experience. This manuscript reports on the iterative development and usability testing of a website designed to educate and motivate adults with severe mental illnesses to engage in smoking cessation activities. Three phases of semi-structured interviews were performed with participants after they used the program and combined with information from screen-recorded usability data. T-tests compared the differences between uses of the first computer program version and a later version. Iteratively conducted usability tests demonstrated an increased ease of use from the first to the last version of the website through significant improvement in the percentage of unproductive clicking along with fewer questions asked about how to use the program. The improvement in use of the website resulted from changes such as: integrating a mouse tutorial, increasing font sizes, and increasing button sizes. The website usability recommendations provide some guidelines for interventionists developing web tools for people who experience serious psychiatric disabilities. In general, insights from the study highlight the need for thoughtful design and usability testing when creating a website for people with severe mental illness.

Destructive Evaluation of a Xenon Hollow Cathode after a 28,000 Hour Life Test

NASA Technical Reports Server (NTRS)

Sarver-Verhey, Timothy R.

1998-01-01

International Space Station (ISS) plasma contactor system requires a hollow cathode assembly (HCA) with a lifetime of at least 18,000 hours. In order to demonstrate the lifetime capability of the HCA, a series of hollow cathode wear tests was performed which included a life test operated at the maximum current of the HCA. This test sought to verify hollow cathode lifetime capability and contamination control protocols. This hollow cathode accumulated 27,800 hours of operation before it failed during a restart attempt. The cathode was subsequently destructively analyzed in order to determine the failure mechanism. Microscopic examination of the cathode interior determined that relatively small changes in the cathode physical geometry had occurred and barium tungstates, which are known to limit the emission process, had formed over a majority of the electron emitter surface. Because the final state of the insert was consistent with expected impregnate chemistry, the hollow cathode was believed to have reached the end of its usable life under the test conditions.

Usability Evaluation of a Clinical Decision Support System for Geriatric ED Pain Treatment.

PubMed

Genes, Nicholas; Kim, Min Soon; Thum, Frederick L; Rivera, Laura; Beato, Rosemary; Song, Carolyn; Soriano, Jared; Kannry, Joseph; Baumlin, Kevin; Hwang, Ula

2016-01-01

Older adults are at risk for inadequate emergency department (ED) pain care. Unrelieved acute pain is associated with poor outcomes. Clinical decision support systems (CDSS) hold promise to improve patient care, but CDSS quality varies widely, particularly when usability evaluation is not employed. To conduct an iterative usability and redesign process of a novel geriatric abdominal pain care CDSS. We hypothesized this process would result in the creation of more usable and favorable pain care interventions. Thirteen emergency physicians familiar with the Electronic Health Record (EHR) in use at the study site were recruited. Over a 10-week period, 17 1-hour usability test sessions were conducted across 3 rounds of testing. Participants were given 3 patient scenarios and provided simulated clinical care using the EHR, while interacting with the CDSS interventions. Quantitative System Usability Scores (SUS), favorability scores and qualitative narrative feedback were collected for each session. Using a multi-step review process by an interdisciplinary team, positive and negative usability issues in effectiveness, efficiency, and satisfaction were considered, prioritized and incorporated in the iterative redesign process of the CDSS. Video analysis was used to determine the appropriateness of the CDS appearances during simulated clinical care. Over the 3 rounds of usability evaluations and subsequent redesign processes, mean SUS progressively improved from 74.8 to 81.2 to 88.9; mean favorability scores improved from 3.23 to 4.29 (1 worst, 5 best). Video analysis revealed that, in the course of the iterative redesign processes, rates of physicians' acknowledgment of CDS interventions increased, however most rates of desired actions by physicians (such as more frequent pain score updates) decreased. The iterative usability redesign process was instrumental in improving the usability of the CDSS; if implemented in practice, it could improve geriatric pain care. The usability evaluation process led to improved acknowledgement and favorability. Incorporating usability testing when designing CDSS interventions for studies may be effective to enhance clinician use.

Current State of Agile User-Centered Design: A Survey

NASA Astrophysics Data System (ADS)

Hussain, Zahid; Slany, Wolfgang; Holzinger, Andreas

Agile software development methods are quite popular nowadays and are being adopted at an increasing rate in the industry every year. However, these methods are still lacking usability awareness in their development lifecycle, and the integration of usability/User-Centered Design (UCD) into agile methods is not adequately addressed. This paper presents the preliminary results of a recently conducted online survey regarding the current state of the integration of agile methods and usability/UCD. A world wide response of 92 practitioners was received. The results show that the majority of practitioners perceive that the integration of agile methods with usability/UCD has added value to their adopted processes and to their teams; has resulted in the improvement of usability and quality of the product developed; and has increased the satisfaction of the end-users of the product developed. The top most used HCI techniques are low-fidelity prototyping, conceptual designs, observational studies of users, usability expert evaluations, field studies, personas, rapid iterative testing, and laboratory usability testing.

Usability Evaluation of a Private Social Network on Mental Health for Relatives.

PubMed

Toribio-Guzmán, José Miguel; García-Holgado, Alicia; Soto Pérez, Felipe; García-Peñalvo, Francisco J; Franco Martín, Manuel

2017-09-01

Usability is one of the most prominent criteria that must be fulfilled by a software product. This study aims to evaluate the usability of SocialNet, a private social network for monitoring the daily progress of patients by their relatives, using a mixed usability approach: heuristic evaluation conducted by experts and user testing. A double heuristic evaluation with one expert evaluator identified the issues related to consistency, design, and privacy. User testing was conducted on 20 users and one evaluator using observation techniques and questionnaires. The main usability problems were found to be related to the structure of SocialNet, and the users presented some difficulties in locating the buttons or links. The results show a high level of usability and satisfaction with the product. This evaluation provides data on the usability of SocialNet based on the difficulties experienced by the users and the expert. The results help in redesigning the tool to resolve the identified problems as part of an iterative process.

Earthdata Search Client: Usability Review Process, Results, and Implemented Changes, Using Earthdata Search Client as a Case Study

NASA Technical Reports Server (NTRS)

Siarto, Jeff; Reese, Mark; Shum, Dana; Baynes, Katie

2016-01-01

User experience and visual design are greatly improved when usability testing is performed on a periodic basis. Design decisions should be tested by real users so that application owners can understand the effectiveness of each decision and identify areas for improvement. It is important that applications be tested not just once, but as a part of a continuing process that looks to build upon previous tests. NASA's Earthdata Search Client has undergone a usability study to ensure its users' needs are being met and that users understand how to use the tool efficiently and effectively. This poster will highlight the process followed for usability study, the results of the study, and what has been implemented in light of the results to improve the application's interface.

The Electronic Patient Reported Outcome Tool: Testing Usability and Feasibility of a Mobile App and Portal to Support Care for Patients With Complex Chronic Disease and Disability in Primary Care Settings

PubMed Central

Gill, Ashlinder; Khan, Anum Irfan; Hans, Parminder Kaur; Kuluski, Kerry; Cott, Cheryl

2016-01-01

Background People experiencing complex chronic disease and disability (CCDD) face some of the greatest challenges of any patient population. Primary care providers find it difficult to manage multiple discordant conditions and symptoms and often complex social challenges experienced by these patients. The electronic Patient Reported Outcome (ePRO) tool is designed to overcome some of these challenges by supporting goal-oriented primary care delivery. Using the tool, patients and providers collaboratively develop health care goals on a portal linked to a mobile device to help patients and providers track progress between visits. Objectives This study tested the usability and feasibility of adopting the ePRO tool into a single interdisciplinary primary health care practice in Toronto, Canada. The Fit between Individuals, Fask, and Technology (FITT) framework was used to guide our assessment and explore whether the ePRO tool is: (1) feasible for adoption in interdisciplinary primary health care practices and (2) usable from both the patient and provider perspectives. This usability pilot is part of a broader user-centered design development strategy. Methods A 4-week pilot study was conducted in which patients and providers used the ePRO tool to develop health-related goals, which patients then monitored using a mobile device. Patients and providers collaboratively set goals using the system during an initial visit and had at least 1 follow-up visit at the end of the pilot to discuss progress. Focus groups and interviews were conducted with patients and providers to capture usability and feasibility measures. Data from the ePRO system were extracted to provide information regarding tool usage. Results Six providers and 11 patients participated in the study; 3 patients dropped out mainly owing to health issues. The remaining 8 patients completed 210 monitoring protocols, equal to over 1300 questions, with patients often answering questions daily. Providers and patients accessed the portal on an average of 10 and 1.5 times, respectively. Users found the system easy to use, some patients reporting that the tool helped in their ability to self-manage, catalyzed a sense of responsibility over their care, and improved patient-centered care delivery. Some providers found that the tool helped focus conversations on goal setting. However, the tool did not fit well with provider workflows, monitoring questions were not adequately tailored to individual patient needs, and daily reporting became tedious and time-consuming for patients. Conclusions Although our study suggests relatively low usability and feasibility of the ePRO tool, we are encouraged by the early impact on patient outcomes and generally positive responses from both user groups regarding the potential of the tool to improve care for patients with CCDD. As is consistent with our user-centered design development approach, we have modified the tool based on user feedback, and are now testing the redeveloped tool through an exploratory trial. PMID:27256035

The use of fault reporting of medical equipment to identify latent design flaws.

PubMed

Flewwelling, C J; Easty, A C; Vicente, K J; Cafazzo, J A

2014-10-01

Poor device design that fails to adequately account for user needs, cognition, and behavior is often responsible for use errors resulting in adverse events. This poor device design is also often latent, and could be responsible for "No Fault Found" (NFF) reporting, in which medical devices sent for repair by clinical users are found to be operating as intended. Unresolved NFF reports may contribute to incident under reporting, clinical user frustration, and biomedical engineering technologist inefficacy. This study uses human factors engineering methods to investigate the relationship between NFF reporting frequency and device usability. An analysis of medical equipment maintenance data was conducted to identify devices with a high NFF reporting frequency. Subsequently, semi-structured interviews and heuristic evaluations were performed in order to identify potential usability issues. Finally, usability testing was conducted in order to validate that latent usability related design faults result in a higher frequency of NFF reporting. The analysis of medical equipment maintenance data identified six devices with a high NFF reporting frequency. Semi-structured interviews, heuristic evaluations and usability testing revealed that usability issues caused a significant portion of the NFF reports. Other factors suspected to contribute to increased NFF reporting include accessory issues, intermittent faults and environmental issues. Usability testing conducted on three of the devices revealed 23 latent usability related design faults. These findings demonstrate that latent usability related design faults manifest themselves as an increase in NFF reporting and that devices containing usability related design faults can be identified through an analysis of medical equipment maintenance data. Copyright © 2014 The Authors. Published by Elsevier Inc. All rights reserved.

Using Cluster Analysis to Extend Usability Testing to Instructional Content. CRESST Report 816

ERIC Educational Resources Information Center

Kerr, Deirdre S.; Chung, Gregory K. W. K.

2012-01-01

Commercial video games undergo usability studies to determine the degree to which the player is able to learn, control, and understand the game. Usability studies allow game designers to improve their games before they are released to the public. If usability studies could be expanded to include information about the presentation of the…

Usability Testing of a Multimedia e-Learning Resource for Electrolyte and Acid-Base Disorders

ERIC Educational Resources Information Center

Davids, Mogamat Razeen; Chikte, Usuf; Grimmer-Somers, Karen; Halperin, Mitchell L.

2014-01-01

The usability of computer interfaces may have a major influence on learning. Design approaches that optimize usability are commonplace in the software development industry but are seldom used in the development of e-learning resources, especially in medical education. We conducted a usability evaluation of a multimedia resource for teaching…

UserTesting.com: A Tool for Usability Testing of Online Resources

ERIC Educational Resources Information Center

Koundinya, Vikram; Klink, Jenna; Widhalm, Melissa

2017-01-01

Extension educators are increasingly using online resources in their program design and delivery. Usability testing is essential for ensuring that these resources are relevant and useful to learners. On the basis of our experiences with iteratively developing products using a testing service called UserTesting, we promote the use of fee-based…

Tree Testing of Hierarchical Menu Structures for Health Applications

PubMed Central

Le, Thai; Chaudhuri, Shomir; Chung, Jane; Thompson, Hilaire J; Demiris, George

2014-01-01

To address the need for greater evidence-based evaluation of Health Information Technology (HIT) systems we introduce a method of usability testing termed tree testing. In a tree test, participants are presented with an abstract hierarchical tree of the system taxonomy and asked to navigate through the tree in completing representative tasks. We apply tree testing to a commercially available health application, demonstrating a use case and providing a comparison with more traditional in-person usability testing methods. Online tree tests (N=54) and in-person usability tests (N=15) were conducted from August to September 2013. Tree testing provided a method to quantitatively evaluate the information structure of a system using various navigational metrics including completion time, task accuracy, and path length. The results of the analyses compared favorably to the results seen from the traditional usability test. Tree testing provides a flexible, evidence-based approach for researchers to evaluate the information structure of HITs. In addition, remote tree testing provides a quick, flexible, and high volume method of acquiring feedback in a structured format that allows for quantitative comparisons. With the diverse nature and often large quantities of health information available, addressing issues of terminology and concept classifications during the early development process of a health information system will improve navigation through the system and save future resources. Tree testing is a usability method that can be used to quickly and easily assess information hierarchy of health information systems. PMID:24582924

Design and implementation of a hospital-based usability laboratory: insights from a Department of Veterans Affairs laboratory for health information technology.

PubMed

Russ, Alissa L; Weiner, Michael; Russell, Scott A; Baker, Darrell A; Fahner, W Jeffrey; Saleem, Jason J

2012-12-01

Although the potential benefits of more usable health information technologies (HIT) are substantial-reduced HIT support costs, increased work efficiency, and improved patient safety--human factors methods to improve usability are rarely employed. The US Department of Veterans Affairs (VA) has emerged as an early leader in establishing usability laboratories to inform the design of HIT, including its electronic health record. Experience with a usability laboratory at a VA Medical Center provides insights on how to design, implement, and leverage usability laboratories in the health care setting. The VA Health Services Research and Development Service Human-Computer Interaction & Simulation Laboratory emerged as one of the first VA usability laboratories and was intended to provide research-based findings about HIT designs. This laboratory supports rapid prototyping, formal usability testing, and analysis tools to assess existing technologies, alternative designs, and potential future technologies. RESULTS OF IMPLEMENTATION: Although the laboratory has maintained a research focus, it has become increasingly integrated with VA operations, both within the medical center and on a national VA level. With this resource, data-driven recommendations have been provided for the design of HIT applications before and after implementation. The demand for usability testing of HIT is increasing, and information on how to develop usability laboratories for the health care setting is often needed. This article may assist other health care organizations that want to invest in usability resources to improve HIT. The establishment and utilization of usability laboratories in the health care setting may improve HIT designs and promote safe, high-quality care for patients.

Development of an Ecological Momentary Assessment Mobile App for a Low-Literacy, Mexican American Population to Collect Disordered Eating Behaviors

PubMed Central

Stein, Karen F; Chaudry, Beenish; Trabold, Nicole

2016-01-01

Background Ecological momentary assessment (EMA) is a popular method for understanding population health in which participants report their experiences while in naturally occurring contexts in order to increase the reliability and ecological validity of the collected data (as compared to retrospective recall). EMA studies, however, have relied primarily on text-based questionnaires, effectively eliminating low-literacy populations from the samples. Objective To provide a case study of design of an EMA mobile app for a low-literacy population. In particular, we present the design process and final design of an EMA mobile app for low literate, Mexican American women to record unhealthy eating and weight control behaviors (UEWCBs). Methods An iterative, user-centered design process was employed to develop the mobile app. An existing EMA protocol to measure UEWCBs in college-enrolled Mexican American women was used as the starting point for the application. The app utilizes an icon interface, with optional audio prompts, that is culturally sensitive and usable by a low-literacy population. A total of 41 women participated over the course of 4 phases of the design process, which included 2 interview and task-based phases (n=8, n=11), focus groups (n=15), and a 5-day, in situ deployment (n=7). Results Participants’ mental models of UEWCBs differed substantially from prevailing definitions found in the literature, prompting a major reorganization of the app interface. Differences in health literacy and numeracy were better identified with the Newest Vital Sign tool, as compared with the Short Assessment of Health Literacy tool. Participants had difficulty imagining scenarios in the interviews to practice recording a specific UEWCB; instead, usability was best tested in situ. Participants were able to use the EMA mobile app over the course of 5 days to record UEWCBs. Conclusions Results suggest that the iterative, user-centered design process was essential for designing the app to be made usable by the target population. Simply taking the protocol designed for a higher-literacy population and replacing words with icons and/or audio would have been unsuccessful with this population. PMID:27418020

Usability testing of a monitoring and feedback tool to stimulate physical activity.

PubMed

van der Weegen, Sanne; Verwey, Renée; Tange, Huibert J; Spreeuwenberg, Marieke D; de Witte, Luc P

2014-01-01

A MONITORING AND FEEDBACK TOOL TO STIMULATE PHYSICAL ACTIVITY, CONSISTING OF AN ACTIVITY SENSOR, SMARTPHONE APPLICATION (APP), AND WEBSITE FOR PATIENTS AND THEIR PRACTICE NURSES, HAS BEEN DEVELOPED: the 'It's LiFe!' tool. In this study the usability of the tool was evaluated by technology experts and end users (people with chronic obstructive pulmonary disease or type 2 diabetes, with ages from 40-70 years), to improve the user interfaces and content of the tool. THE STUDY HAD FOUR PHASES: 1) a heuristic evaluation with six technology experts; 2) a usability test in a laboratory by five patients; 3) a pilot in real life wherein 20 patients used the tool for 3 months; and 4) a final lab test by five patients. In both lab tests (phases 2 and 4) qualitative data were collected through a thinking-aloud procedure and video recordings, and quantitative data through questions about task complexity, text comprehensiveness, and readability. In addition, the post-study system usability questionnaire (PSSUQ) was completed for the app and the website. In the pilot test (phase 3), all patients were interviewed three times and the Software Usability Measurement Inventory (SUMI) was completed. After each phase, improvements were made, mainly to the layout and text. The main improvement was a refresh button for active data synchronization between activity sensor, app, and server, implemented after connectivity problems in the pilot test. The mean score on the PSSUQ for the website improved from 5.6 (standard deviation [SD] 1.3) to 6.5 (SD 0.5), and for the app from 5.4 (SD 1.5) to 6.2 (SD 1.1). Satisfaction in the pilot was not very high according to the SUMI. The use of laboratory versus real-life tests and expert-based versus user-based tests revealed a wide range of usability issues. The usability of the It's LiFe! tool improved considerably during the study.

Development of a personal digital assistant-based wireless application in clinical practice.

PubMed

Chen, Yen-Cheng; Chiu, Hou-Chang; Tsai, Ming-Dar; Chang, Hang; Chong, Chee-Fah

2007-02-01

Our study aims to develop a personal digital assistant (PDA)-based wireless application in medical information processing by using Bluetooth and IEEE 802.11b wireless standards and SyncML codes. In this study, an "integrated database access module" is used to provide a unified integrated access interface while consistency of wireless data transmission is achieved by using the standardized SyncML protocol. A prototype of the system has been developed, implemented, and tested for its mobility, usability, stability, and performance with questionnaire survey. Response time for browsing/searching was usually less than 3s. The average time intervals needed for data transmissions were 68.6+/-8.5s for Bluetooth and 47.0+/-4.8s for 802.11b. The five-point Likert scale (from 1=least to 5=most) questionnaire survey of 30 medical professionals yielded a high degree of satisfaction with the system's mobility (4.18+/-0.89), usability (4.69+/-0.90), stability (3.81+/-0.94), and performance (3.97+/-0.88). The results of our study suggested that PDA applications which exploit wireless communication are convenient and feasible in clinical practice.

Determining the Number of Participants Needed for the Usability Evaluation of E-Learning Resources: A Monte Carlo Simulation

ERIC Educational Resources Information Center

Davids, Mogamat Razeen; Harvey, Justin; Halperin, Mitchell L.; Chikte, Usuf M. E.

2015-01-01

The usability of computer interfaces has a major influence on learning. Optimising the usability of e-learning resources is therefore essential. However, this may be neglected because of time and monetary constraints. User testing is a common approach to usability evaluation and involves studying typical end-users interacting with the application…

Usability of a home-based test for the measurement of fecal calprotectin in asymptomatic IBD patients.

PubMed

Bello, Caroline; Roseth, Arne; Guardiola, Jordi; Reenaers, Catherine; Ruiz-Cerulla, Alexandra; Van Kemseke, Catherine; Arajol, Claudia; Reinhard, Christian; Seidel, Laurence; Louis, Edouard

2017-09-01

The aim of our work was to test the usability of fecal calprotectin (FC) home-based test in inflammatory bowel disease (IBD) patients. IBD patients were prospectively recruited. They had to measure FC with a dedicated tool and smartphone application, 5 times at two weeks intervals over an 8 weeks period. They had to fill in a usability questionnaire at the first and the last FC measurement. A System Usability Scale (SUS: 0-100) and the Global Score of Usability (GSU: 0-85) were calculated. FC was also centrally measured by ELISA. Fifty-eight patients were recruited. Forty-two performed at least one FC measurement and 27 performed all the FC requested measurements. The median (IQR) SUS (0-100) at the first and last use were 85 (78-90) and 81 (70-88), respectively; the median (IQR) GSU (0-85) at the first and last use were 74 (69-80) and 77 (68-83), respectively. Adherence to the planned measurements and usability of the tool were higher in females and in less severe disease. The intra-class correlation coefficient between home-based and centrally measured FC was 0.88. The adherence to home-based measurement of FC was fair. Usability scores for the home-based test were high. There was a good correlation with the centrally measured FC by ELISA. Copyright © 2017 Editrice Gastroenterologica Italiana S.r.l. Published by Elsevier Ltd. All rights reserved.

Human Factors for Nursing: From In-Situ Testing to Mobile Usability Engineering.

PubMed

Kushniruk, Andre W; Borycki, Elizabeth M; Solvoll, Terje; Hullin, Carola

2016-01-01

The tutorial goal is to familiarize participants with human aspects of health informatics and human-centered approaches to the design, evaluation and deployment of both usable and safe healthcare information systems. The focus will be on demonstrating and teaching practical and low-cost methods for evaluating mobile applications in nursing. Basic background to testing methods will be provided, followed by live demonstration of the methods. Then the audience will break into small groups to explore the application of the methods to applications of interest (there will be a number of possible applications that will be available for applications in areas such as electronic health records and decision support, however, if the groups have applications of specific interest to them that will be possible). The challenges of conducting usability testing, and in particular mobile usability testing will be discussed along with practical solutions. The target audience includes practicing nurses and nurse researchers, nursing informatics specialists, nursing students, nursing managers and health informatics professionals interested in improving the usability and safety of healthcare applications.

Applying User-Centered Design Methods to the Development of an mHealth Application for Use in the Hospital Setting by Patients and Care Partners.

PubMed

Couture, Brittany; Lilley, Elizabeth; Chang, Frank; DeBord Smith, Ann; Cleveland, Jessica; Ergai, Awatef; Katsulis, Zachary; Benneyan, James; Gershanik, Esteban; Bates, David W; Collins, Sarah A

2018-04-01

 Developing an optimized and user-friendly mHealth application for patients and family members in the hospital environment presents unique challenges given the diverse patient population and patients' various states of well-being.  This article describes user-centered design methods and results for developing the patient and family facing user interface and functionality of MySafeCare, a safety reporting tool for hospitalized patients and their family members.  Individual and group usability sessions were conducted with specific testing scenarios for participants to follow to test the usability and functionality of the tool. Participants included patients, family members, and Patient and Family Advisory Council (PFAC) members. Engagement rounds were also conducted on study units and lessons learned provided additional information to the usability work. Usability results were aligned with Nielsen's Usability Heuristics.  Eleven patients and family members and 25 PFAC members participated in usability testing and over 250 patients and family members were engaged during research team rounding. Specific themes resulting from the usability testing sessions influenced the changes made to the user interface design, workflow functionality, and terminology.  User-centered design should focus on workflow functionality, terminology, and user interface issues for mHealth applications. These themes illustrated issues aligned with four of Nielsen's Usability Heuristics: match between system and the real world, consistency and standards, flexibility and efficiency of use, and aesthetic and minimalist design. We identified workflow and terminology issues that may be specific to the use of an mHealth application focused on safety and used by hospitalized patients and their families. Schattauer GmbH Stuttgart.

Translation, Cross-Cultural Adaptation, and Validation of the Malay Version of the System Usability Scale Questionnaire for the Assessment of Mobile Apps.

PubMed

Mohamad Marzuki, Muhamad Fadhil; Yaacob, Nor Azwany; Yaacob, Najib Majdi

2018-05-14

A mobile app is a programmed system designed to be used by a target user on a mobile device. The usability of such a system refers not only to the extent to which product can be used to achieve the task that it was designed for, but also its effectiveness and efficiency, as well as user satisfaction. The System Usability Scale is one of the most commonly used questionnaires used to assess the usability of a system. The original 10-item version of System Usability Scale was developed in English and thus needs to be adapted into local languages to assess the usability of a mobile apps developed in other languages. The aim of this study is to translate and validate (with cross-cultural adaptation) the English System Usability Scale questionnaire into Malay, the main language spoken in Malaysia. The development of a translated version will allow the usability of mobile apps to be assessed in Malay. Forward and backward translation of the questionnaire was conducted by groups of Malay native speakers who spoke English as their second language. The final version was obtained after reconciliation and cross-cultural adaptation. The content of the Malay System Usability Scale questionnaire for mobile apps was validated by 10 experts in mobile app development. The efficacy of the questionnaire was further probed by testing the face validity on 10 mobile phone users, followed by reliability testing involving 54 mobile phone users. The content validity index was determined to be 0.91, indicating good relevancy of the 10 items used to assess the usability of a mobile app. Calculation of the face validity index resulted in a value of 0.94, therefore indicating that the questionnaire was easily understood by the users. Reliability testing showed a Cronbach alpha value of .85 (95% CI 0.79-0.91) indicating that the translated System Usability Scale questionnaire is a reliable tool for the assessment of usability of a mobile app. The Malay System Usability Scale questionnaire is a valid and reliable tool to assess the usability of mobile app in Malaysia. ©Muhamad Fadhil Mohamad Marzuki, Nor Azwany Yaacob, Najib Majdi Yaacob. Originally published in JMIR Human Factors (http://humanfactors.jmir.org), 14.05.2018.

Designing an Affordable Usability Test for E-Learning Modules

ERIC Educational Resources Information Center

O'Bryan, Corliss A.; Johnson, Donald M.; Shores-Ellis, Katrina D.; Crandall, Philip G.; Marcy, John A.; Seideman, Steve C.; Ricke, Steven C.

2010-01-01

This article provides background and an introduction to a user-centered design and usability test in an inexpensive format that allows content experts who are novices in e-learning development to perform testing on newly developed technical training modules prior to their release. The use of a small number of test participants, avoidance of…

Enhancing the Usability of an Optical Reader System to Support Point-of-Care Rapid Diagnostic Testing: An Iterative Design Approach.

PubMed

Hohenstein, Jess; O'Dell, Dakota; Murnane, Elizabeth L; Lu, Zhengda; Erickson, David; Gay, Geri

2017-11-21

In today's health care environment, increasing costs and inadequate medical resources have created a worldwide need for more affordable diagnostic tools that are also portable, fast, and easy to use. To address this issue, numerous research and commercial efforts have focused on developing rapid diagnostic technologies; however, the efficacy of existing systems has been hindered by usability problems or high production costs, making them infeasible for deployment in at-home, point-of-care (POC), or resource-limited settings. The aim of this study was to create a low-cost optical reader system that integrates with any smart device and accepts any type of rapid diagnostic test strip to provide fast and accurate data collection, sample analysis, and diagnostic result reporting. An iterative design methodology was employed by a multidisciplinary research team to engineer three versions of a portable diagnostic testing device that were evaluated for usability and overall user receptivity. Repeated design critiques and usability studies identified a number of system requirements and considerations (eg, software compatibility, biomatter contamination, and physical footprint) that we worked to incrementally incorporate into successive system variants. Our final design phase culminated in the development of Tidbit, a reader that is compatible with any Wi-Fi-enabled device and test strip format. The Tidbit includes various features that support intuitive operation, including a straightforward test strip insertion point, external indicator lights, concealed electronic components, and an asymmetric shape, which inherently signals correct device orientation. Usability testing of the Tidbit indicates high usability for potential user communities. This study presents the design process, specification, and user reception of the Tidbit, an inexpensive, easy-to-use, portable optical reader for fast, accurate quantification of rapid diagnostic test results. Usability testing suggests that the reader is usable among and can benefit a wide group of potential users, including in POC contexts. Generally, the methodology of this study demonstrates the importance of testing these types of systems with potential users and exemplifies how iterative design processes can be employed by multidisciplinary research teams to produce compelling technological solutions. ©Jess Hohenstein, Dakota O'Dell, Elizabeth L Murnane, Zhengda Lu, David Erickson, Geri Gay. Originally published in JMIR Human Factors (http://humanfactors.jmir.org), 21.11.2017.

Usability evaluation of the interactive Personal Patient Profile-Prostate decision support system with African American men.

PubMed

Jaja, Cheedy; Pares-Avila, Jose; Wolpin, Seth; Berry, Donna

2010-04-01

The Personal Patient Profile-Prostate (P4) program is an interactive Web-based decision support system that provides men with localized prostate cancer customized education and coaching with which to make the best personal treatment decision. This study assessed functionality and usability of the P4 program and identified problems in user-computer interaction in a sample of African American men. Usability testing was conducted with 12 community-dwelling African American adult men. The health status of participants was not known or collected by the research team. Each participant worked with the P4 program and provided simultaneous feedback using the "think aloud" technique. Handwritten field notes were collated and assigned to 3 standard coded categories. Aspects of P4 program usability was made based on common issues in the assigned categories. Summary statistics were derived for types and frequency of usability issues noted in the coded data. Twelve participants reported a total of 122 usability comments, with a mean of 9 usability comments. The most common usability issue by participant was completeness of information content, which comprised 53 (43%) of the total issues. Comprehensibility of text and graphics was second, comprising 51 (42%) of the total issues. This study provided initial inventory of usability issues for community African American men that may potentially interfere with application of the P4 system in the community setting and overall system usability, confirming the need for usability testing of a culturally appropriate Internet-based decision support system before community application.

Development of a web-based executive functioning intervention for adolescents with epilepsy: The Epilepsy Journey.

PubMed

Modi, Avani C; Schmidt, Matthew; Smith, Aimee W; Turnier, Luke; Glaser, Noah; Wade, Shari L

2017-07-01

Youth with epilepsy exhibit significant deficits in executive functioning (EF), yet there are few interventions to improve EF for adolescents. The aims of the current study were to develop an individually-tailored intervention, called Epilepsy Journey, to improve aspects of EF through an iterative, patient-centered process including focus groups and usability testing. Five adolescents and caregivers participated in focus groups. This input was used to develop ten learning modules based on subscales of the Behavioral Rating Inventory of Executive Functions and key issues that may impact EF in adolescents. Six adolescents participated in usability testing and a usability expert conducted a heuristic evaluation. Demographic information, chart reviews and measures of EF were also completed. Focus group participants and their parents reported difficulties with memory, attention, organization, monitoring, initiation, impulsivity, emotional control, sleep, awareness in schools and managing stress. They also identified successful strategies to address memory and organizational difficulties. Usability testing of the resultant Epilepsy Journey modules revealed problems with navigation and identified features that promoted usability, including progress bars and interactive modules. Program modifications were made after each usability trial resulting in a relatively brief, interactive and readily navigable program. Perceived utility was high with all but one participant. Participants rated the content as helpful and indicated they would recommend Epilepsy Journey to others. Feedback from the focus group and usability testing yielded a feasible, acceptable, relevant and user-friendly web-based intervention for adolescents with epilepsy. The Epilepsy Journey program will be further tested in an open pilot with adolescents with epilepsy and associated EF deficits. Copyright © 2017 Elsevier Inc. All rights reserved.

Usability testing of ANSWER: a web-based methotrexate decision aid for patients with rheumatoid arthritis

PubMed Central

2013-01-01

Background Decision aids are evidence-based tools designed to inform people of the potential benefit and harm of treatment options, clarify their preferences and provide a shared decision-making structure for discussion at a clinic visit. For patients with rheumatoid arthritis (RA) who are considering methotrexate, we have developed a web-based patient decision aid called the ANSWER (Animated, Self-serve, Web-based Research Tool). This study aimed to: 1) assess the usability of the ANSWER prototype; 2) identify strengths and limitations of the ANSWER from the patient’s perspective. Methods The ANSWER prototype consisted of: 1) six animated patient stories and narrated information on the evidence of methotrexate for RA; 2) interactive questionnaires to clarify patients’ treatment preferences. Eligible participants for the usability test were patients with RA who had been prescribed methotrexate. They were asked to verbalize their thoughts (i.e., think aloud) while using the ANSWER, and to complete the System Usability Scale (SUS) to assess overall usability (range = 0-100; higher = more user friendly). Participants were audiotaped and observed, and field notes were taken. The testing continued until no new modifiable issues were found. We used descriptive statistics to summarize participant characteristics and the SUS scores. Content analysis was used to identified usability issues and navigation problems. Results 15 patients participated in the usability testing. The majority were aged 50 or over and were university/college graduates (n = 8, 53.4%). On average they took 56 minutes (SD = 34.8) to complete the tool. The mean SUS score was 81.2 (SD = 13.5). Content analysis of audiotapes and field notes revealed four categories of modifiable usability issues: 1) information delivery (i.e., clarity of the information and presentation style); 2) navigation control (i.e., difficulties in recognizing and using the navigation control buttons); 3) layout (i.e., position of the videos, text, diagrams and navigation buttons); 4) aesthetic (i.e., the colour, look and feel of the online tool). Conclusions Although the SUS score indicated high usability before and after major modification, findings from the think-aloud sessions illustrated areas that required further refinement. Our results highlight the importance of formative evaluation in usability testing. PMID:24289731

Usability evaluation with mental health professionals and young people to develop an Internet-based cognitive-behaviour therapy program for adolescents with anxiety disorders.

PubMed

Wozney, Lori; Baxter, Pamela; Newton, Amanda S

2015-12-16

Use of the Internet to deliver cognitive behavioural therapy, a frontline treatment for anxiety disorders, is emerging as an option to increase access to treatment among adolescents with anxiety disorders. This study examined the usability of the Internet-based component of Breathe, a CBT program designed for adolescents with mild to moderate anxiety and impairments. A mixed-method usability testing design with semi-structured interviews, task completion, and survey by trained usability moderators was undertaken with two interactive cycles to determine the usability (ease of use, efficiency, errors, and user satisfaction) of the user interface and content areas of the program. Purposeful sampling was used to recruit mental health clinicians with expertise in treating adolescent anxiety disorders and young people aged 15 to 24 years involved. Testing involved using Web-conferencing software that allowed remote participation through personal computers. Two testing cycles involved participants completing structured 'think aloud' and 'cognitive walkthrough' tasks within the program. At the end of each cycle participants completed a 15-item global usability evaluation survey and were asked a series of open-ended questions. Descriptive and simple content analyses were used to identify and score usability issues for frequency and severity. Five clinicians and four young people (all < 20 years of age) participated. Most participants described their computer skills as 'good' (60% clinicians, 50% young people), and attitudes toward Internet-based health care ranged from negative (75% young people) to positive (60% clinicians, 25% young people). Scores from the global usability evaluation after both testing cycles ranged from 3.5 to 5 out of 5 in strong agreement/support of the program in terms of user performance indicators (i.e., learnability, efficiency and number of errors) and user satisfaction. Participants were able to complete all critical tasks with minimal errors. Errors and issues identified during testing were predominantly around enhancements to the visual design and navigational support. Opinions across usability elements did not differ between young people and clinician participants. A multi-method remote usability approach provided the opportunity to improve the technical interface, therapeutic messaging and user experience of an Internet-based treatment program for adolescent anxiety disorders.

Usability testing of ANSWER: a web-based methotrexate decision aid for patients with rheumatoid arthritis.

PubMed

Li, Linda C; Adam, Paul M; Townsend, Anne F; Lacaille, Diane; Yousefi, Charlene; Stacey, Dawn; Gromala, Diane; Shaw, Chris D; Tugwell, Peter; Backman, Catherine L

2013-12-01

Decision aids are evidence-based tools designed to inform people of the potential benefit and harm of treatment options, clarify their preferences and provide a shared decision-making structure for discussion at a clinic visit. For patients with rheumatoid arthritis (RA) who are considering methotrexate, we have developed a web-based patient decision aid called the ANSWER (Animated, Self-serve, Web-based Research Tool). This study aimed to: 1) assess the usability of the ANSWER prototype; 2) identify strengths and limitations of the ANSWER from the patient's perspective. The ANSWER prototype consisted of: 1) six animated patient stories and narrated information on the evidence of methotrexate for RA; 2) interactive questionnaires to clarify patients' treatment preferences. Eligible participants for the usability test were patients with RA who had been prescribed methotrexate. They were asked to verbalize their thoughts (i.e., think aloud) while using the ANSWER, and to complete the System Usability Scale (SUS) to assess overall usability (range = 0-100; higher = more user friendly). Participants were audiotaped and observed, and field notes were taken. The testing continued until no new modifiable issues were found. We used descriptive statistics to summarize participant characteristics and the SUS scores. Content analysis was used to identified usability issues and navigation problems. 15 patients participated in the usability testing. The majority were aged 50 or over and were university/college graduates (n = 8, 53.4%). On average they took 56 minutes (SD = 34.8) to complete the tool. The mean SUS score was 81.2 (SD = 13.5). Content analysis of audiotapes and field notes revealed four categories of modifiable usability issues: 1) information delivery (i.e., clarity of the information and presentation style); 2) navigation control (i.e., difficulties in recognizing and using the navigation control buttons); 3) layout (i.e., position of the videos, text, diagrams and navigation buttons); 4) aesthetic (i.e., the colour, look and feel of the online tool). Although the SUS score indicated high usability before and after major modification, findings from the think-aloud sessions illustrated areas that required further refinement. Our results highlight the importance of formative evaluation in usability testing.

Usability in the real world: assessing medical information technologies in patients' homes.

PubMed

Kaufman, David R; Patel, Vimla L; Hilliman, Charlyn; Morin, Philip C; Pevzner, Jenia; Weinstock, Ruth S; Goland, Robin; Shea, Steven; Starren, Justin

2003-01-01

This paper presents an approach to usability evaluation of computer-based health care systems designed for patient use in their homes. Although such devices are becoming more prevalent, there is very little known about their usability. The theoretical foundations for the methods are discussed. The approach incorporates a cognitive walkthrough usability evaluation and new methods for usability testing that can be conducted in patient's homes. The method was applied to the IDEATel intervention, a multi-institution randomized controlled trial of the feasibility, acceptability, and clinical utility of a home-based telemedicine system for diabetic Medicare population. The usability study was designed to assess barriers to optimal use of the system. The focus was both on dimensions of the interface and on dimensions of patient skills and competency. The usability field research involved testing 25 patients in their homes using the system. The analysis included a range of video-analytic methods of varying levels of granularity. The usability evaluation revealed aspects of the interface that were sub-optimal and impeded the performance of certain tasks. It also found a range of patient-related factors such as numeracy and psychomotor skills that constituted barriers to productive use. A multifaceted usability approach provided important insight regarding use of technology by an elderly chronic-care patient population and more generally, for understanding how home health initiatives can more effectively use such technology.

The value of usability testing for Internet-based adolescent self-management interventions: "Managing Hemophilia Online".

PubMed

Breakey, Vicky R; Warias, Ashley V; Ignas, Danial M; White, Meghan; Blanchette, Victor S; Stinson, Jennifer N

2013-10-04

As adolescents with hemophilia approach adulthood, they are expected to assume responsibility for their disease management. A bilingual (English and French) Internet-based self-management program, "Teens Taking Charge: Managing Hemophilia Online," was developed to support adolescents with hemophilia in this transition. This study explored the usability of the website and resulted in refinement of the prototype. A purposive sample (n=18; age 13-18; mean age 15.5 years) was recruited from two tertiary care centers to assess the usability of the program in English and French. Qualitative observations using a "think aloud" usability testing method and semi-structured interviews were conducted in four iterative cycles, with changes to the prototype made as necessary following each cycle. This study was approved by research ethics boards at each site. Teens responded positively to the content and appearance of the website and felt that it was easy to navigate and understand. The multimedia components (videos, animations, quizzes) were felt to enrich the experience. Changes to the presentation of content and the website user-interface were made after the first, second and third cycles of testing in English. Cycle four did not result in any further changes. Overall, teens found the website to be easy to use. Usability testing identified end-user concerns that informed improvements to the program. Usability testing is a crucial step in the development of Internet-based self-management programs to ensure information is delivered in a manner that is accessible and understood by users.

A comparison of usability factors of four mobile devices for accessing healthcare information by adolescents.

PubMed

Sheehan, B; Lee, Y; Rodriguez, M; Tiase, V; Schnall, R

2012-01-01

Mobile health (mHealth) is a growing field aimed at developing mobile information and communication technologies for healthcare. Adolescents are known for their ubiquitous use of mobile technologies in everyday life. However, the use of mHealth tools among adolescents is not well described. We examined the usability of four commonly used mobile devices (an iPhone, an Android with touchscreen keyboard, an Android with built-in keyboard, and an iPad) for accessing healthcare information among a group of urban-dwelling adolescents. Guided by the FITT (Fit between Individuals, Task, and Technology) framework, a thinkaloud protocol was combined with a questionnaire to describe usability on three dimensions: 1) task-technology fit; 2) individual-technology fit; and 3) individual-task fit. For task-technology fit, we compared the efficiency, and effectiveness of each of the devices tested and found that the iPhone was the most usable had the fewest errors and prompts and had the lowest mean overall task time For individual-task fit, we compared efficiency and learnability measures by website tasks and found no statistically significant effect on tasks steps, task time and number of errors. Following our comparison of success rates by website tasks, we compared the difference between two mobile applications which were used for diet tracking and found statistically significant effect on tasks steps, task time and number of errors. For individual-technology fit, interface quality was significantly different across devices indicating that this is an important factor to be considered in developing future mobile devices. All of our users were able to complete all of the tasks, however the time needed to complete the tasks was significantly different by mobile device and mHealth application. Future design of mobile technology and mHealth applications should place particular importance on interface quality.

Testing the Feasibility and Usability of a Novel Smartphone-Based Self-Management Support System for Dialysis Patients: A Pilot Study.

PubMed

Hayashi, Aki; Yamaguchi, Satoko; Waki, Kayo; Fujiu, Katsuhito; Hanafusa, Norio; Nishi, Takahiro; Tomita, Hyoe; Kobayashi, Haruka; Fujita, Hideo; Kadowaki, Takashi; Nangaku, Masaomi; Ohe, Kazuhiko

2017-04-20

Diet and fluid restrictions that need continuous self-management are among the most difficult aspects of dialysis treatment. Smartphone applications may be useful for supporting self-management. Our objective is to investigate the feasibility and usability of a novel smartphone-based self-management support system for dialysis patients. We developed the Self-Management and Recording System for Dialysis (SMART-D), which supports self-monitoring of three mortality-related factors that can be modified by lifestyle: interdialytic weight gain and predialysis serum potassium and phosphorus concentrations. Data is displayed graphically, with all data evaluated automatically to determine whether they achieve the values suggested by the Japanese Society for Dialysis Therapy guidelines. In a pilot study, 9 dialysis patients used SMART-D system for 2 weeks. A total of 7 of them completed questionnaires rating their assessment of SMART-D's usability and their satisfaction with the system. In addition, the Kidney Disease Quality of Life scale was compared before and after the study period. All 9 participants were able to use SMART-D with no major problems. Completion rates for body weight, pre- and postdialysis weight, and serum potassium and phosphorus concentrations were, respectively, 89% (SD 23), 95% (SD 7), and 78% (SD 44). Of the 7 participants who completed the usability survey, all were motivated by the sense of security derived from using the system, and 6 of the 7 (86%) reported that using SMART-D helped improve their lifestyle and self-management. Using SMART-D was feasible, and the system was well regarded by patients. Further study with larger scale cohorts and longer study and follow-up periods is needed to evaluate the effects of SMART-D on clinical outcomes and quality of life. ©Aki Hayashi, Satoko Yamaguchi, Kayo Waki, Katsuhito Fujiu, Norio Hanafusa, Takahiro Nishi, Hyoe Tomita, Haruka Kobayashi, Hideo Fujita, Takashi Kadowaki, Masaomi Nangaku, Kazuhiko Ohe. Originally published in JMIR Research Protocols (http://www.researchprotocols.org), 20.04.2017.

Advocating for Greater Usability in Clinical Technologies: The Role of the Practicing Nurse.

PubMed

Lopez, Karen Dunn; Fahey, Linda

2018-06-01

Health care, especially ICUs, rely on multiple types of technology to promote the best patient outcomes. Unfortunately, too often these technologies are poorly designed, causing errors, additional workload, and unnecessary frustration. The purpose of this article is to (1) empower nurses with the needed usability and usability testing vocabulary to identify and articulate clinical technology usability problems and (2) provide ideas on ways nurses can advocate to have an impact on positive change related to technology usability within a health care organization. Copyright © 2018 Elsevier Inc. All rights reserved.

Evaluating Web Usability

ERIC Educational Resources Information Center

Snider, Jean; Martin, Florence

2012-01-01

Web usability focuses on design elements and processes that make web pages easy to use. A website for college students was evaluated for underutilization. One-on-one testing, focus groups, web analytics, peer university review and marketing focus group and demographic data were utilized to conduct usability evaluation. The results indicated that…

Barriers to comparing the usability of electronic health records.

PubMed

Ratwani, Raj M; Hettinger, A Zachary; Fairbanks, Rollin J

2017-04-01

Despite the widespread adoption of electronic health records (EHRs), usability of many EHRs continues to be suboptimal, with some vendors failing to meet usability standards, resulting in clinician frustration and patient safety hazards. In an effort to increase EHR vendor competition on usability, recommendations have been made and legislation drafted to develop comparison tools that would allow purchasers to better understand the usability of EHR products prior to purchase. Usability comparison can be based on EHR vendor design and development processes, vendor usability testing as part of the Office of the National Coordinator for Health Information Technology certification program, and usability of implemented products. Barriers exist within the current certified health technology program that prevent effective comparison of usability during each of these stages. We describe the importance of providing purchasers with improved information about EHR usability, barriers to making usability comparisons, and solutions to overcome these barriers. © The Author 2016. Published by Oxford University Press on behalf of the American Medical Informatics Association. All rights reserved. For Permissions, please email: journals.permissions@oup.com.

Usability study of a computer-based self-management system for older adults with chronic diseases.

PubMed

Or, Calvin; Tao, Da

2012-11-08

Usability can influence patients' acceptance and adoption of a health information technology. However, little research has been conducted to study the usability of a self-management health care system, especially one geared toward elderly patients. This usability study evaluated a new computer-based self-management system interface for older adults with chronic diseases, using a paper prototype approach. Fifty older adults with different chronic diseases participated. Two usability evaluation methods were involved: (1) a heuristics evaluation and (2) end-user testing with a think-aloud testing method, audio recording, videotaping, and interviewing. A set of usability metrics was employed to determine the overall system usability, including task incompletion rate, task completion time, frequency of error, frequency of help, satisfaction, perceived usefulness, and perceived ease of use. Interviews were used to elicit participants' comments on the system design. The quantitative data were analyzed using descriptive statistics and the qualitative data were analyzed for content. The participants were able to perform the predesigned self-management tasks with the current system design and they expressed mostly positive responses about the perceived usability measures regarding the system interface. However, the heuristics evaluation, performance measures, and interviews revealed a number of usability problems related to system navigation, information search and interpretation, information presentation, and readability. Design recommendations for further system interface modifications were discussed. This study verified the usability of the self-management system developed for older adults with chronic diseases. Also, we demonstrated that our usability evaluation approach could be used to quickly and effectively identify usability problems in a health care information system at an early stage of the system development process using a paper prototype. Conducting a usability evaluation is an essential step in system development to ensure that the system features match the users' true needs, expectations, and characteristics, and also to minimize the likelihood of the users committing user errors and having difficulties using the system.

Usability Study of a Computer-Based Self-Management System for Older Adults with Chronic Diseases

PubMed Central

Tao, Da

2012-01-01

Background Usability can influence patients’ acceptance and adoption of a health information technology. However, little research has been conducted to study the usability of a self-management health care system, especially one geared toward elderly patients. Objective This usability study evaluated a new computer-based self-management system interface for older adults with chronic diseases, using a paper prototype approach. Methods Fifty older adults with different chronic diseases participated. Two usability evaluation methods were involved: (1) a heuristics evaluation and (2) end-user testing with a think-aloud testing method, audio recording, videotaping, and interviewing. A set of usability metrics was employed to determine the overall system usability, including task incompletion rate, task completion time, frequency of error, frequency of help, satisfaction, perceived usefulness, and perceived ease of use. Interviews were used to elicit participants’ comments on the system design. The quantitative data were analyzed using descriptive statistics and the qualitative data were analyzed for content. Results The participants were able to perform the predesigned self-management tasks with the current system design and they expressed mostly positive responses about the perceived usability measures regarding the system interface. However, the heuristics evaluation, performance measures, and interviews revealed a number of usability problems related to system navigation, information search and interpretation, information presentation, and readability. Design recommendations for further system interface modifications were discussed. Conclusions This study verified the usability of the self-management system developed for older adults with chronic diseases. Also, we demonstrated that our usability evaluation approach could be used to quickly and effectively identify usability problems in a health care information system at an early stage of the system development process using a paper prototype. Conducting a usability evaluation is an essential step in system development to ensure that the system features match the users’ true needs, expectations, and characteristics, and also to minimize the likelihood of the users committing user errors and having difficulties using the system. PMID:23612015

Perceptions of Older Adults with Heart Failure on Playing an Interactive Digital e-Health Game (IDEG) for Learning About Heart Failure (HF): Prototype Development and Usability Testing.

PubMed

Radhakrishnan, Kavita; Toprac, Paul; O'Hair, Matt; Bias, Randolph; Mackert, Mike; Xie, Bo; Kim, Miyong; Bradley, Paul

2016-01-01

Effective self-management can decrease up to 50% of heart failure (HF) hospitalizations. However, self-management by patients with HF remains poor. We describe the development and usability testing of an interactive digital e-health game (IDEG) for older patients with HF in Central Texas, USA. Majority of the participants (5 out of 6) who participated in the usability testing found the game interesting, enjoyable and helpful to play. Developing an IDEG that is satisfying and acceptable to older adults with HF is feasible.

APRN Usability Testing of a Tailored Computer-Mediated Health Communication Program

PubMed Central

Lin, Carolyn A.; Neafsey, Patricia J.; Anderson, Elizabeth

2010-01-01

This study tested the usability of a touch-screen enabled “Personal Education Program” (PEP) with Advanced Practice Registered Nurses (APRN). The PEP is designed to enhance medication adherence and reduce adverse self-medication behaviors in older adults with hypertension. An iterative research process was employed, which involved the use of: (1) pre-trial focus groups to guide the design of system information architecture, (2) two different cycles of think-aloud trials to test the software interface, and (3) post-trial focus groups to gather feedback on the think-aloud studies. Results from this iterative usability testing process were utilized to systematically modify and improve the three PEP prototype versions—the pilot, Prototype-1 and Prototype-2. Findings contrasting the two separate think-aloud trials showed that APRN users rated the PEP system usability, system information and system-use satisfaction at a moderately high level between trials. In addition, errors using the interface were reduced by 76 percent and the interface time was reduced by 18.5 percent between the two trials. The usability testing processes employed in this study ensured an interface design adapted to APRNs' needs and preferences to allow them to effectively utilize the computer-mediated health-communication technology in a clinical setting. PMID:19940619

Measuring the Usability of Augmented Reality e-Learning Systems: A User-Centered Evaluation Approach

NASA Astrophysics Data System (ADS)

Pribeanu, Costin; Balog, Alexandru; Iordache, Dragoş Daniel

The development of Augmented Reality (AR) systems is creating new challenges and opportunities for the designers of e-learning systems. The mix of real and virtual requires appropriate interaction techniques that have to be evaluated with users in order to avoid usability problems. Formative usability aims at finding usability problems as early as possible in the development life cycle and is suitable to support the development of such novel interactive systems. This work presents an approach to the user-centered usability evaluation of an e-learning scenario for Biology developed on an Augmented Reality educational platform. The evaluation has been carried on during and after a summer school held within the ARiSE research project. The basic idea was to perform usability evaluation twice. In this respect, we conducted user testing with a small number of students during the summer school in order to get a fast feedback from users having good knowledge in Biology. Then, we repeated the user testing in different conditions and with a relatively larger number of representative users. In this paper we describe both experiments and compare the usability evaluation results.

A Guided Online and Mobile Self-Help Program for Individuals With Eating Disorders: An Iterative Engagement and Usability Study.

PubMed

Nitsch, Martina; Dimopoulos, Christina N; Flaschberger, Edith; Saffran, Kristina; Kruger, Jenna F; Garlock, Lindsay; Wilfley, Denise E; Taylor, Craig B; Jones, Megan

2016-01-11

Numerous digital health interventions have been developed for mental health promotion and intervention, including eating disorders. Efficacy of many interventions has been evaluated, yet knowledge about reasons for dropout and poor adherence is scarce. Most digital health intervention studies lack appropriate research design and methods to investigate individual engagement issues. User engagement and program usability are inextricably linked, making usability studies vital in understanding and improving engagement. The aim of this study was to explore engagement and corresponding usability issues of the Healthy Body Image Program-a guided online intervention for individuals with body image concerns or eating disorders. The secondary aim was to demonstrate the value of usability research in order to investigate engagement. We conducted an iterative usability study based on a mixed-methods approach, combining cognitive and semistructured interviews as well as questionnaires, prior to program launch. Two separate rounds of usability studies were completed, testing a total of 9 potential users. Thematic analysis and descriptive statistics were used to analyze the think-aloud tasks, interviews, and questionnaires. Participants were satisfied with the overall usability of the program. The average usability score was 77.5/100 for the first test round and improved to 83.1/100 after applying modifications for the second iteration. The analysis of the qualitative data revealed five central themes: layout, navigation, content, support, and engagement conditions. The first three themes highlight usability aspects of the program, while the latter two highlight engagement issues. An easy-to-use format, clear wording, the nature of guidance, and opportunity for interactivity were important issues related to usability. The coach support, time investment, and severity of users' symptoms, the program's features and effectiveness, trust, anonymity, and affordability were relevant to engagement. This study identified salient usability and engagement features associated with participant motivation to use the Healthy Body Image Program and ultimately helped improve the program prior to its implementation. This research demonstrates that improvements in usability and engagement can be achieved by testing and adjusting intervention design and content prior to program launch. The results are consistent with related research and reinforce the need for further research to identify usage patterns and effective means for reducing dropout. Digital health research should include usability studies prior to efficacy trials to help create more user-friendly programs that have a higher likelihood of "real-world" adoption.

ZeroCal: Automatic MAC Protocol Calibration

NASA Astrophysics Data System (ADS)

Meier, Andreas; Woehrle, Matthias; Zimmerling, Marco; Thiele, Lothar

Sensor network MAC protocols are typically configured for an intended deployment scenario once and for all at compile time. This approach, however, leads to suboptimal performance if the network conditions deviate from the expectations. We present ZeroCal, a distributed algorithm that allows nodes to dynamically adapt to variations in traffic volume. Using ZeroCal, each node autonomously configures its MAC protocol at runtime, thereby trying to reduce the maximum energy consumption among all nodes. While the algorithm is readily usable for any asynchronous low-power listening or low-power probing protocol, we validate and demonstrate the effectiveness of ZeroCal on X-MAC. Extensive testbed experiments and simulations indicate that ZeroCal quickly adapts to traffic variations. We further show that ZeroCal extends network lifetime by 50% compared to an optimal configuration with identical and static MAC parameters at all nodes.

Usability Testing: A Case Study.

ERIC Educational Resources Information Center

Chisman, Janet; Walbridge, Sharon; Diller, Karen

1999-01-01

Discusses the development and results of usability testing of Washington State University's Web-based OPAC (online public access catalog); examines how easily users could navigate the catalog and whether they understood what they were seeing; and identifies problems and what action if any was taken. (LRW)

In the Loop: The Organization of Team-Based Communication in a Patient-Centered Clinical Collaboration System.

PubMed

Kurahashi, Allison M; Weinstein, Peter B; Jamieson, Trevor; Stinson, Jennifer N; Cafazzo, Joseph A; Lokuge, Bhadra; Morita, Plinio P; Cohen, Eyal; Rapoport, Adam; Bezjak, Andrea; Husain, Amna

2016-03-24

We describe the development and evaluation of a secure Web-based system for the purpose of collaborative care called Loop. Loop assembles the team of care with the patient as an integral member of the team in a secure space. The objectives of this paper are to present the iterative design of the separate views for health care providers (HCPs) within each patient's secure space and examine patients', caregivers', and HCPs' perspectives on this separate view for HCP-only communication. The overall research program includes cycles of ethnography, prototyping, usability testing, and pilot testing. This paper describes the usability testing phase that directly informed development. A descriptive qualitative approach was used to analyze participant perspectives that emerged during usability testing. During usability testing, we sampled 89 participants from three user groups: 23 patients, 19 caregivers, and 47 HCPs. Almost all perspectives from the three user groups supported the need for an HCP-only communication view. In an earlier prototype, the visual presentation caused confusion among HCPs when reading and composing messages about whether a message was visible to the patient. Usability testing guided us to design a more deliberate distinction between posting in the Patient and Team view and the Health Care Provider Only view at the time of composing a message, which once posted is distinguished by an icon. The team made a decision to incorporate an HCP-only communication view based on findings during earlier phases of work. During usability testing we tested the separate communication views, and all groups supported this partition. We spent considerable effort designing the partition; however, preliminary findings from the next phase of evaluation, pilot testing, show that the Patient and Team communication is predominantly being used. This demonstrates the importance of a subsequent phase of the clinical trial of Loop to validate the concept and design.

Does user-centred design affect the efficiency, usability and safety of CPOE order sets?

PubMed

Chan, Julie; Shojania, Kaveh G; Easty, Anthony C; Etchells, Edward E

2011-05-01

Application of user-centred design principles to Computerized provider order entry (CPOE) systems may improve task efficiency, usability or safety, but there is limited evaluative research of its impact on CPOE systems. We evaluated the task efficiency, usability, and safety of three order set formats: our hospital's planned CPOE order sets (CPOE Test), computer order sets based on user-centred design principles (User Centred Design), and existing pre-printed paper order sets (Paper). 27 staff physicians, residents and medical students. Sunnybrook Health Sciences Centre, an academic hospital in Toronto, Canada. Methods Participants completed four simulated order set tasks with three order set formats (two CPOE Test tasks, one User Centred Design, and one Paper). Order of presentation of order set formats and tasks was randomized. Users received individual training for the CPOE Test format only. Completion time (efficiency), requests for assistance (usability), and errors in the submitted orders (safety). 27 study participants completed 108 order sets. Mean task times were: User Centred Design format 273 s, Paper format 293 s (p=0.73 compared to UCD format), and CPOE Test format 637 s (p<0.0001 compared to UCD format). Users requested assistance in 31% of the CPOE Test format tasks, whereas no assistance was needed for the other formats (p<0.01). There were no significant differences in number of errors between formats. The User Centred Design format was more efficient and usable than the CPOE Test format even though training was provided for the latter. We conclude that application of user-centred design principles can enhance task efficiency and usability, increasing the likelihood of successful implementation.

Does user-centred design affect the efficiency, usability and safety of CPOE order sets?

PubMed Central

Chan, Julie; Shojania, Kaveh G; Easty, Anthony C

2011-01-01

Background Application of user-centred design principles to Computerized provider order entry (CPOE) systems may improve task efficiency, usability or safety, but there is limited evaluative research of its impact on CPOE systems. Objective We evaluated the task efficiency, usability, and safety of three order set formats: our hospital's planned CPOE order sets (CPOE Test), computer order sets based on user-centred design principles (User Centred Design), and existing pre-printed paper order sets (Paper). Participants 27staff physicians, residents and medical students. Setting Sunnybrook Health Sciences Centre, an academic hospital in Toronto, Canada. Methods Participants completed four simulated order set tasks with three order set formats (two CPOE Test tasks, one User Centred Design, and one Paper). Order of presentation of order set formats and tasks was randomized. Users received individual training for the CPOE Test format only. Main Measures Completion time (efficiency), requests for assistance (usability), and errors in the submitted orders (safety). Results 27 study participants completed 108 order sets. Mean task times were: User Centred Design format 273 s, Paper format 293 s (p=0.73 compared to UCD format), and CPOE Test format 637 s (p<0.0001 compared to UCD format). Users requested assistance in 31% of the CPOE Test format tasks, whereas no assistance was needed for the other formats (p<0.01). There were no significant differences in number of errors between formats. Conclusions The User Centred Design format was more efficient and usable than the CPOE Test format even though training was provided for the latter. We conclude that application of user-centred design principles can enhance task efficiency and usability, increasing the likelihood of successful implementation. PMID:21486886

An efficient approach to improve the usability of e-learning resources: the role of heuristic evaluation.

PubMed

Davids, Mogamat Razeen; Chikte, Usuf M E; Halperin, Mitchell L

2013-09-01

Optimizing the usability of e-learning materials is necessary to maximize their potential educational impact, but this is often neglected when time and other resources are limited, leading to the release of materials that cannot deliver the desired learning outcomes. As clinician-teachers in a resource-constrained environment, we investigated whether heuristic evaluation of our multimedia e-learning resource by a panel of experts would be an effective and efficient alternative to testing with end users. We engaged six inspectors, whose expertise included usability, e-learning, instructional design, medical informatics, and the content area of nephrology. They applied a set of commonly used heuristics to identify usability problems, assigning severity scores to each problem. The identification of serious problems was compared with problems previously found by user testing. The panel completed their evaluations within 1 wk and identified a total of 22 distinct usability problems, 11 of which were considered serious. The problems violated the heuristics of visibility of system status, user control and freedom, match with the real world, intuitive visual layout, consistency and conformity to standards, aesthetic and minimalist design, error prevention and tolerance, and help and documentation. Compared with user testing, heuristic evaluation found most, but not all, of the serious problems. Combining heuristic evaluation and user testing, with each involving a small number of participants, may be an effective and efficient way of improving the usability of e-learning materials. Heuristic evaluation should ideally be used first to identify the most obvious problems and, once these are fixed, should be followed by testing with typical end users.

The value of usability testing for Internet-based adolescent self-management interventions: “Managing Hemophilia Online”

PubMed Central

2013-01-01

Background As adolescents with hemophilia approach adulthood, they are expected to assume responsibility for their disease management. A bilingual (English and French) Internet-based self-management program, “Teens Taking Charge: Managing Hemophilia Online,” was developed to support adolescents with hemophilia in this transition. This study explored the usability of the website and resulted in refinement of the prototype. Methods A purposive sample (n=18; age 13–18; mean age 15.5 years) was recruited from two tertiary care centers to assess the usability of the program in English and French. Qualitative observations using a “think aloud” usability testing method and semi-structured interviews were conducted in four iterative cycles, with changes to the prototype made as necessary following each cycle. This study was approved by research ethics boards at each site. Results Teens responded positively to the content and appearance of the website and felt that it was easy to navigate and understand. The multimedia components (videos, animations, quizzes) were felt to enrich the experience. Changes to the presentation of content and the website user-interface were made after the first, second and third cycles of testing in English. Cycle four did not result in any further changes. Conclusions Overall, teens found the website to be easy to use. Usability testing identified end-user concerns that informed improvements to the program. Usability testing is a crucial step in the development of Internet-based self-management programs to ensure information is delivered in a manner that is accessible and understood by users. PMID:24094082

From Usability Testing to Clinical Simulations: Bringing Context into the Design and Evaluation of Usable and Safe Health Information Technologies. Contribution of the IMIA Human Factors Engineering for Healthcare Informatics Working Group.

PubMed

Kushniruk, A; Nohr, C; Jensen, S; Borycki, E M

2013-01-01

The objective of this paper is to explore human factors approaches to understanding the use of health information technology (HIT) by extending usability engineering approaches to include analysis of the impact of clinical context through use of clinical simulations. Methods discussed are considered on a continuum from traditional laboratory-based usability testing to clinical simulations. Clinical simulations can be conducted in a simulation laboratory and they can also be conducted in real-world settings. The clinical simulation approach attempts to bring the dimension of clinical context into stronger focus. This involves testing of systems with representative users doing representative tasks, in representative settings/environments. Application of methods where realistic clinical scenarios are used to drive the study of users interacting with systems under realistic conditions and settings can lead to identification of problems and issues with systems that may not be detected using traditional usability engineering methods. In conducting such studies, careful consideration is needed in creating ecologically valid test scenarios. The evidence obtained from such evaluation can be used to improve both the usability and safety of HIT. In addition, recent work has shown that clinical simulations, in particular those conducted in-situ, can lead to considerable benefits when compared to the costs of running such studies. In order to bring context of use into the testing of HIT, clinical simulation, involving observing representative users carrying out tasks in representative settings, holds considerable promise.

Initial Usability and Feasibility Evaluation of a Personal Health Record-Based Self-Management System for Older Adults.

PubMed

Sheehan, Barbara; Lucero, Robert J

2015-01-01

Electronic personal health record-based (ePHR-based) self-management systems can improve patient engagement and have an impact on health outcomes. In order to realize the benefits of these systems, there is a need to develop and evaluate heath information technology from the same theoretical underpinnings. Using an innovative usability approach based in human-centered distributed information design (HCDID), we tested an ePHR-based falls-prevention self-management system-Self-Assessment via a Personal Health Record (i.e., SAPHeR)-designed using HCDID principles in a laboratory. And we later evaluated SAPHeR's use by community-dwelling older adults at home. The innovative approach used in this study supported the analysis of four components: tasks, users, representations, and functions. Tasks were easily learned and features such as text-associated images facilitated task completion. Task performance times were slow, however user satisfaction was high. Nearly seven out of every ten features desired by design participants were evaluated in our usability testing of the SAPHeR system. The in vivo evaluation suggests that older adults could improve their confidence in performing indoor and outdoor activities after using the SAPHeR system. We have applied an innovative consumer-usability evaluation. Our approach addresses the limitations of other usability testing methods that do not utilize consistent theoretically based methods for designing and testing technology. We have successfully demonstrated the utility of testing consumer technology use across multiple components (i.e., task, user, representational, functional) to evaluate the usefulness, usability, and satisfaction of an ePHR-based self-management system.

A Facebook-Based Obesity Prevention Program for Korean American Adolescents: Usability Evaluation.

PubMed

Park, Bu Kyung; Nahm, Eun-Shim; Rogers, Valerie E; Choi, Mona; Friedmann, Erika; Wilson, Marisa; Koru, Gunes

Adolescent obesity is one of the most serious global public health challenges. Social networking sites are currently popular among adolescents. Therefore, the obesity prevention program for Korean American adolescents was developed on the most popular social networking site, Facebook. The purpose of this study was to evaluate the usability of a culturally tailored Facebook-based obesity prevention program for Korean American adolescents (Healthy Teens). An explorative descriptive design of usability testing was used. Usability testing employing one-on-one observation, the think-aloud method, audio taping, screen activity capture, and surveys was performed. Twenty participants were recruited from two Korean language schools (mean age, 15.40 ± 1.50 years). Recruitment and user testing was performed between February and April 2014. Content analysis, using the inductive coding approach, was performed by three coders to analyze transcriptions. Descriptive statistics were used to analyze quantitative data including demographic characteristics, perceived usability, eHealth literacy, and health behaviors. Testing revealed several usability issues in content, appearance, and navigation. Participants' comments regarding content were positive. Although the Facebook platform provided limited flexibility with respect to building the site, participants described the program's appearance as appropriate. Most participants did not experience difficulty in navigating the program. Our preliminary findings indicated that participants perceived the Healthy Teens program as usable and useful. This program could be used as a robust platform for the delivery of health education to adolescents. Further research is required to assess the effects of Facebook-based programs on adolescent obesity prevention. Copyright © 2016 National Association of Pediatric Nurse Practitioners. Published by Elsevier Inc. All rights reserved.

A framework for evaluating electronic health record vendor user-centered design and usability testing processes.

PubMed

Ratwani, Raj M; Zachary Hettinger, A; Kosydar, Allison; Fairbanks, Rollin J; Hodgkins, Michael L

2017-04-01

Currently, there are few resources for electronic health record (EHR) purchasers and end users to understand the usability processes employed by EHR vendors during product design and development. We developed a framework, based on human factors literature and industry standards, to systematically evaluate the user-centered design processes and usability testing methods used by EHR vendors. We reviewed current usability certification requirements and the human factors literature to develop a 15-point framework for evaluating EHR products. The framework is based on 3 dimensions: user-centered design process, summative testing methodology, and summative testing results. Two vendor usability reports were retrieved from the Office of the National Coordinator's Certified Health IT Product List and were evaluated using the framework. One vendor scored low on the framework (5 pts) while the other vendor scored high on the framework (15 pts). The 2 scored vendor reports demonstrate the framework's ability to discriminate between the variabilities in vendor processes and to determine which vendors are meeting best practices. The framework provides a method to more easily comprehend EHR vendors' usability processes and serves to highlight where EHR vendors may be falling short in terms of best practices. The framework provides a greater level of transparency for both purchasers and end users of EHRs. The framework highlights the need for clearer certification requirements and suggests that the authorized certification bodies that examine vendor usability reports may need to be provided with clearer guidance. © The Author 2016. Published by Oxford University Press on behalf of the American Medical Informatics Association. All rights reserved. For Permissions, please email: journals.permissions@oup.com

Interface design recommendations for computerised clinical audit and feedback: Hybrid usability evidence from a research-led system.

PubMed

Brown, Benjamin; Balatsoukas, Panos; Williams, Richard; Sperrin, Matthew; Buchan, Iain

2016-10-01

Audit and Feedback (A&F) is a widely used quality improvement technique that measures clinicians' clinical performance and reports it back to them. Computerised A&F (e-A&F) system interfaces may consist of four key components: (1) Summaries of clinical performance; (2) Patient lists; (3) Patient-level data; (4) Recommended actions. There is a lack of evidence regarding how to best design e-A&F interfaces; establishing such evidence is key to maximising usability, and in turn improving patient safety. To evaluate the usability of a novel theoretically-informed and research-led e-A&F system for primary care (the Performance Improvement plaN GeneratoR: PINGR). (1) Describe PINGR's design, rationale and theoretical basis; (2) Identify usability issues with PINGR; (3) Understand how these issues may interfere with the cognitive goals of end-users; (4) Translate the issues into recommendations for the user-centred design of e-A&F systems. Eight experienced health system evaluators performed a usability inspection using an innovative hybrid approach consisting of five stages: (1) Development of representative user tasks, Goals, and Actions; (2) Combining Heuristic Evaluation and Cognitive Walkthrough methods into a single protocol to identify usability issues; (3) Consolidation of issues; (4) Severity rating of consolidated issues; (5) Analysis of issues according to usability heuristics, interface components, and Goal-Action structure. A final list of 47 issues were categorised into 8 heuristic themes. The most error-prone heuristics were 'Consistency and standards' (13 usability issues; 28% of the total) and 'Match between system and real world' (n=10, 21%). The recommended actions component of the PINGR interface had the most usability issues (n=21, 45%), followed by patient-level data (n=5, 11%), patient lists (n=4, 9%), and summaries of clinical performance (n=4, 9%). The most error-prone Actions across all user Goals were: (1) Patient selection from a list; (2) Data identification from a figure (both population-level and patient-level); (3) Disagreement with a system recommendation. By contextualising our findings within the wider literature on health information system usability, we provide recommendations for the design of e-A&F system interfaces relating to their four key components, in addition to how they may be integrated within a system. Copyright © 2016. Published by Elsevier Ireland Ltd.

Feasibility study of a clinical decision support system for the management of multimorbid seniors in primary care: study protocol.

PubMed

Weltermann, Birgitta; Kersting, Christine

2016-01-01

Care for seniors is complex because patients often have more than one disease, one medication, and one physician. It is a key challenge for primary care physicians to structure the various aspects of each patient's care, to integrate each patient's preferences, and to maintain a long-term overview. This article describes the design for the development and feasibility testing of the clinical decision support system (CDSS) eCare*Seniors© which is electronic health record (EHR)-based allowing for a long-term, comprehensive, evidence-based, and patient preference-oriented management of multimorbid seniors. This mixed-methods study is designed in three steps. First, focus groups and practice observations will be conducted to develop criteria for software design from a physicians' and practice assistants' perspective. Second, based on these criteria, a CDSS prototype will be developed. Third, the prototype's feasibility will be tested by five primary care practices in the care of 30 multimorbid seniors. Primary outcome is the usability of the software measured by the validated system usability scale (SUS) after 3 months. Secondary outcomes are the (a) willingness to routinely use the CDSS, (b) degree of utilization of the CDSS, (c) acceptance of the CDSS, (d) willingness of the physicians to purchase the CDSS, and (e) willingness of the practice assistants to use the CDSS in the long term. These outcomes will be measured using semi-structured interviews and software usage data. If the SUS score reaches ≥70 %, feasibility testing will be judged successful. Otherwise, the CDSS prototype will be refined according to the users' needs and retested by the physicians and practice assistants until it is fully adapted to their requirements and reaches a usability score ≥70 %. The study will support the development of a CDSS which is primary care-defined, user-friendly, easy-to-comprehend, workflow-oriented, and comprehensive. The software will assist physicians and practices in their long-term, individualized care for multimorbid seniors. German Clinical Trials Register, DRKS00008777.

A Usability Study of Users’ Perceptions Toward a Multimedia Computer-Assisted Learning Tool for Neuroanatomy

PubMed Central

Gould, Douglas J.; Terrell, Mark A.; Fleming, Jo

2015-01-01

This usability study evaluated users’ perceptions of a multimedia prototype for a new e-learning tool: Anatomy of the Central Nervous System: A Multimedia Course. Usability testing is a collection of formative evaluation methods that inform the developmental design of e-learning tools to maximize user acceptance, satisfaction, and adoption. Sixty-two study participants piloted the prototype and completed a usability questionnaire designed to measure two usability properties: program need and program applicability. Statistical analyses were used to test the hypothesis that the multimedia prototype was well designed and highly usable, it was perceived as: 1) highly needed across a spectrum of educational contexts, 2) highly applicable in supporting the pedagogical processes of teaching and learning neuroanatomy, and 3) was highly usable by all types of users. Three independent variables represented user differences: level of expertise (faculty vs. student), age, and gender. Analysis of the results supports the research hypotheses that the prototype was designed well for different types of users in various educational contexts and for supporting the pedagogy of neuroanatomy. In addition, the results suggest that the multimedia program will be most useful as a neuroanatomy review tool for health-professions students preparing for licensing or board exams. This study demonstrates the importance of integrating quality properties of usability with principles of human learning during the instructional design process for multimedia products. PMID:19177405

Usability Studies and User-Centered Design in Digital Libraries

ERIC Educational Resources Information Center

Comeaux, David J.

2008-01-01

Digital libraries continue to flourish. At the same time, the principles of user-centered design and the practice of usability testing have been growing in popularity, spreading their influence into the library sphere. This article explores the confluence of these two trends by surveying the current literature on usability studies of digital…

Earning the Stamp of Approval: How To Achieve Optimal Usability.

ERIC Educational Resources Information Center

Makar, Susan

2003-01-01

Describes the redesign of the Web site at the virtual library of the NIST (National Institute of Standards and Technology). Discusses usability problems with the original site, including navigation difficulties; focus groups to determine user needs; usability testing for the new Web site; and the importance of customer input. (LRW)

Designing Websites for ESL Learners: A Usability Testing Study

ERIC Educational Resources Information Center

Liu, Min; Traphagan, Tomoko; Huh, Jin; Koh, Young Ihn; Choi, Gilok; McGregor, Allison

2008-01-01

The purpose of this paper is to report on a usability study for ESL websites conducted to gain insights from learners of English as a second language (ESL) as they interacted with specific sites. Five carefully selected ESL sites were tested by 10 different users generating a total of fifty testing sessions. Two major research questions guided the…

Head and Neck Squamous Cell Carcinomas Do Not Express EGFRvIII

DOE Office of Scientific and Technical Information (OSTI.GOV)

Melchers, Lieuwe J., E-mail: l.j.melchers@umcg.nl; Department of Pathology, University Medical Center Groningen, University of Groningen, Groningen; Clausen, Martijn J.A.M.

2014-10-01

Purpose: To assess the prevalence of EGFRvIII, a specific variant of EGFR (epidermal growth factor receptor), in 3 well-defined cohorts of head and neck squamous cell carcinoma (HNSCC). Methods and Materials: Immunohistochemistry for the specific detection of EGFRvIII using the L8A4 antibody was optimized on formalin-fixed, paraffin-embedded tissue using glioblastoma tissue. It was compared with EGFR and EGFRvIII RNA expression using a specific reverse transcription–polymerase chain reaction also optimized for formalin-fixed, paraffin-embedded tissue. Tissue microarrays including 531 HNSCCs of various stages with complete clinicopathologic and follow-up data were tested for the presence of EGFRvIII. Results: None of the 531 casesmore » showed EGFRvIII protein expression. Using an immunohistochemistry protocol reported by others revealed cytoplasmic staining in 8% of cases. Reverse transcription–polymerase chain reaction for the EGFRvIII transcript of the 28 highest cytoplasmic staining cases, as well as 69 negative cases, did not show expression in any of the tested cases, suggesting aspecific staining by a nonoptimal protocol. Conclusions: The EGFRvIII mutation is not present in HNSCC. Therefore, EGFRvIII does not influence treatment response in HNSCC and is not a usable clinical prognostic marker.« less

Evaluation of the reliability, usability, and applicability of AMSTAR, AMSTAR 2, and ROBIS: protocol for a descriptive analytic study.

PubMed

Gates, Allison; Gates, Michelle; Duarte, Gonçalo; Cary, Maria; Becker, Monika; Prediger, Barbara; Vandermeer, Ben; Fernandes, Ricardo M; Pieper, Dawid; Hartling, Lisa

2018-06-13

Systematic reviews (SRs) of randomised controlled trials (RCTs) can provide the best evidence to inform decision-making, but their methodological and reporting quality varies. Tools exist to guide the critical appraisal of quality and risk of bias in SRs, but evaluations of their measurement properties are limited. We will investigate the interrater reliability (IRR), usability, and applicability of A MeaSurement Tool to Assess systematic Reviews (AMSTAR), AMSTAR 2, and Risk Of Bias In Systematic reviews (ROBIS) for SRs in the fields of biomedicine and public health. An international team of researchers at three collaborating centres will undertake the study. We will use a random sample of 30 SRs of RCTs investigating therapeutic interventions indexed in MEDLINE in February 2014. Two reviewers at each centre will appraise the quality and risk of bias in each SR using AMSTAR, AMSTAR 2, and ROBIS. We will record the time to complete each assessment and for the two reviewers to reach consensus for each SR. We will extract the descriptive characteristics of each SR, the included studies, participants, interventions, and comparators. We will also extract the direction and strength of the results and conclusions for the primary outcome. We will summarise the descriptive characteristics of the SRs using means and standard deviations, or frequencies and proportions. To test for interrater reliability between reviewers and between the consensus agreements of reviewer pairs, we will use Gwet's AC 1 statistic. For comparability to previous evaluations, we will also calculate weighted Cohen's kappa and Fleiss' kappa statistics. To estimate usability, we will calculate the mean time to complete the appraisal and to reach consensus for each tool. To inform applications of the tools, we will test for statistical associations between quality scores and risk of bias judgments, and the results and conclusions of the SRs. Appraising the methodological and reporting quality of SRs is necessary to determine the trustworthiness of their conclusions. Which tool may be most reliably applied and how the appraisals should be used is uncertain; the usability of newly developed tools is unknown. This investigation of common (AMSTAR) and newly developed (AMSTAR 2, ROBIS) tools will provide empiric data to inform their application, interpretation, and refinement.

Effectiveness and usability of Scanning Wizard software: a tool for enhancing switch scanning.

PubMed

Koester, Heidi Horstmann; Simpson, Richard C

2017-11-24

Scanning Wizard software helps scanning users improve the setup of their switch and scanning system. This study evaluated Scanning Wizard's effectiveness and usability. Ten people who use switch scanning and ten practitioners used Scanning Wizard in the initial session. Usability was high, based on survey responses averaging over 4.5 out of 5, and qualitative feedback was very positive. Five switch users were able to complete the multi-week protocol, using settings on their own scanning system that were recommended from the Scanning Wizard session. Using these revised settings, text entry rates improved by an average of 71%, ranging from 29% to 172% improvement. Results suggest that Scanning Wizard is a useful tool for improving the configuration of scanning systems for people who use switch scanning to communicate. Implications for Rehabilitation Some individuals with severe physical impairments use switch scanning for spoken and written communication. Scanning Wizard software helps scanning users improve the setup of their switch and scanning system. This study demonstrated high usability of Scanning Wizard (with 10 switch userpractitioner teams) and increased text entry rate by an average of 71% (for five switch users). Results suggest that Scanning Wizard is a useful tool for improving the configuration of scanning systems for people who use switch scanning to communicate.

Biofeedback in Partial Weight Bearing: Usability of Two Different Devices from a Patient's and Physical Therapist's Perspective.

PubMed

van Lieshout, Remko; Pisters, Martijn F; Vanwanseele, Benedicte; de Bie, Rob A; Wouters, Eveline J; Stukstette, Mirelle J

2016-01-01

Partial weight bearing is frequently instructed by physical therapists in patients after lower-limb trauma or surgery. The use of biofeedback devices seems promising to improve the patient's compliance with weight-bearing instructions. SmartStep and OpenGo-Science are biofeedback devices that provide real-time feedback. For a successful implementation, usability of the devices is a critical aspect and should be tested from a user's perspective. To describe the usability from the physical therapists' and a patients' perspective of Smartstep and OpenGo-Science to provide feedback on partial weight bearing during supervised rehabilitation of patients after lower-limb trauma or surgery. In a convergent mixed-methods design, qualitative and quantitative data were collected. Usability was subdivided into user performance, satisfaction and acceptability. Patients prescribed with partial weight bearing and their physical therapists were asked to use SmartStep and OpenGo-Science during supervised rehabilitation. Usability was qualitatively tested by a think-aloud method and a semi-structured interview and quantitatively tested by the System-Usability-Scale (SUS) and closed questions. For the qualitative data thematic content analyses were used. Nine pairs of physical therapists and their patients participated. The mean SUS scores for patients and physical therapists were for SmartStep 70 and 53, and for OpenGo-Science 79 and 81, respectively. Scores were interpreted with the Curved Grading Scale. The qualitative data showed that there were mixed views and perceptions from patients and physical therapists on satisfaction and acceptability. This study gives insight in the usability of two biofeedback devices from the patient's and physical therapist's perspective. The overall usability from both perspectives seemed to be acceptable for OpenGo-Science. For SmartStep, overall usability seemed only acceptable from the patient's perspective. The study findings could help clinicians to decide which biofeedback device is appropriate for their given situation and provide information for future development of biofeedback devices.

The quality of information on the Internet on orthodontic retainer wear: a cross-sectional study.

PubMed

Doğramacı, Esma J; Rossi-Fedele, Giampiero

2016-03-01

The objectives of this study were to assess the accessibility, usability, reliability and quality of information on the Internet written for the lay public about orthodontic retainers, and to elucidate the different retention protocols encouraged. A cross-sectional, observational study. Online, using a computer connected to the Internet in Australia. Two search terms; 'orthodontic retainer' and 'how long should someone wear a retainer after their braces are removed?' were entered alternatively into five search engines. Twenty results for each search term per search engine that fulfilled the inclusion criteria were evaluated in terms of accessibility, usability, reliability and quality of information using the LIDA and DISCERN instruments, ensuring there were no internal or cross-search engine duplicates. Any information about frequency and duration of retainer wear was also collected. Two hundred different websites were identified and assessed. The median overall LIDA score was 72%, corresponding to a moderate quality level. The median total DISCERN score was 47%. Twenty-two websites recommended patients adhere to the specific protocol prescribed to them by their practitioner. There were 45 (22.5%) and 28 (14%) websites advising indefinite use of removable and bonded retainers respectively. Information about retainers on the Internet is easily accessible and usable, though the quality of the content is generally of a moderate level. However, the information is not always accurate and reliable. Both full-time and part-time wear of removable retainers was suggested over greatly varying time periods. Indefinite wear of removable and bonded retainers was also advocated.

User-centered design and usability testing of an innovative health-related quality of life module.

PubMed

Nagykaldi, Z J; Jordan, M; Quitoriano, J; Ciro, C A; Mold, J W

2014-01-01

Various computerized health risk appraisals (HRAs) are available, but few of them assess health-related quality of life (HRQoL) in a goal-directed framework. This study describes the user-centered development and usability testing of an innovative HRQoL module that extends a validated HRA tool in primary care settings. Systematic user-centered design, usability testing, and qualitative methods were used to develop the HRQoL module in primary care practices. Twenty two patients and 5 clinicians participated in two rounds of interactive technology think-out-loud sessions (TOLs) and semi-structured interviews (SSIs) to iteratively develop a four-step, computerized process that collects information on patient goals for meaningful life activities and current level of disability and presents a personalized and prioritized list of preventive recommendations linked to online resources. Analysis of TOLs and SSIs generated 5 categories and 11 sub-categories related to facilitators and barriers to usability and human-technology interaction. The categories included: Understanding the Purpose, Usability, Perceived Value, Literacy, and Participant Motivation. Some categories were inter-connected. The technology was continually and iteratively improved between sessions until saturation of positive feedback was achieved in 4 categories (addressing motivation will require more research). Usability of all screen units of the module was improved substantially. Clinician feedback emphasized the importance of the module's ability to translate the patient-centered HRQoL Report into actionable items for clinicians to facilitate shared decision-making. Complete integration of the HRQoL module into the existing HRA will require further development and testing. Systematic application of user-centered design and human factors principles in technology development and testing may significantly improve the usability and clinical value of health information systems. This more sophisticated approach helped us translate complex clinical concepts, goal-setting steps, and decision-support processes into an accepted and value-added technology.

Do Perceptions of Insulin Pump Usability Impact Attitudes Toward Insulin Pump Therapy? A Pilot Study of Individuals With Type 1 and Insulin-Treated Type 2 Diabetes

PubMed Central

Gilgen, Emily

2014-01-01

Background: We assessed the impact of perceived insulin pump usability on attitudes toward insulin pump therapy in diabetic individuals currently treated with multiple daily insulin injections (MDI). Method: This comparative, single-arm study recruited 28 adults with type 1 (n = 16) and insulin-treated type 2 diabetes (n = 12) to evaluate 2 current insulin pumps: Medtronic Revel 723 (Pump 1), Asante Snap Insulin Pump (Pump 2). Participants were randomized 1:1 to 1 of 2 assessment sequences: Pump 1 followed by Pump 2; and Pump 2 followed by Pump 1. Structured observational protocols were utilized to assess participants’ ability and time required to learn/perform common tasks associated with pump setup/use. Participants used a modified version of the System Usability Scale (SUS) and investigator-developed questionnaires to rate pump usability and task difficulty; pre-post questionnaires assessed changes in attitudes toward insulin pump therapy. Results: All participants completed the study. SUS scores showed Pump 2 to be more usable than Pump 1 on all usability attributes. Participants rated Pump 2 more positively than Pump 1, overall mean SUS scores of 5.7 versus 4.1 respectively, F(1, 52) = 32.7, P < .001, and SUS scores were higher if participants used the Pump 2 last, 5.3 versus 4.4 for Pump 1 last, F(1, 52) = 10.8, P < .01. Pump 2 was preferred for all tasks: manual bolus (86%), bolus calculation (71%), managing basal rates (93%), interpreting alarms (96%), transferring settings (100%), changing insulin and infusion sets (93%), all P < .05. Conclusions: Perceptions of pump usability can directly impact acceptance and use of features that may benefit those who wear them. Simpler pump devices that decrease perceptions of complexity may encourage broader use of this technology. PMID:25269659

Usability of online psychoeducation for siblings of people with psychosis.

PubMed

Sin, Jacqueline; Henderson, Claire; Norman, Ian

2014-10-01

The E Sibling Project aims to address the needs of siblings of individuals affected by psychosis through provision of a comprehensive online intervention. The online intervention comprises four core elements, including: information on psychosis; various coping and promoting well-being strategies; siblings' blogs and discussion forum with peers; and an "Ask the Experts" function. After the intervention-prototype was developed, we tested its feasibility, usability and acceptability by siblings. We evaluated the usability of the intervention-prototype using a non-randomised usability study with siblings of individuals diagnosed with psychosis. The usability study adapted Poulson et al's framework to collect subjective feedback from participants on ease of use, perceived usefulness and acceptability, together with objective usage data on the intervention. Twenty siblings were recruited to the usability test; 19 tried out the resource-prototype over a 4-week period and 17 completed the online evaluation after using the intervention. In total, 906 page-views were made by the participants and each spent about two hours using the resource. Participants evaluated the intervention as helpful, relevant and useful in terms of content, design and usability. Developments are needed to improve the navigation and intuitiveness of the resource. Using an internet-based information-giving and peer support intervention to promote wellbeing and coping is feasible and acceptable to siblings of people with psychosis.

Usability Testing and Analysis Facility (UTAF)

NASA Technical Reports Server (NTRS)

Wong, Douglas T.

2010-01-01

This slide presentation reviews the work of the Usability Testing and Analysis Facility (UTAF) at NASA Johnson Space Center. It is one of the Space Human Factors Laboratories in the Habitability and Human Factors Branch (SF3) at NASA Johnson Space Center The primary focus pf the UTAF is to perform Human factors evaluation and usability testing of crew / vehicle interfaces. The presentation reviews the UTAF expertise and capabilities, the processes and methodologies, and the equipment available. It also reviews the programs that it has supported detailing the human engineering activities in support of the design of the Orion space craft, testing of the EVA integrated spacesuit, and work done for the design of the lunar projects of the Constellation Program: Altair, Lunar Electric Rover, and Outposts

User perspectives on the usability of a regional health information exchange

PubMed Central

Ho, Yun-Xian; Cala, Cather Marie; Blakemore, Dana; Chen, Qingxia; Frisse, Mark E; Johnson, Kevin B

2011-01-01

Objective We assessed the usability of a health information exchange (HIE) in a densely populated metropolitan region. This grant-funded HIE had been deployed rapidly to address the imminent needs of the patient population and the need to draw wider participation from regional entities. Design We conducted a cross-sectional survey of individuals given access to the HIE at participating organizations and examined some of the usability and usage factors related to the technology acceptance model. Measurements We probed user perceptions using the Questionnaire for User Interaction Satisfaction, an author-generated Trust scale, and user characteristic questions (eg, age, weekly system usage time). Results Overall, users viewed the system favorably (ratings for all usability items were greater than neutral (one-sample Wilcoxon test, p<0.0014, Bonferroni-corrected for 35 tests). System usage was regressed on usability, trust, and demographic and user characteristic factors. Three usability factors were positively predictive of system usage: overall reactions (p<0 0.01), learning (p<0.05), and system functionality (p<0.01). Although trust is an important component in collaborative relationships, we did not find that user trust of other participating healthcare entities was significantly predictive of usage. An analysis of respondents' comments revealed ways to improve the HIE. Conclusion We used a rapid deployment model to develop an HIE and found that perceptions of system usability were positive. We also found that system usage was predicted well by some aspects of usability. Results from this study suggest that a rapid development approach may serve as a viable model for developing usable HIEs serving communities with limited resources. PMID:21622933

A Usability Study of Users' Perceptions toward a Multimedia Computer-Assisted Learning Tool for Neuroanatomy

ERIC Educational Resources Information Center

Gould, Douglas J.; Terrell, Mark A.; Fleming, Jo

2008-01-01

This usability study evaluated users' perceptions of a multimedia prototype for a new e-learning tool: Anatomy of the Central Nervous System: A Multimedia Course. Usability testing is a collection of formative evaluation methods that inform the developmental design of e-learning tools to maximize user acceptance, satisfaction, and adoption.…

A socialization intervention in remote health coaching for older adults in the home.

PubMed

Jimison, Holly B; Klein, Krystal A; Marcoe, Jennifer L

2013-01-01

Previous studies have shown that social ties enhance both physical and mental health, and that social isolation has been linked to increased cognitive decline. As part of our cognitive training platform, we created a socialization intervention to address these issues. The intervention is designed to improve social contact time of older adults with remote family members and friends using a variety of technologies, including Web cameras, Skype software, email and phone. We used usability testing, surveys, interviews and system usage monitoring to develop design guidance for socialization protocols that were appropriate for older adults living independently in their homes. Our early results with this intervention show increased number of social contacts, total communication time (we measure email, phone, and Skype usage) and significant participant satisfaction with the intervention.

Instrumented toys for assessing spatial cognition in infants

NASA Astrophysics Data System (ADS)

Campolo, Domenico; Taffoni, Fabrizio; Formica, Domenico; Keller, Flavio; Guglielmelli, Eugenio

2011-03-01

This paper describes an interdisciplinary approach to the assessment on infants' behavior, with a focus on the technology. The goal is an objective, quantitative analysis of concurrent maturation of sensory, motor and cognitive abilities in young children, in relation to the achievement of developmental milestones. An instrumented block-box toy specifically developed to assess the ability to insert objects into holes is presented. The functional specifications are derived from experimental protocols devised by neuroscientists to assess spatial cognition skills. Technological choices are emphasized with respect to ecological requirements. An ad hoc calibration procedure is also presented which is suitable to unstructured environments. Finally, preliminary tests carried out at a local day-care with 12-24 months old infants are presented which prove the in-field usability of the proposed technology.

A Socialization Intervention in Remote Health Coaching for Older Adults in the Home*

PubMed Central

Jimison, Holly B.; Klein, Krystal A.; Marcoe, Jennifer L.

2014-01-01

Previous studies have shown that social ties enhance both physical and mental health, and that social isolation has been linked to increased cognitive decline. As part of our cognitive training platform, we created a socialization intervention to address these issues. The intervention is designed to improve social contact time of older adults with remote family members and friends using a variety of technologies, including Web cameras, Skype software, email and phone. We used usability testing, surveys, interviews and system usage monitoring to develop design guidance for socialization protocols that were appropriate for older adults living independently in their homes. Our early results with this intervention show increased number of social contacts, total communication time (we measure email, phone, and Skype usage) and significant participant satisfaction with the intervention. PMID:24111362

Educational software usability: Artifact or Design?

PubMed

Van Nuland, Sonya E; Eagleson, Roy; Rogers, Kem A

2017-03-01

Online educational technologies and e-learning tools are providing new opportunities for students to learn worldwide, and they continue to play an important role in anatomical sciences education. Yet, as we shift to teaching online, particularly within the anatomical sciences, it has become apparent that e-learning tool success is based on more than just user satisfaction and preliminary learning outcomes-rather it is a multidimensional construct that should be addressed from an integrated perspective. The efficiency, effectiveness and satisfaction with which a user can navigate an e-learning tool is known as usability, and represents a construct which we propose can be used to quantitatively evaluate e-learning tool success. To assess the usability of an e-learning tool, usability testing should be employed during the design and development phases (i.e., prior to its release to users) as well as during its delivery (i.e., following its release to users). However, both the commercial educational software industry and individual academic developers in the anatomical sciences have overlooked the added value of additional usability testing. Reducing learner frustration and anxiety during e-learning tool use is essential in ensuring e-learning tool success, and will require a commitment on the part of the developers to engage in usability testing during all stages of an e-learning tool's life cycle. Anat Sci Educ 10: 190-199. © 2016 American Association of Anatomists. © 2016 American Association of Anatomists.

Evaluating the Usability of a Professional Modeling Tool Repurposed for Middle School Learning

NASA Astrophysics Data System (ADS)

Peters, Vanessa L.; Songer, Nancy Butler

2013-10-01

This paper reports the results of a three-stage usability test of a modeling tool designed to support learners' deep understanding of the impacts of climate change on ecosystems. The design process involved repurposing an existing modeling technology used by professional scientists into a learning tool specifically designed for middle school students. To evaluate usability, we analyzed students' task performance and task completion time as they worked on an activity with the repurposed modeling technology. In stage 1, we conducted remote testing of an early modeling prototype with urban middle school students (n = 84). In stages 2 and 3, we used screencasting software to record students' mouse and keyboard movements during collaborative think-alouds (n = 22) and conducted a qualitative analysis of their peer discussions. Taken together, the study findings revealed two kinds of usability issues that interfered with students' productive use of the tool: issues related to the use of data and information, and issues related to the use of the modeling technology. The study findings resulted in design improvements that led to stronger usability outcomes and higher task performance among students. In this paper, we describe our methods for usability testing, our research findings, and our design solutions for supporting students' use of the modeling technology and use of data. The paper concludes with implications for the design and study of modeling technologies for science learning.

Informational content, literacy demands, and usability of websites offering health-related genetic tests directly to consumers.

PubMed

Lachance, Christina R; Erby, Lori A H; Ford, Beth M; Allen, Vincent C; Kaphingst, Kimberly A

2010-05-01

As direct-to-consumer genetic testing becomes more available, a diverse group of consumers, including those with limited health literacy, may consider testing. In light of concerns raised about direct-to-consumer genetic testing, this study sought to critically examine whether the informational content, literacy demands, and usability of health-related direct-to-consumer websites met existing recommendations. A content analysis was performed on 29 health-related direct-to-consumer websites. Two coders independently evaluated each website for informational content (e.g., benefits, limitations), literacy demands (e.g., reading level), and usability (e.g., ease of navigation). Most sites presented health conditions and some markers for which they tested, benefits of testing, a description of the testing process, and their privacy policy. Fewer cited scientific literature, explained test limitations, or provided an opportunity to consult a health professional. Key informational content was difficult to locate on most sites. Few sites gave sample disease risk estimates or used common language and explained technical terms consistently. Average reading level was grade 15. The quality of informational content, literacy demands, and usability across health-related direct-to-consumer websites varied widely. Many users would struggle to find and understand the important information. For consumers to better understand the content on these sites and evaluate the meaning of the tests for their health, sites should lower the demands placed on users by distilling and prioritizing the key informational content while simultaneously attending to the reading level and usability elements. In the absence of regulation compelling such changes, government agencies or professional organizations may need to increase consumer and provider awareness of these issues.

Usability study of the EduMod eLearning Program for contouring nodal stations of the head and neck.

PubMed

Deraniyagala, Rohan; Amdur, Robert J; Boyer, Arthur L; Kaylor, Scott

2015-01-01

A major strategy for improving radiation oncology education and competence evaluation is to develop eLearning programs that reproduce the real work environment. A valuable measure of the quality of an eLearning program is "usability," which is a multidimensional endpoint defined from the end user's perspective. The gold standard for measuring usability is the Software Usability Measurement Inventory (SUMI). The purpose of this study is to use the SUMI to measure usability of an eLearning course that uses innovative software to teach and test contouring of nodal stations of the head and neck. This is a prospective institutional review board-approved study in which all participants gave written informed consent. The study population was radiation oncology residents from 8 different programs across the United States. The subjects had to pass all sections of the same 2 eLearning modules and then complete the SUMI usability evaluation instrument. We reached the accrual goal of 25 participants. Usability results for the EduMod eLearning course, "Nodal Stations of the Head and Neck," were compared with a large database of scores of other major software programs. Results were evaluated in 5 domains: Affect, Helpfulness, Control, Learnability, and Global Usability. In all 5 domains, usability scores for the study modules were higher than the database mean and statistically superior in 4 domains. This is the first study to evaluate usability of an eLearning program related to radiation oncology. Usability of 2 representative modules related to contouring nodal stations of the head and neck was highly favorable, with scores that were superior to the industry standard in multiple domains. These results support the continued development of this type of eLearning program for teaching and testing radiation oncology technical skills. Copyright © 2015 American Society for Radiation Oncology. Published by Elsevier Inc. All rights reserved.

Evaluating the parent-adolescent communication toolkit: Usability and preliminary content effectiveness of an online intervention.

PubMed

Toombs, Elaine; Unruh, Anita; McGrath, Patrick

2018-01-01

This study aimed to assess the Parent-Adolescent Communication Toolkit, an online intervention designed to help improve parent communication with their adolescents. Participant preferences for two module delivery systems (sequential and unrestricted module access) were identified. Usability assessment of the PACT intervention was completed using pre-test and posttest comparisons. Usability data, including participant completion and satisfaction ratings were examined. Parents ( N  =   18) of adolescents were randomized to a sequential or unrestricted chapter access group. Parent participants completed pre-test measures, the PACT intervention and posttest measures. Participants provided feedback for the intervention to improve modules and provided usability ratings. Adolescent pre- and posttest ratings were evaluated. Usability ratings were high and parent feedback was positive. The sequential module access groups rated the intervention content higher and completed more content than the unrestricted chapter access group, indicating support for the sequential access design. Parent mean posttest communication scores were significantly higher ( p  <   .05) than pre-test scores. No significant differences were detected for adolescent participants. Findings suggest that the Parent-Adolescent Communication Toolkit has potential to improve parent-adolescent communication but further effectiveness assessment is required.

Establishing best practices to improve usability of web interfaces providing atmospheric data

NASA Astrophysics Data System (ADS)

Oakley, N.; Daudert, B.

2014-12-01

Accessing scientific data through an online portal can be a frustrating task. The concept of making web interfaces easy to use known as "usability" has been thoroughly researched in the field of e-commerce but has not been explicitly addressed in the atmospheric sciences. As more observation stations are installed, satellite missions flown, models run, and field campaigns performed, large amounts of data are produced. Portals on the Internet have become the favored mechanisms to share this information and are ever increasing in number. Portals are often created without being tested for usability with the target audience though the expenses of testing are low and the returns high. To remain competitive and relevant in the provision of atmospheric data, it is imperative that developers understand design elements of a successful portal to make their product stand out among others. This presentation informs the audience of the benefits and basic principles of usability for web pages presenting atmospheric data. We will also share some of the best practices and recommendations we have formulated from the results of usability testing performed on two data provision web sites hosted by the Western Regional Climate Center.

Human Factors in the Large: Experiences from Denmark, Finland and Canada in Moving Towards Regional and National Evaluations of Health Information System Usability. Contribution of the IMIA Human Factors Working Group.

PubMed

Kushniruk, A; Kaipio, J; Nieminen, M; Hyppönen, H; Lääveri, T; Nohr, C; Kanstrup, A M; Berg Christiansen, M; Kuo, M-H; Borycki, E

2014-08-15

The objective of this paper is to explore approaches to understanding the usability of health information systems at regional and national levels. Several different methods are discussed in case studies from Denmark, Finland and Canada. They range from small scale qualitative studies involving usability testing of systems to larger scale national level questionnaire studies aimed at assessing the use and usability of health information systems by entire groups of health professionals. It was found that regional and national usability studies can complement smaller scale usability studies, and that they are needed in order to understand larger trends regarding system usability. Despite adoption of EHRs, many health professionals rate the usability of the systems as low. A range of usability issues have been noted when data is collected on a large scale through use of widely distributed questionnaires and websites designed to monitor user perceptions of usability. As health information systems are deployed on a widespread basis, studies that examine systems used regionally or nationally are required. In addition, collection of large scale data on the usability of specific IT products is needed in order to complement smaller scale studies of specific systems.

Human Factors in the Large: Experiences from Denmark, Finland and Canada in Moving Towards Regional and National Evaluations of Health Information System Usability

PubMed Central

Kaipio, J.; Nieminen, M.; Hyppönen, H.; Lääveri, T.; Nohr, C.; Kanstrup, A. M.; Berg Christiansen, M.; Kuo, M.-H.; Borycki, E.

2014-01-01

Summary Objectives The objective of this paper is to explore approaches to understanding the usability of health information systems at regional and national levels. Methods Several different methods are discussed in case studies from Denmark, Finland and Canada. They range from small scale qualitative studies involving usability testing of systems to larger scale national level questionnaire studies aimed at assessing the use and usability of health information systems by entire groups of health professionals. Results It was found that regional and national usability studies can complement smaller scale usability studies, and that they are needed in order to understand larger trends regarding system usability. Despite adoption of EHRs, many health professionals rate the usability of the systems as low. A range of usability issues have been noted when data is collected on a large scale through use of widely distributed questionnaires and websites designed to monitor user perceptions of usability. Conclusion As health information systems are deployed on a widespread basis, studies that examine systems used regionally or nationally are required. In addition, collection of large scale data on the usability of specific IT products is needed in order to complement smaller scale studies of specific systems. PMID:25123725

Usability of Operational Performance Support Tools - Findings from Sea Test II

NASA Technical Reports Server (NTRS)

Byrne, Vicky; Litaker, Harry; McGuire, Kerry

2014-01-01

Sea Test II, aka NASA Extreme Environment Mission Operations 17(NEEMO 17) took place in the Florida Aquarius undersea habitat. This confined underwater environment provides a excellent analog for space habitation providing similarities to space habitation such as hostile environment, difficult logistics, autonomous operations, and remote communications. This study collected subjective feedback on the usability of two performance support tools during the Sea Test II mission, Sept 10-14, 2013; Google Glass and iPAD. The two main objectives: - Assess the overall functionality and usability of each performance support tool in a mission analog environment. - Assess the advantages and disadvantages of each tool when performing operational procedures and Just-In-Time-Training (JITT).

Route Flap Damping Made Usable

NASA Astrophysics Data System (ADS)

Pelsser, Cristel; Maennel, Olaf; Mohapatra, Pradosh; Bush, Randy; Patel, Keyur

The Border Gateway Protocol (BGP), the de facto inter-domain routing protocol of the Internet, is known to be noisy. The protocol has two main mechanisms to ameliorate this, MinRouteAdvertisementInterval (MRAI), and Route Flap Damping (RFD). MRAI deals with very short bursts on the order of a few to 30 seconds. RFD deals with longer bursts, minutes to hours. Unfortunately, RFD was found to severely penalize sites for being well-connected because topological richness amplifies the number of update messages exchanged. So most operators have disabled it. Through measurement, this paper explores the avenue of absolutely minimal change to code, and shows that a few RFD algorithmic constants and limits can be trivially modified, with the result being damping a non-trivial amount of long term churn without penalizing well-behaved prefixes' normal convergence process.

Facilitating Energy Savings through Enhanced Usability of Thermostats

DOE Office of Scientific and Technical Information (OSTI.GOV)

Meier, Alan; Aragon, Cecilia; Peffer, Therese

2011-05-23

Residential thermostats play a key role in controlling heating and cooling systems. Occupants often find the controls of programmable thermostats confusing, sometimes leading to higher heating consumption than when the buildings are controlled manually. A high degree of usability is vital to a programmable thermostat's effectiveness because, unlike a more efficient heating system, occupants must engage in specific actions after installation to obtain energy savings. We developed a procedure for measuring the usability of thermostats and tested this methodology with 31 subjects on five thermostats. The procedure requires first identifying representative tasks associated with the device and then testing themore » subjects ability to accomplish those tasks. The procedure was able to demonstrate the subjects wide ability to accomplish tasks and the influence of a device's usability on success rates. A metric based on the time to accomplish the tasks and the fraction of subjects actually completing the tasks captured the key aspects of each thermostat's usability. The procedure was recently adopted by the Energy Star Program for its thermostat specification. The approach appears suitable for quantifying usability of controls in other products, such as heat pump water heaters and commercial lighting.« less

Addressing critical issues in the development of an Oncology Information System.

PubMed

Urda, D; Ribelles, N; Subirats, J L; Franco, L; Alba, E; Jerez, J M

2013-05-01

This paper presents the experience on the design and implementation of a user-centered Oncology Information System developed for the Medical Oncology Department at the "Hospital Universitario Virgen de la Victoria", in Málaga, Spain. The project focused on the aspects considered in the literature as critical factors for a successful deployment and usage of a health information system. System usability, adequate technology, integration of clinical routines, real-time statistical analysis of data, information confidentiality and standard protocol-based external interconnection were the key aspects considered. The developed system is based on a web application with a modular and layered architecture accounting for usability, ease of maintenance and further system development. Evaluation of system usability was carried at three and fifteen months after system deployment to analyze the advantages/disadvantages experienced by the end-users. A thorough prior analysis of clinical activities and workflows, the use of the adequate technology, and the availability of data analysis tools will almost guarantee success in the deployment of an Oncology Information System. Copyright © 2012 Elsevier Ireland Ltd. All rights reserved.

Card-Sorting Usability Tests of the WMU Libraries' Web Site

ERIC Educational Resources Information Center

Whang, Michael

2008-01-01

This article describes the card-sorting techniques used by several academic libraries, reports and discusses the results of card-sorting usability tests of the Western Michigan University Libraries' Web site, and reveals how the WMU libraries incorporated the findings into a new Web site redesign, setting the design direction early on. The article…

The Portable Usability Testing Lab: A Flexible Research Tool.

ERIC Educational Resources Information Center

Hale, Michael E.; And Others

A group of faculty at the University of Georgia obtained funding for a research and development facility called the Learning and Performance Support Laboratory (LPSL). One of the LPSL's primary needs was obtaining a portable usability lab for software testing, so the facility obtained the "Luggage Lab 2000." The lab is transportable to…

Harnessing scientific literature reports for pharmacovigilance. Prototype software analytical tool development and usability testing.

PubMed

Sorbello, Alfred; Ripple, Anna; Tonning, Joseph; Munoz, Monica; Hasan, Rashedul; Ly, Thomas; Francis, Henry; Bodenreider, Olivier

2017-03-22

We seek to develop a prototype software analytical tool to augment FDA regulatory reviewers' capacity to harness scientific literature reports in PubMed/MEDLINE for pharmacovigilance and adverse drug event (ADE) safety signal detection. We also aim to gather feedback through usability testing to assess design, performance, and user satisfaction with the tool. A prototype, open source, web-based, software analytical tool generated statistical disproportionality data mining signal scores and dynamic visual analytics for ADE safety signal detection and management. We leveraged Medical Subject Heading (MeSH) indexing terms assigned to published citations in PubMed/MEDLINE to generate candidate drug-adverse event pairs for quantitative data mining. Six FDA regulatory reviewers participated in usability testing by employing the tool as part of their ongoing real-life pharmacovigilance activities to provide subjective feedback on its practical impact, added value, and fitness for use. All usability test participants cited the tool's ease of learning, ease of use, and generation of quantitative ADE safety signals, some of which corresponded to known established adverse drug reactions. Potential concerns included the comparability of the tool's automated literature search relative to a manual 'all fields' PubMed search, missing drugs and adverse event terms, interpretation of signal scores, and integration with existing computer-based analytical tools. Usability testing demonstrated that this novel tool can automate the detection of ADE safety signals from published literature reports. Various mitigation strategies are described to foster improvements in design, productivity, and end user satisfaction.

The McMaster Optimal Aging Portal: Usability Evaluation of a Unique Evidence-Based Health Information Website.

PubMed

Barbara, Angela M; Dobbins, Maureen; Haynes, R Brian; Iorio, Alfonso; Lavis, John N; Raina, Parminder; Levinson, Anthony J

2016-05-11

Increasingly, older adults and their informal caregivers are using the Internet to search for health-related information. There is a proliferation of health information online, but the quality of this information varies, often based on exaggerated or dramatic findings, and not easily comprehended by consumers. The McMaster Optimal Aging Portal (Portal) was developed to provide Internet users with high-quality evidence about aging and address some of these current limitations of health information posted online. The Portal includes content for health professionals coming from three best-in-class resources (MacPLUS, Health Evidence, and Health Systems Evidence) and four types of content specifically prepared for the general public (Evidence Summaries, Web Resource Ratings, Blog Posts, and Twitter messages). Our objectives were to share the findings of the usability evaluation of the Portal with particular focus on the content features for the general public and to inform designers of health information websites and online resources for older adults about key usability themes. Data analysis included task performance during usability testing and qualitative content analyses of both the usability sessions and interviews to identify core themes. A total of 37 participants took part in 33 usability testing sessions and 21 focused interviews. Qualitative analysis revealed common themes regarding the Portal's strengths and challenges to usability. The strengths of the website were related to credibility, applicability, browsing function, design, and accessibility. The usability challenges included reluctance to register, process of registering, searching, terminology, and technical features. The study reinforced the importance of including end users during the development of this unique, dynamic, evidence-based health information website. The feedback was applied to iteratively improve website usability. Our findings can be applied by designers of health-related websites.

The McMaster Optimal Aging Portal: Usability Evaluation of a Unique Evidence-Based Health Information Website

PubMed Central

Dobbins, Maureen; Haynes, R. Brian; Iorio, Alfonso; Lavis, John N; Raina, Parminder

2016-01-01

Background Increasingly, older adults and their informal caregivers are using the Internet to search for health-related information. There is a proliferation of health information online, but the quality of this information varies, often based on exaggerated or dramatic findings, and not easily comprehended by consumers. The McMaster Optimal Aging Portal (Portal) was developed to provide Internet users with high-quality evidence about aging and address some of these current limitations of health information posted online. The Portal includes content for health professionals coming from three best-in-class resources (MacPLUS, Health Evidence, and Health Systems Evidence) and four types of content specifically prepared for the general public (Evidence Summaries, Web Resource Ratings, Blog Posts, and Twitter messages). Objective Our objectives were to share the findings of the usability evaluation of the Portal with particular focus on the content features for the general public and to inform designers of health information websites and online resources for older adults about key usability themes. Methods Data analysis included task performance during usability testing and qualitative content analyses of both the usability sessions and interviews to identify core themes. Results A total of 37 participants took part in 33 usability testing sessions and 21 focused interviews. Qualitative analysis revealed common themes regarding the Portal’s strengths and challenges to usability. The strengths of the website were related to credibility, applicability, browsing function, design, and accessibility. The usability challenges included reluctance to register, process of registering, searching, terminology, and technical features. Conclusions The study reinforced the importance of including end users during the development of this unique, dynamic, evidence-based health information website. The feedback was applied to iteratively improve website usability. Our findings can be applied by designers of health-related websites. PMID:27170443

A research protocol for developing a Point-Of-Care Key Evidence Tool 'POCKET': a checklist for multidimensional evidence reporting on point-of-care in vitro diagnostics.

PubMed

Huddy, Jeremy R; Ni, Melody; Mavroveli, Stella; Barlow, James; Williams, Doris-Ann; Hanna, George B

2015-07-10

Point-of-care in vitro diagnostics (POC-IVD) are increasingly becoming widespread as an acceptable means of providing rapid diagnostic results to facilitate decision-making in many clinical pathways. Evidence in utility, usability and cost-effectiveness is currently provided in a fragmented and detached manner that is fraught with methodological challenges given the disruptive nature these tests have on the clinical pathway. The Point-of-care Key Evidence Tool (POCKET) checklist aims to provide an integrated evidence-based framework that incorporates all required evidence to guide the evaluation of POC-IVD to meet the needs of policy and decisionmakers in the National Health Service (NHS). A multimethod approach will be applied in order to develop the POCKET. A thorough literature review has formed the basis of a robust Delphi process and validation study. Semistructured interviews are being undertaken with POC-IVD stakeholders, including industry, regulators, commissioners, clinicians and patients to understand what evidence is required to facilitate decision-making. Emergent themes will be translated into a series of statements to form a survey questionnaire that aims to reach a consensus in each stakeholder group to what needs to be included in the tool. Results will be presented to a workshop to discuss the statements brought forward and the optimal format for the tool. Once assembled, the tool will be field-tested through case studies to ensure validity and usability and inform refinement, if required. The final version will be published online with a call for comments. Limitations include unpredictable sample representation, development of compromise position rather than consensus, and absence of blinding in validation exercise. The Imperial College Joint Research Compliance Office and the Imperial College Hospitals NHS Trust R&D department have approved the protocol. The checklist tool will be disseminated through a PhD thesis, a website, peer-reviewed publication, academic conferences and formal presentations. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

Development and preliminary testing of a web-based, self-help application for disaster-affected families

PubMed Central

Yuen, Erica K; Gros, Kirstin; Welsh, Kyleen E; McCauley, Jenna; Resnick, Heidi S; Danielson, Carla K; Price, Matthew; Ruggiero, Kenneth J

2015-01-01

Technology-based self-help interventions have the potential to increase access to evidence-based mental healthcare, especially for families affected by natural disasters. However, development of these interventions is a complex process and poses unique challenges. Usability testing, which assesses the ability of individuals to use an application successfully, can have a significant impact on the quality of a self-help intervention. This article describes (a) the development of a novel web-based multi-module self-help intervention for disaster-affected adolescents and their parents and (b) a mixed-methods formal usability study to evaluate user response. A total of 24 adolescents were observed, videotaped, and interviewed as they used the depressed mood component of the self-help intervention. Quantitative results indicated an above-average user experience, and qualitative analysis identified 120 unique usability issues. We discuss the challenges of developing self-help applications, including design considerations and the value of usability testing in technology-based interventions, as well as our plan for widespread dissemination. PMID:25933798

PyMercury: Interactive Python for the Mercury Monte Carlo Particle Transport Code

DOE Office of Scientific and Technical Information (OSTI.GOV)

Iandola, F N; O'Brien, M J; Procassini, R J

2010-11-29

Monte Carlo particle transport applications are often written in low-level languages (C/C++) for optimal performance on clusters and supercomputers. However, this development approach often sacrifices straightforward usability and testing in the interest of fast application performance. To improve usability, some high-performance computing applications employ mixed-language programming with high-level and low-level languages. In this study, we consider the benefits of incorporating an interactive Python interface into a Monte Carlo application. With PyMercury, a new Python extension to the Mercury general-purpose Monte Carlo particle transport code, we improve application usability without diminishing performance. In two case studies, we illustrate how PyMercury improvesmore » usability and simplifies testing and validation in a Monte Carlo application. In short, PyMercury demonstrates the value of interactive Python for Monte Carlo particle transport applications. In the future, we expect interactive Python to play an increasingly significant role in Monte Carlo usage and testing.« less

Usability testing of an mHealth device for swallowing therapy in head and neck cancer survivors.

PubMed

Constantinescu, Gabriela; Kuffel, Kristina; King, Ben; Hodgetts, William; Rieger, Jana

2018-04-01

The objective of this study was to conduct the first patient usability testing of a mobile health (mHealth) system for in-home swallowing therapy. Five participants with a history of head and neck cancer evaluated the mHealth system. After completing an in-application (app) tutorial with the clinician, participants were asked to independently complete five tasks: pair the device to the smartphone, place the device correctly, exercise, interpret progress displays, and close the system. Quantitative and qualitative methods were used to evaluate the effectiveness, efficiency, and satisfaction with the system. Critical changes to the app were found in three of the tasks, resulting in recommendations for the next iteration. These issues were related to ease of Bluetooth pairing, placement of device, and interpretation of statistics. Usability testing with patients identified issues that were essential to address prior to implementing the mHealth system in subsequent clinical trials. Of the usability methods used, video observation (synced screen capture with videoed gestures) revealed the most information.

Interactive Digital e-Health Game for Heart Failure Self-Management: A Feasibility Study.

PubMed

Radhakrishnan, Kavita; Toprac, Paul; O'Hair, Matt; Bias, Randolph; Kim, Miyong T; Bradley, Paul; Mackert, Michael

2016-12-01

To develop and test the prototype of a serious digital game for improving community-dwelling older adults' heart failure (HF) knowledge and self-management behaviors. The serious game innovatively incorporates evidence-based HF guidelines with contemporary game technology. The study included three phases: development of the game prototype, its usability assessment, and evaluation of the game's functionality. Usability testing included researchers' usability assessment, followed by research personnel's observations of participants playing the game, and participants' completion of a usability survey. Next, in a pretest-post-test design, validated instruments-the Atlanta Heart Failure Knowledge Test and the Self Care for Heart Failure Index-were used to measure improvement in HF self-management knowledge and behaviors related to HF self-maintenance, self-management, and self-efficacy, respectively. A postgame survey assessed participants' perceptions of the game. During usability testing, with seven participants, 100%, 100%, and 86% found the game easy to play, enjoyable, and helpful for learning about HF, respectively. In the subsequent functionality testing, with 19 participants, 89% found the game interesting, enjoyable, and easy to play. Playing the game resulted in a significant improvement in HF self-management knowledge, a nonsignificant improvement in self-reported behaviors related to HF self-maintenance, and no difference in HF self-efficacy scores. Participants with lower education level and age preferred games to any other medium for receiving information. It is feasible to develop a serious digital game that community-dwelling older adults with HF find both satisfying and acceptable and that can improve their self-management knowledge.

Interactive Digital e-Health Game for Heart Failure Self-Management: A Feasibility Study

PubMed Central

Toprac, Paul; O'Hair, Matt; Bias, Randolph; Kim, Miyong T.; Bradley, Paul; Mackert, Michael

2016-01-01

Abstract Objective: To develop and test the prototype of a serious digital game for improving community-dwelling older adults' heart failure (HF) knowledge and self-management behaviors. The serious game innovatively incorporates evidence-based HF guidelines with contemporary game technology. Materials and Methods: The study included three phases: development of the game prototype, its usability assessment, and evaluation of the game's functionality. Usability testing included researchers' usability assessment, followed by research personnel's observations of participants playing the game, and participants' completion of a usability survey. Next, in a pretest–post-test design, validated instruments—the Atlanta Heart Failure Knowledge Test and the Self Care for Heart Failure Index—were used to measure improvement in HF self-management knowledge and behaviors related to HF self-maintenance, self-management, and self-efficacy, respectively. A postgame survey assessed participants' perceptions of the game. Results: During usability testing, with seven participants, 100%, 100%, and 86% found the game easy to play, enjoyable, and helpful for learning about HF, respectively. In the subsequent functionality testing, with 19 participants, 89% found the game interesting, enjoyable, and easy to play. Playing the game resulted in a significant improvement in HF self-management knowledge, a nonsignificant improvement in self-reported behaviors related to HF self-maintenance, and no difference in HF self-efficacy scores. Participants with lower education level and age preferred games to any other medium for receiving information. Conclusion: It is feasible to develop a serious digital game that community-dwelling older adults with HF find both satisfying and acceptable and that can improve their self-management knowledge. PMID:27976955

Development and usability of a computer-tailored pedometer-based physical activity advice for breast cancer survivors.

PubMed

De Cocker, K; Charlier, C; Van Hoof, E; Pauwels, E; Lechner, L; Bourgois, J; Spittaels, H; Vandelanotte, C; De Bourdeaudhuij, I

2015-09-01

This observational study aimed to adapt a computer-tailored step advice for the general population into a feasible advice for breast cancer survivors and to test its usability. First, several adaptations were made to the original design (adding cancer-related physical activity (PA) barriers and beliefs, and self-management strategies to improve survivors' personal control). Second, the adapted advice was evaluated in two phases: (1) a usability testing in healthy women (n = 3) and survivors (n = 6); and (2) a process evaluation during 3 weeks in breast cancer survivors (n = 8). Preliminary usability testing revealed no problems during logging-in; however, three survivors misinterpreted some questions. After refining the questionnaire and advice, survivors evaluated the advice as interesting, attractive to read, comprehensible and credible. Inactive survivors found the advice novel, but too long. The process evaluation indicated that the majority of the women (n = 5/8) reported increased steps. Monitoring step counts by using a pedometer was perceived as an important motivator to be more active. To conclude, this study provides initial support for the usability and acceptability of a computer-tailored pedometer-based PA advice for breast cancer survivors. After testing efficacy and effectiveness of this intervention, this tool can broaden the reach of PA promotion in breast cancer survivors. © 2014 John Wiley & Sons Ltd.

Annotating Mutational Effects on Proteins and Protein Interactions: Designing Novel and Revisiting Existing Protocols.

PubMed

Li, Minghui; Goncearenco, Alexander; Panchenko, Anna R

2017-01-01

In this review we describe a protocol to annotate the effects of missense mutations on proteins, their functions, stability, and binding. For this purpose we present a collection of the most comprehensive databases which store different types of sequencing data on missense mutations, we discuss their relationships, possible intersections, and unique features. Next, we suggest an annotation workflow using the state-of-the art methods and highlight their usability, advantages, and limitations for different cases. Finally, we address a particularly difficult problem of deciphering the molecular mechanisms of mutations on proteins and protein complexes to understand the origins and mechanisms of diseases.

A Secure Three-Factor User Authentication and Key Agreement Protocol for TMIS With User Anonymity.

PubMed

Amin, Ruhul; Biswas, G P

2015-08-01

Telecare medical information system (TMIS) makes an efficient and convenient connection between patient(s)/user(s) and doctor(s) over the insecure internet. Therefore, data security, privacy and user authentication are enormously important for accessing important medical data over insecure communication. Recently, many user authentication protocols for TMIS have been proposed in the literature and it has been observed that most of the protocols cannot achieve complete security requirements. In this paper, we have scrutinized two (Mishra et al., Xu et al.) remote user authentication protocols using smart card and explained that both the protocols are suffering against several security weaknesses. We have then presented three-factor user authentication and key agreement protocol usable for TMIS, which fix the security pitfalls of the above mentioned schemes. The informal cryptanalysis makes certain that the proposed protocol provides well security protection on the relevant security attacks. Furthermore, the simulator AVISPA tool confirms that the protocol is secure against active and passive attacks including replay and man-in-the-middle attacks. The security functionalities and performance comparison analysis confirm that our protocol not only provide strong protection on security attacks, but it also achieves better complexities along with efficient login and password change phase as well as session key verification property.

Biofeedback in Partial Weight Bearing: Usability of Two Different Devices from a Patient’s and Physical Therapist’s Perspective

PubMed Central

van Lieshout, Remko; Pisters, Martijn F.; Vanwanseele, Benedicte; de Bie, Rob A.; Wouters, Eveline J.; Stukstette, Mirelle J.

2016-01-01

Background Partial weight bearing is frequently instructed by physical therapists in patients after lower-limb trauma or surgery. The use of biofeedback devices seems promising to improve the patient’s compliance with weight-bearing instructions. SmartStep and OpenGo-Science are biofeedback devices that provide real-time feedback. For a successful implementation, usability of the devices is a critical aspect and should be tested from a user’s perspective. Aim To describe the usability from the physical therapists’ and a patients’ perspective of Smartstep and OpenGo-Science to provide feedback on partial weight bearing during supervised rehabilitation of patients after lower-limb trauma or surgery. Methods In a convergent mixed-methods design, qualitative and quantitative data were collected. Usability was subdivided into user performance, satisfaction and acceptability. Patients prescribed with partial weight bearing and their physical therapists were asked to use SmartStep and OpenGo-Science during supervised rehabilitation. Usability was qualitatively tested by a think-aloud method and a semi-structured interview and quantitatively tested by the System-Usability-Scale (SUS) and closed questions. For the qualitative data thematic content analyses were used. Results Nine pairs of physical therapists and their patients participated. The mean SUS scores for patients and physical therapists were for SmartStep 70 and 53, and for OpenGo-Science 79 and 81, respectively. Scores were interpreted with the Curved Grading Scale. The qualitative data showed that there were mixed views and perceptions from patients and physical therapists on satisfaction and acceptability. Conclusion This study gives insight in the usability of two biofeedback devices from the patient’s and physical therapist’s perspective. The overall usability from both perspectives seemed to be acceptable for OpenGo-Science. For SmartStep, overall usability seemed only acceptable from the patient’s perspective. Implication The study findings could help clinicians to decide which biofeedback device is appropriate for their given situation and provide information for future development of biofeedback devices. PMID:27798674

OPTIMIZING USABILITY OF AN ECONOMIC DECISION SUPPORT TOOL: PROTOTYPE OF THE EQUIPT TOOL.

PubMed

Cheung, Kei Long; Hiligsmann, Mickaël; Präger, Maximilian; Jones, Teresa; Józwiak-Hagymásy, Judit; Muñoz, Celia; Lester-George, Adam; Pokhrel, Subhash; López-Nicolás, Ángel; Trapero-Bertran, Marta; Evers, Silvia M A A; de Vries, Hein

2018-01-01

Economic decision-support tools can provide valuable information for tobacco control stakeholders, but their usability may impact the adoption of such tools. This study aims to illustrate a mixed-method usability evaluation of an economic decision-support tool for tobacco control, using the EQUIPT ROI tool prototype as a case study. A cross-sectional mixed methods design was used, including a heuristic evaluation, a thinking aloud approach, and a questionnaire testing and exploring the usability of the Return of Investment tool. A total of sixty-six users evaluated the tool (thinking aloud) and completed the questionnaire. For the heuristic evaluation, four experts evaluated the interface. In total twenty-one percent of the respondents perceived good usability. A total of 118 usability problems were identified, from which twenty-six problems were categorized as most severe, indicating high priority to fix them before implementation. Combining user-based and expert-based evaluation methods is recommended as these were shown to identify unique usability problems. The evaluation provides input to optimize usability of a decision-support tool, and may serve as a vantage point for other developers to conduct usability evaluations to refine similar tools before wide-scale implementation. Such studies could reduce implementation gaps by optimizing usability, enhancing in turn the research impact of such interventions.

Effect of improving the usability of an e-learning resource: a randomized trial.

PubMed

Davids, Mogamat Razeen; Chikte, Usuf M E; Halperin, Mitchell L

2014-06-01

Optimizing the usability of e-learning materials is necessary to reduce extraneous cognitive load and maximize their potential educational impact. However, this is often neglected, especially when time and other resources are limited. We conducted a randomized trial to investigate whether a usability evaluation of our multimedia e-learning resource, followed by fixing of all problems identified, would translate into improvements in usability parameters and learning by medical residents. Two iterations of our e-learning resource [version 1 (V1) and version 2 (V2)] were compared. V1 was the first fully functional version and V2 was the revised version after all identified usability problems were addressed. Residents in internal medicine and anesthesiology were randomly assigned to one of the versions. Usability was evaluated by having participants complete a user satisfaction questionnaire and by recording and analyzing their interactions with the application. The effect on learning was assessed by questions designed to test the retention and transfer of knowledge. Participants reported high levels of satisfaction with both versions, with good ratings on the System Usability Scale and adjective rating scale. In contrast, analysis of video recordings revealed significant differences in the occurrence of serious usability problems between the two versions, in particular in the interactive HandsOn case with its treatment simulation, where there was a median of five serious problem instances (range: 0-50) recorded per participant for V1 and zero instances (range: 0-1) for V2 (P < 0.001). There were no differences in tests of retention or transfer of knowledge between the two versions. In conclusion, usability evaluation followed by a redesign of our e-learning resource resulted in significant improvements in usability. This is likely to translate into improved motivation and willingness to engage with the learning material. In this population of relatively high-knowledge participants, learning scores were similar across the two versions. Copyright © 2014 The American Physiological Society.

Effect of improving the usability of an e-learning resource: a randomized trial

PubMed Central

Chikte, Usuf M. E.; Halperin, Mitchell L.

2014-01-01

Optimizing the usability of e-learning materials is necessary to reduce extraneous cognitive load and maximize their potential educational impact. However, this is often neglected, especially when time and other resources are limited. We conducted a randomized trial to investigate whether a usability evaluation of our multimedia e-learning resource, followed by fixing of all problems identified, would translate into improvements in usability parameters and learning by medical residents. Two iterations of our e-learning resource [version 1 (V1) and version 2 (V2)] were compared. V1 was the first fully functional version and V2 was the revised version after all identified usability problems were addressed. Residents in internal medicine and anesthesiology were randomly assigned to one of the versions. Usability was evaluated by having participants complete a user satisfaction questionnaire and by recording and analyzing their interactions with the application. The effect on learning was assessed by questions designed to test the retention and transfer of knowledge. Participants reported high levels of satisfaction with both versions, with good ratings on the System Usability Scale and adjective rating scale. In contrast, analysis of video recordings revealed significant differences in the occurrence of serious usability problems between the two versions, in particular in the interactive HandsOn case with its treatment simulation, where there was a median of five serious problem instances (range: 0–50) recorded per participant for V1 and zero instances (range: 0–1) for V2 (P < 0.001). There were no differences in tests of retention or transfer of knowledge between the two versions. In conclusion, usability evaluation followed by a redesign of our e-learning resource resulted in significant improvements in usability. This is likely to translate into improved motivation and willingness to engage with the learning material. In this population of relatively high-knowledge participants, learning scores were similar across the two versions. PMID:24913451

Addressing the Tension Between Strong Perimeter Control an Usability

NASA Technical Reports Server (NTRS)

Hinke, Thomas H.; Kolano, Paul Z.; Keller, Chris

2006-01-01

This paper describes a strong perimeter control system for a general purpose processing system, with the perimeter control system taking significant steps to address usability issues, thus mitigating the tension between strong perimeter protection and usability. A secure front end enforces two-factor authentication for all interactive access to an enclave that contains a large supercomputer and various associated systems, with each requiring their own authentication. Usability is addressed through a design in which the user has to perform two-factor authentication at the secure front end in order to gain access to the enclave, while an agent transparently performs public key authentication as needed to authenticate to specific systems within the enclave. The paper then describes a proxy system that allows users to transfer files into the enclave under script control, when the user is not present to perform two-factor authentication. This uses a pre-authorization approach based on public key technology, which is still strongly tied to both two-factor authentication and strict control over where files can be transferred on the target system. Finally the paper describes an approach to support network applications and systems such as grids or parallel file transfer protocols that require the use of many ports through the perimeter. The paper describes a least privilege approach that dynamically opens ports on a host-specific, if-authorized, as-needed, just-in-time basis.

Usability Testing of the Indiana University Education Faculty Web Forms.

ERIC Educational Resources Information Center

Tuzun, Hakan; Lee, Sun Myung; Graham, Charles; Sluder, Kirk Job

The usability test team examined design problems that limit the ability of instructors at the Indiana University to use data entry forms on the School of Education Web site. The forms permit instructors to publish information about themselves and about courses they teach on the School of Education Web site. Faculty and graduate student instructors…

Design and Usability Testing of an Audio Platform Game for Players with Visual Impairments

ERIC Educational Resources Information Center

Oren, Michael; Harding, Chris; Bonebright, Terri L.

2008-01-01

This article reports on the evaluation of a novel audio platform game that creates a spatial, interactive experience via audio cues. A pilot study with players with visual impairments, and usability testing comparing the visual and audio game versions using both sighted players and players with visual impairments, revealed that all the…

Testing the Usability of Interactive Visualizations for Complex Problem-Solving: Findings Related to Improving Interfaces and Help.

ERIC Educational Resources Information Center

Mirel, Barbara

2001-01-01

Conducts a scenario-based usability test with 10 data analysts using visual querying (visually analyzing data with interactive graphics). Details a range of difficulties found in visual selection that, at times, gave rise to inaccurate selections, invalid conclusions, and misguided decisions. Argues that support for visual selection must be built…

Focus Groups and Usability Testing in Redesigning an Academic Library's Web Site

ERIC Educational Resources Information Center

Oldham, Bonnie W.

2008-01-01

As the World Wide Web has advanced since its inception, librarians have endeavored to keep pace with this progress in the design of their library Web pages. User recommendations collected from focus groups and usability testing have indicated that the University of Scranton's Weinberg Memorial Library's Web site was not working as intended, and…

Get out of Fines Free: Recruiting Student Usability Testers via Fine Waivers

ERIC Educational Resources Information Center

Hockenberry, Benjamin; Blackburn, Kourtney

2016-01-01

St. John Fisher College's Lavery Library's Access Services and Systems departments began a pilot project in which students with overdue fines tested usability of library Web sites in exchange for fine waivers. Circulation staff promoted the program and redeemed fine waiver vouchers at the Checkout Desk, while Systems staff administered testing and…

Mobile Learning Analytics in Higher Education: Usability Testing and Evaluation of an APP Prototype

ERIC Educational Resources Information Center

Kuhnel, Matthias; Seiler, Luisa; Honal, Andrea; Ifenthaler, Dirk

2017-01-01

This study aims to test the usability of MyLA (My Learning Analytics), an application for students at two German universities: The Cooperative State University Mannheim and University of Mannheim. The participating universities focus on the support of personalized and self-regulated learning. MyLA collects data such as learning behavior and…

Usability and feasibility of a tablet-based Decision-Support and Integrated Record-keeping (DESIRE) tool in the nurse management of hypertension in rural western Kenya.

PubMed

Vedanthan, Rajesh; Blank, Evan; Tuikong, Nelly; Kamano, Jemima; Misoi, Lawrence; Tulienge, Deborah; Hutchinson, Claire; Ascheim, Deborah D; Kimaiyo, Sylvester; Fuster, Valentin; Were, Martin C

2015-03-01

Mobile health (mHealth) applications have recently proliferated, especially in low- and middle-income countries, complementing task-redistribution strategies with clinical decision support. Relatively few studies address usability and feasibility issues that may impact success or failure of implementation, and few have been conducted for non-communicable diseases such as hypertension. To conduct iterative usability and feasibility testing of a tablet-based Decision Support and Integrated Record-keeping (DESIRE) tool, a technology intended to assist rural clinicians taking care of hypertension patients at the community level in a resource-limited setting in western Kenya. Usability testing consisted of "think aloud" exercises and "mock patient encounters" with five nurses, as well as one focus group discussion. Feasibility testing consisted of semi-structured interviews of five nurses and two members of the implementation team, and one focus group discussion with nurses. Content analysis was performed using both deductive codes and significant inductive codes. Critical incidents were identified and ranked according to severity. A cause-of-error analysis was used to develop corresponding design change suggestions. Fifty-seven critical incidents were identified in usability testing, 21 of which were unique. The cause-of-error analysis yielded 23 design change suggestions. Feasibility themes included barriers to implementation along both human and technical axes, facilitators to implementation, provider issues, patient issues and feature requests. This participatory, iterative human-centered design process revealed previously unaddressed usability and feasibility issues affecting the implementation of the DESIRE tool in western Kenya. In addition to well-known technical issues, we highlight the importance of human factors that can impact implementation of mHealth interventions. Copyright © 2015 Elsevier Ireland Ltd. All rights reserved.

Usability and Feasibility of a Tablet-Based Decision-Support and Integrated Record-Keeping (DESIRE) Tool in the Nurse Management of Hypertension in Rural Western Kenya

PubMed Central

Vedanthan, Rajesh; Blank, Evan; Tuikong, Nelly; Kamano, Jemima; Misoi, Lawrence; Tulienge, Deborah; Hutchinson, Claire; Ascheim, Deborah D.; Kimaiyo, Sylvester; Fuster, Valentin; Were, Martin C.

2015-01-01

Background Mobile health (mHealth) applications have recently proliferated, especially in low- and middle-income countries, complementing task-redistribution strategies with clinical decision support. Relatively few studies address usability and feasibility issues that may impact success or failure of implementation, and few have been conducted for non-communicable diseases such as hypertension. Objective To conduct iterative usability and feasibility testing of a tablet-based Decision Support and Integrated Record-keeping (DESIRE) tool, a technology intended to assist rural clinicians taking care of hypertension patients at the community level in a resource-limited setting in western Kenya. Methods Usability testing consisted of “think aloud” exercises and “mock patient encounters” with five nurses, as well as one focus group discussion. Feasibility testing consisted of semi-structured interviews of five nurses and two members of the implementation team, and one focus group discussion with nurses. Content analysis was performed using both deductive codes and significant inductive codes. Critical incidents were identified and ranked according to severity. A cause-of-error analysis was used to develop corresponding design change suggestions. Results Fifty-seven critical incidents were identified in usability testing, 21 of which were unique. The cause-of-error analysis yielded 23 design change suggestions. Feasibility themes included barriers to implementation along both human and technical axes, facilitators to implementation, provider issues, patient issues and feature requests. Conclusions This participatory, iterative human-centered design process revealed previously unaddressed usability and feasibility issues affecting the implementation of the DESIRE tool in western Kenya. In addition to well-known technical issues, we highlight the importance of human factors that can impact implementation of mHealth interventions. PMID:25612791

Exploring the Usability of Mobile Apps Supporting Radiologists' Training in Diagnostic Decision Making.

PubMed

Kim, Min Soon; Aro, Michael R; Lage, Kraig J; Ingalls, Kevin L; Sindhwani, Vivek; Markey, Mia K

2016-03-01

The objective of this study was to conduct a usability evaluation of mobile apps for supporting education and training in radiologic diagnostic decision-making processes. Of 381 mobile apps available at two major stores (Google Play and iTunes), eight iOS apps were selected for laboratory-based usability tests. Six staff radiologists completed eight app-specific task sets, using a think-aloud strategy. The triangular methods approach included quantitative performance measures, System Usability Scale (SUS), and qualitative thematic analysis using heuristic usability principles of usability issues. Overall, radiologists achieved higher than 70% success, with favorable SUS scores, in completing the tasks for seven of the eight apps. However, task success rate and SUS score had a weak relation (r = 0.23), indicating that the perceived usability may not reflect the holistic usability of the app. Task analysis and self-report revealed 108 usability issues, which were condensed to 55 unique issues and categorized by nine usability themes and mapped to ten usability heuristics. Nonintuitive functionality (eg, nonintuitive or misleading labels) was the most frequent theme observed, leading to inefficient navigation. These usability findings were consistent with the 13 improvements the radiologists suggested. This study demonstrates the feasibility of usability evaluation of radiology mobile apps and suggests potential improvements in the development of radiology mobile apps. This study also suggests that proficiency with mobile devices may not be equivalent to being an expert user, proficient in using the apps. Copyright © 2016 American College of Radiology. Published by Elsevier Inc. All rights reserved.

C-TOC (Cognitive Testing on Computer): investigating the usability and validity of a novel self-administered cognitive assessment tool in aging and early dementia.

PubMed

Jacova, Claudia; McGrenere, Joanna; Lee, Hyunsoo S; Wang, William W; Le Huray, Sarah; Corenblith, Emily F; Brehmer, Matthew; Tang, Charlotte; Hayden, Sherri; Beattie, B Lynn; Hsiung, Ging-Yuek R

2015-01-01

Cognitive Testing on Computer (C-TOC) is a novel computer-based test battery developed to improve both usability and validity in the computerized assessment of cognitive function in older adults. C-TOC's usability was evaluated concurrently with its iterative development to version 4 in subjects with and without cognitive impairment, and health professional advisors representing different ethnocultural groups. C-TOC version 4 was then validated against neuropsychological tests (NPTs), and by comparing performance scores of subjects with normal cognition, Cognitive Impairment Not Dementia (CIND) and Alzheimer disease. C-TOC's language tests were validated in subjects with aphasic disorders. The most important usability issue that emerged from consultations with 27 older adults and with 8 cultural advisors was the test-takers' understanding of the task, particularly executive function tasks. User interface features did not pose significant problems. C-TOC version 4 tests correlated with comparator NPT (r=0.4 to 0.7). C-TOC test scores were normal (n=16)>CIND (n=16)>Alzheimer disease (n=6). All normal/CIND NPT performance differences were detected on C-TOC. Low computer knowledge adversely affected test performance, particularly in CIND. C-TOC detected impairments in aphasic disorders (n=11). In general, C-TOC had good validity in detecting cognitive impairment. Ensuring test-takers' understanding of the tasks, and considering their computer knowledge appear important steps towards C-TOC's implementation.

75 FR 14145 - Agency Information Collection Activities: Proposed Collection; Comment Request

Federal Register 2010, 2011, 2012, 2013, 2014

2010-03-24

... made in response to usability testing as well as internal review. Changes have also been made to... burden of reporting using the electronic software and improve usability. The affected questions can be...

Usability Evaluation of NLP-PIER: A Clinical Document Search Engine for Researchers.

PubMed

Hultman, Gretchen; McEwan, Reed; Pakhomov, Serguei; Lindemann, Elizabeth; Skube, Steven; Melton, Genevieve B

2017-01-01

NLP-PIER (Natural Language Processing - Patient Information Extraction for Research) is a self-service platform with a search engine for clinical researchers to perform natural language processing (NLP) queries using clinical notes. We conducted user-centered testing of NLP-PIER's usability to inform future design decisions. Quantitative and qualitative data were analyzed. Our findings will be used to improve the usability of NLP-PIER.

Extraction of phenotypic traits from taxonomic descriptions for the tree of life using natural language processing.

PubMed

Endara, Lorena; Cui, Hong; Burleigh, J Gordon

2018-03-01

Phenotypic data sets are necessary to elucidate the genealogy of life, but assembling phenotypic data for taxa across the tree of life can be technically challenging and prohibitively time consuming. We describe a semi-automated protocol to facilitate and expedite the assembly of phenotypic character matrices of plants from formal taxonomic descriptions. This pipeline uses new natural language processing (NLP) techniques and a glossary of over 9000 botanical terms. Our protocol includes the Explorer of Taxon Concepts (ETC), an online application that assembles taxon-by-character matrices from taxonomic descriptions, and MatrixConverter, a Java application that enables users to evaluate and discretize the characters extracted by ETC. We demonstrate this protocol using descriptions from Araucariaceae. The NLP pipeline unlocks the phenotypic data found in taxonomic descriptions and makes them usable for evolutionary analyses.

Procuring interoperability at the expense of usability: a case study of UK National Programme for IT assurance process.

PubMed

Krause, Paul; de Lusignan, Simon

2010-01-01

The allure of interoperable systems is that they should improve patient safety and make health services more efficient. The UK's National Programme for IT has made great strides in achieving interoperability; through linkage to a national electronic spine. However, there has been criticism of the usability of the applications in the clinical environment. Analysis of the procurement and assurance process to explore whether they predetermine usability. Processes separate developers from users, and test products against theoretical assurance models of use rather than simulate or pilot in a clinical environment. The current process appears to be effective for back office systems and high risk applications, but too inflexible for developing applications for the clinical setting. For clinical applications agile techniques are more appropriate. Usability testing should become an integrated part of the contractual process and be introduced earlier in the development process.

Lessons learned from the usability assessment of home-based telemedicine systems.

PubMed

Agnisarman, Sruthy Orozhiyathumana; Chalil Madathil, Kapil; Smith, Kevin; Ashok, Aparna; Welch, Brandon; McElligott, James T

2017-01-01

At-home telemedicine visits are quickly becoming an acceptable alternative for in-person patient visits. However, little work has been done to understand the usability of these home-based telemedicine solutions. It is critical for user acceptance and real-world applicability to evaluate available telemedicine solutions within the context-specific needs of the users of this technology. To address this need, this study evaluated the usability of four home-based telemedicine software platforms: Doxy.me, Vidyo, VSee, and Polycom. Using a within-subjects experimental design, twenty participants were asked to complete a telemedicine session involving several tasks using the four platforms. Upon completion of these tasks for each platform, participants completed the IBM computer system usability questionnaire (CSUQ) and the NASA Task Load Index test. Upon completing the tasks on all four platforms, the participants completed a final post-test subjective questionnaire ranking the platforms based on their preference. Of the twenty participants, 19 completed the study. Statistically significant differences among the telemedicine software platforms were found for task completion time, total workload, mental demand, effort, frustration, preference ranking and computer system usability scores. Usability problems with installation and account creation led to high mental demand and task completion time, suggesting the participants preferred a system without such requirements. Majority of the usability issues were identified at the telemedicine initiation phase. The findings from this study can be used by software developers to develop user-friendly telemedicine systems. Copyright © 2016 Elsevier Ltd. All rights reserved.

Usability Testing, User-Centered Design, and LibGuides Subject Guides: A Case Study

ERIC Educational Resources Information Center

Sonsteby, Alec; DeJonghe, Jennifer

2013-01-01

Usability testing has become a routine way for many libraries to ensure that their Web presence is user-friendly and accessible. At the same time, popular subject guide creation systems, such as LibGuides, decentralize Web content creation and put authorship into the hands of librarians who may not be trained in user-centered design principles. At…

Testing Aspects of the Usability of an Online Learner Dictionary Prototype: A Product- and Process-Oriented Study

ERIC Educational Resources Information Center

Hamel, Marie-Josee

2012-01-01

This article reports on a study which took place in the context of the design and development of an online dictionary prototype for learners of French. Aspects of the "usability", i.e. the quality of the "learner-task-dictionary interaction" of the prototype were tested. Micro-tasks were designed to focus on learners'…

Nurses' perceptions and problems in the usability of a medication safety app.

PubMed

Ankem, Kalyani; Cho, Sookyung; Simpson, Diana

2017-10-16

The majority of medication apps support medication adherence. Equally, if not more important, is medication safety. Few apps report on medication safety, and fewer studies have been conducted with these apps. The usability of a medication safety app was tested with nurses to reveal their perceptions of the graphical user interface and to discover problems they encountered in using the app. Usability testing of the app was conducted with RN-BSN students and informatics students (n = 18). Perceptions of the graphical components were gathered in pretest and posttest questionnaires, and video recordings of the usability testing were transcribed. The significance of the difference in mean performance time for 8 tasks was tested, and qualitative analysis was deployed to identify problems encountered and to rate the severity of each problem. While all participants perceived the graphical user interface as easy to understand, nurses took significantly more time to complete certain tasks. More nurses found the medication app to be lacking in intuitiveness of user interface design, in capability to match real-world data, and in providing optimal information architecture. To successfully integrate mobile devices in healthcare, developers must address the problems that nurses encountered in use of the app.

Moving Real Exergaming Engines on the Web: The webFitForAll Case Study in an Active and Healthy Ageing Living Lab Environment.

PubMed

Konstantinidis, Evdokimos I; Bamparopoulos, Giorgos; Bamidis, Panagiotis D

2017-05-01

Exergames have been the subject of research and technology innovations for a number of years. Different devices and technologies have been utilized to train the body and the mind of senior people or different patient groups. In the past, we presented FitForAll, the protocol efficacy of which was proven through widely taken (controlled) pilots with more than 116 seniors for a period of two months. The current piece of work expands this and presents the first truly web exergaming platform, which is solely based on HTML5 and JavaScript without any browser plugin requirements. The adopted architecture (controller application communication framework) combines a unified solution for input devices such as MS Kinect and Wii Balance Βoard which may seamlessly be exploited through standard physical exercise protocols (American College of Sports Medicine guidelines) and accommodate high detail logging; this allows for proper pilot testing and usability evaluations in ecologically valid Living Lab environments. The latter type of setups is also used herein for evaluating the web application with more than a dozen of real elderly users following quantitative approaches.

Heuristic Evaluation and Usability Testing of a Computerized Patient-Reported Outcomes Survey for Headache Sufferers

PubMed Central

Saris-Baglama, Renee N.; Smith, Kevin J.; DeRosa, Michael A.; Paulsen, Christine A.; Hogue, Sarah J.

2011-01-01

Abstract Objective The aim of this study was to evaluate usability of a prototype tablet PC-administered computerized adaptive test (CAT) of headache impact and patient feedback report, referred to as HEADACHE-CAT. Materials and Methods Heuristic evaluation specialists (n = 2) formed a consensus opinion on the application's strengths and areas for improvement based on general usability principles and human factors research. Usability testing involved structured interviews with headache sufferers (n = 9) to assess how they interacted with and navigated through the application, and to gather input on the survey and report interface, content, visual design, navigation, instructions, and user preferences. Results Specialists identified the need for improved instructions and text formatting, increased font size, page setup that avoids scrolling, and simplified presentation of feedback reports. Participants found the tool useful, and indicated a willingness to complete it again and recommend it to their healthcare provider. However, some had difficulty using the onscreen keyboard and autoadvance option; understanding the difference between generic and headache-specific questions; and interpreting score reports. Conclusions Heuristic evaluation and user testing can help identify usability problems in the early stages of application development, and improve the construct validity of electronic assessments such as the HEADACHE-CAT. An improved computerized HEADACHE-CAT measure can offer headache sufferers an efficient tool to increase patient self-awareness, monitor headaches over time, aid patient–provider communications, and improve quality of life. PMID:21214341

Checking an integrated model of web accessibility and usability evaluation for disabled people.

PubMed

Federici, Stefano; Micangeli, Andrea; Ruspantini, Irene; Borgianni, Stefano; Corradi, Fabrizio; Pasqualotto, Emanuele; Olivetti Belardinelli, Marta

2005-07-08

A combined objective-oriented and subjective-oriented method for evaluating accessibility and usability of web pages for students with disability was tested. The objective-oriented approach is devoted to verifying the conformity of interfaces to standard rules stated by national and international organizations responsible for web technology standardization, such as W3C. Conversely, the subjective-oriented approach allows assessing how the final users interact with the artificial system, accessing levels of user satisfaction based on personal factors and environmental barriers. Five kinds of measurements were applied as objective-oriented and subjective-oriented tests. Objective-oriented evaluations were performed on the Help Desk web page for students with disability, included in the website of a large Italian state university. Subjective-oriented tests were administered to 19 students labeled as disabled on the basis of their own declaration at the University enrolment: 13 students were tested by means of the SUMI test and six students by means of the 'Cooperative evaluation'. Objective-oriented and subjective-oriented methods highlighted different and sometimes conflicting results. Both methods have pointed out much more consistency regarding levels of accessibility than of usability. Since usability is largely affected by individual differences in user's own (dis)abilities, subjective-oriented measures underscored the fact that blind students encountered much more web surfing difficulties.

Developing iCare v.1.0: an academic electronic health record.

PubMed

Wyatt, Tami H; Li, Xueping; Indranoi, Chayawat; Bell, Matthew

2012-06-01

An electronic health record application, iCare v.1.0, was developed and tested that allows data input and retrieval while tracking student performance over time. The development and usability testing of iCare v.1.0 followed a rapid prototyping software development and testing model. Once the functionality was tested by engineers, the usability and feasibility testing began with a convenience sample of focus group members including undergraduate and graduate students and faculty. Three focus groups were created, and four subjects participated in each focus group (n = 12). Nielsen's usability heuristics and methods of evaluation were used to evaluate data captured from each focus group. Overall, users wanted a full-featured electronic health record with features that coached or guided users. The earliest versions of iCare v.1.0 did not provide help features and prompts to guide students but were later added. Future versions will incorporate a full-featured help section. The interface and design of iCare v.1.0 are similar to professional electronic health record applications. As a result of this usability study, future versions of iCare will include more robust help features along with advanced reporting and elements specific to specialty populations such as pediatrics and mental health services.

Towards Usable E-Health. A Systematic Review of Usability Questionnaires.

PubMed

Sousa, Vanessa E C; Dunn Lopez, Karen

2017-05-10

The use of e-health can lead to several positive outcomes. However, the potential for e-health to improve healthcare is partially dependent on its ease of use. In order to determine the usability for any technology, rigorously developed and appropriate measures must be chosen. To identify psychometrically tested questionnaires that measure usability of e-health tools, and to appraise their generalizability, attributes coverage, and quality. We conducted a systematic review of studies that measured usability of e-health tools using four databases (Scopus, PubMed, CINAHL, and HAPI). Non-primary research, studies that did not report measures, studies with children or people with cognitive limitations, and studies about assistive devices or medical equipment were systematically excluded. Two authors independently extracted information including: questionnaire name, number of questions, scoring method, item generation, and psychometrics using a data extraction tool with pre-established categories and a quality appraisal scoring table. Using a broad search strategy, 5,558 potentially relevant papers were identified. After removing duplicates and applying exclusion criteria, 35 articles remained that used 15 unique questionnaires. From the 15 questionnaires, only 5 were general enough to be used across studies. Usability attributes covered by the questionnaires were: learnability (15), efficiency (12), and satisfaction (11). Memorability (1) was the least covered attribute. Quality appraisal showed that face/content (14) and construct (7) validity were the most frequent types of validity assessed. All questionnaires reported reliability measurement. Some questionnaires scored low in the quality appraisal for the following reasons: limited validity testing (7), small sample size (3), no reporting of user centeredness (9) or feasibility estimates of time, effort, and expense (7). Existing questionnaires provide a foundation for research on e-health usability. However, future research is needed to broaden the coverage of the usability attributes and psychometric properties of the available questionnaires.

Usability and feasibility of health IT interventions to enhance Self-Care for Lymphedema Symptom Management in breast cancer survivors.

PubMed

Fu, Mei R; Axelrod, Deborah; Guth, Amber A; Wang, Yao; Scagliola, Joan; Hiotis, Karen; Rampertaap, Kavita; El-Shammaa, Nardin

2016-09-01

The-Optimal-Lymph-Flow health IT system (TOLF) is a patient-centered, web-and-mobile-based educational and behavioral health IT system focusing on safe, innovative, and pragmatic self-care strategies for lymphedema symptom management. The purpose of this study was to evaluate usability, feasibility, and acceptability of TOLF among the end-user of breast cancer survivors. Two types of usability testing were completed with 30 breast cancer survivors: heuristic evaluation and end-user testing. Each participant was asked to think aloud while completing a set of specified tasks designed to explicate and freely explore the system features. A heuristic evaluation checklist, the Perceived Ease of Use and Usefulness Questionnaire, and The Post Study System Usability Questionnaire were used to evaluate usability of the system. Open-ended questions were used to gather qualitative data. Quantitative data were analyzed using descriptive statistics and qualitative data were summarized thematically. Breast cancer survivors were very satisfied with the system: 90% (n = 27) rated the system having no usability problems; 10% (n = 3) noted minor cosmetic problems: spelling errors or text font size. The majority of participants 96.6% (n = 29) strongly agreed that the system was easy to use and effective in helping to learn about lymphedema, symptoms and self-care strategies. Themes from the qualitative data included empowerment, high quality information, loving avatar simulation videos, easy accessibility, and user-friendliness. This usability study provided evidence on breast cancer survivor's acceptance and highly positive evaluation of TOLF's usability as well as feasibility of using technologically-driven delivery model to enhance self-care strategies for lymphedema symptom management.

Trajectory Assessment and Modification Tools for Next Generation Air Traffic Management Operations

NASA Technical Reports Server (NTRS)

Brasil, Connie; Lee, Paul; Mainini, Matthew; Lee, Homola; Lee, Hwasoo; Prevot, Thomas; Smith, Nancy

2011-01-01

This paper reviews three Next Generation Air Transportation System (NextGen) based high fidelity air traffic control human-in-the-loop (HITL) simulations, with a focus on the expected requirement of enhanced automated trajectory assessment and modification tools to support future air traffic flow management (ATFM) planning positions. The simulations were conducted at the National Aeronautics and Space Administration (NASA) Ames Research Centers Airspace Operations Laboratory (AOL) in 2009 and 2010. The test airspace for all three simulations assumed the mid-term NextGenEn-Route high altitude environment utilizing high altitude sectors from the Kansas City and Memphis Air Route Traffic Control Centers. Trajectory assessment, modification and coordination decision support tools were developed at the AOL in order to perform future ATFM tasks. Overall tool usage results and user acceptability ratings were collected across three areas of NextGen operatoins to evaluate the tools. In addition to the usefulness and usability feedback, feasibility issues, benefits, and future requirements were also addressed. Overall, the tool sets were rated very useful and usable, and many elements of the tools received high scores and were used frequently and successfully. Tool utilization results in all three HITLs showed both user and system benefits including better airspace throughput, reduced controller workload, and highly effective communication protocols in both full Data Comm and mixed-equipage environments.

Usability testing of a mobile robotic system for in-home telerehabilitation.

PubMed

Boissy, Patrick; Brière, Simon; Corriveau, Hélène; Grant, Andrew; Lauria, Michel; Michaud, François

2011-01-01

Mobile robots designed to enhance telepresence in the support of telehealth services are being considered for numerous applications. TELEROBOT is a teleoperated mobile robotic platform equipped with videoconferencingcapabilities and designed to be used in a home environment to. In this study, learnability of the system's teleoperation interface and controls was evaluated with ten rehabilitation professionals during four training sessions in a laboratory environment and in an unknown home environment while performing the execution of a standardized evaluation protocol typically used in home care. Results show that the novice teleoperators' performances on two of the four metrics used (number of command and total time) improved significantly across training sessions (ANOVAS, p<0.05) and that performance in these metrics in the last training session reflected teleoperation abilities seen in the unknown home environment during navigation tasks (r=0,77 and 0,60). With only 4 hours of training, rehabilitation professionals were able learn to teleoperate successfully TELEROBOT. However teleoperation performances remained significantly less efficient then those of an expert. Under the home task condition (navigating the home environment from one point to the other as fast as possible) this translated to completion time between 350 seconds (best performance) and 850 seconds (worse performance). Improvements in other usability aspects of the system will be needed to meet the requirements of in-home telerehabilitation.

A usability evaluation of four commercial dental computer-based patient record systems

PubMed Central

Thyvalikakath, Thankam P.; Monaco, Valerie; Thambuganipalle, Hima Bindu; Schleyer, Titus

2008-01-01

Background The usability of dental computer-based patient record (CPR) systems has not been studied, despite early evidence that poor usability is a problem for dental CPR system users at multiple levels. Methods The authors conducted formal usability tests of four dental CPR systems by using a purposive sample of four groups of five novice users. The authors measured task outcomes (correctly completed, incorrectly completed and incomplete) in each CPR system while the participants performed nine clinical documentation tasks, as well as the number of usability problems identified in each CPR system and their potential relationship to task outcomes. The authors reviewed the software application design aspects responsible for these usability problems. Results The range for correctly completed tasks was 16 to 64 percent, for incorrectly completed tasks 18 to 38 percent and for incomplete tasks 9 to 47 percent. The authors identified 286 usability problems. The main types were three unsuccessful attempts, negative affect and task incorrectly completed. They also identified six problematic interface and interaction designs that led to usability problems. Conclusion The four dental CPR systems studied have significant usability problems for novice users, resulting in a steep learning curve and potentially reduced system adoption. Clinical Implications The significant number of data entry errors raises concerns about the quality of documentation in clinical practice. PMID:19047669

Development and preliminary testing of a web-based, self-help application for disaster-affected families.

PubMed

Yuen, Erica K; Gros, Kirstin; Welsh, Kyleen E; McCauley, Jenna; Resnick, Heidi S; Danielson, Carla K; Price, Matthew; Ruggiero, Kenneth J

2016-09-01

Technology-based self-help interventions have the potential to increase access to evidence-based mental healthcare, especially for families affected by natural disasters. However, development of these interventions is a complex process and poses unique challenges. Usability testing, which assesses the ability of individuals to use an application successfully, can have a significant impact on the quality of a self-help intervention. This article describes (a) the development of a novel web-based multi-module self-help intervention for disaster-affected adolescents and their parents and (b) a mixed-methods formal usability study to evaluate user response. A total of 24 adolescents were observed, videotaped, and interviewed as they used the depressed mood component of the self-help intervention. Quantitative results indicated an above-average user experience, and qualitative analysis identified 120 unique usability issues. We discuss the challenges of developing self-help applications, including design considerations and the value of usability testing in technology-based interventions, as well as our plan for widespread dissemination. © The Author(s) 2015.

Designing mobile dietary management support technologies for people with diabetes.

PubMed

Arsand, Eirik; Tufano, James T; Ralston, James D; Hjortdahl, Per

2008-01-01

We performed two cycles of laboratory-based usability testing of three food registration prototypes for people with diabetes. The design concepts were a commercial web application, various smartphones and a mobile phone photo blogging approach. Six adults with Type 1 diabetes and three adults with Type 2 diabetes participated in the usability tests. The results provided five distinct implications for devices for the future dietary management support of people with diabetes. Study participants valued many of the features offered by the three systems that were tested, although the usability tests also revealed several opportunities to enhance their design. Our findings suggest that further development is justified of mobile dietary and nutritional support for individuals living with diabetes. Applications that support healthy eating habits should be integrated with applications for managing blood glucose data and physical activity data, and potentially medication data as well.

Logistical Consideration in Computer-Based Screening of Astronaut Applicants

NASA Technical Reports Server (NTRS)

Galarza, Laura

2000-01-01

This presentation reviews the logistical, ergonomic, and psychometric issues and data related to the development and operational use of a computer-based system for the psychological screening of astronaut applicants. The Behavioral Health and Performance Group (BHPG) at the Johnson Space Center upgraded its astronaut psychological screening and selection procedures for the 1999 astronaut applicants and subsequent astronaut selection cycles. The questionnaires, tests, and inventories were upgraded from a paper-and-pencil system to a computer-based system. Members of the BHPG and a computer programmer designed and developed needed interfaces (screens, buttons, etc.) and programs for the astronaut psychological assessment system. This intranet-based system included the user-friendly computer-based administration of tests, test scoring, generation of reports, the integration of test administration and test output to a single system, and a complete database for past, present, and future selection data. Upon completion of the system development phase, four beta and usability tests were conducted with the newly developed system. The first three tests included 1 to 3 participants each. The final system test was conducted with 23 participants tested simultaneously. Usability and ergonomic data were collected from the system (beta) test participants and from 1999 astronaut applicants who volunteered the information in exchange for anonymity. Beta and usability test data were analyzed to examine operational, ergonomic, programming, test administration and scoring issues related to computer-based testing. Results showed a preference for computer-based testing over paper-and -pencil procedures. The data also reflected specific ergonomic, usability, psychometric, and logistical concerns that should be taken into account in future selection cycles. Conclusion. Psychological, psychometric, human and logistical factors must be examined and considered carefully when developing and using a computer-based system for psychological screening and selection.

Usability 101: A Pilot Test of DOE PAGES Beta | OSTI, US Dept of Energy

Science.gov Websites

Office of Scientific and Technical Information skip to main content Sign In Create Account OSTI.GOV title logo U.S. Department of Energy Office of Scientific and Technical Information Search terms News Sign In Create Account This page is being shared by OSTI.GOV. Usability 101: A Pilot Test of DOE

Usability testing of a Falls Prevention Tool Kit for an inpatient acute care setting.

PubMed

Goldsmith, Denise; Zuyev, Lyubov; Benoit, Angie; Chang, Frank Y; Horsky, Jan; Dykes, Patricia

2009-01-01

Efforts to prevent falls in the hospital setting involves identifying patients at risk of falling and implementing fall prevention strategies. This poster describes the method and results of Performance Usability Testing on a web-based Fall Prevention Tool Kit (FPTK) developed as part of a research study, (Falls TIPS-Tailoring Interventions for Patient Safety) funded by The Robert Wood Johnson Foundation.

Finding online health-related information: usability issues of health portals.

PubMed

Gurel Koybasi, Nergis A; Cagiltay, Kursat

2012-01-01

As Internet and computers become widespread, health portals offering online health-related information become more popular. The most important point for health portals is presenting reliable and valid information. Besides, portal needs to be usable to be able to serve information to users effectively. This study aims to determine usability issues emerging when health-related information is searched on a health portal. User-based usability tests are conducted and eye movement analyses are used in addition to traditional performance measures. Results revealed that users prefer systematic, simple and consistent designs offering interactive tools. Moreover, content and partitions needs to be shaped according to the medical knowledge of target users.

A web-based program for informal caregivers of persons with Alzheimer's disease: an iterative user-centered design.

PubMed

Cristancho-Lacroix, Victoria; Moulin, Florence; Wrobel, Jérémy; Batrancourt, Bénédicte; Plichart, Matthieu; De Rotrou, Jocelyne; Cantegreil-Kallen, Inge; Rigaud, Anne-Sophie

2014-09-15

Web-based programs have been developed for informal caregivers of people with Alzheimer's disease (PWAD). However, these programs can prove difficult to adopt, especially for older people, who are less familiar with the Internet than other populations. Despite the fundamental role of usability testing in promoting caregivers' correct use and adoption of these programs, to our knowledge, this is the first study describing this process before evaluating a program for caregivers of PWAD in a randomized clinical trial. The objective of the study was to describe the development process of a fully automated Web-based program for caregivers of PWAD, aiming to reduce caregivers' stress, and based on the user-centered design approach. There were 49 participants (12 health care professionals, 6 caregivers, and 31 healthy older adults) that were involved in a double iterative design allowing for the adaptation of program content and for the enhancement of website usability. This process included three component parts: (1) project team workshops, (2) a proof of concept, and (3) two usability tests. The usability tests were based on a mixed methodology using behavioral analysis, semistructured interviews, and a usability questionnaire. The user-centered design approach provided valuable guidelines to adapt the content and design of the program, and to improve website usability. The professionals, caregivers (mainly spouses), and older adults considered that our project met the needs of isolated caregivers. Participants underlined that contact between caregivers would be desirable. During usability observations, the mistakes of users were also due to ergonomics issues from Internet browsers and computer interfaces. Moreover, negative self-stereotyping was evidenced, when comparing interviews and results of behavioral analysis. Face-to-face psycho-educational programs may be used as a basis for Web-based programs. Nevertheless, a user-centered design approach involving targeted users (or their representatives) remains crucial for their correct use and adoption. For future user-centered design studies, we recommend to involve end-users from preconception stages, using a mixed research method in usability evaluations, and implementing pilot studies to evaluate acceptability and feasibility of programs.

How Usability Testing Resulted in Improvements to Ground Collision Software for General Aviation: Improved Ground Collision Avoidance System (IGCAS)

NASA Technical Reports Server (NTRS)

Lamarr, Michael; Chinske, Chris; Williams, Ethan; Law, Cameron; Skoog, Mark; Sorokowski, Paul

2016-01-01

The NASA improved Ground Collision Avoidance System (iGCAS) team conducted an onsite usability study at Experimental Aircraft Association (EAA) Air Venture in Oshkosh, Wisconsin from July 19 through July 26, 2015. EAA Air Venture had approximately 550,000 attendees from which the sample pool of pilots were selected. The objectives of this study were to assess the overall appropriateness and acceptability of iGCAS as a warning system for General Aviation aircraft, usability of the iGCAS displays and audio cues, test terrain avoidance characteristics, performance, functionality, pilot response time, and correlate terrain avoidance performance and pilot response time data.

Physician satisfaction with a critical care clinical information system using a multimethod evaluation of usability.

PubMed

Hudson, Darren; Kushniruk, Andre; Borycki, Elizabeth; Zuege, Danny J

2018-04-01

Physician satisfaction with electronic medical records has often been poor. Usability has frequently been identified as a source for decreased satisfaction. While surveys can identify many issues, and are logistically easier to administer, they may miss issues identified using other methods This study sought to understand the level of physician satisfaction and usability issues associated with a critical care clinical information system (eCritical Alberta) implemented throughout the province of Alberta, Canada. All critical care attending physicians using the system were invited to participate in an online survey. Questions included components of the User Acceptance of Information Technology and Usability Questionnaire as well as free text feedback on system components. Physicians were also invited to participate in a think aloud test using simulated scenarios. The transcribed think aloud text and questionnaire were subjected to textual analysis. 82% of all eligible physicians completed the on-line survey (n = 61). Eight physicians were invited and seven completed the think aloud test. Overall satisfaction with the system was moderate. Usability was identified as a significant factor contributing to satisfaction. The major usability factors identified were system response time and layout. The think aloud component identified additional factors beyond those identified in the on-line survey. This study found a modestly high level of physician satisfaction with a province-wide clinical critical care information system. Usability continues to be a significant factor in physician satisfaction. Using multiple methods of evaluation can capture the benefits of a large sample size and deeper understanding of the issues. Copyright © 2018 Elsevier B.V. All rights reserved.

Using scenarios and personas to enhance the effectiveness of heuristic usability evaluations for older adults and their care team.

PubMed

Kneale, Laura; Mikles, Sean; Choi, Yong K; Thompson, Hilaire; Demiris, George

2017-09-01

Using heuristics to evaluate user experience is a common methodology for human-computer interaction studies. One challenge of this method is the inability to tailor results towards specific end-user needs. This manuscript reports on a method that uses validated scenarios and personas of older adults and care team members to enhance heuristics evaluations of the usability of commercially available personal health records for homebound older adults. Our work extends the Chisnell and Redish heuristic evaluation methodology by using a protocol that relies on multiple expert reviews of each system. It further standardizes the heuristic evaluation process through the incorporation of task-based scenarios. We were able to use the modified version of the Chisnell and Redish heuristic evaluation methodology to identify potential usability challenges of two commercially available personal health record systems. This allowed us to: (1) identify potential usability challenges for specific types of users, (2) describe improvements that would be valuable to all end-users of the system, and (3) better understand how the interactions of different users may vary within a single personal health record. The methodology described in this paper may help designers of consumer health information technology tools, such as personal health records, understand the needs of diverse end-user populations. Such methods may be particularly helpful when designing systems for populations that are difficult to recruit for end-user evaluations through traditional methods. Copyright © 2017 Elsevier Inc. All rights reserved.

Evaluation of Home Health Care Devices: Remote Usability Assessment.

PubMed

Kortum, Philip; Peres, S Camille

2015-06-05

An increasing amount of health care is now performed in a home setting, away from the hospital. While there is growing anecdotal evidence about the difficulty patients and caregivers have using increasingly complex health care devices in the home, there has been little systematic scientific study to quantify the global nature of home health care device usability in the field. Research has tended to focus on a handful of devices, making it difficult to gain a broad view of the usability of home-care devices in general. The objective of this paper is to describe a remote usability assessment method using the System Usability Scale (SUS), and to report on the usability of a broad range of health care devices using this metric. A total of 271 participants selected and rated up to 10 home health care devices of their choice using the SUS, which scores usability from 0 (unusable) to 100 (highly usable). Participants rated a total of 455 devices in their own home without an experimenter present. Usability scores ranged from 98 (oxygen masks) to 59 (home hormone test kits). An analysis conducted on devices that had at least 10 ratings showed that the effect of device on SUS scores was significant (P<.001), and that the usability of these devices was on the low end when compared with other commonly used items in the home, such as microwave ovens and telephones. A large database of usability scores for home health care devices collected using this remote methodology would be beneficial for physicians, patients, and their caregivers.

Improved usability of a multi-infusion setup using a centralized control interface: A task-based usability test

PubMed Central

Cnossen, Fokie; Dieperink, Willem; Bult, Wouter; de Smet, Anne Marie; Touw, Daan J.; Nijsten, Maarten W.

2017-01-01

The objective of this study was to assess the usability benefits of adding a bedside central control interface that controls all intravenous (IV) infusion pumps compared to the conventional individual control of multiple infusion pumps. Eighteen dedicated ICU nurses volunteered in a between-subjects task-based usability test. A newly developed central control interface was compared to conventional control of multiple infusion pumps in a simulated ICU setting. Task execution time, clicks, errors and questionnaire responses were evaluated. Overall the central control interface outperformed the conventional control in terms of fewer user actions (40±3 vs. 73±20 clicks, p<0.001) and fewer user errors (1±1 vs. 3±2 errors, p<0.05), with no difference in task execution times (421±108 vs. 406±119 seconds, not significant). Questionnaires indicated a significant preference for the central control interface. Despite being novice users of the central control interface, ICU nurses displayed improved performance with the central control interface compared to the conventional interface they were familiar with. We conclude that the new user interface has an overall better usability than the conventional interface. PMID:28800617

Improved usability of a multi-infusion setup using a centralized control interface: A task-based usability test.

PubMed

Doesburg, Frank; Cnossen, Fokie; Dieperink, Willem; Bult, Wouter; de Smet, Anne Marie; Touw, Daan J; Nijsten, Maarten W

2017-01-01

The objective of this study was to assess the usability benefits of adding a bedside central control interface that controls all intravenous (IV) infusion pumps compared to the conventional individual control of multiple infusion pumps. Eighteen dedicated ICU nurses volunteered in a between-subjects task-based usability test. A newly developed central control interface was compared to conventional control of multiple infusion pumps in a simulated ICU setting. Task execution time, clicks, errors and questionnaire responses were evaluated. Overall the central control interface outperformed the conventional control in terms of fewer user actions (40±3 vs. 73±20 clicks, p<0.001) and fewer user errors (1±1 vs. 3±2 errors, p<0.05), with no difference in task execution times (421±108 vs. 406±119 seconds, not significant). Questionnaires indicated a significant preference for the central control interface. Despite being novice users of the central control interface, ICU nurses displayed improved performance with the central control interface compared to the conventional interface they were familiar with. We conclude that the new user interface has an overall better usability than the conventional interface.

Secure Publish-Subscribe Protocols for Heterogeneous Medical Wireless Body Area Networks

PubMed Central

Picazo-Sanchez, Pablo; Tapiador, Juan E.; Peris-Lopez, Pedro; Suarez-Tangil, Guillermo

2014-01-01

Security and privacy issues in medical wireless body area networks (WBANs) constitute a major unsolved concern because of the challenges posed by the scarcity of resources in WBAN devices and the usability restrictions imposed by the healthcare domain. In this paper, we describe a WBAN architecture based on the well-known publish-subscribe paradigm. We present two protocols for publishing data and sending commands to a sensor that guarantee confidentiality and fine-grained access control. Both protocols are based on a recently proposed ciphertext policy attribute-based encryption (CP-ABE) scheme that is lightweight enough to be embedded into wearable sensors. We show how sensors can implement lattice-based access control (LBAC) policies using this scheme, which are highly appropriate for the eHealth domain. We report experimental results with a prototype implementation demonstrating the suitability of our proposed solution. PMID:25460814

Design and validation of a questionnaire to evaluate the usability of computerized critical care information systems.

PubMed

von Dincklage, Falk; Lichtner, Gregor; Suchodolski, Klaudiusz; Ragaller, Maximilian; Friesdorf, Wolfgang; Podtschaske, Beatrice

2017-08-01

The implementation of computerized critical care information systems (CCIS) can improve the quality of clinical care and staff satisfaction, but also holds risks of disrupting the workflow with consecutive negative impacts. The usability of CCIS is one of the key factors determining their benefits and weaknesses. However, no tailored instrument exists to measure the usability of such systems. Therefore, the aim of this study was to design and validate a questionnaire that measures the usability of CCIS. Following a mixed-method design approach, we developed a questionnaire comprising two evaluation models to assess the usability of CCIS: (1) the task-specific model rates the usability individually for several tasks which CCIS could support and which we derived by analyzing work processes in the ICU; (2) the characteristic-specific model rates the different aspects of the usability, as defined by the international standard "ergonomics of human-system interaction". We tested validity and reliability of the digital version of the questionnaire in a sample population. In the sample population of 535 participants both usability evaluation models showed a strong correlation with the overall rating of the system (multiple correlation coefficients ≥0.80) as well as a very high internal consistency (Cronbach's alpha ≥0.93). The novel questionnaire is a valid and reliable instrument to measure the usability of CCIS and can be used to study the influence of the usability on their implementation benefits and weaknesses.

Developing Analytical Inspection Criteria for Health IT Personnel with Minimum Training in Cognitive Ergonomics: A Practical Solution to EHR Improving EHR Usability

PubMed Central

Zhang, Zhen; Franklin, Amy; Walji, Muhammad; Zhang, Jiajie; Gong, Yang

2014-01-01

EHR usability has been identified as a major barrier to care quality optimization. One major challenge of improving EHR usability is the lack of systematic training in usability or cognitive ergonomics for EHR designers/developers in the vendor community and EHR analysts making significant configurations in healthcare organizations. A practical solution is to provide usability inspection tools that can be easily operationalized by EHR analysts. This project is aimed at developing a set of usability tools with demonstrated validity and reliability. We present a preliminary study of a metric for cognitive transparency and an exploratory experiment testing its validity in predicting the effectiveness of action-effect mapping. Despite the pilot nature of both, we found high sensitivity and specificity of the metric and higher response accuracy within a shorter time for users to determine action-effect mappings in transparent user interface controls. We plan to expand the sample size in our empirical study. PMID:25954439

A Method for Automated Detection of Usability Problems from Client User Interface Events

PubMed Central

Saadawi, Gilan M.; Legowski, Elizabeth; Medvedeva, Olga; Chavan, Girish; Crowley, Rebecca S.

2005-01-01

Think-aloud usability analysis provides extremely useful data but is very time-consuming and expensive to perform because of the extensive manual video analysis that is required. We describe a simple method for automated detection of usability problems from client user interface events for a developing medical intelligent tutoring system. The method incorporates (1) an agent-based method for communication that funnels all interface events and system responses to a centralized database, (2) a simple schema for representing interface events and higher order subgoals, and (3) an algorithm that reproduces the criteria used for manual coding of usability problems. A correction factor was empirically determining to account for the slower task performance of users when thinking aloud. We tested the validity of the method by simultaneously identifying usability problems using TAU and manually computing them from stored interface event data using the proposed algorithm. All usability problems that did not rely on verbal utterances were detectable with the proposed method. PMID:16779121

A Pilot Study of the Interface Design of Cross-Cultural Web Sites through Usability Testing of Multilanguage Web Sites and Determining the Preferences of Taiwanese and American Users

ERIC Educational Resources Information Center

Ku, David Tawei; Chang, Chia-Chi

2014-01-01

By conducting usability testing on a multilanguage Web site, this study analyzed the cultural differences between Taiwanese and American users in the performance of assigned tasks. To provide feasible insight into cross-cultural Web site design, Microsoft Office Online (MOO) that supports both traditional Chinese and English and contains an almost…

Learning a Language with Web 2.0: Exploring the Use of Social Networking Features of Foreign Language Learning Websites

ERIC Educational Resources Information Center

Stevenson, Megan P.; Liu, Min

2010-01-01

This paper presents the results of an online survey and a usability test performed on three foreign language learning websites that use Web 2.0 technology. The online survey was conducted to gain an understanding of how current users of language learning websites use them for learning and social purposes. The usability test was conducted to gain…

Pervasive assistive technology for people with dementia: a UCD case

PubMed Central

Rønn-Andersen, Kristoffer V.H.; Bień, Paulina; Özkil, Ali Gürcan; Forchhammer, Birgitte Hysse; Maier, Anja M.

2016-01-01

Smart mobile and wearable technology offers exciting opportunities to support people with dementia (PwD). Its ubiquity and popularity could even benefit user adoption – a great challenge for assistive technology (AT) for PwD that calls for user-centred design (UCD) methods. This study describes a user-centred approach to developing and testing AT based on off-the-shelf pervasive technologies. A prototype is created by combining a smartphone, smartwatch and various applications to offer six support features. This is tested among five end-users (PwD) and their caregivers. Controlled usability testing was followed by field testing in a real-world context. Data is gathered from video recordings, interaction logs, system usability scale questionnaires, logbooks, application usage logs and interviews structured on the unified theory of acceptance and use of technology model. The data is analysed to evaluate usability, usefulness and user acceptance. Results show some promise for user adoption, but highlight challenges to be overcome, emphasising personalisation and familiarity as key considerations. The complete findings regarding usability issues, usefulness of support features and four identified adoption profiles are used to provide a set of recommendations for practitioners and further research. These contribute toward UCD practices for improved smart, pervasive AT for dementia. PMID:28008366

Evaluation of Methods to Improve the Extraction and Recovery of DNA from Cotton Swabs for Forensic Analysis

PubMed Central

Adamowicz, Michael S.; Stasulli, Dominique M.; Sobestanovich, Emily M.; Bille, Todd W.

2014-01-01

Samples for forensic DNA analysis are often collected from a wide variety of objects using cotton or nylon tipped swabs. Testing has shown that significant quantities of DNA are retained on the swab, however, and subsequently lost. When processing evidentiary samples, the recovery of the maximum amount of available DNA is critical, potentially dictating whether a usable profile can be derived from a piece of evidence or not. The QIAamp DNA Investigator extraction kit was used with its recommended protocol for swabs (one hour incubation at 56°C) as a baseline. Results indicate that over 50% of the recoverable DNA may be retained on the cotton swab tip, or otherwise lost, for both blood and buccal cell samples when using this protocol. The protocol’s incubation time and temperature were altered, as was incubating while shaking or stationary to test for increases in recovery efficiency. An additional step was then tested that included periodic re-suspension of the swab tip in the extraction buffer during incubation. Aliquots of liquid blood or a buccal cell suspension were deposited and dried on cotton swabs and compared with swab-less controls. The concentration of DNA in each extract was quantified and STR analysis was performed to assess the quality of the extracted DNA. Stationary incubations and those performed at 65°C did not result in significant gains in DNA yield. Samples incubated for 24 hours yielded less DNA. Increased yields were observed with three and 18 hour incubation periods. Increases in DNA yields were also observed using a swab re-suspension method for both cell types. The swab re-suspension method yielded an average two-fold increase in recovered DNA yield with buccal cells and an average three-fold increase with blood cells. These findings demonstrate that more of the DNA collected on swabs can be recovered with specific protocol alterations. PMID:25549111

Virtually Usable: A Test of the Information Gardens

ERIC Educational Resources Information Center

Johnson, Megan; Ochoa, Louise; Purpur, Geraldine

2007-01-01

This paper presents the results of a usability study conducted to determine the functionality of a desktop, three-dimensional virtual library designed and supported by the Appalachian State University Distance Learning Library Services team. Formative evaluations were performed with representative students utilizing Morae software. Results…

Multimedia telehomecare system using standard TV set.

PubMed

Guillén, S; Arredondo, M T; Traver, V; García, J M; Fernández, C

2002-12-01

Nowadays, there are a very large number of patients that need specific health support at home. The deployment of broadband communication networks is making feasible the provision of home care services with a proper quality of service. This paper presents a telehomecare multimedia platform that runs over integrated services digital network and internet protocol using videoconferencing standards H.320 and H.323, and standard TV set for patient interaction. This platform allows online remote monitoring: ECG, heart sound, blood pressure. Usability, affordability, and interoperability were considered for the design and development of its hardware and software components. A first evaluation of technical and usability aspects were carried forward with 52 patients of a private clinic and 10 students in the University. Results show a high rate (mean = 4.33, standard deviation--SD = 1.63 in a five-points Likert scale) in the global perception of users on the quality of images, voice, and feeling of virtual presence.

A virtual reality test battery for assessment and screening of spatial neglect.

PubMed

Fordell, H; Bodin, K; Bucht, G; Malm, J

2011-03-01

There is a need for improved screening methods for spatial neglect. To construct a VR-test battery and evaluate its accuracy and usability in patients with acute stroke. VR-DiSTRO consists of a standard desktop computer, a CRT monitor and eye shutter stereoscopic glasses, a force feedback interface, and software, developed to create an interactive and immersive 3D experience. VR-tests were developed and validated to the conventional Star Cancellation test, Line bisection, Baking Tray Task (BTT), and Visual Extinction test. A construct validation to The Rivermead Behavioral Inattention Test, used as criterion of visuospatial neglect, was made. Usability was assessed according to ISO 9241-11. Thirty-one patients with stroke were included, 9/31 patients had neglect. The sensitivity was 100% and the specificity 82% for the VR-DiSTRO to correctly identify neglect. VR-BTT and VR-Extinction had the highest correlation (r² = 0.64 and 0.78), as well as high sensitivity and specificity. The kappa values describing the agreement between traditional neglect tests and the corresponding virtual reality test were between 0.47-0.85. Usability was assessed by a questionnaire; 77% reported that the VR-DiSTRO was 'easy' to use. Eighty-eight percent reported that they felt 'focused', 'pleased' or 'alert'. No patient had adverse symptoms. The test session took 15 min. The VR-DiSTRO quickly and with a high accuracy identified visuospatial neglect in patients with stroke in this construct validation. The usability among elderly patients with stroke was high. This VR-test battery has the potential to become an important screening instrument for neglect and a valuable adjunct to the neuropsychological assessment. © 2010 John Wiley & Sons A/S.

A Human Reliability Based Usability Evaluation Method for Safety-Critical Software

DOE Office of Scientific and Technical Information (OSTI.GOV)

Phillippe Palanque; Regina Bernhaupt; Ronald Boring

2006-04-01

Recent years have seen an increasing use of sophisticated interaction techniques including in the field of safety critical interactive software [8]. The use of such techniques has been required in order to increase the bandwidth between the users and systems and thus to help them deal efficiently with increasingly complex systems. These techniques come from research and innovation done in the field of humancomputer interaction (HCI). A significant effort is currently being undertaken by the HCI community in order to apply and extend current usability evaluation techniques to these new kinds of interaction techniques. However, very little has been donemore » to improve the reliability of software offering these kinds of interaction techniques. Even testing basic graphical user interfaces remains a challenge that has rarely been addressed in the field of software engineering [9]. However, the non reliability of interactive software can jeopardize usability evaluation by showing unexpected or undesired behaviors. The aim of this SIG is to provide a forum for both researchers and practitioners interested in testing interactive software. Our goal is to define a roadmap of activities to cross fertilize usability and reliability testing of these kinds of systems to minimize duplicate efforts in both communities.« less

Polymer membranes as separators for supercapacitors

NASA Astrophysics Data System (ADS)

Szubzda, Bronisław; Szmaja, Aleksandra; Ozimek, Mariusz; Mazurkiewicz, Sławomir

2014-12-01

The purpose of the studies described was to examine the influence of low-energy plasma modification of polyamide and polypropylene polymer nonwoven fabrics on the usable properties of supercapacitors when using these fabrics as the separator material. To achieve this goal the following investigations were carried out: testing the time required for electrolyte saturation of separators and the conductivity of the electrolyte contained in the separator, as well as electrochemical examinations of supercapacitor models in which the modified fabric separators were used. The tests conducted fully confirm the usability of this modification for cleaning the surface and improving the wettability of separators by the electrolyte, which in turn results in a significant decrease of the internal resistance of the supercapacitor, thus increasing the usable power of the device.

A study in usability: redesigning a health sciences library's mobile site.

PubMed

Rosario, Jovy-Anne; Ascher, Marie T; Cunningham, Diana J

2012-01-01

A mobile site redesign was conducted at a medium-sized academic health sciences library with the goal of creating a site that meets the mobile information needs of its users. The redesign phases included (1) needs assessment, (2) usability testing, and (3) site design. The survey results showed that Apple devices were the most prevalent; the most desirable activities performed on a mobile site were searching for articles, accessing full-text articles and e-books, searching databases, and searching the catalog. These activities guided the development of the usability testing tasks and the redesign. All phases were completed within six months, and the total project cost was $50 for incentive purchases. Copyright © Taylor & Francis Group, LLC

A usability evaluation of a SNOMED CT based compositional interface terminology for intensive care.

PubMed

Bakhshi-Raiez, F; de Keizer, N F; Cornet, R; Dorrepaal, M; Dongelmans, D; Jaspers, M W M

2012-05-01

To evaluate the usability of a large compositional interface terminology based on SNOMED CT and the terminology application for registration of the reasons for intensive care admission in a Patient Data Management System. Observational study with user-based usability evaluations before and 3 months after the system was implemented and routinely used. Usability was defined by five aspects: effectiveness, efficiency, learnability, overall user satisfaction, and experienced usability problems. Qualitative (the Think-Aloud user testing method) and quantitative (the System Usability Scale questionnaire and Time-on-Task analyses) methods were used to examine these usability aspects. The results of the evaluation study revealed that the usability of the interface terminology fell short (SUS scores before and after implementation of 47.2 out of 100 and 37.5 respectively out of 100). The qualitative measurements revealed a high number (n=35) of distinct usability problems, leading to ineffective and inefficient registration of reasons for admission. The effectiveness and efficiency of the system did not change over time. About 14% (n=5) of the revealed usability problems were related to the terminology content based on SNOMED CT, while the remaining 86% (n=30) was related to the terminology application. The problems related to the terminology content were more severe than the problems related to the terminology application. This study provides a detailed insight into how clinicians interact with a controlled compositional terminology through a terminology application. The extensiveness, complexity of the hierarchy, and the language usage of an interface terminology are defining for its usability. Carefully crafted domain-specific subsets and a well-designed terminology application are needed to facilitate the use of a complex compositional interface terminology based on SNOMED CT. Copyright © 2011 Elsevier Ireland Ltd. All rights reserved.

Enabling Data Discovery and Reuse by Improving Software Usability:Data Science Experiences, Lessons, and Gaps

NASA Astrophysics Data System (ADS)

Rosati, A.; Yarmey, L.

2014-12-01

It is well understood that a good data scientist needs domain science, analysis, programming, and communication skills to create finished data products, visualizations, and reports. Articles and blogs tout the need for "expert" skill levels in domain knowledge, statistics, storytelling, graphic design, technology…and the list goes on. Since it seems impossible that one person would encompass all these skills, it is often suggested that data science be done by a team instead of an individual. This research into, and experience with, data product design offers an augmented definition - one that elevates relationships and engagement with the final user of a product. Essentially, no matter how fantastic or technically advanced a product appears, the intended audience of that product must be able to understand, use, and find value in the product in order for it to be considered a success. Usability is often misunderstood and seen as common sense or common knowledge, but it is actually an important and challenging piece of product development. This paper describes the National Snow and Ice Data Center's process to usability test the Arctic Data Explorer (ADE). The ADE is a federated data search tool for interdisciplinary Arctic science data that has been improved in features, appearance, functionality, and quality through a series of strategic and targeted usability testing and assessments. Based on the results, it is recommended that usability testing be incorporated into the skill set of each data science team.

Development and testing of painometer: a smartphone app to assess pain intensity.

PubMed

de la Vega, Rocío; Roset, Roman; Castarlenas, Elena; Sánchez-Rodríguez, Elisabet; Solé, Ester; Miró, Jordi

2014-10-01

Electronic and information technologies are increasingly being used to assess pain. This study aims to 1) introduce Painometer, a smartphone app that helps users to assess pain intensity, and 2) report on its usability (ie, user performance and satisfaction) and acceptability (ie, the willingness to use it) when it is made available to health care professionals and nonprofessionals. Painometer includes 4 well-known pain intensity scales: the Faces Pain Scale-Revised, the numerical rating scale-11, the Coloured Analogue Scale, and the visual analog scale. Scores reported with these scales, when used in their traditional format, have shown to be valid and reliable. The app was tested in a sample of 24 health care professionals and 30 nonprofessionals. Two iterative usability cycles were conducted with a qualitative usability testing approach and a semistructured interview. The participants had an average of 10 years' experience in using computers. The domains measured were ease of use, errors in usage, most popular characteristics, suggested changes, and acceptability. Adding instructions and changing format and layout details solved the usability problems reported in cycle 1. No further problems were reported in cycle 2. Painometer has been found to be a useful, user-friendly app that may help to improve the accuracy of pain intensity assessment. Painometer, a smartphone app to assess pain intensity, shows good usability and acceptability properties when used by health care professionals and nonprofessionals. Copyright © 2014 American Pain Society. Published by Elsevier Inc. All rights reserved.

Evaluation of Smartphone Applications for Cardiopulmonary Resuscitation Training in South Korea

PubMed Central

Cho, Yongtak; Song, Yeongtak; Lim, Tae Ho; Kang, Hyunggoo

2016-01-01

Objective. There are many smartphone-based applications (apps) for cardiopulmonary resuscitation (CPR) training. We investigated the conformity and the learnability/usability of these apps for CPR training and real-life supports. Methods. We conducted a mixed-method, sequential explanatory study to assess CPR training apps downloaded on two apps stores in South Korea. Apps were collected with inclusion criteria as follows, Korean-language instruction, training features, and emergency supports for real-life incidents, and analyzed with two tests; 15 medical experts evaluated the apps' contents according to current Basic Life Support guidelines in conformity test, and 15 nonmedical individuals examined the apps using System Usability Scale (SUS) in the learnability/usability test. Results. Out of 79 selected apps, five apps were included and analyzed. For conformity (ICC, 0.95, p < 0.001), means of all apps were greater than 12 of 20 points, indicating that they were well designed according to current guidelines. Three of the five apps yielded acceptable level (greater than 68 of 100 points) for learnability/usability. Conclusion. All the included apps followed current BLS guidelines and a majority offered acceptable learnability/usability for layperson. Current and developmental smartphone-based CPR training apps should include accurate CPR information and be easy to use for laypersons that are potential rescuers in real-life incidents. For Clinical Trials. This is a clinical trial, registered at the Clinical Research Information Service (CRIS, cris.nih.go.kr), number KCT0001840. PMID:27668257

Enhancing the usability of CRT displays in test flight monitoring

NASA Astrophysics Data System (ADS)

Granaas, Michael M.; Sredinski, Victoria E.

1991-01-01

Enhancing the usability of Mission Control Center (MCC) CRT displays stands to improve the quality, productivity, and safety of flight-test research at the NASA Ames-Dryden Flight Research Facility. The results of this research suggests that much can be done to assist the user and improve the quality of flight research through the enhancement of current displays. This research has applications to a variety of flight data monitoring displays.

Usability test of KNRC self-feeding robot.

PubMed

Song, Won-Kyung; Song, Won-Jin; Kim, Yale; Kim, Jongbae

2013-06-01

Various assistive robots for supporting the activities of daily living have been developed. However, not many of these have been introduced into the market because they were found to be impractical in actual scenarios. In this paper, we report on the usability test results of an assistive robot designed for self-feeding for people having disabilities, which includes those having spinal cord injury, cerebral palsy, and traumatic brain injury. First, we present three versions of a novel self-feeding robot (KNRC self-feeding robot), which is suitable for use with Korean food, including sticky rice. These robots have been improved based on participatory action design over a period of three years. Next, we discuss the usability tests of the KNRC self-feeding robots. People with disabilities participated in comparative tests between the KNRC self-feeding robot and the commercialized product named My Spoon. The KNRC self-feeding robot showed positive results in relation to satisfaction and performance compared to the commercialized robot when users ate Korean food, including sticky rice.

Usability Testing as a Method to Refine a Health Sciences Library Website.

PubMed

Denton, Andrea H; Moody, David A; Bennett, Jason C

2016-01-01

User testing, a method of assessing website usability, can be a cost-effective and easily administered process to collect information about a website's effectiveness. A user experience (UX) team at an academic health sciences library has employed user testing for over three years to help refine the library's home page. Test methodology used in-person testers using the "think aloud" method to complete tasks on the home page. Review of test results revealed problem areas of the design and redesign; further testing was effective in refining the page. User testing has proved to be a valuable method to engage users and provide feedback to continually improve the library's home page.

Evidence-based Heuristics for Evaluating Demands on eHealth Literacy and Usability in a Mobile Consumer Health Application.

PubMed

Monkman, Helen; Griffith, Janessa; Kushniruk, Andre W

2015-01-01

Heuristic evaluations have proven to be valuable for identifying usability issues in systems. Commonly used sets of heuritics exist; however, they may not always be the most suitable, given the specific goal of the analysis. One such example is seeking to evaluate the demands on eHealth literacy and usability of consumer health information systems. In this study, eight essential heuristics and three optional heuristics subsumed from the evidence on eHealth/health literacy and usability were tested for their utility in assessing a mobile blood pressure tracking application (app). This evaluation revealed a variety of ways the design of the app could both benefit and impede users with limited eHealth literacy. This study demonstrated the utility of a low-cost, single evaluation approach for identifying both eHealth literacy and usability issues based on existing evidence in the literature.

Development and usability testing of a web-based cancer symptom and quality-of-life support intervention.

PubMed

Wolpin, S E; Halpenny, B; Whitman, G; McReynolds, J; Stewart, M; Lober, W B; Berry, D L

2015-03-01

The feasibility and acceptability of computerized screening and patient-reported outcome measures have been demonstrated in the literature. However, patient-centered management of health information entails two challenges: gathering and presenting data using "patient-tailored" methods and supporting "patient-control" of health information. The design and development of many symptom and quality-of-life information systems have not included opportunities for systematically collecting and analyzing user input. As part of a larger clinical trial, the Electronic Self-Report Assessment for Cancer-II project, participatory design approaches were used to build and test new features and interfaces for patient/caregiver users. The research questions centered on patient/caregiver preferences with regard to the following: (a) content, (b) user interface needs, (c) patient-oriented summary, and (d) patient-controlled sharing of information with family, caregivers, and clinicians. Mixed methods were used with an emphasis on qualitative approaches; focus groups and individual usability tests were the primary research methods. Focus group data were content analyzed, while individual usability sessions were assessed with both qualitative and quantitative methods. We identified 12 key patient/caregiver preferences through focus groups with 6 participants. We implemented seven of these preferences during the iterative design process. We deferred development for some of the preferences due to resource constraints. During individual usability testing (n = 8), we were able to identify 65 usability issues ranging from minor user confusion to critical errors that blocked task completion. The participatory development model that we used led to features and design revisions that were patient centered. We are currently evaluating new approaches for the application interface and for future research pathways. We encourage other researchers to adopt user-centered design approaches when building patient-centered technologies. © The Author(s) 2014.

Usability Testing of the iPhone App to Improve Pain Assessment for Older Adults with Cognitive Impairment (Prehospital Setting): A Qualitative Study.

PubMed

Docking, Rachael E; Lane, Matthew; Schofield, Pat A

2017-03-15

Pain assessment in older adults with cognitive impairment is often challenging, and paramedics are not given sufficient tools/training to assess pain. The development of a mobile app may improve pain assessment and management in this vulnerable population. We conducted usability testing of a newly developed iPhone pain assessment application with potential users, in this case as a tool for clinical paramedic practice to improve pain assessment of older adults with cognitive impairment. We conducted usability testing with paramedic students and a Delphi panel of qualified paramedics. Participants studied the app and paper-based algorithm from which the app was developed. The potential use for the app was discussed. Usability testing focus groups were recorded, transcribed verbatim, and analyzed using a thematic approach. Proposed recommendations were disseminated to the Delphi panel that reviewed and confirmed them. Twenty-four paramedic students from two UK ambulance services participated in the focus groups. Usability of the app and its potential were viewed positively. Four major themes were identified: 1) overall opinion of the app for use in paramedic services; 2) incorporating technological applications into the health care setting; 3) improving knowledge and governance; and 4) alternative uses for the app. Subthemes were identified and are presented. Our results indicate that the pain assessment app constitutes a potentially useful tool in the prehospital setting. By providing access to a tool specifically developed to help identify/assess pain in a user-friendly format, paramedics are likely to have increased knowledge and confidence in assessing pain in patients with dementia. © 2017 American Academy of Pain Medicine. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com

Improving the Quality and Effectiveness of Computer-Mediated Instruction Through Usability Evaluations

ERIC Educational Resources Information Center

Crowther, Michael S.; Keller, Chris C.; Waddoups, Gregory L.

2004-01-01

Brigham Young University's Center for Instructional Design (CID) creates online courses and multimedia instructional applications for university faculty. This paper asserts that including usability testing as a part of evaluation improves the quality and effectiveness of computer-mediated instruction. The paper describes the fundamental purpose…

Improving a Counselor Education Web Site through Usability Testing: The Bibliotherapy Education Project

ERIC Educational Resources Information Center

McMillen, Paula S.; Pehrsson, Dale-Elizabeth

2009-01-01

Technology proficiency expectations have proliferated in counselor education; however, limited information in the counseling literature details how to effectively evaluate or refine online resources from a design/utility standpoint. This description of a small-scale usability study demonstrates a cost-effective strategy for improving counselor…

User Satisfaction Evaluation of an Educational Website

ERIC Educational Resources Information Center

Akilli, Goknur Kaplan

2005-01-01

This study focuses on one particular aspect of usability, namely, user satisfaction, for an educational website used as a supportive tool for various courses by employing only one specific usability testing technique, a questionnaire. The researcher aimed to find out whether eighth semester undergraduate students of Computer Education and…

Evaluating a Web-Based Interface for Internet Telemedicine

NASA Technical Reports Server (NTRS)

Lathan, Corinna E.; Newman, Dava J.; Sebrechts, Marc M.; Doarn, Charles R.

1997-01-01

The objective is to introduce the usability engineering methodology, heuristic evaluation, to the design and development of a web-based telemedicine system. Using a set of usability criteria, or heuristics, one evaluator examined the Spacebridge to Russia web-site for usability problems. Thirty-four usability problems were found in this preliminary study and all were assigned a severity rating. The value of heuristic analysis in the iterative design of a system is shown because the problems can be fixed before deployment of a system and the problems are of a different nature than those found by actual users of the system. It was therefore determined that there is potential value of heuristic evaluation paired with user testing as a strategy for optimal system performance design.

The Cultural Evolution of Human Communication Systems in Different Sized Populations: Usability Trumps Learnability

PubMed Central

Fay, Nicolas; Ellison, T. Mark

2013-01-01

This study examines the intergenerational transfer of human communication systems. It tests if human communication systems evolve to be easy to learn or easy to use (or both), and how population size affects learnability and usability. Using an experimental-semiotic task, we find that human communication systems evolve to be easier to use (production efficiency and reproduction fidelity), but harder to learn (identification accuracy) for a second generation of naïve participants. Thus, usability trumps learnability. In addition, the communication systems that evolve in larger populations exhibit distinct advantages over those that evolve in smaller populations: the learnability loss (from the Initial signs) is more muted and the usability benefits are more pronounced. The usability benefits for human communication systems that evolve in a small and large population is explained through guided variation reducing sign complexity. The enhanced performance of the communication systems that evolve in larger populations is explained by the operation of a content bias acting on the larger pool of competing signs. The content bias selects for information-efficient iconic signs that aid learnability and enhance usability. PMID:23967243

The cultural evolution of human communication systems in different sized populations: usability trumps learnability.

PubMed

Fay, Nicolas; Ellison, T Mark

2013-01-01

This study examines the intergenerational transfer of human communication systems. It tests if human communication systems evolve to be easy to learn or easy to use (or both), and how population size affects learnability and usability. Using an experimental-semiotic task, we find that human communication systems evolve to be easier to use (production efficiency and reproduction fidelity), but harder to learn (identification accuracy) for a second generation of naïve participants. Thus, usability trumps learnability. In addition, the communication systems that evolve in larger populations exhibit distinct advantages over those that evolve in smaller populations: the learnability loss (from the Initial signs) is more muted and the usability benefits are more pronounced. The usability benefits for human communication systems that evolve in a small and large population is explained through guided variation reducing sign complexity. The enhanced performance of the communication systems that evolve in larger populations is explained by the operation of a content bias acting on the larger pool of competing signs. The content bias selects for information-efficient iconic signs that aid learnability and enhance usability.

Interface evaluation for soft robotic manipulators

NASA Astrophysics Data System (ADS)

Moore, Kristin S.; Rodes, William M.; Csencsits, Matthew A.; Kwoka, Martha J.; Gomer, Joshua A.; Pagano, Christopher C.

2006-05-01

The results of two usability experiments evaluating an interface for the operation of OctArm, a biologically inspired robotic arm modeled after an octopus tentacle, are reported. Due to the many degrees-of-freedom (DOF) for the operator to control, such 'continuum' robotic limbs provide unique challenges for human operators because they do not map intuitively. Two modes have been developed to control the arm and reduce the DOF under the explicit direction of the operator. In coupled velocity (CV) mode, a joystick controls changes in arm curvature. In end-effector (EE) mode, a joystick controls the arm by moving the position of an endpoint along a straight line. In Experiment 1, participants used the two modes to grasp objects placed at different locations in a virtual reality modeling language (VRML). Objective measures of performance and subjective preferences were recorded. Results revealed lower grasp times and a subjective preference for the CV mode. Recommendations for improving the interface included providing additional feedback and implementation of an error recovery function. In Experiment 2, only the CV mode was tested with improved training of participants and several changes to the interface. The error recovery function was implemented, allowing participants to reverse through previously attained positions. The mean time to complete the trials in the second usability test was reduced by more than 4 minutes compared with the first usability test, confirming the interface changes improved performance. The results of these tests will be incorporated into future versions of the arm and improve future usability tests.

Technology, design and dementia: an exploratory survey of developers.

PubMed

Jiancaro, Tizneem; Jaglal, Susan B; Mihailidis, Alex

2017-08-01

Despite worldwide surges in dementia, we still know relatively little about the design of home technologies that support this population. The purpose of this study was to investigate design considerations from the perspective of developers. Participants, including technical and clinical specialists, were recruited internationally and answered web-based survey questions comprising Likert-type responses with text entry options. Developers were queried on 23 technology acceptance characteristics and 24 design practices. In all, forty developers completed the survey. Concerning "technology acceptance", cost, learnability, self-confidence (during use) and usability were deemed very important. Concerning "design practice", developers overwhelmingly valued user-centred design (UCD). In terms of general assistive technology (AT) models, these were largely unknown by technical specialists compared to clinical specialists. Recommendations based on this study include incorporating "self-confidence" into design protocols; examining the implications of "usability" and UCD in this context; and considering empathy-based design approaches to suit a diverse user population. Moreover, clinical specialists have much to offer development teams, particularly concerning the use of conceptual AT models. Implications of rehabilitation Stipulate precise usability criteria. Consider "learnability" and "self-confidence" as technology adoption criteria. Recognize the important theoretical role that clinical specialists can fulfil concerning the use of design schemas. Acknowledge the diversity amongst users with dementia, potentially adopting techniques, such as designing for "extraordinary users".

Psychological Usability of Layered Application Software Platforms

NASA Technical Reports Server (NTRS)

Uhiarik, John

1999-01-01

This grant provided Graduate Research Fellowship Program support to James Michael Herold to obtain a graduate degree from the Department of Psychology at Kansas State University and conduct usability testing of graphical user interfaces the Kennedy Space Center. The student independently took an additional internship at Boll Laboratories without informing his graduate advisor or the Department of Psychology. Because he was NOT making progress toward his degree, he elected not to pursue his graduate studies at Kansas State University and self-terminated from the program (spin without informing his advisor or the Department of Psychology]. What he accomplished for NASA in terms of usability testing at the Kennedy Space Center is unclear. NASA terminated support for the project: 07/30/99, including a $4,000 commitment to provide infrastructure support to the Department of Psychology.

Web-based Education for Low-literate Parents in Neonatal Intensive Care Unit: Development of a Website and Heuristic Evaluation and Usability Testing

PubMed Central

Choi, Jeungok; Bakken, Suzanne

2010-01-01

Purpose Low health literacy has been associated with poor health-related outcomes. The purposes are to report the development of a website for low-literate parents in the Neonatal Intensive Care Unit (NICU), and the findings of heuristic evaluation and a usability testing of this website. Methods To address low literacy of NICU parents, multimedia educational Website using visual aids (e.g., pictographs, photographs), voice-recorded text message in addition to a simplified text was developed. The text was created at the 5th grade readability level. The heuristic evaluation was conducted by three usability experts using 10 heuristics. End-users’ performance was measured by counting the time spent completing tasks and number of errors, as well as recording users’ perception of ease of use and usefulness (PEUU) in a sample of 10 NICU parents. Results Three evaluators identified 82 violations across the 10 heuristics. All violations, however, received scores <2, indicating minor usability problems. Participants’ time to complete task varies from 81.2 seconds (SD=30.9) to 2.2 seconds (SD=1.3). Participants rated the Website as easy to use and useful (PEUU Mean= 4.52, SD=0.53). Based on the participants’ comments, appropriate modifications were made. Discussion and Conclusions Different types of visuals on the Website were well accepted by low-literate users and agreement of visuals with text improved understanding of the educational materials over that with text alone. The findings suggest that using concrete and realistic pictures and pictographs with clear captions would maximize the benefit of visuals. One emerging theme was “simplicity” in design (e.g., limited use of colors, one font type and size), content (e.g., avoid lengthy text), and technical features (e.g., limited use of pop-ups). The heuristic evaluation by usability experts and the usability test with actual users provided complementary expertise, which can give a richer assessment of a design for low literacy Website. These results facilitated design modification and implementation of solutions by categorizing and prioritizing the usability problems. PMID:20617546

Assessing and comparing the usability of Chinese EHRs used in two Peking University hospitals to EHRs used in the US: A method of RUA.

PubMed

Xu, Lufei; Wen, Dong; Zhang, Xingting; Lei, Jianbo

2016-05-01

The objective of this study was to investigate the usability level of Chinese hospital Electronic Health Records (EHRs) by assessing the completion times of EHRs for seven "meaningful use (MU)" relevant tasks conducted at two Chinese tertiary hospitals and comparing the results to those of relevant research conducted in US EHRs. Using Rapid Usability Assessment (RUA) developed by the National Center for Cognitive Informatics and Decision Making (NCCD), the usability of EHRs from two Peking University hospitals was assessed using a three-step Keystroke Level Model (KLM) in a laboratory environment. (1) The total EHR task completion time for 7 MU relevant test tasks showed no significant differences between the two Chinese EHRs and their US counterparts, in which the time for thinking was relatively large and comprised 35.6% of the total time. The time for the electronic physician order was the largest. (2) For specific tasks, the mean completion times of the 2 hospital EHR systems spent on recording, modifying and searching (RMS) the medication orders were similar to those for the RMS radioactive tests; the mean time spent on the RMS laboratory test orders were much less. (3) There were 85 usability problems identified in the 2 hospital EHR systems. In Chinese EHRs, a substantial amount of time is required to complete tasks relevant to MU targets and many preventable usability problems can be discovered. The task completion time of the 2 Chinese EHR systems was a little shorter than in the 5 reported US EHR systems, while the differences in smoking status and CPOE tasks were obvious; one main reason for these differences was the use of structured data entry. The efficiency of Chinese and US EHRs was not significantly different. The key to improving the efficiency of both systems lies in expediting the Computerized physician order entry (CPOE) task. Many usability problems can be identified using heuristic assessments and improved by corresponding actions. Copyright © 2016 Elsevier Ireland Ltd. All rights reserved.

Web-based education for low-literate parents in Neonatal Intensive Care Unit: development of a website and heuristic evaluation and usability testing.

PubMed

Choi, Jeungok; Bakken, Suzanne

2010-08-01

Low health literacy has been associated with poor health-related outcomes. The purposes are to report the development of a website for low-literate parents in the Neonatal Intensive Care Unit (NICU), and the findings of heuristic evaluation and a usability testing of this website. To address low literacy of NICU parents, multimedia educational Website using visual aids (e.g., pictographs, photographs), voice-recorded text message in addition to a simplified text was developed. The text was created at the 5th grade readability level. The heuristic evaluation was conducted by three usability experts using 10 heuristics. End-users' performance was measured by counting the time spent completing tasks and number of errors, as well as recording users' perception of ease of use and usefulness (PEUU) in a sample of 10 NICU parents. Three evaluators identified 82 violations across the 10 heuristics. All violations, however, received scores <2, indicating minor usability problems. Participants' time to complete task varies from 81.2 s (SD = 30.9) to 2.2 s (SD = 1.3). Participants rated the Website as easy to use and useful (PEUU mean = 4.52, SD = 0.53). Based on the participants' comments, appropriate modifications were made. Different types of visuals on the Website were well accepted by low-literate users and agreement of visuals with text improved understanding of the educational materials over that with text alone. The findings suggest that using concrete and realistic pictures and pictographs with clear captions would maximize the benefit of visuals. One emerging theme was "simplicity" in design (e.g., limited use of colors, one font type and size), content (e.g., avoid lengthy text), and technical features (e.g., limited use of pop-ups). The heuristic evaluation by usability experts and the usability test with actual users provided complementary expertise, which can give a richer assessment of a design for low literacy Website. These results facilitated design modification and implementation of solutions by categorizing and prioritizing the usability problems.

Health Information Technology Usability Evaluation Scale (Health-ITUES) for Usability Assessment of Mobile Health Technology: Validation Study.

PubMed

Schnall, Rebecca; Cho, Hwayoung; Liu, Jianfang

2018-01-05

Mobile technology has become a ubiquitous technology and can be particularly useful in the delivery of health interventions. This technology can allow us to deliver interventions to scale, cover broad geographic areas, and deliver technologies in highly tailored ways based on the preferences or characteristics of users. The broad use of mobile technologies supports the need for usability assessments of these tools. Although there have been a number of usability assessment instruments developed, none have been validated for use with mobile technologies. The goal of this work was to validate the Health Information Technology Usability Evaluation Scale (Health-ITUES), a customizable usability assessment instrument in a sample of community-dwelling adults who were testing the use of a new mobile health (mHealth) technology. A sample of 92 community-dwelling adults living with HIV used a new mobile app for symptom self-management and completed the Health-ITUES to assess the usability of the app. They also completed the Post-Study System Usability Questionnaire (PSSUQ), a widely used and well-validated usability assessment tool. Correlations between these scales and each of the subscales were assessed. The subscales of the Health-ITUES showed high internal consistency reliability (Cronbach alpha=.85-.92). Each of the Health-ITUES subscales and the overall scale was moderately to strongly correlated with the PSSUQ scales (r=.46-.70), demonstrating the criterion validity of the Health-ITUES. The Health-ITUES has demonstrated reliability and validity for use in assessing the usability of mHealth technologies in community-dwelling adults living with a chronic illness. ©Rebecca Schnall, Hwayoung Cho, Jianfang Liu. Originally published in JMIR Mhealth and Uhealth (http://mhealth.jmir.org), 05.01.2018.

Health Information Technology Usability Evaluation Scale (Health-ITUES) for Usability Assessment of Mobile Health Technology: Validation Study

PubMed Central

Cho, Hwayoung; Liu, Jianfang

2018-01-01

Background Mobile technology has become a ubiquitous technology and can be particularly useful in the delivery of health interventions. This technology can allow us to deliver interventions to scale, cover broad geographic areas, and deliver technologies in highly tailored ways based on the preferences or characteristics of users. The broad use of mobile technologies supports the need for usability assessments of these tools. Although there have been a number of usability assessment instruments developed, none have been validated for use with mobile technologies. Objective The goal of this work was to validate the Health Information Technology Usability Evaluation Scale (Health-ITUES), a customizable usability assessment instrument in a sample of community-dwelling adults who were testing the use of a new mobile health (mHealth) technology. Methods A sample of 92 community-dwelling adults living with HIV used a new mobile app for symptom self-management and completed the Health-ITUES to assess the usability of the app. They also completed the Post-Study System Usability Questionnaire (PSSUQ), a widely used and well-validated usability assessment tool. Correlations between these scales and each of the subscales were assessed. Results The subscales of the Health-ITUES showed high internal consistency reliability (Cronbach alpha=.85-.92). Each of the Health-ITUES subscales and the overall scale was moderately to strongly correlated with the PSSUQ scales (r=.46-.70), demonstrating the criterion validity of the Health-ITUES. Conclusions The Health-ITUES has demonstrated reliability and validity for use in assessing the usability of mHealth technologies in community-dwelling adults living with a chronic illness. PMID:29305343

Evaluation of Protocol Uniformity Concerning Laparoscopic Cholecystectomy in The Netherlands

PubMed Central

Goossens, Richard H. M.; van Eijk, Daan J.; Lange, Johan F.

2008-01-01

Background Iatrogenic bile duct injury remains a current complication of laparoscopic cholecystectomy. One uniform and standardized protocol, based on the “critical view of safety” concept of Strasberg, should reduce the incidence of this complication. Furthermore, owing to the rapid development of minimally invasive surgery, technicians are becoming more frequently involved. To improve communication between the operating team and technicians, standardized actions should also be defined. The aim of this study was to compare existing protocols for laparoscopic cholecystectomy from various Dutch hospitals. Methods Fifteen Dutch hospitals were contacted for evaluation of their protocols for laparoscopic cholecystectomy. All evaluated protocols were divided into six steps and were compared accordingly. Results In total, 13 hospitals responded—5 academic hospitals, 5 teaching hospitals, 3 community hospitals—of which 10 protocols were usable for comparison. Concerning the trocar positions, only minor differences were found. The concept of “critical view of safety” was represented in just one protocol. Furthermore, the order of clipping and cutting the cystic artery and duct differed. Descriptions of instruments and apparatus were also inconsistent. Conclusions Present protocols differ too much to define a universal procedure among surgeons in The Netherlands. The authors propose one (inter)national standardized protocol, including standardized actions. This uniform standardized protocol has to be officially released and recommended by national scientific associations (e.g., the Dutch Society of Surgery) or international societies (e.g., European Association for Endoscopic Surgery and Society of American Gastrointestinal and Endoscopic Surgeons). The aim is to improve patient safety and professional communication, which are necessary for new developments. PMID:18224485

Usability of Optical Mark Reader Sheet as an Answering Tool in Testing.

PubMed

Booka, Masayuki; Oku, Hidehisa; Scheller, Andreas; Yamaoka, Shintaro

2017-01-01

The research result on usability of Optical Mark Reader Sheet (OMRS) being used as the standard answering tool is reported. The use of OMRS significantly requires more answer time than the answer time without OMRS, and the use of assistive devices for OMRS has the possibility to reduce the answer time.

How and Why of User Studies: RLG's RedLightGreen as a Case Study

ERIC Educational Resources Information Center

Proffitt, Merrilee

2006-01-01

This article documents a lifecycle approach to employing user-centered design, covering both qualitative and quantitative data gathering methods in support of using this approach for product design, usability testing, and market research. The author provides specific case studies of usability studies, focus groups, interviews, ethnographic…

Earthdata Search Summer ESIP Usability Workshop

NASA Technical Reports Server (NTRS)

Reese, Mark; Sirato, Jeff

2017-01-01

The Earthdata Search Client has undergone multiple rounds of usability testing during 2017 and the user feedback received has resulted in an enhanced user interface. This session will showcase the new Earthdata Search Client user interface and provide hands-on experience for participants to learn how to search, visualize and download data in the desired format.

Creating a sustainable collaborative consumer health application for chronic disease self-management.

PubMed

Johnson, Constance M; McIlwain, Steve; Gray, Oliver; Willson, Bradley; Vorderstrasse, Allison

2017-07-01

As the prevalence of chronic diseases increase, there is a need for consumer-centric health informatics applications that assist individuals with disease self-management skills. However, due to the cost of development of these applications, there is also a need to build a disease agnostic architecture so that they could be reused for any chronic disease. This paper describes the architecture of a collaborative virtual environment (VE) platform, LIVE©, that was developed to teach self-management skills and provide social support to those individuals with type 2 diabetes. However, a backend database allows for the application to be easily reused for any chronic disease. We tested its usability in the context of a larger randomized controlled trial of its efficacy. The usability was scored as 'good' by half of the participants in the evaluation. Common errors in the testing and solutions to address initial usability issues are discussed. Overall, LIVE© represents a usable and generalizable platform that will be adapted to other chronic diseases and health needs in future research and applications. Copyright © 2017 Elsevier Inc. All rights reserved.

Usability Testing of a Computerized Communication Tool in a Diverse Urban Pediatric Population

PubMed Central

Tsimicalis, Argerie; Stone, Patricia W.; Bakken, Suzanne; Yoon, Sunmoo; Sands, Stephen; Porter, Rechelle; Ruland, Cornelia

2015-01-01

Background Developed in Norway, Sisom is an interactive, rigorously tested, computerized, communication tool designed to help children with cancer express their perceived symptoms/problems. Children travel virtually from island to island rating their symptoms/problems. While Sisom has been found to significantly improve communication in patient consultations in Norway, usability testing is warranted with US children prior to further use in research studies. Objective To determine the usability of Sisom in a sample of English and Spanish speaking children in an urban US community. Methods A mixed methods usability study was conducted with a purposive sample of healthy children and children with cancer. Semi-structured interviews were used to assess healthy children’s symptom recognition. Children with cancer completed 8 usability tasks captured with Morae® 3.3 software. Data were downloaded, transcribed, and analyzed descriptively. Results Four healthy children and 8 children with cancer participated. Of the 44 symptoms assessed, healthy children recognized 15 (34%) pictorial symptoms immediately or indicated 13 (30%) pictures were good representations of the symptom. Six children with cancer completed all tasks. All children navigated successfully from one island to the next, ranking their symptom/problem severity, clicking the magnifying glass for help, or asking the researcher for assistance. All children were satisfied with the aesthetics and expressed an interest in using Sisom to communicate their symptoms. Conclusions A few minor suggestions for improvement and adjustment may optimize the use of Sisom for US children. Implications for Practice Sisom may help clinicians overcome challenges assessing children’s complex symptoms/problems in a child-friendly manner. PMID:24457227

The STEP database through the end-users eyes--USABILITY STUDY.

PubMed

Salunke, Smita; Tuleu, Catherine

2015-08-15

The user-designed database of Safety and Toxicity of Excipients for Paediatrics ("STEP") is created to address the shared need of drug development community to access the relevant information of excipients effortlessly. Usability testing was performed to validate if the database satisfies the need of the end-users. Evaluation framework was developed to assess the usability. The participants performed scenario based tasks and provided feedback and post-session usability ratings. Failure Mode Effect Analysis (FMEA) was performed to prioritize the problems and improvements to the STEP database design and functionalities. The study revealed several design vulnerabilities. Tasks such as limiting the results, running complex queries, location of data and registering to access the database were challenging. The three critical attributes identified to have impact on the usability of the STEP database included (1) content and presentation (2) the navigation and search features (3) potential end-users. Evaluation framework proved to be an effective method for evaluating database effectiveness and user satisfaction. This study provides strong initial support for the usability of the STEP database. Recommendations would be incorporated into the refinement of the database to improve its usability and increase user participation towards the advancement of the database. Copyright © 2015 Elsevier B.V. All rights reserved.

Usability Testing of an Interactive Virtual Reality Distraction Intervention to Reduce Procedural Pain in Children and Adolescents With Cancer.

PubMed

Birnie, Kathryn A; Kulandaivelu, Yalinie; Jibb, Lindsay; Hroch, Petra; Positano, Karyn; Robertson, Simon; Campbell, Fiona; Abla, Oussama; Stinson, Jennifer

2018-06-01

Needle procedures are among the most distressing aspects of pediatric cancer-related treatment. Virtual reality (VR) distraction offers promise for needle-related pain and distress given its highly immersive and interactive virtual environment. This study assessed the usability (ease of use and understanding, acceptability) of a custom VR intervention for children with cancer undergoing implantable venous access device (IVAD) needle insertion. Three iterative cycles of mixed-method usability testing with semistructured interviews were undertaken to refine the VR. Participants included 17 children and adolescents (8-18 years old) with cancer who used the VR intervention prior to or during IVAD access. Most participants reported the VR as easy to use (82%) and understand (94%), and would like to use it during subsequent needle procedures (94%). Based on usability testing, refinements were made to VR hardware, software, and clinical implementation. Refinements focused on increasing responsiveness, interaction, and immersion of the VR program, reducing head movement for VR interaction, and enabling participant alerts to steps of the procedure by clinical staff. No adverse events of nausea or dizziness were reported. The VR intervention was deemed acceptable and safe. Next steps include assessing feasibility and effectiveness of the VR intervention for pain and distress.

Usability Tests in Medicine: A Cost-Benefit Analysis for Hospitals Before Acquiring Medical Devices for Theatre.

PubMed

Gonser, Phillipp; Fuchsberger, Thomas; Matern, Ulrich

2017-08-01

The use of active medical devices in clinical routine should be as safe and efficient as possible. Usability tests (UTs) help improve these aspects of medical devices during their development, but UTs can be of use for hospitals even after a product has been launched. The present pilot study examines the costs and possible benefits of UT for hospitals before buying new medical devices for theatre. Two active medical devices with different complexity were tested in a standardized UT and a cost-benefit analysis was carried out assuming a different device bought at the same price with a higher usability could increase the efficiency of task solving and due to that save valuable theatre time. The cost of the UT amounted up to €19.400. Hospitals could benefit from UTs before buying new devices for theatre by reducing time-consuming operator errors and thereby increase productivity and patient safety. The possible benefits amounted from €23.300 to €1.570.000 (median = €797.000). Not only hospitals could benefit economically from investing in a UT before deciding to buy a medical device, but especially patients would profit from a higher usability by reducing possible operator errors and increase safety and performance of use.

Adapting an in-person patient-caregiver communication intervention to a tailored web-based format.

PubMed

Zulman, Donna M; Schafenacker, Ann; Barr, Kathryn L C; Moore, Ian T; Fisher, Jake; McCurdy, Kathryn; Derry, Holly A; Saunders, Edward W; An, Lawrence C; Northouse, Laurel

2012-03-01

Interventions that target cancer patients and their caregivers have been shown to improve patient-caregiver communication, support, and emotional well-being. To adapt an in-person communication intervention for cancer patients and caregivers to a web-based format, and to examine the usability and acceptability of the web-based program among representative users. A tailored, interactive web-based communication program for cancer patients and their family caregivers was developed based on an existing in-person, nurse-delivered intervention. The development process involved: (1) building a multidisciplinary team of content and web design experts, (2) combining key components of the in-person intervention with the unique tailoring and interactive features of a web-based platform, and (3) conducting focus groups and usability testing to obtain feedback from representative program users at multiple time points. Four focus groups with 2-3 patient-caregiver pairs per group (n = 22 total participants) and two iterations of usability testing with four patient-caregiver pairs per session (n = 16 total participants) were conducted. Response to the program's structure, design, and content was favorable, even among users who were older or had limited computer and Internet experience. The program received high ratings for ease of use and overall usability (mean System Usability Score of 89.5 out of 100). Many elements of a nurse-delivered patient-caregiver intervention can be successfully adapted to a web-based format. A multidisciplinary design team and an iterative evaluation process with representative users were instrumental in the development of a usable and well-received web-based program. Copyright © 2011 John Wiley & Sons, Ltd.

Brief Report: Adapting an In-Person Patient-Caregiver Communication Intervention to a Tailored Web-Based Format

PubMed Central

Zulman, Donna M.; Schafenacker, Ann; Barr, Kathryn L.C.; Moore, Ian T.; Fisher, Jake; McCurdy, Kathryn; Derry, Holly A.; Saunders, Edward W.; An, Lawrence C.; Northouse, Laurel

2011-01-01

Background Interventions that target cancer patients and their caregivers have been shown to improve communication, support, and emotional well-being. Objective To adapt an in-person communication intervention for cancer patients and caregivers to a web-based format, and to examine the usability and acceptability of the web-based program among representative users. Methods A tailored, interactive web-based communication program for cancer patients and their family caregivers was developed based on an existing in-person, nurse-delivered intervention. The development process involved: 1) building a multidisciplinary team of content and web design experts, 2) combining key components of the in-person intervention with the unique tailoring and interactive features of a web-based platform, and 3) conducting focus groups and usability testing to obtain feedback from representative program users at multiple time points. Results Four focus groups with 2 to 3 patient-caregiver pairs per group (n = 22 total participants) and two iterations of usability testing with 4 patient-caregiver pairs per session (n = 16 total participants) were conducted. Response to the program's structure, design, and content was favorable, even among users who were older or had limited computer and internet experience. The program received high ratings for ease of use and overall usability (mean System Usability Score of 89.5 out of 100). Conclusions Many elements of a nurse-delivered patient-caregiver intervention can be successfully adapted to a web-based format. A multidisciplinary design team and an iterative evaluation process with representative users were instrumental in the development of a usable and well-received web-based program. PMID:21830255

A Serious Game for Teaching Nursing Students Clinical Reasoning and Decision-Making Skills.

PubMed

Johnsen, Hege Mari; Fossum, Mariann; Vivekananda-Schmidt, Pirashanthie; Fruhling, Ann; Slettebø, Åshild

2016-01-01

The aim of this study was to design and pilot-test a serious game for teaching nursing students clinical reasoning and decision-making skills in caring for patients with chronic obstructive pulmonary disease. A video-based serious game prototype was developed. A purposeful sample of six participants tested and evaluated the prototype. Usability issues were identified regarding functionality and user-computer interface. However, overall the serious game was perceived to be useful, usable and likable to use.

Health figures: an open source JavaScript library for health data visualization.

PubMed

Ledesma, Andres; Al-Musawi, Mohammed; Nieminen, Hannu

2016-03-22

The way we look at data has a great impact on how we can understand it, particularly when the data is related to health and wellness. Due to the increased use of self-tracking devices and the ongoing shift towards preventive medicine, better understanding of our health data is an important part of improving the general welfare of the citizens. Electronic Health Records, self-tracking devices and mobile applications provide a rich variety of data but it often becomes difficult to understand. We implemented the hFigures library inspired on the hGraph visualization with additional improvements. The purpose of the library is to provide a visual representation of the evolution of health measurements in a complete and useful manner. We researched the usefulness and usability of the library by building an application for health data visualization in a health coaching program. We performed a user evaluation with Heuristic Evaluation, Controlled User Testing and Usability Questionnaires. In the Heuristics Evaluation the average response was 6.3 out of 7 points and the Cognitive Walkthrough done by usability experts indicated no design or mismatch errors. In the CSUQ usability test the system obtained an average score of 6.13 out of 7, and in the ASQ usability test the overall satisfaction score was 6.64 out of 7. We developed hFigures, an open source library for visualizing a complete, accurate and normalized graphical representation of health data. The idea is based on the concept of the hGraph but it provides additional key features, including a comparison of multiple health measurements over time. We conducted a usability evaluation of the library as a key component of an application for health and wellness monitoring. The results indicate that the data visualization library was helpful in assisting users in understanding health data and its evolution over time.

User-centered development and testing of a monitoring system that provides feedback regarding physical functioning to elderly people

PubMed Central

Vermeulen, Joan; Neyens, Jacques CL; Spreeuwenberg, Marieke D; van Rossum, Erik; Sipers, Walther; Habets, Herbert; Hewson, David J; de Witte, Luc P

2013-01-01

Purpose To involve elderly people during the development of a mobile interface of a monitoring system that provides feedback to them regarding changes in physical functioning and to test the system in a pilot study. Methods and participants The iterative user-centered development process consisted of the following phases: (1) selection of user representatives; (2) analysis of users and their context; (3) identification of user requirements; (4) development of the interface; and (5) evaluation of the interface in the lab. Subsequently, the monitoring and feedback system was tested in a pilot study by five patients who were recruited via a geriatric outpatient clinic. Participants used a bathroom scale to monitor weight and balance, and a mobile phone to monitor physical activity on a daily basis for six weeks. Personalized feedback was provided via the interface of the mobile phone. Usability was evaluated on a scale from 1 to 7 using a modified version of the Post-Study System Usability Questionnaire (PSSUQ); higher scores indicated better usability. Interviews were conducted to gain insight into the experiences of the participants with the system. Results The developed interface uses colors, emoticons, and written and/or spoken text messages to provide daily feedback regarding (changes in) weight, balance, and physical activity. The participants rated the usability of the monitoring and feedback system with a mean score of 5.2 (standard deviation 0.90) on the modified PSSUQ. The interviews revealed that most participants liked using the system and appreciated that it signaled changes in their physical functioning. However, usability was negatively influenced by a few technical errors. Conclusion Involvement of elderly users during the development process resulted in an interface with good usability. However, the technical functioning of the monitoring system needs to be optimized before it can be used to support elderly people in their self-management. PMID:24039407

Usability evaluation of mobile applications; where do we stand?

NASA Astrophysics Data System (ADS)

Zahra, Fatima; Hussain, Azham; Mohd, Haslina

2017-10-01

The range and availability of mobile applications is expanding rapidly. With the increased processing power available on portable devices, developers are increasing the range of services by embracing smartphones in their extensive and diverse practices. While usability testing and evaluations of mobile applications have not yet touched the accuracy level of other web based applications. The existing usability models do not adequately capture the complexities of interacting with applications on a mobile platform. Therefore, this study aims to presents review on existing usability models for mobile applications. These models are in their infancy but with time and more research they may eventually be adopted. Moreover, different categories of mobile apps (medical, entertainment, education) possess different functional and non-functional requirements thus customized models are required for diverse mobile applications.

Exploring NASA GES DISC Data with Interoperable Services

NASA Technical Reports Server (NTRS)

Zhao, Peisheng; Yang, Wenli; Hegde, Mahabal; Wei, Jennifer C.; Kempler, Steven; Pham, Long; Teng, William; Savtchenko, Andrey

2015-01-01

Overview of NASA GES DISC (NASA Goddard Earth Science Data and Information Services Center) data with interoperable services: Open-standard and Interoperable Services Improve data discoverability, accessibility, and usability with metadata, catalogue and portal standards Achieve data, information and knowledge sharing across applications with standardized interfaces and protocols Open Geospatial Consortium (OGC) Data Services and Specifications Web Coverage Service (WCS) -- data Web Map Service (WMS) -- pictures of data Web Map Tile Service (WMTS) --- pictures of data tiles Styled Layer Descriptors (SLD) --- rendered styles.

NASA's Big Earth Data Initiative Accomplishments

NASA Technical Reports Server (NTRS)

Klene, Stephan A.; Pauli, Elisheva; Pressley, Natalie N.; Cechini, Matthew F.; McInerney, Mark

2017-01-01

The goal of NASA's effort for BEDI is to improve the usability, discoverability, and accessibility of Earth Observation data in support of societal benefit areas. Accomplishments: In support of BEDI goals, datasets have been entered into Common Metadata Repository(CMR), made available via the Open-source Project for a Network Data Access Protocol (OPeNDAP), have a Digital Object Identifier (DOI) registered for the dataset, and to support fast visualization many layers have been added in to the Global Imagery Browse Services (GIBS).

NASA's Big Earth Data Initiative Accomplishments

NASA Astrophysics Data System (ADS)

Klene, S. A.; Pauli, E.; Pressley, N. N.; Cechini, M. F.; McInerney, M.

2017-12-01

The goal of NASA's effort for BEDI is to improve the usability, discoverability, and accessibility of Earth Observation data in support of societal benefit areas. Accomplishments: In support of BEDI goals, datasets have been entered into Common Metadata Repository(CMR), made available via the Open-source Project for a Network Data Access Protocol (OPeNDAP), have a Digital Object Identifier (DOI) registered for the dataset, and to support fast visualization many layers have been added in to the Global Imagery Browse Service(GIBS)

How Willing Are Adolescents to Record Their Dietary Intake? The Mobile Food Record

PubMed Central

Harray, Amelia J; Kerr, Deborah Anne; Paterson, Stacey; Aflague, Tanisha; Bosch Ruiz, Marc; Ahmad, Ziad; Delp, Edward J

2015-01-01

Background Accurately assessing the diets of children and adolescents can be problematic. Use of technologies, such as mobile apps designed to capture food and beverages consumed at eating occasions with images taken using device-embedded cameras, may address many of the barriers to gathering accurate dietary intake data from adolescents. Objective The objectives of this study were to assess the willingness of adolescents to take images of food and beverages at their eating occasions using a novel mobile food record (mFR) and to evaluate the usability of the user confirmation component of the mFR app, referred to as the “review process.” Methods Mixed methods combining quantitative and qualitative protocols were used in this study. Adolescents (11-15-year olds) attending a summer camp were recruited to participate in the study. First, the participants were asked to take images of foods and beverages consumed as meals and snacks for 2 consecutive days using the mFR app running on an iPhone and the number of images taken was noted. This was followed by focus group sessions to evaluate usability, which was analyzed by content and themes. After using the mFR, a think-aloud method was used to evaluate the usability of the mFR method for reviewing system-identified foods (ie, the review process). A usability questionnaire was administered at the end of all activities. Results The mFR was accepted by the majority of the 24 boys and 17 girls (n=41) but varied according to gender and eating occasion. Girls were significantly more likely than boys to capture images of their eating occasions (Fisher exact test, P=.03). Participants were more likely to take images of their breakfasts (90%, 36/40) and lunches (90%, 72/80) and least likely to capture afternoon and evening snacks, 54% (43/80) and 40% (32/80), respectively. The major themes from the focus groups with regard to using the mFR were games, rewards, and the need to know more about why they were using the app. Results of the usability questionnaire indicated that including a game component would be important to increase willingness to use the mFR, and a high majority of the participants indicated a willingness to use the mFR for 7 days or more. The image review process was found to be easy to use except for some confusion with overlapping markers on the screen. Conclusions The adolescents’ experiences with and feedback about the mFR highlighted the importance of increased training, reminders, entertainment (eg, games), and training with practice in using the device to capture complete dietary intake as part of their active lifestyles. PMID:26024996

SlowMo, a digital therapy targeting reasoning in paranoia, versus treatment as usual in the treatment of people who fear harm from others: study protocol for a randomised controlled trial.

PubMed

Garety, Philippa A; Ward, Thomas; Freeman, Daniel; Fowler, David; Emsley, Richard; Dunn, Graham; Kuipers, Elizabeth; Bebbington, Paul; Waller, Helen; Greenwood, Kathryn; Rus-Calafell, Mar; McGourty, Alison; Hardy, Amy

2017-11-02

Paranoia is one of the most common symptoms of schizophrenia-spectrum disorders, and is associated with significant distress and disruption to the person's life. Developing more effective and accessible psychological interventions for paranoia is a clinical priority. Our research team has approached this challenge in two main ways: firstly, by adopting an interventionist causal approach to increase effectiveness and secondly, by incorporating user-centred inclusive design methods to enhance accessibility and usability. Our resultant new digital intervention, SlowMo, intensively targets a reasoning style associated with paranoia, fast thinking, characterised by jumping to conclusions and belief inflexibility. It consists of an easy-to-use, enjoyable and memorable digital interface. An interactive web-based app facilitates delivery of face-to-face meetings which is then synchronised with an innovative mobile app for use in daily life. We aim to test the clinical efficacy of SlowMo over 24 weeks to determine the mechanisms through which it reduces paranoia, and to identify participant characteristics that moderate its effectiveness. In a parallel-group randomised controlled trial, with 1:1 allocation, 360 participants with distressing persecutory beliefs will be independently randomised to receive either the SlowMo intervention added to treatment as usual (TAU) or TAU, using randomly varying permuted blocks, stratified by paranoia severity and site. Research workers will be blind to therapy allocation. The primary outcome is paranoia severity over 24 weeks; our hypothesised mechanism of change is reasoning; moderators include negative symptoms and working memory; and secondary outcomes include wellbeing, quality of life, and service use. The accessibility, usability and acceptability of the digital platform will be assessed. SlowMo has been developed as the first blended digital therapy to target fears of harm from others through an inclusive design approach. In addition to testing its efficacy, this trial will add to our understanding of psychological mechanisms in paranoia. The study will examine the usability and adherence of a novel digital therapy, including an app for self-management, in a large sample of people affected by severe mental health difficulties. ISRCTN registry, ID: ISRCTN32448671 . Registered prospectively on 30 January 2017. Date assigned 2 February 2017.

Advanced Weather Awareness and Reporting Enhancements

NASA Technical Reports Server (NTRS)

Busquets, Anthony M. (Technical Monitor); Ruokangas, Corinne Clinton; Kelly, Wallace E., III

2005-01-01

AWARE (Aviation Weather Awareness and Reporting Enhancements) was a NASA Cooperative Research and Development program conducted jointly by Rockwell Scientific, Rockwell Collins, and NASA. The effort culminated in an enhanced weather briefing and reporting tool prototype designed to integrate graphical and text-based aviation weather data to provide clear situational awareness in the context of a specific pilot, flight and equipment profile. The initial implementation of AWARE was as a web-based preflight planning tool, specifically for general aviation pilots, who do not have access to support such as the dispatchers available for commercial airlines. Initial usability tests showed that for VFR (Visual Flight Rules) pilots, AWARE provided faster and more effective weather evaluation. In a subsequent formal usability test for IFR (Instrument Flight Rules) pilots, all users finished the AWARE tests faster than the parallel DUAT tests, and all subjects graded AWARE higher for effectiveness, efficiency, and usability. The decision analysis basis of AWARE differentiates it from other aviation safety programs, providing analysis of context-sensitive data in a personalized graphical format to aid pilots/dispatchers in their complex flight requirements.

Participatory design of a collaborative clinical trial protocol writing system.

PubMed

Weng, Chunhua; McDonald, David W; Sparks, Dana; McCoy, Jason; Gennari, John H

2007-06-01

To explore concrete approaches to socio-technical design of collaborative healthcare information systems and to design a groupware technology for collaborative clinical trial protocol writing. We conducted "quick and dirty ethnography" through semi-structured interviews, observational studies, and work artifacts analysis to understand the group work for protocol development. We used participatory design through evolutionary prototyping to explore the feature space of a collaborative writing system. Our design strategies include role-based user advocacy, formative evaluation, and change management. Quick and dirty ethnography helped us efficiently understand relevant work practice, and participatory design helped us engage users into design and bring out their tacit work knowledge. Our approach that intertwined both techniques helped achieve a "work-informed and user-oriented" design. This research leads to a collaborative writing system that supports in situ communication, group awareness, and effective work progress tracking. The usability evaluation results have been satisfactory. The system design is being transferred to an organizational tool for daily use.

NASA Johnson Space Center Usability Testing and Analysis Facility (UTAF) Overview

NASA Technical Reports Server (NTRS)

Whitmore, M.

2004-01-01

The Usability Testing and Analysis Facility (UTAF) is part of the Space Human Factors Laboratory at the NASA Johnson Space Center in Houston, Texas. The facility provides support to the Office of Biological and Physical Research, the Space Shuttle Program, the International Space Station Program, and other NASA organizations. In addition, there are ongoing collaborative research efforts with external businesses and universities. The UTAF provides human factors analysis, evaluation, and usability testing of crew interfaces for space applications. This includes computer displays and controls, workstation systems, and work environments. The UTAF has a unique mix of capabilities, with a staff experienced in both cognitive human factors and ergonomics. The current areas of focus are: human factors applications in emergency medical care and informatics; control and display technologies for electronic procedures and instructions; voice recognition in noisy environments; crew restraint design for unique microgravity workstations; and refinement of human factors processes. This presentation will provide an overview of ongoing activities, and will address how the projects will evolve to meet new space initiatives.

NASA Johnson Space Center Usability Testing and Analysis Facility (WAF) Overview

NASA Technical Reports Server (NTRS)

Whitmore, M.

2004-01-01

The Usability Testing and Analysis Facility (UTAF) is part of the Space Human Factors Laboratory at the NASA Johnson Space Center in Houston, Texas. The facility provides support to the Office of Biological and Physical Research, the Space Shuttle Program, the International Space Station Program, and other NASA organizations. In addition, there are ongoing collaborative research efforts with external businesses and universities. The UTAF provides human factors analysis, evaluation, and usability testing of crew interfaces for space applications. This includes computer displays and controls, workstation systems, and work environments. The UTAF has a unique mix of capabilities, with a staff experienced in both cognitive human factors and ergonomics. The current areas of focus are: human factors applications in emergency medical care and informatics; control and display technologies for electronic procedures and instructions; voice recognition in noisy environments; crew restraint design for unique microgravity workstations; and refinement of human factors processes. This presentation will provide an overview of ongoing activities, and will address how the projects will evolve to meet new space initiatives.

Earthdata User Interface Patterns: Building Usable Web Interfaces Through a Shared UI Pattern Library

NASA Astrophysics Data System (ADS)

Siarto, J.

2014-12-01

As more Earth science software tools and services move to the web--the design and usability of those tools become ever more important. A good user interface is becoming expected and users are becoming increasingly intolerant of websites and web applications that work against them. The Earthdata UI Pattern Library attempts to give these scientists and developers the design tools they need to make usable, compelling user interfaces without the associated overhead of using a full design team. Patterns are tested and functional user interface elements targeted specifically at the Earth science community and will include web layouts, buttons, tables, typography, iconography, mapping and visualization/graphing widgets. These UI elements have emerged as the result of extensive user testing, research and software development within the NASA Earthdata team over the past year.

Evaluating the Usability of a Professional Modeling Tool Repurposed for Middle School Learning

ERIC Educational Resources Information Center

Peters, Vanessa L.; Songer, Nancy Butler

2013-01-01

This paper reports the results of a three-stage usability test of a modeling tool designed to support learners' deep understanding of the impacts of climate change on ecosystems. The design process involved repurposing an existing modeling technology used by professional scientists into a learning tool specifically designed for middle school…

Digital Resource Exchange About Music (DREAM): Phase 2 Usability Testing

ERIC Educational Resources Information Center

Upitis, Rena; Boese, Karen; Abrami, Philip C.; Anwar, Zaeem

2015-01-01

The Digital Resource Exchange About Music (DREAM) is a virtual space for exchanging information about digital learning tools. The purpose of the present study was to determine how users responded to DREAM in the first four months after its public release. This study is the second phase of usability research on DREAM, and was conducted to guide…

Usability Tests in CALL Development: Pilot Studies in the Context of the Dire autrement and Francotoile Projects

ERIC Educational Resources Information Center

Hamel, Marie-Josee; Caws, Catherine

2010-01-01

This article discusses CALL development from both educational and ergonomic perspectives. It focuses on the learner-task-tool interaction, in particular on the aspects contributing to its overall quality, herein called "usability." Two pilot studies are described that were carried out with intermediate to advanced learners of French in two…

User-Centered Innovation: A Model for "Early Usability Testing."

ERIC Educational Resources Information Center

Sugar, William A.; Boling, Elizabeth

The goal of this study is to show how some concepts and techniques from disciplines outside Instructional Systems Development (ISD) have the potential to extend and enhance the traditional view of ISD practice when they are employed very early in the ISD process. The concepts and techniques employed were user-centered in design and usability, and…

Testing the Usability of a Portable DVD Player and Tailored Photo Instructions with Older Adult Veterans

ERIC Educational Resources Information Center

Gould, Christine E.; Zapata, Aimee Marie L.; Shinsky, Deanna N.; Goldstein, Mary K.

2018-01-01

DVD-delivered behavioral skills training may help disseminate efficacious treatments to older adults independent of internet access. The present study examined the usability of a portable DVD player alongside iterative revisions of accompanying instructions to be used by older adults in a DVD-delivered behavioral skills treatment study. The sample…

The Impact of Findability on Student Motivation, Self-Efficacy, and Perceptions of Online Course Quality

ERIC Educational Resources Information Center

Simunich, Bethany; Robins, David B.; Kelly, Valerie

2015-01-01

This study investigated whether "findability," an aspect of usability, is an important component in student perceptions of/satisfaction with online courses and, as such, should be considered more heavily in online course design. Using standard usability testing measures, such as eye-tracking, time-on-task, and think-alouds, participants…

An appraisal of published usability evaluations of electronic health records via systematic review.

PubMed

Ellsworth, Marc A; Dziadzko, Mikhail; O'Horo, John C; Farrell, Ann M; Zhang, Jiajie; Herasevich, Vitaly

2017-01-01

In this systematic review, we aimed to evaluate methodological and reporting trends present in the current literature by investigating published usability studies of electronic health records (EHRs). A literature search was conducted for articles published through January 2015 using MEDLINE (Ovid), EMBASE, Scopus, and Web of Science, supplemented by citation and reference list reviews. Studies were included if they tested the usability of hospital and clinic EHR systems in the inpatient, outpatient, emergency department, or operating room setting. A total of 4848 references were identified for title and abstract screening. Full text screening was performed for 197 articles, with 120 meeting the criteria for study inclusion. A review of the literature demonstrates a paucity of quality published studies describing scientifically valid and reproducible usability evaluations at various stages of EHR system development. A lack of formal and standardized reporting of EHR usability evaluation results is a major contributor to this knowledge gap, and efforts to improve this deficiency will be one step of moving the field of usability engineering forward. © The Author 2016. Published by Oxford University Press on behalf of the American Medical Informatics Association. All rights reserved. For Permissions, please email: journals.permissions@oup.com.

Harnessing Scientific Literature Reports for Pharmacovigilance

PubMed Central

Ripple, Anna; Tonning, Joseph; Munoz, Monica; Hasan, Rashedul; Ly, Thomas; Francis, Henry; Bodenreider, Olivier

2017-01-01

Summary Objectives We seek to develop a prototype software analytical tool to augment FDA regulatory reviewers’ capacity to harness scientific literature reports in PubMed/MEDLINE for pharmacovigilance and adverse drug event (ADE) safety signal detection. We also aim to gather feedback through usability testing to assess design, performance, and user satisfaction with the tool. Methods A prototype, open source, web-based, software analytical tool generated statistical disproportionality data mining signal scores and dynamic visual analytics for ADE safety signal detection and management. We leveraged Medical Subject Heading (MeSH) indexing terms assigned to published citations in PubMed/MEDLINE to generate candidate drug-adverse event pairs for quantitative data mining. Six FDA regulatory reviewers participated in usability testing by employing the tool as part of their ongoing real-life pharmacovigilance activities to provide subjective feedback on its practical impact, added value, and fitness for use. Results All usability test participants cited the tool’s ease of learning, ease of use, and generation of quantitative ADE safety signals, some of which corresponded to known established adverse drug reactions. Potential concerns included the comparability of the tool’s automated literature search relative to a manual ‘all fields’ PubMed search, missing drugs and adverse event terms, interpretation of signal scores, and integration with existing computer-based analytical tools. Conclusions Usability testing demonstrated that this novel tool can automate the detection of ADE safety signals from published literature reports. Various mitigation strategies are described to foster improvements in design, productivity, and end user satisfaction. PMID:28326432

Comparison of Brief Summary Formats Through a Health Literacy Lens.

PubMed

Sharp, Michele L; Hall, Lori; Eleftherion, Anthony; Simpson, Katherine; Neuhauser, Linda

2018-01-01

Print pharmaceutical advertisements in the United States require inclusion of a brief summary of side effects, warnings, precautions, and contraindications from the labeling. The full package insert, which sponsors have traditionally used to fulfill the brief summary requirement, does not adhere to health literacy best practices, limiting its value to consumers. This study compared the understandability and usability of brief summaries in 3 formats designed to be more consumer friendly. Three brief summary formats were tested: (1) 2-column "Question and Answer"; (2) "Prescription Drug Facts Box," similar to current US over-the-counter drug facts labeling; and (3) "Health Literacy," based on clear communication principles. Researchers evaluated the formats using the Suitability Assessment of Materials (SAM) tool and conducted structured, scripted, one-on-one interviews (usability tests) with participants with estimated low to average education levels. This research was replicated across 2 therapeutic areas (type 2 diabetes and plaque psoriasis). SAM scores showed that the Health Literacy format outperformed the Question and Answer format and the Prescription Drug Facts Box format in both therapeutic areas, with both Health Literacy brief summaries rated on the SAM as "superior." Qualitative usability tests supported the SAM findings, with the Health Literacy format preferred consistently over the Question and Answer format, and more often than not over the Prescription Drug Facts Box format. Sponsors can employ a user-tested Health Literacy format to improve the understandability and usability of brief summaries with patients.

SacLab: A toolbox for saccade analysis to increase usability of eye tracking systems in clinical ophthalmology practice.

PubMed

Cercenelli, Laura; Tiberi, Guido; Corazza, Ivan; Giannaccare, Giuseppe; Fresina, Michela; Marcelli, Emanuela

2017-01-01

Many open source software packages have been recently developed to expand the usability of eye tracking systems to study oculomotor behavior, but none of these is specifically designed to encompass all the main functions required for creating eye tracking tests and for providing the automatic analysis of saccadic eye movements. The aim of this study is to introduce SacLab, an intuitive, freely-available MATLAB toolbox based on Graphical User Interfaces (GUIs) that we have developed to increase the usability of the ViewPoint EyeTracker (Arrington Research, Scottsdale, AZ, USA) in clinical ophthalmology practice. SacLab consists of four processing modules that enable the user to easily create visual stimuli tests (Test Designer), record saccadic eye movements (Data Recorder), analyze the recorded data to automatically extract saccadic parameters of clinical interest (Data Analyzer) and provide an aggregate analysis from multiple eye movements recordings (Saccade Analyzer), without requiring any programming effort by the user. A demo application of SacLab to carry out eye tracking tests for the analysis of horizontal saccades was reported. We tested the usability of SacLab toolbox with three ophthalmologists who had no programming experience; the ophthalmologists were briefly trained in the use of SacLab GUIs and were asked to perform the demo application. The toolbox gained an enthusiastic feedback from all the clinicians in terms of intuitiveness, ease of use and flexibility. Test creation and data processing were accomplished in 52±21s and 46±19s, respectively, using the SacLab GUIs. SacLab may represent a useful tool to ease the application of the ViewPoint EyeTracker system in clinical routine in ophthalmology. Copyright © 2016 Elsevier Ltd. All rights reserved.

TEAMS (Tele-Exercise and Multiple Sclerosis), a Tailored Telerehabilitation mHealth App: Participant-Centered Development and Usability Study

PubMed Central

Rimmer, James H; Johnson, George; Wilroy, Jereme; Young, Hui-Ju; Mehta, Tapan; Lai, Byron

2018-01-01

Background People with multiple sclerosis face varying levels of disability and symptoms, thus requiring highly trained therapists and/or exercise trainers to design personalized exercise programs. However, for people living in geographically isolated communities, access to such trained professionals can be challenging due to a number of barriers associated with cost, access to transportation, and travel distance. Generic mobile health exercise apps often fall short of what people with multiple sclerosis need to become physically active (ie, exercise content that has been adapted to accommodate a wide range of functional limitations). Objective This usability study describes the development process of the TEAMS (Tele-Exercise and Multiple Sclerosis) app, which is being used by people with multiple sclerosis in a large randomized controlled trial to engage in home-based telerehabilitation. Methods Twenty-one participants with disabilities (10 people with multiple sclerosis) were involved in the double iterative design, which included the simultaneous development of the app features and exercise content (exercise videos and articles). Framed within a user-centered design approach, the development process included 2 stages: ground-level creation (focus group followed by early stage evaluations and developments), and proof of concept through 2 usability tests. Usability (effectiveness, usefulness, and satisfaction) was evaluated using a mixed-methods approach. Results During testing of the app’s effectiveness, the second usability test resulted in an average of 1 problem per participant, a decrease of 53% compared to the initial usability test. Five themes were constructed from the qualitative data that related to app usefulness and satisfaction, namely: high perceived confidence for app usability, positive perceptions of exercise videos, viable exercise option at home, orientation and familiarity required for successful participation, and app issues. Participants acknowledged that the final app was ready to be delivered to the public after minor revisions. After including these revisions, the project team released the final app that is being used in the randomized controlled trial. Conclusions A multi-level user-centered development process resulted in the development of an inclusive exercise program for people with multiple sclerosis operated through an easy-to-use app. The promotion of exercise through self-regulated mHealth programs requires a stakeholder-driven approach to app development. This ensures that app and content match the preferences and functional abilities of the end user (ie, people with varying levels of multiple sclerosis). PMID:29798832

TEAMS (Tele-Exercise and Multiple Sclerosis), a Tailored Telerehabilitation mHealth App: Participant-Centered Development and Usability Study.

PubMed

Thirumalai, Mohanraj; Rimmer, James H; Johnson, George; Wilroy, Jereme; Young, Hui-Ju; Mehta, Tapan; Lai, Byron

2018-05-24

People with multiple sclerosis face varying levels of disability and symptoms, thus requiring highly trained therapists and/or exercise trainers to design personalized exercise programs. However, for people living in geographically isolated communities, access to such trained professionals can be challenging due to a number of barriers associated with cost, access to transportation, and travel distance. Generic mobile health exercise apps often fall short of what people with multiple sclerosis need to become physically active (ie, exercise content that has been adapted to accommodate a wide range of functional limitations). This usability study describes the development process of the TEAMS (Tele-Exercise and Multiple Sclerosis) app, which is being used by people with multiple sclerosis in a large randomized controlled trial to engage in home-based telerehabilitation. Twenty-one participants with disabilities (10 people with multiple sclerosis) were involved in the double iterative design, which included the simultaneous development of the app features and exercise content (exercise videos and articles). Framed within a user-centered design approach, the development process included 2 stages: ground-level creation (focus group followed by early stage evaluations and developments), and proof of concept through 2 usability tests. Usability (effectiveness, usefulness, and satisfaction) was evaluated using a mixed-methods approach. During testing of the app's effectiveness, the second usability test resulted in an average of 1 problem per participant, a decrease of 53% compared to the initial usability test. Five themes were constructed from the qualitative data that related to app usefulness and satisfaction, namely: high perceived confidence for app usability, positive perceptions of exercise videos, viable exercise option at home, orientation and familiarity required for successful participation, and app issues. Participants acknowledged that the final app was ready to be delivered to the public after minor revisions. After including these revisions, the project team released the final app that is being used in the randomized controlled trial. A multi-level user-centered development process resulted in the development of an inclusive exercise program for people with multiple sclerosis operated through an easy-to-use app. The promotion of exercise through self-regulated mHealth programs requires a stakeholder-driven approach to app development. This ensures that app and content match the preferences and functional abilities of the end user (ie, people with varying levels of multiple sclerosis). ©Mohanraj Thirumalai, James H Rimmer, George Johnson, Jereme Wilroy, Hui-Ju Young, Tapan Mehta, Byron Lai. Originally published in JMIR Mhealth and Uhealth (http://mhealth.jmir.org), 24.05.2018.

Measurement of Usability for Multimedia Interactive Learning Based on Website in Mathematics for SMK

NASA Astrophysics Data System (ADS)

Sukardjo, Moch.; Sugiyanta, Lipur

2018-04-01

Web usability, if evaluation done correctly, can significantly improve the quality of the website. Website containing multimedia for education shoud apply user interfaces that are both easy to learn and easy to use. Multimedia has big role in changing the mindset of a person in learning. Using multimedia, learners get easy to obtain information, adjust information and empower information. Therefore, multimedia is utilized by teachers in developing learning techniques to improve student learning outcomes. For students with self-directed learning, multimedia provides the ease and completeness of the courses in such a way that students can complete the learning independently both at school and at home without the guidance of teachers. The learning independence takes place in how students choose, absorb information, and follow the evaluation quickly and efficiently. The 2013 Curriculum 2013 for Vocational High School (SMK) requires teachers to create engaging teaching and learning activities that students enjoy in the classroom (also called invitation learning environment). The creation of learning activity environment is still problem for most teachers. Various researches reveal that teaching and learning activities will be more effective and easy when assisted by visual tools. Using multimedia, learning material can be presented more attractively that help students understand the material easily. The opposite is found in the learning activity environment who only rely on ordinary lectures. Usability is a quality level of multimedia with easy to learn, easy to use and encourages users to use it. The website Multimedia Interactive Learning for Mathematics SMK Class X is targeted object. Usability website in Multimedia Interactive Learning for Mathematics SMK Class X is important indicators to measure effectiveness, efficiency, and student satisfaction to access the functionality of website. This usability measurement should be done carefully before the design is implemented thoroughly. The only way to get test with high quality results is to start testing at the beginning of the design process and continuously testing each of the next steps. This research performs usability testing on of website by using WAMMI criterion (Website Analysis and Measurement Inventory) and will be focused on how convenience using the website application. Components of Attractiveness, Controllability, Efficiency, Helpfulness, and Learnability are applied. The website in Multimedia Interactive Learning for Mathematics SMK Class X can be in accordance with the purpose to be accepted by student to improve student learning outcomes. The results show that WAMMI method show the usability value of Multimedia Mathematics SMK Class X is about from 70% to 90%.

Usability evaluation and adaptation of the e-health Personal Patient Profile-Prostate decision aid for Spanish-speaking Latino men.

PubMed

Berry, Donna L; Halpenny, Barbara; Bosco, Jaclyn L F; Bruyere, John; Sanda, Martin G

2015-07-24

The Personal Patient Profile-Prostate (P3P), a web-based decision aid, was demonstrated to reduce decisional conflict in English-speaking men with localized prostate cancer early after initial diagnosis. The purpose of this study was to explore and enhance usability and cultural appropriateness of a Spanish P3P by Latino men with a diagnosis of prostate cancer. P3P was translated to Spanish and back-translated by three native Spanish-speaking translators working independently. Spanish-speaking Latino men with a diagnosis of localized prostate cancer, who had made treatment decisions in the past 24 months, were recruited from two urban clinical care sites. Individual cognitive interviews were conducted by two bilingual research assistants as each participant used the Spanish P3P. Notes of user behavior, feedback, and answers to direct questions about comprehension, usability and perceived usefulness were analyzed and categorized. Seven participants with a range of education levels identified 25 unique usability issues in navigation, content comprehension and completeness, sociocultural appropriateness, and methodology. Revisions were prioritized to refine the usability and cultural and linguistic appropriateness of the decision aid. Usability issues were discovered that are potential barriers to effective decision support. Successful use of decision aids requires adaptation and testing beyond translation. Our findings led to revisions further refining the usability and linguistic and cultural appropriateness of Spanish P3P.

Mixed methods evaluation of a quality improvement and audit tool for nurse-to-nurse bedside clinical handover in ward settings.

PubMed

Redley, Bernice; Waugh, Rachael

2018-04-01

Nurse bedside handover quality is influenced by complex interactions related to the content, processes used and the work environment. Audit tools are seldom tested in 'real' settings. Examine the reliability, validity and usability of a quality improvement tool for audit of nurse bedside handover. Naturalistic, descriptive, mixed-methods. Six inpatient wards at a single large not-for-profit private health service in Victoria, Australia. Five nurse experts and 104 nurses involved in 199 change-of-shift bedside handovers. A focus group with experts and pilot test were used to examine content and face validity, and usability of the handover audit tool. The tool was examined for inter-rater reliability and usability using observation audits of handovers across six wards. Data were collected in 2013-2014. Two independent observers for 72 audits demonstrated acceptable inter-observer agreement for 27 (77%) items. Reliability was weak for items examining the handover environment. Seventeen items were not observed reflecting gaps in practices. Across 199 observation audits, gaps in nurse bedside handover practice most often related to process and environment, rather than content items. Usability was impacted by high observer burden, familiarity and non-specific illustrative behaviours. The reliability and validity of most items to audit handover content was acceptable. Gaps in practices for process and environment items were identified. Context specific exemplars and reducing the items used at each handover audit can enhance usability. Further research is needed to develop context specific exemplars and undertake additional reliability testing using a wide range of handover settings. CONTRIBUTION OF THE PAPER. Copyright © 2017 Elsevier Inc. All rights reserved.

Evaluating authentication options for mobile health applications in younger and older adults

PubMed Central

Khan, Hassan; Hengartner, Urs; Ong, Stephanie; Logan, Alexander G.; Vogel, Daniel; Gebotys, Robert; Yang, Jilan

2018-01-01

Objective Apps promoting patient self-management may improve health outcomes. However, methods to secure stored information on mobile devices may adversely affect usability. We tested the reliability and usability of common user authentication techniques in younger and older adults. Methodology Usability testing was conducted in two age groups, 18 to 30 years and 50 years and older. After completing a demographic questionnaire, each participant tested four authentication options in random order: four-digit personal identification number (PIN), graphical password (GRAPHICAL), Android pattern-lock (PATTERN), and a swipe-style Android fingerprint scanner (FINGERPRINT). Participants rated each option using the Systems Usability Scale (SUS). Results A total of 59 older and 43 younger participants completed the study. Overall, PATTERN was the fastest option (3.44s), and PIN had the fewest errors per attempt (0.02). Participants were able to login using PIN, PATTERN, and GRAPHICAL at least 98% of the time. FINGERPRINT was the slowest (26.97s), had an average of 1.46 errors per attempt, and had a successful login rate of 85%. Overall, PIN and PATTERN had higher SUS scores than FINGERPRINT and GRAPHICAL. Compared to younger participants, older participants were also less likely to find PATTERN to be tiring, annoying or time consuming and less likely to consider PIN to be time consuming. Younger participants were more likely to rate GRAPHICAL as annoying, time consuming and tiring than older participants. Conclusions On mobile devices, PIN and pattern-lock outperformed graphical passwords and swipe-style fingerprints. All participants took longer to authenticate using the swipe-style fingerprint compared to other options. Older participants also took two to three seconds longer to authenticate using the PIN, pattern and graphical passwords though this did not appear to affect perceived usability. PMID:29300736

Evaluating authentication options for mobile health applications in younger and older adults.

PubMed

Grindrod, Kelly; Khan, Hassan; Hengartner, Urs; Ong, Stephanie; Logan, Alexander G; Vogel, Daniel; Gebotys, Robert; Yang, Jilan

2018-01-01

Apps promoting patient self-management may improve health outcomes. However, methods to secure stored information on mobile devices may adversely affect usability. We tested the reliability and usability of common user authentication techniques in younger and older adults. Usability testing was conducted in two age groups, 18 to 30 years and 50 years and older. After completing a demographic questionnaire, each participant tested four authentication options in random order: four-digit personal identification number (PIN), graphical password (GRAPHICAL), Android pattern-lock (PATTERN), and a swipe-style Android fingerprint scanner (FINGERPRINT). Participants rated each option using the Systems Usability Scale (SUS). A total of 59 older and 43 younger participants completed the study. Overall, PATTERN was the fastest option (3.44s), and PIN had the fewest errors per attempt (0.02). Participants were able to login using PIN, PATTERN, and GRAPHICAL at least 98% of the time. FINGERPRINT was the slowest (26.97s), had an average of 1.46 errors per attempt, and had a successful login rate of 85%. Overall, PIN and PATTERN had higher SUS scores than FINGERPRINT and GRAPHICAL. Compared to younger participants, older participants were also less likely to find PATTERN to be tiring, annoying or time consuming and less likely to consider PIN to be time consuming. Younger participants were more likely to rate GRAPHICAL as annoying, time consuming and tiring than older participants. On mobile devices, PIN and pattern-lock outperformed graphical passwords and swipe-style fingerprints. All participants took longer to authenticate using the swipe-style fingerprint compared to other options. Older participants also took two to three seconds longer to authenticate using the PIN, pattern and graphical passwords though this did not appear to affect perceived usability.

Robot services for elderly with cognitive impairment: testing usability of graphical user interfaces.

PubMed

Granata, C; Pino, M; Legouverneur, G; Vidal, J-S; Bidaud, P; Rigaud, A-S

2013-01-01

Socially assistive robotics for elderly care is a growing field. However, although robotics has the potential to support elderly in daily tasks by offering specific services, the development of usable interfaces is still a challenge. Since several factors such as age or disease-related changes in perceptual or cognitive abilities and familiarity with computer technologies influence technology use they must be considered when designing interfaces for these users. This paper presents findings from usability testing of two different services provided by a social assistive robot intended for elderly with cognitive impairment: a grocery shopping list and an agenda application. The main goal of this study is to identify the usability problems of the robot interface for target end-users as well as to isolate the human factors that affect the use of the technology by elderly. Socio-demographic characteristics and computer experience were examined as factors that could have an influence on task performance. A group of 11 elderly persons with Mild Cognitive Impairment and a group of 11 cognitively healthy elderly individuals took part in this study. Performance measures (task completion time and number of errors) were collected. Cognitive profile, age and computer experience were found to impact task performance. Participants with cognitive impairment achieved the tasks committing more errors than cognitively healthy elderly. Instead younger participants and those with previous computer experience were faster at completing the tasks confirming previous findings in the literature. The overall results suggested that interfaces and contents of the services assessed were usable by older adults with cognitive impairment. However, some usability problems were identified and should be addressed to better meet the needs and capacities of target end-users.

Developing an Android-Based Patient Decision Aid Based on Ottawa Standards for Patients After Kidney Transplant and Its Usability Evaluation.

PubMed

Zare Moayedi, Mahboobeh; Aslani, Azam; Fakhrahmad, Mostafa; Ezzatzadegan J, Shahrokh

2018-01-01

This study was conducted to develop an android based patient decision aid (PDA) as a self-care instrument for patients after kidney transplant and its usability evaluation. In this study, the systematic development process of Android-based self-care application for patients after kidney transplant based on Ottawa standard was included: scoping, assemble steering group, analysis of requirements, designing, develop of a prototype and system evaluation. The PDA is a self-triage system that will help early identification of risk symptoms in patients, and help manage them. System recommendations for risk signs are: Refer to the nearest hospital or healthcare center without delay, refer to the doctor and tell your doctor in the next visit. To identify patient care needs, a semi-structured interview with members of steering group, including patients and clinical experts, was conducted by the researchers. A prototype of the decision aid was made according to identified needs in the previous step. Finally, in order to evaluate its usability rate by using the System Usability Scale (SUS) questionnaire, it was used by exerts and patients. This study identified information needs, risk signs and steps that patients need to make appropriate decisions about them. The main capabilities of the decision aid are features such as reminders for appointment/test, time of taking medication, registration of symptoms, weight, blood pressure, body temperature, advising to patient in case of signs of risk, weight, blood pressure, body temperature and test results which were reported in the diagram. The mean score of system's usability evaluated by medical informatics specialists, clinicians, and patients were 88.33, 95, and 91. PDAs was usable and desirable from the point of view of medical informatics specialists, clinicians and patients.

From expert-derived user needs to user-perceived ease of use and usefulness: a two-phase mixed-methods evaluation framework.

PubMed

Boland, Mary Regina; Rusanov, Alexander; So, Yat; Lopez-Jimenez, Carlos; Busacca, Linda; Steinman, Richard C; Bakken, Suzanne; Bigger, J Thomas; Weng, Chunhua

2014-12-01

Underspecified user needs and frequent lack of a gold standard reference are typical barriers to technology evaluation. To address this problem, this paper presents a two-phase evaluation framework involving usability experts (phase 1) and end-users (phase 2). In phase 1, a cross-system functionality alignment between expert-derived user needs and system functions was performed to inform the choice of "the best available" comparison system to enable a cognitive walkthrough in phase 1 and a comparative effectiveness evaluation in phase 2. During phase 2, five quantitative and qualitative evaluation methods are mixed to assess usability: time-motion analysis, software log, questionnaires - System Usability Scale and the Unified Theory of Acceptance of Use of Technology, think-aloud protocols, and unstructured interviews. Each method contributes data for a unique measure (e.g., time motion analysis contributes task-completion-time; software log contributes action transition frequency). The measures are triangulated to yield complementary insights regarding user-perceived ease-of-use, functionality integration, anxiety during use, and workflow impact. To illustrate its use, we applied this framework in a formative evaluation of a software called Integrated Model for Patient Care and Clinical Trials (IMPACT). We conclude that this mixed-methods evaluation framework enables an integrated assessment of user needs satisfaction and user-perceived usefulness and usability of a novel design. This evaluation framework effectively bridges the gap between co-evolving user needs and technology designs during iterative prototyping and is particularly useful when it is difficult for users to articulate their needs for technology support due to the lack of a baseline. Copyright © 2013 Elsevier Inc. All rights reserved.

Validating a Web-based Diabetes Education Program in continuing nursing education: knowledge and competency change and user perceptions on usability and quality

PubMed Central

2014-01-01

Background Nurses as the members of health care professionals need to improve their knowledge and competencies particularly in diabetes mellitus through continuing nursing education programs. E-learning is an indirect method of training that can meet nurses’ educational needs. This study is aimed at validating a web-based diabetes education program through measurement of nurses’ knowledge and clinical competency in diabetes and nurses’ perception about its usability and quality. Methods This Quasi-experimental research was conducted on a single group of 31 nurses employed in hospitals affiliated with Shiraz University of Medical Sciences. We used a 125 MCQ knowledge test and Objective Structured Clinical Exam (OSCE) to measure knowledge and clinical competency of nurses in diabetes before and after intervention. A Learning Management System (LMS) was designed to provide educational content in the form of 12 multimedia electronic modules, interactive tests; a forum and learning activities. Nurses were trained for two months in this system after which the post-test was administered. Each nurse completed two questionnaires for measurement of their perceptions on usability and quality. We used descriptive statistics for demographic and descriptive data analysis. Paired t-test was used to compare pre- and post-data using SPSS. Results The findings showed significant differences in knowledge scores (p < 0.001), total score of clinical competencies (p < 0.001), and all ten assessed clinical competencies. The range of ratings given by participants varied on the six usability variables of Web-based training (2.96-4.23 from 5) and eight quality variables of Web-based training (3.58-4.37 from 5). Conclusion Web-based education increased nurses’ knowledge and competencies in diabetes. They positively evaluated Web-based learning usability and quality. It is hoped that this course will have a positive clinical outcomes. PMID:26086025

Validating a Web-based Diabetes Education Program in continuing nursing education: knowledge and competency change and user perceptions on usability and quality.

PubMed

Moattari, Marzieh; Moosavinasab, Elham; Dabbaghmanesh, Mohammad Hossein; ZarifSanaiey, Nahid

2014-01-01

Nurses as the members of health care professionals need to improve their knowledge and competencies particularly in diabetes mellitus through continuing nursing education programs. E-learning is an indirect method of training that can meet nurses' educational needs. This study is aimed at validating a web-based diabetes education program through measurement of nurses' knowledge and clinical competency in diabetes and nurses' perception about its usability and quality. This Quasi-experimental research was conducted on a single group of 31 nurses employed in hospitals affiliated with Shiraz University of Medical Sciences. We used a 125 MCQ knowledge test and Objective Structured Clinical Exam (OSCE) to measure knowledge and clinical competency of nurses in diabetes before and after intervention. A Learning Management System (LMS) was designed to provide educational content in the form of 12 multimedia electronic modules, interactive tests; a forum and learning activities. Nurses were trained for two months in this system after which the post-test was administered. Each nurse completed two questionnaires for measurement of their perceptions on usability and quality. We used descriptive statistics for demographic and descriptive data analysis. Paired t-test was used to compare pre- and post-data using SPSS. The findings showed significant differences in knowledge scores (p < 0.001), total score of clinical competencies (p < 0.001), and all ten assessed clinical competencies. The range of ratings given by participants varied on the six usability variables of Web-based training (2.96-4.23 from 5) and eight quality variables of Web-based training (3.58-4.37 from 5). Web-based education increased nurses' knowledge and competencies in diabetes. They positively evaluated Web-based learning usability and quality. It is hoped that this course will have a positive clinical outcomes.

Knowledge translation of the HELPinKIDS clinical practice guideline for managing childhood vaccination pain: usability and knowledge uptake of educational materials directed to new parents.

PubMed

Taddio, Anna; Shah, Vibhuti; Leung, Eman; Wang, Jane; Parikh, Chaitya; Smart, Sarah; Hetherington, Ross; Ipp, Moshe; Riddell, Rebecca Pillai; Sgro, Michael; Jovicic, Aleksandra; Franck, Linda

2013-02-08

Although numerous evidence-based and feasible interventions are available to treat pain from childhood vaccine injections, evidence indicates that children are not benefitting from this knowledge. Unrelieved vaccination pain puts children at risk for significant long-term harms including the development of needle fears and subsequent health care avoidance behaviours. Parents report that while they want to mitigate vaccination pain in their children, they lack knowledge about how to do so. An evidence-based clinical practice guideline for managing vaccination pain was recently developed in order to address this knowledge-to-care gap. Educational tools (pamphlet and video) for parents were included to facilitate knowledge transfer at the point of care. The objectives of this study were to evaluate usability and effectiveness in terms of knowledge acquisition from the pamphlet and video in parents of newly born infants. Mixed methods design. Following heuristic usability evaluation of the pamphlet and video, parents of newborn infants reviewed revised versions of both tools and participated in individual and group interviews and individual knowledge testing. The knowledge test comprised of 10 true/false questions about the effectiveness of various pain management interventions, and was administered at three time points: at baseline, after review of the pamphlet, and after review of the video. Three overarching themes were identified from the interviews regarding usability of these educational tools: receptivity to learning, accessibility to information, and validity of information. Parents' performance on the knowledge test improved (p≤0.001) from the baseline phase to after review of the pamphlet, and again from the pamphlet review phase to after review of the video. Using a robust testing process, we demonstrated usability and conceptual knowledge acquisition from a parent-directed educational pamphlet and video about management of vaccination pain. Future studies are planned to determine the impact of these educational tools when introduced in clinical settings on parent behaviors during infant vaccinations.

The Accessibility and Usability of College Websites: Is Your Website Presenting Barriers to Potential Students?

ERIC Educational Resources Information Center

Erickson, William; Trerise, Sharon; Lee, Camille; VanLooy, Sara; Knowlton, Samuel; Bruyère, Susanne

2013-01-01

Thirty community college websites were evaluated for compliance with federal web accessibility standards found in Section 508 of the Rehabilitation Act of 1973 (29 U.S.C. 794d). Two typical sites were tested for usability by individuals with visual impairments, individuals with reading-related learning disabilities (LD), and a control group of…

Does Your Library's Web Site Pass the Usability Test? Online Treasures

ERIC Educational Resources Information Center

Balas, Janet L.

2005-01-01

In days that seem very long ago, when the card catalog was the only way to search a library's collection, there was very little debate about the usability of the catalog. Librarians were most concerned about properly formatting catalog cards and, of course, ensuring that the cards were filed correctly. Today, the card catalog has been replaced in…

Design and evaluation of a software prototype for participatory planning of environmental adaptations.

PubMed

Eriksson, J; Ek, A; Johansson, G

2000-03-01

A software prototype to support the planning process for adapting home and work environments for people with physical disabilities was designed and later evaluated. The prototype exploits low-cost three-dimensional (3-D) graphics products in the home computer market. The essential features of the prototype are: interactive rendering with optional hardware acceleration, interactive walk-throughs, direct manipulation tools for moving objects and measuring distances, and import of 3-D-objects from a library. A usability study was conducted, consisting of two test sessions (three weeks apart) and a final interview. The prototype was then tested and evaluated by representatives of future users: five occupational therapist students, and four persons with physical disability, with no previous experience of the prototype. Emphasis in the usability study was placed on the prototype's efficiency and learnability. We found that it is possible to realise a planning tool for environmental adaptations, both regarding usability and technical efficiency. The usability evaluation confirms our findings from previous case studies, regarding the relevance and positive attitude towards this kind of planning tool. Although the prototype was found to be satisfactorily efficient for the basic tasks, the paper presents several suggestions for improvement of future prototype versions.

Location-based social networking media for restaurant promotion and food review using mobile application

NASA Astrophysics Data System (ADS)

Luhur, H. S.; Widjaja, N. D.

2014-03-01

This paper is focusing on the development of a mobile application for searching restaurants and promotions with location based and social networking features. The main function of the application is to search restaurant information. Other functions are also available in this application such as add restaurant, add promotion, add photo, add food review, and other features including social networking features. The restaurant and promotion searching application will be developed under Android platform. Upon completion of this paper, heuristic evaluation and usability testing have been conducted. The result of both testing shows that the application is highly usable. Even though there are some usability problems discovered, the problems can be eliminated immediately by implementing the recommendations from the expert evaluators and the users as the testers of the application. Further improvement made to the application will ensure that the application can really be beneficial for the users of the application.

Cognitive Analysis of Decision Support for Antibiotic Prescribing at the Point of Ordering in a Neonatal Intensive Care Unit

PubMed Central

Sheehan, Barbara; Kaufman, David; Stetson, Peter; Currie, Leanne M.

2009-01-01

Computerized decision support systems have been used to help ensure safe medication prescribing. However, the acceptance of these types of decision support has been reported to be low. It has been suggested that decreased acceptance may be due to lack of clinical relevance. Additionally, cognitive fit between the user interface and clinical task may impact the response of clinicians as they interact with the system. In order to better understand clinician responses to such decision support, we used cognitive task analysis methods to evaluate clinical alerts for antibiotic prescribing in a neonatal intensive care unit. Two methods were used: 1) a cognitive walkthrough; and 2) usability testing with a ‘think-aloud’ protocol. Data were analyzed for impact on cognitive effort according to categories of cognitive distance. We found that responses to alerts may be context specific and that lack of screen cues often increases cognitive effort required to use a system. PMID:20351922

A health literacy and usability heuristic evaluation of a mobile consumer health application.

PubMed

Monkman, Helen; Kushniruk, Andre

2013-01-01

Usability and health literacy are two critical factors in the design and evaluation of consumer health information systems. However, methods for evaluating these two factors in conjunction remain limited. This study adapted a set of existing guidelines for the design of consumer health Web sites into evidence-based evaluation heuristics tailored specifically for mobile consumer health applications. In order to test the approach, a mobile consumer health application (app) was then evaluated using these heuristics. In addition to revealing ways to improve the usability of the system, this analysis identified opportunities to augment the content to make it more understandable by users with limited health literacy. This study successfully demonstrated the utility of converting existing design guidelines into heuristics for the evaluation of usability and health literacy. The heuristics generated could be applied for assessing and revising other existing consumer health information systems.

Usability Testing for e-Resource Discovery: How Students Find and Choose e-Resources Using Library Web Sites

ERIC Educational Resources Information Center

Fry, Amy; Rich, Linda

2011-01-01

In early 2010, library staff at Bowling Green State University (BGSU) in Ohio designed and conducted a usability study of key parts of the library web site, focusing on the web pages generated by the library's electronic resources management system (ERM) that list and describe the library's databases. The goal was to discover how users find and…

An online network tool for quality information to answer questions about occupational safety and health: usability and applicability.

PubMed

Rhebergen, Martijn D F; Hulshof, Carel T J; Lenderink, Annet F; van Dijk, Frank J H

2010-10-22

Common information facilities do not always provide the quality information needed to answer questions on health or health-related issues, such as Occupational Safety and Health (OSH) matters. Barriers may be the accessibility, quantity and readability of information. Online Question & Answer (Q&A) network tools, which link questioners directly to experts can overcome some of these barriers. When designing and testing online tools, assessing the usability and applicability is essential. Therefore, the purpose of this study is to assess the usability and applicability of a new online Q&A network tool for answers on OSH questions. We applied a cross-sectional usability test design. Eight occupational health experts and twelve potential questioners from the working population (workers) were purposively selected to include a variety of computer- and internet-experiences. During the test, participants were first observed while executing eight tasks that entailed important features of the tool. In addition, they were interviewed. Through task observations and interviews we assessed applicability, usability (effectiveness, efficiency and satisfaction) and facilitators and barriers in use. Most features were usable, though several could be improved. Most tasks were executed effectively. Some tasks, for example searching stored questions in categories, were not executed efficiently and participants were less satisfied with the corresponding features. Participants' recommendations led to improvements. The tool was found mostly applicable for additional information, to observe new OSH trends and to improve contact between OSH experts and workers. Hosting and support by a trustworthy professional organization, effective implementation campaigns, timely answering and anonymity were seen as important use requirements. This network tool is a promising new strategy for offering company workers high quality information to answer OSH questions. Q&A network tools can be an addition to existing information facilities in the field of OSH, but also to other healthcare fields struggling with how to answer questions from people in practice with high quality information. In the near future, we will focus on the use of the tool and its effects on information and knowledge dissemination.

Development and validation of a remote home safety protocol.

PubMed

Romero, Sergio; Lee, Mi Jung; Simic, Ivana; Levy, Charles; Sanford, Jon

2018-02-01

Environmental assessments and subsequent modifications conducted by healthcare professionals can enhance home safety and promote independent living. However, travel time, expense and the availability of qualified professionals can limit the broad application of this intervention. Remote technology has the potential to increase access to home safety evaluations. This study describes the development and validation of a remote home safety protocol that can be used by a caregiver of an elderly person to video-record their home environment for later viewing and evaluation by a trained professional. The protocol was developed based on literature reviews and evaluations from clinical and content experts. Cognitive interviews were conducted with a group of six caregivers to validate the protocol. The final protocol included step-by-step directions to record indoor and outdoor areas of the home. The validation process resulted in modifications related to safety, clarity of the protocol, readability, visual appearance, technical descriptions and usability. Our final protocol includes detailed instructions that a caregiver should be able to follow to record a home environment for subsequent evaluation by a home safety professional. Implications for Rehabilitation The results of this study have several implications for rehabilitation practice The remote home safety evaluation protocol can potentially improve access to rehabilitation services for clients in remote areas and prevent unnecessary delays for needed care. Using our protocol, a patient's caregiver can partner with therapists to quickly and efficiently evaluate a patient's home before they are released from the hospital. Caregiver narration, which reflects a caregiver's own perspective, is critical to evaluating home safety. In-home safety evaluations, currently not available to all who need them due to access barriers, can enhance a patient's independence and provide a safer home environment.

Virtual Sliding QWERTY: A new text entry method for smartwatches using Tap-N-Drag.

PubMed

Cha, Jae-Min; Choi, Eunjung; Lim, Jihyoun

2015-11-01

A smaller screen of smartwatches compare to conventional mobile devices such as PDAs and smartphones is one of the main factors that makes users to input texts difficult. However, several studies have only proposed a concept for entering texts for smartwatches without usability tests while other studies showed low text input performance. In this study, we proposed a new text entry method called Virtual Sliding QWERTY (VSQ) which utilizes a virtual qwerty-layout keyboard and a 'Tap-N-Drag' method to move the keyboard to the desired position. In addition, to verify VSQ we conducted a usability test with 20 participants for a combination of 5 key sizes and 4 CD-gains. As a result, VSQ achieved an average of 11.9 Words per Minute which was higher than previous studies. In particular, VSQ at 5 × 5 key size and 2×, or 3× CD-gain had the highest performance in terms of the quantitative and qualitative usability test. Copyright © 2015 Elsevier Ltd and The Ergonomics Society. All rights reserved.

Experiences with establishing and implementing learning management system and computer-based test system in medical college.

PubMed

Park, Joo Hyun; Son, Ji Young; Kim, Sun

2012-09-01

The purpose of this study was to establish an e-learning system to support learning in medical education and identify solutions for improving the system. A learning management system (LMS) and computer-based test (CBT) system were established to support e-learning for medical students. A survey of 219 first- and second-grade medical students was administered. The questionnaire included 9 forced choice questions about the usability of system and 2 open-ended questions about necessary improvements to the system. The LMS consisted of a class management, class evaluation, and class attendance system. CBT consisted of a test management, item bank, and authoring tool system. The results of the survey showed a high level of satisfaction in all system usability items except for stability. Further, the advantages of the e-learning system were ensuring information accessibility, providing constant feedback, and designing an intuitive interface. Necessary improvements to the system were stability, user control, readability, and diverse device usage. Based on the findings, suggestions for developing an e-learning system to improve usability by medical students and support learning effectively are recommended.

The Development of Delta: Using Agile to Develop a Decision Aid for Pediatric Oncology Clinical Trial Enrollment.

PubMed

Robertson, Eden G; Wakefield, Claire E; Cohn, Richard J; O'Brien, Tracey; Ziegler, David S; Fardell, Joanna E

2018-05-04

The internet is increasingly being used to disseminate health information. Given the complexity of pediatric oncology clinical trials, we developed Delta, a Web-based decision aid to support families deciding whether or not to enroll their child with cancer in a clinical trial. This paper details the Agile development process of Delta and user testing results of Delta. Development was iterative and involved 5 main stages: a requirements analysis, planning, design, development, and user testing. For user testing, we conducted 13 eye-tracking analyses and think-aloud interviews with health care professionals (n=6) and parents (n=7). Results suggested that there was minimal rereading of content and a high level of engagement in content. However, there were some navigational problems. Participants reported high acceptability (12/13) and high usability of the website (8/13). Delta demonstrates the utility for the use of Agile in the development of a Web-based decision aid for health purposes. Our study provides a clear step-by-step guide to develop a Web-based psychosocial tool within the health setting. ©Eden G Robertson, Claire E Wakefield, Richard J Cohn, Tracey O'Brien, David S Ziegler, Joanna E Fardell. Originally published in JMIR Research Protocols (http://www.researchprotocols.org), 04.05.2018.

Chemistry in Bioinformatics

PubMed Central

Murray-Rust, Peter; Mitchell, John BO; Rzepa, Henry S

2005-01-01

Chemical information is now seen as critical for most areas of life sciences. But unlike Bioinformatics, where data is openly available and freely re-usable, most chemical information is closed and cannot be re-distributed without permission. This has led to a failure to adopt modern informatics and software techniques and therefore paucity of chemistry in bioinformatics. New technology, however, offers the hope of making chemical data (compounds and properties) free during the authoring process. We argue that the technology is already available; we require a collective agreement to enhance publication protocols. PMID:15941476

Mims electron-nuclear double resonance in LiYF4:Ce3+ crystal

NASA Astrophysics Data System (ADS)

Gafurov, M.; Mamin, G.; Kurkin, I.; Orlinskii, S.

2018-05-01

We report the observation of the pulsed electron-nuclear double resonance (ENDOR) spectra from 19F and 7Li nuclei on impurity Ce3+ ions in LiYF4 crystal. The resolved structure from the nearby and remote nuclei in spectra is observed. The outcome shows that LiYF4:Ce3+ system can be exploited as a convenient matrix for performing spin manipulations and adjusting quantum computation protocols while ENDOR technique is usable for the investigation of electron-nuclear interaction with all the nuclei of the system.

A Secure Mobile-Based Authentication System for e-Banking

NASA Astrophysics Data System (ADS)

Rifà-Pous, Helena

Financial information is extremely sensitive. Hence, electronic banking must provide a robust system to authenticate its customers and let them access their data remotely. On the other hand, such system must be usable, affordable, and portable. We propose a challenge-response based one-time password (OTP) scheme that uses symmetric cryptography in combination with a hardware security module. The proposed protocol safeguards passwords from keyloggers and phishing attacks. Besides, this solution provides convenient mobility for users who want to bank online anytime and anywhere, not just from their own trusted computers.

language and Adjustment Scales for the Thematic Apperception Test for Children 6-11 Years.

PubMed

Neman, R S; Brown, T S; Sells, S B

1973-12-01

This report summarizes research on the development of objectively scored language and emotionality scales for a five-card, orally administered and tape- reqorded version of the Thematic Apperception Test (TAT) used in the Health Examination Survey (HES) of children conducted by the National Center for Health Statistics in 1963-65. National norms for children ages 6-11 are presented for these scales. Two studies were carried out to develop the scales and national norms. Study I involved the development of scoring manuals, criterion measures, and TAT scales, as well as validation studies in which the TAT scales were treated as independent variables and the criteria as dependent variables. In that study major emphasis was placed on creation of usable scales. The sample of 1,224 cases employed was chosen on the basis of completeness and quality of TAT protocol from among the children examined in the first 19 of the 40 Iocations or "stands" in which examinations took place in the national survey. All material appearing in this report is in the public domain and may be reproduced or copied without permission; citation as to source, however, is appreciated.

Validation of the COURAGE Built Environment Self-Reported Questionnaire.

PubMed

Raggi, Alberto; Quintas, Rui; Bucciarelli, Paola; Franco, Maria Grazia; Andreotti, Alessandra; Miret, Marta; Zawisza, Katarzyna; Olaya, Beatriz; Chatterji, Somnath; Sainio, Päivi; Frisoni, Giovanni Battista; Martinuzzi, Andrea; Minicuci, Nadia; Power, Mick; Leonardi, Matilde

2014-01-01

The built environment (BE) impacts on people's disability and health, in terms of overweight, depression, alcohol abuse, poor self-rated health and presence of psychological symptoms; it is reasonable to assume that BE also impacts on participation levels. This paper presents the validation of the COURAGE Built Environment Self-Reported Questionnaire (CBE-SR), an instrument designed to evaluate BE in the context of health and disability. Subjects participating to COURAGE, a cross-sectional study conducted on 10,800 citizens of Poland, Finland and Spain, completed a protocol inclusive of the CBE-SR. Psychometric properties and factor structure were analysed, and factor scores created. Gender differences, differences between persons from different age groups and persons reporting the environment as facilitating, hindering or neutral were calculated. Eight items were deleted so that the final version of CBE-SR comprises 19 items. Cronbach's alpha ranged from 0.743 to 0.906, and test-retest stability was demonstrated for the majority of items. Four subscales were identified: Usability of the neighbourhood environment; Hindrance of walkable environment; Easiness of use of public buildings, places and facilities; and Risk of accidents and usability of the living place. Younger respondents reported their neighbourhood as more usable but perceived walkways as more hindering and public buildings as less easy to use; gender differences were almost inexistent. The CBE-SR is a four-scale instrument with good psychometric properties that measures the person-environment interaction. It is sensitive across age groups and is consistent with the subject's overall judgement of the degree to which the environment is facilitating or hindering. Poor built environments have a negative impact on the level of a person's participation. However, instruments measuring the person-environment interaction are lacking. The CBE-SR is a valid and reliable instrument that researchers can use to assess the relationships between the intrinsic health state and the objective features of the environment. Understanding this relationship would provide further insight into the need of addressing the individual's functioning either by means of interventions directed to the individual or by making changes to the individual's environment. Copyright © 2013 John Wiley & Sons, Ltd.

Three-Dimensional Dosimetric Validation of a Magnetic Resonance Guided Intensity Modulated Radiation Therapy System

DOE Office of Scientific and Technical Information (OSTI.GOV)

Rankine, Leith J., E-mail: Leith_Rankine@med.unc.edu; Department of Radiation Oncology, The University of North Carolina at Chapel Hill, Chapel Hill, North Carolina; Mein, Stewart

Purpose: To validate the dosimetric accuracy of a commercially available magnetic resonance guided intensity modulated radiation therapy (MRgIMRT) system using a hybrid approach: 3-dimensional (3D) measurements and Monte Carlo calculations. Methods and Materials: We used PRESAGE radiochromic plastic dosimeters with remote optical computed tomography readout to perform 3D high-resolution measurements, following a novel remote dosimetry protocol. We followed the intensity modulated radiation therapy commissioning recommendations of American Association of Physicists in Medicine Task Group 119, adapted to incorporate 3D data. Preliminary tests (“AP” and “3D-Bands”) were delivered to 9.5-cm usable diameter cylindrical PRESAGE dosimeters to validate the treatment planning systemmore » (TPS) for nonmodulated deliveries; assess the sensitivity, uniformity, and rotational symmetry of the PRESAGE dosimeters; and test the robustness of the remote dosimetry protocol. Following this, 4 clinical MRgIMRT plans (“MultiTarget,” “Prostate,” “Head/Neck,” and “C-Shape”) were measured using 13-cm usable diameter PRESAGE dosimeters. For all plans, 3D-γ (3% or 3 mm global, 10% threshold) passing rates were calculated and 3D-γ maps were examined. Point doses were measured with an IBA-CC01 ionization chamber for validation of absolute dose. Finally, by use of an in-house-developed, GPU-accelerated Monte Carlo algorithm (gPENELOPE), we independently calculated dose for all 6 Task Group 119 plans and compared against the TPS. Results: For PRESAGE measurements, 3D-γ analysis yielded passing rates of 98.7%, 99.2%, 98.5%, 98.0%, 99.2%, and 90.7% for AP, 3D-Bands, MultiTarget, Prostate, Head/Neck, and C-Shape, respectively. Ion chamber measurements were within an average of 0.5% (±1.1%) from the TPS dose. Monte Carlo calculations demonstrated good agreement with the TPS, with a mean 3D-γ passing rate of 98.5% ± 1.9% using a stricter 2%/2-mm criterion. Conclusions: We have validated the dosimetric accuracy of a commercial MRgIMRT system using high-resolution 3D techniques. We have demonstrated for the first time that hybrid 3D remote dosimetry is a comprehensive and feasible approach to commissioning MRgIMRT. This may provide better sensitivity in error detection compared with standard 2-dimensional measurements and could be used when implementing complex new magnetic resonance guided radiation therapy technologies.« less

App Chronic Disease Checklist: Protocol to Evaluate Mobile Apps for Chronic Disease Self-Management.

PubMed

Anderson, Kevin; Burford, Oksana; Emmerton, Lynne

2016-11-04

The availability of mobile health apps for self-care continues to increase. While little evidence of their clinical impact has been published, there is general agreement among health authorities and authors that consumers' use of health apps assist in self-management and potentially clinical decision making. A consumer's sustained engagement with a health app is dependent on the usability and functionality of the app. While numerous studies have attempted to evaluate health apps, there is a paucity of published methods that adequately recognize client experiences in the academic evaluation of apps for chronic conditions. This paper reports (1) a protocol to shortlist health apps for academic evaluation, (2) synthesis of a checklist to screen health apps for quality and reliability, and (3) a proposed method to theoretically evaluate usability of health apps, with a view towards identifying one or more apps suitable for clinical assessment. A Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) flow diagram was developed to guide the selection of the apps to be assessed. The screening checklist was thematically synthesized with reference to recurring constructs in published checklists and related materials for the assessment of health apps. The checklist was evaluated by the authors for face and construct validity. The proposed method for evaluation of health apps required the design of procedures for raters of apps, dummy data entry to test the apps, and analysis of raters' scores. The PRISMA flow diagram comprises 5 steps: filtering of duplicate apps; eliminating non-English apps; removing apps requiring purchase, filtering apps not updated within the past year; and separation of apps into their core functionality. The screening checklist to evaluate the selected apps was named the App Chronic Disease Checklist, and comprises 4 sections with 6 questions in each section. The validity check verified classification of, and ambiguity in, wording of questions within constructs. The proposed method to evaluate shortlisted and downloaded apps comprises instructions to attempt set-up of a dummy user profile, and dummy data entry to represent in-range and out-of-range clinical measures simulating a range of user behaviors. A minimum score of 80% by consensus (using the Intraclass Correlation Coefficient) between raters is proposed to identify apps suitable for clinical trials. The flow diagram allows researchers to shortlist health apps that are potentially suitable for formal evaluation. The evaluation checklist enables quantitative comparison of shortlisted apps based on constructs reported in the literature. The use of multiple raters, and comparison of their scores, is proposed to manage inherent subjectivity in assessing user experiences. Initial trial of the combined protocol is planned for apps pertaining to the self-monitoring of asthma; these results will be reported elsewhere. ©Kevin Anderson, Oksana Burford, Lynne Emmerton. Originally published in JMIR Research Protocols (http://www.researchprotocols.org), 04.11.2016.

Development and Testing of a Multidimensional iPhone Pain Assessment Application for Adolescents with Cancer

PubMed Central

Jibb, Lindsay A; Nguyen, Cynthia; Nathan, Paul C; Maloney, Anne Marie; Dupuis, L Lee; Gerstle, J Ted; Alman, Benjamin; Hopyan, Sevan; Strahlendorf, Caron; Portwine, Carol; Johnston, Donna L; Orr, Mike

2013-01-01

Background Pain is one of the most common and distressing symptoms reported by adolescents with cancer. Despite advancements in pain assessment and management research, pain due to cancer and/or its treatments continues to be poorly managed. Our research group has developed a native iPhone application (app) called Pain Squad to tackle the problem of poorly managed pain in the adolescent with cancer group. The app functions as an electronic pain diary and is unique in its ability to collect data on pain intensity, duration, location, and the impact pain has on an adolescent’s life (ie, relationships, school work, sleep, mood). It also evaluates medications and other physical and psychological pain management strategies used. Users are prompted twice daily at configurable times to complete 20 questions characterizing their pain and the app transmits results to a database for aggregate reporting through a Web interface. Each diary entry represents a pain case filed by an adolescent with cancer and a reward system (ie, moving up through law-enforcement team ranks, built-in videotaped acknowledgements from fictitious officers) encourages consistent use of the diary. Objective Our objective was to design, develop, and test the usability, feasibility, compliance, and satisfaction of a game-based smartphone pain assessment tool for adolescents with cancer. Methods We used both low- and high-fidelity qualitative usability testing with qualitative semi-structured, audio-taped interviews and iterative cycles to design and refine the iPhone based Pain Squad app. Qualitative thematic analysis of interviews using constant comparative methodology captured emergent themes related to app usability. Content validity was assessed using question importance-rating surveys completed by participants. Compliance and satisfaction data were collected following a 2-week feasibility trial where users were alarmed to record their pain twice daily on the app. Results Thematic analysis of usability interviews showed the app to be appealing overall to adolescents. Analyses of both low- and high-fidelity testing resulted in minor revisions to the app to refine the theme and improve its usability. Adolescents resoundingly endorsed the game-based nature of the app and its virtual reward system. The importance of app pain diary questions was established by content validity analysis. Compliance with the app, assessed during feasibility testing, was high (mean 81%, SD 22%) and adolescents from this phase of the study found the app likeable, easy to use, and not bothersome to complete. Conclusions A multifaceted usability approach demonstrated how the Pain Squad app could be made more appealing to children and adolescents with cancer. The game-based nature and built-in reward system of the app was appealing to adolescents and may have resulted in the high compliance rates and satisfaction ratings observed during clinical feasibility testing. PMID:23475457

Development and testing of a multidimensional iPhone pain assessment application for adolescents with cancer.

PubMed

Stinson, Jennifer N; Jibb, Lindsay A; Nguyen, Cynthia; Nathan, Paul C; Maloney, Anne Marie; Dupuis, L Lee; Gerstle, J Ted; Alman, Benjamin; Hopyan, Sevan; Strahlendorf, Caron; Portwine, Carol; Johnston, Donna L; Orr, Mike

2013-03-08

Pain is one of the most common and distressing symptoms reported by adolescents with cancer. Despite advancements in pain assessment and management research, pain due to cancer and/or its treatments continues to be poorly managed. Our research group has developed a native iPhone application (app) called Pain Squad to tackle the problem of poorly managed pain in the adolescent with cancer group. The app functions as an electronic pain diary and is unique in its ability to collect data on pain intensity, duration, location, and the impact pain has on an adolescent's life (ie, relationships, school work, sleep, mood). It also evaluates medications and other physical and psychological pain management strategies used. Users are prompted twice daily at configurable times to complete 20 questions characterizing their pain and the app transmits results to a database for aggregate reporting through a Web interface. Each diary entry represents a pain case filed by an adolescent with cancer and a reward system (ie, moving up through law-enforcement team ranks, built-in videotaped acknowledgements from fictitious officers) encourages consistent use of the diary. Our objective was to design, develop, and test the usability, feasibility, compliance, and satisfaction of a game-based smartphone pain assessment tool for adolescents with cancer. We used both low- and high-fidelity qualitative usability testing with qualitative semi-structured, audio-taped interviews and iterative cycles to design and refine the iPhone based Pain Squad app. Qualitative thematic analysis of interviews using constant comparative methodology captured emergent themes related to app usability. Content validity was assessed using question importance-rating surveys completed by participants. Compliance and satisfaction data were collected following a 2-week feasibility trial where users were alarmed to record their pain twice daily on the app. Thematic analysis of usability interviews showed the app to be appealing overall to adolescents. Analyses of both low- and high-fidelity testing resulted in minor revisions to the app to refine the theme and improve its usability. Adolescents resoundingly endorsed the game-based nature of the app and its virtual reward system. The importance of app pain diary questions was established by content validity analysis. Compliance with the app, assessed during feasibility testing, was high (mean 81%, SD 22%) and adolescents from this phase of the study found the app likeable, easy to use, and not bothersome to complete. A multifaceted usability approach demonstrated how the Pain Squad app could be made more appealing to children and adolescents with cancer. The game-based nature and built-in reward system of the app was appealing to adolescents and may have resulted in the high compliance rates and satisfaction ratings observed during clinical feasibility testing.

Usability test of a hand exoskeleton for activities of daily living: an example of user-centered design.

PubMed

Almenara, Maria; Cempini, Marco; Gómez, Cristina; Cortese, Mario; Martín, Cristina; Medina, Josep; Vitiello, Nicola; Opisso, Eloy

2017-01-01

(1) To assess a robotic device (Handexos) during the design process with regard to usability, end user satisfaction and safety, (2) to determine whether Handexos can improve the activities of daily living (ADLs) of spinal cord injury (SCI) patients and stroke patients with upper-limb dysfunction. During a 2-year development stage of the device, a total of 37 participants (aged 22-68), 28 clinicians (experts) and nine patients with SCI or stroke (end users) were included in a user-centered design process featuring usability tests. They performed five grasps wearing the device. The assessments were obtained at the end of the session by filling out a questionnaire and making suggestions. The experts' opinion was that the modified device was an improvement over the preliminary version, although this was not reflected in the scores. Whereas end user scores for comfort, grasp, performance and safety were above the sufficiency threshold, the scores for year 2 were lower than those for year 1. The findings demonstrate that although Handexos meets the initial functional requirements and underlines the potential for assisting SCI and post-stroke subjects in ADLs, several aspects such as mechanical complexity and low adaptability to different hand sizes need to be further addressed. Implications for Rehabilitation Wearable robotics devices could improve the activities of daily living in patients with spinal cord injury or stroke. They could be a tool for rehabilitation of the upper limb. Further usability tests to improve this type of tools are recommended.

Back to the Bedside: Developing a Bedside Aid for Concussion and Brain Injury Decisions in the Emergency Department

PubMed Central

Melnick, Edward R.; Lopez, Kevin; Hess, Erik P.; Abujarad, Fuad; Brandt, Cynthia A.; Shiffman, Richard N.; Post, Lori A.

2015-01-01

Context: Current information-rich electronic health record (EHR) interfaces require large, high-resolution screens running on desktop computers. This interface compromises the provider’s already limited time at the bedside by physically separating the patient from the doctor. The case study presented here describes a patient-centered clinical decision support (CDS) design process that aims to bring the physician back to the bedside by integrating a patient decision aid with CDS for shared use by the patient and provider on a touchscreen tablet computer for deciding whether or not to obtain a CT scan for minor head injury in the emergency department, a clinical scenario that could benefit from CDS but has failed previous implementation attempts. Case Description: This case study follows the user-centered design (UCD) approach to build a bedside aid that is useful and usable, and that promotes shared decision-making between patients and their providers using a tablet computer at the bedside. The patient-centered decision support design process focuses on the prototype build using agile software development, but also describes the following: (1) the requirement gathering phase including triangulated qualitative research (focus groups and cognitive task analysis) to understand current challenges, (2) features for patient education, the physician, and shared decision-making, (3) system architecture and technical requirements, and (4) future plans for formative usability testing and field testing. Lessons Learned: We share specific lessons learned and general recommendations from critical insights gained in the patient-centered decision support design process about early stakeholder engagement, EHR integration, external expert feedback, challenges to two users on a single device, project management, and accessibility. Conclusions: Successful implementation of this tool will require seamless integration into the provider’s workflow. This protocol can create an effective interface for shared decision-making and safe resource reduction at the bedside in the austere and dynamic clinical environment of the ED and is generalizable for these purposes in other clinical environments as well. PMID:26290885

Back to the Bedside: Developing a Bedside Aid for Concussion and Brain Injury Decisions in the Emergency Department.

PubMed

Melnick, Edward R; Lopez, Kevin; Hess, Erik P; Abujarad, Fuad; Brandt, Cynthia A; Shiffman, Richard N; Post, Lori A

2015-01-01

Current information-rich electronic health record (EHR) interfaces require large, high-resolution screens running on desktop computers. This interface compromises the provider's already limited time at the bedside by physically separating the patient from the doctor. The case study presented here describes a patient-centered clinical decision support (CDS) design process that aims to bring the physician back to the bedside by integrating a patient decision aid with CDS for shared use by the patient and provider on a touchscreen tablet computer for deciding whether or not to obtain a CT scan for minor head injury in the emergency department, a clinical scenario that could benefit from CDS but has failed previous implementation attempts. This case study follows the user-centered design (UCD) approach to build a bedside aid that is useful and usable, and that promotes shared decision-making between patients and their providers using a tablet computer at the bedside. The patient-centered decision support design process focuses on the prototype build using agile software development, but also describes the following: (1) the requirement gathering phase including triangulated qualitative research (focus groups and cognitive task analysis) to understand current challenges, (2) features for patient education, the physician, and shared decision-making, (3) system architecture and technical requirements, and (4) future plans for formative usability testing and field testing. We share specific lessons learned and general recommendations from critical insights gained in the patient-centered decision support design process about early stakeholder engagement, EHR integration, external expert feedback, challenges to two users on a single device, project management, and accessibility. Successful implementation of this tool will require seamless integration into the provider's workflow. This protocol can create an effective interface for shared decision-making and safe resource reduction at the bedside in the austere and dynamic clinical environment of the ED and is generalizable for these purposes in other clinical environments as well.

A Clinical Reasoning Tool for Virtual Patients: Design-Based Research Study.

PubMed

Hege, Inga; Kononowicz, Andrzej A; Adler, Martin

2017-11-02

Clinical reasoning is a fundamental process medical students have to learn during and after medical school. Virtual patients (VP) are a technology-enhanced learning method to teach clinical reasoning. However, VP systems do not exploit their full potential concerning the clinical reasoning process; for example, most systems focus on the outcome and less on the process of clinical reasoning. Keeping our concept grounded in a former qualitative study, we aimed to design and implement a tool to enhance VPs with activities and feedback, which specifically foster the acquisition of clinical reasoning skills. We designed the tool by translating elements of a conceptual clinical reasoning learning framework into software requirements. The resulting clinical reasoning tool enables learners to build their patient's illness script as a concept map when they are working on a VP scenario. The student's map is compared with the experts' reasoning at each stage of the VP, which is technically enabled by using Medical Subject Headings, which is a comprehensive controlled vocabulary published by the US National Library of Medicine. The tool is implemented using Web technologies, has an open architecture that enables its integration into various systems through an open application program interface, and is available under a Massachusetts Institute of Technology license. We conducted usability tests following a think-aloud protocol and a pilot field study with maps created by 64 medical students. The results show that learners interact with the tool but create less nodes and connections in the concept map than an expert. Further research and usability tests are required to analyze the reasons. The presented tool is a versatile, systematically developed software component that specifically supports the clinical reasoning skills acquisition. It can be plugged into VP systems or used as stand-alone software in other teaching scenarios. The modular design allows an extension with new feedback mechanisms and learning analytics algorithms. ©Inga Hege, Andrzej A Kononowicz, Martin Adler. Originally published in JMIR Medical Education (http://mededu.jmir.org), 02.11.2017.

mPneumonia: Development of an Innovative mHealth Application for Diagnosing and Treating Childhood Pneumonia and Other Childhood Illnesses in Low-Resource Settings

PubMed Central

Ginsburg, Amy Sarah; Delarosa, Jaclyn; Brunette, Waylon; Levari, Shahar; Sundt, Mitch; Larson, Clarice; Tawiah Agyemang, Charlotte; Newton, Sam; Borriello, Gaetano; Anderson, Richard

2015-01-01

Pneumonia is the leading infectious cause of death in children worldwide. Each year, pneumonia kills an estimated 935,000 children under five years of age, with most of these deaths occurring in developing countries. The current approach for pneumonia diagnosis in low-resource settings—using the World Health Organization Integrated Management of Childhood Illness (IMCI) paper-based protocols and relying on a health care provider’s ability to manually count respiratory rate—has proven inadequate. Furthermore, hypoxemia—a diagnostic indicator of the presence and severity of pneumonia often associated with an increased risk of death—is not assessed because pulse oximetry is frequently not available in low-resource settings. In an effort to address childhood pneumonia mortality and improve frontline health care providers’ ability to diagnose, classify, and manage pneumonia and other childhood illnesses, PATH collaborated with the University of Washington to develop “mPneumonia,” an innovative mobile health application using an Android tablet. mPneumonia integrates a digital version of the IMCI algorithm with a software-based breath counter and a pediatric pulse oximeter. We conducted a design-stage usability field test of mPneumonia in Ghana, with the goal of creating a user-friendly diagnostic and management tool for childhood pneumonia and other childhood illnesses that would improve diagnostic accuracy and facilitate adherence by health care providers to established guidelines in low-resource settings. The results of the field test provided valuable information for understanding the usability and acceptability of mPneumonia among health care providers, and identifying approaches to iterate and improve. This critical feedback helped ascertain the common failure modes related to the user interface design, navigation, and accessibility of mPneumonia and the modifications required to improve user experience and create a tool aimed at decreasing mortality from pneumonia and other childhood illnesses in low-resource settings. PMID:26474321

Engaging Community Stakeholders to Evaluate the Design, Usability, and Acceptability of a Chronic Obstructive Pulmonary Disease Social Media Resource Center

PubMed Central

Chaney, Beth; Chaney, Don; Paige, Samantha; Payne-Purvis, Caroline; Tennant, Bethany; Walsh-Childers, Kim; Sriram, PS; Alber, Julia

2015-01-01

Background Patients with chronic obstructive pulmonary disease (COPD) often report inadequate access to comprehensive patient education resources. Objective The purpose of this study was to incorporate community-engagement principles within a mixed-method research design to evaluate the usability and acceptability of a self-tailored social media resource center for medically underserved patients with COPD. Methods A multiphase sequential design (qual → QUANT → quant + QUAL) was incorporated into the current study, whereby a small-scale qualitative (qual) study informed the design of a social media website prototype that was tested with patients during a computer-based usability study (QUANT). To identify usability violations and determine whether or not patients found the website prototype acceptable for use, each patient was asked to complete an 18-item website usability and acceptability questionnaire, as well as a retrospective, in-depth, semistructured interview (quant + QUAL). Results The majority of medically underserved patients with COPD (n=8, mean 56 years, SD 7) found the social media website prototype to be easy to navigate and relevant to their self-management information needs. Mean responses on the 18-item website usability and acceptability questionnaire were very high on a scale of 1 (strongly disagree) to 5 (strongly agree) (mean 4.72, SD 0.33). However, the majority of patients identified several usability violations related to the prototype’s information design, interactive capabilities, and navigational structure. Specifically, 6 out of 8 (75%) patients struggled to create a log-in account to access the prototype, and 7 out of 8 patients (88%) experienced difficulty posting and replying to comments on an interactive discussion forum. Conclusions Patient perceptions of most social media website prototype features (eg, clickable picture-based screenshots of videos, comment tools) were largely positive. Mixed-method stakeholder feedback was used to make design recommendations, categorize usability violations, and prioritize potential solutions for improving the usability of a social media resource center for COPD patient education. PMID:25630449

The Superorbital Expansion Tube concept, experiment and analysis

NASA Technical Reports Server (NTRS)

Neely, A. J.; Morgan, R. G.

1995-01-01

In response to the need for ground testing facilities for super orbital re-entry research, a small scale facility has been set up at the University of Queensland to demonstrate the superorbital expansion tube concept. This unique device is a free piston driven, triple diaphragm, impulse shock facility which uses the enthalpy multiplication mechanism of the unsteady expansion process and the addition of a secondary shock driver to further heat the driver gas. The pilot facility has been operated to produce quasi-steady test flows in air with shock velocities in excess of 13 km/s and with a usable test flow duration of the order of 15 micro sec. an experimental condition produced in the facility with total enthalpy of 108 MJ/kg and a total pressure of 335 MPa is reported. A simple analytical flow model which accounts for non-ideal rupture of the light tertiary diaphragm and the resulting entropy increase in the test gas is discussed. It is shown that equilibrium calculations more accurately model the unsteady expansion process than calculations assuming frozen chemistry. This is because the high enthalpy flows produced in the facility can only be achieved if the chemical energy stored in the test flow during shock heating of the test gas is partially returned to the flow during the process of unsteady expansion. Measurements of heat transfer rates to a flat plate demonstrate the usability of test flow for aerothermodynamic testing and comparison of these rates with empirical calculations confirms the usable accuracy of the flow model.

Development of an interactive social media tool for parents with concerns about vaccines.

PubMed

Shoup, Jo Ann; Wagner, Nicole M; Kraus, Courtney R; Narwaney, Komal J; Goddard, Kristin S; Glanz, Jason M

2015-06-01

Describe a process for designing, building, and evaluating a theory-driven social media intervention tool to help reduce parental concerns about vaccination. We developed an interactive web-based tool using quantitative and qualitative methods (e.g., survey, focus groups, individual interviews, and usability testing). Survey results suggested that social media may represent an effective intervention tool to help parents make informed decisions about vaccination for their children. Focus groups and interviews revealed four main themes for development of the tool: Parents wanted information describing both benefits and risks of vaccination, transparency of sources of information, moderation of the tool by an expert, and ethnic and racial diversity in the visual display of people. Usability testing showed that parents were satisfied with the usability of the tool but had difficulty with performing some of the informational searches. Based on focus groups, interviews, and usability evaluations, we made additional revisions to the tool's content, design, functionality, and overall look and feel. Engaging parents at all stages of development is critical when designing a tool to address concerns about childhood vaccines. Although this can be both resource- and time-intensive, the redesigned tool is more likely to be accepted and used by parents. Next steps involve a formal evaluation through a randomized trial. © 2014 Society for Public Health Education.

A fast stimulability screening protocol for neuronal cultures on microelectrode arrays.

PubMed

Kapucu, Fikret E; Tanskanen, Jarno M A; Yuan, Yuting; Hyttinen, Jari A K

2015-01-01

Microelectrode arrays (MEAs) are used to study the electrical activity in brain slices and neuronal cultures. MEA experiments for the analysis of electrical stimulation responses require the tissue or culture to be prone to stimulation. For brain slices, potential stimulation sites may be directly visible in microscope, in which case the determination of stimulability at those locations is sufficient. In unstructured neuronal cultures, potential stimulation sites may not be known a priori, and spatial stimulability screening should be performed. Considering, e.g., 59 microelectrode sites, each to be stimulated several times, may result in long screening times, unacceptable with a MEA system without an integrated CO2 incubator, or in high stimulation effects on the networks. Here, we describe an implementation of a fast stimulation protocol employing pseudorandom stimulation site switching aiming at alleviating the network effects of the stimulability screening. In this paper, we show the usability of the proposed protocol by first detecting stimulable locations and subsequently apply repeated stimulation on the identified potentially stimulable locations to observe an exemplary neuronal pathway.

Development and usability testing of a web-based decision support for users and health professionals in psychiatric services.

PubMed

Grim, Katarina; Rosenberg, David; Svedberg, Petra; Schön, Ulla-Karin

2017-09-01

Shared decision making (SMD) related to treatment and rehabilitation is considered a central component in recovery-oriented practice. Although decision aids are regarded as an essential component for successfully implementing SDM, these aids are often lacking within psychiatric services. The aim of this study was to use a participatory design to facilitate the development of a user-generated, web-based decision aid for individuals receiving psychiatric services. The results of this effort as well as the lessons learned during the development and usability processes are reported. The participatory design included 4 iterative cycles of development. Various qualitative methods for data collection were used with potential end users participating as informants in focus group and individual interviews and as usability and pilot testers. Interviewing and testing identified usability problems that then led to refinements and making the subsequent prototypes increasingly user-friendly and relevant. In each phase of the process, feedback from potential end-users provided guidance in developing the formation of the web-based decision aid that strengthens the position of users by integrating access to information regarding alternative supports, interactivity between staff and users, and user preferences as a continual focus in the tool. This web-based decision aid has the potential to strengthen service users' experience of self-efficacy and control as well as provide staff access to user knowledge and preferences. Studies employing participatory models focusing on usability have potential to significantly contribute to the development and implementation of tools that reflect user perspectives. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

An Evaluation of the Design and Usability of a Novel Robotic Bilateral Arm Rehabilitation Device for Patients with Stroke.

PubMed

Pei, Yu-Cheng; Chen, Jean-Lon; Wong, Alice M K; Tseng, Kevin C

2017-01-01

Case series. IV (case series). Robot-assisted therapy for upper limb rehabilitation is an emerging research topic and its design process must integrate engineering, neurological pathophysiology, and clinical needs. This study developed/evaluated the usefulness of a novel rehabilitation device, the MirrorPath , designed for the upper limb rehabilitation of patients with hemiplegic stroke. The process follows Tseng's methodology for innovative product design and development, namely two stages, device development and usability assessment. During the development process, the design was guided by patients' rehabilitation needs as defined by patients and their therapists. The design applied synchronic movement of the bilateral upper limbs, an approach that is compatible with the bilateral movement therapy and proprioceptive neuromuscular facilitation theories. MirrorPath consists of a robotic device that guides upper limb movement linked to a control module containing software controlling the robotic movement. Five healthy subjects were recruited in the pretest, and 4 patients, 4 caregivers, and 4 therapists were recruited in the formal test for usability. All recruited subjects were allocated to the test group, completed the evaluation, and their data were all analyzed. The total system usability scale score obtained from the patients, caregivers, and therapists was 71.8 ± 11.9, indicating a high level of usability and product acceptance. Following a standard development process, we could yield a design that meets clinical needs. This low-cost device provides a feasible platform for carrying out robot-assisted bilateral movement therapy of patients with hemiplegic stroke. identifier NCT02698605.

Usability and Navigability of an HIV/AIDS Internet Intervention for Adolescents in a Resource Limited Setting

PubMed Central

Ybarra, Michele; Biringi, Ruth; Prescott, Tonya; Bull, Sheana S.

2012-01-01

Use of Internet is growing in Sub Saharan Africa. Evidence of computer and Internet effectiveness for reduction in risk behaviors associated with HIV shown in U.S. settings has yet to be replicated in Africa. We describe the development, usability and navigability testing of an Internet-based HIV prevention program for secondary school students in Uganda, called CyberSenga. For this work, we used four data collection activities, including observation of (a) computer skills and (b) navigation, (c) focus group discussions, and (d) field assessments to document comprehension and usability of program content. We document limited skills among students, but youth with basic computers skills were able to navigate the program after instruction. Youth were most interested in activities with more interaction. Field-testing illustrated the importance of using a stand-alone electrical source during program delivery. This work suggests delivery of Internet-based health promotion content in Africa requires attention to user preparedness and literacy, bandwidth, Internet connection, and electricity. PMID:22918136

Facilitating energy savings with programmable thermostats: evaluation and guidelines for the thermostat user interface.

PubMed

Peffer, Therese; Perry, Daniel; Pritoni, Marco; Aragon, Cecilia; Meier, Alan

2013-01-01

Thermostats control heating and cooling in homes - representing a major part of domestic energy use - yet, poor ergonomics of these devices has thwarted efforts to reduce energy consumption. Theoretically, programmable thermostats can reduce energy by 5-15%, but in practice little to no savings compared to manual thermostats are found. Several studies have found that programmable thermostats are not installed properly, are generally misunderstood and have poor usability. After conducting a usability study of programmable thermostats, we reviewed several guidelines from ergonomics, general device usability, computer-human interfaces and building control sources. We analysed the characteristics of thermostats that enabled or hindered successfully completing tasks and in a timely manner. Subjects had higher success rates with thermostat displays with positive examples of guidelines, such as visibility of possible actions, consistency and standards, and feedback. We suggested other guidelines that seemed missing, such as navigation cues, clear hierarchy and simple decision paths. Our evaluation of a usability test of five residential programmable thermostats led to the development of a comprehensive set of specific guidelines for thermostat design including visibility of possible actions, consistency, standards, simple decision paths and clear hierarchy. Improving the usability of thermostats may facilitate energy savings.

Evaluating the Functionality and Usability of Two Novel Wheelchair Anti-Rollback Devices for Ramp Ascent in Manual Wheelchair Users With Spinal Cord Injury.

PubMed

Deems-Dluhy, Susan L; Jayaraman, Chandrasekaran; Green, Steve; Albert, Mark V; Jayaraman, Arun

2017-05-01

Difficulty ascending ramps and inclines with a manual wheelchair adversely affects the everyday mobility and overall quality of life of manual wheelchair users. Currently, various anti-rollback devices are available to assist manual wheelchair users to ascend ramps and inclines. However, these devices have 2 main shortcomings: restriction to backward motion limiting recovery from an overturning wheelchair, which is a safety concern; and difficulty in engaging/disengaging the device while on the ramp. To evaluate the functionality and usability of 2 novel wheelchair anti-rollback devices developed to address these shortcomings (prototypes "Wheel" and "Brake"). Cross-sectional. Rehabilitation research facility. Twelve adult participants with chronic spinal cord injury. Participants completed training and tested with both the wheelchair anti-rollback devices on a 7.3-m-long ramp. Number of stops, perceived physical exertion, pain, and ease of use of these devices as participants maneuvered their wheelchairs up a 7.3-m ramp were assessed. Participants also evaluated their satisfaction with the usability of both the devices using the Quebec User Evaluation of Satisfaction With Assistive Technology (QUEST 2.0). Both prototypes evaluated overcame the limitations of the existing anti-rollback devices. Nonparametric statistical tests showed that participants rated both prototypes similarly for the overall functional and usability aspects. However, the participants' satisfactory rating were higher for the prototype "Brake" than for the prototype "Wheel" based on a functional aspect (ie, engaging/disengaging easiness), and higher for Wheel than for Brake, based on a usability aspect (prototype size). The qualitative and quantitative outcomes of this investigation, based on the usability and functional evaluations, provided useful information for the improvement in the design of both anti-rollback devices, which may allow manual wheelchair users to manage ramp ascent more safely and easily. Further evaluations with a different SCI population is recommended. IV. Copyright © 2017 American Academy of Physical Medicine and Rehabilitation. Published by Elsevier Inc. All rights reserved.

A New Cloud Architecture of Virtual Trusted Platform Modules

NASA Astrophysics Data System (ADS)

Liu, Dongxi; Lee, Jack; Jang, Julian; Nepal, Surya; Zic, John

We propose and implement a cloud architecture of virtual Trusted Platform Modules (TPMs) to improve the usability of TPMs. In this architecture, virtual TPMs can be obtained from the TPM cloud on demand. Hence, the TPM functionality is available for applications that do not have physical TPMs in their local platforms. Moreover, the TPM cloud allows users to access their keys and data in the same virtual TPM even if they move to untrusted platforms. The TPM cloud is easy to access for applications in different languages since cloud computing delivers services in standard protocols. The functionality of the TPM cloud is demonstrated by applying it to implement the Needham-Schroeder public-key protocol for web authentications, such that the strong security provided by TPMs is integrated into high level applications. The chain of trust based on the TPM cloud is discussed and the security properties of the virtual TPMs in the cloud is analyzed.

Knowledge translation of the HELPinKIDS clinical practice guideline for managing childhood vaccination pain: usability and knowledge uptake of educational materials directed to new parents

PubMed Central

2013-01-01

Background Although numerous evidence-based and feasible interventions are available to treat pain from childhood vaccine injections, evidence indicates that children are not benefitting from this knowledge. Unrelieved vaccination pain puts children at risk for significant long-term harms including the development of needle fears and subsequent health care avoidance behaviours. Parents report that while they want to mitigate vaccination pain in their children, they lack knowledge about how to do so. An evidence-based clinical practice guideline for managing vaccination pain was recently developed in order to address this knowledge-to-care gap. Educational tools (pamphlet and video) for parents were included to facilitate knowledge transfer at the point of care. The objectives of this study were to evaluate usability and effectiveness in terms of knowledge acquisition from the pamphlet and video in parents of newly born infants. Methods Mixed methods design. Following heuristic usability evaluation of the pamphlet and video, parents of newborn infants reviewed revised versions of both tools and participated in individual and group interviews and individual knowledge testing. The knowledge test comprised of 10 true/false questions about the effectiveness of various pain management interventions, and was administered at three time points: at baseline, after review of the pamphlet, and after review of the video. Results Three overarching themes were identified from the interviews regarding usability of these educational tools: receptivity to learning, accessibility to information, and validity of information. Parents’ performance on the knowledge test improved (p≤0.001) from the baseline phase to after review of the pamphlet, and again from the pamphlet review phase to after review of the video. Conclusions Using a robust testing process, we demonstrated usability and conceptual knowledge acquisition from a parent-directed educational pamphlet and video about management of vaccination pain. Future studies are planned to determine the impact of these educational tools when introduced in clinical settings on parent behaviors during infant vaccinations. PMID:23394070

Efficacy, Safety, and Usability of Remifentanil as Premedication for INSURE in Preterm Neonates.

PubMed

Audil, Hadiyah Y; Tse, Sara; Pezzano, Chad; Mitchell-van Steele, Amy; Pinheiro, Joaquim M B

2018-05-22

Background : We previously reported a 67% extubation failure with INSURE (Intubation, Surfactant, Extubation) using morphine as analgosedative premedication. Remifentanil, a rapid- and short-acting narcotic, might be ideal for INSURE, but efficacy and safety data for this indication are limited. Objectives : To assess whether remifentanil premedication increases extubation success rates compared with morphine, and to evaluate remifentanil's safety and usability in a teaching hospital context. Methods : Retrospective review of remifentanil orders for premedication, at a large teaching hospital neonatal intensive care unit (NICU). We compared INSURE failure rates (needing invasive ventilation after INSURE) with prior morphine-associated rates. Additionally, we surveyed NICU staff to identify usability and logistic issues with remifentanil. Results : 73 remifentanil doses were administered to 62 neonates (mean 31.6 ± 3.8 weeks' gestation). Extubation was successful in 88%, vs. 33% with morphine premedication ( p < 0.001). Significant adverse events included chest wall rigidity (4%), one case of cardiopulmonary resuscitation (CPR) post-surfactant, naloxone reversal (5%), and notable transient desaturation (34%). Among 137 completed surveys, 57% indicated concerns, including delayed drug availability (median 1.1 h after order), rapid desaturations narrowing intubation timeframes and hindering trainee involvement, and difficulty with bag-mask ventilation after unsuccessful intubation attempts. Accordingly, 33% of ultimate intubators were attending neonatologists, versus 16% trainees. Conclusions : Remifentanil premedication was superior to morphine in allowing successful extubation, despite occasional chest wall rigidity and unfavorable conditions for trainees. We recommend direct supervision and INSURE protocols aimed at ensuring rapid intubation.

A review of principles in design and usability testing of tactile technology for individuals with visual impairments.

PubMed

Horton, Emily L; Renganathan, Ramkesh; Toth, Bryan N; Cohen, Alexa J; Bajcsy, Andrea V; Bateman, Amelia; Jennings, Mathew C; Khattar, Anish; Kuo, Ryan S; Lee, Felix A; Lim, Meilin K; Migasiuk, Laura W; Zhang, Amy; Zhao, Oliver K; Oliveira, Marcio A

2017-01-01

To lay the groundwork for devising, improving, and implementing new technologies to meet the needs of individuals with visual impairments, a systematic literature review was conducted to: a) describe hardware platforms used in assistive devices, b) identify their various applications, and c) summarize practices in user testing conducted with these devices. A search in relevant EBSCO databases for articles published between 1980 and 2014 with terminology related to visual impairment, technology, and tactile sensory adaptation yielded 62 articles that met the inclusion criteria for final review. It was found that while earlier hardware development focused on pin matrices, the emphasis then shifted toward force feedback haptics and accessible touch screens. The inclusion of interactive and multimodal features has become increasingly prevalent. The quantity and consistency of research on navigation, education, and computer accessibility suggest that these are pertinent areas of need for the visually impaired community. Methodologies for usability testing ranged from case studies to larger cross-sectional studies. Many studies used blindfolded sighted users to draw conclusions about design principles and usability. Altogether, the findings presented in this review provide insight on effective design strategies and user testing methodologies for future research on assistive technology for individuals with visual impairments.

Distributed electrochemical sensors: recent advances and barriers to market adoption.

PubMed

Hoekstra, Rafael; Blondeau, Pascal; Andrade, Francisco J

2018-07-01

Despite predictions of their widespread application in healthcare and environmental monitoring, electrochemical sensors are yet to be distributed at scale, instead remaining largely confined to R&D labs. This contrasts sharply with the situation for physical sensors, which are now ubiquitous and seamlessly embedded in the mature ecosystem provided by electronics and connectivity protocols. Although chemical sensors could be integrated into the same ecosystem, there are fundamental issues with these sensors in the three key areas of analytical performance, usability, and affordability. Nevertheless, advances are being made in each of these fields, leading to hope that the deployment of automated and user-friendly low-cost electrochemical sensors is on the horizon. Here, we present a brief survey of key challenges and advances in the development of distributed electrochemical sensors for liquid samples, geared towards applications in healthcare and wellbeing, environmental monitoring, and homeland security. As will be seen, in many cases the analytical performance of the sensor is acceptable; it is usability that is the major barrier to commercial viability at this moment. Were this to be overcome, the issue of affordability could be addressed. Graphical Abstract ᅟ.

Development and evaluation of a mobile AAC: a virtual therapist and speech assistant for people with communication disabilities.

PubMed

Wang, Erh-Hsuan; Zhou, Leming; Chen, Szu-Han Kay; Hill, Katya; Parmanto, Bambang

2017-09-26

The currently existing Augmentative and Alternative Communication (AAC) technologies have limitations to produce the best communication rehabilitation outcomes and therefore a better solution is needed. In this work, a mobile AAC app was developed based on results from research studies. Sophisticated AAC language programming, embedded training materials, and real-time communication performance reporting were integrated into the app. Two groups of study participants were recruited to participate a usability study and a preliminary feasibility study for the purpose of evaluating this mobile AAC app, respectively. A tablet-based AAC app was developed to support communication rehabilitation. User studies of the app were conducted and included able-bodied individuals and people with verbal communication disabilities. All study participants agreed that the app establishes a usable alternative treatment protocol for communication rehabilitation. The app's integrated features have great potential to maximize users' communication effectiveness, enhance language skills, and ultimately improve users' quality of life. Implications for rehabilitation We have developed and evaluated an integrated mobile AAC language-based app. This tablet-based app integrated AAC with embedded trainings and real-time performance report.

Dual trigger of triptorelin and HCG optimizes clinical outcome for high ovarian responder in GnRH-antagonist protocols.

PubMed

Li, Saijiao; Zhou, Danni; Yin, Tailang; Xu, Wangming; Xie, Qingzhen; Cheng, Dan; Yang, Jing

2018-01-12

In this paper, a retrospective cohort study was conducted to the high ovarian responders in GnRH-antagonist protocols of IVF/ICSI cycles. The purpose of the study is to investigate whether dual triggering of final oocyte maturation with a combination of gonadotropin-releasing hormone (GnRH) agonist and human chorionic gonadotropin (HCG) can improve the clinical outcome compared with traditional dose (10000IU) HCG trigger and low-dose (8000IU) HCG trigger for high ovarian responders in GnRH-antagonist in vitro fertilization/intracytoplasmic sperm injection (IVF-ICSI) cycles. Our study included 226 couples with high ovarian responders in GnRH-antagonist protocols of IVF/ICSI cycles. Standard dosage of HCG trigger (10000 IU of recombinant HCG) versus dual trigger (0.2 mg of triptorelin and 2000 IU of recombinant HCG) and low-dose HCG trigger (8000IU of recombinant HCG) were used for final oocyte maturation. Our main outcome measures were high quality embryo rate, the number of usable embryos, the risk of OHSS, duration of hospitalization and incidence rate of complications. Our evidence demonstrated that dual trigger is capable of preventing severe OHSS while still maintaining excellent high quality embryo rate in in high ovarian responders of GnRH-antagonist protocols.

The development of an online decision aid to support persons having a genetic predisposition to cancer and their partners during reproductive decision-making: a usability and pilot study.

PubMed

Reumkens, Kelly; Tummers, Marly H E; Gietel-Habets, Joyce J G; van Kuijk, Sander M J; Aalfs, Cora M; van Asperen, Christi J; Ausems, Margreet G E M; Collée, Margriet; Dommering, Charlotte J; Kets, C Marleen; van der Kolk, Lizet E; Oosterwijk, Jan C; Tjan-Heijnen, Vivianne C G; van der Weijden, Trudy; de Die-Smulders, Christine E M; van Osch, Liesbeth A D M

2018-05-30

An online decision aid to support persons having a genetic predisposition to cancer and their partners during reproductive decision-making was developed. A two-phase usability test was conducted among 12 couples (N = 22; 2 persons participated without their partner) at risk for hereditary cancer and 15 health care providers. Couples and health care providers expressed similar suggestions for improvements, and evaluated the modified decision aid as acceptable, easy to use, and comprehensible. The final decision aid was pilot tested (N = 16) with paired sample t tests comparing main outcomes (decisional conflict, knowledge, realistic expectations regarding the reproductive options and decision self-efficacy) before (T0), immediately (T1) and 2 weeks after (T2) use of the decision aid. Pilot testing indicated decreased decisional conflict scores, increased knowledge, and improved realistic expectations regarding the reproductive options, at T1 and T2. No effect was found for couples' decision self-efficacy. The positive findings during usability testing were thus reflected in the pilot study. The decision aid will be further evaluated in a nationwide pretest-posttest study to facilitate implementation in the onco-genetic counselling setting. Ultimately, it is expected that the decision aid will enable end-users to make an informed decision.

"I think it is right": a qualitative exploration of the acceptability and desired future use of oral swab and finger-prick HIV self-tests by lay users in KwaZulu-Natal, South Africa.

PubMed

Knight, Lucia; Makusha, Tawanda; Lim, Jeanette; Peck, Roger; Taegtmeyer, Miriam; van Rooyen, Heidi

2017-09-18

The uptake of HIV testing has increased in sub-Saharan Africa over the past three decades. However, the proportion of people aware of their HIV status remains lower than required to change the pandemic. HIV self-testing (HIVST) may meet this gap. Assessment of readiness for and the acceptability of HIVST by lay users in South Africa is limited. This paper presents results from a formative study designed to assess the perceived usability and acceptability of HIVST among lay users using several self-test prototypes. Fifty lay users were purposively selected from rural and peri-urban KwaZulu-Natal, South Africa. Acceptability of HIVST was assessed using a simple post-test quantitative assessment tool addressing confidence, ease-of-use, intended future use and willingness to pay. In-depth qualitative interviews explored what participants felt about the HIVST and why, their willingness to recommend and how much they would pay for a test. The key finding is that there is high acceptability regardless of self-test prototype. Acceptability is framed by two domains: usability and perceived need. Perceived usability was explored through perceived ease of use, which, regardless of actual correct usage, was reported by many of the respondents. Acceptability is influenced by perceived need, expressed by many who felt that the need for the self-test to protect privacy and autonomy. Ease of access and widespread availability of the test, not at a significant cost, were also important factors. Many participants would recommend self-test use to others and also indicated that they would choose to conduct the test again if it was free while some also indicated being willing to buy a test. The positive response and readiness amongst lay users for an HIVST in this context prototype suggests that there would be a ready and willing market for HIVST. For scalability and sustainability usability, including access and availability that are here independent indications of acceptability, should be considered. So too should the desire for future use, as an additional factor pointing to acceptability. The results show high acceptability in all of these areas domains and a general interest in HIVST amongst lay users in a community in KwaZulu-Natal.

'Televaluation' of clinical information systems: an integrative approach to assessing Web-based systems.

PubMed

Kushniruk, A W; Patel, C; Patel, V L; Cimino, J J

2001-04-01

The World Wide Web provides an unprecedented opportunity for widespread access to health-care applications by both patients and providers. The development of new methods for assessing the effectiveness and usability of these systems is becoming a critical issue. This paper describes the distance evaluation (i.e. 'televaluation') of emerging Web-based information technologies. In health informatics evaluation, there is a need for application of new ideas and methods from the fields of cognitive science and usability engineering. A framework is presented for conducting evaluations of health-care information technologies that integrates a number of methods, ranging from deployment of on-line questionnaires (and Web-based forms) to remote video-based usability testing of user interactions with clinical information systems. Examples illustrating application of these techniques are presented for the assessment of a patient clinical information system (PatCIS), as well as an evaluation of use of Web-based clinical guidelines. Issues in designing, prototyping and iteratively refining evaluation components are discussed, along with description of a 'virtual' usability laboratory.

Designing an Educational Website to Improve Quality of Supportive Oncology Care for Women with Ovarian Cancer: An Expert Usability Review and Analysis.

PubMed

McClellan, Molly A; Karumur, Raghav Pavan; Vogel, Rachel Isaksson; Petzel, Sue V; Cragg, Julie; Chan, Daniel; Jacko, Julie A; Sainfort, François; Geller, Melissa A

A broad-based research team developed a Health Insurance Portability and Accountability Act (HIPAA)-compliant educational website for women with ovarian cancer to improve the quality of supportive oncology care. Prior to a randomized clinical trial of the website, initial usability testing was implemented to evaluate the website. The initial review found that 165/247 checklist items had sufficient information to allow for evaluation with the website achieving an overall score of 63%. By category, lowest scores were for the Home Page, Task Orientation, Page Layout & Visual Design, and Help, Feedback & Error Tolerance. Major issues thought to potentially impede actual usage were prioritized in redevelopment and the second usability review, conducted by the same expert, saw an improvement in scores. Incorporating usability concepts from the start of development, fulfilling the positive expectations of end-users and identifying technical and personal factors that optimize use may greatly enhance usage of health websites.

Designing an Educational Website to Improve Quality of Supportive Oncology Care for Women with Ovarian Cancer: An Expert Usability Review and Analysis

PubMed Central

McClellan, Molly A.; Karumur, Raghav Pavan; Vogel, Rachel Isaksson; Petzel, Sue V.; Cragg, Julie; Chan, Daniel; Jacko, Julie A.; Sainfort, François; Geller, Melissa A.

2016-01-01

A broad-based research team developed a Health Insurance Portability and Accountability Act (HIPAA)-compliant educational website for women with ovarian cancer to improve the quality of supportive oncology care. Prior to a randomized clinical trial of the website, initial usability testing was implemented to evaluate the website. The initial review found that 165/247 checklist items had sufficient information to allow for evaluation with the website achieving an overall score of 63%. By category, lowest scores were for the Home Page, Task Orientation, Page Layout & Visual Design, and Help, Feedback & Error Tolerance. Major issues thought to potentially impede actual usage were prioritized in redevelopment and the second usability review, conducted by the same expert, saw an improvement in scores. Incorporating usability concepts from the start of development, fulfilling the positive expectations of end-users and identifying technical and personal factors that optimize use may greatly enhance usage of health websites. PMID:27110082

Virtual gaming simulation of a mental health assessment: A usability study.

PubMed

Verkuyl, Margaret; Romaniuk, Daria; Mastrilli, Paula

2018-05-18

Providing safe and realistic virtual simulations could be an effective way to facilitate the transition from the classroom to clinical practice. As nursing programs begin to include virtual simulations as a learning strategy; it is critical to first assess the technology for ease of use and usefulness. A virtual gaming simulation was developed, and a usability study was conducted to assess its ease of use and usefulness for students and faculty. The Technology Acceptance Model provided the framework for the study, which included expert review and testing by nursing faculty and nursing students. This study highlighted the importance of assessing ease of use and usefulness in a virtual game simulation and provided feedback for the development of an effective virtual gaming simulation. The study participants said the virtual gaming simulation was engaging, realistic and similar to a clinical experience. Participants found the game easy to use and useful. Testing provided the development team with ideas to improve the user interface. The usability methodology provided is a replicable approach to testing virtual experiences before a research study or before implementing virtual experiences into curriculum. Copyright © 2018 Elsevier Ltd. All rights reserved.

NASA Johnson Space Center Usability Testing and Analysis facility (UTAF) Overview

NASA Technical Reports Server (NTRS)

Whitmore, Mihriban; Holden, Kritina L.

2005-01-01

The Usability Testing and Analysis Facility (UTAF) is part of the Space Human Factors Laboratory at the NASA Johnson Space Center in Houston, Texas. The facility performs research for NASA's HumanSystems Integration Program, under the HumanSystems Research and Technology Division. Specifically, the UTAF provides human factors support for space vehicles, including the International Space Station, the Space Shuttle, and the forthcoming Crew Exploration Vehicle. In addition, there are ongoing collaborative research efforts with external corporations and universities. The UTAF provides human factors analysis, evaluation, and usability testing of crew interfaces for space applications. This includes computer displays and controls, workstation systems, and work environments. The UTAF has a unique mix of capabilities, with a staff experienced in both cognitive human factors and ergonomics. The current areas of focus are: human factors applications in emergency medical care and informatics; control and display technologies for electronic procedures and instructions; voice recognition in noisy environments; crew restraint design for unique microgravity workstations; and refinement of human factors processes and requirements. This presentation will provide an overview of ongoing activities, and will address how the UTAF projects will evolve to meet new space initiatives.

A multimedia psychosocial support program for couples receiving infertility treatment: a feasibility study.

PubMed

Cousineau, Tara M; Lord, Sarah E; Seibring, Angel R; Corsini, Evelyn A; Viders, Jessie C; Lakhani, Shaheen R

2004-03-01

To develop and test the feasibility of a theory-driven, psychosocial support CD-ROM prototype for couples in infertility treatment. Focus group meetings with reproductive health experts, semistructured interviews with infertility patients, and content analysis of an infertility message board to determine content domains of the CD-ROM. Usability and acceptance testing of prototype CD-ROM based on predetermined feasibility criteria. Private offices and fertility centers. Expert panel of 5 reproductive health specialists; interviews with 62 individuals with infertility (35 women, 27 men); feasibility study with 12 patients and 12 experts in reproductive medicine and infertility support. None. Product usability/acceptance test. Participant feedback and content analysis informed the development of a prototype patient education CD-ROM that uses audio, video, interactive tasks, and personalized feedback. Over 80% of participants successfully completed usability tasks, and over 90% rated prototype satisfaction as "good" to "excellent." Some areas were noted for improvement in navigation and refinement in delivery of instructions. Results strongly indicate an interest in an infertility multimedia support tool. Multimedia methods may serve as an effective, innovative psychosocial intervention for infertility patients and overcome barriers of limited local access to educational and support services.

Usability issues concerning child restraint system harness design.

PubMed

Rudin-Brown, Christina M; Kumagai, Jason K; Angel, Harry A; Iwasa-Madge, Kim M; Noy, Y Ian

2003-05-01

A study was conducted to assess usability issues relating to child restraint system (CRS) harness design. Four convertible child restraint systems representing a wide variety of design features were used. Forty-two participants installed two child test dummies in both forward- and rear-facing configurations either inside or outside a test vehicle. Observer-scored checklists determined the degree to which each harness was installed correctly. Participant-scored questionnaires evaluated the 'ease-of-use' of various design features. While the percentage of correct installations exceeded 83% for all designs when installed in the forward-facing configuration, in the rear-facing position (that intended for children under 9-10 kg), there was a significant (between 65 and 89%) percentage of incorrect installations for all models. This finding is of particular interest and may be indicative of a more generalized problem with 'convertible' CRS designs when they are used in the rear-facing configuration. Furthermore, while certain design features were perceived by users as providing significantly better protection in the event of a collision, these also tended to be the features that were misused most often. The benefits and costs of various design features are discussed, and a method to test harness design usability is presented.

Forensic botany: usability of bryophyte material in forensic studies.

PubMed

Virtanen, Viivi; Korpelainen, Helena; Kostamo, Kirsi

2007-10-25

Two experiments were performed to test the relevance of bryophyte (Plantae, Bryophyta) material for forensic studies. The first experiment was conducted to reveal if, and how well, plant fragments attach to footwear in general. In the test, 16 persons walked outdoors wearing rubber boots or hiking boots. After 24h of use outdoors the boots were carefully cleaned, and all plant fragments were collected. Afterwards, all plant material was examined to identify the species. In the second experiment, fresh material of nine bryophyte species was kept in a shed in adverse conditions for 18 months, after which DNA was extracted and subjected to genotyping to test the quality of the material. Both experiments give support for the usability of bryophyte material in forensic studies. The bryophyte fragments become attached to shoes, where they remain even after the wearer walks on a dry road for several hours. Bryophyte DNA stays intact, allowing DNA profiling after lengthy periods following detachment from the original plant source. Based on these experiments, and considering the fact that many bryophytes are clonal plants, we propose that bryophytes are among the most usable plants to provide botanical evidence for forensic investigations.

Usability testing and requirements derivation for EMU-compatible electrical connectors

NASA Technical Reports Server (NTRS)

Reaux, Ray A.; Griffin, Thomas J.; Lewis, Ruthan

1989-01-01

On-orbit servicing of payloads is simplified when a spacecraft has been designed for serviceability. A key design criterion for a serviceable spaceraft is standardization of electrical connectors. This paper investigates the effects of extravehicular mobility unit (EMU) glove size, connector size, and connector type on usability of electrical connectors. An experiment was conducted exploring participants' ability to mate and demate connectors in an evacuated glovebox. Independent variables were two EMU glove-sizes, five connector size groups, and seven connector types. Significant differences in performance times and heart rate changes during mate and demate operations were found. Subjective assessments of connectors were collected from participants with a usability questionnaire. The data were used to derive design recommendations for a NASA-recommended EMU-compatible electrical connector.

Development of the Lupus Interactive Navigator as an Empowering Web-Based eHealth Tool to Facilitate Lupus Management: Users Perspectives on Usability and Acceptability.

PubMed

Neville, Carolyn; Da Costa, Deborah; Rochon, Murray; Peschken, Christine A; Pineau, Christian A; Bernatsky, Sasha; Keeling, Stephanie; Avina-Zubieta, Antonio; Lye, Elizabeth; Eng, Davy; Fortin, Paul R

2016-05-30

Systemic Lupus Erythematosus (SLE) is a serious, complex, and chronic illness. Similar to most other chronic illness states, there is great interest in helping persons with SLE engage in their disease management. The objectives of this study were to (1) develop the Lupus Interactive Navigator (LIN), a web-based self-management program for persons with SLE, and (2) test the LIN for usability and acceptability. The LIN development platform was based on the results of preliminary comprehensive needs assessments and adapted from the Oncology Interactive Navigator, a web-based tool developed for persons with cancer. Medical researchers, writers, designers, and programmers worked with clinical experts and persons with SLE to develop content for the LIN. Usability and acceptability of the LIN was tested on individuals with SLE meeting American College of Rheumatology criteria, who were recruited from five Canadian SLE clinics. Participants were provided with access to the LIN and were asked to use it over a two-week period. Following the testing period, participants were contacted for a 30-minute telephone interview to assess usability and acceptability. The content for the LIN was subdivided into six primary information topics with interview videos featuring rheumatologists, allied health professionals, and persons with SLE. Usability and acceptability of the LIN was tested on 43 females with SLE. Of these, 37 (86%) completed telephone interviews. The average age was 43.6 (SD 15.9) years and disease duration averaged 14.1 (SD 10.8) years. Median time spent on LIN was 16.3 (interquartile range [IQR]:13.7, 53.5) minutes and median number of sessions was 2 (IQR: 1, 3). Overall, Likert ratings (0=strongly disagree; 7=strongly agree) of website usability and content were very high, with 75% scoring >6 out of 7 on all items. All participants agreed that LIN was easy to use, would recommend it to others with SLE, and would refer to it for future questions about SLE. Very high ratings were also given to relevancy, credibility, and usefulness of the information provided. Overall, 73% of the participants rated all topics helpful to very helpful. Participants who reported more prior knowledge about SLE rated items regarding improvement in knowledge and helpfulness relatively lower than persons with less prior knowledge. Most participants commented that the LIN would be very useful to those newly diagnosed with SLE. Minor revisions were recommended. This study furthers the understanding of the needs in the SLE community and delivers a unique eHealth tool to promote self-management in persons with SLE. The LIN was found to be highly acceptable in content and usability. The information provided on LIN may be most helpful for individuals with less experience with the disease, such as those newly diagnosed, indicating the need to tailor the content for persons with more SLE experience.

Improving Access to HIV and AIDS Information Resources for Patients, Caregivers, and Clinicians: Results from the SHINE Project.

PubMed

Dixon, Brian E; Kaneshiro, Kellie

2012-01-01

Human immunodeficiency virus and acquired immunodeficiency syndrome (HIV/AIDS) remains a significant international public health challenge. The Statewide HIV/AIDS Information Network (SHINE) Project was created to improve HIV/AIDS health information use and access for health care professionals, patients, and affected communities in Indiana. Our objective was to assess the information-seeking behaviors of health care professionals and consumers who seek information on the testing, treatment, and management of HIV/AIDS and the usability of the SHINE Project's resources in meeting end user needs. The feedback was designed to help SHINE Project members improve and expand the SHINE Project's online resources. A convenience sample of health care professionals and consumers participated in a usability study. Participants were asked to complete typical HIV/AIDS information-seeking tasks using the SHINE Project website. Feedback was provided in the form of standardized questionnaire and usability "think-aloud" responses. Thirteen participants took part in the usability study. Clinicians generally reported the site to be "very good," while consumers generally found it to be "good." Health care professionals commented that they lack access to comprehensive resources for treating patients with HIV/AIDS. They requested new electronic resources that could be integrated in clinical practice and existing information technology infrastructures. Consumers found the SHINE website and its collected information resources overwhelming and difficult to navigate. They requested simpler, multimedia-content rich resources to deliver information on HIV/AIDS testing, treatment, and disease management. Accessibility, usability, and user education remain important challenges that public health and information specialists must address when developing and deploying interventions intended to empower consumers and support coordinated, patient-centric care.

Evaluation of the acceptability and usability of a decision support system to encourage safe and effective use of opioid therapy for chronic, noncancer pain by primary care providers.

PubMed

Trafton, Jodie; Martins, Susana; Michel, Martha; Lewis, Eleanor; Wang, Dan; Combs, Ann; Scates, Naquell; Tu, Samson; Goldstein, Mary K

2010-04-01

To develop and evaluate a clinical decision support system (CDSS) named Assessment and Treatment in Healthcare: Evidenced-Based Automation (ATHENA)-Opioid Therapy, which encourages safe and effective use of opioid therapy for chronic, noncancer pain. CDSS development and iterative evaluation using the analysis, design, development, implementation, and evaluation process including simulation-based and in-clinic assessments of usability for providers followed by targeted system revisions. Volunteers provided detailed feedback to guide improvements in the graphical user interface, and content and design changes to increase clinical usefulness, understandability, clinical workflow fit, and ease of completing guideline recommended practices. Revisions based on feedback increased CDSS usability ratings over time. Practice concerns outside the scope of the CDSS were also identified. Usability testing optimized the CDSS to better address barriers such as lack of provider education, confusion in dosing calculations and titration schedules, access to relevant patient information, provider discontinuity, documentation, and access to validated assessment tools. It also highlighted barriers to good clinical practice that are difficult to address with CDSS technology in its current conceptualization. For example, clinicians indicated that constraints on time and competing priorities in primary care, discomfort in patient-provider communications, and lack of evidence to guide opioid prescribing decisions impeded their ability to provide effective, guideline-adherent pain management. Iterative testing was essential for designing a highly usable and acceptable CDSS; however, identified barriers may limit the impact of the ATHENA-Opioid Therapy system and other CDSS on clinical practices and outcomes unless CDSS are paired with parallel initiatives to address these issues.

Combining Static Model Checking with Dynamic Enforcement Using the Statecall Policy Language

NASA Astrophysics Data System (ADS)

Madhavapeddy, Anil

Internet protocols encapsulate a significant amount of state, making implementing the host software complex. In this paper, we define the Statecall Policy Language (SPL) which provides a usable middle ground between ad-hoc coding and formal reasoning. It enables programmers to embed automata in their code which can be statically model-checked using SPIN and dynamically enforced. The performance overheads are minimal, and the automata also provide higher-level debugging capabilities. We also describe some practical uses of SPL by describing the automata used in an SSH server written entirely in OCaml/SPL.

Sensory System for Implementing a Human—Computer Interface Based on Electrooculography

PubMed Central

Barea, Rafael; Boquete, Luciano; Rodriguez-Ascariz, Jose Manuel; Ortega, Sergio; López, Elena

2011-01-01

This paper describes a sensory system for implementing a human–computer interface based on electrooculography. An acquisition system captures electrooculograms and transmits them via the ZigBee protocol. The data acquired are analysed in real time using a microcontroller-based platform running the Linux operating system. The continuous wavelet transform and neural network are used to process and analyse the signals to obtain highly reliable results in real time. To enhance system usability, the graphical interface is projected onto special eyewear, which is also used to position the signal-capturing electrodes. PMID:22346579

Understanding protocol performance: impact of test performance.

PubMed

Turner, Robert G

2013-01-01

This is the second of two articles that examine the factors that determine protocol performance. The objective of these articles is to provide a general understanding of protocol performance that can be used to estimate performance, establish limits on performance, decide if a protocol is justified, and ultimately select a protocol. The first article was concerned with protocol criterion and test correlation. It demonstrated the advantages and disadvantages of different criterion when all tests had the same performance. It also examined the impact of increasing test correlation on protocol performance and the characteristics of the different criteria. To examine the impact on protocol performance when individual tests in a protocol have different performance. This is evaluated for different criteria and test correlations. The results of the two articles are combined and summarized. A mathematical model is used to calculate protocol performance for different protocol criteria and test correlations when there are small to large variations in the performance of individual tests in the protocol. The performance of the individual tests that make up a protocol has a significant impact on the performance of the protocol. As expected, the better the performance of the individual tests, the better the performance of the protocol. Many of the characteristics of the different criteria are relatively independent of the variation in the performance of the individual tests. However, increasing test variation degrades some criteria advantages and causes a new disadvantage to appear. This negative impact increases as test variation increases and as more tests are added to the protocol. Best protocol performance is obtained when individual tests are uncorrelated and have the same performance. In general, the greater the variation in the performance of tests in the protocol, the more detrimental this variation is to protocol performance. Since this negative impact is increased as more tests are added to the protocol, greater test variation indicates using fewer tests in the protocol. American Academy of Audiology.

App Chronic Disease Checklist: Protocol to Evaluate Mobile Apps for Chronic Disease Self-Management

PubMed Central

Anderson, Kevin; Burford, Oksana

2016-01-01

Background The availability of mobile health apps for self-care continues to increase. While little evidence of their clinical impact has been published, there is general agreement among health authorities and authors that consumers’ use of health apps assist in self-management and potentially clinical decision making. A consumer’s sustained engagement with a health app is dependent on the usability and functionality of the app. While numerous studies have attempted to evaluate health apps, there is a paucity of published methods that adequately recognize client experiences in the academic evaluation of apps for chronic conditions. Objective This paper reports (1) a protocol to shortlist health apps for academic evaluation, (2) synthesis of a checklist to screen health apps for quality and reliability, and (3) a proposed method to theoretically evaluate usability of health apps, with a view towards identifying one or more apps suitable for clinical assessment. Methods A Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) flow diagram was developed to guide the selection of the apps to be assessed. The screening checklist was thematically synthesized with reference to recurring constructs in published checklists and related materials for the assessment of health apps. The checklist was evaluated by the authors for face and construct validity. The proposed method for evaluation of health apps required the design of procedures for raters of apps, dummy data entry to test the apps, and analysis of raters’ scores. Results The PRISMA flow diagram comprises 5 steps: filtering of duplicate apps; eliminating non-English apps; removing apps requiring purchase, filtering apps not updated within the past year; and separation of apps into their core functionality. The screening checklist to evaluate the selected apps was named the App Chronic Disease Checklist, and comprises 4 sections with 6 questions in each section. The validity check verified classification of, and ambiguity in, wording of questions within constructs. The proposed method to evaluate shortlisted and downloaded apps comprises instructions to attempt set-up of a dummy user profile, and dummy data entry to represent in-range and out-of-range clinical measures simulating a range of user behaviors. A minimum score of 80% by consensus (using the Intraclass Correlation Coefficient) between raters is proposed to identify apps suitable for clinical trials. Conclusions The flow diagram allows researchers to shortlist health apps that are potentially suitable for formal evaluation. The evaluation checklist enables quantitative comparison of shortlisted apps based on constructs reported in the literature. The use of multiple raters, and comparison of their scores, is proposed to manage inherent subjectivity in assessing user experiences. Initial trial of the combined protocol is planned for apps pertaining to the self-monitoring of asthma; these results will be reported elsewhere. PMID:27815233

Semantic Indexing of Medical Learning Objects: Medical Students' Usage of a Semantic Network

PubMed Central

Gießler, Paul; Ohnesorge-Radtke, Ursula; Spreckelsen, Cord

2015-01-01

Background The Semantically Annotated Media (SAM) project aims to provide a flexible platform for searching, browsing, and indexing medical learning objects (MLOs) based on a semantic network derived from established classification systems. Primarily, SAM supports the Aachen emedia skills lab, but SAM is ready for indexing distributed content and the Simple Knowledge Organizing System standard provides a means for easily upgrading or even exchanging SAM’s semantic network. There is a lack of research addressing the usability of MLO indexes or search portals like SAM and the user behavior with such platforms. Objective The purpose of this study was to assess the usability of SAM by investigating characteristic user behavior of medical students accessing MLOs via SAM. Methods In this study, we chose a mixed-methods approach. Lean usability testing was combined with usability inspection by having the participants complete four typical usage scenarios before filling out a questionnaire. The questionnaire was based on the IsoMetrics usability inventory. Direct user interaction with SAM (mouse clicks and pages accessed) was logged. Results The study analyzed the typical usage patterns and habits of students using a semantic network for accessing MLOs. Four scenarios capturing characteristics of typical tasks to be solved by using SAM yielded high ratings of usability items and showed good results concerning the consistency of indexing by different users. Long-tail phenomena emerge as they are typical for a collaborative Web 2.0 platform. Suitable but nonetheless rarely used keywords were assigned to MLOs by some users. Conclusions It is possible to develop a Web-based tool with high usability and acceptance for indexing and retrieval of MLOs. SAM can be applied to indexing multicentered repositories of MLOs collaboratively. PMID:27731860

Semantic Indexing of Medical Learning Objects: Medical Students' Usage of a Semantic Network.

PubMed

Tix, Nadine; Gießler, Paul; Ohnesorge-Radtke, Ursula; Spreckelsen, Cord

2015-11-11

The Semantically Annotated Media (SAM) project aims to provide a flexible platform for searching, browsing, and indexing medical learning objects (MLOs) based on a semantic network derived from established classification systems. Primarily, SAM supports the Aachen emedia skills lab, but SAM is ready for indexing distributed content and the Simple Knowledge Organizing System standard provides a means for easily upgrading or even exchanging SAM's semantic network. There is a lack of research addressing the usability of MLO indexes or search portals like SAM and the user behavior with such platforms. The purpose of this study was to assess the usability of SAM by investigating characteristic user behavior of medical students accessing MLOs via SAM. In this study, we chose a mixed-methods approach. Lean usability testing was combined with usability inspection by having the participants complete four typical usage scenarios before filling out a questionnaire. The questionnaire was based on the IsoMetrics usability inventory. Direct user interaction with SAM (mouse clicks and pages accessed) was logged. The study analyzed the typical usage patterns and habits of students using a semantic network for accessing MLOs. Four scenarios capturing characteristics of typical tasks to be solved by using SAM yielded high ratings of usability items and showed good results concerning the consistency of indexing by different users. Long-tail phenomena emerge as they are typical for a collaborative Web 2.0 platform. Suitable but nonetheless rarely used keywords were assigned to MLOs by some users. It is possible to develop a Web-based tool with high usability and acceptance for indexing and retrieval of MLOs. SAM can be applied to indexing multicentered repositories of MLOs collaboratively.

The impact of computer self-efficacy, computer anxiety, and perceived usability and acceptability on the efficacy of a decision support tool for colorectal cancer screening

PubMed Central

Lindblom, Katrina; Gregory, Tess; Flight, Ingrid H K; Zajac, Ian

2011-01-01

Objective This study investigated the efficacy of an internet-based personalized decision support (PDS) tool designed to aid in the decision to screen for colorectal cancer (CRC) using a fecal occult blood test. We tested whether the efficacy of the tool in influencing attitudes to screening was mediated by perceived usability and acceptability, and considered the role of computer self-efficacy and computer anxiety in these relationships. Methods Eighty-one participants aged 50–76 years worked through the on-line PDS tool and completed questionnaires on computer self-efficacy, computer anxiety, attitudes to and beliefs about CRC screening before and after exposure to the PDS, and perceived usability and acceptability of the tool. Results Repeated measures ANOVA found that PDS exposure led to a significant increase in knowledge about CRC and screening, and more positive attitudes to CRC screening as measured by factors from the Preventive Health Model. Perceived usability and acceptability of the PDS mediated changes in attitudes toward CRC screening (but not CRC knowledge), and computer self-efficacy and computer anxiety were significant predictors of individuals' perceptions of the tool. Conclusion Interventions designed to decrease computer anxiety, such as computer courses and internet training, may improve the acceptability of new health information technologies including internet-based decision support tools, increasing their impact on behavior change. PMID:21857024

Adolescents’ experience of a rapid HIV self-testing device in youth-friendly clinic settings in Cape Town South Africa: a cross-sectional community based usability study

PubMed Central

Smith, Philip; Wallace, Melissa; Bekker, Linda-Gail

2016-01-01

Abstract Introduction: Since HIV testing in South African adolescents and young adults is sub-optimal, the objective of the current study was to investigate the feasibility and acceptability of an HIV rapid self-testing device in adolescents and young people at the Desmond Tutu HIV Foundation Youth Centre and Mobile Clinic. Methods: Self-presenting adolescents and young adults were invited to participate in a study investigating the fidelity, usability and acceptability of the AtomoRapid HIV Rapid self-testing device. Trained healthcare workers trained participants to use the device before the participant conducted the HIV self-test with device usage instructions. The healthcare worker then conducted a questionnaire-based survey to assess outcomes. Results: Of the 224 enrolled participants between 16 and 24 years of age, 155 (69,2%) were female. Overall, fidelity was high; 216 (96,4%) participants correctly completed the test and correctly read and interpreted the HIV test result. There were eight (3,6%) user errors overall; six participants failed to prick their finger even though the lancet fired correctly. There were two user errors where participants failed to use the capillary tube correctly. Participants rated acceptability and usability highly, with debut testers giving significantly higher ratings for both. Younger participants gave significantly higher ratings of acceptability. Conclusions: Adolescents and young adults found HIV self-testing highly acceptable with the AtomoRapid and they used the device accurately. Further research should investigate how, where and when to deploy HIV self-testing as a means to accompany existing strategies in reaching the UNAIDS goal to test 90% of all individuals worldwide. PMID:28406597

A usability study of a mobile health application for rural Ghanaian midwives.

PubMed

Vélez, Olivia; Okyere, Portia Boakye; Kanter, Andrew S; Bakken, Suzanne

2014-01-01

Midwives in rural Ghana work at the frontline of the health care system, where they have access to essential data about the patient population. However, current methods of data capture, primarily pen and paper, make the data neither accessible nor usable for monitoring patient care or program evaluation. Electronic health (eHealth) systems present a potential mechanism for enhancing the roles of midwives by providing tools for collecting, exchanging, and viewing patient data as well as offering midwives the possibility for receiving information and decision support. Introducing such technology in low-resource settings has been challenging because of low levels of user acceptance, software design that does not match the end-user environment, and/or unforeseen challenges such as irregular power availability. These challenges are often attributable to a lack of understanding by the software developers of the end users' needs and work environment. A mobile health (mHealth) application known as mClinic was designed to support midwife access to the Millennium Village-Global Network, an eHealth delivery platform that captures data for managing patient care as well as program evaluation and monitoring, decision making, and management. We conducted a descriptive usability study composed of 3 phases to evaluate an mClinic prototype: 1) hybrid lab-live software evaluation of mClinic to identify usability issues; 2) completion of a usability questionnaire; and 3) interviews that included low-fidelity prototyping of new functionality proposed by midwives. The heuristic evaluation identified usability problems related to 4 of 8 usability categories. Analysis of usability questionnaire data indicated that the midwives perceived mClinic as useful but were more neutral about the ease of use. Analysis of midwives' reactions to low-fidelity prototypes during the interview process supported the applicability of mClinic to midwives' work and identified the need for additional functionality. User acceptance is essential for the success of any mHealth implementation. Usability testing identified mClinic development flaws and needed software enhancements. © 2014 by the American College of Nurse-Midwives.

The Virtual Insect Brain protocol: creating and comparing standardized neuroanatomy

PubMed Central

Jenett, Arnim; Schindelin, Johannes E; Heisenberg, Martin

2006-01-01

Background In the fly Drosophila melanogaster, new genetic, physiological, molecular and behavioral techniques for the functional analysis of the brain are rapidly accumulating. These diverse investigations on the function of the insect brain use gene expression patterns that can be visualized and provide the means for manipulating groups of neurons as a common ground. To take advantage of these patterns one needs to know their typical anatomy. Results This paper describes the Virtual Insect Brain (VIB) protocol, a script suite for the quantitative assessment, comparison, and presentation of neuroanatomical data. It is based on the 3D-reconstruction and visualization software Amira, version 3.x (Mercury Inc.) [1]. Besides its backbone, a standardization procedure which aligns individual 3D images (series of virtual sections obtained by confocal microscopy) to a common coordinate system and computes average intensities for each voxel (volume pixel) the VIB protocol provides an elaborate data management system for data administration. The VIB protocol facilitates direct comparison of gene expression patterns and describes their interindividual variability. It provides volumetry of brain regions and helps to characterize the phenotypes of brain structure mutants. Using the VIB protocol does not require any programming skills since all operations are carried out at an intuitively usable graphical user interface. Although the VIB protocol has been developed for the standardization of Drosophila neuroanatomy, the program structure can be used for the standardization of other 3D structures as well. Conclusion Standardizing brains and gene expression patterns is a new approach to biological shape and its variability. The VIB protocol provides a first set of tools supporting this endeavor in Drosophila. The script suite is freely available at [2] PMID:17196102

Operating manual-based usability evaluation of medical devices: an effective patient safety screening method.

PubMed

Turley, James P; Johnson, Todd R; Smith, Danielle Paige; Zhang, Jaijie; Brixey, Juliana J

2006-04-01

Use of medical devices often directly contributes to medical errors. Because it is difficult or impossible to change the design of existing devices, the best opportunity for improving medical device safety is during the purchasing process. However, most hospital personnel are not familiar with the usability evaluation methods designed to identify aspects of a user interface that do not support intuitive and safe use. A review of medical device operating manuals is proposed as a more practical method of usability evaluation. Operating manuals for five volumetric infusion pumps from three manufacturers were selected for this study (January-April 2003). Each manual's safety message content was evaluated to determine whether the message indicated a device design characteristic that violated known usability principles (heuristics) or indicated a violation of an affordance of the device. "Minimize memory load," with 65 violations, was the heuristic violated most frequently across pumps. Variations between pumps, including the frequency and severity of violations for each, were noted. Results suggest that manual review can provide a proxy for heuristic evaluation of the actual medical device. This method, intended to be a component of prepurchasing evaluation, can complement more formal usability evaluation methods and be used to select a subset of devices for more extensive and formal testing.

Naive (commonsense) geography and geobrowser usability after ten years of Google Earth

NASA Astrophysics Data System (ADS)

Hamerlinck, J. D.

2016-04-01

In 1995, the concept of ‘naive geography’ was formally introduced as an area of cognitive geographic information science representing ‘the body of knowledge that people have about the surrounding geographic world’ and reflecting ‘the way people think and reason about geographic space and time, both consciously and subconsciously’. The need to incorporate such commonsense knowledge and reasoning into design of geospatial technologies was identified but faced challenges in formalizing these relationships and processes in software implementation. Ten years later, the Google Earth geobrowser was released, marking the beginning of a new era of open access to, and application of, geographic data and information in society. Fast-forward to today, and the opportunity presents itself to take stock of twenty years of naive geography and a decade of the ubiquitous virtual globe. This paper introduces an ongoing research effort to explore the integration of naive (or commonsense) geography concepts in the Google Earth geobrowser virtual globe and their possible impact on Google Earth's usability, utility, and usefulness. A multi-phase methodology is described, combining usability reviews and usability testing with use-case scenarios involving the U.S.-Canadian Yellowstone to Yukon Initiative. Initial progress on a usability review combining cognitive walkthroughs and heuristics evaluation is presented.

Navigation in the electronic health record: A review of the safety and usability literature.

PubMed

Roman, Lisette C; Ancker, Jessica S; Johnson, Stephen B; Senathirajah, Yalini

2017-03-01

Inefficient navigation in electronic health records has been shown to increase users' cognitive load, which may increase potential for errors, reduce efficiency, and increase fatigue. However, navigation has received insufficient recognition and attention in the electronic health record (EHR) literature as an independent construct and contributor to overall usability. Our aims in this literature review were to (1) assess the prevalence of navigation-related topics within the EHR usability and safety research literature, (2) categorize types of navigation actions within the EHR, (3) capture relationships between these navigation actions and usability principles, and (4) collect terms and concepts related to EHR navigation. Our goal was to improve access to navigation-related research in usability. We applied scoping literature review search methods with the assistance of a reference librarian to identify articles published since 1996 that reported evaluation of the usability or safety of an EHR user interface via user test, analytic methods, or inspection methods. The 4336 references collected from MEDLINE, EMBASE, Engineering Village, and expert referrals were de-duplicated and screened for relevance, and navigation-related concepts were abstracted from the 21 articles eligible for review using a standard abstraction form. Of the 21 eligible articles, 20 (95%) mentioned navigation in results and discussion of usability evaluations. Navigation between pages of the EHR was the more frequently documented type of navigation (86%) compared to navigation within a single page (14%). Navigation actions (e.g., scrolling through a medication list) were frequently linked to specific usability heuristic violations, among which flexibility and efficiency of use, recognition rather than recall, and error prevention were most common. Discussion of navigation was prevalent in results across all types of evaluation methods among the articles reviewed. Navigating between multiple screens was frequently identified as a usability barrier. The lack of standard terminology created some challenges to identifying and comparing articles. We observed that usability researchers are frequently capturing navigation-related issues even in articles that did not explicitly state navigation as a focus. Capturing and synthesizing the literature on navigation is challenging because of the lack of uniform vocabulary. Navigation is a potential target for normative recommendations for improved interaction design for safer systems. Future research in this domain, including development of normative recommendations for usability design and evaluation, will be facilitated by development of a standard terminology for describing EHR navigation. Copyright © 2017 Elsevier Inc. All rights reserved.

Reduction of Burnout in Mental Health Care Providers Using the Provider Resilience Mobile Application.

PubMed

Wood, Amanda Ernst; Prins, Annabel; Bush, Nigel E; Hsia, Jennifer F; Bourn, Laura E; Earley, Michael D; Walser, Robyn D; Ruzek, Josef

2017-05-01

This pilot study examined the usability, acceptability, and effectiveness of a free Provider Resilience (PR) mobile application (app) designed by the National Center for Telehealth and Technology to reduce provider burnout. Outpatient mental health providers (N = 30) used the PR app for 1 month. Participants rated the PR app on the System Usability Scale with an overall score of 79.7, which is in the top quartile for usability. Results of paired sample t tests on the Professional Quality of Life Scale indicated significant decreases on the Burnout (t = 3.65, p < .001) and Compassion Fatigue (t = 4.54, p < .001) subscales. The Provider Resilience app shows promise in reducing burnout and compassion fatigue in mental health care providers.

Usability factors of mobile health application for chronic diseases

NASA Astrophysics Data System (ADS)

Zahra, Fatima; Hussain, Azham; Mohd, Haslina

2016-08-01

M-health has changed the conventional delivery system of health-care, permitting continuous, pervasive Health-care anywhere, anytime. Chronic disease apps are increasing, as many health workers, patients and clinicians already embracing smartphones in their comprehensive and diverse practices. There are lots of challenges and requirements that need to be addressed for mobile health applications to prevent or eliminate design problems and minimize potential threats for users, the proposed factors for chronic disease mobile applications can be used as a guide for app developers While, the usability testing, and evaluations of chronic disease apps have not yet touched the accuracy level of other web based applications. This study is being conducted to learn about challenges of m-health apps and to identify the factors that affect the usability of such applications.

Usability Study of Two Collocated Prototype System Displays

NASA Technical Reports Server (NTRS)

Trujillo, Anna C.

2007-01-01

Currently, most of the displays in control rooms can be categorized as status screens, alerts/procedures screens (or paper), or control screens (where the state of a component is changed by the operator). The primary focus of this line of research is to determine which pieces of information (status, alerts/procedures, and control) should be collocated. Two collocated displays were tested for ease of understanding in an automated desktop survey. This usability study was conducted as a prelude to a larger human-in-the-loop experiment in order to verify that the 2 new collocated displays were easy to learn and usable. The results indicate that while the DC display was preferred and yielded better performance than the MDO display, both collocated displays can be easily learned and used.

Designing a Technology Enhanced Practice for Home Nursing Care of Patients with Congestive Heart Failure

PubMed Central

Casper, Gail R.; Karsh, Ben-Tzion; K.L., Calvin; Carayon, Pascale; Grenier, Anne-Sophie; Sebern, Margaret; Burke, Laura J.; Brennan, Patricia F.

2005-01-01

This paper describes the process we used to design the HeartCare website to support Technology Enhanced Practice (TEP) for home care nurses engaged in providing care for patients with Congestive Heart Failure (CHF). Composed of communication, information, and self-monitoring functions, the HeartCare website is aimed at supporting best practice nursing care for these patients. Its unique focus is professional practice, thus the scope of this project is greater and more abstract than those focusing on a task or set of activities. A modified macroergonomic analysis, design work system analysis, and focus groups utilizing participatory design methodology were undertaken to characterize the nursing practice model. Design of the HeartCare website required synthesizing the extant practice model and the agency’s evidence-based heart failure protocols, identifying aspects of practice that could be enhanced by supporting technology, and delineation of functional requirements of the Enhanced HeartCare technology. Validation and refinement of the website and planning for user training activities will be accomplished through a two-stage usability testing strategy. PMID:16779013

Are we there yet? Evaluating commercial grade brain-computer interface for control of computer applications by individuals with cerebral palsy.

PubMed

Taherian, Sarvnaz; Selitskiy, Dmitry; Pau, James; Claire Davies, T

2017-02-01

Using a commercial electroencephalography (EEG)-based brain-computer interface (BCI), the training and testing protocol for six individuals with spastic quadriplegic cerebral palsy (GMFCS and MACS IV and V) was evaluated. A customised, gamified training paradigm was employed. Over three weeks, the participants spent two sessions exploring the system, and up to six sessions playing the game which focussed on EEG feedback of left and right arm motor imagery. The participants showed variable inconclusive results in the ability to produce two distinct EEG patterns. Participant performance was influenced by physical illness, motivation, fatigue and concentration. The results from this case study highlight the infancy of BCIs as a form of assistive technology for people with cerebral palsy. Existing commercial BCIs are not designed according to the needs of end-users. Implications for Rehabilitation Mood, fatigue, physical illness and motivation influence the usability of a brain-computer interface. Commercial brain-computer interfaces are not designed for practical assistive technology use for people with cerebral palsy. Practical brain-computer interface assistive technologies may need to be flexible to suit individual needs.

A parallel coordinates style interface for exploratory volume visualization.

PubMed

Tory, Melanie; Potts, Simeon; Möller, Torsten

2005-01-01

We present a user interface, based on parallel coordinates, that facilitates exploration of volume data. By explicitly representing the visualization parameter space, the interface provides an overview of rendering options and enables users to easily explore different parameters. Rendered images are stored in an integrated history bar that facilitates backtracking to previous visualization options. Initial usability testing showed clear agreement between users and experts of various backgrounds (usability, graphic design, volume visualization, and medical physics) that the proposed user interface is a valuable data exploration tool.

Colorectal cancer screening patient education materials-how effective is online health information?

PubMed

John, Elizabeth Sheena; John, Ann M; Hansberry, David R; Thomas, Prashant J; Agarwal, Prateek; Deitch, Christopher; Chokhavatia, Sita

2016-12-01

Patients screened for colorectal cancer (CRC) frequently turn to the Internet to improve their understanding of tests used for detection, including colonoscopy, flexible sigmoidoscopy, fecal occult blood test (FOBT), and CT colonography. It was of interest to determine the quality and readability levels of online health information. The screening tools were googled, and the top 20 results of each test were analyzed for readability, accessibility, usability, and reliability. The 80 articles excluded scientific literature and blogs. We used ten validated readability scales to measure grade levels, and one-way ANOVA and Tukey's honestly statistical different (HSD) post hoc analyses to determine any statistically significant differences among the four diagnostic tests. The LIDA tool assessed overall quality by measuring accessibility, usability, and reliability. The 80 articles were written at an 11.7 grade level, with CT colonography articles written at significantly higher levels than FOBT articles, F(3, 75) = 3.07, p = 0.033. LIDA showed moderate percentages in accessibility (83.9 %), usability (73.0 %), and reliability (75.9 %). Online health information about CRC screening tools are written at higher levels than the National Institute of Health (NIH) and American Medical Association (AMA) recommended third to seventh grade levels. More patients could benefit from this modality of information if it were written at a level and quality that would better facilitate understanding.

Evidence-based development and first usability testing of a social serious game based multi-modal system for early screening for atypical socio-cognitive development.

PubMed

Gyori, Miklos; Borsos, Zsófia; Stefanik, Krisztina

2015-01-01

At current, screening for, and diagnosis of, autism spectrum disorders (ASD) are based on purely behavioral data; established screening tools rely on human observation and ratings of relevant behaviors. The research and development project in the focus of this paper is aimed at designing, creating and evaluating a social serious game based multi-modal, interactive software system for screening for high functioning cases of ASD at kindergarten age. The aims of this paper are (1) to summarize the evidence-based design process and (2) to present results from the first usability test of the system. Game topic, candidate responses, and candidate game contents were identified via an iterative literature review. On this basis, the 1^st partial prototype of the fully playable game has been created, with complete data recording functionality but without the decision making component. A first usability test was carried out on this prototype (n=13). Overall results were unambiguously promising. Although sporadic difficulties in, and slightly negative attitudes towards, using the game occasionally arose, these were confined to non-target-group children only. The next steps of development include (1) completing the game design; (2) carrying out first large-n field test; (3) creating the first prototype of the decision making component.

A usability assessment on a virtual reality system for panic disorder treatment

NASA Astrophysics Data System (ADS)

Lee, Jaelin; Kawai, Takashi; Yoshida, Nahoko; Izawa, Shuhei; Nomura, Shinobu; Eames, Douglas; Kaiya, Hisanobu

2008-02-01

The authors have developed a virtual reality exposure system that reflects the Japanese culture and environment. Concretely, the system focuses on the subway environment, which is the environment most patients receiving treatment for panic disorder at hospitals in Tokyo, Japan tend to avoid. The system is PC based and features realistic video images and highly interactive functionality. In particular, the system enables instant transformation of the virtual space and allows situations to be freely customized according to the condition and symptoms expressed by each patient. Positive results achieved in therapy assessments aimed at patients with panic disorder accompanying agoraphobia indicate the possibility of indoor treatment. Full utilization of the functionality available requires that the interactive functions be easily operable. Accordingly, there appears to be a need for usability testing aimed at determining whether or not a therapist can operate the system naturally while focusing fully on treatment. In this paper, the configuration of the virtual reality exposure system focusing on the subway environment is outlined. Further, the results of usability tests aimed at assessing how naturally it can be operated while focusing fully on treatment are described.

A Digital Tool to Promote Alcohol and Drug Use Screening, Brief Intervention, and Referral to Treatment Skill Translation: A Mobile App Development and Randomized Controlled Trial Protocol

PubMed Central

2017-01-01

Background Translation of knowledge and skills from classroom settings to clinical practice is a major challenge in healthcare training, especially for behavioral interventions. For example, screening, brief intervention, and referral to treatment (SBIRT) is a highly-promoted approach to identifying and treating individuals at risk for alcohol or drug problems, yet effective, routine use of SBIRT has lagged. Objective The objective of this paper is to describe the development, pilot testing, and trial protocol of a mobile app based on the theory of planned behavior (TPB) to promote SBIRT skill translation and application. Methods Intended for use after classroom training occurs, the mobile app has three primary functions designed to increase behavioral intent to deliver SBIRT: (1) review skills (ie, address knowledge and beliefs about SBIRT), (2) apply skills with patients (ie, build confidence and perceived behavioral control), and (3) report performance data (ie, increase accountability and social norms and/or influence). The app includes depression and anxiety screening tools due to high comorbidity with substance use. A randomized controlled trial (RCT) is in progress among health and social service learners (N=200) recruited from 3 universities and 6 different training programs in nursing, social work, internal medicine, psychiatry, and psychology. Participants are randomized to SBIRT classroom instruction alone or classroom instruction plus app access prior to beginning their field placement rotations. TPB-based data are collected via Qualtrics or via the mobile app pre-post and SBIRT utilization, weekly for 10 weeks. Key outcomes include the frequency of and self-reported confidence in delivery of SBIRT. Results Beta testing with advanced practice nursing students (N=22) indicated that the app and its associated assessment tools were acceptable and useful. The system usability scale (SUS) mean was 65.8 (n=19), which indicated that the SBIRT app was acceptable but could benefit from improvement. Indeed, modifications were implemented prior to starting the trial. Enrollment of trial participants began in September 2016. Results are expected by December 2017. Conclusions This report describes the process of TPB-based app development and testing, and the protocol for a RCT to determine the effectiveness of the app in enhancing skill translation. If effective, this approach could improve SBIRT implementation, fidelity, and clinical outcomes. PMID:28420604

The art and science of patient storytelling-harnessing narrative communication for behavioral interventions: the ACCE project.

PubMed

Houston, Thomas K; Cherrington, Andrea; Coley, Heather L; Robinson, Kimberly M; Trobaugh, John A; Williams, Jessica H; Foster, Pamela H; Ford, Daniel E; Gerber, Ben S; Shewchuk, Richard M; Allison, Jeroan J

2011-08-01

Narrative communication is an emerging form of persuasive communication used in health education to solicit actual patient stories. Eliciting a narrative is an open-ended process and may or may not map to desired intervention objectives or underlying behavioral constructs. In addition, incorporating actual, unscripted narratives into multimedia interventions is challenging. The authors evaluated a protocol of editing narratives for a multimedia intervention to promote smoking cessation in the African American community that maintains fidelity to the original message and was related to behavioral constructs from social cognitive theory. The authors used four steps: (a) narrative collection (videotaping), (b) narrative review (rating of content), (c) narrative editing (documentary style), and (d) pilot testing (usability and assessment of transportation). The authors videotaped 50 personal smoking cessation narratives. After coding for presence of theoretical constructs, perceived risks of smoking (present in 53% of narratives) was the most common related behavioral construct. Four narratives were chosen for inclusion in the DVD. Pilot testing showed viewers reported high level of transportation into the narrative. The authors found that some behavioral constructs were rare and difficult to solicit in this population but that the final product was engaging to the viewers. Lessons learned may be useful for other video-based behavioral interventions that incorporate personal narratives.

Selected laboratory evaluations of the whole-water sample-splitting capabilities of a prototype fourteen-liter Teflon churn splitter

USGS Publications Warehouse

Horowitz, A.J.; Smith, J.J.; Elrick, K.A.

2001-01-01

A prototype 14-L Teflon? churn splitter was evaluated for whole-water sample-splitting capabilities over a range of sediment concentratons and grain sizes as well as for potential chemical contamination from both organic and inorganic constituents. These evaluations represent a 'best-case' scenario because they were performed in the controlled environment of a laboratory, and used monomineralic silica sand slurries of known concentration made up in deionized water. Further, all splitting was performed by a single operator, and all the requisite concentration analyses were performed by a single laboratory. The prototype Teflon? churn splitter did not appear to supply significant concentrations of either organic or inorganic contaminants at current U.S. Geological Survey (USGS) National Water Quality Laboratory detection and reporting limits when test samples were prepared using current USGS protocols. As with the polyethylene equivalent of the prototype Teflon? churn, the maximum usable whole-water suspended sediment concentration for the prototype churn appears to lie between 1,000 and 10,000 milligrams per liter (mg/L). Further, the maximum grain-size limit appears to lie between 125- and 250-microns (m). Tests to determine the efficacy of the valve baffle indicate that it must be retained to facilitate representative whole-water subsampling.

The Perceived Ease of Use and Usefulness of Loop: Evaluation and Content Analysis of a Web-Based Clinical Collaboration System

PubMed Central

Kurahashi, Allison M; Stinson, Jennifer N; van Wyk, Margaret; Luca, Stephanie; Jamieson, Trevor; Weinstein, Peter; Cafazzo, Joseph A; Lokuge, Bhadra; Cohen, Eyal; Rapoport, Adam

2018-01-01

Background Patients with complex health care needs require the expertise of many health care providers. Communication, collaboration, and patient-centered care positively impact care quality and patient outcomes. Few technologies exist that facilitate collaboration between providers across settings of care and also engage the patient. We developed a Web-based clinical collaboration system, Loop, to address this gap. The likelihood of a technological system’s uptake is associated with its perceived ease of use and perceived usefulness. We engaged stakeholders in the conceptualization and development of Loop in an effort to maximize its intuitiveness and utility. Objective This study aimed to report end users’ perceptions about the ease of use and usefulness of Loop captured during usability tests of Loop. Methods Participants represented three user types (patients, caregivers, and health care providers) recruited from three populations (adults with cancer, adolescents and young adults with cancer, and children with medical complexity). We conducted usability testing over three iterative cycles of testing and development in both laboratory-based and off-site environments. We performed a content analysis of usability testing transcripts to summarize and describe participant perceptions about the ease of use and usefulness of Loop. Results Participants enjoyed testing Loop and were able to use the core functions—composing, posting, and reading messages—with little difficulty. They had difficulty interpreting certain visual cues and design elements or the purpose of some features. This difficulty negatively impacted perceived ease of use but was primarily limited to auxiliary features. Participants predicted that Loop could improve the efficiency and effectiveness of communication between care team members; however, this perceived usefulness could be compromised by disruptions to personal workflow such as additional time or task requirements. Conclusions Loop was perceived to have value as a collaboration system; however, usability testing findings indicate that some design and functional elements need to be addressed to improve ease of use. Additionally, participant concerns highlight the need to consider how a system can be implemented so as to minimize impact on workflow and optimize usefulness. PMID:29317386

Detecting relay attacks on RFID communication systems using quantum bits

NASA Astrophysics Data System (ADS)

Jannati, Hoda; Ardeshir-Larijani, Ebrahim

2016-11-01

RFID systems became widespread in variety of applications because of their simplicity in manufacturing and usability. In the province of critical infrastructure protection, RFID systems are usually employed to identify and track people, objects and vehicles that enter restricted areas. The most important vulnerability which is prevalent among all protocols employed in RFID systems is against relay attacks. Until now, to protect RFID systems against this kind of attack, the only approach is the utilization of distance-bounding protocols which are not applicable over low-cost devices such as RFID passive tags. This work presents a novel technique using emerging quantum technologies to detect relay attacks on RFID systems. Recently, it is demonstrated that quantum key distribution (QKD) can be implemented in a client-server scheme where client only requires an on-chip polarization rotator that may be integrated into a handheld device. Now we present our technique for a tag-reader scenario which needs similar resources as the mentioned QKD scheme. We argue that our technique requires less resources and provides lower probability of false alarm for the system, compared with distance-bounding protocols, and may pave the way to enhance the security of current RFID systems.

A Multifactor Secure Authentication System for Wireless Payment

NASA Astrophysics Data System (ADS)

Sanyal, Sugata; Tiwari, Ayu; Sanyal, Sudip

Organizations are deploying wireless based online payment applications to expand their business globally, it increases the growing need of regulatory requirements for the protection of confidential data, and especially in internet based financial areas. Existing internet based authentication systems often use either the Web or the Mobile channel individually to confirm the claimed identity of the remote user. The vulnerability is that access is based on only single factor authentication which is not secure to protect user data, there is a need of multifactor authentication. This paper proposes a new protocol based on multifactor authentication system that is both secure and highly usable. It uses a novel approach based on Transaction Identification Code and SMS to enforce another security level with the traditional Login/password system. The system provides a highly secure environment that is simple to use and deploy with in a limited resources that does not require any change in infrastructure or underline protocol of wireless network. This Protocol for Wireless Payment is extended as a two way authentications system to satisfy the emerging market need of mutual authentication and also supports secure B2B communication which increases faith of the user and business organizations on wireless financial transaction using mobile devices.

A task-specific interactive game-based virtual reality rehabilitation system for patients with stroke: a usability test and two clinical experiments.

PubMed

Shin, Joon-Ho; Ryu, Hokyoung; Jang, Seong Ho

2014-03-06

Virtual reality (VR) is not commonly used in clinical rehabilitation, and commercial VR gaming systems may have mixed effects in patients with stroke. Therefore, we developed RehabMaster™, a task-specific interactive game-based VR system for post-stroke rehabilitation of the upper extremities, and assessed its usability and clinical efficacy. A participatory design and usability tests were carried out for development of RehabMaster with representative user groups. Two clinical trials were then performed. The first was an observational study in which seven patients with chronic stroke received 30 minutes of RehabMaster intervention per day for two weeks. The second was a randomised controlled trial of 16 patients with acute or subacute stroke who received 10 sessions of conventional occupational therapy only (OT-only group) or conventional occupational therapy plus 20 minutes of RehabMaster intervention (RehabMaster + OT group). The Fugl-Meyer Assessment score (FMA), modified Barthel Index (MBI), adverse effects, and drop-out rate were recorded. The requirements of a VR system for stroke rehabilitation were established and incorporated into RehabMaster. The reported advantages from the usability tests were improved attention, the immersive flow experience, and individualised intervention. The first clinical trial showed that the RehabMaster intervention improved the FMA (P = .03) and MBI (P = .04) across evaluation times. The second trial revealed that the addition of RehabMaster intervention tended to enhance the improvement in the FMA (P = .07) but did not affect the improvement in the MBI. One patient with chronic stroke left the trial, and no adverse effects were reported. The RehabMaster is a feasible and safe VR system for enhancing upper extremity function in patients with stroke.

A task-specific interactive game-based virtual reality rehabilitation system for patients with stroke: a usability test and two clinical experiments

PubMed Central

2014-01-01

Background Virtual reality (VR) is not commonly used in clinical rehabilitation, and commercial VR gaming systems may have mixed effects in patients with stroke. Therefore, we developed RehabMaster™, a task-specific interactive game-based VR system for post-stroke rehabilitation of the upper extremities, and assessed its usability and clinical efficacy. Methods A participatory design and usability tests were carried out for development of RehabMaster with representative user groups. Two clinical trials were then performed. The first was an observational study in which seven patients with chronic stroke received 30 minutes of RehabMaster intervention per day for two weeks. The second was a randomised controlled trial of 16 patients with acute or subacute stroke who received 10 sessions of conventional occupational therapy only (OT-only group) or conventional occupational therapy plus 20 minutes of RehabMaster intervention (RehabMaster + OT group). The Fugl-Meyer Assessment score (FMA), modified Barthel Index (MBI), adverse effects, and drop-out rate were recorded. Results The requirements of a VR system for stroke rehabilitation were established and incorporated into RehabMaster. The reported advantages from the usability tests were improved attention, the immersive flow experience, and individualised intervention. The first clinical trial showed that the RehabMaster intervention improved the FMA (P = .03) and MBI (P = .04) across evaluation times. The second trial revealed that the addition of RehabMaster intervention tended to enhance the improvement in the FMA (P = .07) but did not affect the improvement in the MBI. One patient with chronic stroke left the trial, and no adverse effects were reported. Conclusions The RehabMaster is a feasible and safe VR system for enhancing upper extremity function in patients with stroke. PMID:24597650

Web-Based Intervention for Nutritional Management in Cystic Fibrosis: Development, Usability, and Pilot Trial.

PubMed

Stark, Lori J; Opipari-Arrigan, Lisa; Filigno, Stephanie S; Simon, Stacey L; Leonard, Amanda; Mogayzel, Peter J; Rausch, Joseph; Zion, Cynthia; Powers, Scott W

2016-06-01

Usability and pilot testing of a web intervention (BeInCharge.org [BIC]) of behavior plus nutrition intervention for children with cystic fibrosis (CF) ages 4-9 years. Think Aloud methodology was used with five mothers to assess usability and refine the intervention. A pilot trial was then conducted with 10 mothers of children with CF ages 4-9 years randomized to the web-based BIC or a Standard Care Control (STC). Change in weight gain for each group was compared in a pre-to-post design. Mothers rated the usability and clarity of BIC highly. The pilot trial showed children of mothers who received BIC had a significant change in weight pre-to-post-treatment (0.67 kg, p = .04). Change for the STC was not significant (0.41 kg, p = .10). A web-based behavior plus nutrition intervention appears promising in increasing weight gain in children with CF. © The Author 2015. Published by Oxford University Press on behalf of the Society of Pediatric Psychology. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

Evaluating the Usability of Pinchigator, a system for Navigating Virtual Worlds using Pinch Gloves

NASA Technical Reports Server (NTRS)

Hamilton, George S.; Brookman, Stephen; Dumas, Joseph D. II; Tilghman, Neal

2003-01-01

Appropriate design of two dimensional user interfaces (2D U/I) utilizing the well known WIMP (Window, Icon, Menu, Pointing device) environment for computer software is well studied and guidance can be found in several standards. Three-dimensional U/I design is not nearly so mature as 2D U/I, and standards bodies have not reached consensus on what makes a usable interface. This is especially true when the tools for interacting with the virtual environment may include stereo viewing, real time trackers and pinch gloves instead of just a mouse & keyboard. Over the last several years the authors have created a 3D U/I system dubbed Pinchigator for navigating virtual worlds based on the dVise dV/Mockup visualization software, Fakespace Pinch Gloves and Pohlemus trackers. The current work is to test the usability of the system on several virtual worlds, suggest improvements to increase Pinchigator s usability, and then to generalize about what was learned and how those lessons might be applied to improve other 3D U/I systems.

Supporting Caregivers of Children With Acute Lymphoblastic Leukemia via a Smartphone App: A Pilot Study of Usability and Effectiveness.

PubMed

Wang, Jingting; Yao, Nengliang; Shen, Min; Zhang, Xiaoyan; Wang, Yuanyuan; Liu, Yanyan; Geng, Zhaohui; Yuan, Changrong

2016-11-01

Smartphone applications are widely used for self-help interventions in adult cancer survivors. However, applications for parents of pediatric cancer patients are limited. We developed an applications to assist parents of children with acute lymphoblastic leukemia. The aim of this study is to evaluate the app's usability and effectiveness in a preliminary way. A stepwise approach and mixed methods were used. The application was initially tested by healthcare providers, and their comments and suggestions were used to develop an updated version. This version was tested by parents of children with acute lymphoblastic leukemia. Comments and nonverbal expressions of parents were recorded during a 2-week pilot test. The qualitative study was followed by a quantitative study using audit log data from the administration portal to understand how parents use the application. Six healthcare providers and 15 parents participated. Parents gained a greater knowledge of leukemia, confidence in caregiving, social support, and information on how to reduce stress. Over usability was rated as stable, useful, simple, and self-explanatory. No software failure occurred. Applications have the potential to support caregivers of pediatric cancer patients. We plan to address limitations and perform an empirical interventional study to examine its clinical effectiveness.

Development and field testing of Teen Pocket PATH®, a mobile health application to improve medication adherence in adolescent solid organ recipients

PubMed Central

Shellmer, Diana A.; Dew, Mary Amanda; Mazariegos, George; Dabbs, Annette DeVito

2017-01-01

Applying principles of user-centered design, we iteratively developed and tested the prototype of TPP, an mHealth application to promote medication adherence and enhance communication about medication management between adolescents and primary caregivers. A purposive sample of seven adolescent solid organ transplant recipients who were ≥one yr post-transplant and their primary caregivers participated. Participants completed up to three face-to-face laboratory usability sessions, a 6-week field test, and a debriefing session. Primary caregivers participated in an additional usability telephone session. Participants completed usability and satisfaction measures. Sample included liver (n = 4), heart (n = 2), and lung (n = 1) recipients aged 11–18 yr (57% were female, 86% were Caucasian), and nine primary caregivers aged 42–61 yr (88.9% were parents, 88% were female, 88% were Caucasian). Ninety percent of the adolescents endorsed the graphs or logs of missed/late medication dosing as useful and 100% endorsed the remaining features (e.g., medication list, dose time reminders/warnings) as useful. All adolescents expressed interest in using TPP for monitoring medications and satisfaction with the automatic messaging between adolescent and caregiver versions of the application. Adolescents unanimously found TPP easy to use. TPP shows promise as an mHealth adherence tool. PMID:26916967

Tailored prevention of inpatient falls: development and usability testing of the fall TIPS toolkit.

PubMed

Zuyev, Lyubov; Benoit, Angela N; Chang, Frank Y; Dykes, Patricia C

2011-02-01

Patient falls and fall-related injuries are serious problems in hospitals. The Fall TIPS application aims to prevent patient falls by translating routine nursing fall risk assessment into a decision support intervention that communicates fall risk status and creates a tailored evidence-based plan of care that is accessible to the care team, patients, and family members. In our design and implementation of the Fall TIPS toolkit, we used the Spiral Software Development Life Cycle model. Three output tools available to be generated from the toolkit are bed poster, plan of care, and patient education handout. A preliminary design of the application was based on initial requirements defined by project leaders and informed by focus groups with end users. Preliminary design partially simulated the paper version of the Morse Fall Scale currently used in hospitals involved in the research study. Strengths and weaknesses of the first prototype were identified by heuristic evaluation. Usability testing was performed at sites where research study is implemented. Suggestions mentioned by end users participating in usability studies were either directly incorporated into the toolkit and output tools, were slightly modified, or will be addressed during training. The next step is implementation of the fall prevention toolkit on the pilot testing units.

Debunking Health IT Usability Myths

PubMed Central

Staggers, N.; Xiao, Y.; Chapman, L.

2013-01-01

Poor usability is a threat to patient safety and linked to productivity loss, workflow disruption, user frustration, sub-optimal product use and system de-installations. Although usability is receiving more attention nationally and internationally, myths about usability persist. This editorial debunks five common myths about usability (1) usability only concerns the look and feel of a product and is, therefore, only a minor concern, (2) usability is not measurable, (3) usability stifles innovation, (4) vendors are solely responsible for product usability, and (5) usability methods are not practical for use in healthcare. PMID:23874361

Using Wearable Computers in Shuttle Processing: A Feasibility Study

NASA Technical Reports Server (NTRS)

Centeno, Martha A.; Correa, Daisy; Groh-Hammond, Marcia

2001-01-01

Shuttle processing operations are performed following prescribed instructions compiled in a Work Authorization Document (WAD). Until very recently, WADs were printed so that they could be properly executed, including the buy off of each and every step by the appropriate authorizing agent. However, with the development of EPICs, Maximo, and PeopleSoft applications, some of these documents are now available in electronic format; hence, it is possible for technicians and engineers to access them on line and buy off the steps electronically. To take full advantage of these developments, technicians need access to such documents at the point of job execution. Body wearable computers present an opportunity to develop a WAD delivery system that enables access while preserving technician's mobility, safety levels, and quality of work done. The primary objectives of this project were to determine if body wearable computers are a feasible delivery system for WADs. More specifically, identify and recommend specific brands of body wearable computers readily available on the market. Thus, this effort has field-tested this technology in two areas of shuttle processing, and it has examined the usability of the technology. Results of two field tests and a Human Factors Usability Test are presented. Section 2 provides a description of the body wearable computer technology. Section 3 presents the test at the Space Shuttle Main Engine (SSME) Shop. Section 4 presents the results of the integration test at the Solid Rocket Boosters Assembly and Refurbishing Facility (SRBARF). Section 5 presents the results of the usability test done at the Operations Support Building (OSB).

Usability evaluation of cloud-based mapping tools for the display of very large datasets

NASA Astrophysics Data System (ADS)

Stotz, Nicole Marie

The elasticity and on-demand nature of cloud services have made it easier to create web maps. Users only need access to a web browser and the Internet to utilize cloud based web maps, eliminating the need for specialized software. To encourage a wide variety of users, a map must be well designed; usability is a very important concept in designing a web map. Fusion Tables, a new product from Google, is one example of newer cloud-based distributed GIS services. It allows for easy spatial data manipulation and visualization, within the Google Maps framework. ESRI has also introduced a cloud based version of their software, called ArcGIS Online, built on Amazon's EC2 cloud. Utilizing a user-centered design framework, two prototype maps were created with data from the San Diego East County Economic Development Council. One map was built on Fusion Tables, and another on ESRI's ArcGIS Online. A usability analysis was conducted and used to compare both map prototypes in term so of design and functionality. Load tests were also ran, and performance metrics gathered on both map prototypes. The usability analysis was taken by 25 geography students, and consisted of time based tasks and questions on map design and functionality. Survey participants completed the time based tasks for the Fusion Tables map prototype quicker than those of the ArcGIS Online map prototype. While response was generally positive towards the design and functionality of both prototypes, overall the Fusion Tables map prototype was preferred. For the load tests, the data set was broken into 22 groups for a total of 44 tests. While the Fusion Tables map prototype performed more efficiently than the ArcGIS Online prototype, differences are almost unnoticeable. A SWOT analysis was conducted for each prototype. The results from this research point to the Fusion Tables map prototype. A redesign of this prototype would incorporate design suggestions from the usability survey, while some functionality would need to be dropped. This is a free product and would therefore be the best option if cost is an issue, but this map may not be supported in the future.

47 CFR 87.303 - Frequencies.

Code of Federal Regulations, 2010 CFR

2010-10-01

... telecommand operations for flight testing of aircraft and missiles, or their major components. The bands 2310... expendable and re-usable launch vehicles, whether or not such operations involve flight testing: 2364.5, 2370... Flight Test Stations § 87.303 Frequencies. (a) These frequencies are available for assignment to flight...

Mind the Gap. A systematic review to identify usability and safety challenges and practices during electronic health record implementation.

PubMed

Ratwani, Raj; Fairbanks, Terry; Savage, Erica; Adams, Katie; Wittie, Michael; Boone, Edna; Hayden, Andrew; Barnes, Janey; Hettinger, Zach; Gettinger, Andrew

2016-11-16

Decisions made during electronic health record (EHR) implementations profoundly affect usability and safety. This study aims to identify gaps between the current literature and key stakeholders' perceptions of usability and safety practices and the challenges encountered during the implementation of EHRs. Two approaches were used: a literature review and interviews with key stakeholders. We performed a systematic review of the literature to identify usability and safety challenges and best practices during implementation. A total of 55 articles were reviewed through searches of PubMed, Web of Science and Scopus. We used a qualitative approach to identify key stakeholders' perceptions; semi-structured interviews were conducted with a diverse set of health IT stakeholders to understand their current practices and challenges related to usability during implementation. We used a grounded theory approach: data were coded, sorted, and emerging themes were identified. Conclusions from both sources of data were compared to identify areas of misalignment. We identified six emerging themes from the literature and stakeholder interviews: cost and resources, risk assessment, governance and consensus building, customization, clinical workflow and usability testing, and training. Across these themes, there were misalignments between the literature and stakeholder perspectives, indicating major gaps. Major gaps identified from each of six emerging themes are discussed as critical areas for future research, opportunities for new stakeholder initiatives, and opportunities to better disseminate resources to improve the implementation of EHRs. Our analysis identified practices and challenges across six different emerging themes, illustrated important gaps, and results suggest critical areas for future research and dissemination to improve EHR implementation.

Usability and Safety in Electronic Medical Records Interface Design: A Review of Recent Literature and Guideline Formulation.

PubMed

Zahabi, Maryam; Kaber, David B; Swangnetr, Manida

2015-08-01

The objectives of this study were to (a) review electronic medical record (EMR) and related electronic health record (EHR) interface usability issues, (b) review how EMRs have been evaluated with safety analysis techniques along with any hazard recognition, and (c) formulate design guidelines and a concept for enhanced EMR interfaces with a focus on diagnosis and documentation processes. A major impact of information technology in health care has been the introduction of EMRs. Although numerous studies indicate use of EMRs to increase health care quality, there remain concerns with usability issues and safety. A literature search was conducted using Compendex, PubMed, CINAHL, and Web of Science databases to find EMR research published since 2000. Inclusion criteria included relevant English-language papers with subsets of keywords and any studies (manually) identified with a focus on EMR usability. Fifty studies met the inclusion criteria. Results revealed EMR and EHR usability problems to include violations of natural dialog, control consistency, effective use of language, effective information presentation, and customization principles as well as a lack of error prevention, minimization of cognitive load, and feedback. Studies focusing on EMR system safety made no objective assessments and applied only inductive reasoning methods for hazard recognition. On the basis of the identified usability problems and structure of safety analysis techniques, we provide EMR design guidelines and a design concept focused on the diagnosis process and documentation. The design guidelines and new interface concept can be used for prototyping and testing enhanced EMRs. © 2015, Human Factors and Ergonomics Society.

Development of MijnAVL, an Interactive Portal to Empower Breast and Lung Cancer Survivors: An Iterative, Multi-Stakeholder Approach.

PubMed

Kuijpers, Wilma; Groen, Wim G; Oldenburg, Hester Sa; Wouters, Michel Wjm; Aaronson, Neil K; van Harten, Wim H

2015-01-22

MijnAVL (MyAVL) is an interactive portal being developed to empower cancer survivors. Literature review and focus groups yielded the selection of features such as access to the electronic medical record (EMR), patient reported outcomes (PROs) and related feedback, and a physical activity support program. Our aim was to present a final design of MijnAVL based on (1) health professionals' evaluation of proposed features, (2) cancer survivors' evaluation of a first draft, and (3) cancer survivors' evaluation of a functional online prototype. Professionals from various disciplines gave input to the content of and procedures related to MijnAVL. Subsequently, 16 cancer survivors participated in an interview to evaluate content and graphic design of a first draft (shown with screenshots). Finally, 7 survivors participated in a usability test with a fully functional prototype. They performed predefined tasks (eg, logging in, finding a test result, completing a questionnaire) while thinking aloud. Descriptive statistics and simple content analysis were used to analyze the data of both the interviews and the usability tests. Professionals supported access to the EMR (eg, histology reports, lab results, and their letters to general practitioners). They also informed the development of PROs and the physical activity support program. Based on the first draft, survivors selected the preferred graphic design, approved the features and provided suggestions for the content (eg, explanation of medical jargon, more concise texts, notification by emails). Usability tests revealed that it was relatively easy to navigate the website and use the different features. Recommendations included, among others, a frequently asked questions section and the use of hyperlinks between different parts of the website. The development of MijnAVL, an interactive portal to empower breast and lung cancer survivors, was performed iteratively and involved multiple groups of end-users. This approach resulted in a usable and understandable final version. Its effectiveness should be determined in further research.

Development of MijnAVL, an Interactive Portal to Empower Breast and Lung Cancer Survivors: An Iterative, Multi-Stakeholder Approach

PubMed Central

Kuijpers, Wilma; Groen, Wim G; Oldenburg, Hester SA; Wouters, Michel WJM; Aaronson, Neil K

2015-01-01

Background MijnAVL (MyAVL) is an interactive portal being developed to empower cancer survivors. Literature review and focus groups yielded the selection of features such as access to the electronic medical record (EMR), patient reported outcomes (PROs) and related feedback, and a physical activity support program. Objective Our aim was to present a final design of MijnAVL based on (1) health professionals' evaluation of proposed features, (2) cancer survivors’ evaluation of a first draft, and (3) cancer survivors’ evaluation of a functional online prototype. Methods Professionals from various disciplines gave input to the content of and procedures related to MijnAVL. Subsequently, 16 cancer survivors participated in an interview to evaluate content and graphic design of a first draft (shown with screenshots). Finally, 7 survivors participated in a usability test with a fully functional prototype. They performed predefined tasks (eg, logging in, finding a test result, completing a questionnaire) while thinking aloud. Descriptive statistics and simple content analysis were used to analyze the data of both the interviews and the usability tests. Results Professionals supported access to the EMR (eg, histology reports, lab results, and their letters to general practitioners). They also informed the development of PROs and the physical activity support program. Based on the first draft, survivors selected the preferred graphic design, approved the features and provided suggestions for the content (eg, explanation of medical jargon, more concise texts, notification by emails). Usability tests revealed that it was relatively easy to navigate the website and use the different features. Recommendations included, among others, a frequently asked questions section and the use of hyperlinks between different parts of the website. Conclusions The development of MijnAVL, an interactive portal to empower breast and lung cancer survivors, was performed iteratively and involved multiple groups of end-users. This approach resulted in a usable and understandable final version. Its effectiveness should be determined in further research. PMID:25614924

Development of Decision Support Formulas for the Prediction of Bladder Outlet Obstruction and Prostatic Surgery in Patients With Lower Urinary Tract Symptom/Benign Prostatic Hyperplasia: Part II, External Validation and Usability Testing of a Smartphone App.

PubMed

Choo, Min Soo; Jeong, Seong Jin; Cho, Sung Yong; Yoo, Changwon; Jeong, Chang Wook; Ku, Ja Hyeon; Oh, Seung-June

2017-04-01

We aimed to externally validate the prediction model we developed for having bladder outlet obstruction (BOO) and requiring prostatic surgery using 2 independent data sets from tertiary referral centers, and also aimed to validate a mobile app for using this model through usability testing. Formulas and nomograms predicting whether a subject has BOO and needs prostatic surgery were validated with an external validation cohort from Seoul National University Bundang Hospital and Seoul Metropolitan Government-Seoul National University Boramae Medical Center between January 2004 and April 2015. A smartphone-based app was developed, and 8 young urologists were enrolled for usability testing to identify any human factor issues of the app. A total of 642 patients were included in the external validation cohort. No significant differences were found in the baseline characteristics of major parameters between the original (n=1,179) and the external validation cohort, except for the maximal flow rate. Predictions of requiring prostatic surgery in the validation cohort showed a sensitivity of 80.6%, a specificity of 73.2%, a positive predictive value of 49.7%, and a negative predictive value of 92.0%, and area under receiver operating curve of 0.84. The calibration plot indicated that the predictions have good correspondence. The decision curve showed also a high net benefit. Similar evaluation results using the external validation cohort were seen in the predictions of having BOO. Overall results of the usability test demonstrated that the app was user-friendly with no major human factor issues. External validation of these newly developed a prediction model demonstrated a moderate level of discrimination, adequate calibration, and high net benefit gains for predicting both having BOO and requiring prostatic surgery. Also a smartphone app implementing the prediction model was user-friendly with no major human factor issue.

Quality assurance in the EORTC 22033-26033/CE5 phase III randomized trial for low grade glioma: the digital individual case review.

PubMed

Fairchild, Alysa; Weber, Damien C; Bar-Deroma, Raquel; Gulyban, Akos; Fenton, Paul A; Stupp, Roger; Baumert, Brigitta G

2012-06-01

The phase III EORTC 22033-26033/NCIC CE5 intergroup trial compares 50.4 Gy radiotherapy with up-front temozolomide in previously untreated low-grade glioma. We describe the digital EORTC individual case review (ICR) performed to evaluate protocol radiotherapy (RT) compliance. Fifty-eight institutions were asked to submit 1-2 randomly selected cases. Digital ICR datasets were uploaded to the EORTC server and accessed by three central reviewers. Twenty-seven parameters were analysed including volume delineation, treatment planning, organ at risk (OAR) dosimetry and verification. Consensus reviews were collated and summary statistics calculated. Fifty-seven of seventy-two requested datasets from forty-eight institutions were technically usable. 31/57 received a major deviation for at least one section. Relocation accuracy was according to protocol in 45. Just over 30% had acceptable target volumes. OAR contours were missing in an average of 25% of cases. Up to one-third of those present were incorrectly drawn while dosimetry was largely protocol compliant. Beam energy was acceptable in 97% and 48 patients had per protocol beam arrangements. Digital RT plan submission and review within the EORTC 22033-26033 ICR provide a solid foundation for future quality assurance procedures. Strict evaluation resulted in overall grades of minor and major deviation for 37% and 32%, respectively. Copyright © 2012 Elsevier Ireland Ltd. All rights reserved.

Usability of a CKD educational website targeted to patients and their family members.

PubMed

Diamantidis, Clarissa J; Zuckerman, Marni; Fink, Wanda; Hu, Peter; Yang, Shiming; Fink, Jeffrey C

2012-10-01

Web-based technology is critical to the future of healthcare. As part of the Safe Kidney Care cohort study evaluating patient safety in CKD, this study determined how effectively a representative sample of patients with CKD or family members could interpret and use the Safe Kidney Care website (www.safekidneycare.org), an informational website on safety in CKD. Between November of 2011 and January of 2012, persons with CKD or their family members underwent formal usability testing administered by a single interviewer with a second recording observer. Each participant was independently provided a list of 21 tasks to complete, with each task rated as either easily completed/noncritical error or critical error (user cannot complete the task without significant interviewer intervention). Twelve participants completed formal usability testing. Median completion time for all tasks was 17.5 minutes (range=10-44 minutes). In total, 10 participants had greater than or equal to one critical error. There were 55 critical errors in 252 tasks (22%), with the highest proportion of critical errors occurring when participants were asked to find information on treatments that may damage kidneys, find the website on the internet, increase font size, and scroll to the bottom of the webpage. Participants were generally satisfied with the content and usability of the website. Web-based educational materials for patients with CKD should target a wide range of computer literacy levels and anticipate variability in competency in use of the computer and internet.

Adapting a Psychosocial Intervention for Smartphone Delivery to Middle-Aged and Older Adults with Serious Mental Illness.

PubMed

Whiteman, Karen L; Lohman, Matthew C; Gill, Lydia E; Bruce, Martha L; Bartels, Stephen J

2017-08-01

To describe the process of adapting an integrated medical and psychiatric self-management intervention to a smartphone application for middle-aged and older adults with serious mental illness using an adaptive systems engineering framework and user-centered design. First, we determined the technical abilities and needs of middle-aged and older adults with serious mental illnesses using smartphones. Then, we developed smartphone content through principles of user-centered design and modified an existing smartphone platform. Finally, we conducted a usability test using "think aloud" and verbal probing. We adapted a psychosocial self-management intervention to a smartphone application and tested its usability. Ten participants (mean age: 55.3 years, SD: 6.2 years) with serious mental illness and comorbid chronic health conditions reported a high level of usability and satisfaction with the smartphone application. Middle-aged and older adults with serious mental illness and limited technical abilities were able to participate in a process involving user-centered design and adaptation of a self-management intervention to be delivered by a smartphone. High usability ratings suggest that middle-aged and older adults with serious mental illness have the potential to use tailored smartphone interventions. Future research is indicated to establish effectiveness and to determine the type and intensity of clinical support needed to successfully implement smartphone applications as a component of community-based services for older adults with psychiatric and medical conditions. Copyright © 2017 American Association for Geriatric Psychiatry. Published by Elsevier Inc. All rights reserved.

Use of Online Machine Translation for Nursing Literature: A Questionnaire-Based Survey

PubMed Central

Anazawa, Ryoko; Ishikawa, Hirono; Takahiro, Kiuchi

2013-01-01

Background: The language barrier is a significant obstacle for nurses who are not native English speakers to obtain information from international journals. Freely accessible online machine translation (MT) offers a possible solution to this problem. Aim: To explore how Japanese nursing professionals use online MT and perceive its usability in reading English articles and to discuss what should be considered for better utilisation of online MT lessening the language barrier. Method: In total, 250 randomly selected assistants and research associates at nursing colleges across Japan answered a questionnaire examining the current use of online MT and perceived usability among Japanese nurses, along with the number of articles read in English and the perceived language barrier. The items were rated on Likert scales, and t-test, ANOVA, chi-square test, and Spearman’s correlation were used for analyses. Results: Of the participants, 73.8% had used online MT. More than half of them felt it was usable. The language barrier was strongly felt, and academic degrees and English proficiency level were associated factors. The perceived language barrier was related to the frequency of online MT use. No associated factor was found for the perceived usability of online MT. Conclusion: Language proficiency is an important factor for optimum utilisation of MT. A need for education in the English language, reading scientific papers, and online MT training was indicated. Cooperation with developers and providers of MT for the improvement of their systems is required. PMID:23459140

Evaluation of the Digital Alzheimer Center: Testing Usability and Usefulness of an Online Portal for Patients with Dementia and Their Carers.

PubMed

Hattink, Bart; Droes, Rose-Marie; Sikkes, Sietske; Oostra, Ellen; Lemstra, Afina W

2016-07-21

Dementia is a progressive and highly disabling neurodegenerative disease that will likely become highly prevalent in the future due to the globally aging population. To improve health care efficiency and quality for dementia care, eHealth could help with, for example, an online portal, such as the Digital Alzheimer Center (DAC) of the Vrije Universiteit Medical Center Amsterdam. It provides up-to-date disease information, peer-to-peer contact, and methods for contacting the hospital and health professionals. We aimed to investigate the usability and usefulness of the DAC for patients with dementia and carers to get insight into the feasibility and value of this eHealth app in dementia care and to recommend potential improvements. A descriptive study among patients, carers, and health care professionals was performed. Mixed methods were used, consisting of observations (n=10, 4 people with dementia, 6 carers), an online survey (n=287; 88 patients, 199 carers), and semistructured interviews (n=18; 6 patients, 6 carers, 6 health care professionals). During the observations, participants performed a set of five different prescribed tasks on the portal. Speed, number of errors, and navigation were noted. The online survey aimed to assess users' opinions on the portal's usability and usefulness. Semistructured interviews were conducted in a subsample of patients, carers, and health care professionals to gain more in-depth information. In the usability assessment, eight categories of errors were distinguished, of which three were of critical, two of medium, and three of low severity. In the survey, 45% (40/88) of the patients and 53% (105/199) of the carers indicated they used the portal. In all, 33% (12/36) of patients and 61% (62/102) of carers found it easy to learn to work with the portal. Most considered the DAC generally useful: 65% (17/26) of patients and 78% (67/86) of carers found the DAC useful, especially for understanding dementia (patients: 64%, 16/25; carers: 62%, 53/86). In the semistructured interviews, the site was generally rated positively on usability and usefulness and being well designed. People with dementia and carers indicated it helped them to understand and deal with dementia. To our knowledge, this is the first study investigating the usability and usefulness of an Internet portal especially designed for people with dementia and their carers. An online patient portal could be a useful means to help to support patients and carers in dealing with dementia: the majority of users positively evaluated usability and usefulness of the portal, and appreciated the information on it. However, only a minority of patients found it easy to work with the portal. Good design and frequent usability testing is essential to offer a good online portal.

Telecoil-mode hearing aid compatibility performance requirements for wireless and cordless handsets: magnetic signal-to-noise.

PubMed

Julstrom, Stephen; Kozma-Spytek, Linda; Isabelle, Scott

2011-09-01

During the revision of the American National Standards Institute (ANSI) C63.19 and the development of the ANSI/Telecommunications Industry Association-1083 hearing aid compatibility standards, it became evident that additional data concerning user acceptance of interfering magnetic noises generated by wireless and cordless telephones were needed in order to determine the requirements for telecoil-coupling compatibility. Further insight was needed into the magnetic signal-to-noise (S/N) ratios required to achieve specific levels of telephone usability by hearing aid wearers. (A companion article addresses magnetic signal level requirements.) Test subjects used their own hearing aids. The magnetic signals were applied through large magnetic head-worn coils, selected for the field orientation appropriate for each hearing aid. After adjusting their aid's volume control to an acoustic speech reference, the subjects adjusted the applied magnetic signal level to find their Most Comfortable Level (MCL). Each subject then adjusted the levels of six of eight different representative interfering noises to three levels of subjective telephone usability: "usable for a brief call," "acceptable for normal use," and "excellent performance." Each subject's objective noise audibility threshold in the presence of speech was also obtained for the various noise types. The 57 test subjects covered an age range of 22 to 79 yr, with a self-reported hearing loss duration of 12 to 72 yr. All had telecoils that they used for at least some telecommunications needs. The self-reported degree of hearing loss ranged from moderate to profound. A guided intake questionnaire yielded general background information for each subject. A test control box fed by prepared speech and noise recordings from computer files enabled the subject or the tester, depending on the portion of the test, to select A-weighting-normalized noise interference levels in 1.25 dB steps relative to the selected MCL. For each subject for each tested noise type, the values for the selected S/N ratios were recorded for the three categories of subjective usability and the objective noise threshold. About half of the test subjects needed a minimum 21 dB S/N ratio for them to consider their listening experience "acceptable for normal use" of a telephone. With a 30 dB S/N ratio, about 85% of the subjects reported normal use acceptability. Significant differences were apparent in the measured S/N user requirements among the noise types, though, indicating a deficiency in an A-weighted level measurement's ability to consistently predict the subjective acceptability of the various noises. An improved weighting function having both spectral and temporal components was developed to substantially eliminate these predictive inconsistencies. The interfering noise level that subjects chose for a telephone usability rating of "excellent performance" matched closely their objectively measured noise audibility threshold. A rating of "acceptable for normal use" was typically achieved at a 4 dB higher noise level, and a rating of "usable for a brief call," at a 10.4 dB higher noise level. These results did not relate significantly to noise type or to the subject's aided noise-in-speech hearing acuity. American Academy of Audiology.

Dry-powder inhalers in patients with persistent airflow limitation: usability and preference.

PubMed

Dal Negro, Roberto W; Povero, Massimiliano

2016-01-01

Inhalation devices represent per sé critical factors because they can affect the therapeutic outcomes independently of the drug used. The role of patients' usability and preference (PUP) for Dry Powder Inhalers (DPIs) is high indeed because they can influence the extent of the adherence to treatment and the therapeutic outcomes. Aim of the study was to assess and compare the PUP of three different DPIs in out-patients with persistent airflow limitation due to asthma or COPD. The PUP of three different DPIs (Breezhaler; Genuair; Handihaler) were investigated by means of the Handling Questionnaire in out-patients with persistent airflow limitation needing an inhalation therapy. Patients had to report their preference before and after the nurse's instruction on the handling of each device. The nurse had also to note the critical steps during the patient's procedure for actuation; to count the number of attempts needed for actuating the device properly, and to measure the time (in sec.) required for these procedures. Data were collected up to three attempts per device. Welch test was used for normal distributed variables, while the Wilcoxon test for not normal distributed variables. The χ (2) test and the ANOVA test were also used. Univariate and multivariate regressions were also performed in order to investigate the effect of patients' characteristics and of technical differences of each device on their proper use. Three hundred thirty-three consecutive out-patients (age range 55-58 years, and well matched for gender), with persistent airway limitation of different severity were investigated, suffering from bronchial asthma (n = 175) or from chronic obstructive pulmonary disease (COPD) (n = 158). In particular, 127 patients (38 %) tested the three DPIs, while 110 (33 %) tested Breezhaler and Genuair, and 96 (29 %) Breezhaler and Handihaler. More than 50 % of patients who tested all devices preferred the Genuair and perceived this device as the easiest to use. The nurse's judgement confirmed their opinion. When compared to the other two DPIs, Genuair proved the least problematic either according to the patients' judgement and to the nurse's opinion. Mean number of attempts aimed to achieving the first proper actuation was lower with Genuair than with Breezhaler and Handihaler (1.5 vs 2.5-2.6, p < 0.0001). Finally, Genuair also proved the easiest to use and the least problematic according to the nurse judgement (0.0001), the most easily learned (0.0001), and that one with a successful rate of more than 56 % at the first attempt. Breezhaler and Handihaler needed an average of about one additional attempt to be used properly (p < 0.0001), and their usability proved significantly more difficult (OR of successful rate between 0.15 and 0.17, p < 0.001). In general, older patients needed more attempts to perform their first proper inhalation; their successful rate was lower, and they needed more time to learn how to use devices properly: with Genuair these differences were minimized. The possibility of grading objectively the performance of different DPIs in terms of their usability and therapeutic convenience in daily life represents a crucial operational opportunity to pursue. To note that a substantial discrepancy exists between the patients' belief "at glance" and the patients' effective usability with can be registered with some devices. From a general point of view, devices requiring less manual actions for their actuation confirmed their better usability and proper handling after less attempts. In particular, Genuair came out as the most preferred DPI also when several different aspects of preference and usability are assessed objectively and compared.

A methodological approach for designing a usable ontology-based GUI in healthcare.

PubMed

Lasierra, N; Kushniruk, A; Alesanco, A; Borycki, E; García, J

2013-01-01

This paper presents a methodological approach to the design and evaluation of an interface for an ontology-based system used for designing care plans for monitoring patients at home. In order to define the care plans, physicians need a tool for creating instances of the ontology and configuring some rules. Our purpose is to develop an interface to allow clinicians to interact with the ontology. Although ontology-driven applications do not necessarily present the ontology in the user interface, it is our hypothesis that showing selected parts of the ontology in a "usable" way could enhance clinician's understanding and make easier the definition of the care plans. Based on prototyping and iterative testing, this methodology combines visualization techniques and usability methods. Preliminary results obtained after a formative evaluation indicate the effectiveness of suggested combination.

A user experience evaluation of Amazon Kindle mobile application

NASA Astrophysics Data System (ADS)

Hussain, Azham; Mkpojiogu, Emmanuel O. C.; Musa, Ja'afaru; Mortada, Salah

2017-10-01

There is a dramatic increase in the development of mobile applications in recent years. This makes the usability evaluation of these mobile applications an important aspect in the advancement and application of technology. In this paper, a laboratory-based usability evaluation was carried out on the Amazon Kindle app using 15 users who performed 5 tasks on the Kindle e-book mobile app. A post-test questionnaire was administered to elicit users' perception on the usability of the application. The results demonstrate that almost all the participants were satisfied with services provided by the Amazon Kindle e-book mobile app. On all the four user experience factors examined, namely, perceived ease-of-use, perceived visibility, perceived enjoyabilty, and perceived efficiency, the evaluation outcome shows that the participants had a good and rich mobile experience with the application.

Computer Administered Safety Planning for Individuals at Risk for Suicide: Development and Usability Testing.

PubMed

Boudreaux, Edwin D; Brown, Gregory K; Stanley, Barbara; Sadasivam, Rajani S; Camargo, Carlos A; Miller, Ivan W

2017-05-15

Safety planning is a brief intervention that has become an accepted practice in many clinical settings to help prevent suicide. Even though it is quick compared to other approaches, it frequently requires 20 min or more to complete, which can impede adoption. A self-administered, Web-based safety planning application could potentially reduce clinician time, help promote standardization and quality, and provide enhanced ability to share the created plan. The aim of this study was to design, build, and test the usability of a Web-based, self-administered safety planning application. We employed a user-centered software design strategy led by a multidisciplinary team. The application was tested for usability with a target sample of suicidal patients. Detailed observations, structured usability ratings, and Think Aloud procedures were used. Suicidal ideation intensity and perceived ability to cope were assessed pre-post engagement with the Web application. A total of 30 participants were enrolled. Usability ratings were generally strong, and all patients successfully built a safety plan. However, the completeness of the safety plan varied. The mean number of steps completed was 5.5 (SD 0.9) out of 6, with 90% (27/30) of participants completing at least 5 steps and 67% (20/30) completing all 6 steps. Some safety planning steps were viewed as inapplicable to some individuals. Some confusion in instructions led to modifications to improve understandability of each step. Ratings of suicide intensity after completion of the application were significantly lower than preratings, pre: mean 5.11 (SD 2.9) versus post: mean 4.46 (SD 3.0), t 27 =2.49, P=.02. Ratings of ability to cope with suicidal thoughts after completion of the application were higher than preratings, with the difference approaching statistical significance, pre: mean 5.93 (SD 2.9), post: mean 6.64 (SD 2.4), t 27 =-2.03, P=.05. We have taken the first step toward identifying the components needed to maximize usability of a self-administered, Web-based safety planning application. Results support initial consideration of the application as an adjunct to clinical contact. This allows for the clinician or other personnel to provide clarification, when needed, to help the patient build the plan, and to help review and revise the draft. ©Edwin D Boudreaux, Gregory K Brown, Barbara Stanley, Rajani S Sadasivam, Carlos A Camargo Jr, Ivan W Miller. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 15.05.2017.

The Usability of Diabetes MAP: A Web-delivered Intervention for Improving Medication Adherence.

PubMed

Nelson, Lyndsay A; Bethune, Magaela C; Lagotte, Andrea E; Osborn, Chandra Y

2016-05-12

Web-delivered interventions are a feasible approach to health promotion. However, if a website is poorly designed, difficult to navigate, and has technical bugs, it will not be used as intended. Usability testing prior to evaluating a website's benefits can identify barriers to user engagement and maximize future use. We developed a Web-delivered intervention called Diabetes Medication Adherence Promotion (Diabetes MAP) and used a mixed-methods approach to test its usability prior to evaluating its efficacy on medication adherence and glycemic control in a randomized controlled trial. We recruited English-speaking adults with type 2 diabetes mellitus (T2DM) from an academic medical center who were prescribed diabetes medications. A trained research assistant administered a baseline survey, collected medical record information, and instructed participants on how to access Diabetes MAP. Participants were asked to use the site independently for 2 weeks and to provide survey and/or focus group feedback on their experience. We analyzed survey data descriptively and qualitative data thematically to identify participants' favorable and unfavorable experiences, characterize usability concerns, and solicit recommendations for improving Diabetes MAP. Enrolled participants (N=32) were an average of 51.7 ± 11.8 years old, 66% (21/32) female, 60% (19/32) non-Hispanic White, 88% (28/32) had more than 12 years of education, half had household incomes over $50,000, and 78% (25/32) were privately insured. Average duration of diagnosed diabetes was 7.8 ± 6.3 years, average A1c was 7.4 ± 2.0, and 38% (12/32) were prescribed insulin. Of enrolled participants, 91% (29/32) provided survey and/or focus group feedback about Diabetes MAP. On the survey, participants agreed website information was clear and easy to understand, but in focus groups they reported navigational challenges and difficulty overcoming user errors (eg, entering data in an unspecified format). Participants also reported difficulty accessing the site and, once accessed, using all of its features. Participants recommended improving the site's user interface to facilitate quick, efficient access to all features and content. Adults with T2DM rated the Diabetes MAP website favorably on surveys, but focus groups gave more in-depth feedback on the user experience (eg, difficulty accessing the site, maximizing all of the site's features and content, and recovering from errors). Appropriate usability testing methods ensure Web-delivered interventions work as intended and any benefits are not diminished by usability challenges.

The Usability of Diabetes MAP: A Web-delivered Intervention for Improving Medication Adherence

PubMed Central

Nelson, Lyndsay A; Bethune, Magaela C; Lagotte, Andrea E

2016-01-01

Background Web-delivered interventions are a feasible approach to health promotion. However, if a website is poorly designed, difficult to navigate, and has technical bugs, it will not be used as intended. Usability testing prior to evaluating a website’s benefits can identify barriers to user engagement and maximize future use. Objective We developed a Web-delivered intervention called Diabetes Medication Adherence Promotion (Diabetes MAP) and used a mixed-methods approach to test its usability prior to evaluating its efficacy on medication adherence and glycemic control in a randomized controlled trial. Methods We recruited English-speaking adults with type 2 diabetes mellitus (T2DM) from an academic medical center who were prescribed diabetes medications. A trained research assistant administered a baseline survey, collected medical record information, and instructed participants on how to access Diabetes MAP. Participants were asked to use the site independently for 2 weeks and to provide survey and/or focus group feedback on their experience. We analyzed survey data descriptively and qualitative data thematically to identify participants’ favorable and unfavorable experiences, characterize usability concerns, and solicit recommendations for improving Diabetes MAP. Results Enrolled participants (N=32) were an average of 51.7 ± 11.8 years old, 66% (21/32) female, 60% (19/32) non-Hispanic White, 88% (28/32) had more than 12 years of education, half had household incomes over $50,000, and 78% (25/32) were privately insured. Average duration of diagnosed diabetes was 7.8 ± 6.3 years, average A1c was 7.4 ± 2.0, and 38% (12/32) were prescribed insulin. Of enrolled participants, 91% (29/32) provided survey and/or focus group feedback about Diabetes MAP. On the survey, participants agreed website information was clear and easy to understand, but in focus groups they reported navigational challenges and difficulty overcoming user errors (eg, entering data in an unspecified format). Participants also reported difficulty accessing the site and, once accessed, using all of its features. Participants recommended improving the site’s user interface to facilitate quick, efficient access to all features and content. Conclusions Adults with T2DM rated the Diabetes MAP website favorably on surveys, but focus groups gave more in-depth feedback on the user experience (eg, difficulty accessing the site, maximizing all of the site’s features and content, and recovering from errors). Appropriate usability testing methods ensure Web-delivered interventions work as intended and any benefits are not diminished by usability challenges. PMID:27174496

Constructing an Online Test Framework, Using the Example of a Sign Language Receptive Skills Test

ERIC Educational Resources Information Center

Haug, Tobias; Herman, Rosalind; Woll, Bencie

2015-01-01

This paper presents the features of an online test framework for a receptive skills test that has been adapted, based on a British template, into different sign languages. The online test includes features that meet the needs of the different sign language versions. Features such as usability of the test, automatic saving of scores, and score…

Web-Based Testing: Exploring the Relationship between Hardware Usability and Test Performance

ERIC Educational Resources Information Center

Huff, Kyle; Cline, Melinda; Guynes, Carl S.

2012-01-01

Web-based testing has recently become common in both academic and professional settings. A web-based test is administered through a web browser. Individuals may complete a web-based test at nearly any time and at any place. In addition, almost any computer lab can become a testing center. It is important to understand the environmental issues that…

Virtual reality rehabilitation of balance: assessment of the usability of the Nintendo Wii(®) Fit Plus.

PubMed

Meldrum, Dara; Glennon, Aine; Herdman, Susan; Murray, Deirdre; McConn-Walsh, Rory

2012-05-01

The aim of this study was to investigate the usability of the Nintendo Wii Fit Plus(®) (NWFP) in the treatment of balance impairment in vestibular and other neurological disease. This was a cross-sectional, quasi-experimental study. Participants (n = 26; mean age 43 ± 14, M13:F13) with quantified balance impairment took part in a 30-minute session on the NWFP using exercises and games that challenge balance. Outcomes included the System Usability Scale (SUS), a numerical rating scale of enjoyment and a post treatment questionnaire. The mean SUS score was high (mean 82 ± 18%) with only two participants rating below 50%. There was a negative correlation of age with SUS scores (r = -0.54; p = 0.004). Mean numerical rating scale score (/10) for enjoyment of the NWFP session was 8.4 ± 3. Of the participants, 88.5% said that they would like to use the NWFP in future treatment. Seventy-three percent reported more enjoyment and motivation than usual physiotherapy. No falls occurred during testing. This study has quantified the usability of the NWFP as a treatment for balance impairment showing high levels of usability and enjoyment with no serious adverse effects. The results of this study may assist physiotherapists in devising novel balance rehabilitation programmes. [Box: see text].

Serving Satellite Remote Sensing Data to User Community through the OGC Interoperability Protocols

NASA Astrophysics Data System (ADS)

di, L.; Yang, W.; Bai, Y.

2005-12-01

Remote sensing is one of the major methods for collecting geospatial data. Hugh amount of remote sensing data has been collected by space agencies and private companies around the world. For example, NASA's Earth Observing System (EOS) is generating more than 3 Tb of remote sensing data per day. The data collected by EOS are processed, distributed, archived, and managed by the EOS Data and Information System (EOSDIS). Currently, EOSDIS is managing several petabytes of data. All of those data are not only valuable for global change research, but also useful for local and regional application and decision makings. How to make the data easily accessible to and usable by the user community is one of key issues for realizing the full potential of these valuable datasets. In the past several years, the Open Geospatial Consortium (OGC) has developed several interoperability protocols aiming at making geospatial data easily accessible to and usable by the user community through Internet. The protocols particularly relevant to the discovery, access, and integration of multi-source satellite remote sensing data are the Catalog Service for Web (CS/W) and Web Coverage Services (WCS) Specifications. The OGC CS/W specifies the interfaces, HTTP protocol bindings, and a framework for defining application profiles required to publish and access digital catalogues of metadata for geographic data, services, and related resource information. The OGC WCS specification defines the interfaces between web-based clients and servers for accessing on-line multi-dimensional, multi-temporal geospatial coverage in an interoperable way. Based on definitions by OGC and ISO 19123, coverage data include all remote sensing images as well as gridded model outputs. The Laboratory for Advanced Information Technology and Standards (LAITS), George Mason University, has been working on developing and implementing OGC specifications for better serving NASA Earth science data to the user community for many years. We have developed the NWGISS software package that implements multiple OGC specifications, including OGC WMS, WCS, CS/W, and WFS. As a part of NASA REASON GeoBrain project, the NWGISS WCS and CS/W servers have been extended to provide operational access to NASA EOS data at data pools through OGC protocols and to make both services chainable in the web-service chaining. The extensions in the WCS server include the implementation of WCS 1.0.0 and WCS 1.0.2, and the development of WSDL description of the WCS services. In order to find the on-line EOS data resources, the CS/W server is extended at the backend to search metadata in NASA ECHO. This presentation reports those extensions and discuss lessons-learned on the implementation. It also discusses the advantage, disadvantages, and future improvement of OGC specifications, particularly the WCS.

Aging barriers influencing mobile health usability for older adults: A literature based framework (MOLD-US).

PubMed

Wildenbos, G A; Peute, Linda; Jaspers, Monique

2018-06-01

With the growing population of older adults as a potential user group of mHealth, the need increases for mHealth interventions to address specific aging characteristics of older adults. The existence of aging barriers to computer use is widely acknowledged. Yet, usability studies show that mHealth still fails to be appropriately designed for older adults and their expectations. To enhance designs of mHealth aimed at older adult populations, it is essential to gain insight into aging barriers that impact the usability of mHealth as experienced by these adults. This study aims to synthesize literature on aging barriers to digital (health) computer use, and explain, map and visualize these barriers in relation to the usability of mHealth by means of a framework. We performed a scoping review to synthesize and summarize reported physical and functional age barriers in relation to digital (mobile) health applications use. Aging barriers reported in the literature were mapped onto usability aspects categorized by Nielsen to explain their influence on user experience of mHealth. A framework (MOLD-US) was developed summarizing the evidence on the influence of aging barriers on mHealth use experienced by older adults. Four key categories of aging barriers influencing usability of mHealth were identified: cognition, motivation, physical ability and perception. Effective and satisfactory use of mHealth by older adults is complicated by cognition and motivation barriers. Physical ability and perceptual barriers further increase the risk of user errors and fail to notice important interaction tasks. Complexities of medical conditions, such as diminished eye sight related to diabetes or deteriorated motor skills as a result of rheumatism, can cause errors in user interaction. This research provides a novel framework for the exploration of aging barriers and their causes influencing mHealth usability in older adults. This framework allows for further systematic empirical testing and analysis of mHealth usability issues, as it enables results to be classified and interpreted based on impediments intrinsic to usability issues experienced by older adults. Importantly, the paper identifies a key need for future research on motivational barriers impeding mhealth use of older adults. More insights are needed in particular to disaggregating normal age related functional changes from specific medical conditions that influence experienced usefulness of mHealth by these adults. Copyright © 2018 Elsevier B.V. All rights reserved.

Interoperable PKI Data Distribution in Computational Grids

DOE Office of Scientific and Technical Information (OSTI.GOV)

Pala, Massimiliano; Cholia, Shreyas; Rea, Scott A.

One of the most successful working examples of virtual organizations, computational grids need authentication mechanisms that inter-operate across domain boundaries. Public Key Infrastructures(PKIs) provide sufficient flexibility to allow resource managers to securely grant access to their systems in such distributed environments. However, as PKIs grow and services are added to enhance both security and usability, users and applications must struggle to discover available resources-particularly when the Certification Authority (CA) is alien to the relying party. This article presents how to overcome these limitations of the current grid authentication model by integrating the PKI Resource Query Protocol (PRQP) into the Gridmore » Security Infrastructure (GSI).« less

A Digital Framework to Support Providers and Patients in Diabetes Related Behavior Modification.

PubMed

Abidi, Samina; Vallis, Michael; Piccinini-Vallis, Helena; Imran, Syed Ali; Abidi, Syed Sibte Raza

2017-01-01

We present Diabetes Web-Centric Information and Support Environment (D-WISE) that features: (a) Decision support tool to assist family physicians to administer Behavior Modification (BM) strategies to patients; and (b) Patient BM application that offers BM strategies and motivational interventions to engage patients. We take a knowledge management approach, using semantic web technologies, to model the social cognition theory constructs, Canadian diabetes guidelines and BM protocols used locally, in terms of a BM ontology that drives the BM decision support to physicians and BM strategy adherence monitoring and messaging to patients. We present the qualitative analysis of D-WISE usability by both physicians and patients.

Simple Peer-to-Peer SIP Privacy

NASA Astrophysics Data System (ADS)

Koskela, Joakim; Tarkoma, Sasu

In this paper, we introduce a model for enhancing privacy in peer-to-peer communication systems. The model is based on data obfuscation, preventing intermediate nodes from tracking calls, while still utilizing the shared resources of the peer network. This increases security when moving between untrusted, limited and ad-hoc networks, when the user is forced to rely on peer-to-peer schemes. The model is evaluated using a Host Identity Protocol-based prototype on mobile devices, and is found to provide good privacy, especially when combined with a source address hiding scheme. The contribution of this paper is to present the model and results obtained from its use, including usability considerations.

Five year follow-up of a smoking withdrawal clinic population.

PubMed Central

West, D W; Graham, S; Swanson, M; Wilkinson, G

1977-01-01

Eight hundred volunteers who attended smoking clinics at Roswell Park Memorial Institute from 1964-1965 were followed up five years later to ascertain their current smoking status. From three waves of a mailed questionnaire, plus a telephone campaign, we obtained 559 usable responses. The relationship between smoking status at the five-year follow-up and clinic protocols and selected social and psychological characteristics as determined during the clinics were examined. Of those individuals contacted five years after the clinic, 17.8 per cent were not smoking. Variations in clinic protocol in terms of drugs and education methods had no relation to long-term smoking withdrawal. Several social and psychological variables, however, were related to smoking behavior five years after the clinics. Non-smokers were more likely than smokers to be males, to be older, to have smoked less before the clinic, to have started smoking at a later age, to have a milieu that was supportive of their stopping, and to have fewer indices of neurosis and fewer psychosomatic symptoms. PMID:869086

Redesigning printed educational materials for primary care physicians: design improvements increase usability.

PubMed

Grudniewicz, Agnes; Bhattacharyya, Onil; McKibbon, K Ann; Straus, Sharon E

2015-11-04

Printed educational materials (PEMs) are a frequently used tool to disseminate clinical information and attempt to change behavior within primary care. However, their effect on clinician behavior is limited. In this study, we explored how PEMs can be redesigned to better meet the needs of primary care physicians (PCPs) and whether usability and selection can be increased when design principles and user preferences are used. We redesigned a publicly available PEM using physician preferences, design principles, and graphic designer support. We invited PCPs to select their preferred document between the redesigned and original versions in a discrete choice experiment, followed by an assessment of usability with the System Usability Scale and a think aloud process. We conducted this study in both a controlled and opportunistic setting to determine whether usability testing results vary by study location. Think aloud data was thematically analyzed, and results were interpreted using the Technology Acceptance Model. One hundred and eighty four PCPs participated in the discrete choice experiment at the 2014 Family Medicine Forum, a large Canadian conference for family physicians. Of these, 87.7 % preferred the redesigned version. Follow-up interviews were held with a randomly selected group of seven participants. We repeated this in a controlled setting in Toronto, Canada, with a set of 14 participants. Using the System Usability Scale, we found that usability scores were significantly increased with the redesign (p < 0.001). We also found that when PCPs were given the choice between the two versions, they selected the redesigned version as their preferred PEM more often than the original (p < 0.001). Results did not appear to differ between the opportunistic and controlled setting. We used the results of the think aloud process to add to a list of end user preferences developed in a previous study. We found that redesigning a PEM with user preferences and design principles can improve its usability and result in the PEM being selected more often than the original. We feel this finding supports the involvement of the user, application of design principles, and the assistance of a graphic designer in the development of PEMs.

Developing software to "track and catch" missed follow-up of abnormal test results in a complex sociotechnical environment.

PubMed

Smith, M; Murphy, D; Laxmisan, A; Sittig, D; Reis, B; Esquivel, A; Singh, H

2013-01-01

Abnormal test results do not always receive timely follow-up, even when providers are notified through electronic health record (EHR)-based alerts. High workload, alert fatigue, and other demands on attention disrupt a provider's prospective memory for tasks required to initiate follow-up. Thus, EHR-based tracking and reminding functionalities are needed to improve follow-up. The purpose of this study was to develop a decision-support software prototype enabling individual and system-wide tracking of abnormal test result alerts lacking follow-up, and to conduct formative evaluations, including usability testing. We developed a working prototype software system, the Alert Watch And Response Engine (AWARE), to detect abnormal test result alerts lacking documented follow-up, and to present context-specific reminders to providers. Development and testing took place within the VA's EHR and focused on four cancer-related abnormal test results. Design concepts emphasized mitigating the effects of high workload and alert fatigue while being minimally intrusive. We conducted a multifaceted formative evaluation of the software, addressing fit within the larger socio-technical system. Evaluations included usability testing with the prototype and interview questions about organizational and workflow factors. Participants included 23 physicians, 9 clinical information technology specialists, and 8 quality/safety managers. Evaluation results indicated that our software prototype fit within the technical environment and clinical workflow, and physicians were able to use it successfully. Quality/safety managers reported that the tool would be useful in future quality assurance activities to detect patients who lack documented follow-up. Additionally, we successfully installed the software on the local facility's "test" EHR system, thus demonstrating technical compatibility. To address the factors involved in missed test results, we developed a software prototype to account for technical, usability, organizational, and workflow needs. Our evaluation has shown the feasibility of the prototype as a means of facilitating better follow-up for cancer-related abnormal test results.

A Self-Regulation Theory–Based Asthma Management Mobile App for Adolescents: A Usability Assessment

PubMed Central

2017-01-01

Background Self-regulation theory suggests people learn to influence their own behavior through self-monitoring, goal-setting, feedback, self-reward, and self-instruction, all of which smartphones are now capable of facilitating. Several mobile apps exist to manage asthma; however, little evidence exists about whether these apps employ user-centered design processes that adhere to government usability guidelines for mobile apps. Objective Building upon a previous study that documented adolescent preferences for an asthma self-management app, we employed a user-centered approach to assess the usability of a high-fidelity wireframe for an asthma self-management app intended for use by adolescents with persistent asthma. Methods Individual interviews were conducted with adolescents (ages 11-18 years) with persistent asthma who owned a smartphone (N=8). Adolescents were asked to evaluate a PDF app wireframe consisting of 76 screen shots displaying app features, including log in and home screen, profile setup, settings and info, self-management features, and graphical displays for charting asthma control and medication. Preferences, comments, and suggestions for each set of screen shots were assessed using the audio-recorded interviews. Two coders reached consensus on adolescent evaluations of the following aspects of app features: (1) usability, (2) behavioral intentions to use, (3) confusing aspects, and (4) suggestions for improvement. Results The app wireframe was generally well received, and several suggestions for improvement were recorded. Suggestions included increased customization of charts and notifications, reminders, and alerts. Participants preferred longitudinal data about asthma control and medication use to be displayed using line graphs. All participants reported that they would find an asthma management app like the one depicted in the wireframe useful for managing their asthma. Conclusions Early stage usability tests guided by government usability guidelines (usability.gov) revealed areas for improvement for an asthma self-management app for adolescents. Addressing these areas will be critical to developing an engaging and effective asthma self-management app that is capable of improving adolescent asthma outcomes. PMID:28148471

A Smartphone App to Promote an Active Lifestyle in Lower-Educated Working Young Adults: Development, Usability, Acceptability, and Feasibility Study

PubMed Central

De Bourdeaudhuij, Ilse; Clarys, Peter; De Cocker, Katrien; Vandelanotte, Corneel; Deforche, Benedicte

2018-01-01

Background Physical activity (PA) levels are problematic in lower-educated working young adults (18-26 years). To promote PA, smartphone apps have great potential, but there is no evidence for their effectiveness in this population. To increase the likelihood that a newly developed app will be effective, formative research and user testing are required. Objective The aim of this study was to describe the development, usability, acceptability, and feasibility of a new theory- and evidence-based smartphone app to promote an active lifestyle in lower-educated working young adults. Methods The new app was developed by applying 4 steps. First, determinants important to promote an active lifestyle in this population were selected. Second, evidence-based behavior change techniques were selected to convert the determinants into practical applications. Third, a new smartphone app was developed. Fourth, volunteers (n=11, both lower and higher educated) tested the app on usability, and lower-educated working young adults (n=16) tested its acceptability and feasibility via (think aloud) interviews, a questionnaire, and Google Analytics. The app was accordingly adapted for the final version. Results A new Android app, Active Coach, was developed that focused on knowledge, attitude, social support, and self-efficacy (based on outcomes from step 1), and that applied self-regulation techniques (based on outcomes from step 2). The app consists of a 9-week program with personal goals, practical tips, and scientific facts to encourage an active lifestyle. To ensure all-day and automatic self-monitoring of the activity behavior, the Active Coach app works in combination with a wearable activity tracker, the Fitbit Charge. Issues detected by the usability test (eg, text errors, wrong messages) were all fixed. The acceptability and feasibility test showed that participants found the app clear, understandable, and motivating, although some aspects needed to be more personal. Conclusions By applying a stepwise, user-centered approach that regularly consulted the target group, the new app is adapted to their specific needs and preferences. The Active Coach app was overall positively evaluated by the lower-educated working young adults at the end of the development process. PMID:29463491

Usability testing of existing type 2 diabetes mellitus websites.

PubMed

Davis, Dorian; Jiang, Steven

2016-08-01

Given the significant increase in the use of the internet as an educational tool for diabetes, very little research has been published on the usability of healthcare websites, even though it is a determining factor for user satisfaction. The aim of this study is to evaluate and critique the interfaces of existing diabetes websites for usability concerns and provide design solutions for improvement. Emphasis is placed on Type 2 Diabetes Mellitus since it is the most common and life threatening form of diabetes. A usability test was performed on the interfaces of three existing diabetes websites, American Diabetes Association (www.diabetes.org), WebMD (www.webmd.com) and the National Diabetes Education Program (ndep.nih.gov). The goal was to collect qualitative and quantitative data to determine: (1) if participants are able to complete specified tasks successfully; (2) the length of time it takes participants to complete the specified tasks and; (3) participants' satisfaction with the three websites. Twenty adults, 18 years of age and older participated in the study. The results from the MANOVA test revealed a significant difference between the three websites for number of clicks, number of errors and completion time when analyzed simultaneously. The ANOVA tests revealed a significant difference for all three variables. The Student-Newman-Keuls (SNK) test shows a significant difference for completion time between American Diabetes Association and WebMD. A significant difference was found for the number of clicks for the National Diabetes Education Program compared to the American Diabetes Association and WebMD. However, no significant difference was found for the number of clicks between American Diabetes Association and WebMD. Lastly, a significant difference was found between each interface for number of errors. Although, the American Diabetes Association web-interface was most favorable, there were many positive design elements for each interface. On the other hand, the significant amount of information overload experienced for each website left participants feeling perplexed. Thus, innovative solutions are needed to reduce information overload and ensure users are engaged and empowered to make informed decisions about their healthcare. Copyright © 2016 Elsevier Ireland Ltd. All rights reserved.

Designing and evaluating an interprofessional shared decision-making and goal-setting decision aid for patients with diabetes in clinical care--systematic decision aid development and study protocol.

PubMed

Yu, Catherine H; Stacey, Dawn; Sale, Joanna; Hall, Susan; Kaplan, David M; Ivers, Noah; Rezmovitz, Jeremy; Leung, Fok-Han; Shah, Baiju R; Straus, Sharon E

2014-01-22

Care of patients with diabetes often occurs in the context of other chronic illness. Competing disease priorities and competing patient-physician priorities present challenges in the provision of care for the complex patient. Guideline implementation interventions to date do not acknowledge these intricacies of clinical practice. As a result, patients and providers are left overwhelmed and paralyzed by the sheer volume of recommendations and tasks. An individualized approach to the patient with diabetes and multiple comorbid conditions using shared decision-making (SDM) and goal setting has been advocated as a patient-centred approach that may facilitate prioritization of treatment options. Furthermore, incorporating interprofessional integration into practice may overcome barriers to implementation. However, these strategies have not been taken up extensively in clinical practice. To systematically develop and test an interprofessional SDM and goal-setting toolkit for patients with diabetes and other chronic diseases, following the Knowledge to Action framework. 1. Feasibility study: Individual interviews with primary care physicians, nurses, dietitians, pharmacists, and patients with diabetes will be conducted, exploring their experiences with shared decision-making and priority-setting, including facilitators and barriers, the relevance of a decision aid and toolkit for priority-setting, and how best to integrate it into practice.2. Toolkit development: Based on this data, an evidence-based multi-component SDM toolkit will be developed. The toolkit will be reviewed by content experts (primary care, endocrinology, geriatricians, nurses, dietitians, pharmacists, patients) for accuracy and comprehensiveness.3. Heuristic evaluation: A human factors engineer will review the toolkit and identify, list and categorize usability issues by severity.4. Usability testing: This will be done using cognitive task analysis.5. Iterative refinement: Throughout the development process, the toolkit will be refined through several iterative cycles of feedback and redesign. Interprofessional shared decision-making regarding priority-setting with the use of a decision aid toolkit may help prioritize care of individuals with multiple comorbid conditions. Adhering to principles of user-centered design, we will develop and refine a toolkit to assess the feasibility of this approach.

Designing and evaluating an interprofessional shared decision-making and goal-setting decision aid for patients with diabetes in clinical care - systematic decision aid development and study protocol

PubMed Central

2014-01-01

Background Care of patients with diabetes often occurs in the context of other chronic illness. Competing disease priorities and competing patient-physician priorities present challenges in the provision of care for the complex patient. Guideline implementation interventions to date do not acknowledge these intricacies of clinical practice. As a result, patients and providers are left overwhelmed and paralyzed by the sheer volume of recommendations and tasks. An individualized approach to the patient with diabetes and multiple comorbid conditions using shared decision-making (SDM) and goal setting has been advocated as a patient-centred approach that may facilitate prioritization of treatment options. Furthermore, incorporating interprofessional integration into practice may overcome barriers to implementation. However, these strategies have not been taken up extensively in clinical practice. Objectives To systematically develop and test an interprofessional SDM and goal-setting toolkit for patients with diabetes and other chronic diseases, following the Knowledge to Action framework. Methods 1. Feasibility study: Individual interviews with primary care physicians, nurses, dietitians, pharmacists, and patients with diabetes will be conducted, exploring their experiences with shared decision-making and priority-setting, including facilitators and barriers, the relevance of a decision aid and toolkit for priority-setting, and how best to integrate it into practice. 2. Toolkit development: Based on this data, an evidence-based multi-component SDM toolkit will be developed. The toolkit will be reviewed by content experts (primary care, endocrinology, geriatricians, nurses, dietitians, pharmacists, patients) for accuracy and comprehensiveness. 3. Heuristic evaluation: A human factors engineer will review the toolkit and identify, list and categorize usability issues by severity. 4. Usability testing: This will be done using cognitive task analysis. 5. Iterative refinement: Throughout the development process, the toolkit will be refined through several iterative cycles of feedback and redesign. Discussion Interprofessional shared decision-making regarding priority-setting with the use of a decision aid toolkit may help prioritize care of individuals with multiple comorbid conditions. Adhering to principles of user-centered design, we will develop and refine a toolkit to assess the feasibility of this approach. PMID:24450385

Low Latency Estimation of Motor Intentions to Assist Reaching Movements along Multiple Sessions in Chronic Stroke Patients: A Feasibility Study.

PubMed

Ibáñez, Jaime; Monge-Pereira, Esther; Molina-Rueda, Francisco; Serrano, J I; Del Castillo, Maria D; Cuesta-Gómez, Alicia; Carratalá-Tejada, María; Cano-de-la-Cuerda, Roberto; Alguacil-Diego, Isabel M; Miangolarra-Page, Juan C; Pons, Jose L

2017-01-01

Background: The association between motor-related cortical activity and peripheral stimulation with temporal precision has been proposed as a possible intervention to facilitate cortico-muscular pathways and thereby improve motor rehabilitation after stroke. Previous studies with patients have provided evidence of the possibility to implement brain-machine interface platforms able to decode motor intentions and use this information to trigger afferent stimulation and movement assistance. This study tests the use a low-latency movement intention detector to drive functional electrical stimulation assisting upper-limb reaching movements of patients with stroke. Methods: An eight-sessions intervention on the paretic arm was tested on four chronic stroke patients along 1 month. Patients' intentions to initiate reaching movements were decoded from electroencephalographic signals and used to trigger functional electrical stimulation that in turn assisted patients to do the task. The analysis of the patients' ability to interact with the intervention platform, the assessment of changes in patients' clinical scales and of the system usability and the kinematic analysis of the reaching movements before and after the intervention period were carried to study the potential impact of the intervention. Results: On average 66.3 ± 15.7% of trials (resting intervals followed by self-initiated movements) were correctly classified with the decoder of motor intentions. The average detection latency (with respect to the movement onsets estimated with gyroscopes) was 112 ± 278 ms. The Fügl-Meyer index upper extremity increased 11.5 ± 5.5 points with the intervention. The stroke impact scale also increased. In line with changes in clinical scales, kinematics of reaching movements showed a trend toward lower compensatory mechanisms. Patients' assessment of the therapy reflected their acceptance of the proposed intervention protocol. Conclusions: According to results obtained here with a small sample of patients, Brain-Machine Interfaces providing low-latency support to upper-limb reaching movements in patients with stroke are a reliable and usable solution for motor rehabilitation interventions with potential functional benefits.

Low Latency Estimation of Motor Intentions to Assist Reaching Movements along Multiple Sessions in Chronic Stroke Patients: A Feasibility Study

PubMed Central

Ibáñez, Jaime; Monge-Pereira, Esther; Molina-Rueda, Francisco; Serrano, J. I.; del Castillo, Maria D.; Cuesta-Gómez, Alicia; Carratalá-Tejada, María; Cano-de-la-Cuerda, Roberto; Alguacil-Diego, Isabel M.; Miangolarra-Page, Juan C.; Pons, Jose L.

2017-01-01

Background: The association between motor-related cortical activity and peripheral stimulation with temporal precision has been proposed as a possible intervention to facilitate cortico-muscular pathways and thereby improve motor rehabilitation after stroke. Previous studies with patients have provided evidence of the possibility to implement brain-machine interface platforms able to decode motor intentions and use this information to trigger afferent stimulation and movement assistance. This study tests the use a low-latency movement intention detector to drive functional electrical stimulation assisting upper-limb reaching movements of patients with stroke. Methods: An eight-sessions intervention on the paretic arm was tested on four chronic stroke patients along 1 month. Patients' intentions to initiate reaching movements were decoded from electroencephalographic signals and used to trigger functional electrical stimulation that in turn assisted patients to do the task. The analysis of the patients' ability to interact with the intervention platform, the assessment of changes in patients' clinical scales and of the system usability and the kinematic analysis of the reaching movements before and after the intervention period were carried to study the potential impact of the intervention. Results: On average 66.3 ± 15.7% of trials (resting intervals followed by self-initiated movements) were correctly classified with the decoder of motor intentions. The average detection latency (with respect to the movement onsets estimated with gyroscopes) was 112 ± 278 ms. The Fügl-Meyer index upper extremity increased 11.5 ± 5.5 points with the intervention. The stroke impact scale also increased. In line with changes in clinical scales, kinematics of reaching movements showed a trend toward lower compensatory mechanisms. Patients' assessment of the therapy reflected their acceptance of the proposed intervention protocol. Conclusions: According to results obtained here with a small sample of patients, Brain-Machine Interfaces providing low-latency support to upper-limb reaching movements in patients with stroke are a reliable and usable solution for motor rehabilitation interventions with potential functional benefits. PMID:28367109

Developing Test Score Reports that Work: The Process and Best Practices for Effective Communication

ERIC Educational Resources Information Center

Zenisky, April L.; Hambleton, Ronald K.

2012-01-01

Test scores matter these days. Test-takers want to understand how they performed, and test score reports, particularly those for individual examinees, are the vehicles by which most people get the bulk of this information. Historically, score reports have not always met the examinees' information or usability needs, but this is clearly changing…

Basic Skills Testing & Training. 1996 AMA Survey. Summary of Key Findings.

ERIC Educational Resources Information Center

American Management Association, New York, NY.

The American Management Association's (AMA) 10th annual survey on workplace testing was mailed in January 1996 to a sample of its 9,500 member companies, resulting in 961 usable responses. The survey sought to determine how many firms test for "basic skills," how job applicants perform on these tests, how much the tests costs, and what firms do…

Results of the Intelligence Test for Visually Impaired Children (ITVIC).

ERIC Educational Resources Information Center

Dekker, R.; And Others

1991-01-01

Statistical analyses of scores on subtests of the Intelligence Test for Visually Impaired Children were done for two groups of children, either with or without usable vision. Results suggest that the battery has differential factorial and predictive validity. (Author/DB)

Hydrogen peroxide plasma sterilization of a waterproof, high-definition video camera case for intraoperative imaging in veterinary surgery.

PubMed

Adin, Christopher A; Royal, Kenneth D; Moore, Brandon; Jacob, Megan

2018-06-13

To evaluate the safety and usability of a wearable, waterproof high-definition camera/case for acquisition of surgical images by sterile personnel. An in vitro study to test the efficacy of biodecontamination of camera cases. Usability for intraoperative image acquisition was assessed in clinical procedures. Two waterproof GoPro Hero4 Silver camera cases were inoculated by immersion in media containing Staphylococcus pseudointermedius or Escherichia coli at ≥5.50E+07 colony forming units/mL. Cases were biodecontaminated by manual washing and hydrogen peroxide plasma sterilization. Cultures were obtained by swab and by immersion in enrichment broth before and after each contamination/decontamination cycle (n = 4). The cameras were then applied by a surgeon in clinical procedures by using either a headband or handheld mode and were assessed for usability according to 5 user characteristics. Cultures of all poststerilization swabs were negative. One of 8 cultures was positive in enrichment broth, consistent with a low level of contamination in 1 sample. Usability of the camera was considered poor in headband mode, with limited battery life, inability to control camera functions, and lack of zoom function affecting image quality. Handheld operation of the camera by the primary surgeon improved usability, allowing close-up still and video intraoperative image acquisition. Vaporized hydrogen peroxide sterilization of this camera case was considered effective for biodecontamination. Handheld operation improved usability for intraoperative image acquisition. Vaporized hydrogen peroxide sterilization and thorough manual washing of a waterproof camera may provide cost effective intraoperative image acquisition for documentation purposes. © 2018 The American College of Veterinary Surgeons.

A Concise and Practical Framework for the Development and Usability Evaluation of Patient Information Websites.

PubMed

Peute, L W; Knijnenburg, S L; Kremer, L C; Jaspers, M W M

2015-01-01

The Website Developmental Model for the Healthcare Consumer (WDMHC) is an extensive and successfully evaluated framework that incorporates user-centered design principles. However, due to its extensiveness its application is limited. In the current study we apply a subset of the WDMHC framework in a case study concerning the development and evaluation of a website aimed at childhood cancer survivors (CCS). To assess whether the implementation of a limited subset of the WDMHC-framework is sufficient to deliver a high-quality website with few usability problems, aimed at a specific patient population. The website was developed using a six-step approach divided into three phases derived from the WDMHC: 1) information needs analysis, mock-up creation and focus group discussion; 2) website prototype development; and 3) heuristic evaluation (HE) and think aloud analysis (TA). The HE was performed by three double experts (knowledgeable both in usability engineering and childhood cancer survivorship), who assessed the site using the Nielsen heuristics. Eight end-users were invited to complete three scenarios covering all functionality of the website by TA. The HE and TA were performed concurrently on the website prototype. The HE resulted in 29 unique usability issues; the end-users performing the TA encountered eleven unique problems. Four issues specifically revealed by HE concerned cosmetic design flaws, whereas two problems revealed by TA were related to website content. Based on the subset of the WDMHC framework we were able to deliver a website that closely matched the expectancy of the end-users and resulted in relatively few usability problems during end-user testing. With the successful application of this subset of the WDMHC, we provide developers with a clear and easily applicable framework for the development of healthcare websites with high usability aimed at specific medical populations.

High usability of a smartphone application for reporting symptoms in adults with cystic fibrosis.

PubMed

Wood, Jamie; Jenkins, Sue; Putrino, David; Mulrennan, Siobhain; Morey, Sue; Cecins, Nola; Hill, Kylie

2017-01-01

Introduction In cystic fibrosis, exacerbations impair lung function and health-related quality of life, increase healthcare costs and reduce survival. Delayed reporting of worsening symptoms can result in more severe exacerbations and worse clinical outcomes; therefore there is a need for a novel approach to facilitate the early identification and treatment of exacerbations in this population. This study investigated the usability of a smartphone application to report symptoms in adults with cystic fibrosis, and the observer agreement in clinical decision-making between senior clinicians interpreting smartphone application responses. Methods Adults with cystic fibrosis used the smartphone application weekly for four weeks. The application comprised 10 yes/no questions regarding respiratory symptoms and two regarding emotional well-being. Usability was measured with the System Usability Scale; Observer agreement was tested by providing a cystic fibrosis physician and a nurse practitioner with 45 clinical scenarios. For each scenario the clinicians, who were blinded to each other's responses, were asked to indicate whether or not they would: (i) initiate telephone contact, and/or (ii) request a clinic visit for the individual. Results Ten participants (five female), aged mean (SD) 33 (11) years, FEV1 49 (27)% predicted completed the study. The mean (SD) System Usability Scale score was 94 (6). There was perfect agreement between clinicians for initiating contact with the participant ( κ = 1.0, p < 0.001), and near-perfect for requesting a clinic visit ( κ = 0.86, p < 0.001). Discussion The use of a smartphone application for reporting symptoms in adults with cystic fibrosis has excellent usability and near-perfect agreement between senior clinicians when interpreting the application responses.

Developing Software to “Track and Catch” Missed Follow-up of Abnormal Test Results in a Complex Sociotechnical Environment

PubMed Central

Smith, M.; Murphy, D.; Laxmisan, A.; Sittig, D.; Reis, B.; Esquivel, A.; Singh, H.

2013-01-01

Summary Background Abnormal test results do not always receive timely follow-up, even when providers are notified through electronic health record (EHR)-based alerts. High workload, alert fatigue, and other demands on attention disrupt a provider’s prospective memory for tasks required to initiate follow-up. Thus, EHR-based tracking and reminding functionalities are needed to improve follow-up. Objectives The purpose of this study was to develop a decision-support software prototype enabling individual and system-wide tracking of abnormal test result alerts lacking follow-up, and to conduct formative evaluations, including usability testing. Methods We developed a working prototype software system, the Alert Watch And Response Engine (AWARE), to detect abnormal test result alerts lacking documented follow-up, and to present context-specific reminders to providers. Development and testing took place within the VA’s EHR and focused on four cancer-related abnormal test results. Design concepts emphasized mitigating the effects of high workload and alert fatigue while being minimally intrusive. We conducted a multifaceted formative evaluation of the software, addressing fit within the larger socio-technical system. Evaluations included usability testing with the prototype and interview questions about organizational and workflow factors. Participants included 23 physicians, 9 clinical information technology specialists, and 8 quality/safety managers. Results Evaluation results indicated that our software prototype fit within the technical environment and clinical workflow, and physicians were able to use it successfully. Quality/safety managers reported that the tool would be useful in future quality assurance activities to detect patients who lack documented follow-up. Additionally, we successfully installed the software on the local facility’s “test” EHR system, thus demonstrating technical compatibility. Conclusion To address the factors involved in missed test results, we developed a software prototype to account for technical, usability, organizational, and workflow needs. Our evaluation has shown the feasibility of the prototype as a means of facilitating better follow-up for cancer-related abnormal test results. PMID:24155789

AMOLED (active matrix OLED) functionality and usable lifetime at temperature

NASA Astrophysics Data System (ADS)

Fellowes, David A.; Wood, Michael V.; Prache, Olivier; Jones, Susan

2005-05-01

Active Matrix Organic Light Emitting Diode (AMOLED) displays are known to exhibit high levels of performance, and these levels of performance have continually been improved over time with new materials and electronics design. eMagin Corporation developed a manually adjustable temperature compensation circuit with brightness control to allow for excellent performance over a wide temperature range. Night Vision and Electronic Sensors Directorate (US Army) tested the performance and survivability of a number of AMOLED displays in a temperature chamber over a range from -55°C to +85°C. Although device performance of AMOLEDs has always been its strong suit, the issue of usable display lifetimes for military applications continues to be an area of discussion and research. eMagin has made improvements in OLED materials and worked towards the development of a better understanding of usable lifetime for operation in a military system. NVESD ran luminance degradation tests of AMOLED panels at 50°C and at ambient to characterize the lifetime of AMOLED devices. The result is a better understanding of the applicability of AMOLEDs in military systems: where good fits are made, and where further development is needed.